00:00:00.001 Started by upstream project "autotest-spdk-v24.01-LTS-vs-dpdk-v22.11" build number 980 00:00:00.001 originally caused by: 00:00:00.002 Started by upstream project "nightly-trigger" build number 3647 00:00:00.002 originally caused by: 00:00:00.002 Started by timer 00:00:00.144 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-phy.groovy 00:00:00.144 The recommended git tool is: git 00:00:00.144 using credential 00000000-0000-0000-0000-000000000002 00:00:00.146 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.169 Fetching changes from the remote Git repository 00:00:00.172 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.201 Using shallow fetch with depth 1 00:00:00.201 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.201 > git --version # timeout=10 00:00:00.213 > git --version # 'git version 2.39.2' 00:00:00.213 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.231 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.231 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:05.990 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:06.000 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:06.010 Checking out Revision db4637e8b949f278f369ec13f70585206ccd9507 (FETCH_HEAD) 00:00:06.010 > git config core.sparsecheckout # timeout=10 00:00:06.020 > git read-tree -mu HEAD # timeout=10 00:00:06.034 > git checkout -f db4637e8b949f278f369ec13f70585206ccd9507 # timeout=5 00:00:06.051 Commit message: "jenkins/jjb-config: Add missing SPDK_TEST_NVME_INTERRUPT flag" 00:00:06.051 > git rev-list --no-walk db4637e8b949f278f369ec13f70585206ccd9507 # timeout=10 00:00:06.136 [Pipeline] Start of Pipeline 00:00:06.153 [Pipeline] library 00:00:06.155 Loading library shm_lib@master 00:00:06.155 Library shm_lib@master is cached. Copying from home. 00:00:06.179 [Pipeline] node 00:00:06.187 Running on GP11 in /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:06.193 [Pipeline] { 00:00:06.203 [Pipeline] catchError 00:00:06.204 [Pipeline] { 00:00:06.213 [Pipeline] wrap 00:00:06.219 [Pipeline] { 00:00:06.225 [Pipeline] stage 00:00:06.226 [Pipeline] { (Prologue) 00:00:06.411 [Pipeline] sh 00:00:06.699 + logger -p user.info -t JENKINS-CI 00:00:06.719 [Pipeline] echo 00:00:06.720 Node: GP11 00:00:06.728 [Pipeline] sh 00:00:07.022 [Pipeline] setCustomBuildProperty 00:00:07.033 [Pipeline] echo 00:00:07.035 Cleanup processes 00:00:07.040 [Pipeline] sh 00:00:07.324 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:07.324 928022 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:07.338 [Pipeline] sh 00:00:07.624 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:07.624 ++ grep -v 'sudo pgrep' 00:00:07.624 ++ awk '{print $1}' 00:00:07.624 + sudo kill -9 00:00:07.624 + true 00:00:07.640 [Pipeline] cleanWs 00:00:07.651 [WS-CLEANUP] Deleting project workspace... 00:00:07.651 [WS-CLEANUP] Deferred wipeout is used... 00:00:07.658 [WS-CLEANUP] done 00:00:07.663 [Pipeline] setCustomBuildProperty 00:00:07.679 [Pipeline] sh 00:00:07.967 + sudo git config --global --replace-all safe.directory '*' 00:00:08.088 [Pipeline] httpRequest 00:00:08.593 [Pipeline] echo 00:00:08.595 Sorcerer 10.211.164.20 is alive 00:00:08.605 [Pipeline] retry 00:00:08.607 [Pipeline] { 00:00:08.622 [Pipeline] httpRequest 00:00:08.626 HttpMethod: GET 00:00:08.627 URL: http://10.211.164.20/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:08.628 Sending request to url: http://10.211.164.20/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:08.647 Response Code: HTTP/1.1 200 OK 00:00:08.648 Success: Status code 200 is in the accepted range: 200,404 00:00:08.648 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:14.222 [Pipeline] } 00:00:14.240 [Pipeline] // retry 00:00:14.248 [Pipeline] sh 00:00:14.535 + tar --no-same-owner -xf jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:14.553 [Pipeline] httpRequest 00:00:14.941 [Pipeline] echo 00:00:14.943 Sorcerer 10.211.164.20 is alive 00:00:14.953 [Pipeline] retry 00:00:14.956 [Pipeline] { 00:00:14.970 [Pipeline] httpRequest 00:00:14.975 HttpMethod: GET 00:00:14.975 URL: http://10.211.164.20/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:14.976 Sending request to url: http://10.211.164.20/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:14.980 Response Code: HTTP/1.1 200 OK 00:00:14.980 Success: Status code 200 is in the accepted range: 200,404 00:00:14.980 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:39.131 [Pipeline] } 00:00:39.149 [Pipeline] // retry 00:00:39.157 [Pipeline] sh 00:00:39.444 + tar --no-same-owner -xf spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:42.753 [Pipeline] sh 00:00:43.043 + git -C spdk log --oneline -n5 00:00:43.043 c13c99a5e test: Various fixes for Fedora40 00:00:43.043 726a04d70 test/nvmf: adjust timeout for bigger nvmes 00:00:43.043 61c96acfb dpdk: Point dpdk submodule at a latest fix from spdk-23.11 00:00:43.043 7db6dcdb8 nvme/fio_plugin: update the way ruhs descriptors are fetched 00:00:43.043 ff6f5c41e nvme/fio_plugin: trim add support for multiple ranges 00:00:43.064 [Pipeline] withCredentials 00:00:43.076 > git --version # timeout=10 00:00:43.088 > git --version # 'git version 2.39.2' 00:00:43.108 Masking supported pattern matches of $GIT_PASSWORD or $GIT_ASKPASS 00:00:43.110 [Pipeline] { 00:00:43.121 [Pipeline] retry 00:00:43.123 [Pipeline] { 00:00:43.139 [Pipeline] sh 00:00:43.424 + git ls-remote http://dpdk.org/git/dpdk-stable v22.11.4 00:00:43.698 [Pipeline] } 00:00:43.717 [Pipeline] // retry 00:00:43.723 [Pipeline] } 00:00:43.740 [Pipeline] // withCredentials 00:00:43.751 [Pipeline] httpRequest 00:00:44.149 [Pipeline] echo 00:00:44.152 Sorcerer 10.211.164.20 is alive 00:00:44.162 [Pipeline] retry 00:00:44.164 [Pipeline] { 00:00:44.179 [Pipeline] httpRequest 00:00:44.184 HttpMethod: GET 00:00:44.184 URL: http://10.211.164.20/packages/dpdk_fee0f13c213d0584f0c42a51d0e0625d99a0b2f1.tar.gz 00:00:44.185 Sending request to url: http://10.211.164.20/packages/dpdk_fee0f13c213d0584f0c42a51d0e0625d99a0b2f1.tar.gz 00:00:44.199 Response Code: HTTP/1.1 200 OK 00:00:44.199 Success: Status code 200 is in the accepted range: 200,404 00:00:44.200 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk_fee0f13c213d0584f0c42a51d0e0625d99a0b2f1.tar.gz 00:01:12.402 [Pipeline] } 00:01:12.420 [Pipeline] // retry 00:01:12.429 [Pipeline] sh 00:01:12.714 + tar --no-same-owner -xf dpdk_fee0f13c213d0584f0c42a51d0e0625d99a0b2f1.tar.gz 00:01:14.630 [Pipeline] sh 00:01:14.916 + git -C dpdk log --oneline -n5 00:01:14.916 caf0f5d395 version: 22.11.4 00:01:14.916 7d6f1cc05f Revert "net/iavf: fix abnormal disable HW interrupt" 00:01:14.916 dc9c799c7d vhost: fix missing spinlock unlock 00:01:14.916 4307659a90 net/mlx5: fix LACP redirection in Rx domain 00:01:14.916 6ef77f2a5e net/gve: fix RX buffer size alignment 00:01:14.927 [Pipeline] } 00:01:14.941 [Pipeline] // stage 00:01:14.950 [Pipeline] stage 00:01:14.952 [Pipeline] { (Prepare) 00:01:14.972 [Pipeline] writeFile 00:01:14.989 [Pipeline] sh 00:01:15.279 + logger -p user.info -t JENKINS-CI 00:01:15.293 [Pipeline] sh 00:01:15.583 + logger -p user.info -t JENKINS-CI 00:01:15.597 [Pipeline] sh 00:01:15.883 + cat autorun-spdk.conf 00:01:15.883 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:15.883 SPDK_TEST_NVMF=1 00:01:15.883 SPDK_TEST_NVME_CLI=1 00:01:15.883 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:15.883 SPDK_TEST_NVMF_NICS=e810 00:01:15.883 SPDK_TEST_VFIOUSER=1 00:01:15.883 SPDK_RUN_UBSAN=1 00:01:15.883 NET_TYPE=phy 00:01:15.883 SPDK_TEST_NATIVE_DPDK=v22.11.4 00:01:15.883 SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:15.891 RUN_NIGHTLY=1 00:01:15.997 [Pipeline] readFile 00:01:16.026 [Pipeline] withEnv 00:01:16.029 [Pipeline] { 00:01:16.042 [Pipeline] sh 00:01:16.328 + set -ex 00:01:16.328 + [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf ]] 00:01:16.328 + source /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:16.328 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:16.328 ++ SPDK_TEST_NVMF=1 00:01:16.328 ++ SPDK_TEST_NVME_CLI=1 00:01:16.328 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:16.328 ++ SPDK_TEST_NVMF_NICS=e810 00:01:16.328 ++ SPDK_TEST_VFIOUSER=1 00:01:16.328 ++ SPDK_RUN_UBSAN=1 00:01:16.328 ++ NET_TYPE=phy 00:01:16.328 ++ SPDK_TEST_NATIVE_DPDK=v22.11.4 00:01:16.328 ++ SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:16.328 ++ RUN_NIGHTLY=1 00:01:16.328 + case $SPDK_TEST_NVMF_NICS in 00:01:16.328 + DRIVERS=ice 00:01:16.328 + [[ tcp == \r\d\m\a ]] 00:01:16.328 + [[ -n ice ]] 00:01:16.328 + sudo rmmod mlx4_ib mlx5_ib irdma i40iw iw_cxgb4 00:01:16.328 rmmod: ERROR: Module mlx4_ib is not currently loaded 00:01:16.328 rmmod: ERROR: Module mlx5_ib is not currently loaded 00:01:16.328 rmmod: ERROR: Module irdma is not currently loaded 00:01:16.328 rmmod: ERROR: Module i40iw is not currently loaded 00:01:16.328 rmmod: ERROR: Module iw_cxgb4 is not currently loaded 00:01:16.328 + true 00:01:16.328 + for D in $DRIVERS 00:01:16.328 + sudo modprobe ice 00:01:16.328 + exit 0 00:01:16.338 [Pipeline] } 00:01:16.353 [Pipeline] // withEnv 00:01:16.358 [Pipeline] } 00:01:16.372 [Pipeline] // stage 00:01:16.382 [Pipeline] catchError 00:01:16.384 [Pipeline] { 00:01:16.398 [Pipeline] timeout 00:01:16.398 Timeout set to expire in 1 hr 0 min 00:01:16.401 [Pipeline] { 00:01:16.415 [Pipeline] stage 00:01:16.417 [Pipeline] { (Tests) 00:01:16.431 [Pipeline] sh 00:01:16.717 + jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:16.717 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:16.717 + DIR_ROOT=/var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:16.717 + [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest ]] 00:01:16.717 + DIR_SPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:16.717 + DIR_OUTPUT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:16.717 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk ]] 00:01:16.717 + [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:16.717 + mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:16.717 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:16.717 + [[ nvmf-tcp-phy-autotest == pkgdep-* ]] 00:01:16.717 + cd /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:16.717 + source /etc/os-release 00:01:16.717 ++ NAME='Fedora Linux' 00:01:16.717 ++ VERSION='39 (Cloud Edition)' 00:01:16.717 ++ ID=fedora 00:01:16.717 ++ VERSION_ID=39 00:01:16.717 ++ VERSION_CODENAME= 00:01:16.717 ++ PLATFORM_ID=platform:f39 00:01:16.717 ++ PRETTY_NAME='Fedora Linux 39 (Cloud Edition)' 00:01:16.717 ++ ANSI_COLOR='0;38;2;60;110;180' 00:01:16.717 ++ LOGO=fedora-logo-icon 00:01:16.717 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:39 00:01:16.717 ++ HOME_URL=https://fedoraproject.org/ 00:01:16.717 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f39/system-administrators-guide/ 00:01:16.717 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:01:16.718 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:01:16.718 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:01:16.718 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=39 00:01:16.718 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:01:16.718 ++ REDHAT_SUPPORT_PRODUCT_VERSION=39 00:01:16.718 ++ SUPPORT_END=2024-11-12 00:01:16.718 ++ VARIANT='Cloud Edition' 00:01:16.718 ++ VARIANT_ID=cloud 00:01:16.718 + uname -a 00:01:16.718 Linux spdk-gp-11 6.8.9-200.fc39.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Jul 24 03:04:40 UTC 2024 x86_64 GNU/Linux 00:01:16.718 + sudo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:01:17.654 Hugepages 00:01:17.654 node hugesize free / total 00:01:17.654 node0 1048576kB 0 / 0 00:01:17.654 node0 2048kB 0 / 0 00:01:17.654 node1 1048576kB 0 / 0 00:01:17.654 node1 2048kB 0 / 0 00:01:17.654 00:01:17.654 Type BDF Vendor Device NUMA Driver Device Block devices 00:01:17.654 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:01:17.654 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:01:17.654 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:01:17.654 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:01:17.654 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:01:17.654 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:01:17.654 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:01:17.654 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:01:17.654 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:01:17.654 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:01:17.654 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:01:17.654 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:01:17.654 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:01:17.654 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:01:17.654 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:01:17.654 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:01:17.914 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:01:17.914 + rm -f /tmp/spdk-ld-path 00:01:17.914 + source autorun-spdk.conf 00:01:17.914 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:17.914 ++ SPDK_TEST_NVMF=1 00:01:17.914 ++ SPDK_TEST_NVME_CLI=1 00:01:17.914 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:17.914 ++ SPDK_TEST_NVMF_NICS=e810 00:01:17.914 ++ SPDK_TEST_VFIOUSER=1 00:01:17.914 ++ SPDK_RUN_UBSAN=1 00:01:17.914 ++ NET_TYPE=phy 00:01:17.914 ++ SPDK_TEST_NATIVE_DPDK=v22.11.4 00:01:17.914 ++ SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:17.914 ++ RUN_NIGHTLY=1 00:01:17.914 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:01:17.914 + [[ -n '' ]] 00:01:17.914 + sudo git config --global --add safe.directory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:17.914 + for M in /var/spdk/build-*-manifest.txt 00:01:17.914 + [[ -f /var/spdk/build-kernel-manifest.txt ]] 00:01:17.914 + cp /var/spdk/build-kernel-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:17.914 + for M in /var/spdk/build-*-manifest.txt 00:01:17.914 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:01:17.914 + cp /var/spdk/build-pkg-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:17.914 + for M in /var/spdk/build-*-manifest.txt 00:01:17.914 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:01:17.914 + cp /var/spdk/build-repo-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:17.914 ++ uname 00:01:17.914 + [[ Linux == \L\i\n\u\x ]] 00:01:17.914 + sudo dmesg -T 00:01:17.914 + sudo dmesg --clear 00:01:17.914 + dmesg_pid=928720 00:01:17.914 + [[ Fedora Linux == FreeBSD ]] 00:01:17.914 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:17.914 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:17.914 + sudo dmesg -Tw 00:01:17.914 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:01:17.914 + [[ -x /usr/src/fio-static/fio ]] 00:01:17.914 + export FIO_BIN=/usr/src/fio-static/fio 00:01:17.914 + FIO_BIN=/usr/src/fio-static/fio 00:01:17.914 + [[ '' == \/\v\a\r\/\j\e\n\k\i\n\s\/\w\o\r\k\s\p\a\c\e\/\n\v\m\f\-\t\c\p\-\p\h\y\-\a\u\t\o\t\e\s\t\/\q\e\m\u\_\v\f\i\o\/* ]] 00:01:17.914 + [[ ! -v VFIO_QEMU_BIN ]] 00:01:17.914 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:01:17.914 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:17.914 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:17.914 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:01:17.914 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:17.914 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:17.914 + spdk/autorun.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:17.914 Test configuration: 00:01:17.914 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:17.914 SPDK_TEST_NVMF=1 00:01:17.914 SPDK_TEST_NVME_CLI=1 00:01:17.914 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:17.914 SPDK_TEST_NVMF_NICS=e810 00:01:17.914 SPDK_TEST_VFIOUSER=1 00:01:17.914 SPDK_RUN_UBSAN=1 00:01:17.914 NET_TYPE=phy 00:01:17.914 SPDK_TEST_NATIVE_DPDK=v22.11.4 00:01:17.914 SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:17.914 RUN_NIGHTLY=1 01:02:26 -- common/autotest_common.sh@1689 -- $ [[ n == y ]] 00:01:17.914 01:02:26 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:01:17.914 01:02:26 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:01:17.914 01:02:26 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:01:17.914 01:02:26 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:01:17.914 01:02:26 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:17.914 01:02:26 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:17.914 01:02:26 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:17.914 01:02:26 -- paths/export.sh@5 -- $ export PATH 00:01:17.914 01:02:26 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:17.914 01:02:26 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:01:17.914 01:02:26 -- common/autobuild_common.sh@440 -- $ date +%s 00:01:17.914 01:02:26 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1732060946.XXXXXX 00:01:17.914 01:02:26 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1732060946.6bK6BM 00:01:17.914 01:02:26 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:01:17.914 01:02:26 -- common/autobuild_common.sh@446 -- $ '[' -n v22.11.4 ']' 00:01:17.914 01:02:26 -- common/autobuild_common.sh@447 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:17.914 01:02:26 -- common/autobuild_common.sh@447 -- $ scanbuild_exclude=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk' 00:01:17.915 01:02:26 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:01:17.915 01:02:26 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:01:17.915 01:02:26 -- common/autobuild_common.sh@456 -- $ get_config_params 00:01:17.915 01:02:26 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:01:17.915 01:02:26 -- common/autotest_common.sh@10 -- $ set +x 00:01:17.915 01:02:26 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build' 00:01:17.915 01:02:26 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:01:17.915 01:02:26 -- spdk/autobuild.sh@12 -- $ umask 022 00:01:17.915 01:02:26 -- spdk/autobuild.sh@13 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:17.915 01:02:26 -- spdk/autobuild.sh@16 -- $ date -u 00:01:17.915 Wed Nov 20 12:02:26 AM UTC 2024 00:01:17.915 01:02:26 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:01:17.915 LTS-67-gc13c99a5e 00:01:17.915 01:02:26 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:01:17.915 01:02:26 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:01:17.915 01:02:26 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:01:17.915 01:02:26 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:17.915 01:02:26 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:17.915 01:02:26 -- common/autotest_common.sh@10 -- $ set +x 00:01:17.915 ************************************ 00:01:17.915 START TEST ubsan 00:01:17.915 ************************************ 00:01:17.915 01:02:26 -- common/autotest_common.sh@1114 -- $ echo 'using ubsan' 00:01:17.915 using ubsan 00:01:17.915 00:01:17.915 real 0m0.000s 00:01:17.915 user 0m0.000s 00:01:17.915 sys 0m0.000s 00:01:17.915 01:02:26 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:01:17.915 01:02:26 -- common/autotest_common.sh@10 -- $ set +x 00:01:17.915 ************************************ 00:01:17.915 END TEST ubsan 00:01:17.915 ************************************ 00:01:17.915 01:02:26 -- spdk/autobuild.sh@27 -- $ '[' -n v22.11.4 ']' 00:01:17.915 01:02:26 -- spdk/autobuild.sh@28 -- $ build_native_dpdk 00:01:17.915 01:02:26 -- common/autobuild_common.sh@432 -- $ run_test build_native_dpdk _build_native_dpdk 00:01:17.915 01:02:26 -- common/autotest_common.sh@1087 -- $ '[' 2 -le 1 ']' 00:01:17.915 01:02:26 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:17.915 01:02:26 -- common/autotest_common.sh@10 -- $ set +x 00:01:17.915 ************************************ 00:01:17.915 START TEST build_native_dpdk 00:01:17.915 ************************************ 00:01:17.915 01:02:26 -- common/autotest_common.sh@1114 -- $ _build_native_dpdk 00:01:17.915 01:02:26 -- common/autobuild_common.sh@48 -- $ local external_dpdk_dir 00:01:17.915 01:02:26 -- common/autobuild_common.sh@49 -- $ local external_dpdk_base_dir 00:01:17.915 01:02:26 -- common/autobuild_common.sh@50 -- $ local compiler_version 00:01:17.915 01:02:26 -- common/autobuild_common.sh@51 -- $ local compiler 00:01:17.915 01:02:26 -- common/autobuild_common.sh@52 -- $ local dpdk_kmods 00:01:17.915 01:02:26 -- common/autobuild_common.sh@53 -- $ local repo=dpdk 00:01:17.915 01:02:26 -- common/autobuild_common.sh@55 -- $ compiler=gcc 00:01:17.915 01:02:26 -- common/autobuild_common.sh@61 -- $ export CC=gcc 00:01:17.915 01:02:26 -- common/autobuild_common.sh@61 -- $ CC=gcc 00:01:17.915 01:02:26 -- common/autobuild_common.sh@63 -- $ [[ gcc != *clang* ]] 00:01:17.915 01:02:26 -- common/autobuild_common.sh@63 -- $ [[ gcc != *gcc* ]] 00:01:17.915 01:02:26 -- common/autobuild_common.sh@68 -- $ gcc -dumpversion 00:01:17.915 01:02:26 -- common/autobuild_common.sh@68 -- $ compiler_version=13 00:01:17.915 01:02:26 -- common/autobuild_common.sh@69 -- $ compiler_version=13 00:01:17.915 01:02:26 -- common/autobuild_common.sh@70 -- $ external_dpdk_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:17.915 01:02:26 -- common/autobuild_common.sh@71 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:17.915 01:02:26 -- common/autobuild_common.sh@71 -- $ external_dpdk_base_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:01:17.915 01:02:26 -- common/autobuild_common.sh@73 -- $ [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk ]] 00:01:17.915 01:02:26 -- common/autobuild_common.sh@82 -- $ orgdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:17.915 01:02:26 -- common/autobuild_common.sh@83 -- $ git -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk log --oneline -n 5 00:01:17.915 caf0f5d395 version: 22.11.4 00:01:17.915 7d6f1cc05f Revert "net/iavf: fix abnormal disable HW interrupt" 00:01:17.915 dc9c799c7d vhost: fix missing spinlock unlock 00:01:17.915 4307659a90 net/mlx5: fix LACP redirection in Rx domain 00:01:17.915 6ef77f2a5e net/gve: fix RX buffer size alignment 00:01:17.915 01:02:26 -- common/autobuild_common.sh@85 -- $ dpdk_cflags='-fPIC -g -fcommon' 00:01:17.915 01:02:26 -- common/autobuild_common.sh@86 -- $ dpdk_ldflags= 00:01:17.915 01:02:26 -- common/autobuild_common.sh@87 -- $ dpdk_ver=22.11.4 00:01:17.915 01:02:26 -- common/autobuild_common.sh@89 -- $ [[ gcc == *gcc* ]] 00:01:17.915 01:02:26 -- common/autobuild_common.sh@89 -- $ [[ 13 -ge 5 ]] 00:01:17.915 01:02:26 -- common/autobuild_common.sh@90 -- $ dpdk_cflags+=' -Werror' 00:01:17.915 01:02:26 -- common/autobuild_common.sh@93 -- $ [[ gcc == *gcc* ]] 00:01:17.915 01:02:26 -- common/autobuild_common.sh@93 -- $ [[ 13 -ge 10 ]] 00:01:17.915 01:02:26 -- common/autobuild_common.sh@94 -- $ dpdk_cflags+=' -Wno-stringop-overflow' 00:01:17.915 01:02:26 -- common/autobuild_common.sh@100 -- $ DPDK_DRIVERS=("bus" "bus/pci" "bus/vdev" "mempool/ring" "net/i40e" "net/i40e/base") 00:01:17.915 01:02:26 -- common/autobuild_common.sh@102 -- $ local mlx5_libs_added=n 00:01:17.915 01:02:26 -- common/autobuild_common.sh@103 -- $ [[ 0 -eq 1 ]] 00:01:17.915 01:02:26 -- common/autobuild_common.sh@103 -- $ [[ 0 -eq 1 ]] 00:01:17.915 01:02:26 -- common/autobuild_common.sh@139 -- $ [[ 0 -eq 1 ]] 00:01:17.915 01:02:26 -- common/autobuild_common.sh@167 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:01:17.915 01:02:26 -- common/autobuild_common.sh@168 -- $ uname -s 00:01:17.915 01:02:26 -- common/autobuild_common.sh@168 -- $ '[' Linux = Linux ']' 00:01:17.915 01:02:26 -- common/autobuild_common.sh@169 -- $ lt 22.11.4 21.11.0 00:01:17.915 01:02:26 -- scripts/common.sh@372 -- $ cmp_versions 22.11.4 '<' 21.11.0 00:01:17.915 01:02:26 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:01:17.915 01:02:26 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:01:17.915 01:02:26 -- scripts/common.sh@335 -- $ IFS=.-: 00:01:17.915 01:02:26 -- scripts/common.sh@335 -- $ read -ra ver1 00:01:17.915 01:02:26 -- scripts/common.sh@336 -- $ IFS=.-: 00:01:17.915 01:02:26 -- scripts/common.sh@336 -- $ read -ra ver2 00:01:17.915 01:02:26 -- scripts/common.sh@337 -- $ local 'op=<' 00:01:17.915 01:02:26 -- scripts/common.sh@339 -- $ ver1_l=3 00:01:17.915 01:02:26 -- scripts/common.sh@340 -- $ ver2_l=3 00:01:17.915 01:02:26 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:01:17.915 01:02:26 -- scripts/common.sh@343 -- $ case "$op" in 00:01:17.915 01:02:26 -- scripts/common.sh@344 -- $ : 1 00:01:17.915 01:02:26 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:01:17.915 01:02:26 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:01:17.915 01:02:26 -- scripts/common.sh@364 -- $ decimal 22 00:01:17.915 01:02:26 -- scripts/common.sh@352 -- $ local d=22 00:01:17.915 01:02:26 -- scripts/common.sh@353 -- $ [[ 22 =~ ^[0-9]+$ ]] 00:01:17.915 01:02:26 -- scripts/common.sh@354 -- $ echo 22 00:01:17.915 01:02:26 -- scripts/common.sh@364 -- $ ver1[v]=22 00:01:17.915 01:02:26 -- scripts/common.sh@365 -- $ decimal 21 00:01:17.915 01:02:26 -- scripts/common.sh@352 -- $ local d=21 00:01:17.915 01:02:26 -- scripts/common.sh@353 -- $ [[ 21 =~ ^[0-9]+$ ]] 00:01:17.915 01:02:26 -- scripts/common.sh@354 -- $ echo 21 00:01:17.915 01:02:26 -- scripts/common.sh@365 -- $ ver2[v]=21 00:01:17.915 01:02:26 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:01:17.915 01:02:26 -- scripts/common.sh@366 -- $ return 1 00:01:17.915 01:02:26 -- common/autobuild_common.sh@173 -- $ patch -p1 00:01:17.915 patching file config/rte_config.h 00:01:17.915 Hunk #1 succeeded at 60 (offset 1 line). 00:01:17.915 01:02:26 -- common/autobuild_common.sh@176 -- $ lt 22.11.4 24.07.0 00:01:17.915 01:02:26 -- scripts/common.sh@372 -- $ cmp_versions 22.11.4 '<' 24.07.0 00:01:17.915 01:02:26 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:01:17.915 01:02:26 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:01:17.915 01:02:26 -- scripts/common.sh@335 -- $ IFS=.-: 00:01:17.915 01:02:26 -- scripts/common.sh@335 -- $ read -ra ver1 00:01:17.915 01:02:26 -- scripts/common.sh@336 -- $ IFS=.-: 00:01:17.915 01:02:26 -- scripts/common.sh@336 -- $ read -ra ver2 00:01:17.915 01:02:26 -- scripts/common.sh@337 -- $ local 'op=<' 00:01:17.915 01:02:26 -- scripts/common.sh@339 -- $ ver1_l=3 00:01:17.915 01:02:26 -- scripts/common.sh@340 -- $ ver2_l=3 00:01:17.915 01:02:26 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:01:17.915 01:02:26 -- scripts/common.sh@343 -- $ case "$op" in 00:01:17.915 01:02:26 -- scripts/common.sh@344 -- $ : 1 00:01:17.915 01:02:26 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:01:17.915 01:02:26 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:01:18.174 01:02:26 -- scripts/common.sh@364 -- $ decimal 22 00:01:18.174 01:02:26 -- scripts/common.sh@352 -- $ local d=22 00:01:18.174 01:02:26 -- scripts/common.sh@353 -- $ [[ 22 =~ ^[0-9]+$ ]] 00:01:18.174 01:02:26 -- scripts/common.sh@354 -- $ echo 22 00:01:18.174 01:02:26 -- scripts/common.sh@364 -- $ ver1[v]=22 00:01:18.174 01:02:26 -- scripts/common.sh@365 -- $ decimal 24 00:01:18.174 01:02:26 -- scripts/common.sh@352 -- $ local d=24 00:01:18.174 01:02:26 -- scripts/common.sh@353 -- $ [[ 24 =~ ^[0-9]+$ ]] 00:01:18.174 01:02:26 -- scripts/common.sh@354 -- $ echo 24 00:01:18.174 01:02:26 -- scripts/common.sh@365 -- $ ver2[v]=24 00:01:18.174 01:02:26 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:01:18.174 01:02:26 -- scripts/common.sh@367 -- $ (( ver1[v] < ver2[v] )) 00:01:18.174 01:02:26 -- scripts/common.sh@367 -- $ return 0 00:01:18.174 01:02:26 -- common/autobuild_common.sh@177 -- $ patch -p1 00:01:18.174 patching file lib/pcapng/rte_pcapng.c 00:01:18.174 Hunk #1 succeeded at 110 (offset -18 lines). 00:01:18.174 01:02:26 -- common/autobuild_common.sh@180 -- $ dpdk_kmods=false 00:01:18.174 01:02:26 -- common/autobuild_common.sh@181 -- $ uname -s 00:01:18.174 01:02:26 -- common/autobuild_common.sh@181 -- $ '[' Linux = FreeBSD ']' 00:01:18.174 01:02:26 -- common/autobuild_common.sh@185 -- $ printf %s, bus bus/pci bus/vdev mempool/ring net/i40e net/i40e/base 00:01:18.174 01:02:26 -- common/autobuild_common.sh@185 -- $ meson build-tmp --prefix=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build --libdir lib -Denable_docs=false -Denable_kmods=false -Dtests=false -Dc_link_args= '-Dc_args=-fPIC -g -fcommon -Werror -Wno-stringop-overflow' -Dmachine=native -Denable_drivers=bus,bus/pci,bus/vdev,mempool/ring,net/i40e,net/i40e/base, 00:01:22.460 The Meson build system 00:01:22.460 Version: 1.5.0 00:01:22.460 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:01:22.460 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp 00:01:22.460 Build type: native build 00:01:22.460 Program cat found: YES (/usr/bin/cat) 00:01:22.460 Project name: DPDK 00:01:22.460 Project version: 22.11.4 00:01:22.460 C compiler for the host machine: gcc (gcc 13.3.1 "gcc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:01:22.460 C linker for the host machine: gcc ld.bfd 2.40-14 00:01:22.460 Host machine cpu family: x86_64 00:01:22.460 Host machine cpu: x86_64 00:01:22.460 Message: ## Building in Developer Mode ## 00:01:22.460 Program pkg-config found: YES (/usr/bin/pkg-config) 00:01:22.460 Program check-symbols.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/buildtools/check-symbols.sh) 00:01:22.460 Program options-ibverbs-static.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/buildtools/options-ibverbs-static.sh) 00:01:22.460 Program objdump found: YES (/usr/bin/objdump) 00:01:22.460 Program python3 found: YES (/usr/bin/python3) 00:01:22.460 Program cat found: YES (/usr/bin/cat) 00:01:22.460 config/meson.build:83: WARNING: The "machine" option is deprecated. Please use "cpu_instruction_set" instead. 00:01:22.460 Checking for size of "void *" : 8 00:01:22.460 Checking for size of "void *" : 8 (cached) 00:01:22.460 Library m found: YES 00:01:22.460 Library numa found: YES 00:01:22.460 Has header "numaif.h" : YES 00:01:22.460 Library fdt found: NO 00:01:22.460 Library execinfo found: NO 00:01:22.460 Has header "execinfo.h" : YES 00:01:22.460 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:01:22.460 Run-time dependency libarchive found: NO (tried pkgconfig) 00:01:22.460 Run-time dependency libbsd found: NO (tried pkgconfig) 00:01:22.460 Run-time dependency jansson found: NO (tried pkgconfig) 00:01:22.460 Run-time dependency openssl found: YES 3.1.1 00:01:22.460 Run-time dependency libpcap found: YES 1.10.4 00:01:22.460 Has header "pcap.h" with dependency libpcap: YES 00:01:22.460 Compiler for C supports arguments -Wcast-qual: YES 00:01:22.460 Compiler for C supports arguments -Wdeprecated: YES 00:01:22.460 Compiler for C supports arguments -Wformat: YES 00:01:22.460 Compiler for C supports arguments -Wformat-nonliteral: NO 00:01:22.460 Compiler for C supports arguments -Wformat-security: NO 00:01:22.460 Compiler for C supports arguments -Wmissing-declarations: YES 00:01:22.460 Compiler for C supports arguments -Wmissing-prototypes: YES 00:01:22.460 Compiler for C supports arguments -Wnested-externs: YES 00:01:22.460 Compiler for C supports arguments -Wold-style-definition: YES 00:01:22.460 Compiler for C supports arguments -Wpointer-arith: YES 00:01:22.460 Compiler for C supports arguments -Wsign-compare: YES 00:01:22.460 Compiler for C supports arguments -Wstrict-prototypes: YES 00:01:22.460 Compiler for C supports arguments -Wundef: YES 00:01:22.460 Compiler for C supports arguments -Wwrite-strings: YES 00:01:22.460 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:01:22.460 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:01:22.460 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:01:22.460 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:01:22.461 Compiler for C supports arguments -mavx512f: YES 00:01:22.461 Checking if "AVX512 checking" compiles: YES 00:01:22.461 Fetching value of define "__SSE4_2__" : 1 00:01:22.461 Fetching value of define "__AES__" : 1 00:01:22.461 Fetching value of define "__AVX__" : 1 00:01:22.461 Fetching value of define "__AVX2__" : (undefined) 00:01:22.461 Fetching value of define "__AVX512BW__" : (undefined) 00:01:22.461 Fetching value of define "__AVX512CD__" : (undefined) 00:01:22.461 Fetching value of define "__AVX512DQ__" : (undefined) 00:01:22.461 Fetching value of define "__AVX512F__" : (undefined) 00:01:22.461 Fetching value of define "__AVX512VL__" : (undefined) 00:01:22.461 Fetching value of define "__PCLMUL__" : 1 00:01:22.461 Fetching value of define "__RDRND__" : 1 00:01:22.461 Fetching value of define "__RDSEED__" : (undefined) 00:01:22.461 Fetching value of define "__VPCLMULQDQ__" : (undefined) 00:01:22.461 Compiler for C supports arguments -Wno-format-truncation: YES 00:01:22.461 Message: lib/kvargs: Defining dependency "kvargs" 00:01:22.461 Message: lib/telemetry: Defining dependency "telemetry" 00:01:22.461 Checking for function "getentropy" : YES 00:01:22.461 Message: lib/eal: Defining dependency "eal" 00:01:22.461 Message: lib/ring: Defining dependency "ring" 00:01:22.461 Message: lib/rcu: Defining dependency "rcu" 00:01:22.461 Message: lib/mempool: Defining dependency "mempool" 00:01:22.461 Message: lib/mbuf: Defining dependency "mbuf" 00:01:22.461 Fetching value of define "__PCLMUL__" : 1 (cached) 00:01:22.461 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:22.461 Compiler for C supports arguments -mpclmul: YES 00:01:22.461 Compiler for C supports arguments -maes: YES 00:01:22.461 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:22.461 Compiler for C supports arguments -mavx512bw: YES 00:01:22.461 Compiler for C supports arguments -mavx512dq: YES 00:01:22.461 Compiler for C supports arguments -mavx512vl: YES 00:01:22.461 Compiler for C supports arguments -mvpclmulqdq: YES 00:01:22.461 Compiler for C supports arguments -mavx2: YES 00:01:22.461 Compiler for C supports arguments -mavx: YES 00:01:22.461 Message: lib/net: Defining dependency "net" 00:01:22.461 Message: lib/meter: Defining dependency "meter" 00:01:22.461 Message: lib/ethdev: Defining dependency "ethdev" 00:01:22.461 Message: lib/pci: Defining dependency "pci" 00:01:22.461 Message: lib/cmdline: Defining dependency "cmdline" 00:01:22.461 Message: lib/metrics: Defining dependency "metrics" 00:01:22.461 Message: lib/hash: Defining dependency "hash" 00:01:22.461 Message: lib/timer: Defining dependency "timer" 00:01:22.461 Fetching value of define "__AVX2__" : (undefined) (cached) 00:01:22.461 Compiler for C supports arguments -mavx2: YES (cached) 00:01:22.461 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:22.461 Fetching value of define "__AVX512VL__" : (undefined) (cached) 00:01:22.461 Fetching value of define "__AVX512CD__" : (undefined) (cached) 00:01:22.461 Fetching value of define "__AVX512BW__" : (undefined) (cached) 00:01:22.461 Compiler for C supports arguments -mavx512f -mavx512vl -mavx512cd -mavx512bw: YES 00:01:22.461 Message: lib/acl: Defining dependency "acl" 00:01:22.461 Message: lib/bbdev: Defining dependency "bbdev" 00:01:22.461 Message: lib/bitratestats: Defining dependency "bitratestats" 00:01:22.461 Run-time dependency libelf found: YES 0.191 00:01:22.461 Message: lib/bpf: Defining dependency "bpf" 00:01:22.461 Message: lib/cfgfile: Defining dependency "cfgfile" 00:01:22.461 Message: lib/compressdev: Defining dependency "compressdev" 00:01:22.461 Message: lib/cryptodev: Defining dependency "cryptodev" 00:01:22.461 Message: lib/distributor: Defining dependency "distributor" 00:01:22.461 Message: lib/efd: Defining dependency "efd" 00:01:22.461 Message: lib/eventdev: Defining dependency "eventdev" 00:01:22.461 Message: lib/gpudev: Defining dependency "gpudev" 00:01:22.461 Message: lib/gro: Defining dependency "gro" 00:01:22.461 Message: lib/gso: Defining dependency "gso" 00:01:22.461 Message: lib/ip_frag: Defining dependency "ip_frag" 00:01:22.461 Message: lib/jobstats: Defining dependency "jobstats" 00:01:22.461 Message: lib/latencystats: Defining dependency "latencystats" 00:01:22.461 Message: lib/lpm: Defining dependency "lpm" 00:01:22.461 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:22.461 Fetching value of define "__AVX512DQ__" : (undefined) (cached) 00:01:22.461 Fetching value of define "__AVX512IFMA__" : (undefined) 00:01:22.461 Compiler for C supports arguments -mavx512f -mavx512dq -mavx512ifma: YES 00:01:22.461 Message: lib/member: Defining dependency "member" 00:01:22.461 Message: lib/pcapng: Defining dependency "pcapng" 00:01:22.461 Compiler for C supports arguments -Wno-cast-qual: YES 00:01:22.461 Message: lib/power: Defining dependency "power" 00:01:22.461 Message: lib/rawdev: Defining dependency "rawdev" 00:01:22.461 Message: lib/regexdev: Defining dependency "regexdev" 00:01:22.461 Message: lib/dmadev: Defining dependency "dmadev" 00:01:22.461 Message: lib/rib: Defining dependency "rib" 00:01:22.461 Message: lib/reorder: Defining dependency "reorder" 00:01:22.461 Message: lib/sched: Defining dependency "sched" 00:01:22.461 Message: lib/security: Defining dependency "security" 00:01:22.461 Message: lib/stack: Defining dependency "stack" 00:01:22.461 Has header "linux/userfaultfd.h" : YES 00:01:22.461 Message: lib/vhost: Defining dependency "vhost" 00:01:22.461 Message: lib/ipsec: Defining dependency "ipsec" 00:01:22.461 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:22.461 Fetching value of define "__AVX512DQ__" : (undefined) (cached) 00:01:22.461 Compiler for C supports arguments -mavx512f -mavx512dq: YES 00:01:22.461 Compiler for C supports arguments -mavx512bw: YES (cached) 00:01:22.461 Message: lib/fib: Defining dependency "fib" 00:01:22.461 Message: lib/port: Defining dependency "port" 00:01:22.461 Message: lib/pdump: Defining dependency "pdump" 00:01:22.461 Message: lib/table: Defining dependency "table" 00:01:22.461 Message: lib/pipeline: Defining dependency "pipeline" 00:01:22.461 Message: lib/graph: Defining dependency "graph" 00:01:22.461 Message: lib/node: Defining dependency "node" 00:01:22.461 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:01:22.461 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:01:22.461 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:01:22.461 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:01:22.461 Compiler for C supports arguments -Wno-sign-compare: YES 00:01:22.461 Compiler for C supports arguments -Wno-unused-value: YES 00:01:24.373 Compiler for C supports arguments -Wno-format: YES 00:01:24.373 Compiler for C supports arguments -Wno-format-security: YES 00:01:24.373 Compiler for C supports arguments -Wno-format-nonliteral: YES 00:01:24.373 Compiler for C supports arguments -Wno-strict-aliasing: YES 00:01:24.373 Compiler for C supports arguments -Wno-unused-but-set-variable: YES 00:01:24.373 Compiler for C supports arguments -Wno-unused-parameter: YES 00:01:24.373 Fetching value of define "__AVX2__" : (undefined) (cached) 00:01:24.373 Compiler for C supports arguments -mavx2: YES (cached) 00:01:24.373 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:24.373 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:24.373 Compiler for C supports arguments -mavx512bw: YES (cached) 00:01:24.373 Compiler for C supports arguments -march=skylake-avx512: YES 00:01:24.373 Message: drivers/net/i40e: Defining dependency "net_i40e" 00:01:24.373 Program doxygen found: YES (/usr/local/bin/doxygen) 00:01:24.373 Configuring doxy-api.conf using configuration 00:01:24.373 Program sphinx-build found: NO 00:01:24.373 Configuring rte_build_config.h using configuration 00:01:24.373 Message: 00:01:24.373 ================= 00:01:24.373 Applications Enabled 00:01:24.373 ================= 00:01:24.373 00:01:24.373 apps: 00:01:24.373 dumpcap, pdump, proc-info, test-acl, test-bbdev, test-cmdline, test-compress-perf, test-crypto-perf, 00:01:24.373 test-eventdev, test-fib, test-flow-perf, test-gpudev, test-pipeline, test-pmd, test-regex, test-sad, 00:01:24.373 test-security-perf, 00:01:24.373 00:01:24.373 Message: 00:01:24.373 ================= 00:01:24.373 Libraries Enabled 00:01:24.373 ================= 00:01:24.373 00:01:24.373 libs: 00:01:24.373 kvargs, telemetry, eal, ring, rcu, mempool, mbuf, net, 00:01:24.373 meter, ethdev, pci, cmdline, metrics, hash, timer, acl, 00:01:24.373 bbdev, bitratestats, bpf, cfgfile, compressdev, cryptodev, distributor, efd, 00:01:24.373 eventdev, gpudev, gro, gso, ip_frag, jobstats, latencystats, lpm, 00:01:24.373 member, pcapng, power, rawdev, regexdev, dmadev, rib, reorder, 00:01:24.373 sched, security, stack, vhost, ipsec, fib, port, pdump, 00:01:24.373 table, pipeline, graph, node, 00:01:24.373 00:01:24.373 Message: 00:01:24.374 =============== 00:01:24.374 Drivers Enabled 00:01:24.374 =============== 00:01:24.374 00:01:24.374 common: 00:01:24.374 00:01:24.374 bus: 00:01:24.374 pci, vdev, 00:01:24.374 mempool: 00:01:24.374 ring, 00:01:24.374 dma: 00:01:24.374 00:01:24.374 net: 00:01:24.374 i40e, 00:01:24.374 raw: 00:01:24.374 00:01:24.374 crypto: 00:01:24.374 00:01:24.374 compress: 00:01:24.374 00:01:24.374 regex: 00:01:24.374 00:01:24.374 vdpa: 00:01:24.374 00:01:24.374 event: 00:01:24.374 00:01:24.374 baseband: 00:01:24.374 00:01:24.374 gpu: 00:01:24.374 00:01:24.374 00:01:24.374 Message: 00:01:24.374 ================= 00:01:24.374 Content Skipped 00:01:24.374 ================= 00:01:24.374 00:01:24.374 apps: 00:01:24.374 00:01:24.374 libs: 00:01:24.374 kni: explicitly disabled via build config (deprecated lib) 00:01:24.374 flow_classify: explicitly disabled via build config (deprecated lib) 00:01:24.374 00:01:24.374 drivers: 00:01:24.374 common/cpt: not in enabled drivers build config 00:01:24.374 common/dpaax: not in enabled drivers build config 00:01:24.374 common/iavf: not in enabled drivers build config 00:01:24.374 common/idpf: not in enabled drivers build config 00:01:24.374 common/mvep: not in enabled drivers build config 00:01:24.374 common/octeontx: not in enabled drivers build config 00:01:24.374 bus/auxiliary: not in enabled drivers build config 00:01:24.374 bus/dpaa: not in enabled drivers build config 00:01:24.374 bus/fslmc: not in enabled drivers build config 00:01:24.374 bus/ifpga: not in enabled drivers build config 00:01:24.374 bus/vmbus: not in enabled drivers build config 00:01:24.374 common/cnxk: not in enabled drivers build config 00:01:24.374 common/mlx5: not in enabled drivers build config 00:01:24.374 common/qat: not in enabled drivers build config 00:01:24.374 common/sfc_efx: not in enabled drivers build config 00:01:24.374 mempool/bucket: not in enabled drivers build config 00:01:24.374 mempool/cnxk: not in enabled drivers build config 00:01:24.374 mempool/dpaa: not in enabled drivers build config 00:01:24.374 mempool/dpaa2: not in enabled drivers build config 00:01:24.374 mempool/octeontx: not in enabled drivers build config 00:01:24.374 mempool/stack: not in enabled drivers build config 00:01:24.374 dma/cnxk: not in enabled drivers build config 00:01:24.374 dma/dpaa: not in enabled drivers build config 00:01:24.374 dma/dpaa2: not in enabled drivers build config 00:01:24.374 dma/hisilicon: not in enabled drivers build config 00:01:24.374 dma/idxd: not in enabled drivers build config 00:01:24.374 dma/ioat: not in enabled drivers build config 00:01:24.374 dma/skeleton: not in enabled drivers build config 00:01:24.374 net/af_packet: not in enabled drivers build config 00:01:24.374 net/af_xdp: not in enabled drivers build config 00:01:24.374 net/ark: not in enabled drivers build config 00:01:24.374 net/atlantic: not in enabled drivers build config 00:01:24.374 net/avp: not in enabled drivers build config 00:01:24.374 net/axgbe: not in enabled drivers build config 00:01:24.374 net/bnx2x: not in enabled drivers build config 00:01:24.374 net/bnxt: not in enabled drivers build config 00:01:24.374 net/bonding: not in enabled drivers build config 00:01:24.374 net/cnxk: not in enabled drivers build config 00:01:24.374 net/cxgbe: not in enabled drivers build config 00:01:24.374 net/dpaa: not in enabled drivers build config 00:01:24.374 net/dpaa2: not in enabled drivers build config 00:01:24.374 net/e1000: not in enabled drivers build config 00:01:24.374 net/ena: not in enabled drivers build config 00:01:24.374 net/enetc: not in enabled drivers build config 00:01:24.374 net/enetfec: not in enabled drivers build config 00:01:24.374 net/enic: not in enabled drivers build config 00:01:24.374 net/failsafe: not in enabled drivers build config 00:01:24.374 net/fm10k: not in enabled drivers build config 00:01:24.374 net/gve: not in enabled drivers build config 00:01:24.374 net/hinic: not in enabled drivers build config 00:01:24.374 net/hns3: not in enabled drivers build config 00:01:24.374 net/iavf: not in enabled drivers build config 00:01:24.374 net/ice: not in enabled drivers build config 00:01:24.374 net/idpf: not in enabled drivers build config 00:01:24.374 net/igc: not in enabled drivers build config 00:01:24.374 net/ionic: not in enabled drivers build config 00:01:24.374 net/ipn3ke: not in enabled drivers build config 00:01:24.374 net/ixgbe: not in enabled drivers build config 00:01:24.374 net/kni: not in enabled drivers build config 00:01:24.374 net/liquidio: not in enabled drivers build config 00:01:24.374 net/mana: not in enabled drivers build config 00:01:24.374 net/memif: not in enabled drivers build config 00:01:24.374 net/mlx4: not in enabled drivers build config 00:01:24.374 net/mlx5: not in enabled drivers build config 00:01:24.374 net/mvneta: not in enabled drivers build config 00:01:24.374 net/mvpp2: not in enabled drivers build config 00:01:24.374 net/netvsc: not in enabled drivers build config 00:01:24.374 net/nfb: not in enabled drivers build config 00:01:24.374 net/nfp: not in enabled drivers build config 00:01:24.374 net/ngbe: not in enabled drivers build config 00:01:24.374 net/null: not in enabled drivers build config 00:01:24.374 net/octeontx: not in enabled drivers build config 00:01:24.374 net/octeon_ep: not in enabled drivers build config 00:01:24.374 net/pcap: not in enabled drivers build config 00:01:24.374 net/pfe: not in enabled drivers build config 00:01:24.374 net/qede: not in enabled drivers build config 00:01:24.374 net/ring: not in enabled drivers build config 00:01:24.374 net/sfc: not in enabled drivers build config 00:01:24.374 net/softnic: not in enabled drivers build config 00:01:24.374 net/tap: not in enabled drivers build config 00:01:24.374 net/thunderx: not in enabled drivers build config 00:01:24.374 net/txgbe: not in enabled drivers build config 00:01:24.374 net/vdev_netvsc: not in enabled drivers build config 00:01:24.374 net/vhost: not in enabled drivers build config 00:01:24.374 net/virtio: not in enabled drivers build config 00:01:24.374 net/vmxnet3: not in enabled drivers build config 00:01:24.374 raw/cnxk_bphy: not in enabled drivers build config 00:01:24.374 raw/cnxk_gpio: not in enabled drivers build config 00:01:24.374 raw/dpaa2_cmdif: not in enabled drivers build config 00:01:24.374 raw/ifpga: not in enabled drivers build config 00:01:24.374 raw/ntb: not in enabled drivers build config 00:01:24.374 raw/skeleton: not in enabled drivers build config 00:01:24.374 crypto/armv8: not in enabled drivers build config 00:01:24.374 crypto/bcmfs: not in enabled drivers build config 00:01:24.374 crypto/caam_jr: not in enabled drivers build config 00:01:24.374 crypto/ccp: not in enabled drivers build config 00:01:24.374 crypto/cnxk: not in enabled drivers build config 00:01:24.374 crypto/dpaa_sec: not in enabled drivers build config 00:01:24.374 crypto/dpaa2_sec: not in enabled drivers build config 00:01:24.374 crypto/ipsec_mb: not in enabled drivers build config 00:01:24.374 crypto/mlx5: not in enabled drivers build config 00:01:24.374 crypto/mvsam: not in enabled drivers build config 00:01:24.374 crypto/nitrox: not in enabled drivers build config 00:01:24.374 crypto/null: not in enabled drivers build config 00:01:24.374 crypto/octeontx: not in enabled drivers build config 00:01:24.374 crypto/openssl: not in enabled drivers build config 00:01:24.374 crypto/scheduler: not in enabled drivers build config 00:01:24.374 crypto/uadk: not in enabled drivers build config 00:01:24.374 crypto/virtio: not in enabled drivers build config 00:01:24.374 compress/isal: not in enabled drivers build config 00:01:24.374 compress/mlx5: not in enabled drivers build config 00:01:24.374 compress/octeontx: not in enabled drivers build config 00:01:24.374 compress/zlib: not in enabled drivers build config 00:01:24.374 regex/mlx5: not in enabled drivers build config 00:01:24.374 regex/cn9k: not in enabled drivers build config 00:01:24.374 vdpa/ifc: not in enabled drivers build config 00:01:24.374 vdpa/mlx5: not in enabled drivers build config 00:01:24.374 vdpa/sfc: not in enabled drivers build config 00:01:24.374 event/cnxk: not in enabled drivers build config 00:01:24.374 event/dlb2: not in enabled drivers build config 00:01:24.374 event/dpaa: not in enabled drivers build config 00:01:24.374 event/dpaa2: not in enabled drivers build config 00:01:24.374 event/dsw: not in enabled drivers build config 00:01:24.374 event/opdl: not in enabled drivers build config 00:01:24.374 event/skeleton: not in enabled drivers build config 00:01:24.374 event/sw: not in enabled drivers build config 00:01:24.374 event/octeontx: not in enabled drivers build config 00:01:24.374 baseband/acc: not in enabled drivers build config 00:01:24.374 baseband/fpga_5gnr_fec: not in enabled drivers build config 00:01:24.374 baseband/fpga_lte_fec: not in enabled drivers build config 00:01:24.374 baseband/la12xx: not in enabled drivers build config 00:01:24.374 baseband/null: not in enabled drivers build config 00:01:24.374 baseband/turbo_sw: not in enabled drivers build config 00:01:24.374 gpu/cuda: not in enabled drivers build config 00:01:24.374 00:01:24.374 00:01:24.374 Build targets in project: 316 00:01:24.374 00:01:24.374 DPDK 22.11.4 00:01:24.374 00:01:24.374 User defined options 00:01:24.374 libdir : lib 00:01:24.374 prefix : /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:24.374 c_args : -fPIC -g -fcommon -Werror -Wno-stringop-overflow 00:01:24.374 c_link_args : 00:01:24.374 enable_docs : false 00:01:24.374 enable_drivers: bus,bus/pci,bus/vdev,mempool/ring,net/i40e,net/i40e/base, 00:01:24.374 enable_kmods : false 00:01:24.374 machine : native 00:01:24.374 tests : false 00:01:24.374 00:01:24.374 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:01:24.374 WARNING: Running the setup command as `meson [options]` instead of `meson setup [options]` is ambiguous and deprecated. 00:01:24.374 01:02:32 -- common/autobuild_common.sh@189 -- $ ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp -j48 00:01:24.374 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp' 00:01:24.374 [1/745] Generating lib/rte_kvargs_mingw with a custom command 00:01:24.374 [2/745] Generating lib/rte_telemetry_def with a custom command 00:01:24.374 [3/745] Generating lib/rte_telemetry_mingw with a custom command 00:01:24.375 [4/745] Generating lib/rte_kvargs_def with a custom command 00:01:24.375 [5/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:01:24.375 [6/745] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:01:24.375 [7/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:01:24.375 [8/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:01:24.375 [9/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:01:24.375 [10/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:01:24.375 [11/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:01:24.375 [12/745] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:01:24.375 [13/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:01:24.375 [14/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:01:24.375 [15/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:01:24.375 [16/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:01:24.375 [17/745] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:01:24.375 [18/745] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:01:24.375 [19/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:01:24.375 [20/745] Linking static target lib/librte_kvargs.a 00:01:24.375 [21/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:01:24.375 [22/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:01:24.375 [23/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:01:24.375 [24/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:01:24.375 [25/745] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:01:24.375 [26/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:01:24.375 [27/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:01:24.375 [28/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:01:24.375 [29/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:01:24.638 [30/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:01:24.638 [31/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_log.c.o 00:01:24.638 [32/745] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:01:24.638 [33/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:01:24.638 [34/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:01:24.638 [35/745] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:01:24.638 [36/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:01:24.638 [37/745] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:01:24.638 [38/745] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:01:24.638 [39/745] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:01:24.638 [40/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:01:24.638 [41/745] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:01:24.638 [42/745] Generating lib/rte_eal_def with a custom command 00:01:24.638 [43/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:01:24.638 [44/745] Generating lib/rte_eal_mingw with a custom command 00:01:24.638 [45/745] Generating lib/rte_ring_def with a custom command 00:01:24.638 [46/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:01:24.638 [47/745] Generating lib/rte_ring_mingw with a custom command 00:01:24.638 [48/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:01:24.638 [49/745] Generating lib/rte_rcu_def with a custom command 00:01:24.638 [50/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:01:24.638 [51/745] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:01:24.638 [52/745] Generating lib/rte_rcu_mingw with a custom command 00:01:24.638 [53/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:01:24.638 [54/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:01:24.638 [55/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:01:24.638 [56/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:01:24.638 [57/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:01:24.638 [58/745] Generating lib/rte_mempool_def with a custom command 00:01:24.638 [59/745] Generating lib/rte_mempool_mingw with a custom command 00:01:24.638 [60/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:01:24.638 [61/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:01:24.638 [62/745] Generating lib/rte_mbuf_def with a custom command 00:01:24.638 [63/745] Generating lib/rte_mbuf_mingw with a custom command 00:01:24.638 [64/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_log.c.o 00:01:24.638 [65/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:01:24.638 [66/745] Generating lib/rte_net_def with a custom command 00:01:24.638 [67/745] Generating lib/rte_net_mingw with a custom command 00:01:24.638 [68/745] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:01:24.638 [69/745] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:01:24.638 [70/745] Generating lib/rte_meter_def with a custom command 00:01:24.638 [71/745] Generating lib/rte_meter_mingw with a custom command 00:01:24.638 [72/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:01:24.638 [73/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:01:24.638 [74/745] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:01:24.638 [75/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:01:24.638 [76/745] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:01:24.638 [77/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:01:24.900 [78/745] Generating lib/rte_ethdev_def with a custom command 00:01:24.900 [79/745] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:01:24.900 [80/745] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:01:24.900 [81/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:01:24.900 [82/745] Linking static target lib/librte_ring.a 00:01:24.900 [83/745] Generating lib/rte_ethdev_mingw with a custom command 00:01:24.900 [84/745] Linking target lib/librte_kvargs.so.23.0 00:01:24.900 [85/745] Generating lib/rte_pci_def with a custom command 00:01:24.900 [86/745] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:01:24.900 [87/745] Linking static target lib/librte_meter.a 00:01:24.900 [88/745] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:01:24.900 [89/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:01:24.900 [90/745] Generating lib/rte_pci_mingw with a custom command 00:01:25.161 [91/745] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:01:25.162 [92/745] Linking static target lib/librte_pci.a 00:01:25.162 [93/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:01:25.162 [94/745] Generating symbol file lib/librte_kvargs.so.23.0.p/librte_kvargs.so.23.0.symbols 00:01:25.162 [95/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:01:25.162 [96/745] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:01:25.162 [97/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:01:25.162 [98/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:01:25.162 [99/745] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:01:25.162 [100/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:01:25.162 [101/745] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:01:25.424 [102/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:01:25.424 [103/745] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:01:25.424 [104/745] Linking static target lib/librte_telemetry.a 00:01:25.424 [105/745] Generating lib/rte_cmdline_def with a custom command 00:01:25.424 [106/745] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:25.424 [107/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:01:25.424 [108/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:01:25.424 [109/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:01:25.424 [110/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:01:25.424 [111/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:01:25.424 [112/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:01:25.424 [113/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:01:25.424 [114/745] Generating lib/rte_cmdline_mingw with a custom command 00:01:25.424 [115/745] Generating lib/rte_metrics_def with a custom command 00:01:25.424 [116/745] Generating lib/rte_metrics_mingw with a custom command 00:01:25.424 [117/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:01:25.424 [118/745] Generating lib/rte_hash_def with a custom command 00:01:25.424 [119/745] Generating lib/rte_hash_mingw with a custom command 00:01:25.424 [120/745] Generating lib/rte_timer_def with a custom command 00:01:25.424 [121/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:01:25.424 [122/745] Generating lib/rte_timer_mingw with a custom command 00:01:25.690 [123/745] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:01:25.690 [124/745] Compiling C object lib/librte_metrics.a.p/metrics_rte_metrics.c.o 00:01:25.690 [125/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:01:25.690 [126/745] Compiling C object lib/net/libnet_crc_avx512_lib.a.p/net_crc_avx512.c.o 00:01:25.690 [127/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:01:25.690 [128/745] Linking static target lib/net/libnet_crc_avx512_lib.a 00:01:25.690 [129/745] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:01:25.690 [130/745] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:01:25.950 [131/745] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:01:25.951 [132/745] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:01:25.951 [133/745] Generating lib/rte_acl_mingw with a custom command 00:01:25.951 [134/745] Generating lib/rte_acl_def with a custom command 00:01:25.951 [135/745] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:01:25.951 [136/745] Generating lib/rte_bbdev_def with a custom command 00:01:25.951 [137/745] Generating lib/rte_bbdev_mingw with a custom command 00:01:25.951 [138/745] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:01:25.951 [139/745] Generating lib/rte_bitratestats_def with a custom command 00:01:25.951 [140/745] Generating lib/rte_bitratestats_mingw with a custom command 00:01:25.951 [141/745] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:01:25.951 [142/745] Linking target lib/librte_telemetry.so.23.0 00:01:25.951 [143/745] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:01:25.951 [144/745] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:01:25.951 [145/745] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:01:25.951 [146/745] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:01:25.951 [147/745] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:01:25.951 [148/745] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:01:26.210 [149/745] Generating lib/rte_bpf_def with a custom command 00:01:26.210 [150/745] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:01:26.210 [151/745] Generating lib/rte_bpf_mingw with a custom command 00:01:26.210 [152/745] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:01:26.210 [153/745] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:01:26.210 [154/745] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:01:26.210 [155/745] Generating lib/rte_cfgfile_def with a custom command 00:01:26.210 [156/745] Generating lib/rte_cfgfile_mingw with a custom command 00:01:26.210 [157/745] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:01:26.210 [158/745] Generating symbol file lib/librte_telemetry.so.23.0.p/librte_telemetry.so.23.0.symbols 00:01:26.210 [159/745] Generating lib/rte_compressdev_def with a custom command 00:01:26.210 [160/745] Generating lib/rte_compressdev_mingw with a custom command 00:01:26.210 [161/745] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:01:26.210 [162/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:01:26.210 [163/745] Linking static target lib/librte_rcu.a 00:01:26.210 [164/745] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:01:26.210 [165/745] Generating lib/rte_cryptodev_def with a custom command 00:01:26.210 [166/745] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:01:26.210 [167/745] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:01:26.210 [168/745] Linking static target lib/librte_timer.a 00:01:26.210 [169/745] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:01:26.210 [170/745] Generating lib/rte_cryptodev_mingw with a custom command 00:01:26.475 [171/745] Generating lib/rte_distributor_def with a custom command 00:01:26.475 [172/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:01:26.475 [173/745] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:01:26.475 [174/745] Generating lib/rte_distributor_mingw with a custom command 00:01:26.475 [175/745] Linking static target lib/librte_cmdline.a 00:01:26.475 [176/745] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:01:26.475 [177/745] Generating lib/rte_efd_def with a custom command 00:01:26.475 [178/745] Generating lib/rte_efd_mingw with a custom command 00:01:26.475 [179/745] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:01:26.475 [180/745] Linking static target lib/librte_net.a 00:01:26.475 [181/745] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:01:26.734 [182/745] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:01:26.734 [183/745] Compiling C object lib/librte_metrics.a.p/metrics_rte_metrics_telemetry.c.o 00:01:26.734 [184/745] Compiling C object lib/librte_cfgfile.a.p/cfgfile_rte_cfgfile.c.o 00:01:26.734 [185/745] Linking static target lib/librte_metrics.a 00:01:26.734 [186/745] Linking static target lib/librte_mempool.a 00:01:26.734 [187/745] Linking static target lib/librte_cfgfile.a 00:01:26.734 [188/745] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:01:26.734 [189/745] Compiling C object lib/librte_acl.a.p/acl_tb_mem.c.o 00:01:26.734 [190/745] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:01:26.734 [191/745] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:01:26.998 [192/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:01:26.998 [193/745] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:01:26.998 [194/745] Generating lib/rte_eventdev_def with a custom command 00:01:26.998 [195/745] Compiling C object lib/librte_acl.a.p/acl_rte_acl.c.o 00:01:26.998 [196/745] Linking static target lib/librte_eal.a 00:01:26.998 [197/745] Generating lib/rte_eventdev_mingw with a custom command 00:01:26.998 [198/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf.c.o 00:01:26.998 [199/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_stub.c.o 00:01:26.998 [200/745] Generating lib/rte_gpudev_def with a custom command 00:01:26.998 [201/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_dump.c.o 00:01:27.259 [202/745] Generating lib/rte_gpudev_mingw with a custom command 00:01:27.259 [203/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_load.c.o 00:01:27.259 [204/745] Generating lib/cfgfile.sym_chk with a custom command (wrapped by meson to capture output) 00:01:27.259 [205/745] Compiling C object lib/librte_bitratestats.a.p/bitratestats_rte_bitrate.c.o 00:01:27.259 [206/745] Compiling C object lib/librte_acl.a.p/acl_acl_gen.c.o 00:01:27.259 [207/745] Linking static target lib/librte_bitratestats.a 00:01:27.259 [208/745] Generating lib/rte_gro_def with a custom command 00:01:27.259 [209/745] Generating lib/rte_gro_mingw with a custom command 00:01:27.259 [210/745] Generating lib/metrics.sym_chk with a custom command (wrapped by meson to capture output) 00:01:27.259 [211/745] Compiling C object lib/librte_acl.a.p/acl_acl_run_scalar.c.o 00:01:27.259 [212/745] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:01:27.525 [213/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_load_elf.c.o 00:01:27.525 [214/745] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:01:27.525 [215/745] Generating lib/bitratestats.sym_chk with a custom command (wrapped by meson to capture output) 00:01:27.525 [216/745] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor_match_sse.c.o 00:01:27.525 [217/745] Generating lib/rte_gso_def with a custom command 00:01:27.525 [218/745] Generating lib/rte_gso_mingw with a custom command 00:01:27.525 [219/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_exec.c.o 00:01:27.525 [220/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_convert.c.o 00:01:27.788 [221/745] Compiling C object lib/librte_eventdev.a.p/eventdev_eventdev_private.c.o 00:01:27.788 [222/745] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:01:27.788 [223/745] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:01:27.788 [224/745] Compiling C object lib/librte_bbdev.a.p/bbdev_rte_bbdev.c.o 00:01:27.789 [225/745] Linking static target lib/librte_bbdev.a 00:01:27.789 [226/745] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor_single.c.o 00:01:27.789 [227/745] Generating lib/rte_ip_frag_def with a custom command 00:01:27.789 [228/745] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:01:27.789 [229/745] Generating lib/rte_ip_frag_mingw with a custom command 00:01:27.789 [230/745] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:01:27.789 [231/745] Generating lib/rte_jobstats_def with a custom command 00:01:27.789 [232/745] Generating lib/rte_jobstats_mingw with a custom command 00:01:27.789 [233/745] Generating lib/rte_latencystats_def with a custom command 00:01:27.789 [234/745] Generating lib/rte_latencystats_mingw with a custom command 00:01:27.789 [235/745] Compiling C object lib/librte_eventdev.a.p/eventdev_eventdev_trace_points.c.o 00:01:28.054 [236/745] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:01:28.054 [237/745] Linking static target lib/librte_compressdev.a 00:01:28.054 [238/745] Generating lib/rte_lpm_def with a custom command 00:01:28.054 [239/745] Generating lib/rte_lpm_mingw with a custom command 00:01:28.054 [240/745] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_ring.c.o 00:01:28.054 [241/745] Compiling C object lib/librte_jobstats.a.p/jobstats_rte_jobstats.c.o 00:01:28.054 [242/745] Linking static target lib/librte_jobstats.a 00:01:28.318 [243/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_pkt.c.o 00:01:28.318 [244/745] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:01:28.318 [245/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_validate.c.o 00:01:28.318 [246/745] Generating lib/rte_member_def with a custom command 00:01:28.318 [247/745] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor.c.o 00:01:28.318 [248/745] Linking static target lib/librte_distributor.a 00:01:28.578 [249/745] Generating lib/rte_member_mingw with a custom command 00:01:28.578 [250/745] Compiling C object lib/librte_gso.a.p/gso_gso_udp4.c.o 00:01:28.578 [251/745] Generating lib/jobstats.sym_chk with a custom command (wrapped by meson to capture output) 00:01:28.578 [252/745] Generating lib/rte_pcapng_def with a custom command 00:01:28.578 [253/745] Compiling C object lib/librte_gso.a.p/gso_gso_tcp4.c.o 00:01:28.578 [254/745] Compiling C object lib/librte_gso.a.p/gso_gso_tunnel_tcp4.c.o 00:01:28.578 [255/745] Generating lib/rte_pcapng_mingw with a custom command 00:01:28.578 [256/745] Compiling C object lib/librte_gso.a.p/gso_gso_tunnel_udp4.c.o 00:01:28.578 [257/745] Generating lib/bbdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:28.578 [258/745] Compiling C object lib/librte_gso.a.p/gso_rte_gso.c.o 00:01:28.839 [259/745] Compiling C object lib/librte_gro.a.p/gro_gro_tcp4.c.o 00:01:28.839 [260/745] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:01:28.839 [261/745] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:01:28.839 [262/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_jit_x86.c.o 00:01:28.839 [263/745] Compiling C object lib/librte_gro.a.p/gro_gro_udp4.c.o 00:01:28.839 [264/745] Linking static target lib/librte_bpf.a 00:01:28.839 [265/745] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:01:28.839 [266/745] Compiling C object lib/librte_gpudev.a.p/gpudev_gpudev.c.o 00:01:28.839 [267/745] Generating lib/rte_power_def with a custom command 00:01:28.839 [268/745] Linking static target lib/librte_gpudev.a 00:01:28.839 [269/745] Generating lib/distributor.sym_chk with a custom command (wrapped by meson to capture output) 00:01:28.839 [270/745] Generating lib/rte_power_mingw with a custom command 00:01:28.839 [271/745] Compiling C object lib/librte_gro.a.p/gro_gro_vxlan_tcp4.c.o 00:01:28.839 [272/745] Compiling C object lib/librte_gro.a.p/gro_rte_gro.c.o 00:01:28.839 [273/745] Generating lib/rte_rawdev_def with a custom command 00:01:28.839 [274/745] Compiling C object lib/librte_gro.a.p/gro_gro_vxlan_udp4.c.o 00:01:28.839 [275/745] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv4_reassembly.c.o 00:01:28.839 [276/745] Generating lib/rte_rawdev_mingw with a custom command 00:01:28.839 [277/745] Linking static target lib/librte_gro.a 00:01:28.839 [278/745] Generating lib/rte_regexdev_def with a custom command 00:01:28.839 [279/745] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:01:28.839 [280/745] Generating lib/rte_regexdev_mingw with a custom command 00:01:29.103 [281/745] Generating lib/rte_dmadev_mingw with a custom command 00:01:29.103 [282/745] Generating lib/rte_dmadev_def with a custom command 00:01:29.103 [283/745] Generating lib/rte_rib_mingw with a custom command 00:01:29.103 [284/745] Generating lib/rte_rib_def with a custom command 00:01:29.103 [285/745] Generating lib/rte_reorder_def with a custom command 00:01:29.103 [286/745] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv6_reassembly.c.o 00:01:29.103 [287/745] Compiling C object lib/librte_power.a.p/power_rte_power_empty_poll.c.o 00:01:29.103 [288/745] Generating lib/rte_reorder_mingw with a custom command 00:01:29.367 [289/745] Generating lib/bpf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:29.367 [290/745] Generating lib/gro.sym_chk with a custom command (wrapped by meson to capture output) 00:01:29.367 [291/745] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:29.367 [292/745] Compiling C object lib/librte_member.a.p/member_rte_member.c.o 00:01:29.367 [293/745] Compiling C object lib/librte_acl.a.p/acl_acl_bld.c.o 00:01:29.367 [294/745] Compiling C object lib/librte_ip_frag.a.p/ip_frag_ip_frag_internal.c.o 00:01:29.367 [295/745] Generating lib/rte_sched_def with a custom command 00:01:29.367 [296/745] Generating lib/rte_sched_mingw with a custom command 00:01:29.367 [297/745] Compiling C object lib/librte_sched.a.p/sched_rte_red.c.o 00:01:29.367 [298/745] Compiling C object lib/librte_member.a.p/member_rte_member_vbf.c.o 00:01:29.367 [299/745] Compiling C object lib/librte_latencystats.a.p/latencystats_rte_latencystats.c.o 00:01:29.367 [300/745] Linking static target lib/librte_latencystats.a 00:01:29.367 [301/745] Compiling C object lib/librte_sched.a.p/sched_rte_pie.c.o 00:01:29.367 [302/745] Compiling C object lib/member/libsketch_avx512_tmp.a.p/rte_member_sketch_avx512.c.o 00:01:29.367 [303/745] Generating lib/rte_security_def with a custom command 00:01:29.367 [304/745] Generating lib/rte_security_mingw with a custom command 00:01:29.367 [305/745] Linking static target lib/member/libsketch_avx512_tmp.a 00:01:29.367 [306/745] Compiling C object lib/librte_sched.a.p/sched_rte_approx.c.o 00:01:29.367 [307/745] Generating lib/rte_stack_def with a custom command 00:01:29.367 [308/745] Generating lib/rte_stack_mingw with a custom command 00:01:29.631 [309/745] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ip_frag_common.c.o 00:01:29.631 [310/745] Compiling C object lib/librte_stack.a.p/stack_rte_stack_std.c.o 00:01:29.631 [311/745] Compiling C object lib/librte_rawdev.a.p/rawdev_rte_rawdev.c.o 00:01:29.631 [312/745] Linking static target lib/librte_rawdev.a 00:01:29.631 [313/745] Compiling C object lib/librte_stack.a.p/stack_rte_stack_lf.c.o 00:01:29.631 [314/745] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_crypto_adapter.c.o 00:01:29.631 [315/745] Compiling C object lib/librte_stack.a.p/stack_rte_stack.c.o 00:01:29.631 [316/745] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv6_fragmentation.c.o 00:01:29.631 [317/745] Linking static target lib/librte_stack.a 00:01:29.631 [318/745] Compiling C object lib/librte_lpm.a.p/lpm_rte_lpm.c.o 00:01:29.631 [319/745] Generating lib/rte_vhost_def with a custom command 00:01:29.631 [320/745] Generating lib/rte_vhost_mingw with a custom command 00:01:29.631 [321/745] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:01:29.631 [322/745] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:01:29.631 [323/745] Linking static target lib/librte_dmadev.a 00:01:29.631 [324/745] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_eventdev.c.o 00:01:29.893 [325/745] Generating lib/latencystats.sym_chk with a custom command (wrapped by meson to capture output) 00:01:29.893 [326/745] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv4_fragmentation.c.o 00:01:29.893 [327/745] Linking static target lib/librte_ip_frag.a 00:01:29.893 [328/745] Generating lib/rte_ipsec_def with a custom command 00:01:29.893 [329/745] Generating lib/rte_ipsec_mingw with a custom command 00:01:29.893 [330/745] Generating lib/stack.sym_chk with a custom command (wrapped by meson to capture output) 00:01:29.893 [331/745] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_eth_tx_adapter.c.o 00:01:29.893 [332/745] Compiling C object lib/librte_acl.a.p/acl_acl_run_sse.c.o 00:01:30.152 [333/745] Compiling C object lib/librte_power.a.p/power_rte_power_intel_uncore.c.o 00:01:30.152 [334/745] Generating lib/gpudev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:30.152 [335/745] Compiling C object lib/librte_fib.a.p/fib_rte_fib.c.o 00:01:30.152 [336/745] Generating lib/rawdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:30.152 [337/745] Generating lib/rte_fib_def with a custom command 00:01:30.419 [338/745] Generating lib/ip_frag.sym_chk with a custom command (wrapped by meson to capture output) 00:01:30.419 [339/745] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:01:30.419 [340/745] Generating lib/rte_fib_mingw with a custom command 00:01:30.419 [341/745] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:01:30.419 [342/745] Compiling C object lib/librte_gso.a.p/gso_gso_common.c.o 00:01:30.419 [343/745] Linking static target lib/librte_gso.a 00:01:30.419 [344/745] Compiling C object lib/librte_regexdev.a.p/regexdev_rte_regexdev.c.o 00:01:30.419 [345/745] Linking static target lib/librte_regexdev.a 00:01:30.679 [346/745] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:30.679 [347/745] Compiling C object lib/librte_efd.a.p/efd_rte_efd.c.o 00:01:30.679 [348/745] Linking static target lib/librte_efd.a 00:01:30.679 [349/745] Compiling C object lib/librte_member.a.p/member_rte_member_ht.c.o 00:01:30.679 [350/745] Generating lib/gso.sym_chk with a custom command (wrapped by meson to capture output) 00:01:30.679 [351/745] Compiling C object lib/librte_pcapng.a.p/pcapng_rte_pcapng.c.o 00:01:30.679 [352/745] Linking static target lib/librte_pcapng.a 00:01:30.679 [353/745] Compiling C object lib/librte_lpm.a.p/lpm_rte_lpm6.c.o 00:01:30.944 [354/745] Linking static target lib/librte_lpm.a 00:01:30.944 [355/745] Compiling C object lib/librte_ipsec.a.p/ipsec_ses.c.o 00:01:30.944 [356/745] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:01:30.944 [357/745] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:01:30.944 [358/745] Compiling C object lib/librte_rib.a.p/rib_rte_rib.c.o 00:01:30.944 [359/745] Generating lib/efd.sym_chk with a custom command (wrapped by meson to capture output) 00:01:30.944 [360/745] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:01:30.944 [361/745] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:01:30.944 [362/745] Linking static target lib/librte_reorder.a 00:01:30.944 [363/745] Generating lib/rte_port_def with a custom command 00:01:31.205 [364/745] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:01:31.205 [365/745] Generating lib/rte_port_mingw with a custom command 00:01:31.205 [366/745] Compiling C object lib/librte_ipsec.a.p/ipsec_ipsec_telemetry.c.o 00:01:31.205 [367/745] Generating lib/rte_pdump_mingw with a custom command 00:01:31.205 [368/745] Generating lib/rte_pdump_def with a custom command 00:01:31.205 [369/745] Compiling C object lib/fib/libtrie_avx512_tmp.a.p/trie_avx512.c.o 00:01:31.205 [370/745] Linking static target lib/fib/libtrie_avx512_tmp.a 00:01:31.205 [371/745] Generating lib/pcapng.sym_chk with a custom command (wrapped by meson to capture output) 00:01:31.205 [372/745] Compiling C object lib/fib/libdir24_8_avx512_tmp.a.p/dir24_8_avx512.c.o 00:01:31.205 [373/745] Linking static target lib/fib/libdir24_8_avx512_tmp.a 00:01:31.205 [374/745] Compiling C object lib/librte_fib.a.p/fib_rte_fib6.c.o 00:01:31.205 [375/745] Compiling C object lib/librte_ipsec.a.p/ipsec_sa.c.o 00:01:31.465 [376/745] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:01:31.465 [377/745] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:01:31.465 [378/745] Generating lib/lpm.sym_chk with a custom command (wrapped by meson to capture output) 00:01:31.465 [379/745] Linking static target lib/librte_power.a 00:01:31.465 [380/745] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:01:31.465 [381/745] Linking static target lib/librte_security.a 00:01:31.465 [382/745] Compiling C object lib/acl/libavx2_tmp.a.p/acl_run_avx2.c.o 00:01:31.465 [383/745] Compiling C object lib/librte_ipsec.a.p/ipsec_ipsec_sad.c.o 00:01:31.465 [384/745] Linking static target lib/acl/libavx2_tmp.a 00:01:31.465 [385/745] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:01:31.465 [386/745] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:01:31.465 [387/745] Linking static target lib/librte_hash.a 00:01:31.465 [388/745] Compiling C object lib/librte_table.a.p/table_rte_swx_keycmp.c.o 00:01:31.465 [389/745] Generating lib/regexdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:31.728 [390/745] Compiling C object lib/acl/libavx512_tmp.a.p/acl_run_avx512.c.o 00:01:31.728 [391/745] Linking static target lib/acl/libavx512_tmp.a 00:01:31.728 [392/745] Compiling C object lib/librte_rib.a.p/rib_rte_rib6.c.o 00:01:31.728 [393/745] Linking static target lib/librte_acl.a 00:01:31.728 [394/745] Linking static target lib/librte_rib.a 00:01:31.728 [395/745] Compiling C object lib/librte_table.a.p/table_rte_swx_table_learner.c.o 00:01:31.728 [396/745] Compiling C object lib/librte_table.a.p/table_rte_swx_table_em.c.o 00:01:31.728 [397/745] Compiling C object lib/librte_port.a.p/port_rte_port_sched.c.o 00:01:31.992 [398/745] Generating lib/rte_table_def with a custom command 00:01:31.992 [399/745] Generating lib/rte_table_mingw with a custom command 00:01:32.259 [400/745] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_eth_rx_adapter.c.o 00:01:32.259 [401/745] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:01:32.259 [402/745] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:01:32.259 [403/745] Linking static target lib/librte_ethdev.a 00:01:32.259 [404/745] Generating lib/acl.sym_chk with a custom command (wrapped by meson to capture output) 00:01:32.259 [405/745] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:01:32.527 [406/745] Linking static target lib/librte_mbuf.a 00:01:32.527 [407/745] Generating lib/rib.sym_chk with a custom command (wrapped by meson to capture output) 00:01:32.527 [408/745] Compiling C object lib/librte_port.a.p/port_rte_port_frag.c.o 00:01:32.527 [409/745] Compiling C object lib/librte_port.a.p/port_rte_port_fd.c.o 00:01:32.527 [410/745] Compiling C object lib/librte_port.a.p/port_rte_port_ras.c.o 00:01:32.527 [411/745] Generating lib/rte_pipeline_def with a custom command 00:01:32.527 [412/745] Generating lib/rte_pipeline_mingw with a custom command 00:01:32.527 [413/745] Compiling C object lib/librte_table.a.p/table_rte_table_array.c.o 00:01:32.527 [414/745] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:01:32.527 [415/745] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:01:32.527 [416/745] Compiling C object lib/librte_fib.a.p/fib_trie.c.o 00:01:32.527 [417/745] Compiling C object lib/librte_port.a.p/port_rte_port_ethdev.c.o 00:01:32.527 [418/745] Compiling C object lib/librte_table.a.p/table_rte_swx_table_wm.c.o 00:01:32.527 [419/745] Compiling C object lib/librte_table.a.p/table_rte_swx_table_selector.c.o 00:01:32.793 [420/745] Generating lib/rte_graph_def with a custom command 00:01:32.793 [421/745] Generating lib/rte_graph_mingw with a custom command 00:01:32.793 [422/745] Compiling C object lib/librte_fib.a.p/fib_dir24_8.c.o 00:01:32.793 [423/745] Linking static target lib/librte_fib.a 00:01:32.793 [424/745] Compiling C object lib/librte_table.a.p/table_rte_table_hash_cuckoo.c.o 00:01:32.793 [425/745] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_timer_adapter.c.o 00:01:32.793 [426/745] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:01:32.793 [427/745] Compiling C object lib/librte_table.a.p/table_rte_table_acl.c.o 00:01:32.793 [428/745] Compiling C object lib/librte_member.a.p/member_rte_member_sketch.c.o 00:01:32.793 [429/745] Linking static target lib/librte_eventdev.a 00:01:32.793 [430/745] Linking static target lib/librte_member.a 00:01:32.793 [431/745] Compiling C object lib/librte_table.a.p/table_rte_table_lpm.c.o 00:01:33.054 [432/745] Compiling C object lib/librte_port.a.p/port_rte_port_sym_crypto.c.o 00:01:33.054 [433/745] Compiling C object lib/librte_node.a.p/node_null.c.o 00:01:33.054 [434/745] Compiling C object lib/librte_port.a.p/port_rte_swx_port_ethdev.c.o 00:01:33.054 [435/745] Compiling C object lib/librte_table.a.p/table_rte_table_stub.c.o 00:01:33.054 [436/745] Compiling C object lib/librte_table.a.p/table_rte_table_lpm_ipv6.c.o 00:01:33.054 [437/745] Generating lib/rte_node_def with a custom command 00:01:33.054 [438/745] Compiling C object lib/librte_port.a.p/port_rte_swx_port_fd.c.o 00:01:33.054 [439/745] Generating lib/rte_node_mingw with a custom command 00:01:33.314 [440/745] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:33.314 [441/745] Generating lib/fib.sym_chk with a custom command (wrapped by meson to capture output) 00:01:33.314 [442/745] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:01:33.314 [443/745] Compiling C object lib/librte_sched.a.p/sched_rte_sched.c.o 00:01:33.314 [444/745] Linking static target lib/librte_sched.a 00:01:33.314 [445/745] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:01:33.314 [446/745] Generating drivers/rte_bus_pci_def with a custom command 00:01:33.314 [447/745] Compiling C object lib/librte_port.a.p/port_rte_port_eventdev.c.o 00:01:33.314 [448/745] Generating drivers/rte_bus_pci_mingw with a custom command 00:01:33.314 [449/745] Generating drivers/rte_bus_vdev_def with a custom command 00:01:33.314 [450/745] Generating lib/member.sym_chk with a custom command (wrapped by meson to capture output) 00:01:33.577 [451/745] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:01:33.577 [452/745] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:01:33.577 [453/745] Generating drivers/rte_bus_vdev_mingw with a custom command 00:01:33.577 [454/745] Generating drivers/rte_mempool_ring_def with a custom command 00:01:33.577 [455/745] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_port_in_action.c.o 00:01:33.577 [456/745] Generating drivers/rte_mempool_ring_mingw with a custom command 00:01:33.577 [457/745] Compiling C object lib/librte_ipsec.a.p/ipsec_esp_outb.c.o 00:01:33.577 [458/745] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:01:33.577 [459/745] Linking static target lib/librte_cryptodev.a 00:01:33.577 [460/745] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:01:33.577 [461/745] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key8.c.o 00:01:33.577 [462/745] Compiling C object lib/librte_port.a.p/port_rte_swx_port_ring.c.o 00:01:33.839 [463/745] Compiling C object lib/librte_pdump.a.p/pdump_rte_pdump.c.o 00:01:33.839 [464/745] Linking static target lib/librte_pdump.a 00:01:33.839 [465/745] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:01:33.839 [466/745] Compiling C object lib/librte_graph.a.p/graph_graph_debug.c.o 00:01:33.839 [467/745] Compiling C object lib/librte_graph.a.p/graph_graph_ops.c.o 00:01:33.839 [468/745] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key16.c.o 00:01:33.839 [469/745] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:01:33.839 [470/745] Linking static target drivers/libtmp_rte_bus_vdev.a 00:01:33.839 [471/745] Compiling C object lib/librte_table.a.p/table_rte_table_hash_ext.c.o 00:01:33.839 [472/745] Compiling C object lib/librte_graph.a.p/graph_graph_populate.c.o 00:01:33.839 [473/745] Compiling C object lib/librte_graph.a.p/graph_node.c.o 00:01:34.103 [474/745] Generating lib/sched.sym_chk with a custom command (wrapped by meson to capture output) 00:01:34.103 [475/745] Compiling C object lib/librte_node.a.p/node_ethdev_ctrl.c.o 00:01:34.103 [476/745] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:01:34.103 [477/745] Compiling C object lib/librte_graph.a.p/graph_graph.c.o 00:01:34.103 [478/745] Compiling C object lib/librte_table.a.p/table_rte_table_hash_lru.c.o 00:01:34.103 [479/745] Compiling C object lib/librte_node.a.p/node_log.c.o 00:01:34.103 [480/745] Generating drivers/rte_net_i40e_def with a custom command 00:01:34.103 [481/745] Generating drivers/rte_net_i40e_mingw with a custom command 00:01:34.362 [482/745] Generating lib/pdump.sym_chk with a custom command (wrapped by meson to capture output) 00:01:34.362 [483/745] Compiling C object lib/librte_node.a.p/node_pkt_drop.c.o 00:01:34.362 [484/745] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:01:34.362 [485/745] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:34.362 [486/745] Linking static target drivers/librte_bus_vdev.a 00:01:34.362 [487/745] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key32.c.o 00:01:34.362 [488/745] Linking static target lib/librte_table.a 00:01:34.362 [489/745] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_pipeline.c.o 00:01:34.362 [490/745] Compiling C object lib/librte_ipsec.a.p/ipsec_esp_inb.c.o 00:01:34.362 [491/745] Compiling C object drivers/librte_bus_vdev.so.23.0.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:34.362 [492/745] Linking static target lib/librte_ipsec.a 00:01:34.626 [493/745] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:01:34.626 [494/745] Linking static target drivers/libtmp_rte_bus_pci.a 00:01:34.626 [495/745] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:34.889 [496/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_diag.c.o 00:01:34.889 [497/745] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_main.c.o 00:01:34.889 [498/745] Compiling C object lib/librte_port.a.p/port_rte_swx_port_source_sink.c.o 00:01:34.889 [499/745] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_ctl.c.o 00:01:34.889 [500/745] Compiling C object lib/librte_node.a.p/node_ethdev_tx.c.o 00:01:34.889 [501/745] Compiling C object lib/librte_graph.a.p/graph_graph_stats.c.o 00:01:34.889 [502/745] Linking static target lib/librte_graph.a 00:01:35.154 [503/745] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:01:35.154 [504/745] Compiling C object app/dpdk-test-cmdline.p/test-cmdline_cmdline_test.c.o 00:01:35.154 [505/745] Generating lib/ipsec.sym_chk with a custom command (wrapped by meson to capture output) 00:01:35.154 [506/745] Compiling C object app/dpdk-test-cmdline.p/test-cmdline_commands.c.o 00:01:35.154 [507/745] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:35.154 [508/745] Compiling C object drivers/librte_bus_pci.so.23.0.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:35.154 [509/745] Linking static target drivers/librte_bus_pci.a 00:01:35.154 [510/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_hmc.c.o 00:01:35.154 [511/745] Compiling C object lib/librte_node.a.p/node_ethdev_rx.c.o 00:01:35.154 [512/745] Compiling C object lib/librte_port.a.p/port_rte_port_ring.c.o 00:01:35.415 [513/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_dcb.c.o 00:01:35.415 [514/745] Generating lib/table.sym_chk with a custom command (wrapped by meson to capture output) 00:01:35.683 [515/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_vf_representor.c.o 00:01:35.683 [516/745] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:35.683 [517/745] Generating lib/eventdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:35.945 [518/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_lan_hmc.c.o 00:01:35.945 [519/745] Compiling C object lib/librte_port.a.p/port_rte_port_source_sink.c.o 00:01:35.945 [520/745] Linking static target lib/librte_port.a 00:01:35.945 [521/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_hash.c.o 00:01:35.945 [522/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_tm.c.o 00:01:36.208 [523/745] Compiling C object app/dpdk-test-acl.p/test-acl_main.c.o 00:01:36.208 [524/745] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:01:36.208 [525/745] Linking static target drivers/libtmp_rte_mempool_ring.a 00:01:36.208 [526/745] Compiling C object app/dpdk-dumpcap.p/dumpcap_main.c.o 00:01:36.469 [527/745] Generating lib/graph.sym_chk with a custom command (wrapped by meson to capture output) 00:01:36.469 [528/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_pf.c.o 00:01:36.469 [529/745] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_options_parse.c.o 00:01:36.469 [530/745] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:01:36.469 [531/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_test.c.o 00:01:36.469 [532/745] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:36.469 [533/745] Linking static target drivers/librte_mempool_ring.a 00:01:36.469 [534/745] Compiling C object drivers/librte_mempool_ring.so.23.0.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:36.730 [535/745] Compiling C object app/dpdk-proc-info.p/proc-info_main.c.o 00:01:36.730 [536/745] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_main.c.o 00:01:36.730 [537/745] Compiling C object app/dpdk-pdump.p/pdump_main.c.o 00:01:36.730 [538/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_common.c.o 00:01:36.730 [539/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_parser.c.o 00:01:36.996 [540/745] Generating lib/port.sym_chk with a custom command (wrapped by meson to capture output) 00:01:36.996 [541/745] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:37.263 [542/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_ops.c.o 00:01:37.263 [543/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_fdir.c.o 00:01:37.263 [544/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_options_parsing.c.o 00:01:37.263 [545/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_vectors.c.o 00:01:37.524 [546/745] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev_vector.c.o 00:01:37.524 [547/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_vector_parsing.c.o 00:01:37.524 [548/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_main.c.o 00:01:37.791 [549/745] Compiling C object drivers/net/i40e/libi40e_avx512_lib.a.p/i40e_rxtx_vec_avx512.c.o 00:01:37.791 [550/745] Linking static target drivers/net/i40e/libi40e_avx512_lib.a 00:01:37.791 [551/745] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_pipeline_spec.c.o 00:01:37.791 [552/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_options.c.o 00:01:37.791 [553/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_main.c.o 00:01:38.055 [554/745] Compiling C object drivers/net/i40e/libi40e_avx2_lib.a.p/i40e_rxtx_vec_avx2.c.o 00:01:38.055 [555/745] Linking static target drivers/net/i40e/libi40e_avx2_lib.a 00:01:38.055 [556/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_adminq.c.o 00:01:38.316 [557/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_common.c.o 00:01:38.316 [558/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_common.c.o 00:01:38.579 [559/745] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_flow_gen.c.o 00:01:38.579 [560/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_flow.c.o 00:01:38.579 [561/745] Compiling C object lib/librte_node.a.p/node_pkt_cls.c.o 00:01:38.841 [562/745] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_items_gen.c.o 00:01:38.841 [563/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_queue.c.o 00:01:38.841 [564/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_atq.c.o 00:01:38.841 [565/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_config.c.o 00:01:38.841 [566/745] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:01:38.841 [567/745] Compiling C object app/dpdk-test-gpudev.p/test-gpudev_main.c.o 00:01:39.107 [568/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_nvm.c.o 00:01:39.107 [569/745] Linking static target drivers/net/i40e/base/libi40e_base.a 00:01:39.107 [570/745] Linking target lib/librte_eal.so.23.0 00:01:39.107 [571/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_init.c.o 00:01:39.107 [572/745] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_actions_gen.c.o 00:01:39.107 [573/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_main.c.o 00:01:39.107 [574/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_rte_pmd_i40e.c.o 00:01:39.369 [575/745] Generating symbol file lib/librte_eal.so.23.0.p/librte_eal.so.23.0.symbols 00:01:39.369 [576/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_acl.c.o 00:01:39.369 [577/745] Linking target lib/librte_ring.so.23.0 00:01:39.369 [578/745] Linking target lib/librte_meter.so.23.0 00:01:39.369 [579/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_queue.c.o 00:01:39.369 [580/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_atq.c.o 00:01:39.369 [581/745] Linking target lib/librte_pci.so.23.0 00:01:39.369 [582/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_lpm.c.o 00:01:39.633 [583/745] Linking target lib/librte_timer.so.23.0 00:01:39.633 [584/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_lpm_ipv6.c.o 00:01:39.633 [585/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_stub.c.o 00:01:39.634 [586/745] Generating symbol file lib/librte_ring.so.23.0.p/librte_ring.so.23.0.symbols 00:01:39.634 [587/745] Linking target lib/librte_acl.so.23.0 00:01:39.634 [588/745] Linking target lib/librte_cfgfile.so.23.0 00:01:39.634 [589/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_hash.c.o 00:01:39.634 [590/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_common.c.o 00:01:39.634 [591/745] Generating symbol file lib/librte_meter.so.23.0.p/librte_meter.so.23.0.symbols 00:01:39.634 [592/745] Linking target lib/librte_jobstats.so.23.0 00:01:39.634 [593/745] Linking target lib/librte_rcu.so.23.0 00:01:39.634 [594/745] Linking target lib/librte_mempool.so.23.0 00:01:39.634 [595/745] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:39.634 [596/745] Linking target lib/librte_rawdev.so.23.0 00:01:39.634 [597/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_atq.c.o 00:01:39.634 [598/745] Linking target lib/librte_stack.so.23.0 00:01:39.634 [599/745] Generating symbol file lib/librte_pci.so.23.0.p/librte_pci.so.23.0.symbols 00:01:39.634 [600/745] Linking target lib/librte_dmadev.so.23.0 00:01:39.634 [601/745] Linking target lib/librte_graph.so.23.0 00:01:39.634 [602/745] Linking target drivers/librte_bus_vdev.so.23.0 00:01:39.634 [603/745] Generating symbol file lib/librte_timer.so.23.0.p/librte_timer.so.23.0.symbols 00:01:39.896 [604/745] Compiling C object app/dpdk-test-fib.p/test-fib_main.c.o 00:01:39.896 [605/745] Linking target drivers/librte_bus_pci.so.23.0 00:01:39.896 [606/745] Generating symbol file lib/librte_acl.so.23.0.p/librte_acl.so.23.0.symbols 00:01:39.896 [607/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_queue.c.o 00:01:39.896 [608/745] Generating symbol file lib/librte_rcu.so.23.0.p/librte_rcu.so.23.0.symbols 00:01:39.896 [609/745] Generating symbol file lib/librte_mempool.so.23.0.p/librte_mempool.so.23.0.symbols 00:01:39.896 [610/745] Generating symbol file lib/librte_dmadev.so.23.0.p/librte_dmadev.so.23.0.symbols 00:01:39.896 [611/745] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev.c.o 00:01:39.896 [612/745] Generating symbol file drivers/librte_bus_vdev.so.23.0.p/librte_bus_vdev.so.23.0.symbols 00:01:39.896 [613/745] Generating symbol file lib/librte_graph.so.23.0.p/librte_graph.so.23.0.symbols 00:01:39.896 [614/745] Linking target lib/librte_mbuf.so.23.0 00:01:39.896 [615/745] Linking target lib/librte_rib.so.23.0 00:01:39.896 [616/745] Generating symbol file drivers/librte_bus_pci.so.23.0.p/librte_bus_pci.so.23.0.symbols 00:01:40.163 [617/745] Linking target drivers/librte_mempool_ring.so.23.0 00:01:40.163 [618/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_rxtx_vec_sse.c.o 00:01:40.163 [619/745] Compiling C object app/dpdk-testpmd.p/test-pmd_cmd_flex_item.c.o 00:01:40.163 [620/745] Generating symbol file lib/librte_mbuf.so.23.0.p/librte_mbuf.so.23.0.symbols 00:01:40.163 [621/745] Generating symbol file lib/librte_rib.so.23.0.p/librte_rib.so.23.0.symbols 00:01:40.163 [622/745] Linking target lib/librte_net.so.23.0 00:01:40.425 [623/745] Linking target lib/librte_bbdev.so.23.0 00:01:40.425 [624/745] Linking target lib/librte_compressdev.so.23.0 00:01:40.425 [625/745] Linking target lib/librte_cryptodev.so.23.0 00:01:40.425 [626/745] Generating symbol file lib/librte_net.so.23.0.p/librte_net.so.23.0.symbols 00:01:40.425 [627/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_throughput.c.o 00:01:40.687 [628/745] Linking target lib/librte_ethdev.so.23.0 00:01:40.687 [629/745] Linking target lib/librte_cmdline.so.23.0 00:01:40.687 [630/745] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_mtr.c.o 00:01:40.687 [631/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_verify.c.o 00:01:40.687 [632/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_runtime.c.o 00:01:40.687 [633/745] Linking target lib/librte_hash.so.23.0 00:01:40.687 [634/745] Linking target lib/librte_distributor.so.23.0 00:01:40.687 [635/745] Linking target lib/librte_gpudev.so.23.0 00:01:40.687 [636/745] Compiling C object app/dpdk-testpmd.p/test-pmd_5tswap.c.o 00:01:40.687 [637/745] Generating symbol file lib/librte_cryptodev.so.23.0.p/librte_cryptodev.so.23.0.symbols 00:01:40.687 [638/745] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_main.c.o 00:01:40.687 [639/745] Compiling C object lib/librte_node.a.p/node_ip4_lookup.c.o 00:01:40.687 [640/745] Linking target lib/librte_regexdev.so.23.0 00:01:40.687 [641/745] Linking target lib/librte_reorder.so.23.0 00:01:40.687 [642/745] Linking target lib/librte_sched.so.23.0 00:01:40.687 [643/745] Linking target lib/librte_security.so.23.0 00:01:40.687 [644/745] Linking target lib/librte_fib.so.23.0 00:01:40.947 [645/745] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_tm.c.o 00:01:40.947 [646/745] Generating symbol file lib/librte_ethdev.so.23.0.p/librte_ethdev.so.23.0.symbols 00:01:40.947 [647/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_pmd_cyclecount.c.o 00:01:40.947 [648/745] Linking target lib/librte_metrics.so.23.0 00:01:40.947 [649/745] Linking target lib/librte_pcapng.so.23.0 00:01:40.947 [650/745] Generating symbol file lib/librte_hash.so.23.0.p/librte_hash.so.23.0.symbols 00:01:40.947 [651/745] Linking target lib/librte_bpf.so.23.0 00:01:40.947 [652/745] Linking target lib/librte_gso.so.23.0 00:01:40.947 [653/745] Linking target lib/librte_power.so.23.0 00:01:40.947 [654/745] Linking target lib/librte_gro.so.23.0 00:01:40.947 [655/745] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_throughput.c.o 00:01:40.947 [656/745] Linking target lib/librte_efd.so.23.0 00:01:40.947 [657/745] Linking target lib/librte_lpm.so.23.0 00:01:40.947 [658/745] Linking target lib/librte_ip_frag.so.23.0 00:01:40.947 [659/745] Linking target lib/librte_member.so.23.0 00:01:40.947 [660/745] Generating symbol file lib/librte_sched.so.23.0.p/librte_sched.so.23.0.symbols 00:01:40.947 [661/745] Generating symbol file lib/librte_security.so.23.0.p/librte_security.so.23.0.symbols 00:01:40.947 [662/745] Linking target lib/librte_eventdev.so.23.0 00:01:41.205 [663/745] Linking target lib/librte_ipsec.so.23.0 00:01:41.205 [664/745] Compiling C object app/dpdk-testpmd.p/test-pmd_ieee1588fwd.c.o 00:01:41.205 [665/745] Compiling C object app/dpdk-testpmd.p/test-pmd_iofwd.c.o 00:01:41.205 [666/745] Generating symbol file lib/librte_pcapng.so.23.0.p/librte_pcapng.so.23.0.symbols 00:01:41.205 [667/745] Compiling C object app/dpdk-testpmd.p/test-pmd_flowgen.c.o 00:01:41.205 [668/745] Generating symbol file lib/librte_metrics.so.23.0.p/librte_metrics.so.23.0.symbols 00:01:41.205 [669/745] Generating symbol file lib/librte_bpf.so.23.0.p/librte_bpf.so.23.0.symbols 00:01:41.205 [670/745] Generating symbol file lib/librte_lpm.so.23.0.p/librte_lpm.so.23.0.symbols 00:01:41.205 [671/745] Generating symbol file lib/librte_ip_frag.so.23.0.p/librte_ip_frag.so.23.0.symbols 00:01:41.205 [672/745] Linking target lib/librte_latencystats.so.23.0 00:01:41.205 [673/745] Linking target lib/librte_pdump.so.23.0 00:01:41.205 [674/745] Linking target lib/librte_bitratestats.so.23.0 00:01:41.205 [675/745] Generating symbol file lib/librte_eventdev.so.23.0.p/librte_eventdev.so.23.0.symbols 00:01:41.205 [676/745] Compiling C object app/dpdk-testpmd.p/test-pmd_icmpecho.c.o 00:01:41.205 [677/745] Compiling C object app/dpdk-testpmd.p/test-pmd_bpf_cmd.c.o 00:01:41.205 [678/745] Compiling C object app/dpdk-testpmd.p/test-pmd_macfwd.c.o 00:01:41.463 [679/745] Linking target lib/librte_port.so.23.0 00:01:41.463 [680/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_common.c.o 00:01:41.464 [681/745] Compiling C object app/dpdk-testpmd.p/test-pmd_util.c.o 00:01:41.464 [682/745] Compiling C object app/dpdk-testpmd.p/test-pmd_rxonly.c.o 00:01:41.464 [683/745] Generating symbol file lib/librte_port.so.23.0.p/librte_port.so.23.0.symbols 00:01:41.464 [684/745] Compiling C object app/dpdk-testpmd.p/test-pmd_shared_rxq_fwd.c.o 00:01:41.464 [685/745] Linking target lib/librte_table.so.23.0 00:01:41.722 [686/745] Compiling C object app/dpdk-testpmd.p/test-pmd_parameters.c.o 00:01:41.722 [687/745] Compiling C object app/dpdk-testpmd.p/.._drivers_net_i40e_i40e_testpmd.c.o 00:01:41.722 [688/745] Compiling C object app/dpdk-test-sad.p/test-sad_main.c.o 00:01:41.722 [689/745] Compiling C object app/dpdk-test-security-perf.p/test-security-perf_test_security_perf.c.o 00:01:41.722 [690/745] Generating symbol file lib/librte_table.so.23.0.p/librte_table.so.23.0.symbols 00:01:41.722 [691/745] Compiling C object app/dpdk-testpmd.p/test-pmd_macswap.c.o 00:01:41.722 [692/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_latency.c.o 00:01:41.980 [693/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_rxtx.c.o 00:01:41.980 [694/745] Compiling C object app/dpdk-test-regex.p/test-regex_main.c.o 00:01:42.238 [695/745] Compiling C object app/dpdk-testpmd.p/test-pmd_csumonly.c.o 00:01:42.496 [696/745] Compiling C object app/dpdk-test-security-perf.p/test_test_cryptodev_security_ipsec.c.o 00:01:42.496 [697/745] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_common.c.o 00:01:42.496 [698/745] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_verify.c.o 00:01:42.496 [699/745] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_cyclecount.c.o 00:01:42.754 [700/745] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline.c.o 00:01:43.028 [701/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_ethdev.c.o 00:01:43.028 [702/745] Linking static target drivers/libtmp_rte_net_i40e.a 00:01:43.028 [703/745] Compiling C object app/dpdk-testpmd.p/test-pmd_testpmd.c.o 00:01:43.286 [704/745] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_pipeline.c.o 00:01:43.544 [705/745] Generating drivers/rte_net_i40e.pmd.c with a custom command 00:01:43.544 [706/745] Compiling C object drivers/librte_net_i40e.so.23.0.p/meson-generated_.._rte_net_i40e.pmd.c.o 00:01:43.544 [707/745] Compiling C object drivers/librte_net_i40e.a.p/meson-generated_.._rte_net_i40e.pmd.c.o 00:01:43.544 [708/745] Linking static target drivers/librte_net_i40e.a 00:01:43.544 [709/745] Compiling C object app/dpdk-testpmd.p/test-pmd_noisy_vnf.c.o 00:01:44.110 [710/745] Compiling C object app/dpdk-testpmd.p/test-pmd_txonly.c.o 00:01:44.110 [711/745] Generating drivers/rte_net_i40e.sym_chk with a custom command (wrapped by meson to capture output) 00:01:44.110 [712/745] Linking target drivers/librte_net_i40e.so.23.0 00:01:44.368 [713/745] Compiling C object lib/librte_node.a.p/node_ip4_rewrite.c.o 00:01:44.368 [714/745] Linking static target lib/librte_node.a 00:01:44.625 [715/745] Generating lib/node.sym_chk with a custom command (wrapped by meson to capture output) 00:01:44.625 [716/745] Linking target lib/librte_node.so.23.0 00:01:45.190 [717/745] Compiling C object app/dpdk-testpmd.p/test-pmd_config.c.o 00:01:46.124 [718/745] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev_perf.c.o 00:01:46.381 [719/745] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_flow.c.o 00:01:54.493 [720/745] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:02:26.556 [721/745] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:02:26.556 [722/745] Linking static target lib/librte_vhost.a 00:02:26.556 [723/745] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:02:26.556 [724/745] Linking target lib/librte_vhost.so.23.0 00:02:34.666 [725/745] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_table_action.c.o 00:02:34.666 [726/745] Linking static target lib/librte_pipeline.a 00:02:34.924 [727/745] Linking target app/dpdk-dumpcap 00:02:35.182 [728/745] Linking target app/dpdk-test-pipeline 00:02:35.182 [729/745] Linking target app/dpdk-test-regex 00:02:35.182 [730/745] Linking target app/dpdk-test-gpudev 00:02:35.182 [731/745] Linking target app/dpdk-test-acl 00:02:35.182 [732/745] Linking target app/dpdk-test-security-perf 00:02:35.182 [733/745] Linking target app/dpdk-test-fib 00:02:35.182 [734/745] Linking target app/dpdk-test-sad 00:02:35.182 [735/745] Linking target app/dpdk-test-cmdline 00:02:35.182 [736/745] Linking target app/dpdk-test-flow-perf 00:02:35.182 [737/745] Linking target app/dpdk-pdump 00:02:35.182 [738/745] Linking target app/dpdk-proc-info 00:02:35.182 [739/745] Linking target app/dpdk-test-bbdev 00:02:35.182 [740/745] Linking target app/dpdk-test-eventdev 00:02:35.182 [741/745] Linking target app/dpdk-test-compress-perf 00:02:35.182 [742/745] Linking target app/dpdk-test-crypto-perf 00:02:35.182 [743/745] Linking target app/dpdk-testpmd 00:02:37.083 [744/745] Generating lib/pipeline.sym_chk with a custom command (wrapped by meson to capture output) 00:02:37.083 [745/745] Linking target lib/librte_pipeline.so.23.0 00:02:37.083 01:03:45 -- common/autobuild_common.sh@190 -- $ ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp -j48 install 00:02:37.083 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp' 00:02:37.083 [0/1] Installing files. 00:02:37.343 Installing subdir /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples 00:02:37.343 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq 00:02:37.343 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/packet_ordering/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/packet_ordering 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/packet_ordering/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/packet_ordering 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/skeleton/basicfwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/skeleton 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/skeleton/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/skeleton 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/helloworld/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/helloworld 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/helloworld/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/helloworld 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/obj.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/obj.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/conn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/conn.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_table.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/mirroring.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/hash_func.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/recirculation.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/varbit.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/hash_func.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/meter.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/registers.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/varbit.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/learner.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ethdev.io to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/learner.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/mirroring.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_nexthop_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/recirculation.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/meter.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_routing_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/registers.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_nexthop_group_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/pcap.io to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/packet.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_ecdsa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_xts.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_cmac.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_tdes.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_hmac.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_ccm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_aes.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_dev_self_test.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_rsa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_sha.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_gcm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_dev_self_test.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-jobstats/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-jobstats 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-jobstats/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-jobstats 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_classify/flow_classify.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_classify 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_classify/ipv4_rules_file.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_classify 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_classify/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_classify 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/service_cores/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/service_cores 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/service_cores/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/service_cores 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/virtio_net.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/pkt_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/sse/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/sse 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/altivec/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/altivec 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/neon/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/neon 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/flow_blocks.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_fragmentation/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_fragmentation 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_fragmentation/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_fragmentation 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_crypto/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_crypto 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_crypto/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_crypto 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor_nop.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_monitor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/power_manager.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/vm_power_cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_monitor.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_manager.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_manager.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/power_manager.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor_x86.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/vm_power_cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/vm_power_cli_guest.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/vm_power_cli_guest.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/perf_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/perf_core.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/rxtx_callbacks/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/rxtx_callbacks 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/rxtx_callbacks/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/rxtx_callbacks 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/link_status_interrupt/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/link_status_interrupt 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/link_status_interrupt/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/link_status_interrupt 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bbdev_app/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bbdev_app 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bbdev_app/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bbdev_app 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:37.344 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_poll.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_poll.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_common.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event_internal_port.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t2.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/README to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t1.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/dummy.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t3.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/blk.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk_compat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/blk_spec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/node/node.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/node 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/node/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/node 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/args.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/init.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/shared/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/shared 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ptpclient/ptpclient.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ptpclient 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ptpclient/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ptpclient 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_reassembly/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_reassembly 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_reassembly/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_reassembly 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/parse_obj_list.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/parse_obj_list.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/commands.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/vdpa_blk_compact.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/dma/dmafwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/dma 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/dma/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/dma 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/rte_policer.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/rte_policer.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/cat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/cat.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/l2fwd-cat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/timer/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/timer 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/timer/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/timer 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/stats.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_red.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_pie.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cfg_file.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_ov.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cmdline.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cfg_file.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/app_thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipv4_multicast/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipv4_multicast 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipv4_multicast/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipv4_multicast 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_route.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl_scalar.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_default_v4.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_sequential.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_route_parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_default_v6.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_default_v4.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_fib.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_route_parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_default_v6.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event_internal_port.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/event_helper.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_worker.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/parser.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_worker.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec-secgw.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_process.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sp4.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/esp.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sad.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/flow.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/parser.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ep1.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sad.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/flow.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/rt.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/event_helper.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/esp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ep0.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipip.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec-secgw.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sp6.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesctr_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_3descbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aescbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/run_test.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aescbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/bypass_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesctr_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aescbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:37.345 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/common_defs_secgw.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesctr_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesgcm_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/pkttest.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/linux_test.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/data_rxtx.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_3descbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_null_header_reconstruct.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_3descbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_ipv6opts.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/pkttest.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/load_env.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_3descbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesgcm_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aescbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesctr_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesgcm_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesgcm_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/shm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/shm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/ka-agent/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive/ka-agent 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/ka-agent/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive/ka-agent 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/link.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/action.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cryptodev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/conn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/conn.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cryptodev.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/parser.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/mempool.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/swq.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/parser.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tmgr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/swq.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tmgr.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tap.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/kni.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tap.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/mempool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/link.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/pipeline.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/kni.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/kni.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/firewall.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/route_ecmp.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/flow.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/route.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/l2fwd.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/flow_crypto.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/tap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/rss.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq_dcb/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq_dcb 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq_dcb/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq_dcb 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ntb/ntb_fwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ntb 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ntb/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ntb 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/ethapp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/ethapp.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/rte_ethtool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/rte_ethtool.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:02:37.346 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process 00:02:37.605 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/mp_commands.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:37.605 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:37.605 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/mp_commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:37.605 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:37.605 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/commands.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:37.605 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:37.605 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:37.605 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:37.605 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp 00:02:37.605 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_client/client.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_client 00:02:37.605 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_client/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_client 00:02:37.605 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:37.605 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/args.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:37.605 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/init.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:37.605 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:37.605 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:37.606 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:37.606 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/shared/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/shared 00:02:37.606 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/symmetric_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/symmetric_mp 00:02:37.606 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/symmetric_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/symmetric_mp 00:02:37.606 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_worker_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:37.606 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:37.606 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:37.606 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_worker_tx.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:37.606 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:37.606 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/distributor/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/distributor 00:02:37.606 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/distributor/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/distributor 00:02:37.606 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-graph/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-graph 00:02:37.606 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-graph/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-graph 00:02:37.606 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-crypto/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-crypto 00:02:37.606 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-crypto/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-crypto 00:02:37.606 Installing lib/librte_kvargs.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_kvargs.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_telemetry.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_telemetry.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_eal.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_eal.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_ring.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_ring.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_rcu.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_rcu.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_mempool.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_mempool.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_mbuf.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_mbuf.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_net.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_net.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_meter.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_meter.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_ethdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_ethdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_pci.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_pci.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_cmdline.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_cmdline.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_metrics.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_metrics.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_hash.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_hash.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_timer.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_timer.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_acl.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_acl.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_bbdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_bbdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_bitratestats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_bitratestats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_bpf.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_bpf.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_cfgfile.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_cfgfile.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_compressdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_compressdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_cryptodev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_cryptodev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_distributor.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_distributor.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_efd.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_efd.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_eventdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_eventdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_gpudev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_gpudev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_gro.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_gro.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_gso.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_gso.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_ip_frag.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_ip_frag.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_jobstats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_jobstats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_latencystats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_latencystats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_lpm.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_lpm.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_member.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_member.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_pcapng.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_pcapng.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_power.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_power.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_rawdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_rawdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_regexdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_regexdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_dmadev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_dmadev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_rib.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_rib.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_reorder.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_reorder.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_sched.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_sched.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_security.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_security.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_stack.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_stack.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_vhost.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_vhost.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_ipsec.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.606 Installing lib/librte_ipsec.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.607 Installing lib/librte_fib.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.607 Installing lib/librte_fib.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.607 Installing lib/librte_port.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.607 Installing lib/librte_port.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.607 Installing lib/librte_pdump.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.607 Installing lib/librte_pdump.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.607 Installing lib/librte_table.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.607 Installing lib/librte_table.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.607 Installing lib/librte_pipeline.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.607 Installing lib/librte_pipeline.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:37.607 Installing lib/librte_graph.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:38.176 Installing lib/librte_graph.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:38.176 Installing lib/librte_node.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:38.176 Installing lib/librte_node.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:38.176 Installing drivers/librte_bus_pci.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:38.176 Installing drivers/librte_bus_pci.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0 00:02:38.176 Installing drivers/librte_bus_vdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:38.176 Installing drivers/librte_bus_vdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0 00:02:38.176 Installing drivers/librte_mempool_ring.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:38.176 Installing drivers/librte_mempool_ring.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0 00:02:38.176 Installing drivers/librte_net_i40e.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:38.176 Installing drivers/librte_net_i40e.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0 00:02:38.176 Installing app/dpdk-dumpcap to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:38.176 Installing app/dpdk-pdump to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:38.176 Installing app/dpdk-proc-info to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:38.176 Installing app/dpdk-test-acl to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:38.176 Installing app/dpdk-test-bbdev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:38.176 Installing app/dpdk-test-cmdline to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:38.176 Installing app/dpdk-test-compress-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:38.176 Installing app/dpdk-test-crypto-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:38.176 Installing app/dpdk-test-eventdev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:38.176 Installing app/dpdk-test-fib to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:38.176 Installing app/dpdk-test-flow-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:38.176 Installing app/dpdk-test-gpudev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:38.176 Installing app/dpdk-test-pipeline to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:38.176 Installing app/dpdk-testpmd to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:38.176 Installing app/dpdk-test-regex to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:38.176 Installing app/dpdk-test-sad to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:38.176 Installing app/dpdk-test-security-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/config/rte_config.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/kvargs/rte_kvargs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/telemetry/rte_telemetry.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_atomic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_byteorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_cpuflags.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_cycles.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_io.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_memcpy.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_pause.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_power_intrinsics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_prefetch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_rwlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_spinlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_vect.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_cpuflags.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_cycles.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_io.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_memcpy.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_pause.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_power_intrinsics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_prefetch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_rtm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_rwlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_spinlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_vect.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic_32.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic_64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder_32.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder_64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_alarm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bitmap.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bitops.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_branch_prediction.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bus.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_class.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_compat.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_debug.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_dev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_devargs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal_memconfig.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_errno.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_epoll.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_fbarray.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_hexdump.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_hypervisor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_interrupts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_keepalive.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_launch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_lcore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_log.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_malloc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_mcslock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_memory.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_memzone.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pci_dev_feature_defs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pci_dev_features.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_per_lcore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pflock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_random.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_reciprocal.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_seqcount.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_seqlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_service.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_service_component.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_string_fns.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_tailq.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_ticketlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_time.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace_point.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace_point_register.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_uuid.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_version.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_vfio.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/linux/include/rte_os.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_elem.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_c11_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_generic_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_hts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_hts_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek_zc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_rts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_rts_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rcu/rte_rcu_qsbr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mempool/rte_mempool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mempool/rte_mempool_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mempool/rte_mempool_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_ptype.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_pool_ops.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_dyn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ip.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_tcp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_udp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_esp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_sctp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_icmp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_arp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ether.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_macsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_vxlan.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_gre.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_gtp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_net.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_net_crc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_mpls.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_higig.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ecpri.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_geneve.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_l2tpv2.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ppp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/meter/rte_meter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_cman.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_dev_info.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_flow.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_flow_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_mtr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_mtr_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_tm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_tm_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_eth_ctrl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pci/rte_pci.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_num.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_ipaddr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_etheraddr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_string.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_rdline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_vt100.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_socket.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_cirbuf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_portlist.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/metrics/rte_metrics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/metrics/rte_metrics_telemetry.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_fbk_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_hash_crc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_jhash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash_gfni.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_generic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_sw.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_x86.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash_x86_gfni.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/timer/rte_timer.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/acl/rte_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/acl/rte_acl_osdep.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev_pmd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev_op.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bitratestats/rte_bitrate.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/bpf_def.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/rte_bpf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/rte_bpf_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cfgfile/rte_cfgfile.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/compressdev/rte_compressdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/compressdev/rte_comp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto_sym.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto_asym.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/distributor/rte_distributor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/efd/rte_efd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_crypto_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_eth_rx_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_eth_tx_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_timer_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gpudev/rte_gpudev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gro/rte_gro.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gso/rte_gso.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ip_frag/rte_ip_frag.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/jobstats/rte_jobstats.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/latencystats/rte_latencystats.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_scalar.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_sve.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/member/rte_member.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pcapng/rte_pcapng.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_empty_poll.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_intel_uncore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_pmd_mgmt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_guest_channel.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rawdev/rte_rawdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rawdev/rte_rawdev_pmd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/dmadev/rte_dmadev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/dmadev/rte_dmadev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rib/rte_rib.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rib/rte_rib6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/reorder/rte_reorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_approx.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_red.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_sched.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_sched_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_pie.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/security/rte_security.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/security/rte_security_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_std.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_generic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_c11.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_stubs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vdpa.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost_async.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_sa.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_sad.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/fib/rte_fib.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/fib/rte_fib6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_fd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_frag.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ras.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_sched.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_source_sink.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_sym_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_eventdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_fd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_source_sink.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pdump/rte_pdump.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_hash_func.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_em.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_learner.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_selector.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_wm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_array.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_cuckoo.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_func.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_lpm_ipv6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_stub.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru_x86.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_func_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_port_in_action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_table_action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_extern.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_ctl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph_worker.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_ip4_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_eth_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/bus/pci/rte_bus_pci.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/bus/vdev/rte_bus_vdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/net/i40e/rte_pmd_i40e.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-devbind.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:38.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-pmdinfo.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:38.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-telemetry.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:38.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-hugepages.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:38.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/rte_build_config.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/meson-private/libdpdk-libs.pc to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig 00:02:38.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/meson-private/libdpdk.pc to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig 00:02:38.180 Installing symlink pointing to librte_kvargs.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_kvargs.so.23 00:02:38.180 Installing symlink pointing to librte_kvargs.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_kvargs.so 00:02:38.180 Installing symlink pointing to librte_telemetry.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_telemetry.so.23 00:02:38.180 Installing symlink pointing to librte_telemetry.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_telemetry.so 00:02:38.180 Installing symlink pointing to librte_eal.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eal.so.23 00:02:38.180 Installing symlink pointing to librte_eal.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eal.so 00:02:38.180 Installing symlink pointing to librte_ring.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ring.so.23 00:02:38.180 Installing symlink pointing to librte_ring.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ring.so 00:02:38.180 Installing symlink pointing to librte_rcu.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rcu.so.23 00:02:38.180 Installing symlink pointing to librte_rcu.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rcu.so 00:02:38.180 Installing symlink pointing to librte_mempool.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mempool.so.23 00:02:38.180 Installing symlink pointing to librte_mempool.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mempool.so 00:02:38.180 Installing symlink pointing to librte_mbuf.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mbuf.so.23 00:02:38.180 Installing symlink pointing to librte_mbuf.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mbuf.so 00:02:38.180 Installing symlink pointing to librte_net.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_net.so.23 00:02:38.180 Installing symlink pointing to librte_net.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_net.so 00:02:38.180 Installing symlink pointing to librte_meter.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_meter.so.23 00:02:38.180 Installing symlink pointing to librte_meter.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_meter.so 00:02:38.180 Installing symlink pointing to librte_ethdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ethdev.so.23 00:02:38.180 Installing symlink pointing to librte_ethdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ethdev.so 00:02:38.180 Installing symlink pointing to librte_pci.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pci.so.23 00:02:38.180 Installing symlink pointing to librte_pci.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pci.so 00:02:38.180 Installing symlink pointing to librte_cmdline.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cmdline.so.23 00:02:38.180 Installing symlink pointing to librte_cmdline.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cmdline.so 00:02:38.180 Installing symlink pointing to librte_metrics.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_metrics.so.23 00:02:38.180 Installing symlink pointing to librte_metrics.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_metrics.so 00:02:38.180 Installing symlink pointing to librte_hash.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_hash.so.23 00:02:38.181 Installing symlink pointing to librte_hash.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_hash.so 00:02:38.181 Installing symlink pointing to librte_timer.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_timer.so.23 00:02:38.181 Installing symlink pointing to librte_timer.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_timer.so 00:02:38.181 Installing symlink pointing to librte_acl.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_acl.so.23 00:02:38.181 Installing symlink pointing to librte_acl.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_acl.so 00:02:38.181 Installing symlink pointing to librte_bbdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bbdev.so.23 00:02:38.181 Installing symlink pointing to librte_bbdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bbdev.so 00:02:38.181 Installing symlink pointing to librte_bitratestats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bitratestats.so.23 00:02:38.181 Installing symlink pointing to librte_bitratestats.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bitratestats.so 00:02:38.181 Installing symlink pointing to librte_bpf.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bpf.so.23 00:02:38.181 Installing symlink pointing to librte_bpf.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bpf.so 00:02:38.181 Installing symlink pointing to librte_cfgfile.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cfgfile.so.23 00:02:38.181 Installing symlink pointing to librte_cfgfile.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cfgfile.so 00:02:38.181 Installing symlink pointing to librte_compressdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_compressdev.so.23 00:02:38.181 Installing symlink pointing to librte_compressdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_compressdev.so 00:02:38.181 Installing symlink pointing to librte_cryptodev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cryptodev.so.23 00:02:38.181 Installing symlink pointing to librte_cryptodev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cryptodev.so 00:02:38.181 Installing symlink pointing to librte_distributor.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_distributor.so.23 00:02:38.181 Installing symlink pointing to librte_distributor.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_distributor.so 00:02:38.181 Installing symlink pointing to librte_efd.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_efd.so.23 00:02:38.181 Installing symlink pointing to librte_efd.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_efd.so 00:02:38.181 Installing symlink pointing to librte_eventdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eventdev.so.23 00:02:38.181 Installing symlink pointing to librte_eventdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eventdev.so 00:02:38.181 Installing symlink pointing to librte_gpudev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gpudev.so.23 00:02:38.181 Installing symlink pointing to librte_gpudev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gpudev.so 00:02:38.181 Installing symlink pointing to librte_gro.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gro.so.23 00:02:38.181 Installing symlink pointing to librte_gro.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gro.so 00:02:38.181 Installing symlink pointing to librte_gso.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gso.so.23 00:02:38.181 Installing symlink pointing to librte_gso.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gso.so 00:02:38.181 Installing symlink pointing to librte_ip_frag.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ip_frag.so.23 00:02:38.181 Installing symlink pointing to librte_ip_frag.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ip_frag.so 00:02:38.181 Installing symlink pointing to librte_jobstats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_jobstats.so.23 00:02:38.181 Installing symlink pointing to librte_jobstats.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_jobstats.so 00:02:38.181 Installing symlink pointing to librte_latencystats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_latencystats.so.23 00:02:38.181 Installing symlink pointing to librte_latencystats.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_latencystats.so 00:02:38.181 Installing symlink pointing to librte_lpm.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_lpm.so.23 00:02:38.181 Installing symlink pointing to librte_lpm.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_lpm.so 00:02:38.181 Installing symlink pointing to librte_member.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_member.so.23 00:02:38.181 Installing symlink pointing to librte_member.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_member.so 00:02:38.181 Installing symlink pointing to librte_pcapng.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pcapng.so.23 00:02:38.181 Installing symlink pointing to librte_pcapng.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pcapng.so 00:02:38.181 Installing symlink pointing to librte_power.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_power.so.23 00:02:38.181 Installing symlink pointing to librte_power.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_power.so 00:02:38.181 Installing symlink pointing to librte_rawdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rawdev.so.23 00:02:38.181 Installing symlink pointing to librte_rawdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rawdev.so 00:02:38.181 Installing symlink pointing to librte_regexdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_regexdev.so.23 00:02:38.181 Installing symlink pointing to librte_regexdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_regexdev.so 00:02:38.181 Installing symlink pointing to librte_dmadev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dmadev.so.23 00:02:38.181 Installing symlink pointing to librte_dmadev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dmadev.so 00:02:38.181 Installing symlink pointing to librte_rib.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rib.so.23 00:02:38.181 Installing symlink pointing to librte_rib.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rib.so 00:02:38.181 Installing symlink pointing to librte_reorder.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_reorder.so.23 00:02:38.181 Installing symlink pointing to librte_reorder.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_reorder.so 00:02:38.181 Installing symlink pointing to librte_sched.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_sched.so.23 00:02:38.181 Installing symlink pointing to librte_sched.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_sched.so 00:02:38.181 Installing symlink pointing to librte_security.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_security.so.23 00:02:38.181 Installing symlink pointing to librte_security.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_security.so 00:02:38.181 Installing symlink pointing to librte_stack.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_stack.so.23 00:02:38.181 Installing symlink pointing to librte_stack.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_stack.so 00:02:38.181 Installing symlink pointing to librte_vhost.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_vhost.so.23 00:02:38.181 Installing symlink pointing to librte_vhost.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_vhost.so 00:02:38.181 Installing symlink pointing to librte_ipsec.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ipsec.so.23 00:02:38.181 Installing symlink pointing to librte_ipsec.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ipsec.so 00:02:38.181 Installing symlink pointing to librte_fib.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_fib.so.23 00:02:38.181 Installing symlink pointing to librte_fib.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_fib.so 00:02:38.181 Installing symlink pointing to librte_port.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_port.so.23 00:02:38.181 Installing symlink pointing to librte_port.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_port.so 00:02:38.181 Installing symlink pointing to librte_pdump.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdump.so.23 00:02:38.181 Installing symlink pointing to librte_pdump.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdump.so 00:02:38.181 Installing symlink pointing to librte_table.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_table.so.23 00:02:38.181 Installing symlink pointing to librte_table.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_table.so 00:02:38.181 Installing symlink pointing to librte_pipeline.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pipeline.so.23 00:02:38.181 Installing symlink pointing to librte_pipeline.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pipeline.so 00:02:38.181 Installing symlink pointing to librte_graph.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_graph.so.23 00:02:38.181 Installing symlink pointing to librte_graph.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_graph.so 00:02:38.181 Installing symlink pointing to librte_node.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_node.so.23 00:02:38.181 Installing symlink pointing to librte_node.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_node.so 00:02:38.181 Installing symlink pointing to librte_bus_pci.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_pci.so.23 00:02:38.181 Installing symlink pointing to librte_bus_pci.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_pci.so 00:02:38.182 Installing symlink pointing to librte_bus_vdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_vdev.so.23 00:02:38.182 Installing symlink pointing to librte_bus_vdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_vdev.so 00:02:38.182 Installing symlink pointing to librte_mempool_ring.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_mempool_ring.so.23 00:02:38.182 Installing symlink pointing to librte_mempool_ring.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_mempool_ring.so 00:02:38.182 Installing symlink pointing to librte_net_i40e.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_net_i40e.so.23 00:02:38.182 './librte_bus_pci.so' -> 'dpdk/pmds-23.0/librte_bus_pci.so' 00:02:38.182 './librte_bus_pci.so.23' -> 'dpdk/pmds-23.0/librte_bus_pci.so.23' 00:02:38.182 './librte_bus_pci.so.23.0' -> 'dpdk/pmds-23.0/librte_bus_pci.so.23.0' 00:02:38.182 './librte_bus_vdev.so' -> 'dpdk/pmds-23.0/librte_bus_vdev.so' 00:02:38.182 './librte_bus_vdev.so.23' -> 'dpdk/pmds-23.0/librte_bus_vdev.so.23' 00:02:38.182 './librte_bus_vdev.so.23.0' -> 'dpdk/pmds-23.0/librte_bus_vdev.so.23.0' 00:02:38.182 './librte_mempool_ring.so' -> 'dpdk/pmds-23.0/librte_mempool_ring.so' 00:02:38.182 './librte_mempool_ring.so.23' -> 'dpdk/pmds-23.0/librte_mempool_ring.so.23' 00:02:38.182 './librte_mempool_ring.so.23.0' -> 'dpdk/pmds-23.0/librte_mempool_ring.so.23.0' 00:02:38.182 './librte_net_i40e.so' -> 'dpdk/pmds-23.0/librte_net_i40e.so' 00:02:38.182 './librte_net_i40e.so.23' -> 'dpdk/pmds-23.0/librte_net_i40e.so.23' 00:02:38.182 './librte_net_i40e.so.23.0' -> 'dpdk/pmds-23.0/librte_net_i40e.so.23.0' 00:02:38.182 Installing symlink pointing to librte_net_i40e.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_net_i40e.so 00:02:38.182 Running custom install script '/bin/sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/config/../buildtools/symlink-drivers-solibs.sh lib dpdk/pmds-23.0' 00:02:38.182 01:03:46 -- common/autobuild_common.sh@192 -- $ uname -s 00:02:38.182 01:03:46 -- common/autobuild_common.sh@192 -- $ [[ Linux == \F\r\e\e\B\S\D ]] 00:02:38.182 01:03:46 -- common/autobuild_common.sh@203 -- $ cat 00:02:38.182 01:03:46 -- common/autobuild_common.sh@208 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:38.182 00:02:38.182 real 1m20.124s 00:02:38.182 user 14m22.725s 00:02:38.182 sys 1m50.585s 00:02:38.182 01:03:46 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:02:38.182 01:03:46 -- common/autotest_common.sh@10 -- $ set +x 00:02:38.182 ************************************ 00:02:38.182 END TEST build_native_dpdk 00:02:38.182 ************************************ 00:02:38.182 01:03:46 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:02:38.182 01:03:46 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:02:38.182 01:03:46 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:02:38.182 01:03:46 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:02:38.182 01:03:46 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:02:38.182 01:03:46 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:02:38.182 01:03:46 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:02:38.182 01:03:46 -- spdk/autobuild.sh@67 -- $ /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/configure --enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build --with-shared 00:02:38.182 Using /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig for additional libs... 00:02:38.440 DPDK libraries: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:38.440 DPDK includes: //var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:38.440 Using default SPDK env in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:02:38.698 Using 'verbs' RDMA provider 00:02:49.025 Configuring ISA-L (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l/spdk-isal.log)...done. 00:02:57.150 Configuring ISA-L-crypto (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l-crypto/spdk-isal-crypto.log)...done. 00:02:57.150 Creating mk/config.mk...done. 00:02:57.150 Creating mk/cc.flags.mk...done. 00:02:57.150 Type 'make' to build. 00:02:57.150 01:04:05 -- spdk/autobuild.sh@69 -- $ run_test make make -j48 00:02:57.150 01:04:05 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:02:57.150 01:04:05 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:02:57.150 01:04:05 -- common/autotest_common.sh@10 -- $ set +x 00:02:57.150 ************************************ 00:02:57.150 START TEST make 00:02:57.150 ************************************ 00:02:57.150 01:04:05 -- common/autotest_common.sh@1114 -- $ make -j48 00:02:57.408 make[1]: Nothing to be done for 'all'. 00:02:59.325 The Meson build system 00:02:59.325 Version: 1.5.0 00:02:59.325 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user 00:02:59.325 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:02:59.325 Build type: native build 00:02:59.325 Project name: libvfio-user 00:02:59.325 Project version: 0.0.1 00:02:59.325 C compiler for the host machine: gcc (gcc 13.3.1 "gcc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:02:59.325 C linker for the host machine: gcc ld.bfd 2.40-14 00:02:59.325 Host machine cpu family: x86_64 00:02:59.325 Host machine cpu: x86_64 00:02:59.325 Run-time dependency threads found: YES 00:02:59.325 Library dl found: YES 00:02:59.325 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:02:59.325 Run-time dependency json-c found: YES 0.17 00:02:59.325 Run-time dependency cmocka found: YES 1.1.7 00:02:59.325 Program pytest-3 found: NO 00:02:59.325 Program flake8 found: NO 00:02:59.325 Program misspell-fixer found: NO 00:02:59.325 Program restructuredtext-lint found: NO 00:02:59.325 Program valgrind found: YES (/usr/bin/valgrind) 00:02:59.325 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:02:59.325 Compiler for C supports arguments -Wmissing-declarations: YES 00:02:59.325 Compiler for C supports arguments -Wwrite-strings: YES 00:02:59.325 ../libvfio-user/test/meson.build:20: WARNING: Project targets '>= 0.53.0' but uses feature introduced in '0.57.0': exclude_suites arg in add_test_setup. 00:02:59.325 Program test-lspci.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user/test/test-lspci.sh) 00:02:59.325 Program test-linkage.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user/test/test-linkage.sh) 00:02:59.325 ../libvfio-user/test/py/meson.build:16: WARNING: Project targets '>= 0.53.0' but uses feature introduced in '0.57.0': exclude_suites arg in add_test_setup. 00:02:59.325 Build targets in project: 8 00:02:59.325 WARNING: Project specifies a minimum meson_version '>= 0.53.0' but uses features which were added in newer versions: 00:02:59.325 * 0.57.0: {'exclude_suites arg in add_test_setup'} 00:02:59.325 00:02:59.325 libvfio-user 0.0.1 00:02:59.325 00:02:59.325 User defined options 00:02:59.325 buildtype : debug 00:02:59.325 default_library: shared 00:02:59.325 libdir : /usr/local/lib 00:02:59.325 00:02:59.325 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:02:59.905 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug' 00:03:00.165 [1/37] Compiling C object lib/libvfio-user.so.0.0.1.p/irq.c.o 00:03:00.165 [2/37] Compiling C object samples/lspci.p/lspci.c.o 00:03:00.165 [3/37] Compiling C object lib/libvfio-user.so.0.0.1.p/migration.c.o 00:03:00.165 [4/37] Compiling C object lib/libvfio-user.so.0.0.1.p/dma.c.o 00:03:00.165 [5/37] Compiling C object samples/shadow_ioeventfd_server.p/shadow_ioeventfd_server.c.o 00:03:00.165 [6/37] Compiling C object samples/null.p/null.c.o 00:03:00.165 [7/37] Compiling C object lib/libvfio-user.so.0.0.1.p/pci_caps.c.o 00:03:00.165 [8/37] Compiling C object lib/libvfio-user.so.0.0.1.p/tran.c.o 00:03:00.165 [9/37] Compiling C object samples/client.p/.._lib_tran.c.o 00:03:00.165 [10/37] Compiling C object lib/libvfio-user.so.0.0.1.p/pci.c.o 00:03:00.165 [11/37] Compiling C object test/unit_tests.p/.._lib_tran.c.o 00:03:00.165 [12/37] Compiling C object samples/client.p/.._lib_migration.c.o 00:03:00.165 [13/37] Compiling C object test/unit_tests.p/.._lib_dma.c.o 00:03:00.165 [14/37] Compiling C object samples/client.p/.._lib_tran_sock.c.o 00:03:00.425 [15/37] Compiling C object samples/gpio-pci-idio-16.p/gpio-pci-idio-16.c.o 00:03:00.425 [16/37] Compiling C object test/unit_tests.p/.._lib_tran_pipe.c.o 00:03:00.425 [17/37] Compiling C object test/unit_tests.p/.._lib_tran_sock.c.o 00:03:00.425 [18/37] Compiling C object test/unit_tests.p/.._lib_irq.c.o 00:03:00.425 [19/37] Compiling C object test/unit_tests.p/.._lib_migration.c.o 00:03:00.425 [20/37] Compiling C object test/unit_tests.p/unit-tests.c.o 00:03:00.425 [21/37] Compiling C object samples/server.p/server.c.o 00:03:00.425 [22/37] Compiling C object test/unit_tests.p/.._lib_pci.c.o 00:03:00.425 [23/37] Compiling C object lib/libvfio-user.so.0.0.1.p/tran_sock.c.o 00:03:00.425 [24/37] Compiling C object test/unit_tests.p/mocks.c.o 00:03:00.425 [25/37] Compiling C object test/unit_tests.p/.._lib_pci_caps.c.o 00:03:00.425 [26/37] Compiling C object samples/client.p/client.c.o 00:03:00.425 [27/37] Linking target samples/client 00:03:00.425 [28/37] Compiling C object lib/libvfio-user.so.0.0.1.p/libvfio-user.c.o 00:03:00.425 [29/37] Compiling C object test/unit_tests.p/.._lib_libvfio-user.c.o 00:03:00.425 [30/37] Linking target lib/libvfio-user.so.0.0.1 00:03:00.686 [31/37] Linking target test/unit_tests 00:03:00.686 [32/37] Generating symbol file lib/libvfio-user.so.0.0.1.p/libvfio-user.so.0.0.1.symbols 00:03:00.686 [33/37] Linking target samples/server 00:03:00.686 [34/37] Linking target samples/null 00:03:00.686 [35/37] Linking target samples/lspci 00:03:00.948 [36/37] Linking target samples/shadow_ioeventfd_server 00:03:00.948 [37/37] Linking target samples/gpio-pci-idio-16 00:03:00.948 INFO: autodetecting backend as ninja 00:03:00.948 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:03:00.948 DESTDIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user meson install --quiet -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:03:01.883 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug' 00:03:01.883 ninja: no work to do. 00:03:14.084 CC lib/ut_mock/mock.o 00:03:14.084 CC lib/log/log.o 00:03:14.084 CC lib/log/log_flags.o 00:03:14.084 CC lib/log/log_deprecated.o 00:03:14.084 CC lib/ut/ut.o 00:03:14.084 LIB libspdk_ut_mock.a 00:03:14.084 SO libspdk_ut_mock.so.5.0 00:03:14.084 LIB libspdk_log.a 00:03:14.084 LIB libspdk_ut.a 00:03:14.084 SO libspdk_ut.so.1.0 00:03:14.084 SO libspdk_log.so.6.1 00:03:14.084 SYMLINK libspdk_ut_mock.so 00:03:14.084 SYMLINK libspdk_ut.so 00:03:14.084 SYMLINK libspdk_log.so 00:03:14.084 CC lib/ioat/ioat.o 00:03:14.084 CC lib/dma/dma.o 00:03:14.084 CXX lib/trace_parser/trace.o 00:03:14.084 CC lib/util/base64.o 00:03:14.084 CC lib/util/bit_array.o 00:03:14.084 CC lib/util/cpuset.o 00:03:14.084 CC lib/util/crc16.o 00:03:14.084 CC lib/util/crc32.o 00:03:14.084 CC lib/util/crc32c.o 00:03:14.084 CC lib/util/crc32_ieee.o 00:03:14.084 CC lib/util/crc64.o 00:03:14.084 CC lib/util/dif.o 00:03:14.084 CC lib/util/fd.o 00:03:14.084 CC lib/util/file.o 00:03:14.084 CC lib/util/hexlify.o 00:03:14.084 CC lib/util/iov.o 00:03:14.084 CC lib/util/math.o 00:03:14.084 CC lib/util/pipe.o 00:03:14.084 CC lib/util/strerror_tls.o 00:03:14.084 CC lib/util/string.o 00:03:14.084 CC lib/util/uuid.o 00:03:14.084 CC lib/util/fd_group.o 00:03:14.084 CC lib/util/xor.o 00:03:14.084 CC lib/util/zipf.o 00:03:14.084 CC lib/vfio_user/host/vfio_user_pci.o 00:03:14.084 CC lib/vfio_user/host/vfio_user.o 00:03:14.084 LIB libspdk_dma.a 00:03:14.084 SO libspdk_dma.so.3.0 00:03:14.084 SYMLINK libspdk_dma.so 00:03:14.084 LIB libspdk_ioat.a 00:03:14.084 SO libspdk_ioat.so.6.0 00:03:14.084 LIB libspdk_vfio_user.a 00:03:14.084 SO libspdk_vfio_user.so.4.0 00:03:14.084 SYMLINK libspdk_ioat.so 00:03:14.084 SYMLINK libspdk_vfio_user.so 00:03:14.084 LIB libspdk_util.a 00:03:14.084 SO libspdk_util.so.8.0 00:03:14.084 SYMLINK libspdk_util.so 00:03:14.084 CC lib/json/json_parse.o 00:03:14.084 CC lib/json/json_util.o 00:03:14.084 CC lib/json/json_write.o 00:03:14.084 CC lib/vmd/vmd.o 00:03:14.084 CC lib/rdma/common.o 00:03:14.084 CC lib/vmd/led.o 00:03:14.084 CC lib/idxd/idxd.o 00:03:14.084 CC lib/conf/conf.o 00:03:14.084 CC lib/rdma/rdma_verbs.o 00:03:14.084 CC lib/env_dpdk/env.o 00:03:14.084 CC lib/idxd/idxd_user.o 00:03:14.084 CC lib/env_dpdk/memory.o 00:03:14.084 CC lib/idxd/idxd_kernel.o 00:03:14.084 CC lib/env_dpdk/pci.o 00:03:14.084 CC lib/env_dpdk/threads.o 00:03:14.084 CC lib/env_dpdk/init.o 00:03:14.084 CC lib/env_dpdk/pci_ioat.o 00:03:14.084 CC lib/env_dpdk/pci_virtio.o 00:03:14.084 CC lib/env_dpdk/pci_vmd.o 00:03:14.084 CC lib/env_dpdk/pci_idxd.o 00:03:14.084 CC lib/env_dpdk/pci_event.o 00:03:14.084 CC lib/env_dpdk/sigbus_handler.o 00:03:14.084 CC lib/env_dpdk/pci_dpdk.o 00:03:14.084 CC lib/env_dpdk/pci_dpdk_2211.o 00:03:14.084 CC lib/env_dpdk/pci_dpdk_2207.o 00:03:14.084 LIB libspdk_trace_parser.a 00:03:14.084 SO libspdk_trace_parser.so.4.0 00:03:14.084 LIB libspdk_conf.a 00:03:14.084 SYMLINK libspdk_trace_parser.so 00:03:14.084 SO libspdk_conf.so.5.0 00:03:14.084 LIB libspdk_json.a 00:03:14.084 SYMLINK libspdk_conf.so 00:03:14.084 SO libspdk_json.so.5.1 00:03:14.084 LIB libspdk_rdma.a 00:03:14.084 SYMLINK libspdk_json.so 00:03:14.084 SO libspdk_rdma.so.5.0 00:03:14.084 SYMLINK libspdk_rdma.so 00:03:14.084 CC lib/jsonrpc/jsonrpc_server.o 00:03:14.084 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:03:14.084 CC lib/jsonrpc/jsonrpc_client.o 00:03:14.084 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:03:14.084 LIB libspdk_idxd.a 00:03:14.084 SO libspdk_idxd.so.11.0 00:03:14.342 SYMLINK libspdk_idxd.so 00:03:14.342 LIB libspdk_vmd.a 00:03:14.342 SO libspdk_vmd.so.5.0 00:03:14.342 SYMLINK libspdk_vmd.so 00:03:14.342 LIB libspdk_jsonrpc.a 00:03:14.342 SO libspdk_jsonrpc.so.5.1 00:03:14.342 SYMLINK libspdk_jsonrpc.so 00:03:14.600 CC lib/rpc/rpc.o 00:03:14.858 LIB libspdk_rpc.a 00:03:14.858 SO libspdk_rpc.so.5.0 00:03:14.858 SYMLINK libspdk_rpc.so 00:03:14.858 CC lib/trace/trace.o 00:03:14.858 CC lib/sock/sock.o 00:03:14.858 CC lib/trace/trace_flags.o 00:03:14.858 CC lib/trace/trace_rpc.o 00:03:14.858 CC lib/sock/sock_rpc.o 00:03:14.858 CC lib/notify/notify.o 00:03:14.858 CC lib/notify/notify_rpc.o 00:03:15.116 LIB libspdk_notify.a 00:03:15.116 SO libspdk_notify.so.5.0 00:03:15.116 SYMLINK libspdk_notify.so 00:03:15.116 LIB libspdk_trace.a 00:03:15.116 SO libspdk_trace.so.9.0 00:03:15.116 SYMLINK libspdk_trace.so 00:03:15.375 LIB libspdk_sock.a 00:03:15.375 SO libspdk_sock.so.8.0 00:03:15.375 CC lib/thread/thread.o 00:03:15.375 CC lib/thread/iobuf.o 00:03:15.375 SYMLINK libspdk_sock.so 00:03:15.375 CC lib/nvme/nvme_ctrlr_cmd.o 00:03:15.375 CC lib/nvme/nvme_ctrlr.o 00:03:15.375 CC lib/nvme/nvme_fabric.o 00:03:15.375 CC lib/nvme/nvme_ns_cmd.o 00:03:15.375 CC lib/nvme/nvme_ns.o 00:03:15.375 CC lib/nvme/nvme_pcie_common.o 00:03:15.375 CC lib/nvme/nvme_pcie.o 00:03:15.375 CC lib/nvme/nvme_qpair.o 00:03:15.375 CC lib/nvme/nvme.o 00:03:15.375 CC lib/nvme/nvme_quirks.o 00:03:15.375 CC lib/nvme/nvme_transport.o 00:03:15.375 CC lib/nvme/nvme_discovery.o 00:03:15.375 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:03:15.375 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:03:15.375 CC lib/nvme/nvme_tcp.o 00:03:15.375 CC lib/nvme/nvme_opal.o 00:03:15.375 CC lib/nvme/nvme_io_msg.o 00:03:15.375 CC lib/nvme/nvme_poll_group.o 00:03:15.375 CC lib/nvme/nvme_zns.o 00:03:15.375 CC lib/nvme/nvme_cuse.o 00:03:15.375 CC lib/nvme/nvme_vfio_user.o 00:03:15.375 CC lib/nvme/nvme_rdma.o 00:03:15.633 LIB libspdk_env_dpdk.a 00:03:15.892 SO libspdk_env_dpdk.so.13.0 00:03:15.892 SYMLINK libspdk_env_dpdk.so 00:03:16.826 LIB libspdk_thread.a 00:03:17.085 SO libspdk_thread.so.9.0 00:03:17.085 SYMLINK libspdk_thread.so 00:03:17.085 CC lib/virtio/virtio.o 00:03:17.085 CC lib/vfu_tgt/tgt_endpoint.o 00:03:17.085 CC lib/init/json_config.o 00:03:17.085 CC lib/virtio/virtio_vhost_user.o 00:03:17.085 CC lib/accel/accel.o 00:03:17.085 CC lib/blob/blobstore.o 00:03:17.085 CC lib/vfu_tgt/tgt_rpc.o 00:03:17.085 CC lib/accel/accel_rpc.o 00:03:17.085 CC lib/init/subsystem.o 00:03:17.085 CC lib/virtio/virtio_vfio_user.o 00:03:17.085 CC lib/blob/request.o 00:03:17.085 CC lib/virtio/virtio_pci.o 00:03:17.085 CC lib/init/subsystem_rpc.o 00:03:17.085 CC lib/accel/accel_sw.o 00:03:17.085 CC lib/blob/zeroes.o 00:03:17.085 CC lib/init/rpc.o 00:03:17.085 CC lib/blob/blob_bs_dev.o 00:03:17.343 LIB libspdk_init.a 00:03:17.343 SO libspdk_init.so.4.0 00:03:17.600 SYMLINK libspdk_init.so 00:03:17.600 LIB libspdk_virtio.a 00:03:17.600 LIB libspdk_vfu_tgt.a 00:03:17.600 SO libspdk_vfu_tgt.so.2.0 00:03:17.600 SO libspdk_virtio.so.6.0 00:03:17.600 SYMLINK libspdk_vfu_tgt.so 00:03:17.600 SYMLINK libspdk_virtio.so 00:03:17.600 CC lib/event/app.o 00:03:17.600 CC lib/event/reactor.o 00:03:17.600 CC lib/event/log_rpc.o 00:03:17.600 CC lib/event/app_rpc.o 00:03:17.600 CC lib/event/scheduler_static.o 00:03:17.859 LIB libspdk_nvme.a 00:03:17.859 SO libspdk_nvme.so.12.0 00:03:18.116 LIB libspdk_event.a 00:03:18.116 SO libspdk_event.so.12.0 00:03:18.116 SYMLINK libspdk_event.so 00:03:18.116 SYMLINK libspdk_nvme.so 00:03:18.116 LIB libspdk_accel.a 00:03:18.116 SO libspdk_accel.so.14.0 00:03:18.373 SYMLINK libspdk_accel.so 00:03:18.373 CC lib/bdev/bdev.o 00:03:18.373 CC lib/bdev/bdev_rpc.o 00:03:18.373 CC lib/bdev/bdev_zone.o 00:03:18.373 CC lib/bdev/part.o 00:03:18.373 CC lib/bdev/scsi_nvme.o 00:03:20.271 LIB libspdk_blob.a 00:03:20.271 SO libspdk_blob.so.10.1 00:03:20.271 SYMLINK libspdk_blob.so 00:03:20.271 CC lib/blobfs/blobfs.o 00:03:20.271 CC lib/lvol/lvol.o 00:03:20.271 CC lib/blobfs/tree.o 00:03:20.837 LIB libspdk_bdev.a 00:03:20.837 SO libspdk_bdev.so.14.0 00:03:21.106 LIB libspdk_blobfs.a 00:03:21.106 SO libspdk_blobfs.so.9.0 00:03:21.106 SYMLINK libspdk_bdev.so 00:03:21.106 LIB libspdk_lvol.a 00:03:21.106 SYMLINK libspdk_blobfs.so 00:03:21.106 SO libspdk_lvol.so.9.1 00:03:21.106 CC lib/ublk/ublk.o 00:03:21.106 CC lib/scsi/dev.o 00:03:21.106 CC lib/ublk/ublk_rpc.o 00:03:21.106 CC lib/nvmf/ctrlr.o 00:03:21.106 CC lib/scsi/lun.o 00:03:21.106 CC lib/nvmf/ctrlr_discovery.o 00:03:21.106 CC lib/scsi/port.o 00:03:21.106 CC lib/nbd/nbd.o 00:03:21.106 CC lib/nvmf/ctrlr_bdev.o 00:03:21.106 CC lib/scsi/scsi.o 00:03:21.106 CC lib/nbd/nbd_rpc.o 00:03:21.106 CC lib/scsi/scsi_bdev.o 00:03:21.106 CC lib/nvmf/subsystem.o 00:03:21.106 CC lib/nvmf/nvmf.o 00:03:21.106 CC lib/scsi/scsi_pr.o 00:03:21.106 CC lib/ftl/ftl_core.o 00:03:21.106 CC lib/scsi/scsi_rpc.o 00:03:21.106 CC lib/nvmf/nvmf_rpc.o 00:03:21.106 CC lib/ftl/ftl_init.o 00:03:21.106 CC lib/nvmf/transport.o 00:03:21.106 CC lib/scsi/task.o 00:03:21.106 CC lib/nvmf/tcp.o 00:03:21.106 CC lib/ftl/ftl_layout.o 00:03:21.106 CC lib/ftl/ftl_debug.o 00:03:21.106 CC lib/nvmf/vfio_user.o 00:03:21.106 CC lib/ftl/ftl_io.o 00:03:21.106 CC lib/nvmf/rdma.o 00:03:21.106 CC lib/ftl/ftl_sb.o 00:03:21.106 SYMLINK libspdk_lvol.so 00:03:21.106 CC lib/ftl/ftl_l2p.o 00:03:21.106 CC lib/ftl/ftl_l2p_flat.o 00:03:21.106 CC lib/ftl/ftl_nv_cache.o 00:03:21.106 CC lib/ftl/ftl_band.o 00:03:21.106 CC lib/ftl/ftl_band_ops.o 00:03:21.106 CC lib/ftl/ftl_writer.o 00:03:21.106 CC lib/ftl/ftl_rq.o 00:03:21.106 CC lib/ftl/ftl_reloc.o 00:03:21.106 CC lib/ftl/ftl_l2p_cache.o 00:03:21.106 CC lib/ftl/ftl_p2l.o 00:03:21.106 CC lib/ftl/mngt/ftl_mngt.o 00:03:21.106 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:03:21.106 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:03:21.106 CC lib/ftl/mngt/ftl_mngt_startup.o 00:03:21.106 CC lib/ftl/mngt/ftl_mngt_md.o 00:03:21.106 CC lib/ftl/mngt/ftl_mngt_misc.o 00:03:21.106 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:03:21.106 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:03:21.106 CC lib/ftl/mngt/ftl_mngt_band.o 00:03:21.106 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:03:21.364 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:03:21.364 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:03:21.364 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:03:21.364 CC lib/ftl/utils/ftl_conf.o 00:03:21.364 CC lib/ftl/utils/ftl_md.o 00:03:21.624 CC lib/ftl/utils/ftl_mempool.o 00:03:21.624 CC lib/ftl/utils/ftl_bitmap.o 00:03:21.624 CC lib/ftl/utils/ftl_property.o 00:03:21.624 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:03:21.624 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:03:21.624 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:03:21.624 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:03:21.624 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:03:21.624 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:03:21.624 CC lib/ftl/upgrade/ftl_sb_v3.o 00:03:21.624 CC lib/ftl/upgrade/ftl_sb_v5.o 00:03:21.624 CC lib/ftl/nvc/ftl_nvc_dev.o 00:03:21.624 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:03:21.624 CC lib/ftl/base/ftl_base_dev.o 00:03:21.624 CC lib/ftl/base/ftl_base_bdev.o 00:03:21.624 CC lib/ftl/ftl_trace.o 00:03:21.881 LIB libspdk_nbd.a 00:03:21.881 SO libspdk_nbd.so.6.0 00:03:21.881 LIB libspdk_scsi.a 00:03:21.881 SYMLINK libspdk_nbd.so 00:03:21.882 SO libspdk_scsi.so.8.0 00:03:22.140 SYMLINK libspdk_scsi.so 00:03:22.140 LIB libspdk_ublk.a 00:03:22.140 SO libspdk_ublk.so.2.0 00:03:22.140 CC lib/iscsi/conn.o 00:03:22.140 CC lib/vhost/vhost.o 00:03:22.140 CC lib/vhost/vhost_rpc.o 00:03:22.140 CC lib/iscsi/init_grp.o 00:03:22.140 CC lib/iscsi/iscsi.o 00:03:22.140 CC lib/vhost/vhost_scsi.o 00:03:22.140 CC lib/vhost/vhost_blk.o 00:03:22.140 CC lib/iscsi/md5.o 00:03:22.140 CC lib/iscsi/param.o 00:03:22.140 CC lib/vhost/rte_vhost_user.o 00:03:22.140 CC lib/iscsi/portal_grp.o 00:03:22.140 CC lib/iscsi/tgt_node.o 00:03:22.140 CC lib/iscsi/iscsi_subsystem.o 00:03:22.140 CC lib/iscsi/iscsi_rpc.o 00:03:22.140 CC lib/iscsi/task.o 00:03:22.140 SYMLINK libspdk_ublk.so 00:03:22.397 LIB libspdk_ftl.a 00:03:22.655 SO libspdk_ftl.so.8.0 00:03:22.913 SYMLINK libspdk_ftl.so 00:03:23.479 LIB libspdk_vhost.a 00:03:23.479 SO libspdk_vhost.so.7.1 00:03:23.479 SYMLINK libspdk_vhost.so 00:03:23.738 LIB libspdk_nvmf.a 00:03:23.738 LIB libspdk_iscsi.a 00:03:23.738 SO libspdk_nvmf.so.17.0 00:03:23.738 SO libspdk_iscsi.so.7.0 00:03:23.738 SYMLINK libspdk_iscsi.so 00:03:23.738 SYMLINK libspdk_nvmf.so 00:03:23.996 CC module/vfu_device/vfu_virtio.o 00:03:23.996 CC module/env_dpdk/env_dpdk_rpc.o 00:03:23.996 CC module/vfu_device/vfu_virtio_blk.o 00:03:23.996 CC module/vfu_device/vfu_virtio_scsi.o 00:03:23.996 CC module/vfu_device/vfu_virtio_rpc.o 00:03:23.996 CC module/blob/bdev/blob_bdev.o 00:03:23.996 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:03:23.996 CC module/accel/error/accel_error.o 00:03:23.996 CC module/scheduler/dynamic/scheduler_dynamic.o 00:03:23.996 CC module/accel/error/accel_error_rpc.o 00:03:23.996 CC module/accel/iaa/accel_iaa.o 00:03:23.996 CC module/accel/iaa/accel_iaa_rpc.o 00:03:23.996 CC module/sock/posix/posix.o 00:03:23.996 CC module/accel/dsa/accel_dsa.o 00:03:23.996 CC module/accel/dsa/accel_dsa_rpc.o 00:03:23.996 CC module/accel/ioat/accel_ioat.o 00:03:23.996 CC module/accel/ioat/accel_ioat_rpc.o 00:03:23.996 CC module/scheduler/gscheduler/gscheduler.o 00:03:24.254 LIB libspdk_env_dpdk_rpc.a 00:03:24.254 SO libspdk_env_dpdk_rpc.so.5.0 00:03:24.254 SYMLINK libspdk_env_dpdk_rpc.so 00:03:24.254 LIB libspdk_scheduler_dpdk_governor.a 00:03:24.254 LIB libspdk_scheduler_gscheduler.a 00:03:24.254 SO libspdk_scheduler_dpdk_governor.so.3.0 00:03:24.255 SO libspdk_scheduler_gscheduler.so.3.0 00:03:24.255 LIB libspdk_accel_error.a 00:03:24.255 LIB libspdk_accel_ioat.a 00:03:24.255 LIB libspdk_scheduler_dynamic.a 00:03:24.255 LIB libspdk_accel_iaa.a 00:03:24.255 SO libspdk_accel_error.so.1.0 00:03:24.255 SO libspdk_accel_ioat.so.5.0 00:03:24.255 SYMLINK libspdk_scheduler_dpdk_governor.so 00:03:24.255 SYMLINK libspdk_scheduler_gscheduler.so 00:03:24.255 SO libspdk_scheduler_dynamic.so.3.0 00:03:24.255 SO libspdk_accel_iaa.so.2.0 00:03:24.255 LIB libspdk_accel_dsa.a 00:03:24.255 SYMLINK libspdk_accel_error.so 00:03:24.255 SYMLINK libspdk_accel_ioat.so 00:03:24.255 SYMLINK libspdk_scheduler_dynamic.so 00:03:24.255 LIB libspdk_blob_bdev.a 00:03:24.514 SO libspdk_accel_dsa.so.4.0 00:03:24.514 SYMLINK libspdk_accel_iaa.so 00:03:24.514 SO libspdk_blob_bdev.so.10.1 00:03:24.514 SYMLINK libspdk_accel_dsa.so 00:03:24.514 SYMLINK libspdk_blob_bdev.so 00:03:24.514 CC module/bdev/lvol/vbdev_lvol.o 00:03:24.514 CC module/bdev/delay/vbdev_delay.o 00:03:24.514 CC module/bdev/malloc/bdev_malloc.o 00:03:24.514 CC module/blobfs/bdev/blobfs_bdev.o 00:03:24.514 CC module/bdev/delay/vbdev_delay_rpc.o 00:03:24.514 CC module/bdev/malloc/bdev_malloc_rpc.o 00:03:24.514 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:03:24.514 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:03:24.514 CC module/bdev/zone_block/vbdev_zone_block.o 00:03:24.514 CC module/bdev/raid/bdev_raid.o 00:03:24.514 CC module/bdev/error/vbdev_error.o 00:03:24.514 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:03:24.514 CC module/bdev/raid/bdev_raid_rpc.o 00:03:24.514 CC module/bdev/raid/bdev_raid_sb.o 00:03:24.514 CC module/bdev/error/vbdev_error_rpc.o 00:03:24.514 CC module/bdev/passthru/vbdev_passthru.o 00:03:24.514 CC module/bdev/raid/raid0.o 00:03:24.514 CC module/bdev/null/bdev_null.o 00:03:24.514 CC module/bdev/nvme/bdev_nvme.o 00:03:24.514 CC module/bdev/aio/bdev_aio.o 00:03:24.514 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:03:24.514 CC module/bdev/raid/raid1.o 00:03:24.514 CC module/bdev/aio/bdev_aio_rpc.o 00:03:24.514 CC module/bdev/null/bdev_null_rpc.o 00:03:24.514 CC module/bdev/raid/concat.o 00:03:24.514 CC module/bdev/iscsi/bdev_iscsi.o 00:03:24.514 CC module/bdev/ftl/bdev_ftl.o 00:03:24.514 CC module/bdev/nvme/bdev_nvme_rpc.o 00:03:24.514 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:03:24.514 CC module/bdev/ftl/bdev_ftl_rpc.o 00:03:24.514 CC module/bdev/split/vbdev_split.o 00:03:24.514 CC module/bdev/split/vbdev_split_rpc.o 00:03:24.514 CC module/bdev/nvme/nvme_rpc.o 00:03:24.514 CC module/bdev/gpt/gpt.o 00:03:24.514 CC module/bdev/nvme/bdev_mdns_client.o 00:03:24.514 CC module/bdev/nvme/vbdev_opal.o 00:03:24.514 CC module/bdev/gpt/vbdev_gpt.o 00:03:24.514 CC module/bdev/nvme/vbdev_opal_rpc.o 00:03:24.514 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:03:24.514 CC module/bdev/virtio/bdev_virtio_scsi.o 00:03:24.514 CC module/bdev/virtio/bdev_virtio_blk.o 00:03:24.514 CC module/bdev/virtio/bdev_virtio_rpc.o 00:03:24.773 LIB libspdk_vfu_device.a 00:03:24.773 SO libspdk_vfu_device.so.2.0 00:03:24.773 SYMLINK libspdk_vfu_device.so 00:03:25.031 LIB libspdk_sock_posix.a 00:03:25.031 LIB libspdk_blobfs_bdev.a 00:03:25.031 SO libspdk_sock_posix.so.5.0 00:03:25.031 SO libspdk_blobfs_bdev.so.5.0 00:03:25.031 LIB libspdk_bdev_split.a 00:03:25.031 SO libspdk_bdev_split.so.5.0 00:03:25.031 SYMLINK libspdk_blobfs_bdev.so 00:03:25.031 LIB libspdk_bdev_null.a 00:03:25.031 SYMLINK libspdk_sock_posix.so 00:03:25.031 LIB libspdk_bdev_ftl.a 00:03:25.031 LIB libspdk_bdev_passthru.a 00:03:25.031 SO libspdk_bdev_null.so.5.0 00:03:25.031 SO libspdk_bdev_ftl.so.5.0 00:03:25.031 SYMLINK libspdk_bdev_split.so 00:03:25.031 LIB libspdk_bdev_gpt.a 00:03:25.031 SO libspdk_bdev_passthru.so.5.0 00:03:25.031 LIB libspdk_bdev_error.a 00:03:25.031 LIB libspdk_bdev_aio.a 00:03:25.031 SO libspdk_bdev_gpt.so.5.0 00:03:25.290 SYMLINK libspdk_bdev_null.so 00:03:25.290 SO libspdk_bdev_error.so.5.0 00:03:25.290 LIB libspdk_bdev_malloc.a 00:03:25.290 SYMLINK libspdk_bdev_ftl.so 00:03:25.290 SO libspdk_bdev_aio.so.5.0 00:03:25.290 LIB libspdk_bdev_zone_block.a 00:03:25.290 SYMLINK libspdk_bdev_passthru.so 00:03:25.290 SO libspdk_bdev_malloc.so.5.0 00:03:25.290 LIB libspdk_bdev_delay.a 00:03:25.290 SYMLINK libspdk_bdev_gpt.so 00:03:25.290 SO libspdk_bdev_zone_block.so.5.0 00:03:25.290 SYMLINK libspdk_bdev_error.so 00:03:25.290 SO libspdk_bdev_delay.so.5.0 00:03:25.290 SYMLINK libspdk_bdev_aio.so 00:03:25.290 LIB libspdk_bdev_iscsi.a 00:03:25.290 SYMLINK libspdk_bdev_malloc.so 00:03:25.290 SYMLINK libspdk_bdev_zone_block.so 00:03:25.290 SO libspdk_bdev_iscsi.so.5.0 00:03:25.290 SYMLINK libspdk_bdev_delay.so 00:03:25.290 SYMLINK libspdk_bdev_iscsi.so 00:03:25.290 LIB libspdk_bdev_virtio.a 00:03:25.290 LIB libspdk_bdev_lvol.a 00:03:25.290 SO libspdk_bdev_virtio.so.5.0 00:03:25.290 SO libspdk_bdev_lvol.so.5.0 00:03:25.551 SYMLINK libspdk_bdev_virtio.so 00:03:25.551 SYMLINK libspdk_bdev_lvol.so 00:03:25.860 LIB libspdk_bdev_raid.a 00:03:25.860 SO libspdk_bdev_raid.so.5.0 00:03:25.860 SYMLINK libspdk_bdev_raid.so 00:03:26.819 LIB libspdk_bdev_nvme.a 00:03:26.819 SO libspdk_bdev_nvme.so.6.0 00:03:27.078 SYMLINK libspdk_bdev_nvme.so 00:03:27.336 CC module/event/subsystems/sock/sock.o 00:03:27.336 CC module/event/subsystems/iobuf/iobuf.o 00:03:27.336 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:03:27.336 CC module/event/subsystems/vmd/vmd.o 00:03:27.336 CC module/event/subsystems/vfu_tgt/vfu_tgt.o 00:03:27.336 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:03:27.336 CC module/event/subsystems/vmd/vmd_rpc.o 00:03:27.336 CC module/event/subsystems/scheduler/scheduler.o 00:03:27.336 LIB libspdk_event_sock.a 00:03:27.336 LIB libspdk_event_scheduler.a 00:03:27.336 LIB libspdk_event_vhost_blk.a 00:03:27.336 LIB libspdk_event_vmd.a 00:03:27.336 LIB libspdk_event_vfu_tgt.a 00:03:27.336 LIB libspdk_event_iobuf.a 00:03:27.336 SO libspdk_event_sock.so.4.0 00:03:27.336 SO libspdk_event_scheduler.so.3.0 00:03:27.336 SO libspdk_event_vhost_blk.so.2.0 00:03:27.336 SO libspdk_event_vmd.so.5.0 00:03:27.336 SO libspdk_event_vfu_tgt.so.2.0 00:03:27.336 SO libspdk_event_iobuf.so.2.0 00:03:27.594 SYMLINK libspdk_event_sock.so 00:03:27.594 SYMLINK libspdk_event_vhost_blk.so 00:03:27.594 SYMLINK libspdk_event_scheduler.so 00:03:27.594 SYMLINK libspdk_event_vfu_tgt.so 00:03:27.594 SYMLINK libspdk_event_vmd.so 00:03:27.594 SYMLINK libspdk_event_iobuf.so 00:03:27.594 CC module/event/subsystems/accel/accel.o 00:03:27.852 LIB libspdk_event_accel.a 00:03:27.852 SO libspdk_event_accel.so.5.0 00:03:27.852 SYMLINK libspdk_event_accel.so 00:03:27.852 CC module/event/subsystems/bdev/bdev.o 00:03:28.111 LIB libspdk_event_bdev.a 00:03:28.111 SO libspdk_event_bdev.so.5.0 00:03:28.111 SYMLINK libspdk_event_bdev.so 00:03:28.369 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:03:28.369 CC module/event/subsystems/ublk/ublk.o 00:03:28.369 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:03:28.369 CC module/event/subsystems/nbd/nbd.o 00:03:28.369 CC module/event/subsystems/scsi/scsi.o 00:03:28.369 LIB libspdk_event_ublk.a 00:03:28.369 LIB libspdk_event_nbd.a 00:03:28.369 LIB libspdk_event_scsi.a 00:03:28.369 SO libspdk_event_ublk.so.2.0 00:03:28.369 SO libspdk_event_nbd.so.5.0 00:03:28.369 SO libspdk_event_scsi.so.5.0 00:03:28.627 SYMLINK libspdk_event_ublk.so 00:03:28.627 SYMLINK libspdk_event_nbd.so 00:03:28.627 SYMLINK libspdk_event_scsi.so 00:03:28.627 LIB libspdk_event_nvmf.a 00:03:28.627 SO libspdk_event_nvmf.so.5.0 00:03:28.627 SYMLINK libspdk_event_nvmf.so 00:03:28.627 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:03:28.627 CC module/event/subsystems/iscsi/iscsi.o 00:03:28.885 LIB libspdk_event_vhost_scsi.a 00:03:28.885 SO libspdk_event_vhost_scsi.so.2.0 00:03:28.885 LIB libspdk_event_iscsi.a 00:03:28.885 SO libspdk_event_iscsi.so.5.0 00:03:28.885 SYMLINK libspdk_event_vhost_scsi.so 00:03:28.885 SYMLINK libspdk_event_iscsi.so 00:03:28.885 SO libspdk.so.5.0 00:03:28.885 SYMLINK libspdk.so 00:03:29.153 CXX app/trace/trace.o 00:03:29.153 CC app/trace_record/trace_record.o 00:03:29.153 CC app/spdk_top/spdk_top.o 00:03:29.153 CC app/spdk_nvme_discover/discovery_aer.o 00:03:29.153 CC app/spdk_lspci/spdk_lspci.o 00:03:29.153 TEST_HEADER include/spdk/accel.h 00:03:29.153 CC app/spdk_nvme_identify/identify.o 00:03:29.153 CC app/spdk_nvme_perf/perf.o 00:03:29.153 TEST_HEADER include/spdk/accel_module.h 00:03:29.153 CC test/rpc_client/rpc_client_test.o 00:03:29.153 TEST_HEADER include/spdk/assert.h 00:03:29.153 TEST_HEADER include/spdk/barrier.h 00:03:29.153 TEST_HEADER include/spdk/base64.h 00:03:29.153 TEST_HEADER include/spdk/bdev.h 00:03:29.153 TEST_HEADER include/spdk/bdev_module.h 00:03:29.153 TEST_HEADER include/spdk/bdev_zone.h 00:03:29.153 TEST_HEADER include/spdk/bit_array.h 00:03:29.153 TEST_HEADER include/spdk/bit_pool.h 00:03:29.153 TEST_HEADER include/spdk/blob_bdev.h 00:03:29.153 TEST_HEADER include/spdk/blobfs_bdev.h 00:03:29.153 CC examples/interrupt_tgt/interrupt_tgt.o 00:03:29.153 TEST_HEADER include/spdk/blobfs.h 00:03:29.153 TEST_HEADER include/spdk/blob.h 00:03:29.153 TEST_HEADER include/spdk/conf.h 00:03:29.153 TEST_HEADER include/spdk/config.h 00:03:29.153 CC app/spdk_dd/spdk_dd.o 00:03:29.153 TEST_HEADER include/spdk/cpuset.h 00:03:29.153 TEST_HEADER include/spdk/crc16.h 00:03:29.153 TEST_HEADER include/spdk/crc32.h 00:03:29.153 CC app/nvmf_tgt/nvmf_main.o 00:03:29.153 TEST_HEADER include/spdk/crc64.h 00:03:29.153 CC app/iscsi_tgt/iscsi_tgt.o 00:03:29.153 TEST_HEADER include/spdk/dif.h 00:03:29.153 CC app/vhost/vhost.o 00:03:29.153 TEST_HEADER include/spdk/dma.h 00:03:29.153 CC examples/ioat/perf/perf.o 00:03:29.153 CC examples/ioat/verify/verify.o 00:03:29.153 CC examples/nvme/cmb_copy/cmb_copy.o 00:03:29.153 CC examples/nvme/hotplug/hotplug.o 00:03:29.153 TEST_HEADER include/spdk/endian.h 00:03:29.153 CC examples/nvme/arbitration/arbitration.o 00:03:29.153 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:03:29.153 TEST_HEADER include/spdk/env_dpdk.h 00:03:29.153 CC examples/nvme/nvme_manage/nvme_manage.o 00:03:29.153 CC examples/nvme/abort/abort.o 00:03:29.153 CC examples/nvme/reconnect/reconnect.o 00:03:29.153 TEST_HEADER include/spdk/env.h 00:03:29.153 CC examples/nvme/hello_world/hello_world.o 00:03:29.153 TEST_HEADER include/spdk/event.h 00:03:29.153 CC examples/idxd/perf/perf.o 00:03:29.153 CC examples/vmd/lsvmd/lsvmd.o 00:03:29.153 CC examples/util/zipf/zipf.o 00:03:29.153 TEST_HEADER include/spdk/fd_group.h 00:03:29.153 CC examples/accel/perf/accel_perf.o 00:03:29.153 CC examples/sock/hello_world/hello_sock.o 00:03:29.153 CC examples/vmd/led/led.o 00:03:29.153 CC test/nvme/aer/aer.o 00:03:29.153 TEST_HEADER include/spdk/fd.h 00:03:29.153 TEST_HEADER include/spdk/file.h 00:03:29.153 CC test/event/event_perf/event_perf.o 00:03:29.153 TEST_HEADER include/spdk/ftl.h 00:03:29.153 TEST_HEADER include/spdk/gpt_spec.h 00:03:29.153 CC app/fio/nvme/fio_plugin.o 00:03:29.153 TEST_HEADER include/spdk/hexlify.h 00:03:29.153 TEST_HEADER include/spdk/histogram_data.h 00:03:29.153 CC test/thread/poller_perf/poller_perf.o 00:03:29.153 TEST_HEADER include/spdk/idxd.h 00:03:29.153 TEST_HEADER include/spdk/idxd_spec.h 00:03:29.153 TEST_HEADER include/spdk/init.h 00:03:29.153 CC app/spdk_tgt/spdk_tgt.o 00:03:29.153 TEST_HEADER include/spdk/ioat.h 00:03:29.153 TEST_HEADER include/spdk/ioat_spec.h 00:03:29.153 TEST_HEADER include/spdk/iscsi_spec.h 00:03:29.153 TEST_HEADER include/spdk/json.h 00:03:29.153 TEST_HEADER include/spdk/jsonrpc.h 00:03:29.153 TEST_HEADER include/spdk/likely.h 00:03:29.153 TEST_HEADER include/spdk/log.h 00:03:29.153 TEST_HEADER include/spdk/lvol.h 00:03:29.153 CC examples/bdev/hello_world/hello_bdev.o 00:03:29.153 CC examples/thread/thread/thread_ex.o 00:03:29.153 TEST_HEADER include/spdk/memory.h 00:03:29.153 CC examples/blob/cli/blobcli.o 00:03:29.416 TEST_HEADER include/spdk/mmio.h 00:03:29.416 CC test/bdev/bdevio/bdevio.o 00:03:29.416 CC examples/blob/hello_world/hello_blob.o 00:03:29.416 CC examples/nvmf/nvmf/nvmf.o 00:03:29.416 CC test/accel/dif/dif.o 00:03:29.416 TEST_HEADER include/spdk/nbd.h 00:03:29.416 CC test/dma/test_dma/test_dma.o 00:03:29.416 CC examples/bdev/bdevperf/bdevperf.o 00:03:29.416 TEST_HEADER include/spdk/notify.h 00:03:29.416 TEST_HEADER include/spdk/nvme.h 00:03:29.416 CC test/blobfs/mkfs/mkfs.o 00:03:29.416 TEST_HEADER include/spdk/nvme_intel.h 00:03:29.416 TEST_HEADER include/spdk/nvme_ocssd.h 00:03:29.416 CC test/app/bdev_svc/bdev_svc.o 00:03:29.416 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:03:29.416 TEST_HEADER include/spdk/nvme_spec.h 00:03:29.416 TEST_HEADER include/spdk/nvme_zns.h 00:03:29.416 TEST_HEADER include/spdk/nvmf_cmd.h 00:03:29.416 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:03:29.416 TEST_HEADER include/spdk/nvmf.h 00:03:29.416 TEST_HEADER include/spdk/nvmf_spec.h 00:03:29.416 CC test/lvol/esnap/esnap.o 00:03:29.416 CC test/env/mem_callbacks/mem_callbacks.o 00:03:29.416 TEST_HEADER include/spdk/nvmf_transport.h 00:03:29.416 TEST_HEADER include/spdk/opal.h 00:03:29.416 TEST_HEADER include/spdk/opal_spec.h 00:03:29.416 TEST_HEADER include/spdk/pci_ids.h 00:03:29.416 TEST_HEADER include/spdk/pipe.h 00:03:29.416 TEST_HEADER include/spdk/queue.h 00:03:29.416 TEST_HEADER include/spdk/reduce.h 00:03:29.416 TEST_HEADER include/spdk/rpc.h 00:03:29.416 TEST_HEADER include/spdk/scheduler.h 00:03:29.416 TEST_HEADER include/spdk/scsi.h 00:03:29.416 TEST_HEADER include/spdk/scsi_spec.h 00:03:29.416 TEST_HEADER include/spdk/sock.h 00:03:29.416 TEST_HEADER include/spdk/stdinc.h 00:03:29.416 TEST_HEADER include/spdk/string.h 00:03:29.416 TEST_HEADER include/spdk/thread.h 00:03:29.416 TEST_HEADER include/spdk/trace.h 00:03:29.416 TEST_HEADER include/spdk/trace_parser.h 00:03:29.416 TEST_HEADER include/spdk/tree.h 00:03:29.416 LINK spdk_lspci 00:03:29.416 TEST_HEADER include/spdk/ublk.h 00:03:29.416 TEST_HEADER include/spdk/util.h 00:03:29.416 TEST_HEADER include/spdk/uuid.h 00:03:29.416 TEST_HEADER include/spdk/version.h 00:03:29.416 TEST_HEADER include/spdk/vfio_user_pci.h 00:03:29.416 TEST_HEADER include/spdk/vfio_user_spec.h 00:03:29.416 TEST_HEADER include/spdk/vhost.h 00:03:29.416 TEST_HEADER include/spdk/vmd.h 00:03:29.416 TEST_HEADER include/spdk/xor.h 00:03:29.416 TEST_HEADER include/spdk/zipf.h 00:03:29.416 CXX test/cpp_headers/accel.o 00:03:29.416 LINK rpc_client_test 00:03:29.416 LINK lsvmd 00:03:29.416 LINK spdk_nvme_discover 00:03:29.416 LINK led 00:03:29.416 LINK event_perf 00:03:29.416 LINK interrupt_tgt 00:03:29.680 LINK nvmf_tgt 00:03:29.680 LINK poller_perf 00:03:29.680 LINK zipf 00:03:29.680 LINK pmr_persistence 00:03:29.680 LINK cmb_copy 00:03:29.680 LINK vhost 00:03:29.680 LINK spdk_trace_record 00:03:29.680 LINK iscsi_tgt 00:03:29.680 LINK ioat_perf 00:03:29.680 LINK verify 00:03:29.680 LINK bdev_svc 00:03:29.680 LINK hello_world 00:03:29.680 LINK hotplug 00:03:29.680 LINK hello_sock 00:03:29.680 LINK spdk_tgt 00:03:29.680 LINK mkfs 00:03:29.680 LINK mem_callbacks 00:03:29.680 LINK hello_blob 00:03:29.680 LINK hello_bdev 00:03:29.680 LINK thread 00:03:29.680 CXX test/cpp_headers/accel_module.o 00:03:29.680 LINK aer 00:03:29.942 CC test/nvme/reset/reset.o 00:03:29.942 LINK arbitration 00:03:29.942 LINK nvmf 00:03:29.942 LINK spdk_dd 00:03:29.942 CXX test/cpp_headers/assert.o 00:03:29.942 LINK idxd_perf 00:03:29.942 LINK reconnect 00:03:29.942 CC test/event/reactor/reactor.o 00:03:29.942 LINK abort 00:03:29.942 CC test/env/vtophys/vtophys.o 00:03:29.942 CC test/nvme/sgl/sgl.o 00:03:29.942 LINK spdk_trace 00:03:29.942 CC test/nvme/e2edp/nvme_dp.o 00:03:29.942 CC test/event/reactor_perf/reactor_perf.o 00:03:29.942 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:03:29.942 CC app/fio/bdev/fio_plugin.o 00:03:29.942 CC test/app/histogram_perf/histogram_perf.o 00:03:29.942 LINK dif 00:03:29.942 CXX test/cpp_headers/barrier.o 00:03:29.942 LINK bdevio 00:03:29.942 CC test/nvme/overhead/overhead.o 00:03:29.942 CC test/nvme/err_injection/err_injection.o 00:03:29.942 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:03:29.942 CC test/nvme/startup/startup.o 00:03:30.206 LINK test_dma 00:03:30.206 CC test/event/app_repeat/app_repeat.o 00:03:30.206 CC test/app/jsoncat/jsoncat.o 00:03:30.206 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:03:30.206 CC test/nvme/reserve/reserve.o 00:03:30.206 CXX test/cpp_headers/base64.o 00:03:30.206 CC test/env/memory/memory_ut.o 00:03:30.206 CXX test/cpp_headers/bdev.o 00:03:30.206 LINK accel_perf 00:03:30.206 LINK nvme_manage 00:03:30.206 CXX test/cpp_headers/bdev_module.o 00:03:30.206 CC test/event/scheduler/scheduler.o 00:03:30.206 CXX test/cpp_headers/bdev_zone.o 00:03:30.206 CXX test/cpp_headers/bit_array.o 00:03:30.206 CC test/nvme/simple_copy/simple_copy.o 00:03:30.206 CXX test/cpp_headers/bit_pool.o 00:03:30.206 CC test/env/pci/pci_ut.o 00:03:30.206 LINK reactor 00:03:30.206 CXX test/cpp_headers/blob_bdev.o 00:03:30.206 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:03:30.206 LINK blobcli 00:03:30.206 LINK spdk_nvme 00:03:30.206 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:03:30.206 LINK vtophys 00:03:30.206 LINK reactor_perf 00:03:30.206 CXX test/cpp_headers/blobfs_bdev.o 00:03:30.206 CC test/app/stub/stub.o 00:03:30.206 LINK histogram_perf 00:03:30.206 CXX test/cpp_headers/blobfs.o 00:03:30.206 LINK reset 00:03:30.473 CC test/nvme/connect_stress/connect_stress.o 00:03:30.473 LINK env_dpdk_post_init 00:03:30.473 CC test/nvme/boot_partition/boot_partition.o 00:03:30.473 LINK jsoncat 00:03:30.473 LINK startup 00:03:30.473 LINK app_repeat 00:03:30.473 CXX test/cpp_headers/blob.o 00:03:30.473 LINK err_injection 00:03:30.473 CXX test/cpp_headers/conf.o 00:03:30.473 CXX test/cpp_headers/config.o 00:03:30.473 CXX test/cpp_headers/cpuset.o 00:03:30.473 CC test/nvme/compliance/nvme_compliance.o 00:03:30.473 LINK sgl 00:03:30.473 CC test/nvme/fused_ordering/fused_ordering.o 00:03:30.473 CXX test/cpp_headers/crc16.o 00:03:30.473 CXX test/cpp_headers/crc32.o 00:03:30.473 CC test/nvme/doorbell_aers/doorbell_aers.o 00:03:30.473 LINK reserve 00:03:30.473 LINK nvme_dp 00:03:30.473 CXX test/cpp_headers/crc64.o 00:03:30.473 CXX test/cpp_headers/dif.o 00:03:30.473 CXX test/cpp_headers/dma.o 00:03:30.473 CXX test/cpp_headers/endian.o 00:03:30.473 CXX test/cpp_headers/env_dpdk.o 00:03:30.473 CXX test/cpp_headers/env.o 00:03:30.473 CC test/nvme/cuse/cuse.o 00:03:30.473 CC test/nvme/fdp/fdp.o 00:03:30.473 CXX test/cpp_headers/event.o 00:03:30.736 LINK overhead 00:03:30.736 CXX test/cpp_headers/fd_group.o 00:03:30.736 CXX test/cpp_headers/fd.o 00:03:30.736 CXX test/cpp_headers/file.o 00:03:30.736 LINK scheduler 00:03:30.736 CXX test/cpp_headers/ftl.o 00:03:30.736 CXX test/cpp_headers/gpt_spec.o 00:03:30.736 CXX test/cpp_headers/hexlify.o 00:03:30.736 LINK stub 00:03:30.736 LINK spdk_nvme_perf 00:03:30.736 CXX test/cpp_headers/histogram_data.o 00:03:30.736 LINK simple_copy 00:03:30.736 CXX test/cpp_headers/idxd.o 00:03:30.736 LINK connect_stress 00:03:30.736 CXX test/cpp_headers/idxd_spec.o 00:03:30.736 LINK boot_partition 00:03:30.736 LINK spdk_nvme_identify 00:03:30.736 CXX test/cpp_headers/init.o 00:03:30.736 LINK bdevperf 00:03:30.736 CXX test/cpp_headers/ioat.o 00:03:30.736 LINK spdk_top 00:03:30.736 CXX test/cpp_headers/ioat_spec.o 00:03:30.736 CXX test/cpp_headers/iscsi_spec.o 00:03:30.736 CXX test/cpp_headers/json.o 00:03:30.736 CXX test/cpp_headers/jsonrpc.o 00:03:30.736 CXX test/cpp_headers/likely.o 00:03:30.736 LINK nvme_fuzz 00:03:30.736 CXX test/cpp_headers/log.o 00:03:30.997 CXX test/cpp_headers/lvol.o 00:03:30.997 CXX test/cpp_headers/memory.o 00:03:30.997 CXX test/cpp_headers/mmio.o 00:03:30.997 LINK fused_ordering 00:03:30.997 CXX test/cpp_headers/nbd.o 00:03:30.997 LINK doorbell_aers 00:03:30.997 CXX test/cpp_headers/notify.o 00:03:30.997 CXX test/cpp_headers/nvme.o 00:03:30.997 LINK spdk_bdev 00:03:30.997 CXX test/cpp_headers/nvme_intel.o 00:03:30.997 CXX test/cpp_headers/nvme_ocssd.o 00:03:30.997 LINK pci_ut 00:03:30.997 CXX test/cpp_headers/nvme_ocssd_spec.o 00:03:30.997 CXX test/cpp_headers/nvme_spec.o 00:03:30.997 CXX test/cpp_headers/nvme_zns.o 00:03:30.997 CXX test/cpp_headers/nvmf_cmd.o 00:03:30.997 CXX test/cpp_headers/nvmf_fc_spec.o 00:03:30.997 CXX test/cpp_headers/nvmf.o 00:03:30.997 CXX test/cpp_headers/nvmf_spec.o 00:03:30.997 CXX test/cpp_headers/nvmf_transport.o 00:03:30.997 CXX test/cpp_headers/opal.o 00:03:30.997 CXX test/cpp_headers/opal_spec.o 00:03:30.997 CXX test/cpp_headers/pci_ids.o 00:03:30.997 CXX test/cpp_headers/pipe.o 00:03:30.997 CXX test/cpp_headers/queue.o 00:03:30.997 CXX test/cpp_headers/reduce.o 00:03:30.997 LINK vhost_fuzz 00:03:30.997 CXX test/cpp_headers/rpc.o 00:03:30.997 CXX test/cpp_headers/scheduler.o 00:03:30.997 CXX test/cpp_headers/scsi.o 00:03:30.997 LINK memory_ut 00:03:30.997 CXX test/cpp_headers/scsi_spec.o 00:03:30.997 CXX test/cpp_headers/sock.o 00:03:30.997 CXX test/cpp_headers/stdinc.o 00:03:30.997 CXX test/cpp_headers/string.o 00:03:30.997 CXX test/cpp_headers/thread.o 00:03:31.255 CXX test/cpp_headers/trace.o 00:03:31.255 LINK nvme_compliance 00:03:31.255 CXX test/cpp_headers/trace_parser.o 00:03:31.255 CXX test/cpp_headers/tree.o 00:03:31.255 CXX test/cpp_headers/ublk.o 00:03:31.255 CXX test/cpp_headers/util.o 00:03:31.255 CXX test/cpp_headers/uuid.o 00:03:31.255 CXX test/cpp_headers/version.o 00:03:31.255 CXX test/cpp_headers/vfio_user_pci.o 00:03:31.255 CXX test/cpp_headers/vfio_user_spec.o 00:03:31.255 CXX test/cpp_headers/vhost.o 00:03:31.255 CXX test/cpp_headers/vmd.o 00:03:31.255 LINK fdp 00:03:31.255 CXX test/cpp_headers/xor.o 00:03:31.255 CXX test/cpp_headers/zipf.o 00:03:32.188 LINK cuse 00:03:32.446 LINK iscsi_fuzz 00:03:34.978 LINK esnap 00:03:34.978 00:03:34.978 real 0m37.841s 00:03:34.978 user 7m15.257s 00:03:34.978 sys 1m36.902s 00:03:34.978 01:04:43 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:03:34.978 01:04:43 -- common/autotest_common.sh@10 -- $ set +x 00:03:34.978 ************************************ 00:03:34.978 END TEST make 00:03:34.978 ************************************ 00:03:34.978 01:04:43 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:34.978 01:04:43 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:34.978 01:04:43 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:35.237 01:04:43 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:35.237 01:04:43 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:35.237 01:04:43 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:35.237 01:04:43 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:35.237 01:04:43 -- scripts/common.sh@335 -- # IFS=.-: 00:03:35.237 01:04:43 -- scripts/common.sh@335 -- # read -ra ver1 00:03:35.237 01:04:43 -- scripts/common.sh@336 -- # IFS=.-: 00:03:35.237 01:04:43 -- scripts/common.sh@336 -- # read -ra ver2 00:03:35.237 01:04:43 -- scripts/common.sh@337 -- # local 'op=<' 00:03:35.237 01:04:43 -- scripts/common.sh@339 -- # ver1_l=2 00:03:35.237 01:04:43 -- scripts/common.sh@340 -- # ver2_l=1 00:03:35.237 01:04:43 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:35.237 01:04:43 -- scripts/common.sh@343 -- # case "$op" in 00:03:35.237 01:04:43 -- scripts/common.sh@344 -- # : 1 00:03:35.237 01:04:43 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:35.237 01:04:43 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:35.237 01:04:43 -- scripts/common.sh@364 -- # decimal 1 00:03:35.237 01:04:43 -- scripts/common.sh@352 -- # local d=1 00:03:35.237 01:04:43 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:35.237 01:04:43 -- scripts/common.sh@354 -- # echo 1 00:03:35.237 01:04:43 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:35.237 01:04:43 -- scripts/common.sh@365 -- # decimal 2 00:03:35.237 01:04:43 -- scripts/common.sh@352 -- # local d=2 00:03:35.237 01:04:43 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:35.237 01:04:43 -- scripts/common.sh@354 -- # echo 2 00:03:35.237 01:04:43 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:35.237 01:04:43 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:35.237 01:04:43 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:35.237 01:04:43 -- scripts/common.sh@367 -- # return 0 00:03:35.237 01:04:43 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:35.237 01:04:43 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:35.237 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:35.237 --rc genhtml_branch_coverage=1 00:03:35.237 --rc genhtml_function_coverage=1 00:03:35.237 --rc genhtml_legend=1 00:03:35.237 --rc geninfo_all_blocks=1 00:03:35.237 --rc geninfo_unexecuted_blocks=1 00:03:35.237 00:03:35.237 ' 00:03:35.237 01:04:43 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:35.237 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:35.237 --rc genhtml_branch_coverage=1 00:03:35.237 --rc genhtml_function_coverage=1 00:03:35.237 --rc genhtml_legend=1 00:03:35.237 --rc geninfo_all_blocks=1 00:03:35.237 --rc geninfo_unexecuted_blocks=1 00:03:35.237 00:03:35.237 ' 00:03:35.237 01:04:43 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:35.237 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:35.237 --rc genhtml_branch_coverage=1 00:03:35.237 --rc genhtml_function_coverage=1 00:03:35.237 --rc genhtml_legend=1 00:03:35.237 --rc geninfo_all_blocks=1 00:03:35.237 --rc geninfo_unexecuted_blocks=1 00:03:35.237 00:03:35.237 ' 00:03:35.237 01:04:43 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:35.237 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:35.237 --rc genhtml_branch_coverage=1 00:03:35.237 --rc genhtml_function_coverage=1 00:03:35.237 --rc genhtml_legend=1 00:03:35.237 --rc geninfo_all_blocks=1 00:03:35.237 --rc geninfo_unexecuted_blocks=1 00:03:35.237 00:03:35.237 ' 00:03:35.237 01:04:43 -- spdk/autotest.sh@25 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:03:35.237 01:04:43 -- nvmf/common.sh@7 -- # uname -s 00:03:35.237 01:04:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:03:35.237 01:04:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:03:35.237 01:04:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:03:35.237 01:04:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:03:35.237 01:04:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:03:35.237 01:04:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:03:35.237 01:04:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:03:35.237 01:04:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:03:35.237 01:04:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:03:35.237 01:04:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:03:35.237 01:04:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:03:35.237 01:04:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:03:35.237 01:04:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:03:35.237 01:04:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:03:35.237 01:04:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:03:35.237 01:04:43 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:03:35.237 01:04:43 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:03:35.237 01:04:43 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:03:35.237 01:04:43 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:03:35.237 01:04:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:35.237 01:04:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:35.237 01:04:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:35.237 01:04:43 -- paths/export.sh@5 -- # export PATH 00:03:35.237 01:04:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:35.237 01:04:43 -- nvmf/common.sh@46 -- # : 0 00:03:35.237 01:04:43 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:03:35.237 01:04:43 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:03:35.237 01:04:43 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:03:35.237 01:04:43 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:03:35.237 01:04:43 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:03:35.237 01:04:43 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:03:35.237 01:04:43 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:03:35.237 01:04:43 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:03:35.237 01:04:43 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:03:35.237 01:04:43 -- spdk/autotest.sh@32 -- # uname -s 00:03:35.237 01:04:43 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:03:35.237 01:04:43 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:03:35.237 01:04:43 -- spdk/autotest.sh@34 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:03:35.237 01:04:43 -- spdk/autotest.sh@39 -- # echo '|/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/core-collector.sh %P %s %t' 00:03:35.237 01:04:43 -- spdk/autotest.sh@40 -- # echo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:03:35.237 01:04:43 -- spdk/autotest.sh@44 -- # modprobe nbd 00:03:35.237 01:04:43 -- spdk/autotest.sh@46 -- # type -P udevadm 00:03:35.237 01:04:43 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:03:35.237 01:04:43 -- spdk/autotest.sh@48 -- # udevadm_pid=983520 00:03:35.237 01:04:43 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:03:35.237 01:04:43 -- spdk/autotest.sh@51 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:03:35.237 01:04:43 -- spdk/autotest.sh@54 -- # echo 983522 00:03:35.237 01:04:43 -- spdk/autotest.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:03:35.237 01:04:43 -- spdk/autotest.sh@56 -- # echo 983523 00:03:35.237 01:04:43 -- spdk/autotest.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:03:35.237 01:04:43 -- spdk/autotest.sh@58 -- # [[ ............................... != QEMU ]] 00:03:35.237 01:04:43 -- spdk/autotest.sh@60 -- # echo 983524 00:03:35.237 01:04:43 -- spdk/autotest.sh@59 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:03:35.237 01:04:43 -- spdk/autotest.sh@62 -- # echo 983525 00:03:35.237 01:04:43 -- spdk/autotest.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:03:35.237 01:04:43 -- spdk/autotest.sh@66 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:03:35.237 01:04:43 -- spdk/autotest.sh@68 -- # timing_enter autotest 00:03:35.237 01:04:43 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:35.238 01:04:43 -- common/autotest_common.sh@10 -- # set +x 00:03:35.238 01:04:43 -- spdk/autotest.sh@70 -- # create_test_list 00:03:35.238 01:04:43 -- common/autotest_common.sh@746 -- # xtrace_disable 00:03:35.238 01:04:43 -- common/autotest_common.sh@10 -- # set +x 00:03:35.238 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-bmc-pm.bmc.pm.log 00:03:35.238 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-cpu-temp.pm.log 00:03:35.238 01:04:43 -- spdk/autotest.sh@72 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/autotest.sh 00:03:35.238 01:04:43 -- spdk/autotest.sh@72 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:35.238 01:04:43 -- spdk/autotest.sh@72 -- # src=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:35.238 01:04:43 -- spdk/autotest.sh@73 -- # out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:03:35.238 01:04:43 -- spdk/autotest.sh@74 -- # cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:35.238 01:04:43 -- spdk/autotest.sh@76 -- # freebsd_update_contigmem_mod 00:03:35.238 01:04:43 -- common/autotest_common.sh@1450 -- # uname 00:03:35.238 01:04:43 -- common/autotest_common.sh@1450 -- # '[' Linux = FreeBSD ']' 00:03:35.238 01:04:43 -- spdk/autotest.sh@77 -- # freebsd_set_maxsock_buf 00:03:35.238 01:04:43 -- common/autotest_common.sh@1470 -- # uname 00:03:35.238 01:04:43 -- common/autotest_common.sh@1470 -- # [[ Linux = FreeBSD ]] 00:03:35.238 01:04:43 -- spdk/autotest.sh@79 -- # [[ y == y ]] 00:03:35.238 01:04:43 -- spdk/autotest.sh@81 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 --version 00:03:35.238 lcov: LCOV version 1.15 00:03:35.238 01:04:43 -- spdk/autotest.sh@83 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -i -t Baseline -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info 00:03:38.520 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno:no functions found 00:03:38.520 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno 00:03:38.520 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno:no functions found 00:03:38.520 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno 00:03:38.520 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno:no functions found 00:03:38.520 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno 00:04:10.593 01:05:16 -- spdk/autotest.sh@87 -- # timing_enter pre_cleanup 00:04:10.593 01:05:16 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:10.593 01:05:16 -- common/autotest_common.sh@10 -- # set +x 00:04:10.593 01:05:16 -- spdk/autotest.sh@89 -- # rm -f 00:04:10.593 01:05:16 -- spdk/autotest.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:10.593 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:04:10.593 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:04:10.593 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:04:10.593 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:04:10.593 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:04:10.593 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:04:10.593 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:04:10.593 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:04:10.593 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:04:10.593 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:04:10.593 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:04:10.593 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:04:10.593 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:04:10.593 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:04:10.593 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:04:10.593 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:04:10.593 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:04:10.593 01:05:18 -- spdk/autotest.sh@94 -- # get_zoned_devs 00:04:10.593 01:05:18 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:04:10.593 01:05:18 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:04:10.593 01:05:18 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:04:10.593 01:05:18 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:04:10.593 01:05:18 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:04:10.593 01:05:18 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:04:10.593 01:05:18 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:04:10.593 01:05:18 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:04:10.593 01:05:18 -- spdk/autotest.sh@96 -- # (( 0 > 0 )) 00:04:10.593 01:05:18 -- spdk/autotest.sh@108 -- # ls /dev/nvme0n1 00:04:10.593 01:05:18 -- spdk/autotest.sh@108 -- # grep -v p 00:04:10.593 01:05:18 -- spdk/autotest.sh@108 -- # for dev in $(ls /dev/nvme*n* | grep -v p || true) 00:04:10.593 01:05:18 -- spdk/autotest.sh@110 -- # [[ -z '' ]] 00:04:10.593 01:05:18 -- spdk/autotest.sh@111 -- # block_in_use /dev/nvme0n1 00:04:10.593 01:05:18 -- scripts/common.sh@380 -- # local block=/dev/nvme0n1 pt 00:04:10.593 01:05:18 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:04:10.593 No valid GPT data, bailing 00:04:10.593 01:05:18 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:04:10.593 01:05:18 -- scripts/common.sh@393 -- # pt= 00:04:10.593 01:05:18 -- scripts/common.sh@394 -- # return 1 00:04:10.593 01:05:18 -- spdk/autotest.sh@112 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:04:10.593 1+0 records in 00:04:10.593 1+0 records out 00:04:10.593 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00236245 s, 444 MB/s 00:04:10.593 01:05:18 -- spdk/autotest.sh@116 -- # sync 00:04:10.593 01:05:18 -- spdk/autotest.sh@118 -- # xtrace_disable_per_cmd reap_spdk_processes 00:04:10.593 01:05:18 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:04:10.593 01:05:18 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:04:12.492 01:05:20 -- spdk/autotest.sh@122 -- # uname -s 00:04:12.492 01:05:20 -- spdk/autotest.sh@122 -- # '[' Linux = Linux ']' 00:04:12.492 01:05:20 -- spdk/autotest.sh@123 -- # run_test setup.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:04:12.492 01:05:20 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:12.492 01:05:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:12.492 01:05:20 -- common/autotest_common.sh@10 -- # set +x 00:04:12.492 ************************************ 00:04:12.492 START TEST setup.sh 00:04:12.492 ************************************ 00:04:12.492 01:05:20 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:04:12.492 * Looking for test storage... 00:04:12.492 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:12.492 01:05:20 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:12.492 01:05:20 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:12.492 01:05:20 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:12.492 01:05:20 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:12.492 01:05:20 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:12.492 01:05:20 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:12.492 01:05:20 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:12.492 01:05:20 -- scripts/common.sh@335 -- # IFS=.-: 00:04:12.492 01:05:20 -- scripts/common.sh@335 -- # read -ra ver1 00:04:12.492 01:05:20 -- scripts/common.sh@336 -- # IFS=.-: 00:04:12.492 01:05:20 -- scripts/common.sh@336 -- # read -ra ver2 00:04:12.492 01:05:20 -- scripts/common.sh@337 -- # local 'op=<' 00:04:12.492 01:05:20 -- scripts/common.sh@339 -- # ver1_l=2 00:04:12.492 01:05:20 -- scripts/common.sh@340 -- # ver2_l=1 00:04:12.492 01:05:20 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:12.492 01:05:20 -- scripts/common.sh@343 -- # case "$op" in 00:04:12.492 01:05:20 -- scripts/common.sh@344 -- # : 1 00:04:12.492 01:05:20 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:12.492 01:05:20 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:12.492 01:05:20 -- scripts/common.sh@364 -- # decimal 1 00:04:12.492 01:05:20 -- scripts/common.sh@352 -- # local d=1 00:04:12.492 01:05:20 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:12.492 01:05:20 -- scripts/common.sh@354 -- # echo 1 00:04:12.492 01:05:20 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:12.492 01:05:20 -- scripts/common.sh@365 -- # decimal 2 00:04:12.492 01:05:20 -- scripts/common.sh@352 -- # local d=2 00:04:12.492 01:05:20 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:12.492 01:05:20 -- scripts/common.sh@354 -- # echo 2 00:04:12.492 01:05:20 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:12.492 01:05:20 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:12.492 01:05:20 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:12.492 01:05:20 -- scripts/common.sh@367 -- # return 0 00:04:12.492 01:05:20 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:12.492 01:05:20 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:12.492 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:12.492 --rc genhtml_branch_coverage=1 00:04:12.492 --rc genhtml_function_coverage=1 00:04:12.492 --rc genhtml_legend=1 00:04:12.492 --rc geninfo_all_blocks=1 00:04:12.492 --rc geninfo_unexecuted_blocks=1 00:04:12.492 00:04:12.492 ' 00:04:12.492 01:05:20 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:12.492 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:12.492 --rc genhtml_branch_coverage=1 00:04:12.492 --rc genhtml_function_coverage=1 00:04:12.492 --rc genhtml_legend=1 00:04:12.492 --rc geninfo_all_blocks=1 00:04:12.492 --rc geninfo_unexecuted_blocks=1 00:04:12.492 00:04:12.492 ' 00:04:12.492 01:05:20 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:12.492 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:12.492 --rc genhtml_branch_coverage=1 00:04:12.492 --rc genhtml_function_coverage=1 00:04:12.492 --rc genhtml_legend=1 00:04:12.492 --rc geninfo_all_blocks=1 00:04:12.492 --rc geninfo_unexecuted_blocks=1 00:04:12.492 00:04:12.492 ' 00:04:12.492 01:05:20 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:12.492 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:12.492 --rc genhtml_branch_coverage=1 00:04:12.492 --rc genhtml_function_coverage=1 00:04:12.492 --rc genhtml_legend=1 00:04:12.492 --rc geninfo_all_blocks=1 00:04:12.492 --rc geninfo_unexecuted_blocks=1 00:04:12.492 00:04:12.492 ' 00:04:12.492 01:05:20 -- setup/test-setup.sh@10 -- # uname -s 00:04:12.492 01:05:20 -- setup/test-setup.sh@10 -- # [[ Linux == Linux ]] 00:04:12.492 01:05:20 -- setup/test-setup.sh@12 -- # run_test acl /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:04:12.492 01:05:20 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:12.492 01:05:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:12.492 01:05:20 -- common/autotest_common.sh@10 -- # set +x 00:04:12.492 ************************************ 00:04:12.492 START TEST acl 00:04:12.492 ************************************ 00:04:12.492 01:05:20 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:04:12.492 * Looking for test storage... 00:04:12.492 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:12.492 01:05:20 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:12.492 01:05:20 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:12.492 01:05:20 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:12.492 01:05:20 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:12.492 01:05:20 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:12.492 01:05:20 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:12.492 01:05:20 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:12.492 01:05:20 -- scripts/common.sh@335 -- # IFS=.-: 00:04:12.492 01:05:20 -- scripts/common.sh@335 -- # read -ra ver1 00:04:12.492 01:05:20 -- scripts/common.sh@336 -- # IFS=.-: 00:04:12.492 01:05:20 -- scripts/common.sh@336 -- # read -ra ver2 00:04:12.492 01:05:20 -- scripts/common.sh@337 -- # local 'op=<' 00:04:12.492 01:05:20 -- scripts/common.sh@339 -- # ver1_l=2 00:04:12.492 01:05:20 -- scripts/common.sh@340 -- # ver2_l=1 00:04:12.492 01:05:20 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:12.492 01:05:20 -- scripts/common.sh@343 -- # case "$op" in 00:04:12.492 01:05:20 -- scripts/common.sh@344 -- # : 1 00:04:12.492 01:05:20 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:12.492 01:05:20 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:12.492 01:05:20 -- scripts/common.sh@364 -- # decimal 1 00:04:12.492 01:05:20 -- scripts/common.sh@352 -- # local d=1 00:04:12.492 01:05:20 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:12.492 01:05:20 -- scripts/common.sh@354 -- # echo 1 00:04:12.492 01:05:20 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:12.492 01:05:20 -- scripts/common.sh@365 -- # decimal 2 00:04:12.492 01:05:20 -- scripts/common.sh@352 -- # local d=2 00:04:12.492 01:05:20 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:12.492 01:05:20 -- scripts/common.sh@354 -- # echo 2 00:04:12.492 01:05:20 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:12.492 01:05:20 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:12.492 01:05:20 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:12.492 01:05:20 -- scripts/common.sh@367 -- # return 0 00:04:12.492 01:05:20 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:12.492 01:05:20 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:12.492 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:12.492 --rc genhtml_branch_coverage=1 00:04:12.492 --rc genhtml_function_coverage=1 00:04:12.492 --rc genhtml_legend=1 00:04:12.492 --rc geninfo_all_blocks=1 00:04:12.492 --rc geninfo_unexecuted_blocks=1 00:04:12.492 00:04:12.492 ' 00:04:12.492 01:05:20 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:12.493 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:12.493 --rc genhtml_branch_coverage=1 00:04:12.493 --rc genhtml_function_coverage=1 00:04:12.493 --rc genhtml_legend=1 00:04:12.493 --rc geninfo_all_blocks=1 00:04:12.493 --rc geninfo_unexecuted_blocks=1 00:04:12.493 00:04:12.493 ' 00:04:12.493 01:05:20 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:12.493 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:12.493 --rc genhtml_branch_coverage=1 00:04:12.493 --rc genhtml_function_coverage=1 00:04:12.493 --rc genhtml_legend=1 00:04:12.493 --rc geninfo_all_blocks=1 00:04:12.493 --rc geninfo_unexecuted_blocks=1 00:04:12.493 00:04:12.493 ' 00:04:12.493 01:05:20 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:12.493 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:12.493 --rc genhtml_branch_coverage=1 00:04:12.493 --rc genhtml_function_coverage=1 00:04:12.493 --rc genhtml_legend=1 00:04:12.493 --rc geninfo_all_blocks=1 00:04:12.493 --rc geninfo_unexecuted_blocks=1 00:04:12.493 00:04:12.493 ' 00:04:12.493 01:05:20 -- setup/acl.sh@10 -- # get_zoned_devs 00:04:12.493 01:05:20 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:04:12.493 01:05:20 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:04:12.493 01:05:20 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:04:12.493 01:05:20 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:04:12.493 01:05:20 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:04:12.493 01:05:20 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:04:12.493 01:05:20 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:04:12.493 01:05:20 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:04:12.493 01:05:20 -- setup/acl.sh@12 -- # devs=() 00:04:12.493 01:05:20 -- setup/acl.sh@12 -- # declare -a devs 00:04:12.493 01:05:20 -- setup/acl.sh@13 -- # drivers=() 00:04:12.493 01:05:20 -- setup/acl.sh@13 -- # declare -A drivers 00:04:12.493 01:05:20 -- setup/acl.sh@51 -- # setup reset 00:04:12.493 01:05:20 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:12.493 01:05:20 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:14.393 01:05:22 -- setup/acl.sh@52 -- # collect_setup_devs 00:04:14.393 01:05:22 -- setup/acl.sh@16 -- # local dev driver 00:04:14.393 01:05:22 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:14.393 01:05:22 -- setup/acl.sh@15 -- # setup output status 00:04:14.393 01:05:22 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:14.393 01:05:22 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:04:14.959 Hugepages 00:04:14.959 node hugesize free / total 00:04:15.218 01:05:23 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:04:15.218 01:05:23 -- setup/acl.sh@19 -- # continue 00:04:15.218 01:05:23 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:15.218 01:05:23 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:04:15.218 01:05:23 -- setup/acl.sh@19 -- # continue 00:04:15.218 01:05:23 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:15.218 01:05:23 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:04:15.218 01:05:23 -- setup/acl.sh@19 -- # continue 00:04:15.218 01:05:23 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:15.218 00:04:15.218 Type BDF Vendor Device NUMA Driver Device Block devices 00:04:15.218 01:05:23 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:04:15.218 01:05:23 -- setup/acl.sh@19 -- # continue 00:04:15.218 01:05:23 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:15.218 01:05:23 -- setup/acl.sh@19 -- # [[ 0000:00:04.0 == *:*:*.* ]] 00:04:15.218 01:05:23 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:15.218 01:05:23 -- setup/acl.sh@20 -- # continue 00:04:15.218 01:05:23 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:15.218 01:05:23 -- setup/acl.sh@19 -- # [[ 0000:00:04.1 == *:*:*.* ]] 00:04:15.218 01:05:23 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:15.218 01:05:23 -- setup/acl.sh@20 -- # continue 00:04:15.218 01:05:23 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:15.218 01:05:23 -- setup/acl.sh@19 -- # [[ 0000:00:04.2 == *:*:*.* ]] 00:04:15.218 01:05:23 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:15.218 01:05:23 -- setup/acl.sh@20 -- # continue 00:04:15.218 01:05:23 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:15.218 01:05:23 -- setup/acl.sh@19 -- # [[ 0000:00:04.3 == *:*:*.* ]] 00:04:15.218 01:05:23 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:15.218 01:05:23 -- setup/acl.sh@20 -- # continue 00:04:15.218 01:05:23 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:15.218 01:05:23 -- setup/acl.sh@19 -- # [[ 0000:00:04.4 == *:*:*.* ]] 00:04:15.218 01:05:23 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:15.218 01:05:23 -- setup/acl.sh@20 -- # continue 00:04:15.218 01:05:23 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:15.218 01:05:23 -- setup/acl.sh@19 -- # [[ 0000:00:04.5 == *:*:*.* ]] 00:04:15.218 01:05:23 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:15.218 01:05:23 -- setup/acl.sh@20 -- # continue 00:04:15.218 01:05:23 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:15.218 01:05:23 -- setup/acl.sh@19 -- # [[ 0000:00:04.6 == *:*:*.* ]] 00:04:15.218 01:05:23 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:15.218 01:05:23 -- setup/acl.sh@20 -- # continue 00:04:15.218 01:05:23 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:15.218 01:05:23 -- setup/acl.sh@19 -- # [[ 0000:00:04.7 == *:*:*.* ]] 00:04:15.218 01:05:23 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:15.218 01:05:23 -- setup/acl.sh@20 -- # continue 00:04:15.218 01:05:23 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:15.218 01:05:23 -- setup/acl.sh@19 -- # [[ 0000:80:04.0 == *:*:*.* ]] 00:04:15.219 01:05:23 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:15.219 01:05:23 -- setup/acl.sh@20 -- # continue 00:04:15.219 01:05:23 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:15.219 01:05:23 -- setup/acl.sh@19 -- # [[ 0000:80:04.1 == *:*:*.* ]] 00:04:15.219 01:05:23 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:15.219 01:05:23 -- setup/acl.sh@20 -- # continue 00:04:15.219 01:05:23 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:15.219 01:05:23 -- setup/acl.sh@19 -- # [[ 0000:80:04.2 == *:*:*.* ]] 00:04:15.219 01:05:23 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:15.219 01:05:23 -- setup/acl.sh@20 -- # continue 00:04:15.219 01:05:23 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:15.219 01:05:23 -- setup/acl.sh@19 -- # [[ 0000:80:04.3 == *:*:*.* ]] 00:04:15.219 01:05:23 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:15.219 01:05:23 -- setup/acl.sh@20 -- # continue 00:04:15.219 01:05:23 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:15.219 01:05:23 -- setup/acl.sh@19 -- # [[ 0000:80:04.4 == *:*:*.* ]] 00:04:15.219 01:05:23 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:15.219 01:05:23 -- setup/acl.sh@20 -- # continue 00:04:15.219 01:05:23 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:15.219 01:05:23 -- setup/acl.sh@19 -- # [[ 0000:80:04.5 == *:*:*.* ]] 00:04:15.219 01:05:23 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:15.219 01:05:23 -- setup/acl.sh@20 -- # continue 00:04:15.219 01:05:23 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:15.219 01:05:23 -- setup/acl.sh@19 -- # [[ 0000:80:04.6 == *:*:*.* ]] 00:04:15.219 01:05:23 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:15.219 01:05:23 -- setup/acl.sh@20 -- # continue 00:04:15.219 01:05:23 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:15.219 01:05:23 -- setup/acl.sh@19 -- # [[ 0000:80:04.7 == *:*:*.* ]] 00:04:15.219 01:05:23 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:15.219 01:05:23 -- setup/acl.sh@20 -- # continue 00:04:15.219 01:05:23 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:15.219 01:05:23 -- setup/acl.sh@19 -- # [[ 0000:88:00.0 == *:*:*.* ]] 00:04:15.219 01:05:23 -- setup/acl.sh@20 -- # [[ nvme == nvme ]] 00:04:15.219 01:05:23 -- setup/acl.sh@21 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:04:15.219 01:05:23 -- setup/acl.sh@22 -- # devs+=("$dev") 00:04:15.219 01:05:23 -- setup/acl.sh@22 -- # drivers["$dev"]=nvme 00:04:15.219 01:05:23 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:15.219 01:05:23 -- setup/acl.sh@24 -- # (( 1 > 0 )) 00:04:15.219 01:05:23 -- setup/acl.sh@54 -- # run_test denied denied 00:04:15.219 01:05:23 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:15.219 01:05:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:15.219 01:05:23 -- common/autotest_common.sh@10 -- # set +x 00:04:15.219 ************************************ 00:04:15.219 START TEST denied 00:04:15.219 ************************************ 00:04:15.219 01:05:23 -- common/autotest_common.sh@1114 -- # denied 00:04:15.219 01:05:23 -- setup/acl.sh@38 -- # PCI_BLOCKED=' 0000:88:00.0' 00:04:15.219 01:05:23 -- setup/acl.sh@38 -- # setup output config 00:04:15.219 01:05:23 -- setup/acl.sh@39 -- # grep 'Skipping denied controller at 0000:88:00.0' 00:04:15.219 01:05:23 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:15.219 01:05:23 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:16.594 0000:88:00.0 (8086 0a54): Skipping denied controller at 0000:88:00.0 00:04:16.594 01:05:24 -- setup/acl.sh@40 -- # verify 0000:88:00.0 00:04:16.594 01:05:24 -- setup/acl.sh@28 -- # local dev driver 00:04:16.594 01:05:24 -- setup/acl.sh@30 -- # for dev in "$@" 00:04:16.594 01:05:24 -- setup/acl.sh@31 -- # [[ -e /sys/bus/pci/devices/0000:88:00.0 ]] 00:04:16.594 01:05:24 -- setup/acl.sh@32 -- # readlink -f /sys/bus/pci/devices/0000:88:00.0/driver 00:04:16.594 01:05:24 -- setup/acl.sh@32 -- # driver=/sys/bus/pci/drivers/nvme 00:04:16.594 01:05:24 -- setup/acl.sh@33 -- # [[ nvme == \n\v\m\e ]] 00:04:16.594 01:05:24 -- setup/acl.sh@41 -- # setup reset 00:04:16.594 01:05:24 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:16.594 01:05:24 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:19.125 00:04:19.125 real 0m3.849s 00:04:19.125 user 0m1.135s 00:04:19.125 sys 0m1.827s 00:04:19.125 01:05:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:19.125 01:05:27 -- common/autotest_common.sh@10 -- # set +x 00:04:19.125 ************************************ 00:04:19.125 END TEST denied 00:04:19.125 ************************************ 00:04:19.125 01:05:27 -- setup/acl.sh@55 -- # run_test allowed allowed 00:04:19.125 01:05:27 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:19.125 01:05:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:19.125 01:05:27 -- common/autotest_common.sh@10 -- # set +x 00:04:19.125 ************************************ 00:04:19.125 START TEST allowed 00:04:19.125 ************************************ 00:04:19.125 01:05:27 -- common/autotest_common.sh@1114 -- # allowed 00:04:19.125 01:05:27 -- setup/acl.sh@45 -- # PCI_ALLOWED=0000:88:00.0 00:04:19.125 01:05:27 -- setup/acl.sh@45 -- # setup output config 00:04:19.125 01:05:27 -- setup/acl.sh@46 -- # grep -E '0000:88:00.0 .*: nvme -> .*' 00:04:19.125 01:05:27 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:19.125 01:05:27 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:21.658 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:04:21.658 01:05:29 -- setup/acl.sh@47 -- # verify 00:04:21.658 01:05:29 -- setup/acl.sh@28 -- # local dev driver 00:04:21.658 01:05:29 -- setup/acl.sh@48 -- # setup reset 00:04:21.658 01:05:29 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:21.658 01:05:29 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:23.032 00:04:23.032 real 0m3.907s 00:04:23.032 user 0m1.056s 00:04:23.032 sys 0m1.745s 00:04:23.032 01:05:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:23.032 01:05:31 -- common/autotest_common.sh@10 -- # set +x 00:04:23.032 ************************************ 00:04:23.032 END TEST allowed 00:04:23.032 ************************************ 00:04:23.032 00:04:23.032 real 0m10.663s 00:04:23.032 user 0m3.307s 00:04:23.032 sys 0m5.448s 00:04:23.032 01:05:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:23.032 01:05:31 -- common/autotest_common.sh@10 -- # set +x 00:04:23.032 ************************************ 00:04:23.032 END TEST acl 00:04:23.032 ************************************ 00:04:23.032 01:05:31 -- setup/test-setup.sh@13 -- # run_test hugepages /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:04:23.032 01:05:31 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:23.032 01:05:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:23.032 01:05:31 -- common/autotest_common.sh@10 -- # set +x 00:04:23.032 ************************************ 00:04:23.032 START TEST hugepages 00:04:23.032 ************************************ 00:04:23.032 01:05:31 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:04:23.032 * Looking for test storage... 00:04:23.032 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:23.032 01:05:31 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:23.032 01:05:31 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:23.032 01:05:31 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:23.292 01:05:31 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:23.292 01:05:31 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:23.292 01:05:31 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:23.292 01:05:31 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:23.292 01:05:31 -- scripts/common.sh@335 -- # IFS=.-: 00:04:23.292 01:05:31 -- scripts/common.sh@335 -- # read -ra ver1 00:04:23.292 01:05:31 -- scripts/common.sh@336 -- # IFS=.-: 00:04:23.292 01:05:31 -- scripts/common.sh@336 -- # read -ra ver2 00:04:23.292 01:05:31 -- scripts/common.sh@337 -- # local 'op=<' 00:04:23.292 01:05:31 -- scripts/common.sh@339 -- # ver1_l=2 00:04:23.292 01:05:31 -- scripts/common.sh@340 -- # ver2_l=1 00:04:23.292 01:05:31 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:23.292 01:05:31 -- scripts/common.sh@343 -- # case "$op" in 00:04:23.292 01:05:31 -- scripts/common.sh@344 -- # : 1 00:04:23.292 01:05:31 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:23.292 01:05:31 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:23.292 01:05:31 -- scripts/common.sh@364 -- # decimal 1 00:04:23.292 01:05:31 -- scripts/common.sh@352 -- # local d=1 00:04:23.292 01:05:31 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:23.292 01:05:31 -- scripts/common.sh@354 -- # echo 1 00:04:23.292 01:05:31 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:23.292 01:05:31 -- scripts/common.sh@365 -- # decimal 2 00:04:23.292 01:05:31 -- scripts/common.sh@352 -- # local d=2 00:04:23.292 01:05:31 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:23.292 01:05:31 -- scripts/common.sh@354 -- # echo 2 00:04:23.292 01:05:31 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:23.292 01:05:31 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:23.292 01:05:31 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:23.292 01:05:31 -- scripts/common.sh@367 -- # return 0 00:04:23.292 01:05:31 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:23.292 01:05:31 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:23.292 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:23.292 --rc genhtml_branch_coverage=1 00:04:23.292 --rc genhtml_function_coverage=1 00:04:23.292 --rc genhtml_legend=1 00:04:23.292 --rc geninfo_all_blocks=1 00:04:23.292 --rc geninfo_unexecuted_blocks=1 00:04:23.292 00:04:23.292 ' 00:04:23.292 01:05:31 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:23.292 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:23.292 --rc genhtml_branch_coverage=1 00:04:23.292 --rc genhtml_function_coverage=1 00:04:23.292 --rc genhtml_legend=1 00:04:23.292 --rc geninfo_all_blocks=1 00:04:23.292 --rc geninfo_unexecuted_blocks=1 00:04:23.292 00:04:23.292 ' 00:04:23.292 01:05:31 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:23.292 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:23.292 --rc genhtml_branch_coverage=1 00:04:23.292 --rc genhtml_function_coverage=1 00:04:23.292 --rc genhtml_legend=1 00:04:23.292 --rc geninfo_all_blocks=1 00:04:23.292 --rc geninfo_unexecuted_blocks=1 00:04:23.292 00:04:23.292 ' 00:04:23.292 01:05:31 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:23.292 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:23.292 --rc genhtml_branch_coverage=1 00:04:23.292 --rc genhtml_function_coverage=1 00:04:23.292 --rc genhtml_legend=1 00:04:23.292 --rc geninfo_all_blocks=1 00:04:23.292 --rc geninfo_unexecuted_blocks=1 00:04:23.292 00:04:23.292 ' 00:04:23.292 01:05:31 -- setup/hugepages.sh@10 -- # nodes_sys=() 00:04:23.292 01:05:31 -- setup/hugepages.sh@10 -- # declare -a nodes_sys 00:04:23.292 01:05:31 -- setup/hugepages.sh@12 -- # declare -i default_hugepages=0 00:04:23.292 01:05:31 -- setup/hugepages.sh@13 -- # declare -i no_nodes=0 00:04:23.292 01:05:31 -- setup/hugepages.sh@14 -- # declare -i nr_hugepages=0 00:04:23.292 01:05:31 -- setup/hugepages.sh@16 -- # get_meminfo Hugepagesize 00:04:23.292 01:05:31 -- setup/common.sh@17 -- # local get=Hugepagesize 00:04:23.292 01:05:31 -- setup/common.sh@18 -- # local node= 00:04:23.292 01:05:31 -- setup/common.sh@19 -- # local var val 00:04:23.292 01:05:31 -- setup/common.sh@20 -- # local mem_f mem 00:04:23.292 01:05:31 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:23.292 01:05:31 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:23.292 01:05:31 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:23.292 01:05:31 -- setup/common.sh@28 -- # mapfile -t mem 00:04:23.292 01:05:31 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:23.292 01:05:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.292 01:05:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.292 01:05:31 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 40637184 kB' 'MemAvailable: 44943544 kB' 'Buffers: 2708 kB' 'Cached: 12935008 kB' 'SwapCached: 0 kB' 'Active: 9307764 kB' 'Inactive: 4084660 kB' 'Active(anon): 8910432 kB' 'Inactive(anon): 0 kB' 'Active(file): 397332 kB' 'Inactive(file): 4084660 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 458108 kB' 'Mapped: 162824 kB' 'Shmem: 8455724 kB' 'KReclaimable: 469000 kB' 'Slab: 1012968 kB' 'SReclaimable: 469000 kB' 'SUnreclaim: 543968 kB' 'KernelStack: 12864 kB' 'PageTables: 8036 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 36559288 kB' 'Committed_AS: 10004268 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198328 kB' 'VmallocChunk: 0 kB' 'Percpu: 40128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 2048' 'HugePages_Free: 2048' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 4194304 kB' 'DirectMap4k: 1867356 kB' 'DirectMap2M: 17975296 kB' 'DirectMap1G: 50331648 kB' 00:04:23.292 01:05:31 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:23.292 01:05:31 -- setup/common.sh@32 -- # continue 00:04:23.292 01:05:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.292 01:05:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.292 01:05:31 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:23.292 01:05:31 -- setup/common.sh@32 -- # continue 00:04:23.292 01:05:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.292 01:05:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.292 01:05:31 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:23.292 01:05:31 -- setup/common.sh@32 -- # continue 00:04:23.292 01:05:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.292 01:05:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.292 01:05:31 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:23.292 01:05:31 -- setup/common.sh@32 -- # continue 00:04:23.292 01:05:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.292 01:05:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.292 01:05:31 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:23.292 01:05:31 -- setup/common.sh@32 -- # continue 00:04:23.292 01:05:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.292 01:05:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.292 01:05:31 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:23.292 01:05:31 -- setup/common.sh@32 -- # continue 00:04:23.292 01:05:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.292 01:05:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.292 01:05:31 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:23.292 01:05:31 -- setup/common.sh@32 -- # continue 00:04:23.292 01:05:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.292 01:05:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.292 01:05:31 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:23.292 01:05:31 -- setup/common.sh@32 -- # continue 00:04:23.292 01:05:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.292 01:05:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.292 01:05:31 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:23.292 01:05:31 -- setup/common.sh@32 -- # continue 00:04:23.292 01:05:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.292 01:05:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.292 01:05:31 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:23.292 01:05:31 -- setup/common.sh@32 -- # continue 00:04:23.292 01:05:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.292 01:05:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.292 01:05:31 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:23.292 01:05:31 -- setup/common.sh@32 -- # continue 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # continue 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # continue 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # continue 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # continue 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # continue 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # continue 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # continue 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # continue 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # continue 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # continue 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # continue 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # continue 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # continue 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # continue 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # continue 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # continue 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # continue 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # continue 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # continue 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # continue 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # continue 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # continue 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # continue 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # continue 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # continue 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # continue 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # continue 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # continue 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # continue 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # continue 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # continue 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # continue 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # continue 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # continue 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # continue 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # continue 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # continue 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # continue 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # continue 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # continue 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.293 01:05:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.293 01:05:31 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:23.294 01:05:31 -- setup/common.sh@32 -- # continue 00:04:23.294 01:05:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.294 01:05:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.294 01:05:31 -- setup/common.sh@32 -- # [[ Hugepagesize == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:23.294 01:05:31 -- setup/common.sh@33 -- # echo 2048 00:04:23.294 01:05:31 -- setup/common.sh@33 -- # return 0 00:04:23.294 01:05:31 -- setup/hugepages.sh@16 -- # default_hugepages=2048 00:04:23.294 01:05:31 -- setup/hugepages.sh@17 -- # default_huge_nr=/sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages 00:04:23.294 01:05:31 -- setup/hugepages.sh@18 -- # global_huge_nr=/proc/sys/vm/nr_hugepages 00:04:23.294 01:05:31 -- setup/hugepages.sh@21 -- # unset -v HUGE_EVEN_ALLOC 00:04:23.294 01:05:31 -- setup/hugepages.sh@22 -- # unset -v HUGEMEM 00:04:23.294 01:05:31 -- setup/hugepages.sh@23 -- # unset -v HUGENODE 00:04:23.294 01:05:31 -- setup/hugepages.sh@24 -- # unset -v NRHUGE 00:04:23.294 01:05:31 -- setup/hugepages.sh@207 -- # get_nodes 00:04:23.294 01:05:31 -- setup/hugepages.sh@27 -- # local node 00:04:23.294 01:05:31 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:23.294 01:05:31 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=2048 00:04:23.294 01:05:31 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:23.294 01:05:31 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:23.294 01:05:31 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:23.294 01:05:31 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:23.294 01:05:31 -- setup/hugepages.sh@208 -- # clear_hp 00:04:23.294 01:05:31 -- setup/hugepages.sh@37 -- # local node hp 00:04:23.294 01:05:31 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:23.294 01:05:31 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:23.294 01:05:31 -- setup/hugepages.sh@41 -- # echo 0 00:04:23.294 01:05:31 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:23.294 01:05:31 -- setup/hugepages.sh@41 -- # echo 0 00:04:23.294 01:05:31 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:23.294 01:05:31 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:23.294 01:05:31 -- setup/hugepages.sh@41 -- # echo 0 00:04:23.294 01:05:31 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:23.294 01:05:31 -- setup/hugepages.sh@41 -- # echo 0 00:04:23.294 01:05:31 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:04:23.294 01:05:31 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:04:23.294 01:05:31 -- setup/hugepages.sh@210 -- # run_test default_setup default_setup 00:04:23.294 01:05:31 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:23.294 01:05:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:23.294 01:05:31 -- common/autotest_common.sh@10 -- # set +x 00:04:23.294 ************************************ 00:04:23.294 START TEST default_setup 00:04:23.294 ************************************ 00:04:23.294 01:05:31 -- common/autotest_common.sh@1114 -- # default_setup 00:04:23.294 01:05:31 -- setup/hugepages.sh@136 -- # get_test_nr_hugepages 2097152 0 00:04:23.294 01:05:31 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:23.294 01:05:31 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:04:23.294 01:05:31 -- setup/hugepages.sh@51 -- # shift 00:04:23.294 01:05:31 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:04:23.294 01:05:31 -- setup/hugepages.sh@52 -- # local node_ids 00:04:23.294 01:05:31 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:23.294 01:05:31 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:23.294 01:05:31 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:04:23.294 01:05:31 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:04:23.294 01:05:31 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:23.294 01:05:31 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:23.294 01:05:31 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:23.294 01:05:31 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:23.294 01:05:31 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:23.294 01:05:31 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:04:23.294 01:05:31 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:23.294 01:05:31 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:04:23.294 01:05:31 -- setup/hugepages.sh@73 -- # return 0 00:04:23.294 01:05:31 -- setup/hugepages.sh@137 -- # setup output 00:04:23.294 01:05:31 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:23.294 01:05:31 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:24.672 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:24.672 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:24.672 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:24.672 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:24.672 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:24.672 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:24.672 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:24.673 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:24.673 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:24.673 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:24.673 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:24.673 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:24.673 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:24.673 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:24.673 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:24.673 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:25.613 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:04:25.613 01:05:33 -- setup/hugepages.sh@138 -- # verify_nr_hugepages 00:04:25.613 01:05:33 -- setup/hugepages.sh@89 -- # local node 00:04:25.613 01:05:33 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:25.613 01:05:33 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:25.613 01:05:33 -- setup/hugepages.sh@92 -- # local surp 00:04:25.613 01:05:33 -- setup/hugepages.sh@93 -- # local resv 00:04:25.613 01:05:33 -- setup/hugepages.sh@94 -- # local anon 00:04:25.614 01:05:33 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:25.614 01:05:33 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:25.614 01:05:33 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:25.614 01:05:33 -- setup/common.sh@18 -- # local node= 00:04:25.614 01:05:33 -- setup/common.sh@19 -- # local var val 00:04:25.614 01:05:33 -- setup/common.sh@20 -- # local mem_f mem 00:04:25.614 01:05:33 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:25.614 01:05:33 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:25.614 01:05:33 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:25.614 01:05:33 -- setup/common.sh@28 -- # mapfile -t mem 00:04:25.614 01:05:33 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.614 01:05:33 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 42744036 kB' 'MemAvailable: 47050300 kB' 'Buffers: 2708 kB' 'Cached: 12935108 kB' 'SwapCached: 0 kB' 'Active: 9312716 kB' 'Inactive: 4084660 kB' 'Active(anon): 8915384 kB' 'Inactive(anon): 0 kB' 'Active(file): 397332 kB' 'Inactive(file): 4084660 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 462848 kB' 'Mapped: 162744 kB' 'Shmem: 8455824 kB' 'KReclaimable: 468904 kB' 'Slab: 1012804 kB' 'SReclaimable: 468904 kB' 'SUnreclaim: 543900 kB' 'KernelStack: 12704 kB' 'PageTables: 7708 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10008876 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198392 kB' 'VmallocChunk: 0 kB' 'Percpu: 40128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1867356 kB' 'DirectMap2M: 17975296 kB' 'DirectMap1G: 50331648 kB' 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.614 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.614 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.615 01:05:33 -- setup/common.sh@33 -- # echo 0 00:04:25.615 01:05:33 -- setup/common.sh@33 -- # return 0 00:04:25.615 01:05:33 -- setup/hugepages.sh@97 -- # anon=0 00:04:25.615 01:05:33 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:25.615 01:05:33 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:25.615 01:05:33 -- setup/common.sh@18 -- # local node= 00:04:25.615 01:05:33 -- setup/common.sh@19 -- # local var val 00:04:25.615 01:05:33 -- setup/common.sh@20 -- # local mem_f mem 00:04:25.615 01:05:33 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:25.615 01:05:33 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:25.615 01:05:33 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:25.615 01:05:33 -- setup/common.sh@28 -- # mapfile -t mem 00:04:25.615 01:05:33 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.615 01:05:33 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 42749168 kB' 'MemAvailable: 47055432 kB' 'Buffers: 2708 kB' 'Cached: 12935108 kB' 'SwapCached: 0 kB' 'Active: 9314408 kB' 'Inactive: 4084660 kB' 'Active(anon): 8917076 kB' 'Inactive(anon): 0 kB' 'Active(file): 397332 kB' 'Inactive(file): 4084660 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 465024 kB' 'Mapped: 162836 kB' 'Shmem: 8455824 kB' 'KReclaimable: 468904 kB' 'Slab: 1012860 kB' 'SReclaimable: 468904 kB' 'SUnreclaim: 543956 kB' 'KernelStack: 12704 kB' 'PageTables: 7688 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10011396 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198344 kB' 'VmallocChunk: 0 kB' 'Percpu: 40128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1867356 kB' 'DirectMap2M: 17975296 kB' 'DirectMap1G: 50331648 kB' 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.615 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.615 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.616 01:05:33 -- setup/common.sh@33 -- # echo 0 00:04:25.616 01:05:33 -- setup/common.sh@33 -- # return 0 00:04:25.616 01:05:33 -- setup/hugepages.sh@99 -- # surp=0 00:04:25.616 01:05:33 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:25.616 01:05:33 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:25.616 01:05:33 -- setup/common.sh@18 -- # local node= 00:04:25.616 01:05:33 -- setup/common.sh@19 -- # local var val 00:04:25.616 01:05:33 -- setup/common.sh@20 -- # local mem_f mem 00:04:25.616 01:05:33 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:25.616 01:05:33 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:25.616 01:05:33 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:25.616 01:05:33 -- setup/common.sh@28 -- # mapfile -t mem 00:04:25.616 01:05:33 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.616 01:05:33 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 42749448 kB' 'MemAvailable: 47055712 kB' 'Buffers: 2708 kB' 'Cached: 12935124 kB' 'SwapCached: 0 kB' 'Active: 9314808 kB' 'Inactive: 4084660 kB' 'Active(anon): 8917476 kB' 'Inactive(anon): 0 kB' 'Active(file): 397332 kB' 'Inactive(file): 4084660 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 465004 kB' 'Mapped: 163284 kB' 'Shmem: 8455840 kB' 'KReclaimable: 468904 kB' 'Slab: 1012836 kB' 'SReclaimable: 468904 kB' 'SUnreclaim: 543932 kB' 'KernelStack: 12832 kB' 'PageTables: 7840 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10012612 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198364 kB' 'VmallocChunk: 0 kB' 'Percpu: 40128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1867356 kB' 'DirectMap2M: 17975296 kB' 'DirectMap1G: 50331648 kB' 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.616 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.616 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.617 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.617 01:05:33 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.618 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.618 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.618 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.618 01:05:33 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.618 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.618 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.618 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.618 01:05:33 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.618 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.618 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.618 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.618 01:05:33 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.618 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.618 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.618 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.618 01:05:33 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.618 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.618 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.618 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.618 01:05:33 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.618 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.618 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.618 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.618 01:05:33 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.618 01:05:33 -- setup/common.sh@33 -- # echo 0 00:04:25.618 01:05:33 -- setup/common.sh@33 -- # return 0 00:04:25.618 01:05:33 -- setup/hugepages.sh@100 -- # resv=0 00:04:25.618 01:05:33 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:25.618 nr_hugepages=1024 00:04:25.618 01:05:33 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:25.618 resv_hugepages=0 00:04:25.618 01:05:33 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:25.618 surplus_hugepages=0 00:04:25.618 01:05:33 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:25.618 anon_hugepages=0 00:04:25.618 01:05:33 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:25.618 01:05:33 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:25.618 01:05:33 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:25.618 01:05:33 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:25.618 01:05:33 -- setup/common.sh@18 -- # local node= 00:04:25.618 01:05:33 -- setup/common.sh@19 -- # local var val 00:04:25.618 01:05:33 -- setup/common.sh@20 -- # local mem_f mem 00:04:25.618 01:05:33 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:25.618 01:05:33 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:25.618 01:05:33 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:25.618 01:05:33 -- setup/common.sh@28 -- # mapfile -t mem 00:04:25.618 01:05:33 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:25.618 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.618 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.618 01:05:33 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 42752624 kB' 'MemAvailable: 47058888 kB' 'Buffers: 2708 kB' 'Cached: 12935124 kB' 'SwapCached: 0 kB' 'Active: 9309684 kB' 'Inactive: 4084660 kB' 'Active(anon): 8912352 kB' 'Inactive(anon): 0 kB' 'Active(file): 397332 kB' 'Inactive(file): 4084660 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 459916 kB' 'Mapped: 162336 kB' 'Shmem: 8455840 kB' 'KReclaimable: 468904 kB' 'Slab: 1012796 kB' 'SReclaimable: 468904 kB' 'SUnreclaim: 543892 kB' 'KernelStack: 12880 kB' 'PageTables: 7880 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10006508 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198360 kB' 'VmallocChunk: 0 kB' 'Percpu: 40128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1867356 kB' 'DirectMap2M: 17975296 kB' 'DirectMap1G: 50331648 kB' 00:04:25.618 01:05:33 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.618 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.618 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.618 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.618 01:05:33 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.618 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.618 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.618 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.618 01:05:33 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.618 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.618 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.618 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.618 01:05:33 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.618 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.618 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.618 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.618 01:05:33 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.618 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.618 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.618 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.618 01:05:33 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.618 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.618 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.618 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.618 01:05:33 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.618 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.618 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.618 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.618 01:05:33 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.618 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.618 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.618 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.618 01:05:33 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.618 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.618 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.618 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.618 01:05:33 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.618 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.618 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.618 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.618 01:05:33 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.618 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.618 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.618 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.618 01:05:33 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.618 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.618 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.618 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.618 01:05:33 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.618 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.618 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.618 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.618 01:05:33 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.618 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.618 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.618 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.618 01:05:33 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.618 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.618 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.618 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.618 01:05:33 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.618 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.618 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.618 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.618 01:05:33 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.618 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.618 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.618 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.618 01:05:33 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.618 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.619 01:05:33 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.619 01:05:33 -- setup/common.sh@33 -- # echo 1024 00:04:25.619 01:05:33 -- setup/common.sh@33 -- # return 0 00:04:25.619 01:05:33 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:25.619 01:05:33 -- setup/hugepages.sh@112 -- # get_nodes 00:04:25.619 01:05:33 -- setup/hugepages.sh@27 -- # local node 00:04:25.619 01:05:33 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:25.619 01:05:33 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:25.619 01:05:33 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:25.619 01:05:33 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:25.619 01:05:33 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:25.619 01:05:33 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:25.619 01:05:33 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:25.619 01:05:33 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:25.619 01:05:33 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:25.619 01:05:33 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:25.619 01:05:33 -- setup/common.sh@18 -- # local node=0 00:04:25.619 01:05:33 -- setup/common.sh@19 -- # local var val 00:04:25.619 01:05:33 -- setup/common.sh@20 -- # local mem_f mem 00:04:25.619 01:05:33 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:25.619 01:05:33 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:25.619 01:05:33 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:25.619 01:05:33 -- setup/common.sh@28 -- # mapfile -t mem 00:04:25.619 01:05:33 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.619 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.619 01:05:33 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 19735988 kB' 'MemUsed: 13138936 kB' 'SwapCached: 0 kB' 'Active: 6158836 kB' 'Inactive: 3551816 kB' 'Active(anon): 5952084 kB' 'Inactive(anon): 0 kB' 'Active(file): 206752 kB' 'Inactive(file): 3551816 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9452096 kB' 'Mapped: 99444 kB' 'AnonPages: 261900 kB' 'Shmem: 5693528 kB' 'KernelStack: 7352 kB' 'PageTables: 4264 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 314480 kB' 'Slab: 657976 kB' 'SReclaimable: 314480 kB' 'SUnreclaim: 343496 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # continue 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.620 01:05:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.620 01:05:33 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.620 01:05:33 -- setup/common.sh@33 -- # echo 0 00:04:25.620 01:05:33 -- setup/common.sh@33 -- # return 0 00:04:25.620 01:05:33 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:25.620 01:05:33 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:25.620 01:05:33 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:25.620 01:05:33 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:25.620 01:05:33 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:25.620 node0=1024 expecting 1024 00:04:25.620 01:05:33 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:25.620 00:04:25.620 real 0m2.502s 00:04:25.620 user 0m0.640s 00:04:25.620 sys 0m0.933s 00:04:25.620 01:05:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:25.620 01:05:33 -- common/autotest_common.sh@10 -- # set +x 00:04:25.620 ************************************ 00:04:25.620 END TEST default_setup 00:04:25.620 ************************************ 00:04:25.879 01:05:33 -- setup/hugepages.sh@211 -- # run_test per_node_1G_alloc per_node_1G_alloc 00:04:25.879 01:05:33 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:25.879 01:05:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:25.879 01:05:33 -- common/autotest_common.sh@10 -- # set +x 00:04:25.879 ************************************ 00:04:25.879 START TEST per_node_1G_alloc 00:04:25.879 ************************************ 00:04:25.879 01:05:33 -- common/autotest_common.sh@1114 -- # per_node_1G_alloc 00:04:25.879 01:05:33 -- setup/hugepages.sh@143 -- # local IFS=, 00:04:25.879 01:05:33 -- setup/hugepages.sh@145 -- # get_test_nr_hugepages 1048576 0 1 00:04:25.879 01:05:33 -- setup/hugepages.sh@49 -- # local size=1048576 00:04:25.879 01:05:33 -- setup/hugepages.sh@50 -- # (( 3 > 1 )) 00:04:25.879 01:05:33 -- setup/hugepages.sh@51 -- # shift 00:04:25.879 01:05:33 -- setup/hugepages.sh@52 -- # node_ids=('0' '1') 00:04:25.879 01:05:33 -- setup/hugepages.sh@52 -- # local node_ids 00:04:25.879 01:05:33 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:25.879 01:05:33 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:04:25.879 01:05:33 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 1 00:04:25.879 01:05:33 -- setup/hugepages.sh@62 -- # user_nodes=('0' '1') 00:04:25.879 01:05:33 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:25.879 01:05:33 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:04:25.879 01:05:33 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:25.879 01:05:33 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:25.879 01:05:33 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:25.879 01:05:33 -- setup/hugepages.sh@69 -- # (( 2 > 0 )) 00:04:25.879 01:05:33 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:25.879 01:05:33 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:04:25.879 01:05:33 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:25.879 01:05:33 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:04:25.879 01:05:33 -- setup/hugepages.sh@73 -- # return 0 00:04:25.879 01:05:33 -- setup/hugepages.sh@146 -- # NRHUGE=512 00:04:25.879 01:05:33 -- setup/hugepages.sh@146 -- # HUGENODE=0,1 00:04:25.879 01:05:33 -- setup/hugepages.sh@146 -- # setup output 00:04:25.879 01:05:33 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:25.879 01:05:33 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:26.816 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:26.816 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:26.816 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:26.816 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:26.816 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:26.816 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:26.816 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:26.816 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:26.816 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:26.816 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:26.816 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:26.816 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:26.816 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:26.816 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:26.816 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:26.816 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:26.816 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:27.081 01:05:35 -- setup/hugepages.sh@147 -- # nr_hugepages=1024 00:04:27.081 01:05:35 -- setup/hugepages.sh@147 -- # verify_nr_hugepages 00:04:27.081 01:05:35 -- setup/hugepages.sh@89 -- # local node 00:04:27.081 01:05:35 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:27.081 01:05:35 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:27.081 01:05:35 -- setup/hugepages.sh@92 -- # local surp 00:04:27.081 01:05:35 -- setup/hugepages.sh@93 -- # local resv 00:04:27.081 01:05:35 -- setup/hugepages.sh@94 -- # local anon 00:04:27.081 01:05:35 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:27.081 01:05:35 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:27.081 01:05:35 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:27.081 01:05:35 -- setup/common.sh@18 -- # local node= 00:04:27.081 01:05:35 -- setup/common.sh@19 -- # local var val 00:04:27.081 01:05:35 -- setup/common.sh@20 -- # local mem_f mem 00:04:27.081 01:05:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:27.081 01:05:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:27.081 01:05:35 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:27.081 01:05:35 -- setup/common.sh@28 -- # mapfile -t mem 00:04:27.081 01:05:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:27.081 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.081 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.082 01:05:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 42741932 kB' 'MemAvailable: 47048196 kB' 'Buffers: 2708 kB' 'Cached: 12935188 kB' 'SwapCached: 0 kB' 'Active: 9309552 kB' 'Inactive: 4084660 kB' 'Active(anon): 8912220 kB' 'Inactive(anon): 0 kB' 'Active(file): 397332 kB' 'Inactive(file): 4084660 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 459584 kB' 'Mapped: 162336 kB' 'Shmem: 8455904 kB' 'KReclaimable: 468904 kB' 'Slab: 1012868 kB' 'SReclaimable: 468904 kB' 'SUnreclaim: 543964 kB' 'KernelStack: 12864 kB' 'PageTables: 7840 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10006544 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198408 kB' 'VmallocChunk: 0 kB' 'Percpu: 40128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1867356 kB' 'DirectMap2M: 17975296 kB' 'DirectMap1G: 50331648 kB' 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.082 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.082 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.083 01:05:35 -- setup/common.sh@33 -- # echo 0 00:04:27.083 01:05:35 -- setup/common.sh@33 -- # return 0 00:04:27.083 01:05:35 -- setup/hugepages.sh@97 -- # anon=0 00:04:27.083 01:05:35 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:27.083 01:05:35 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:27.083 01:05:35 -- setup/common.sh@18 -- # local node= 00:04:27.083 01:05:35 -- setup/common.sh@19 -- # local var val 00:04:27.083 01:05:35 -- setup/common.sh@20 -- # local mem_f mem 00:04:27.083 01:05:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:27.083 01:05:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:27.083 01:05:35 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:27.083 01:05:35 -- setup/common.sh@28 -- # mapfile -t mem 00:04:27.083 01:05:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.083 01:05:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 42742340 kB' 'MemAvailable: 47048604 kB' 'Buffers: 2708 kB' 'Cached: 12935188 kB' 'SwapCached: 0 kB' 'Active: 9309956 kB' 'Inactive: 4084660 kB' 'Active(anon): 8912624 kB' 'Inactive(anon): 0 kB' 'Active(file): 397332 kB' 'Inactive(file): 4084660 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 459996 kB' 'Mapped: 162376 kB' 'Shmem: 8455904 kB' 'KReclaimable: 468904 kB' 'Slab: 1012952 kB' 'SReclaimable: 468904 kB' 'SUnreclaim: 544048 kB' 'KernelStack: 12864 kB' 'PageTables: 7836 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10006556 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198392 kB' 'VmallocChunk: 0 kB' 'Percpu: 40128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1867356 kB' 'DirectMap2M: 17975296 kB' 'DirectMap1G: 50331648 kB' 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.083 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.083 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.084 01:05:35 -- setup/common.sh@33 -- # echo 0 00:04:27.084 01:05:35 -- setup/common.sh@33 -- # return 0 00:04:27.084 01:05:35 -- setup/hugepages.sh@99 -- # surp=0 00:04:27.084 01:05:35 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:27.084 01:05:35 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:27.084 01:05:35 -- setup/common.sh@18 -- # local node= 00:04:27.084 01:05:35 -- setup/common.sh@19 -- # local var val 00:04:27.084 01:05:35 -- setup/common.sh@20 -- # local mem_f mem 00:04:27.084 01:05:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:27.084 01:05:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:27.084 01:05:35 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:27.084 01:05:35 -- setup/common.sh@28 -- # mapfile -t mem 00:04:27.084 01:05:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.084 01:05:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 42742624 kB' 'MemAvailable: 47048888 kB' 'Buffers: 2708 kB' 'Cached: 12935200 kB' 'SwapCached: 0 kB' 'Active: 9309724 kB' 'Inactive: 4084660 kB' 'Active(anon): 8912392 kB' 'Inactive(anon): 0 kB' 'Active(file): 397332 kB' 'Inactive(file): 4084660 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 459676 kB' 'Mapped: 162296 kB' 'Shmem: 8455916 kB' 'KReclaimable: 468904 kB' 'Slab: 1012916 kB' 'SReclaimable: 468904 kB' 'SUnreclaim: 544012 kB' 'KernelStack: 12880 kB' 'PageTables: 7808 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10006572 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198408 kB' 'VmallocChunk: 0 kB' 'Percpu: 40128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1867356 kB' 'DirectMap2M: 17975296 kB' 'DirectMap1G: 50331648 kB' 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.084 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.084 01:05:35 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.085 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.085 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.086 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.086 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.086 01:05:35 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.086 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.086 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.086 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.086 01:05:35 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.086 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.086 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.086 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.086 01:05:35 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.086 01:05:35 -- setup/common.sh@33 -- # echo 0 00:04:27.086 01:05:35 -- setup/common.sh@33 -- # return 0 00:04:27.086 01:05:35 -- setup/hugepages.sh@100 -- # resv=0 00:04:27.086 01:05:35 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:27.086 nr_hugepages=1024 00:04:27.086 01:05:35 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:27.086 resv_hugepages=0 00:04:27.086 01:05:35 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:27.086 surplus_hugepages=0 00:04:27.086 01:05:35 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:27.086 anon_hugepages=0 00:04:27.086 01:05:35 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:27.086 01:05:35 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:27.086 01:05:35 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:27.086 01:05:35 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:27.086 01:05:35 -- setup/common.sh@18 -- # local node= 00:04:27.086 01:05:35 -- setup/common.sh@19 -- # local var val 00:04:27.086 01:05:35 -- setup/common.sh@20 -- # local mem_f mem 00:04:27.086 01:05:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:27.086 01:05:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:27.086 01:05:35 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:27.086 01:05:35 -- setup/common.sh@28 -- # mapfile -t mem 00:04:27.086 01:05:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:27.086 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.086 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.086 01:05:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 42742624 kB' 'MemAvailable: 47048888 kB' 'Buffers: 2708 kB' 'Cached: 12935216 kB' 'SwapCached: 0 kB' 'Active: 9309688 kB' 'Inactive: 4084660 kB' 'Active(anon): 8912356 kB' 'Inactive(anon): 0 kB' 'Active(file): 397332 kB' 'Inactive(file): 4084660 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 459672 kB' 'Mapped: 162296 kB' 'Shmem: 8455932 kB' 'KReclaimable: 468904 kB' 'Slab: 1012916 kB' 'SReclaimable: 468904 kB' 'SUnreclaim: 544012 kB' 'KernelStack: 12880 kB' 'PageTables: 7808 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10006584 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198424 kB' 'VmallocChunk: 0 kB' 'Percpu: 40128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1867356 kB' 'DirectMap2M: 17975296 kB' 'DirectMap1G: 50331648 kB' 00:04:27.086 01:05:35 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.086 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.086 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.086 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.086 01:05:35 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.086 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.086 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.086 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.086 01:05:35 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.086 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.086 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.086 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.086 01:05:35 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.086 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.086 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.086 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.086 01:05:35 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.086 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.086 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.086 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.086 01:05:35 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.086 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.086 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.086 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.086 01:05:35 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.086 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.086 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.086 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.086 01:05:35 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.086 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.086 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.086 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.086 01:05:35 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.086 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.086 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.086 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.086 01:05:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.086 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.086 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.086 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.086 01:05:35 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.086 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.086 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.086 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.086 01:05:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.086 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.086 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.086 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.086 01:05:35 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.086 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.086 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.086 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.086 01:05:35 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.086 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.086 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.086 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.086 01:05:35 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.086 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.086 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.086 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.086 01:05:35 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.086 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.086 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.086 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.086 01:05:35 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.086 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.086 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.086 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.086 01:05:35 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.086 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.086 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.086 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.086 01:05:35 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.086 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.086 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.086 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.086 01:05:35 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.086 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.086 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.087 01:05:35 -- setup/common.sh@33 -- # echo 1024 00:04:27.087 01:05:35 -- setup/common.sh@33 -- # return 0 00:04:27.087 01:05:35 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:27.087 01:05:35 -- setup/hugepages.sh@112 -- # get_nodes 00:04:27.087 01:05:35 -- setup/hugepages.sh@27 -- # local node 00:04:27.087 01:05:35 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:27.087 01:05:35 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:27.087 01:05:35 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:27.087 01:05:35 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:27.087 01:05:35 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:27.087 01:05:35 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:27.087 01:05:35 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:27.087 01:05:35 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:27.087 01:05:35 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:27.087 01:05:35 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:27.087 01:05:35 -- setup/common.sh@18 -- # local node=0 00:04:27.087 01:05:35 -- setup/common.sh@19 -- # local var val 00:04:27.087 01:05:35 -- setup/common.sh@20 -- # local mem_f mem 00:04:27.087 01:05:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:27.087 01:05:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:27.087 01:05:35 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:27.087 01:05:35 -- setup/common.sh@28 -- # mapfile -t mem 00:04:27.087 01:05:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.087 01:05:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 20778472 kB' 'MemUsed: 12096452 kB' 'SwapCached: 0 kB' 'Active: 6157924 kB' 'Inactive: 3551816 kB' 'Active(anon): 5951172 kB' 'Inactive(anon): 0 kB' 'Active(file): 206752 kB' 'Inactive(file): 3551816 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9452132 kB' 'Mapped: 99448 kB' 'AnonPages: 260752 kB' 'Shmem: 5693564 kB' 'KernelStack: 7304 kB' 'PageTables: 4212 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 314480 kB' 'Slab: 657984 kB' 'SReclaimable: 314480 kB' 'SUnreclaim: 343504 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.087 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.087 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.088 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.088 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.088 01:05:35 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.088 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.088 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.088 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.088 01:05:35 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.088 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.088 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.088 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.088 01:05:35 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.088 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.088 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.088 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.088 01:05:35 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.088 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.088 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.088 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.088 01:05:35 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.088 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.088 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.088 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.088 01:05:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.088 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.088 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.088 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.088 01:05:35 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.088 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.088 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.088 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.088 01:05:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.088 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.088 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.088 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.088 01:05:35 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.088 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.088 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.088 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.088 01:05:35 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.088 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.088 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.088 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.088 01:05:35 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.088 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.088 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.088 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.088 01:05:35 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.088 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.088 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.088 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.088 01:05:35 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.088 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.088 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.088 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.088 01:05:35 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.088 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.088 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.088 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.088 01:05:35 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.088 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.088 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.088 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.088 01:05:35 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.088 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.088 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.088 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.088 01:05:35 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.088 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.088 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.088 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.088 01:05:35 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.088 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.088 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.088 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.088 01:05:35 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.088 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.088 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.088 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.088 01:05:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.088 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.088 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.088 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.088 01:05:35 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.088 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.088 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.088 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.088 01:05:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.088 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.088 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.088 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.088 01:05:35 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.088 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.088 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.088 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.088 01:05:35 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.088 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.088 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.088 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.088 01:05:35 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.088 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.088 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.088 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.088 01:05:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.088 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.088 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.088 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.088 01:05:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.088 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.088 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.088 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.088 01:05:35 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.089 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.089 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.089 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.089 01:05:35 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.089 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.089 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.089 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.089 01:05:35 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.089 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.089 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.089 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.089 01:05:35 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.089 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.089 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.089 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.089 01:05:35 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.089 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.089 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.089 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.089 01:05:35 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.089 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.089 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.089 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.089 01:05:35 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.089 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.089 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.089 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.089 01:05:35 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.089 01:05:35 -- setup/common.sh@33 -- # echo 0 00:04:27.089 01:05:35 -- setup/common.sh@33 -- # return 0 00:04:27.089 01:05:35 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:27.089 01:05:35 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:27.089 01:05:35 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:27.089 01:05:35 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:27.089 01:05:35 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:27.089 01:05:35 -- setup/common.sh@18 -- # local node=1 00:04:27.089 01:05:35 -- setup/common.sh@19 -- # local var val 00:04:27.089 01:05:35 -- setup/common.sh@20 -- # local mem_f mem 00:04:27.089 01:05:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:27.089 01:05:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:27.089 01:05:35 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:27.089 01:05:35 -- setup/common.sh@28 -- # mapfile -t mem 00:04:27.089 01:05:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:27.089 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.089 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.089 01:05:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660748 kB' 'MemFree: 21964620 kB' 'MemUsed: 5696128 kB' 'SwapCached: 0 kB' 'Active: 3151612 kB' 'Inactive: 532844 kB' 'Active(anon): 2961032 kB' 'Inactive(anon): 0 kB' 'Active(file): 190580 kB' 'Inactive(file): 532844 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3485820 kB' 'Mapped: 62848 kB' 'AnonPages: 198668 kB' 'Shmem: 2762396 kB' 'KernelStack: 5560 kB' 'PageTables: 3548 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 154424 kB' 'Slab: 354932 kB' 'SReclaimable: 154424 kB' 'SUnreclaim: 200508 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:27.089 01:05:35 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.089 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.089 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.089 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.089 01:05:35 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.089 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.089 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.089 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.089 01:05:35 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.089 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.089 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.089 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.089 01:05:35 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.089 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.089 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.089 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.089 01:05:35 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.089 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.089 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.089 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.089 01:05:35 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.089 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.089 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.089 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.089 01:05:35 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.089 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.089 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.089 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.089 01:05:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.089 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.089 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.089 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.089 01:05:35 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.089 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.089 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.089 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.089 01:05:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.089 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.089 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.089 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.089 01:05:35 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.089 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.089 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.090 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.090 01:05:35 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.090 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.090 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.090 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.090 01:05:35 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.090 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.090 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.090 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.090 01:05:35 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.090 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.090 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.090 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.090 01:05:35 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.090 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.090 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.090 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.090 01:05:35 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.090 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.090 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.090 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.350 01:05:35 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.350 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.350 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.350 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.350 01:05:35 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.350 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.350 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.350 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.350 01:05:35 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.350 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.350 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.350 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.350 01:05:35 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.350 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.350 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.350 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.350 01:05:35 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.350 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.350 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.350 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.350 01:05:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.350 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.350 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.350 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.350 01:05:35 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.350 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.350 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.350 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.350 01:05:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.350 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.350 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.350 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.350 01:05:35 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.350 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.350 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.350 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.350 01:05:35 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.350 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.350 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.350 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.350 01:05:35 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.350 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.350 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.350 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.350 01:05:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.350 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.350 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.350 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.350 01:05:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.350 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.350 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.350 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.350 01:05:35 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.350 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.350 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.350 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.350 01:05:35 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.350 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.350 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.350 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.350 01:05:35 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.350 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.350 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.350 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.350 01:05:35 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.350 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.350 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.350 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.350 01:05:35 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.350 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.350 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.350 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.350 01:05:35 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.350 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.350 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.350 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.350 01:05:35 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.350 01:05:35 -- setup/common.sh@32 -- # continue 00:04:27.350 01:05:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.350 01:05:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.350 01:05:35 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.350 01:05:35 -- setup/common.sh@33 -- # echo 0 00:04:27.350 01:05:35 -- setup/common.sh@33 -- # return 0 00:04:27.350 01:05:35 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:27.350 01:05:35 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:27.350 01:05:35 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:27.350 01:05:35 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:27.350 01:05:35 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:27.350 node0=512 expecting 512 00:04:27.351 01:05:35 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:27.351 01:05:35 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:27.351 01:05:35 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:27.351 01:05:35 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:04:27.351 node1=512 expecting 512 00:04:27.351 01:05:35 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:04:27.351 00:04:27.351 real 0m1.466s 00:04:27.351 user 0m0.590s 00:04:27.351 sys 0m0.830s 00:04:27.351 01:05:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:27.351 01:05:35 -- common/autotest_common.sh@10 -- # set +x 00:04:27.351 ************************************ 00:04:27.351 END TEST per_node_1G_alloc 00:04:27.351 ************************************ 00:04:27.351 01:05:35 -- setup/hugepages.sh@212 -- # run_test even_2G_alloc even_2G_alloc 00:04:27.351 01:05:35 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:27.351 01:05:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:27.351 01:05:35 -- common/autotest_common.sh@10 -- # set +x 00:04:27.351 ************************************ 00:04:27.351 START TEST even_2G_alloc 00:04:27.351 ************************************ 00:04:27.351 01:05:35 -- common/autotest_common.sh@1114 -- # even_2G_alloc 00:04:27.351 01:05:35 -- setup/hugepages.sh@152 -- # get_test_nr_hugepages 2097152 00:04:27.351 01:05:35 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:27.351 01:05:35 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:27.351 01:05:35 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:27.351 01:05:35 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:27.351 01:05:35 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:27.351 01:05:35 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:27.351 01:05:35 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:27.351 01:05:35 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:27.351 01:05:35 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:27.351 01:05:35 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:27.351 01:05:35 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:27.351 01:05:35 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:27.351 01:05:35 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:27.351 01:05:35 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:27.351 01:05:35 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:04:27.351 01:05:35 -- setup/hugepages.sh@83 -- # : 512 00:04:27.351 01:05:35 -- setup/hugepages.sh@84 -- # : 1 00:04:27.351 01:05:35 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:27.351 01:05:35 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:04:27.351 01:05:35 -- setup/hugepages.sh@83 -- # : 0 00:04:27.351 01:05:35 -- setup/hugepages.sh@84 -- # : 0 00:04:27.351 01:05:35 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:27.351 01:05:35 -- setup/hugepages.sh@153 -- # NRHUGE=1024 00:04:27.351 01:05:35 -- setup/hugepages.sh@153 -- # HUGE_EVEN_ALLOC=yes 00:04:27.351 01:05:35 -- setup/hugepages.sh@153 -- # setup output 00:04:27.351 01:05:35 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:27.351 01:05:35 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:28.287 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:28.287 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:28.287 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:28.287 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:28.287 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:28.287 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:28.287 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:28.287 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:28.287 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:28.287 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:28.287 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:28.287 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:28.287 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:28.287 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:28.287 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:28.287 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:28.287 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:28.552 01:05:36 -- setup/hugepages.sh@154 -- # verify_nr_hugepages 00:04:28.552 01:05:36 -- setup/hugepages.sh@89 -- # local node 00:04:28.552 01:05:36 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:28.552 01:05:36 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:28.552 01:05:36 -- setup/hugepages.sh@92 -- # local surp 00:04:28.552 01:05:36 -- setup/hugepages.sh@93 -- # local resv 00:04:28.552 01:05:36 -- setup/hugepages.sh@94 -- # local anon 00:04:28.552 01:05:36 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:28.552 01:05:36 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:28.552 01:05:36 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:28.552 01:05:36 -- setup/common.sh@18 -- # local node= 00:04:28.552 01:05:36 -- setup/common.sh@19 -- # local var val 00:04:28.552 01:05:36 -- setup/common.sh@20 -- # local mem_f mem 00:04:28.552 01:05:36 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:28.552 01:05:36 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:28.552 01:05:36 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:28.552 01:05:36 -- setup/common.sh@28 -- # mapfile -t mem 00:04:28.552 01:05:36 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:28.552 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.552 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.552 01:05:36 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 42729016 kB' 'MemAvailable: 47035280 kB' 'Buffers: 2708 kB' 'Cached: 12935280 kB' 'SwapCached: 0 kB' 'Active: 9309828 kB' 'Inactive: 4084660 kB' 'Active(anon): 8912496 kB' 'Inactive(anon): 0 kB' 'Active(file): 397332 kB' 'Inactive(file): 4084660 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 459864 kB' 'Mapped: 162344 kB' 'Shmem: 8455996 kB' 'KReclaimable: 468904 kB' 'Slab: 1013064 kB' 'SReclaimable: 468904 kB' 'SUnreclaim: 544160 kB' 'KernelStack: 12880 kB' 'PageTables: 7876 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10006768 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 40128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1867356 kB' 'DirectMap2M: 17975296 kB' 'DirectMap1G: 50331648 kB' 00:04:28.552 01:05:36 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:28.552 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.552 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.552 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.552 01:05:36 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:28.552 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.552 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.552 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.552 01:05:36 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:28.552 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.552 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.552 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.552 01:05:36 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:28.552 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.552 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.552 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.552 01:05:36 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:28.552 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.552 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.552 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.552 01:05:36 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:28.552 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.552 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.552 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.552 01:05:36 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:28.552 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.552 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.552 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.552 01:05:36 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:28.552 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.552 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.552 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.552 01:05:36 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:28.552 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.552 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.552 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.552 01:05:36 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:28.552 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.552 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.552 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.552 01:05:36 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:28.552 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.552 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.552 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.552 01:05:36 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:28.552 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.552 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.552 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.552 01:05:36 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:28.552 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.552 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.552 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.552 01:05:36 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:28.552 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.552 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.552 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.552 01:05:36 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:28.552 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.552 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.552 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.552 01:05:36 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:28.552 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.552 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.552 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.552 01:05:36 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:28.552 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.552 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.552 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.552 01:05:36 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:28.552 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.552 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.552 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.552 01:05:36 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:28.552 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.553 01:05:36 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:28.553 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.553 01:05:36 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:28.553 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.553 01:05:36 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:28.553 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.553 01:05:36 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:28.553 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.553 01:05:36 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:28.553 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.553 01:05:36 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:28.553 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.553 01:05:36 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:28.553 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.553 01:05:36 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:28.553 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.553 01:05:36 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:28.553 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.553 01:05:36 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:28.553 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.553 01:05:36 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:28.553 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.553 01:05:36 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:28.553 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.553 01:05:36 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:28.553 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.553 01:05:36 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:28.553 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.553 01:05:36 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:28.553 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.553 01:05:36 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:28.553 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.553 01:05:36 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:28.553 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.553 01:05:36 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:28.553 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.553 01:05:36 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:28.553 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.553 01:05:36 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:28.553 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.553 01:05:36 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:28.553 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.553 01:05:36 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:28.553 01:05:36 -- setup/common.sh@33 -- # echo 0 00:04:28.553 01:05:36 -- setup/common.sh@33 -- # return 0 00:04:28.553 01:05:36 -- setup/hugepages.sh@97 -- # anon=0 00:04:28.553 01:05:36 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:28.553 01:05:36 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:28.553 01:05:36 -- setup/common.sh@18 -- # local node= 00:04:28.553 01:05:36 -- setup/common.sh@19 -- # local var val 00:04:28.553 01:05:36 -- setup/common.sh@20 -- # local mem_f mem 00:04:28.553 01:05:36 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:28.553 01:05:36 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:28.553 01:05:36 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:28.553 01:05:36 -- setup/common.sh@28 -- # mapfile -t mem 00:04:28.553 01:05:36 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.553 01:05:36 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 42731040 kB' 'MemAvailable: 47037304 kB' 'Buffers: 2708 kB' 'Cached: 12935284 kB' 'SwapCached: 0 kB' 'Active: 9310320 kB' 'Inactive: 4084660 kB' 'Active(anon): 8912988 kB' 'Inactive(anon): 0 kB' 'Active(file): 397332 kB' 'Inactive(file): 4084660 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 460308 kB' 'Mapped: 162420 kB' 'Shmem: 8456000 kB' 'KReclaimable: 468904 kB' 'Slab: 1013128 kB' 'SReclaimable: 468904 kB' 'SUnreclaim: 544224 kB' 'KernelStack: 12880 kB' 'PageTables: 7852 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10006780 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198360 kB' 'VmallocChunk: 0 kB' 'Percpu: 40128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1867356 kB' 'DirectMap2M: 17975296 kB' 'DirectMap1G: 50331648 kB' 00:04:28.553 01:05:36 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.553 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.553 01:05:36 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.553 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.553 01:05:36 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.553 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.553 01:05:36 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.553 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.553 01:05:36 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.553 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.553 01:05:36 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.553 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.553 01:05:36 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.553 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.553 01:05:36 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.553 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.553 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.554 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.554 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.555 01:05:36 -- setup/common.sh@33 -- # echo 0 00:04:28.555 01:05:36 -- setup/common.sh@33 -- # return 0 00:04:28.555 01:05:36 -- setup/hugepages.sh@99 -- # surp=0 00:04:28.555 01:05:36 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:28.555 01:05:36 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:28.555 01:05:36 -- setup/common.sh@18 -- # local node= 00:04:28.555 01:05:36 -- setup/common.sh@19 -- # local var val 00:04:28.555 01:05:36 -- setup/common.sh@20 -- # local mem_f mem 00:04:28.555 01:05:36 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:28.555 01:05:36 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:28.555 01:05:36 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:28.555 01:05:36 -- setup/common.sh@28 -- # mapfile -t mem 00:04:28.555 01:05:36 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.555 01:05:36 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 42731332 kB' 'MemAvailable: 47037596 kB' 'Buffers: 2708 kB' 'Cached: 12935296 kB' 'SwapCached: 0 kB' 'Active: 9309820 kB' 'Inactive: 4084660 kB' 'Active(anon): 8912488 kB' 'Inactive(anon): 0 kB' 'Active(file): 397332 kB' 'Inactive(file): 4084660 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 459760 kB' 'Mapped: 162304 kB' 'Shmem: 8456012 kB' 'KReclaimable: 468904 kB' 'Slab: 1013096 kB' 'SReclaimable: 468904 kB' 'SUnreclaim: 544192 kB' 'KernelStack: 12880 kB' 'PageTables: 7820 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10006796 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198360 kB' 'VmallocChunk: 0 kB' 'Percpu: 40128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1867356 kB' 'DirectMap2M: 17975296 kB' 'DirectMap1G: 50331648 kB' 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:28.555 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.555 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:28.556 01:05:36 -- setup/common.sh@33 -- # echo 0 00:04:28.556 01:05:36 -- setup/common.sh@33 -- # return 0 00:04:28.556 01:05:36 -- setup/hugepages.sh@100 -- # resv=0 00:04:28.556 01:05:36 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:28.556 nr_hugepages=1024 00:04:28.556 01:05:36 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:28.556 resv_hugepages=0 00:04:28.556 01:05:36 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:28.556 surplus_hugepages=0 00:04:28.556 01:05:36 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:28.556 anon_hugepages=0 00:04:28.556 01:05:36 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:28.556 01:05:36 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:28.556 01:05:36 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:28.556 01:05:36 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:28.556 01:05:36 -- setup/common.sh@18 -- # local node= 00:04:28.556 01:05:36 -- setup/common.sh@19 -- # local var val 00:04:28.556 01:05:36 -- setup/common.sh@20 -- # local mem_f mem 00:04:28.556 01:05:36 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:28.556 01:05:36 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:28.556 01:05:36 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:28.556 01:05:36 -- setup/common.sh@28 -- # mapfile -t mem 00:04:28.556 01:05:36 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.556 01:05:36 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 42731080 kB' 'MemAvailable: 47037344 kB' 'Buffers: 2708 kB' 'Cached: 12935308 kB' 'SwapCached: 0 kB' 'Active: 9309824 kB' 'Inactive: 4084660 kB' 'Active(anon): 8912492 kB' 'Inactive(anon): 0 kB' 'Active(file): 397332 kB' 'Inactive(file): 4084660 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 459760 kB' 'Mapped: 162304 kB' 'Shmem: 8456024 kB' 'KReclaimable: 468904 kB' 'Slab: 1013096 kB' 'SReclaimable: 468904 kB' 'SUnreclaim: 544192 kB' 'KernelStack: 12880 kB' 'PageTables: 7820 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10006808 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198360 kB' 'VmallocChunk: 0 kB' 'Percpu: 40128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1867356 kB' 'DirectMap2M: 17975296 kB' 'DirectMap1G: 50331648 kB' 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.556 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.556 01:05:36 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.557 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.557 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.558 01:05:36 -- setup/common.sh@33 -- # echo 1024 00:04:28.558 01:05:36 -- setup/common.sh@33 -- # return 0 00:04:28.558 01:05:36 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:28.558 01:05:36 -- setup/hugepages.sh@112 -- # get_nodes 00:04:28.558 01:05:36 -- setup/hugepages.sh@27 -- # local node 00:04:28.558 01:05:36 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:28.558 01:05:36 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:28.558 01:05:36 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:28.558 01:05:36 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:28.558 01:05:36 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:28.558 01:05:36 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:28.558 01:05:36 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:28.558 01:05:36 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:28.558 01:05:36 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:28.558 01:05:36 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:28.558 01:05:36 -- setup/common.sh@18 -- # local node=0 00:04:28.558 01:05:36 -- setup/common.sh@19 -- # local var val 00:04:28.558 01:05:36 -- setup/common.sh@20 -- # local mem_f mem 00:04:28.558 01:05:36 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:28.558 01:05:36 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:28.558 01:05:36 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:28.558 01:05:36 -- setup/common.sh@28 -- # mapfile -t mem 00:04:28.558 01:05:36 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.558 01:05:36 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 20760192 kB' 'MemUsed: 12114732 kB' 'SwapCached: 0 kB' 'Active: 6158216 kB' 'Inactive: 3551816 kB' 'Active(anon): 5951464 kB' 'Inactive(anon): 0 kB' 'Active(file): 206752 kB' 'Inactive(file): 3551816 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9452136 kB' 'Mapped: 99456 kB' 'AnonPages: 261100 kB' 'Shmem: 5693568 kB' 'KernelStack: 7336 kB' 'PageTables: 4312 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 314480 kB' 'Slab: 657984 kB' 'SReclaimable: 314480 kB' 'SUnreclaim: 343504 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.558 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.558 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.559 01:05:36 -- setup/common.sh@33 -- # echo 0 00:04:28.559 01:05:36 -- setup/common.sh@33 -- # return 0 00:04:28.559 01:05:36 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:28.559 01:05:36 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:28.559 01:05:36 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:28.559 01:05:36 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:28.559 01:05:36 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:28.559 01:05:36 -- setup/common.sh@18 -- # local node=1 00:04:28.559 01:05:36 -- setup/common.sh@19 -- # local var val 00:04:28.559 01:05:36 -- setup/common.sh@20 -- # local mem_f mem 00:04:28.559 01:05:36 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:28.559 01:05:36 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:28.559 01:05:36 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:28.559 01:05:36 -- setup/common.sh@28 -- # mapfile -t mem 00:04:28.559 01:05:36 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.559 01:05:36 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660748 kB' 'MemFree: 21970932 kB' 'MemUsed: 5689816 kB' 'SwapCached: 0 kB' 'Active: 3151452 kB' 'Inactive: 532844 kB' 'Active(anon): 2960872 kB' 'Inactive(anon): 0 kB' 'Active(file): 190580 kB' 'Inactive(file): 532844 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3485884 kB' 'Mapped: 62848 kB' 'AnonPages: 198504 kB' 'Shmem: 2762460 kB' 'KernelStack: 5528 kB' 'PageTables: 3460 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 154424 kB' 'Slab: 355112 kB' 'SReclaimable: 154424 kB' 'SUnreclaim: 200688 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.559 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.559 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.560 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.560 01:05:36 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.560 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.560 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.560 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.560 01:05:36 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.560 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.560 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.819 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.819 01:05:36 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.819 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.819 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.819 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.819 01:05:36 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.819 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.819 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.819 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.819 01:05:36 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.819 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.819 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.819 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.819 01:05:36 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.819 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.819 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.819 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.819 01:05:36 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.819 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.819 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.819 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.819 01:05:36 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.819 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.819 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.819 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.819 01:05:36 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.819 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.819 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.819 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.819 01:05:36 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.819 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.819 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.819 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.819 01:05:36 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.819 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.819 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.819 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.819 01:05:36 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.819 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.819 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.819 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.819 01:05:36 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.819 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.819 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.819 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.819 01:05:36 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.819 01:05:36 -- setup/common.sh@32 -- # continue 00:04:28.819 01:05:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.819 01:05:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.819 01:05:36 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.819 01:05:36 -- setup/common.sh@33 -- # echo 0 00:04:28.819 01:05:36 -- setup/common.sh@33 -- # return 0 00:04:28.819 01:05:36 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:28.819 01:05:36 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:28.819 01:05:36 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:28.819 01:05:36 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:28.819 01:05:36 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:28.819 node0=512 expecting 512 00:04:28.819 01:05:36 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:28.819 01:05:36 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:28.819 01:05:36 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:28.819 01:05:36 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:04:28.819 node1=512 expecting 512 00:04:28.819 01:05:36 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:04:28.819 00:04:28.819 real 0m1.441s 00:04:28.819 user 0m0.590s 00:04:28.819 sys 0m0.808s 00:04:28.819 01:05:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:28.819 01:05:36 -- common/autotest_common.sh@10 -- # set +x 00:04:28.819 ************************************ 00:04:28.819 END TEST even_2G_alloc 00:04:28.819 ************************************ 00:04:28.819 01:05:36 -- setup/hugepages.sh@213 -- # run_test odd_alloc odd_alloc 00:04:28.819 01:05:36 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:28.819 01:05:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:28.819 01:05:36 -- common/autotest_common.sh@10 -- # set +x 00:04:28.819 ************************************ 00:04:28.819 START TEST odd_alloc 00:04:28.819 ************************************ 00:04:28.819 01:05:36 -- common/autotest_common.sh@1114 -- # odd_alloc 00:04:28.819 01:05:36 -- setup/hugepages.sh@159 -- # get_test_nr_hugepages 2098176 00:04:28.819 01:05:36 -- setup/hugepages.sh@49 -- # local size=2098176 00:04:28.819 01:05:36 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:28.819 01:05:36 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:28.819 01:05:36 -- setup/hugepages.sh@57 -- # nr_hugepages=1025 00:04:28.819 01:05:36 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:28.819 01:05:36 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:28.819 01:05:36 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:28.819 01:05:36 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1025 00:04:28.819 01:05:36 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:28.819 01:05:36 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:28.819 01:05:36 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:28.819 01:05:36 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:28.819 01:05:36 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:28.819 01:05:36 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:28.819 01:05:36 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:04:28.819 01:05:36 -- setup/hugepages.sh@83 -- # : 513 00:04:28.819 01:05:36 -- setup/hugepages.sh@84 -- # : 1 00:04:28.819 01:05:36 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:28.819 01:05:36 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=513 00:04:28.819 01:05:36 -- setup/hugepages.sh@83 -- # : 0 00:04:28.819 01:05:36 -- setup/hugepages.sh@84 -- # : 0 00:04:28.819 01:05:36 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:28.819 01:05:36 -- setup/hugepages.sh@160 -- # HUGEMEM=2049 00:04:28.819 01:05:36 -- setup/hugepages.sh@160 -- # HUGE_EVEN_ALLOC=yes 00:04:28.819 01:05:36 -- setup/hugepages.sh@160 -- # setup output 00:04:28.819 01:05:36 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:28.819 01:05:36 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:29.889 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:29.889 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:29.889 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:29.889 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:29.889 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:29.889 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:29.889 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:29.889 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:29.889 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:29.889 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:29.889 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:29.889 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:29.889 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:29.890 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:29.890 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:29.890 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:29.890 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:30.154 01:05:38 -- setup/hugepages.sh@161 -- # verify_nr_hugepages 00:04:30.154 01:05:38 -- setup/hugepages.sh@89 -- # local node 00:04:30.154 01:05:38 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:30.154 01:05:38 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:30.154 01:05:38 -- setup/hugepages.sh@92 -- # local surp 00:04:30.154 01:05:38 -- setup/hugepages.sh@93 -- # local resv 00:04:30.154 01:05:38 -- setup/hugepages.sh@94 -- # local anon 00:04:30.154 01:05:38 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:30.154 01:05:38 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:30.154 01:05:38 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:30.154 01:05:38 -- setup/common.sh@18 -- # local node= 00:04:30.154 01:05:38 -- setup/common.sh@19 -- # local var val 00:04:30.154 01:05:38 -- setup/common.sh@20 -- # local mem_f mem 00:04:30.154 01:05:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:30.154 01:05:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:30.154 01:05:38 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:30.154 01:05:38 -- setup/common.sh@28 -- # mapfile -t mem 00:04:30.154 01:05:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:30.154 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.154 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.154 01:05:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 42731364 kB' 'MemAvailable: 47037628 kB' 'Buffers: 2708 kB' 'Cached: 12935372 kB' 'SwapCached: 0 kB' 'Active: 9309440 kB' 'Inactive: 4084660 kB' 'Active(anon): 8912108 kB' 'Inactive(anon): 0 kB' 'Active(file): 397332 kB' 'Inactive(file): 4084660 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 459684 kB' 'Mapped: 161336 kB' 'Shmem: 8456088 kB' 'KReclaimable: 468904 kB' 'Slab: 1012348 kB' 'SReclaimable: 468904 kB' 'SUnreclaim: 543444 kB' 'KernelStack: 13232 kB' 'PageTables: 8044 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606840 kB' 'Committed_AS: 9997024 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198552 kB' 'VmallocChunk: 0 kB' 'Percpu: 40128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1867356 kB' 'DirectMap2M: 17975296 kB' 'DirectMap1G: 50331648 kB' 00:04:30.154 01:05:38 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:30.154 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.154 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.154 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.154 01:05:38 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:30.154 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.154 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.154 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.154 01:05:38 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:30.154 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.154 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.154 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.154 01:05:38 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:30.154 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.154 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.154 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.154 01:05:38 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:30.154 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.154 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.154 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.154 01:05:38 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:30.154 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.154 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.154 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.154 01:05:38 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:30.154 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.154 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.154 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.154 01:05:38 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:30.154 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.154 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.154 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.154 01:05:38 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:30.154 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.154 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.154 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.154 01:05:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:30.154 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.154 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.154 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.154 01:05:38 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:30.154 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.154 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.154 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.154 01:05:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:30.154 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.154 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.154 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.154 01:05:38 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:30.154 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.154 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.154 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.154 01:05:38 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:30.154 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.154 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.154 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.155 01:05:38 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:30.155 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.155 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.155 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.155 01:05:38 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:30.155 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.155 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.155 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.155 01:05:38 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:30.155 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.155 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.155 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.155 01:05:38 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:30.155 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.155 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.155 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.155 01:05:38 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:30.155 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.155 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.155 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.155 01:05:38 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:30.155 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.155 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.155 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.155 01:05:38 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:30.155 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.155 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.155 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.155 01:05:38 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:30.155 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.155 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.155 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.155 01:05:38 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:30.155 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.155 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.155 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.155 01:05:38 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:30.155 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.155 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.155 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.155 01:05:38 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:30.155 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.155 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.155 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.155 01:05:38 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:30.155 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.155 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.155 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.155 01:05:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:30.155 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.155 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.155 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.155 01:05:38 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:30.155 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.155 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.155 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.155 01:05:38 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:30.155 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.155 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.155 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.155 01:05:38 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:30.155 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.155 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.155 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.155 01:05:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:30.155 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.155 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.155 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.155 01:05:38 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:30.155 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.155 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.155 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.155 01:05:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:30.155 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.155 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.155 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.155 01:05:38 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:30.155 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.155 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.155 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.155 01:05:38 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:30.155 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.155 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.155 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.155 01:05:38 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:30.155 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.155 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.155 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.155 01:05:38 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:30.155 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.155 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.155 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.155 01:05:38 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:30.155 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.155 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.155 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.155 01:05:38 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:30.155 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.155 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.155 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.155 01:05:38 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:30.155 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.155 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.155 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.155 01:05:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:30.155 01:05:38 -- setup/common.sh@33 -- # echo 0 00:04:30.155 01:05:38 -- setup/common.sh@33 -- # return 0 00:04:30.155 01:05:38 -- setup/hugepages.sh@97 -- # anon=0 00:04:30.155 01:05:38 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:30.155 01:05:38 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:30.155 01:05:38 -- setup/common.sh@18 -- # local node= 00:04:30.155 01:05:38 -- setup/common.sh@19 -- # local var val 00:04:30.155 01:05:38 -- setup/common.sh@20 -- # local mem_f mem 00:04:30.155 01:05:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:30.155 01:05:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:30.155 01:05:38 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:30.155 01:05:38 -- setup/common.sh@28 -- # mapfile -t mem 00:04:30.155 01:05:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:30.155 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.155 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.156 01:05:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 42738728 kB' 'MemAvailable: 47044992 kB' 'Buffers: 2708 kB' 'Cached: 12935376 kB' 'SwapCached: 0 kB' 'Active: 9308812 kB' 'Inactive: 4084660 kB' 'Active(anon): 8911480 kB' 'Inactive(anon): 0 kB' 'Active(file): 397332 kB' 'Inactive(file): 4084660 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 458596 kB' 'Mapped: 161384 kB' 'Shmem: 8456092 kB' 'KReclaimable: 468904 kB' 'Slab: 1012340 kB' 'SReclaimable: 468904 kB' 'SUnreclaim: 543436 kB' 'KernelStack: 13120 kB' 'PageTables: 8208 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606840 kB' 'Committed_AS: 9997036 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198360 kB' 'VmallocChunk: 0 kB' 'Percpu: 40128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1867356 kB' 'DirectMap2M: 17975296 kB' 'DirectMap1G: 50331648 kB' 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.156 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.156 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.157 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.157 01:05:38 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.157 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.157 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.157 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.157 01:05:38 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.157 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.157 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.157 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.157 01:05:38 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.157 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.157 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.157 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.157 01:05:38 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.157 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.157 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.157 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.157 01:05:38 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.157 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.157 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.157 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.157 01:05:38 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.157 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.157 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.157 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.157 01:05:38 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.157 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.157 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.157 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.157 01:05:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.157 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.157 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.157 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.157 01:05:38 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.157 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.157 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.157 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.157 01:05:38 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.157 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.157 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.157 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.157 01:05:38 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.157 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.157 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.157 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.157 01:05:38 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.157 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.157 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.157 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.157 01:05:38 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.157 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.157 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.157 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.157 01:05:38 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.157 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.157 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.157 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.157 01:05:38 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.157 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.157 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.157 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.157 01:05:38 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.157 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.157 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.157 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.157 01:05:38 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.157 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.157 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.157 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.157 01:05:38 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.157 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.157 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.157 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.157 01:05:38 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.157 01:05:38 -- setup/common.sh@33 -- # echo 0 00:04:30.157 01:05:38 -- setup/common.sh@33 -- # return 0 00:04:30.157 01:05:38 -- setup/hugepages.sh@99 -- # surp=0 00:04:30.157 01:05:38 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:30.157 01:05:38 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:30.157 01:05:38 -- setup/common.sh@18 -- # local node= 00:04:30.157 01:05:38 -- setup/common.sh@19 -- # local var val 00:04:30.157 01:05:38 -- setup/common.sh@20 -- # local mem_f mem 00:04:30.157 01:05:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:30.157 01:05:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:30.157 01:05:38 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:30.157 01:05:38 -- setup/common.sh@28 -- # mapfile -t mem 00:04:30.157 01:05:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:30.157 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.157 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.157 01:05:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 42736356 kB' 'MemAvailable: 47042620 kB' 'Buffers: 2708 kB' 'Cached: 12935376 kB' 'SwapCached: 0 kB' 'Active: 9310140 kB' 'Inactive: 4084660 kB' 'Active(anon): 8912808 kB' 'Inactive(anon): 0 kB' 'Active(file): 397332 kB' 'Inactive(file): 4084660 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 459904 kB' 'Mapped: 161308 kB' 'Shmem: 8456092 kB' 'KReclaimable: 468904 kB' 'Slab: 1012280 kB' 'SReclaimable: 468904 kB' 'SUnreclaim: 543376 kB' 'KernelStack: 13120 kB' 'PageTables: 9232 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606840 kB' 'Committed_AS: 9997052 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198504 kB' 'VmallocChunk: 0 kB' 'Percpu: 40128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1867356 kB' 'DirectMap2M: 17975296 kB' 'DirectMap1G: 50331648 kB' 00:04:30.157 01:05:38 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:30.157 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.157 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.157 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.157 01:05:38 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:30.157 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.157 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.157 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.157 01:05:38 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:30.157 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.157 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.157 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.157 01:05:38 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:30.157 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.157 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.157 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.157 01:05:38 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:30.157 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.157 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.157 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.157 01:05:38 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:30.157 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.157 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.157 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.157 01:05:38 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:30.157 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.157 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:30.158 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.158 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.159 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.159 01:05:38 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:30.159 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.159 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.159 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.159 01:05:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:30.159 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.159 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.159 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.159 01:05:38 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:30.159 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.159 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.159 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.159 01:05:38 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:30.159 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.159 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.159 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.159 01:05:38 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:30.159 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.159 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.159 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.159 01:05:38 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:30.159 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.159 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.159 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.159 01:05:38 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:30.159 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.159 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.159 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.159 01:05:38 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:30.159 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.159 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.159 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.159 01:05:38 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:30.159 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.159 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.159 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.159 01:05:38 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:30.159 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.159 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.159 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.159 01:05:38 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:30.159 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.159 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.159 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.159 01:05:38 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:30.159 01:05:38 -- setup/common.sh@33 -- # echo 0 00:04:30.159 01:05:38 -- setup/common.sh@33 -- # return 0 00:04:30.159 01:05:38 -- setup/hugepages.sh@100 -- # resv=0 00:04:30.159 01:05:38 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1025 00:04:30.159 nr_hugepages=1025 00:04:30.159 01:05:38 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:30.159 resv_hugepages=0 00:04:30.159 01:05:38 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:30.159 surplus_hugepages=0 00:04:30.159 01:05:38 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:30.159 anon_hugepages=0 00:04:30.159 01:05:38 -- setup/hugepages.sh@107 -- # (( 1025 == nr_hugepages + surp + resv )) 00:04:30.159 01:05:38 -- setup/hugepages.sh@109 -- # (( 1025 == nr_hugepages )) 00:04:30.159 01:05:38 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:30.159 01:05:38 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:30.159 01:05:38 -- setup/common.sh@18 -- # local node= 00:04:30.159 01:05:38 -- setup/common.sh@19 -- # local var val 00:04:30.159 01:05:38 -- setup/common.sh@20 -- # local mem_f mem 00:04:30.159 01:05:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:30.159 01:05:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:30.159 01:05:38 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:30.159 01:05:38 -- setup/common.sh@28 -- # mapfile -t mem 00:04:30.159 01:05:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:30.159 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.159 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.159 01:05:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 42739004 kB' 'MemAvailable: 47045268 kB' 'Buffers: 2708 kB' 'Cached: 12935400 kB' 'SwapCached: 0 kB' 'Active: 9308272 kB' 'Inactive: 4084660 kB' 'Active(anon): 8910940 kB' 'Inactive(anon): 0 kB' 'Active(file): 397332 kB' 'Inactive(file): 4084660 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 458040 kB' 'Mapped: 161320 kB' 'Shmem: 8456116 kB' 'KReclaimable: 468904 kB' 'Slab: 1012280 kB' 'SReclaimable: 468904 kB' 'SUnreclaim: 543376 kB' 'KernelStack: 12736 kB' 'PageTables: 7844 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606840 kB' 'Committed_AS: 9993032 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198296 kB' 'VmallocChunk: 0 kB' 'Percpu: 40128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1867356 kB' 'DirectMap2M: 17975296 kB' 'DirectMap1G: 50331648 kB' 00:04:30.159 01:05:38 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:30.159 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.159 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.159 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.159 01:05:38 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:30.159 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.159 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.159 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.159 01:05:38 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:30.159 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.159 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.159 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.159 01:05:38 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:30.159 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.159 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.159 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.159 01:05:38 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:30.159 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.159 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.159 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.159 01:05:38 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:30.159 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.159 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.159 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.159 01:05:38 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:30.159 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.159 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.159 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.159 01:05:38 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:30.159 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.159 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.159 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.159 01:05:38 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:30.159 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.159 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.159 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.159 01:05:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:30.159 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.160 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.160 01:05:38 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:30.161 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.161 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.161 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.161 01:05:38 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:30.161 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.161 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.161 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.161 01:05:38 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:30.161 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.161 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.161 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.161 01:05:38 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:30.161 01:05:38 -- setup/common.sh@33 -- # echo 1025 00:04:30.161 01:05:38 -- setup/common.sh@33 -- # return 0 00:04:30.161 01:05:38 -- setup/hugepages.sh@110 -- # (( 1025 == nr_hugepages + surp + resv )) 00:04:30.161 01:05:38 -- setup/hugepages.sh@112 -- # get_nodes 00:04:30.161 01:05:38 -- setup/hugepages.sh@27 -- # local node 00:04:30.161 01:05:38 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:30.161 01:05:38 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:30.161 01:05:38 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:30.161 01:05:38 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=513 00:04:30.161 01:05:38 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:30.161 01:05:38 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:30.161 01:05:38 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:30.161 01:05:38 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:30.161 01:05:38 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:30.161 01:05:38 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:30.161 01:05:38 -- setup/common.sh@18 -- # local node=0 00:04:30.161 01:05:38 -- setup/common.sh@19 -- # local var val 00:04:30.161 01:05:38 -- setup/common.sh@20 -- # local mem_f mem 00:04:30.161 01:05:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:30.161 01:05:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:30.161 01:05:38 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:30.161 01:05:38 -- setup/common.sh@28 -- # mapfile -t mem 00:04:30.161 01:05:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:30.161 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.161 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.161 01:05:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 20762344 kB' 'MemUsed: 12112580 kB' 'SwapCached: 0 kB' 'Active: 6158904 kB' 'Inactive: 3551816 kB' 'Active(anon): 5952152 kB' 'Inactive(anon): 0 kB' 'Active(file): 206752 kB' 'Inactive(file): 3551816 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9452140 kB' 'Mapped: 99120 kB' 'AnonPages: 261772 kB' 'Shmem: 5693572 kB' 'KernelStack: 7288 kB' 'PageTables: 4096 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 314480 kB' 'Slab: 657568 kB' 'SReclaimable: 314480 kB' 'SUnreclaim: 343088 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:30.161 01:05:38 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.161 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.161 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.161 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.161 01:05:38 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.161 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.161 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.161 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.161 01:05:38 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.161 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.161 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.161 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.161 01:05:38 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.161 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.161 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.161 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.161 01:05:38 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.161 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.161 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.161 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.161 01:05:38 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.161 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.161 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.161 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.161 01:05:38 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.161 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.161 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.161 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.161 01:05:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.161 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.161 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.161 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.161 01:05:38 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.161 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.161 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.161 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.161 01:05:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.161 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.161 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.161 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.161 01:05:38 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.161 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.161 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.161 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.161 01:05:38 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.161 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.161 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.161 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.161 01:05:38 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.161 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.161 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.161 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.161 01:05:38 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.161 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.161 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.161 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.161 01:05:38 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.161 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.161 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.161 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.161 01:05:38 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.161 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.161 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.161 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.161 01:05:38 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.161 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.161 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.161 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.161 01:05:38 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.161 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.161 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.161 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.161 01:05:38 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.161 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.161 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.161 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.161 01:05:38 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.161 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.161 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.161 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.161 01:05:38 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.161 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.161 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.161 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.162 01:05:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.162 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.162 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.162 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.162 01:05:38 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.162 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.162 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.162 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.162 01:05:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.162 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.162 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.162 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.162 01:05:38 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.162 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.162 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.162 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.162 01:05:38 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.162 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.162 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.162 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.162 01:05:38 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.162 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.162 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.162 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.162 01:05:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.162 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.162 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.162 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.162 01:05:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.162 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.162 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.162 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.162 01:05:38 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.162 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.162 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.162 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.162 01:05:38 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.162 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.162 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.162 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.162 01:05:38 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.162 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.162 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.162 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.162 01:05:38 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.162 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.162 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.162 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.162 01:05:38 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.162 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.162 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.162 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.162 01:05:38 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.162 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.162 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.162 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.162 01:05:38 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.162 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.162 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.162 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.162 01:05:38 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.162 01:05:38 -- setup/common.sh@33 -- # echo 0 00:04:30.162 01:05:38 -- setup/common.sh@33 -- # return 0 00:04:30.162 01:05:38 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:30.162 01:05:38 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:30.162 01:05:38 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:30.162 01:05:38 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:30.162 01:05:38 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:30.162 01:05:38 -- setup/common.sh@18 -- # local node=1 00:04:30.162 01:05:38 -- setup/common.sh@19 -- # local var val 00:04:30.162 01:05:38 -- setup/common.sh@20 -- # local mem_f mem 00:04:30.162 01:05:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:30.162 01:05:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:30.162 01:05:38 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:30.162 01:05:38 -- setup/common.sh@28 -- # mapfile -t mem 00:04:30.162 01:05:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:30.162 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.162 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.162 01:05:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660748 kB' 'MemFree: 21976660 kB' 'MemUsed: 5684088 kB' 'SwapCached: 0 kB' 'Active: 3150980 kB' 'Inactive: 532844 kB' 'Active(anon): 2960400 kB' 'Inactive(anon): 0 kB' 'Active(file): 190580 kB' 'Inactive(file): 532844 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3486000 kB' 'Mapped: 62616 kB' 'AnonPages: 197908 kB' 'Shmem: 2762576 kB' 'KernelStack: 5512 kB' 'PageTables: 3352 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 154424 kB' 'Slab: 354744 kB' 'SReclaimable: 154424 kB' 'SUnreclaim: 200320 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 513' 'HugePages_Free: 513' 'HugePages_Surp: 0' 00:04:30.162 01:05:38 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.162 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.162 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.162 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.162 01:05:38 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.162 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.162 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.162 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.162 01:05:38 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.162 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.162 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.162 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.162 01:05:38 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.162 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.162 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.162 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.162 01:05:38 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.162 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.162 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.162 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.162 01:05:38 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.162 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.162 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.162 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.162 01:05:38 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.162 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.162 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.162 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.163 01:05:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.163 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.163 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.163 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.163 01:05:38 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.163 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.163 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.163 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.163 01:05:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.163 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.163 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.163 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.163 01:05:38 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.163 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.163 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.163 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.163 01:05:38 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.163 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.163 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.163 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.163 01:05:38 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.163 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.163 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.163 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.163 01:05:38 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.163 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.163 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.163 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.163 01:05:38 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.163 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.163 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.163 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.163 01:05:38 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.163 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.163 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.163 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.163 01:05:38 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.163 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.163 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.163 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.163 01:05:38 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.163 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.163 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.163 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.163 01:05:38 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.163 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.163 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.163 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.163 01:05:38 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.163 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.163 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.163 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.163 01:05:38 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.163 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.163 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.163 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.163 01:05:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.163 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.163 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.163 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.163 01:05:38 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.163 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.163 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.163 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.163 01:05:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.163 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.163 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.163 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.163 01:05:38 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.163 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.163 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.163 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.163 01:05:38 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.163 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.163 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.163 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.163 01:05:38 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.163 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.163 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.163 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.163 01:05:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.163 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.163 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.163 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.163 01:05:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.163 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.163 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.163 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.163 01:05:38 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.163 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.163 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.163 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.163 01:05:38 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.163 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.163 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.163 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.163 01:05:38 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.163 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.163 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.163 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.163 01:05:38 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.163 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.163 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.163 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.163 01:05:38 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.163 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.163 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.163 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.163 01:05:38 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.163 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.163 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.163 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.163 01:05:38 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.163 01:05:38 -- setup/common.sh@32 -- # continue 00:04:30.163 01:05:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:30.163 01:05:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:30.163 01:05:38 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:30.163 01:05:38 -- setup/common.sh@33 -- # echo 0 00:04:30.163 01:05:38 -- setup/common.sh@33 -- # return 0 00:04:30.163 01:05:38 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:30.163 01:05:38 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:30.163 01:05:38 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:30.163 01:05:38 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:30.163 01:05:38 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 513' 00:04:30.163 node0=512 expecting 513 00:04:30.163 01:05:38 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:30.163 01:05:38 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:30.163 01:05:38 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:30.163 01:05:38 -- setup/hugepages.sh@128 -- # echo 'node1=513 expecting 512' 00:04:30.163 node1=513 expecting 512 00:04:30.163 01:05:38 -- setup/hugepages.sh@130 -- # [[ 512 513 == \5\1\2\ \5\1\3 ]] 00:04:30.163 00:04:30.163 real 0m1.463s 00:04:30.163 user 0m0.609s 00:04:30.163 sys 0m0.819s 00:04:30.163 01:05:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:30.163 01:05:38 -- common/autotest_common.sh@10 -- # set +x 00:04:30.163 ************************************ 00:04:30.163 END TEST odd_alloc 00:04:30.163 ************************************ 00:04:30.163 01:05:38 -- setup/hugepages.sh@214 -- # run_test custom_alloc custom_alloc 00:04:30.163 01:05:38 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:30.164 01:05:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:30.164 01:05:38 -- common/autotest_common.sh@10 -- # set +x 00:04:30.164 ************************************ 00:04:30.164 START TEST custom_alloc 00:04:30.164 ************************************ 00:04:30.164 01:05:38 -- common/autotest_common.sh@1114 -- # custom_alloc 00:04:30.164 01:05:38 -- setup/hugepages.sh@167 -- # local IFS=, 00:04:30.164 01:05:38 -- setup/hugepages.sh@169 -- # local node 00:04:30.164 01:05:38 -- setup/hugepages.sh@170 -- # nodes_hp=() 00:04:30.164 01:05:38 -- setup/hugepages.sh@170 -- # local nodes_hp 00:04:30.164 01:05:38 -- setup/hugepages.sh@172 -- # local nr_hugepages=0 _nr_hugepages=0 00:04:30.164 01:05:38 -- setup/hugepages.sh@174 -- # get_test_nr_hugepages 1048576 00:04:30.164 01:05:38 -- setup/hugepages.sh@49 -- # local size=1048576 00:04:30.164 01:05:38 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:30.164 01:05:38 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:30.164 01:05:38 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:04:30.164 01:05:38 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:30.164 01:05:38 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:30.164 01:05:38 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:30.164 01:05:38 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:04:30.164 01:05:38 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:30.164 01:05:38 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:30.164 01:05:38 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:30.164 01:05:38 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:30.164 01:05:38 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:30.164 01:05:38 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:30.164 01:05:38 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:04:30.164 01:05:38 -- setup/hugepages.sh@83 -- # : 256 00:04:30.164 01:05:38 -- setup/hugepages.sh@84 -- # : 1 00:04:30.164 01:05:38 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:30.164 01:05:38 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:04:30.164 01:05:38 -- setup/hugepages.sh@83 -- # : 0 00:04:30.164 01:05:38 -- setup/hugepages.sh@84 -- # : 0 00:04:30.164 01:05:38 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:30.164 01:05:38 -- setup/hugepages.sh@175 -- # nodes_hp[0]=512 00:04:30.164 01:05:38 -- setup/hugepages.sh@176 -- # (( 2 > 1 )) 00:04:30.164 01:05:38 -- setup/hugepages.sh@177 -- # get_test_nr_hugepages 2097152 00:04:30.164 01:05:38 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:30.164 01:05:38 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:30.164 01:05:38 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:30.164 01:05:38 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:30.164 01:05:38 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:30.164 01:05:38 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:30.164 01:05:38 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:30.164 01:05:38 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:30.164 01:05:38 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:30.164 01:05:38 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:30.164 01:05:38 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:30.164 01:05:38 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:30.164 01:05:38 -- setup/hugepages.sh@74 -- # (( 1 > 0 )) 00:04:30.164 01:05:38 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:30.164 01:05:38 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:04:30.164 01:05:38 -- setup/hugepages.sh@78 -- # return 0 00:04:30.164 01:05:38 -- setup/hugepages.sh@178 -- # nodes_hp[1]=1024 00:04:30.164 01:05:38 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:04:30.164 01:05:38 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:04:30.164 01:05:38 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:04:30.164 01:05:38 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:04:30.164 01:05:38 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:04:30.164 01:05:38 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:04:30.164 01:05:38 -- setup/hugepages.sh@186 -- # get_test_nr_hugepages_per_node 00:04:30.164 01:05:38 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:30.164 01:05:38 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:30.164 01:05:38 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:30.164 01:05:38 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:30.164 01:05:38 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:30.164 01:05:38 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:30.164 01:05:38 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:30.164 01:05:38 -- setup/hugepages.sh@74 -- # (( 2 > 0 )) 00:04:30.164 01:05:38 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:30.164 01:05:38 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:04:30.164 01:05:38 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:30.164 01:05:38 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=1024 00:04:30.164 01:05:38 -- setup/hugepages.sh@78 -- # return 0 00:04:30.164 01:05:38 -- setup/hugepages.sh@187 -- # HUGENODE='nodes_hp[0]=512,nodes_hp[1]=1024' 00:04:30.164 01:05:38 -- setup/hugepages.sh@187 -- # setup output 00:04:30.164 01:05:38 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:30.164 01:05:38 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:31.555 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:31.555 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:31.555 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:31.555 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:31.556 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:31.556 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:31.556 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:31.556 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:31.556 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:31.556 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:31.556 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:31.556 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:31.556 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:31.556 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:31.556 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:31.556 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:31.556 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:31.556 01:05:39 -- setup/hugepages.sh@188 -- # nr_hugepages=1536 00:04:31.556 01:05:39 -- setup/hugepages.sh@188 -- # verify_nr_hugepages 00:04:31.556 01:05:39 -- setup/hugepages.sh@89 -- # local node 00:04:31.556 01:05:39 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:31.556 01:05:39 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:31.556 01:05:39 -- setup/hugepages.sh@92 -- # local surp 00:04:31.556 01:05:39 -- setup/hugepages.sh@93 -- # local resv 00:04:31.556 01:05:39 -- setup/hugepages.sh@94 -- # local anon 00:04:31.556 01:05:39 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:31.556 01:05:39 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:31.556 01:05:39 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:31.556 01:05:39 -- setup/common.sh@18 -- # local node= 00:04:31.556 01:05:39 -- setup/common.sh@19 -- # local var val 00:04:31.556 01:05:39 -- setup/common.sh@20 -- # local mem_f mem 00:04:31.556 01:05:39 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:31.556 01:05:39 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:31.556 01:05:39 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:31.556 01:05:39 -- setup/common.sh@28 -- # mapfile -t mem 00:04:31.556 01:05:39 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:31.556 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.556 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.556 01:05:39 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 41685652 kB' 'MemAvailable: 45991916 kB' 'Buffers: 2708 kB' 'Cached: 12935472 kB' 'SwapCached: 0 kB' 'Active: 9308280 kB' 'Inactive: 4084660 kB' 'Active(anon): 8910948 kB' 'Inactive(anon): 0 kB' 'Active(file): 397332 kB' 'Inactive(file): 4084660 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 457952 kB' 'Mapped: 161384 kB' 'Shmem: 8456188 kB' 'KReclaimable: 468904 kB' 'Slab: 1012220 kB' 'SReclaimable: 468904 kB' 'SUnreclaim: 543316 kB' 'KernelStack: 12848 kB' 'PageTables: 7508 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083576 kB' 'Committed_AS: 9993220 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198392 kB' 'VmallocChunk: 0 kB' 'Percpu: 40128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1867356 kB' 'DirectMap2M: 17975296 kB' 'DirectMap1G: 50331648 kB' 00:04:31.556 01:05:39 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.556 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.556 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.556 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.556 01:05:39 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.556 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.556 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.556 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.556 01:05:39 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.556 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.556 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.556 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.556 01:05:39 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.556 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.556 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.556 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.556 01:05:39 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.556 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.556 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.556 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.556 01:05:39 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.556 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.556 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.556 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.556 01:05:39 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.556 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.556 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.556 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.556 01:05:39 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.556 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.556 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.556 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.556 01:05:39 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.556 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.556 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.556 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.556 01:05:39 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.556 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.556 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.556 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.556 01:05:39 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.556 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.556 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.556 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.556 01:05:39 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.556 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.556 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.556 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.556 01:05:39 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.556 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.556 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.556 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.556 01:05:39 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.556 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.556 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.556 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.556 01:05:39 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.556 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.556 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.556 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.556 01:05:39 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.556 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.556 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.556 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.556 01:05:39 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.556 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.556 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.556 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.556 01:05:39 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.556 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.556 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.556 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.556 01:05:39 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.556 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.556 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.556 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.556 01:05:39 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.556 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.556 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.556 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.556 01:05:39 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.556 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.556 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.556 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.556 01:05:39 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.556 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.556 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.556 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.556 01:05:39 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.556 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.556 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.556 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.556 01:05:39 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.556 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.556 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.556 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.556 01:05:39 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.556 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.556 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.556 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.556 01:05:39 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.556 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.556 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.556 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.556 01:05:39 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.556 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.557 01:05:39 -- setup/common.sh@33 -- # echo 0 00:04:31.557 01:05:39 -- setup/common.sh@33 -- # return 0 00:04:31.557 01:05:39 -- setup/hugepages.sh@97 -- # anon=0 00:04:31.557 01:05:39 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:31.557 01:05:39 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:31.557 01:05:39 -- setup/common.sh@18 -- # local node= 00:04:31.557 01:05:39 -- setup/common.sh@19 -- # local var val 00:04:31.557 01:05:39 -- setup/common.sh@20 -- # local mem_f mem 00:04:31.557 01:05:39 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:31.557 01:05:39 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:31.557 01:05:39 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:31.557 01:05:39 -- setup/common.sh@28 -- # mapfile -t mem 00:04:31.557 01:05:39 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.557 01:05:39 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 41686628 kB' 'MemAvailable: 45992892 kB' 'Buffers: 2708 kB' 'Cached: 12935476 kB' 'SwapCached: 0 kB' 'Active: 9308032 kB' 'Inactive: 4084660 kB' 'Active(anon): 8910700 kB' 'Inactive(anon): 0 kB' 'Active(file): 397332 kB' 'Inactive(file): 4084660 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 457764 kB' 'Mapped: 161388 kB' 'Shmem: 8456192 kB' 'KReclaimable: 468904 kB' 'Slab: 1012276 kB' 'SReclaimable: 468904 kB' 'SUnreclaim: 543372 kB' 'KernelStack: 12848 kB' 'PageTables: 7520 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083576 kB' 'Committed_AS: 9993232 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 40128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1867356 kB' 'DirectMap2M: 17975296 kB' 'DirectMap1G: 50331648 kB' 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.557 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.557 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.558 01:05:39 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.558 01:05:39 -- setup/common.sh@33 -- # echo 0 00:04:31.558 01:05:39 -- setup/common.sh@33 -- # return 0 00:04:31.558 01:05:39 -- setup/hugepages.sh@99 -- # surp=0 00:04:31.558 01:05:39 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:31.558 01:05:39 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:31.558 01:05:39 -- setup/common.sh@18 -- # local node= 00:04:31.558 01:05:39 -- setup/common.sh@19 -- # local var val 00:04:31.558 01:05:39 -- setup/common.sh@20 -- # local mem_f mem 00:04:31.558 01:05:39 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:31.558 01:05:39 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:31.558 01:05:39 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:31.558 01:05:39 -- setup/common.sh@28 -- # mapfile -t mem 00:04:31.558 01:05:39 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.558 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.559 01:05:39 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 41686608 kB' 'MemAvailable: 45992872 kB' 'Buffers: 2708 kB' 'Cached: 12935488 kB' 'SwapCached: 0 kB' 'Active: 9307916 kB' 'Inactive: 4084660 kB' 'Active(anon): 8910584 kB' 'Inactive(anon): 0 kB' 'Active(file): 397332 kB' 'Inactive(file): 4084660 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 457608 kB' 'Mapped: 161308 kB' 'Shmem: 8456204 kB' 'KReclaimable: 468904 kB' 'Slab: 1012268 kB' 'SReclaimable: 468904 kB' 'SUnreclaim: 543364 kB' 'KernelStack: 12848 kB' 'PageTables: 7512 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083576 kB' 'Committed_AS: 9993248 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198360 kB' 'VmallocChunk: 0 kB' 'Percpu: 40128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1867356 kB' 'DirectMap2M: 17975296 kB' 'DirectMap1G: 50331648 kB' 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.559 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.559 01:05:39 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.560 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.560 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.560 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.560 01:05:39 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.560 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.560 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.560 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.560 01:05:39 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.560 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.560 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.560 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.560 01:05:39 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.560 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.560 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.560 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.560 01:05:39 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.560 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.560 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.560 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.560 01:05:39 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.560 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.560 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.560 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.560 01:05:39 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.560 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.560 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.560 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.560 01:05:39 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.560 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.560 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.560 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.560 01:05:39 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.560 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.560 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.560 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.560 01:05:39 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.560 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.560 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.560 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.560 01:05:39 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.560 01:05:39 -- setup/common.sh@33 -- # echo 0 00:04:31.560 01:05:39 -- setup/common.sh@33 -- # return 0 00:04:31.560 01:05:39 -- setup/hugepages.sh@100 -- # resv=0 00:04:31.560 01:05:39 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1536 00:04:31.560 nr_hugepages=1536 00:04:31.560 01:05:39 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:31.560 resv_hugepages=0 00:04:31.560 01:05:39 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:31.560 surplus_hugepages=0 00:04:31.560 01:05:39 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:31.560 anon_hugepages=0 00:04:31.560 01:05:39 -- setup/hugepages.sh@107 -- # (( 1536 == nr_hugepages + surp + resv )) 00:04:31.560 01:05:39 -- setup/hugepages.sh@109 -- # (( 1536 == nr_hugepages )) 00:04:31.560 01:05:39 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:31.560 01:05:39 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:31.560 01:05:39 -- setup/common.sh@18 -- # local node= 00:04:31.560 01:05:39 -- setup/common.sh@19 -- # local var val 00:04:31.560 01:05:39 -- setup/common.sh@20 -- # local mem_f mem 00:04:31.560 01:05:39 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:31.560 01:05:39 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:31.560 01:05:39 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:31.560 01:05:39 -- setup/common.sh@28 -- # mapfile -t mem 00:04:31.560 01:05:39 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:31.560 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.560 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.560 01:05:39 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 41686852 kB' 'MemAvailable: 45993116 kB' 'Buffers: 2708 kB' 'Cached: 12935500 kB' 'SwapCached: 0 kB' 'Active: 9307944 kB' 'Inactive: 4084660 kB' 'Active(anon): 8910612 kB' 'Inactive(anon): 0 kB' 'Active(file): 397332 kB' 'Inactive(file): 4084660 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 457616 kB' 'Mapped: 161308 kB' 'Shmem: 8456216 kB' 'KReclaimable: 468904 kB' 'Slab: 1012268 kB' 'SReclaimable: 468904 kB' 'SUnreclaim: 543364 kB' 'KernelStack: 12848 kB' 'PageTables: 7512 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083576 kB' 'Committed_AS: 9993264 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198360 kB' 'VmallocChunk: 0 kB' 'Percpu: 40128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1867356 kB' 'DirectMap2M: 17975296 kB' 'DirectMap1G: 50331648 kB' 00:04:31.560 01:05:39 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.560 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.560 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.560 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.560 01:05:39 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.560 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.560 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.560 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.560 01:05:39 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.560 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.560 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.560 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.560 01:05:39 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.560 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.560 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.560 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.560 01:05:39 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.560 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.560 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.560 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.560 01:05:39 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.560 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.560 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.560 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.560 01:05:39 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.560 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.560 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.560 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.560 01:05:39 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.560 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.560 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.560 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.560 01:05:39 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.560 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.560 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.560 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.560 01:05:39 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.560 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.560 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.560 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.560 01:05:39 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.560 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.560 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.560 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.560 01:05:39 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.560 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.560 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.560 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.560 01:05:39 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.560 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.560 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.560 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.560 01:05:39 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.560 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.560 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.561 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.561 01:05:39 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.561 01:05:39 -- setup/common.sh@33 -- # echo 1536 00:04:31.561 01:05:39 -- setup/common.sh@33 -- # return 0 00:04:31.561 01:05:39 -- setup/hugepages.sh@110 -- # (( 1536 == nr_hugepages + surp + resv )) 00:04:31.561 01:05:39 -- setup/hugepages.sh@112 -- # get_nodes 00:04:31.561 01:05:39 -- setup/hugepages.sh@27 -- # local node 00:04:31.561 01:05:39 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:31.561 01:05:39 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:31.561 01:05:39 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:31.561 01:05:39 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:31.561 01:05:39 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:31.561 01:05:39 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:31.561 01:05:39 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:31.561 01:05:39 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:31.561 01:05:39 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:31.561 01:05:39 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:31.561 01:05:39 -- setup/common.sh@18 -- # local node=0 00:04:31.562 01:05:39 -- setup/common.sh@19 -- # local var val 00:04:31.562 01:05:39 -- setup/common.sh@20 -- # local mem_f mem 00:04:31.562 01:05:39 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:31.562 01:05:39 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:31.562 01:05:39 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:31.562 01:05:39 -- setup/common.sh@28 -- # mapfile -t mem 00:04:31.562 01:05:39 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.562 01:05:39 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 20751916 kB' 'MemUsed: 12123008 kB' 'SwapCached: 0 kB' 'Active: 6156608 kB' 'Inactive: 3551816 kB' 'Active(anon): 5949856 kB' 'Inactive(anon): 0 kB' 'Active(file): 206752 kB' 'Inactive(file): 3551816 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9452148 kB' 'Mapped: 98692 kB' 'AnonPages: 259444 kB' 'Shmem: 5693580 kB' 'KernelStack: 7256 kB' 'PageTables: 4008 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 314480 kB' 'Slab: 657540 kB' 'SReclaimable: 314480 kB' 'SUnreclaim: 343060 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.562 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.562 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.563 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.563 01:05:39 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.563 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.563 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.563 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.563 01:05:39 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.563 01:05:39 -- setup/common.sh@33 -- # echo 0 00:04:31.563 01:05:39 -- setup/common.sh@33 -- # return 0 00:04:31.563 01:05:39 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:31.563 01:05:39 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:31.563 01:05:39 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:31.563 01:05:39 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:31.563 01:05:39 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:31.563 01:05:39 -- setup/common.sh@18 -- # local node=1 00:04:31.563 01:05:39 -- setup/common.sh@19 -- # local var val 00:04:31.563 01:05:39 -- setup/common.sh@20 -- # local mem_f mem 00:04:31.563 01:05:39 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:31.563 01:05:39 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:31.563 01:05:39 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:31.563 01:05:39 -- setup/common.sh@28 -- # mapfile -t mem 00:04:31.563 01:05:39 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:31.563 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.563 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.563 01:05:39 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660748 kB' 'MemFree: 20934936 kB' 'MemUsed: 6725812 kB' 'SwapCached: 0 kB' 'Active: 3151268 kB' 'Inactive: 532844 kB' 'Active(anon): 2960688 kB' 'Inactive(anon): 0 kB' 'Active(file): 190580 kB' 'Inactive(file): 532844 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3486088 kB' 'Mapped: 62616 kB' 'AnonPages: 198092 kB' 'Shmem: 2762664 kB' 'KernelStack: 5560 kB' 'PageTables: 3408 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 154424 kB' 'Slab: 354728 kB' 'SReclaimable: 154424 kB' 'SUnreclaim: 200304 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:31.563 01:05:39 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.563 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.563 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.563 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.563 01:05:39 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.563 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.563 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.563 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.563 01:05:39 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.563 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.563 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.563 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.563 01:05:39 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.563 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.563 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.563 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.563 01:05:39 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.563 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.563 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.563 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.563 01:05:39 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.563 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.563 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.563 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.563 01:05:39 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.563 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.563 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.563 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.563 01:05:39 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.563 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.563 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.563 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.563 01:05:39 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.563 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.563 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.563 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.823 01:05:39 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.823 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.823 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.823 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.823 01:05:39 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.823 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.823 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.823 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.823 01:05:39 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.823 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.823 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.823 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.823 01:05:39 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.823 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.823 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.823 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.823 01:05:39 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.823 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.823 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.823 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.823 01:05:39 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.823 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.823 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.823 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.823 01:05:39 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.823 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.823 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.823 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.823 01:05:39 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.823 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.823 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.823 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.823 01:05:39 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.823 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.823 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.823 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.823 01:05:39 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.823 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.823 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.823 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.823 01:05:39 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.823 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.823 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.823 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.823 01:05:39 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.823 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.823 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.823 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.823 01:05:39 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.823 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.823 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.823 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.823 01:05:39 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.823 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.823 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.823 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.823 01:05:39 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.823 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.823 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.823 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.823 01:05:39 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.823 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.823 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.823 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.823 01:05:39 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.823 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.823 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.823 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.823 01:05:39 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.823 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.823 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.823 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.823 01:05:39 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.823 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.823 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.823 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.823 01:05:39 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.823 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.823 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.823 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.823 01:05:39 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.823 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.823 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.823 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.823 01:05:39 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.823 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.823 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.823 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.823 01:05:39 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.823 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.823 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.823 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.823 01:05:39 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.823 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.823 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.823 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.823 01:05:39 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.823 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.823 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.823 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.823 01:05:39 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.823 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.823 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.823 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.823 01:05:39 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.823 01:05:39 -- setup/common.sh@32 -- # continue 00:04:31.823 01:05:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.823 01:05:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.823 01:05:39 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.823 01:05:39 -- setup/common.sh@33 -- # echo 0 00:04:31.823 01:05:39 -- setup/common.sh@33 -- # return 0 00:04:31.823 01:05:39 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:31.823 01:05:39 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:31.823 01:05:39 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:31.823 01:05:39 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:31.823 01:05:39 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:31.823 node0=512 expecting 512 00:04:31.823 01:05:39 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:31.823 01:05:39 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:31.823 01:05:39 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:31.823 01:05:39 -- setup/hugepages.sh@128 -- # echo 'node1=1024 expecting 1024' 00:04:31.823 node1=1024 expecting 1024 00:04:31.823 01:05:39 -- setup/hugepages.sh@130 -- # [[ 512,1024 == \5\1\2\,\1\0\2\4 ]] 00:04:31.823 00:04:31.823 real 0m1.500s 00:04:31.823 user 0m0.616s 00:04:31.823 sys 0m0.844s 00:04:31.823 01:05:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:31.823 01:05:39 -- common/autotest_common.sh@10 -- # set +x 00:04:31.823 ************************************ 00:04:31.823 END TEST custom_alloc 00:04:31.823 ************************************ 00:04:31.823 01:05:39 -- setup/hugepages.sh@215 -- # run_test no_shrink_alloc no_shrink_alloc 00:04:31.823 01:05:39 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:31.823 01:05:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:31.823 01:05:39 -- common/autotest_common.sh@10 -- # set +x 00:04:31.823 ************************************ 00:04:31.823 START TEST no_shrink_alloc 00:04:31.823 ************************************ 00:04:31.823 01:05:39 -- common/autotest_common.sh@1114 -- # no_shrink_alloc 00:04:31.823 01:05:39 -- setup/hugepages.sh@195 -- # get_test_nr_hugepages 2097152 0 00:04:31.823 01:05:39 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:31.823 01:05:39 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:04:31.823 01:05:39 -- setup/hugepages.sh@51 -- # shift 00:04:31.823 01:05:39 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:04:31.823 01:05:39 -- setup/hugepages.sh@52 -- # local node_ids 00:04:31.823 01:05:39 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:31.823 01:05:39 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:31.823 01:05:39 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:04:31.823 01:05:39 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:04:31.824 01:05:39 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:31.824 01:05:39 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:31.824 01:05:39 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:31.824 01:05:39 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:31.824 01:05:39 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:31.824 01:05:39 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:04:31.824 01:05:39 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:31.824 01:05:39 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:04:31.824 01:05:39 -- setup/hugepages.sh@73 -- # return 0 00:04:31.824 01:05:39 -- setup/hugepages.sh@198 -- # setup output 00:04:31.824 01:05:39 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:31.824 01:05:39 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:32.761 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:32.761 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:32.761 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:33.023 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:33.023 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:33.023 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:33.023 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:33.023 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:33.023 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:33.023 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:33.023 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:33.023 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:33.023 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:33.023 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:33.023 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:33.023 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:33.023 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:33.023 01:05:41 -- setup/hugepages.sh@199 -- # verify_nr_hugepages 00:04:33.023 01:05:41 -- setup/hugepages.sh@89 -- # local node 00:04:33.023 01:05:41 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:33.023 01:05:41 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:33.023 01:05:41 -- setup/hugepages.sh@92 -- # local surp 00:04:33.023 01:05:41 -- setup/hugepages.sh@93 -- # local resv 00:04:33.023 01:05:41 -- setup/hugepages.sh@94 -- # local anon 00:04:33.023 01:05:41 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:33.023 01:05:41 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:33.023 01:05:41 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:33.023 01:05:41 -- setup/common.sh@18 -- # local node= 00:04:33.023 01:05:41 -- setup/common.sh@19 -- # local var val 00:04:33.023 01:05:41 -- setup/common.sh@20 -- # local mem_f mem 00:04:33.023 01:05:41 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:33.023 01:05:41 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:33.023 01:05:41 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:33.023 01:05:41 -- setup/common.sh@28 -- # mapfile -t mem 00:04:33.023 01:05:41 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:33.023 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.023 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.023 01:05:41 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 42702512 kB' 'MemAvailable: 47008784 kB' 'Buffers: 2708 kB' 'Cached: 12935560 kB' 'SwapCached: 0 kB' 'Active: 9306632 kB' 'Inactive: 4084660 kB' 'Active(anon): 8909300 kB' 'Inactive(anon): 0 kB' 'Active(file): 397332 kB' 'Inactive(file): 4084660 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 456188 kB' 'Mapped: 161328 kB' 'Shmem: 8456276 kB' 'KReclaimable: 468912 kB' 'Slab: 1012292 kB' 'SReclaimable: 468912 kB' 'SUnreclaim: 543380 kB' 'KernelStack: 12848 kB' 'PageTables: 7412 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 9993308 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198472 kB' 'VmallocChunk: 0 kB' 'Percpu: 40128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1867356 kB' 'DirectMap2M: 17975296 kB' 'DirectMap1G: 50331648 kB' 00:04:33.023 01:05:41 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.023 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.023 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.023 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.023 01:05:41 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.023 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.023 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.023 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.023 01:05:41 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.023 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.023 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.023 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.023 01:05:41 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.023 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.023 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.023 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.023 01:05:41 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.023 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.023 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.023 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.023 01:05:41 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.023 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.023 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.023 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.023 01:05:41 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.023 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.023 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.023 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.023 01:05:41 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.023 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.023 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.023 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.023 01:05:41 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.023 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.023 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.023 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.023 01:05:41 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.023 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.023 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.023 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.023 01:05:41 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.023 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.023 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.023 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.023 01:05:41 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.023 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.023 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.023 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.023 01:05:41 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.023 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.023 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.023 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.023 01:05:41 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.023 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.023 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.023 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.023 01:05:41 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.023 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.023 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.023 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.023 01:05:41 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.023 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.023 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.023 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.023 01:05:41 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.023 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.023 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.023 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.023 01:05:41 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:33.024 01:05:41 -- setup/common.sh@33 -- # echo 0 00:04:33.024 01:05:41 -- setup/common.sh@33 -- # return 0 00:04:33.024 01:05:41 -- setup/hugepages.sh@97 -- # anon=0 00:04:33.024 01:05:41 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:33.024 01:05:41 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:33.024 01:05:41 -- setup/common.sh@18 -- # local node= 00:04:33.024 01:05:41 -- setup/common.sh@19 -- # local var val 00:04:33.024 01:05:41 -- setup/common.sh@20 -- # local mem_f mem 00:04:33.024 01:05:41 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:33.024 01:05:41 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:33.024 01:05:41 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:33.024 01:05:41 -- setup/common.sh@28 -- # mapfile -t mem 00:04:33.024 01:05:41 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.024 01:05:41 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 42726464 kB' 'MemAvailable: 47032736 kB' 'Buffers: 2708 kB' 'Cached: 12935564 kB' 'SwapCached: 0 kB' 'Active: 9307220 kB' 'Inactive: 4084660 kB' 'Active(anon): 8909888 kB' 'Inactive(anon): 0 kB' 'Active(file): 397332 kB' 'Inactive(file): 4084660 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 456852 kB' 'Mapped: 161412 kB' 'Shmem: 8456280 kB' 'KReclaimable: 468912 kB' 'Slab: 1012408 kB' 'SReclaimable: 468912 kB' 'SUnreclaim: 543496 kB' 'KernelStack: 12848 kB' 'PageTables: 7376 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 9993320 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198440 kB' 'VmallocChunk: 0 kB' 'Percpu: 40128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1867356 kB' 'DirectMap2M: 17975296 kB' 'DirectMap1G: 50331648 kB' 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.024 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.024 01:05:41 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.025 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.025 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.026 01:05:41 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.026 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.026 01:05:41 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.026 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.026 01:05:41 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.026 01:05:41 -- setup/common.sh@33 -- # echo 0 00:04:33.026 01:05:41 -- setup/common.sh@33 -- # return 0 00:04:33.026 01:05:41 -- setup/hugepages.sh@99 -- # surp=0 00:04:33.026 01:05:41 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:33.026 01:05:41 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:33.026 01:05:41 -- setup/common.sh@18 -- # local node= 00:04:33.026 01:05:41 -- setup/common.sh@19 -- # local var val 00:04:33.026 01:05:41 -- setup/common.sh@20 -- # local mem_f mem 00:04:33.026 01:05:41 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:33.026 01:05:41 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:33.026 01:05:41 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:33.026 01:05:41 -- setup/common.sh@28 -- # mapfile -t mem 00:04:33.026 01:05:41 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.026 01:05:41 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 42726764 kB' 'MemAvailable: 47033036 kB' 'Buffers: 2708 kB' 'Cached: 12935568 kB' 'SwapCached: 0 kB' 'Active: 9306252 kB' 'Inactive: 4084660 kB' 'Active(anon): 8908920 kB' 'Inactive(anon): 0 kB' 'Active(file): 397332 kB' 'Inactive(file): 4084660 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 455808 kB' 'Mapped: 161312 kB' 'Shmem: 8456284 kB' 'KReclaimable: 468912 kB' 'Slab: 1012360 kB' 'SReclaimable: 468912 kB' 'SUnreclaim: 543448 kB' 'KernelStack: 12896 kB' 'PageTables: 7504 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 9993336 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198456 kB' 'VmallocChunk: 0 kB' 'Percpu: 40128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1867356 kB' 'DirectMap2M: 17975296 kB' 'DirectMap1G: 50331648 kB' 00:04:33.026 01:05:41 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.026 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.026 01:05:41 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.026 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.026 01:05:41 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.026 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.026 01:05:41 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.026 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.026 01:05:41 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.026 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.026 01:05:41 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.026 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.026 01:05:41 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.026 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.026 01:05:41 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.026 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.026 01:05:41 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.026 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.026 01:05:41 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.026 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.026 01:05:41 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.026 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.026 01:05:41 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.026 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.026 01:05:41 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.026 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.026 01:05:41 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.026 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.026 01:05:41 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.026 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.026 01:05:41 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.026 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.026 01:05:41 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.026 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.026 01:05:41 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.026 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.026 01:05:41 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.026 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.026 01:05:41 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.026 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.026 01:05:41 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.026 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.026 01:05:41 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.026 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.026 01:05:41 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.026 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.026 01:05:41 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.026 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.026 01:05:41 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.026 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.026 01:05:41 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.026 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.026 01:05:41 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.026 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.026 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.027 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.027 01:05:41 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.027 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.027 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.027 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.027 01:05:41 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.027 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.027 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.027 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.027 01:05:41 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.027 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.027 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.027 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.027 01:05:41 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.027 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.027 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.027 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.027 01:05:41 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.027 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.027 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.027 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.027 01:05:41 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.027 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.027 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.027 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.027 01:05:41 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.027 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.027 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.027 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.027 01:05:41 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.027 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.027 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.027 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.027 01:05:41 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.027 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.027 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.027 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.027 01:05:41 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.027 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.027 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.027 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.027 01:05:41 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.027 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.027 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.027 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.027 01:05:41 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.027 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.027 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.027 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.027 01:05:41 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.027 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.027 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.027 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.027 01:05:41 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.027 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.027 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.027 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.027 01:05:41 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.027 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.027 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.027 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.027 01:05:41 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.027 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.027 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.027 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.027 01:05:41 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.287 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.287 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.287 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.287 01:05:41 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.287 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.287 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.287 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.287 01:05:41 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.287 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.287 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.287 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.287 01:05:41 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.287 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.287 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.287 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.287 01:05:41 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.287 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.287 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.287 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.287 01:05:41 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.287 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.287 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.287 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.287 01:05:41 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.287 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.287 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.287 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.287 01:05:41 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:33.287 01:05:41 -- setup/common.sh@33 -- # echo 0 00:04:33.287 01:05:41 -- setup/common.sh@33 -- # return 0 00:04:33.287 01:05:41 -- setup/hugepages.sh@100 -- # resv=0 00:04:33.287 01:05:41 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:33.288 nr_hugepages=1024 00:04:33.288 01:05:41 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:33.288 resv_hugepages=0 00:04:33.288 01:05:41 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:33.288 surplus_hugepages=0 00:04:33.288 01:05:41 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:33.288 anon_hugepages=0 00:04:33.288 01:05:41 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:33.288 01:05:41 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:33.288 01:05:41 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:33.288 01:05:41 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:33.288 01:05:41 -- setup/common.sh@18 -- # local node= 00:04:33.288 01:05:41 -- setup/common.sh@19 -- # local var val 00:04:33.288 01:05:41 -- setup/common.sh@20 -- # local mem_f mem 00:04:33.288 01:05:41 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:33.288 01:05:41 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:33.288 01:05:41 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:33.288 01:05:41 -- setup/common.sh@28 -- # mapfile -t mem 00:04:33.288 01:05:41 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.288 01:05:41 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 42726764 kB' 'MemAvailable: 47033036 kB' 'Buffers: 2708 kB' 'Cached: 12935588 kB' 'SwapCached: 0 kB' 'Active: 9306584 kB' 'Inactive: 4084660 kB' 'Active(anon): 8909252 kB' 'Inactive(anon): 0 kB' 'Active(file): 397332 kB' 'Inactive(file): 4084660 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 456124 kB' 'Mapped: 161312 kB' 'Shmem: 8456304 kB' 'KReclaimable: 468912 kB' 'Slab: 1012360 kB' 'SReclaimable: 468912 kB' 'SUnreclaim: 543448 kB' 'KernelStack: 12896 kB' 'PageTables: 7504 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 9993352 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198472 kB' 'VmallocChunk: 0 kB' 'Percpu: 40128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1867356 kB' 'DirectMap2M: 17975296 kB' 'DirectMap1G: 50331648 kB' 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.288 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.288 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:33.289 01:05:41 -- setup/common.sh@33 -- # echo 1024 00:04:33.289 01:05:41 -- setup/common.sh@33 -- # return 0 00:04:33.289 01:05:41 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:33.289 01:05:41 -- setup/hugepages.sh@112 -- # get_nodes 00:04:33.289 01:05:41 -- setup/hugepages.sh@27 -- # local node 00:04:33.289 01:05:41 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:33.289 01:05:41 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:33.289 01:05:41 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:33.289 01:05:41 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:33.289 01:05:41 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:33.289 01:05:41 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:33.289 01:05:41 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:33.289 01:05:41 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:33.289 01:05:41 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:33.289 01:05:41 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:33.289 01:05:41 -- setup/common.sh@18 -- # local node=0 00:04:33.289 01:05:41 -- setup/common.sh@19 -- # local var val 00:04:33.289 01:05:41 -- setup/common.sh@20 -- # local mem_f mem 00:04:33.289 01:05:41 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:33.289 01:05:41 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:33.289 01:05:41 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:33.289 01:05:41 -- setup/common.sh@28 -- # mapfile -t mem 00:04:33.289 01:05:41 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.289 01:05:41 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 19699700 kB' 'MemUsed: 13175224 kB' 'SwapCached: 0 kB' 'Active: 6156104 kB' 'Inactive: 3551816 kB' 'Active(anon): 5949352 kB' 'Inactive(anon): 0 kB' 'Active(file): 206752 kB' 'Inactive(file): 3551816 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9452156 kB' 'Mapped: 98696 kB' 'AnonPages: 258900 kB' 'Shmem: 5693588 kB' 'KernelStack: 7288 kB' 'PageTables: 4028 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 314488 kB' 'Slab: 657540 kB' 'SReclaimable: 314488 kB' 'SUnreclaim: 343052 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.289 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.289 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.290 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.290 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.290 01:05:41 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.290 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.290 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.290 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.290 01:05:41 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.290 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.290 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.290 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.290 01:05:41 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.290 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.290 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.290 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.290 01:05:41 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.290 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.290 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.290 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.290 01:05:41 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.290 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.290 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.290 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.290 01:05:41 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.290 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.290 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.290 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.290 01:05:41 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.290 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.290 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.290 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.290 01:05:41 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.290 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.290 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.290 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.290 01:05:41 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.290 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.290 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.290 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.290 01:05:41 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.290 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.290 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.290 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.290 01:05:41 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.290 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.290 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.290 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.290 01:05:41 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.290 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.290 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.290 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.290 01:05:41 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.290 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.290 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.290 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.290 01:05:41 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.290 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.290 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.290 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.290 01:05:41 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.290 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.290 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.290 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.290 01:05:41 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.290 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.290 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.290 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.290 01:05:41 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.290 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.290 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.290 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.290 01:05:41 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.290 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.290 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.290 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.290 01:05:41 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.290 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.290 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.290 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.290 01:05:41 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.290 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.290 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.290 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.290 01:05:41 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.290 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.290 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.290 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.290 01:05:41 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.290 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.290 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.290 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.290 01:05:41 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.290 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.290 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.290 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.290 01:05:41 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.290 01:05:41 -- setup/common.sh@32 -- # continue 00:04:33.290 01:05:41 -- setup/common.sh@31 -- # IFS=': ' 00:04:33.290 01:05:41 -- setup/common.sh@31 -- # read -r var val _ 00:04:33.290 01:05:41 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:33.290 01:05:41 -- setup/common.sh@33 -- # echo 0 00:04:33.290 01:05:41 -- setup/common.sh@33 -- # return 0 00:04:33.290 01:05:41 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:33.290 01:05:41 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:33.290 01:05:41 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:33.290 01:05:41 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:33.290 01:05:41 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:33.290 node0=1024 expecting 1024 00:04:33.290 01:05:41 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:33.290 01:05:41 -- setup/hugepages.sh@202 -- # CLEAR_HUGE=no 00:04:33.290 01:05:41 -- setup/hugepages.sh@202 -- # NRHUGE=512 00:04:33.290 01:05:41 -- setup/hugepages.sh@202 -- # setup output 00:04:33.290 01:05:41 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:33.290 01:05:41 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:34.227 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:34.227 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:34.227 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:34.227 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:34.227 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:34.227 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:34.227 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:34.227 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:34.227 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:34.227 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:34.227 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:34.227 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:34.227 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:34.227 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:34.227 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:34.227 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:34.227 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:34.492 INFO: Requested 512 hugepages but 1024 already allocated on node0 00:04:34.492 01:05:42 -- setup/hugepages.sh@204 -- # verify_nr_hugepages 00:04:34.492 01:05:42 -- setup/hugepages.sh@89 -- # local node 00:04:34.492 01:05:42 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:34.492 01:05:42 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:34.492 01:05:42 -- setup/hugepages.sh@92 -- # local surp 00:04:34.492 01:05:42 -- setup/hugepages.sh@93 -- # local resv 00:04:34.492 01:05:42 -- setup/hugepages.sh@94 -- # local anon 00:04:34.492 01:05:42 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:34.492 01:05:42 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:34.492 01:05:42 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:34.492 01:05:42 -- setup/common.sh@18 -- # local node= 00:04:34.492 01:05:42 -- setup/common.sh@19 -- # local var val 00:04:34.492 01:05:42 -- setup/common.sh@20 -- # local mem_f mem 00:04:34.492 01:05:42 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:34.492 01:05:42 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:34.492 01:05:42 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:34.492 01:05:42 -- setup/common.sh@28 -- # mapfile -t mem 00:04:34.492 01:05:42 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:34.492 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.492 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.492 01:05:42 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 42719532 kB' 'MemAvailable: 47025804 kB' 'Buffers: 2708 kB' 'Cached: 12935644 kB' 'SwapCached: 0 kB' 'Active: 9308040 kB' 'Inactive: 4084660 kB' 'Active(anon): 8910708 kB' 'Inactive(anon): 0 kB' 'Active(file): 397332 kB' 'Inactive(file): 4084660 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 457648 kB' 'Mapped: 161416 kB' 'Shmem: 8456360 kB' 'KReclaimable: 468912 kB' 'Slab: 1012356 kB' 'SReclaimable: 468912 kB' 'SUnreclaim: 543444 kB' 'KernelStack: 12944 kB' 'PageTables: 7672 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 9993656 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198504 kB' 'VmallocChunk: 0 kB' 'Percpu: 40128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1867356 kB' 'DirectMap2M: 17975296 kB' 'DirectMap1G: 50331648 kB' 00:04:34.492 01:05:42 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.492 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.492 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.492 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.492 01:05:42 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.492 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.492 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.492 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.492 01:05:42 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.492 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.492 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.492 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.492 01:05:42 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.492 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.492 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.492 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.492 01:05:42 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.492 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.492 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.492 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.492 01:05:42 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.492 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.492 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.492 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.492 01:05:42 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.492 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.492 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.492 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.492 01:05:42 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.492 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.492 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.492 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.492 01:05:42 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.492 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.492 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.492 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.492 01:05:42 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.492 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.492 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.492 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.492 01:05:42 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.492 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.492 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.492 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.493 01:05:42 -- setup/common.sh@33 -- # echo 0 00:04:34.493 01:05:42 -- setup/common.sh@33 -- # return 0 00:04:34.493 01:05:42 -- setup/hugepages.sh@97 -- # anon=0 00:04:34.493 01:05:42 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:34.493 01:05:42 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:34.493 01:05:42 -- setup/common.sh@18 -- # local node= 00:04:34.493 01:05:42 -- setup/common.sh@19 -- # local var val 00:04:34.493 01:05:42 -- setup/common.sh@20 -- # local mem_f mem 00:04:34.493 01:05:42 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:34.493 01:05:42 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:34.493 01:05:42 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:34.493 01:05:42 -- setup/common.sh@28 -- # mapfile -t mem 00:04:34.493 01:05:42 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.493 01:05:42 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 42721500 kB' 'MemAvailable: 47027772 kB' 'Buffers: 2708 kB' 'Cached: 12935644 kB' 'SwapCached: 0 kB' 'Active: 9308676 kB' 'Inactive: 4084660 kB' 'Active(anon): 8911344 kB' 'Inactive(anon): 0 kB' 'Active(file): 397332 kB' 'Inactive(file): 4084660 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 458328 kB' 'Mapped: 161424 kB' 'Shmem: 8456360 kB' 'KReclaimable: 468912 kB' 'Slab: 1012420 kB' 'SReclaimable: 468912 kB' 'SUnreclaim: 543508 kB' 'KernelStack: 12960 kB' 'PageTables: 7680 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 9993668 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198472 kB' 'VmallocChunk: 0 kB' 'Percpu: 40128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1867356 kB' 'DirectMap2M: 17975296 kB' 'DirectMap1G: 50331648 kB' 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.493 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.493 01:05:42 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.494 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.494 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.495 01:05:42 -- setup/common.sh@33 -- # echo 0 00:04:34.495 01:05:42 -- setup/common.sh@33 -- # return 0 00:04:34.495 01:05:42 -- setup/hugepages.sh@99 -- # surp=0 00:04:34.495 01:05:42 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:34.495 01:05:42 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:34.495 01:05:42 -- setup/common.sh@18 -- # local node= 00:04:34.495 01:05:42 -- setup/common.sh@19 -- # local var val 00:04:34.495 01:05:42 -- setup/common.sh@20 -- # local mem_f mem 00:04:34.495 01:05:42 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:34.495 01:05:42 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:34.495 01:05:42 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:34.495 01:05:42 -- setup/common.sh@28 -- # mapfile -t mem 00:04:34.495 01:05:42 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.495 01:05:42 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 42730884 kB' 'MemAvailable: 47037156 kB' 'Buffers: 2708 kB' 'Cached: 12935656 kB' 'SwapCached: 0 kB' 'Active: 9307872 kB' 'Inactive: 4084660 kB' 'Active(anon): 8910540 kB' 'Inactive(anon): 0 kB' 'Active(file): 397332 kB' 'Inactive(file): 4084660 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 457520 kB' 'Mapped: 161404 kB' 'Shmem: 8456372 kB' 'KReclaimable: 468912 kB' 'Slab: 1012420 kB' 'SReclaimable: 468912 kB' 'SUnreclaim: 543508 kB' 'KernelStack: 12976 kB' 'PageTables: 7712 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 9997500 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198568 kB' 'VmallocChunk: 0 kB' 'Percpu: 40128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1867356 kB' 'DirectMap2M: 17975296 kB' 'DirectMap1G: 50331648 kB' 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.495 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.495 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.496 01:05:42 -- setup/common.sh@33 -- # echo 0 00:04:34.496 01:05:42 -- setup/common.sh@33 -- # return 0 00:04:34.496 01:05:42 -- setup/hugepages.sh@100 -- # resv=0 00:04:34.496 01:05:42 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:34.496 nr_hugepages=1024 00:04:34.496 01:05:42 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:34.496 resv_hugepages=0 00:04:34.496 01:05:42 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:34.496 surplus_hugepages=0 00:04:34.496 01:05:42 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:34.496 anon_hugepages=0 00:04:34.496 01:05:42 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:34.496 01:05:42 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:34.496 01:05:42 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:34.496 01:05:42 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:34.496 01:05:42 -- setup/common.sh@18 -- # local node= 00:04:34.496 01:05:42 -- setup/common.sh@19 -- # local var val 00:04:34.496 01:05:42 -- setup/common.sh@20 -- # local mem_f mem 00:04:34.496 01:05:42 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:34.496 01:05:42 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:34.496 01:05:42 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:34.496 01:05:42 -- setup/common.sh@28 -- # mapfile -t mem 00:04:34.496 01:05:42 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.496 01:05:42 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 42730212 kB' 'MemAvailable: 47036484 kB' 'Buffers: 2708 kB' 'Cached: 12935656 kB' 'SwapCached: 0 kB' 'Active: 9309280 kB' 'Inactive: 4084660 kB' 'Active(anon): 8911948 kB' 'Inactive(anon): 0 kB' 'Active(file): 397332 kB' 'Inactive(file): 4084660 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 458452 kB' 'Mapped: 161404 kB' 'Shmem: 8456372 kB' 'KReclaimable: 468912 kB' 'Slab: 1012420 kB' 'SReclaimable: 468912 kB' 'SUnreclaim: 543508 kB' 'KernelStack: 13104 kB' 'PageTables: 8624 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 9997752 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198712 kB' 'VmallocChunk: 0 kB' 'Percpu: 40128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1867356 kB' 'DirectMap2M: 17975296 kB' 'DirectMap1G: 50331648 kB' 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.496 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.496 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.497 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.497 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.498 01:05:42 -- setup/common.sh@33 -- # echo 1024 00:04:34.498 01:05:42 -- setup/common.sh@33 -- # return 0 00:04:34.498 01:05:42 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:34.498 01:05:42 -- setup/hugepages.sh@112 -- # get_nodes 00:04:34.498 01:05:42 -- setup/hugepages.sh@27 -- # local node 00:04:34.498 01:05:42 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:34.498 01:05:42 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:34.498 01:05:42 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:34.498 01:05:42 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:34.498 01:05:42 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:34.498 01:05:42 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:34.498 01:05:42 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:34.498 01:05:42 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:34.498 01:05:42 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:34.498 01:05:42 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:34.498 01:05:42 -- setup/common.sh@18 -- # local node=0 00:04:34.498 01:05:42 -- setup/common.sh@19 -- # local var val 00:04:34.498 01:05:42 -- setup/common.sh@20 -- # local mem_f mem 00:04:34.498 01:05:42 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:34.498 01:05:42 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:34.498 01:05:42 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:34.498 01:05:42 -- setup/common.sh@28 -- # mapfile -t mem 00:04:34.498 01:05:42 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.498 01:05:42 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 19703436 kB' 'MemUsed: 13171488 kB' 'SwapCached: 0 kB' 'Active: 6156676 kB' 'Inactive: 3551816 kB' 'Active(anon): 5949924 kB' 'Inactive(anon): 0 kB' 'Active(file): 206752 kB' 'Inactive(file): 3551816 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9452160 kB' 'Mapped: 98708 kB' 'AnonPages: 259524 kB' 'Shmem: 5693592 kB' 'KernelStack: 7256 kB' 'PageTables: 3972 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 314488 kB' 'Slab: 657548 kB' 'SReclaimable: 314488 kB' 'SUnreclaim: 343060 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.498 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.498 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.499 01:05:42 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.499 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.499 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.499 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.499 01:05:42 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.499 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.499 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.499 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.499 01:05:42 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.499 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.499 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.499 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.499 01:05:42 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.499 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.499 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.499 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.499 01:05:42 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.499 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.499 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.499 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.499 01:05:42 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.499 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.499 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.499 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.499 01:05:42 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.499 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.499 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.499 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.499 01:05:42 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.499 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.499 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.499 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.499 01:05:42 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.499 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.499 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.499 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.499 01:05:42 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.499 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.499 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.499 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.499 01:05:42 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.499 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.499 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.499 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.499 01:05:42 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.499 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.499 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.499 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.499 01:05:42 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.499 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.499 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.499 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.499 01:05:42 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.499 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.499 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.499 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.499 01:05:42 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.499 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.499 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.499 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.499 01:05:42 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.499 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.499 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.499 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.499 01:05:42 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.499 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.499 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.499 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.499 01:05:42 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.499 01:05:42 -- setup/common.sh@32 -- # continue 00:04:34.499 01:05:42 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.499 01:05:42 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.499 01:05:42 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.499 01:05:42 -- setup/common.sh@33 -- # echo 0 00:04:34.499 01:05:42 -- setup/common.sh@33 -- # return 0 00:04:34.499 01:05:42 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:34.499 01:05:42 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:34.499 01:05:42 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:34.499 01:05:42 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:34.499 01:05:42 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:34.499 node0=1024 expecting 1024 00:04:34.499 01:05:42 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:34.499 00:04:34.499 real 0m2.849s 00:04:34.499 user 0m1.178s 00:04:34.499 sys 0m1.598s 00:04:34.499 01:05:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:34.499 01:05:42 -- common/autotest_common.sh@10 -- # set +x 00:04:34.499 ************************************ 00:04:34.499 END TEST no_shrink_alloc 00:04:34.499 ************************************ 00:04:34.499 01:05:42 -- setup/hugepages.sh@217 -- # clear_hp 00:04:34.499 01:05:42 -- setup/hugepages.sh@37 -- # local node hp 00:04:34.499 01:05:42 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:34.499 01:05:42 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:34.499 01:05:42 -- setup/hugepages.sh@41 -- # echo 0 00:04:34.499 01:05:42 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:34.499 01:05:42 -- setup/hugepages.sh@41 -- # echo 0 00:04:34.499 01:05:42 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:34.499 01:05:42 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:34.499 01:05:42 -- setup/hugepages.sh@41 -- # echo 0 00:04:34.499 01:05:42 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:34.499 01:05:42 -- setup/hugepages.sh@41 -- # echo 0 00:04:34.499 01:05:42 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:04:34.499 01:05:42 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:04:34.499 00:04:34.499 real 0m11.562s 00:04:34.499 user 0m4.409s 00:04:34.499 sys 0m6.020s 00:04:34.499 01:05:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:34.499 01:05:42 -- common/autotest_common.sh@10 -- # set +x 00:04:34.499 ************************************ 00:04:34.499 END TEST hugepages 00:04:34.499 ************************************ 00:04:34.759 01:05:42 -- setup/test-setup.sh@14 -- # run_test driver /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:04:34.759 01:05:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:34.759 01:05:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:34.759 01:05:42 -- common/autotest_common.sh@10 -- # set +x 00:04:34.759 ************************************ 00:04:34.759 START TEST driver 00:04:34.759 ************************************ 00:04:34.759 01:05:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:04:34.759 * Looking for test storage... 00:04:34.759 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:34.759 01:05:42 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:34.759 01:05:42 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:34.759 01:05:42 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:34.759 01:05:42 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:34.759 01:05:42 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:34.759 01:05:42 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:34.759 01:05:42 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:34.759 01:05:42 -- scripts/common.sh@335 -- # IFS=.-: 00:04:34.759 01:05:42 -- scripts/common.sh@335 -- # read -ra ver1 00:04:34.759 01:05:42 -- scripts/common.sh@336 -- # IFS=.-: 00:04:34.759 01:05:42 -- scripts/common.sh@336 -- # read -ra ver2 00:04:34.759 01:05:42 -- scripts/common.sh@337 -- # local 'op=<' 00:04:34.759 01:05:42 -- scripts/common.sh@339 -- # ver1_l=2 00:04:34.759 01:05:42 -- scripts/common.sh@340 -- # ver2_l=1 00:04:34.759 01:05:42 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:34.759 01:05:42 -- scripts/common.sh@343 -- # case "$op" in 00:04:34.759 01:05:42 -- scripts/common.sh@344 -- # : 1 00:04:34.759 01:05:42 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:34.759 01:05:42 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:34.759 01:05:42 -- scripts/common.sh@364 -- # decimal 1 00:04:34.759 01:05:42 -- scripts/common.sh@352 -- # local d=1 00:04:34.759 01:05:42 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:34.759 01:05:42 -- scripts/common.sh@354 -- # echo 1 00:04:34.759 01:05:42 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:34.759 01:05:42 -- scripts/common.sh@365 -- # decimal 2 00:04:34.759 01:05:42 -- scripts/common.sh@352 -- # local d=2 00:04:34.759 01:05:42 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:34.759 01:05:42 -- scripts/common.sh@354 -- # echo 2 00:04:34.759 01:05:42 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:34.759 01:05:42 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:34.759 01:05:42 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:34.759 01:05:42 -- scripts/common.sh@367 -- # return 0 00:04:34.759 01:05:42 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:34.759 01:05:42 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:34.759 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:34.759 --rc genhtml_branch_coverage=1 00:04:34.759 --rc genhtml_function_coverage=1 00:04:34.759 --rc genhtml_legend=1 00:04:34.759 --rc geninfo_all_blocks=1 00:04:34.759 --rc geninfo_unexecuted_blocks=1 00:04:34.759 00:04:34.759 ' 00:04:34.759 01:05:42 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:34.759 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:34.759 --rc genhtml_branch_coverage=1 00:04:34.759 --rc genhtml_function_coverage=1 00:04:34.759 --rc genhtml_legend=1 00:04:34.759 --rc geninfo_all_blocks=1 00:04:34.759 --rc geninfo_unexecuted_blocks=1 00:04:34.759 00:04:34.759 ' 00:04:34.759 01:05:42 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:34.759 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:34.759 --rc genhtml_branch_coverage=1 00:04:34.759 --rc genhtml_function_coverage=1 00:04:34.759 --rc genhtml_legend=1 00:04:34.759 --rc geninfo_all_blocks=1 00:04:34.759 --rc geninfo_unexecuted_blocks=1 00:04:34.759 00:04:34.759 ' 00:04:34.759 01:05:42 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:34.759 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:34.759 --rc genhtml_branch_coverage=1 00:04:34.759 --rc genhtml_function_coverage=1 00:04:34.759 --rc genhtml_legend=1 00:04:34.759 --rc geninfo_all_blocks=1 00:04:34.759 --rc geninfo_unexecuted_blocks=1 00:04:34.759 00:04:34.759 ' 00:04:34.759 01:05:42 -- setup/driver.sh@68 -- # setup reset 00:04:34.759 01:05:42 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:34.759 01:05:42 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:37.289 01:05:45 -- setup/driver.sh@69 -- # run_test guess_driver guess_driver 00:04:37.289 01:05:45 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:37.289 01:05:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:37.289 01:05:45 -- common/autotest_common.sh@10 -- # set +x 00:04:37.289 ************************************ 00:04:37.289 START TEST guess_driver 00:04:37.289 ************************************ 00:04:37.289 01:05:45 -- common/autotest_common.sh@1114 -- # guess_driver 00:04:37.289 01:05:45 -- setup/driver.sh@46 -- # local driver setup_driver marker 00:04:37.289 01:05:45 -- setup/driver.sh@47 -- # local fail=0 00:04:37.289 01:05:45 -- setup/driver.sh@49 -- # pick_driver 00:04:37.289 01:05:45 -- setup/driver.sh@36 -- # vfio 00:04:37.289 01:05:45 -- setup/driver.sh@21 -- # local iommu_grups 00:04:37.289 01:05:45 -- setup/driver.sh@22 -- # local unsafe_vfio 00:04:37.289 01:05:45 -- setup/driver.sh@24 -- # [[ -e /sys/module/vfio/parameters/enable_unsafe_noiommu_mode ]] 00:04:37.289 01:05:45 -- setup/driver.sh@25 -- # unsafe_vfio=N 00:04:37.289 01:05:45 -- setup/driver.sh@27 -- # iommu_groups=(/sys/kernel/iommu_groups/*) 00:04:37.289 01:05:45 -- setup/driver.sh@29 -- # (( 141 > 0 )) 00:04:37.289 01:05:45 -- setup/driver.sh@30 -- # is_driver vfio_pci 00:04:37.289 01:05:45 -- setup/driver.sh@14 -- # mod vfio_pci 00:04:37.289 01:05:45 -- setup/driver.sh@12 -- # dep vfio_pci 00:04:37.289 01:05:45 -- setup/driver.sh@11 -- # modprobe --show-depends vfio_pci 00:04:37.289 01:05:45 -- setup/driver.sh@12 -- # [[ insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/virt/lib/irqbypass.ko.xz 00:04:37.289 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:04:37.289 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:04:37.289 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:04:37.289 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:04:37.289 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio_iommu_type1.ko.xz 00:04:37.289 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci-core.ko.xz 00:04:37.289 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci.ko.xz == *\.\k\o* ]] 00:04:37.289 01:05:45 -- setup/driver.sh@30 -- # return 0 00:04:37.289 01:05:45 -- setup/driver.sh@37 -- # echo vfio-pci 00:04:37.289 01:05:45 -- setup/driver.sh@49 -- # driver=vfio-pci 00:04:37.289 01:05:45 -- setup/driver.sh@51 -- # [[ vfio-pci == \N\o\ \v\a\l\i\d\ \d\r\i\v\e\r\ \f\o\u\n\d ]] 00:04:37.289 01:05:45 -- setup/driver.sh@56 -- # echo 'Looking for driver=vfio-pci' 00:04:37.289 Looking for driver=vfio-pci 00:04:37.289 01:05:45 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:37.289 01:05:45 -- setup/driver.sh@45 -- # setup output config 00:04:37.289 01:05:45 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:37.289 01:05:45 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:38.666 01:05:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:38.666 01:05:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:38.666 01:05:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:38.666 01:05:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:38.666 01:05:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:38.666 01:05:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:38.666 01:05:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:38.666 01:05:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:38.666 01:05:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:38.666 01:05:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:38.666 01:05:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:38.666 01:05:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:38.666 01:05:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:38.666 01:05:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:38.666 01:05:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:38.666 01:05:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:38.666 01:05:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:38.666 01:05:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:38.666 01:05:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:38.666 01:05:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:38.666 01:05:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:38.666 01:05:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:38.666 01:05:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:38.666 01:05:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:38.666 01:05:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:38.666 01:05:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:38.666 01:05:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:38.666 01:05:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:38.666 01:05:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:38.666 01:05:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:38.666 01:05:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:38.666 01:05:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:38.666 01:05:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:38.666 01:05:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:38.666 01:05:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:38.666 01:05:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:38.666 01:05:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:38.666 01:05:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:38.666 01:05:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:38.666 01:05:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:38.666 01:05:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:38.666 01:05:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:38.666 01:05:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:38.666 01:05:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:38.666 01:05:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:38.666 01:05:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:38.666 01:05:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:38.666 01:05:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:39.233 01:05:47 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:39.233 01:05:47 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:39.233 01:05:47 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:39.493 01:05:47 -- setup/driver.sh@64 -- # (( fail == 0 )) 00:04:39.493 01:05:47 -- setup/driver.sh@65 -- # setup reset 00:04:39.493 01:05:47 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:39.493 01:05:47 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:42.026 00:04:42.026 real 0m4.788s 00:04:42.026 user 0m1.066s 00:04:42.026 sys 0m1.912s 00:04:42.026 01:05:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:42.026 01:05:50 -- common/autotest_common.sh@10 -- # set +x 00:04:42.026 ************************************ 00:04:42.026 END TEST guess_driver 00:04:42.026 ************************************ 00:04:42.026 00:04:42.026 real 0m7.381s 00:04:42.026 user 0m1.675s 00:04:42.026 sys 0m2.977s 00:04:42.026 01:05:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:42.026 01:05:50 -- common/autotest_common.sh@10 -- # set +x 00:04:42.026 ************************************ 00:04:42.026 END TEST driver 00:04:42.026 ************************************ 00:04:42.026 01:05:50 -- setup/test-setup.sh@15 -- # run_test devices /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:04:42.026 01:05:50 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:42.026 01:05:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:42.026 01:05:50 -- common/autotest_common.sh@10 -- # set +x 00:04:42.026 ************************************ 00:04:42.026 START TEST devices 00:04:42.026 ************************************ 00:04:42.026 01:05:50 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:04:42.026 * Looking for test storage... 00:04:42.026 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:42.026 01:05:50 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:42.026 01:05:50 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:42.026 01:05:50 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:42.284 01:05:50 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:42.284 01:05:50 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:42.284 01:05:50 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:42.284 01:05:50 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:42.284 01:05:50 -- scripts/common.sh@335 -- # IFS=.-: 00:04:42.284 01:05:50 -- scripts/common.sh@335 -- # read -ra ver1 00:04:42.284 01:05:50 -- scripts/common.sh@336 -- # IFS=.-: 00:04:42.284 01:05:50 -- scripts/common.sh@336 -- # read -ra ver2 00:04:42.284 01:05:50 -- scripts/common.sh@337 -- # local 'op=<' 00:04:42.284 01:05:50 -- scripts/common.sh@339 -- # ver1_l=2 00:04:42.284 01:05:50 -- scripts/common.sh@340 -- # ver2_l=1 00:04:42.284 01:05:50 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:42.284 01:05:50 -- scripts/common.sh@343 -- # case "$op" in 00:04:42.284 01:05:50 -- scripts/common.sh@344 -- # : 1 00:04:42.284 01:05:50 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:42.284 01:05:50 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:42.284 01:05:50 -- scripts/common.sh@364 -- # decimal 1 00:04:42.284 01:05:50 -- scripts/common.sh@352 -- # local d=1 00:04:42.284 01:05:50 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:42.284 01:05:50 -- scripts/common.sh@354 -- # echo 1 00:04:42.284 01:05:50 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:42.284 01:05:50 -- scripts/common.sh@365 -- # decimal 2 00:04:42.284 01:05:50 -- scripts/common.sh@352 -- # local d=2 00:04:42.284 01:05:50 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:42.284 01:05:50 -- scripts/common.sh@354 -- # echo 2 00:04:42.284 01:05:50 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:42.284 01:05:50 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:42.284 01:05:50 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:42.284 01:05:50 -- scripts/common.sh@367 -- # return 0 00:04:42.284 01:05:50 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:42.284 01:05:50 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:42.284 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:42.284 --rc genhtml_branch_coverage=1 00:04:42.284 --rc genhtml_function_coverage=1 00:04:42.284 --rc genhtml_legend=1 00:04:42.284 --rc geninfo_all_blocks=1 00:04:42.284 --rc geninfo_unexecuted_blocks=1 00:04:42.284 00:04:42.284 ' 00:04:42.284 01:05:50 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:42.284 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:42.284 --rc genhtml_branch_coverage=1 00:04:42.284 --rc genhtml_function_coverage=1 00:04:42.284 --rc genhtml_legend=1 00:04:42.284 --rc geninfo_all_blocks=1 00:04:42.284 --rc geninfo_unexecuted_blocks=1 00:04:42.284 00:04:42.284 ' 00:04:42.284 01:05:50 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:42.284 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:42.284 --rc genhtml_branch_coverage=1 00:04:42.284 --rc genhtml_function_coverage=1 00:04:42.284 --rc genhtml_legend=1 00:04:42.284 --rc geninfo_all_blocks=1 00:04:42.284 --rc geninfo_unexecuted_blocks=1 00:04:42.284 00:04:42.284 ' 00:04:42.284 01:05:50 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:42.284 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:42.284 --rc genhtml_branch_coverage=1 00:04:42.284 --rc genhtml_function_coverage=1 00:04:42.284 --rc genhtml_legend=1 00:04:42.284 --rc geninfo_all_blocks=1 00:04:42.284 --rc geninfo_unexecuted_blocks=1 00:04:42.284 00:04:42.284 ' 00:04:42.284 01:05:50 -- setup/devices.sh@190 -- # trap cleanup EXIT 00:04:42.284 01:05:50 -- setup/devices.sh@192 -- # setup reset 00:04:42.284 01:05:50 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:42.284 01:05:50 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:43.660 01:05:51 -- setup/devices.sh@194 -- # get_zoned_devs 00:04:43.660 01:05:51 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:04:43.660 01:05:51 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:04:43.660 01:05:51 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:04:43.660 01:05:51 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:04:43.660 01:05:51 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:04:43.660 01:05:51 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:04:43.660 01:05:51 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:04:43.660 01:05:51 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:04:43.660 01:05:51 -- setup/devices.sh@196 -- # blocks=() 00:04:43.660 01:05:51 -- setup/devices.sh@196 -- # declare -a blocks 00:04:43.660 01:05:51 -- setup/devices.sh@197 -- # blocks_to_pci=() 00:04:43.660 01:05:51 -- setup/devices.sh@197 -- # declare -A blocks_to_pci 00:04:43.660 01:05:51 -- setup/devices.sh@198 -- # min_disk_size=3221225472 00:04:43.660 01:05:51 -- setup/devices.sh@200 -- # for block in "/sys/block/nvme"!(*c*) 00:04:43.660 01:05:51 -- setup/devices.sh@201 -- # ctrl=nvme0n1 00:04:43.660 01:05:51 -- setup/devices.sh@201 -- # ctrl=nvme0 00:04:43.660 01:05:51 -- setup/devices.sh@202 -- # pci=0000:88:00.0 00:04:43.660 01:05:51 -- setup/devices.sh@203 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:04:43.660 01:05:51 -- setup/devices.sh@204 -- # block_in_use nvme0n1 00:04:43.660 01:05:51 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:04:43.660 01:05:51 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:04:43.660 No valid GPT data, bailing 00:04:43.660 01:05:51 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:04:43.660 01:05:51 -- scripts/common.sh@393 -- # pt= 00:04:43.660 01:05:51 -- scripts/common.sh@394 -- # return 1 00:04:43.660 01:05:51 -- setup/devices.sh@204 -- # sec_size_to_bytes nvme0n1 00:04:43.660 01:05:51 -- setup/common.sh@76 -- # local dev=nvme0n1 00:04:43.660 01:05:51 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:04:43.660 01:05:51 -- setup/common.sh@80 -- # echo 1000204886016 00:04:43.660 01:05:51 -- setup/devices.sh@204 -- # (( 1000204886016 >= min_disk_size )) 00:04:43.660 01:05:51 -- setup/devices.sh@205 -- # blocks+=("${block##*/}") 00:04:43.660 01:05:51 -- setup/devices.sh@206 -- # blocks_to_pci["${block##*/}"]=0000:88:00.0 00:04:43.660 01:05:51 -- setup/devices.sh@209 -- # (( 1 > 0 )) 00:04:43.660 01:05:51 -- setup/devices.sh@211 -- # declare -r test_disk=nvme0n1 00:04:43.660 01:05:51 -- setup/devices.sh@213 -- # run_test nvme_mount nvme_mount 00:04:43.660 01:05:51 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:43.660 01:05:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:43.660 01:05:51 -- common/autotest_common.sh@10 -- # set +x 00:04:43.660 ************************************ 00:04:43.660 START TEST nvme_mount 00:04:43.660 ************************************ 00:04:43.660 01:05:51 -- common/autotest_common.sh@1114 -- # nvme_mount 00:04:43.660 01:05:51 -- setup/devices.sh@95 -- # nvme_disk=nvme0n1 00:04:43.660 01:05:51 -- setup/devices.sh@96 -- # nvme_disk_p=nvme0n1p1 00:04:43.660 01:05:51 -- setup/devices.sh@97 -- # nvme_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:43.660 01:05:51 -- setup/devices.sh@98 -- # nvme_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:43.660 01:05:51 -- setup/devices.sh@101 -- # partition_drive nvme0n1 1 00:04:43.660 01:05:51 -- setup/common.sh@39 -- # local disk=nvme0n1 00:04:43.660 01:05:51 -- setup/common.sh@40 -- # local part_no=1 00:04:43.660 01:05:51 -- setup/common.sh@41 -- # local size=1073741824 00:04:43.660 01:05:51 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:04:43.660 01:05:51 -- setup/common.sh@44 -- # parts=() 00:04:43.660 01:05:51 -- setup/common.sh@44 -- # local parts 00:04:43.660 01:05:51 -- setup/common.sh@46 -- # (( part = 1 )) 00:04:43.660 01:05:51 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:43.660 01:05:51 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:04:43.660 01:05:51 -- setup/common.sh@46 -- # (( part++ )) 00:04:43.660 01:05:51 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:43.660 01:05:51 -- setup/common.sh@51 -- # (( size /= 512 )) 00:04:43.660 01:05:51 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:04:43.660 01:05:51 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 00:04:44.598 Creating new GPT entries in memory. 00:04:44.598 GPT data structures destroyed! You may now partition the disk using fdisk or 00:04:44.598 other utilities. 00:04:44.599 01:05:52 -- setup/common.sh@57 -- # (( part = 1 )) 00:04:44.599 01:05:52 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:44.599 01:05:52 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:04:44.599 01:05:52 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:04:44.599 01:05:52 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:04:45.974 Creating new GPT entries in memory. 00:04:45.974 The operation has completed successfully. 00:04:45.974 01:05:53 -- setup/common.sh@57 -- # (( part++ )) 00:04:45.974 01:05:53 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:45.974 01:05:53 -- setup/common.sh@62 -- # wait 1003585 00:04:45.974 01:05:53 -- setup/devices.sh@102 -- # mkfs /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:45.974 01:05:53 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1p1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size= 00:04:45.974 01:05:53 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:45.974 01:05:53 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1p1 ]] 00:04:45.974 01:05:53 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1p1 00:04:45.974 01:05:53 -- setup/common.sh@72 -- # mount /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:45.974 01:05:53 -- setup/devices.sh@105 -- # verify 0000:88:00.0 nvme0n1:nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:45.974 01:05:53 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:04:45.974 01:05:53 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1p1 00:04:45.974 01:05:53 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:45.974 01:05:53 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:45.974 01:05:53 -- setup/devices.sh@53 -- # local found=0 00:04:45.974 01:05:53 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:04:45.974 01:05:53 -- setup/devices.sh@56 -- # : 00:04:45.974 01:05:53 -- setup/devices.sh@59 -- # local pci status 00:04:45.974 01:05:53 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.974 01:05:53 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:04:45.974 01:05:53 -- setup/devices.sh@47 -- # setup output config 00:04:45.974 01:05:53 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:45.974 01:05:53 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:46.909 01:05:54 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:46.909 01:05:54 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1p1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1\p\1* ]] 00:04:46.909 01:05:54 -- setup/devices.sh@63 -- # found=1 00:04:46.909 01:05:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:46.909 01:05:54 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:46.909 01:05:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:46.909 01:05:54 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:46.909 01:05:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:46.909 01:05:54 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:46.909 01:05:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:46.909 01:05:54 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:46.909 01:05:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:46.909 01:05:54 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:46.909 01:05:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:46.909 01:05:54 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:46.909 01:05:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:46.909 01:05:54 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:46.909 01:05:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:46.909 01:05:54 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:46.909 01:05:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:46.909 01:05:54 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:46.909 01:05:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:46.909 01:05:54 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:46.909 01:05:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:46.909 01:05:54 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:46.909 01:05:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:46.909 01:05:54 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:46.909 01:05:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:46.909 01:05:54 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:46.909 01:05:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:46.909 01:05:54 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:46.909 01:05:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:46.909 01:05:54 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:46.909 01:05:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:46.909 01:05:54 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:46.909 01:05:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:47.168 01:05:55 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:47.168 01:05:55 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:04:47.168 01:05:55 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:47.168 01:05:55 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:04:47.168 01:05:55 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:47.168 01:05:55 -- setup/devices.sh@110 -- # cleanup_nvme 00:04:47.168 01:05:55 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:47.168 01:05:55 -- setup/devices.sh@21 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:47.168 01:05:55 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:47.168 01:05:55 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:04:47.168 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:04:47.168 01:05:55 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:04:47.168 01:05:55 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:04:47.426 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:04:47.426 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:04:47.426 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:04:47.426 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:04:47.427 01:05:55 -- setup/devices.sh@113 -- # mkfs /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 1024M 00:04:47.427 01:05:55 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size=1024M 00:04:47.427 01:05:55 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:47.427 01:05:55 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1 ]] 00:04:47.427 01:05:55 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1 1024M 00:04:47.427 01:05:55 -- setup/common.sh@72 -- # mount /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:47.427 01:05:55 -- setup/devices.sh@116 -- # verify 0000:88:00.0 nvme0n1:nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:47.427 01:05:55 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:04:47.427 01:05:55 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1 00:04:47.427 01:05:55 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:47.427 01:05:55 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:47.427 01:05:55 -- setup/devices.sh@53 -- # local found=0 00:04:47.427 01:05:55 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:04:47.427 01:05:55 -- setup/devices.sh@56 -- # : 00:04:47.427 01:05:55 -- setup/devices.sh@59 -- # local pci status 00:04:47.427 01:05:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:47.427 01:05:55 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:04:47.427 01:05:55 -- setup/devices.sh@47 -- # setup output config 00:04:47.427 01:05:55 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:47.427 01:05:55 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:48.363 01:05:56 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:48.363 01:05:56 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1* ]] 00:04:48.363 01:05:56 -- setup/devices.sh@63 -- # found=1 00:04:48.363 01:05:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.363 01:05:56 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:48.363 01:05:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.363 01:05:56 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:48.363 01:05:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.363 01:05:56 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:48.363 01:05:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.363 01:05:56 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:48.363 01:05:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.363 01:05:56 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:48.363 01:05:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.363 01:05:56 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:48.363 01:05:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.363 01:05:56 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:48.363 01:05:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.363 01:05:56 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:48.363 01:05:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.363 01:05:56 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:48.363 01:05:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.363 01:05:56 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:48.363 01:05:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.363 01:05:56 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:48.363 01:05:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.363 01:05:56 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:48.363 01:05:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.363 01:05:56 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:48.363 01:05:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.363 01:05:56 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:48.363 01:05:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.622 01:05:56 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:48.622 01:05:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.622 01:05:56 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:48.622 01:05:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.622 01:05:56 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:48.622 01:05:56 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:04:48.622 01:05:56 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:48.622 01:05:56 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:04:48.622 01:05:56 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:48.622 01:05:56 -- setup/devices.sh@123 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:48.622 01:05:56 -- setup/devices.sh@125 -- # verify 0000:88:00.0 data@nvme0n1 '' '' 00:04:48.622 01:05:56 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:04:48.622 01:05:56 -- setup/devices.sh@49 -- # local mounts=data@nvme0n1 00:04:48.622 01:05:56 -- setup/devices.sh@50 -- # local mount_point= 00:04:48.622 01:05:56 -- setup/devices.sh@51 -- # local test_file= 00:04:48.622 01:05:56 -- setup/devices.sh@53 -- # local found=0 00:04:48.622 01:05:56 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:04:48.622 01:05:56 -- setup/devices.sh@59 -- # local pci status 00:04:48.622 01:05:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.622 01:05:56 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:04:48.622 01:05:56 -- setup/devices.sh@47 -- # setup output config 00:04:48.622 01:05:56 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:48.622 01:05:56 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:50.001 01:05:57 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:50.001 01:05:57 -- setup/devices.sh@62 -- # [[ Active devices: data@nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\d\a\t\a\@\n\v\m\e\0\n\1* ]] 00:04:50.001 01:05:57 -- setup/devices.sh@63 -- # found=1 00:04:50.001 01:05:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:50.001 01:05:57 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:50.001 01:05:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:50.001 01:05:57 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:50.001 01:05:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:50.001 01:05:57 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:50.001 01:05:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:50.001 01:05:57 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:50.001 01:05:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:50.001 01:05:57 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:50.001 01:05:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:50.001 01:05:57 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:50.001 01:05:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:50.001 01:05:57 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:50.001 01:05:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:50.001 01:05:57 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:50.001 01:05:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:50.001 01:05:57 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:50.001 01:05:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:50.001 01:05:57 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:50.001 01:05:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:50.001 01:05:57 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:50.001 01:05:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:50.001 01:05:57 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:50.001 01:05:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:50.001 01:05:57 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:50.001 01:05:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:50.001 01:05:57 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:50.001 01:05:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:50.001 01:05:57 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:50.001 01:05:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:50.001 01:05:57 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:50.001 01:05:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:50.001 01:05:58 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:50.001 01:05:58 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:04:50.001 01:05:58 -- setup/devices.sh@68 -- # return 0 00:04:50.001 01:05:58 -- setup/devices.sh@128 -- # cleanup_nvme 00:04:50.001 01:05:58 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:50.001 01:05:58 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:50.001 01:05:58 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:04:50.001 01:05:58 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:04:50.001 /dev/nvme0n1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:04:50.001 00:04:50.001 real 0m6.339s 00:04:50.001 user 0m1.467s 00:04:50.001 sys 0m2.455s 00:04:50.001 01:05:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:50.001 01:05:58 -- common/autotest_common.sh@10 -- # set +x 00:04:50.001 ************************************ 00:04:50.001 END TEST nvme_mount 00:04:50.001 ************************************ 00:04:50.001 01:05:58 -- setup/devices.sh@214 -- # run_test dm_mount dm_mount 00:04:50.001 01:05:58 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:50.001 01:05:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:50.001 01:05:58 -- common/autotest_common.sh@10 -- # set +x 00:04:50.001 ************************************ 00:04:50.001 START TEST dm_mount 00:04:50.001 ************************************ 00:04:50.001 01:05:58 -- common/autotest_common.sh@1114 -- # dm_mount 00:04:50.001 01:05:58 -- setup/devices.sh@144 -- # pv=nvme0n1 00:04:50.001 01:05:58 -- setup/devices.sh@145 -- # pv0=nvme0n1p1 00:04:50.001 01:05:58 -- setup/devices.sh@146 -- # pv1=nvme0n1p2 00:04:50.001 01:05:58 -- setup/devices.sh@148 -- # partition_drive nvme0n1 00:04:50.001 01:05:58 -- setup/common.sh@39 -- # local disk=nvme0n1 00:04:50.001 01:05:58 -- setup/common.sh@40 -- # local part_no=2 00:04:50.001 01:05:58 -- setup/common.sh@41 -- # local size=1073741824 00:04:50.001 01:05:58 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:04:50.001 01:05:58 -- setup/common.sh@44 -- # parts=() 00:04:50.001 01:05:58 -- setup/common.sh@44 -- # local parts 00:04:50.002 01:05:58 -- setup/common.sh@46 -- # (( part = 1 )) 00:04:50.002 01:05:58 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:50.002 01:05:58 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:04:50.002 01:05:58 -- setup/common.sh@46 -- # (( part++ )) 00:04:50.002 01:05:58 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:50.002 01:05:58 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:04:50.002 01:05:58 -- setup/common.sh@46 -- # (( part++ )) 00:04:50.002 01:05:58 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:50.002 01:05:58 -- setup/common.sh@51 -- # (( size /= 512 )) 00:04:50.002 01:05:58 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:04:50.002 01:05:58 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 nvme0n1p2 00:04:50.939 Creating new GPT entries in memory. 00:04:50.939 GPT data structures destroyed! You may now partition the disk using fdisk or 00:04:50.939 other utilities. 00:04:50.939 01:05:59 -- setup/common.sh@57 -- # (( part = 1 )) 00:04:50.939 01:05:59 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:50.939 01:05:59 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:04:50.939 01:05:59 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:04:50.939 01:05:59 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:04:52.324 Creating new GPT entries in memory. 00:04:52.324 The operation has completed successfully. 00:04:52.324 01:06:00 -- setup/common.sh@57 -- # (( part++ )) 00:04:52.324 01:06:00 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:52.324 01:06:00 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:04:52.324 01:06:00 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:04:52.324 01:06:00 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=2:2099200:4196351 00:04:53.259 The operation has completed successfully. 00:04:53.259 01:06:01 -- setup/common.sh@57 -- # (( part++ )) 00:04:53.259 01:06:01 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:53.259 01:06:01 -- setup/common.sh@62 -- # wait 1006047 00:04:53.259 01:06:01 -- setup/devices.sh@150 -- # dm_name=nvme_dm_test 00:04:53.259 01:06:01 -- setup/devices.sh@151 -- # dm_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:53.259 01:06:01 -- setup/devices.sh@152 -- # dm_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:04:53.259 01:06:01 -- setup/devices.sh@155 -- # dmsetup create nvme_dm_test 00:04:53.259 01:06:01 -- setup/devices.sh@160 -- # for t in {1..5} 00:04:53.259 01:06:01 -- setup/devices.sh@161 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:04:53.259 01:06:01 -- setup/devices.sh@161 -- # break 00:04:53.259 01:06:01 -- setup/devices.sh@164 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:04:53.259 01:06:01 -- setup/devices.sh@165 -- # readlink -f /dev/mapper/nvme_dm_test 00:04:53.259 01:06:01 -- setup/devices.sh@165 -- # dm=/dev/dm-0 00:04:53.259 01:06:01 -- setup/devices.sh@166 -- # dm=dm-0 00:04:53.259 01:06:01 -- setup/devices.sh@168 -- # [[ -e /sys/class/block/nvme0n1p1/holders/dm-0 ]] 00:04:53.259 01:06:01 -- setup/devices.sh@169 -- # [[ -e /sys/class/block/nvme0n1p2/holders/dm-0 ]] 00:04:53.259 01:06:01 -- setup/devices.sh@171 -- # mkfs /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:53.259 01:06:01 -- setup/common.sh@66 -- # local dev=/dev/mapper/nvme_dm_test mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount size= 00:04:53.259 01:06:01 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:53.259 01:06:01 -- setup/common.sh@70 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:04:53.259 01:06:01 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/mapper/nvme_dm_test 00:04:53.259 01:06:01 -- setup/common.sh@72 -- # mount /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:53.259 01:06:01 -- setup/devices.sh@174 -- # verify 0000:88:00.0 nvme0n1:nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:04:53.259 01:06:01 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:04:53.259 01:06:01 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme_dm_test 00:04:53.259 01:06:01 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:53.259 01:06:01 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:04:53.259 01:06:01 -- setup/devices.sh@53 -- # local found=0 00:04:53.259 01:06:01 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:04:53.259 01:06:01 -- setup/devices.sh@56 -- # : 00:04:53.259 01:06:01 -- setup/devices.sh@59 -- # local pci status 00:04:53.259 01:06:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:53.259 01:06:01 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:04:53.259 01:06:01 -- setup/devices.sh@47 -- # setup output config 00:04:53.259 01:06:01 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:53.259 01:06:01 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:54.195 01:06:02 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:54.195 01:06:02 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0,mount@nvme0n1:nvme_dm_test, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\_\d\m\_\t\e\s\t* ]] 00:04:54.195 01:06:02 -- setup/devices.sh@63 -- # found=1 00:04:54.195 01:06:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:54.195 01:06:02 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:54.195 01:06:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:54.195 01:06:02 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:54.195 01:06:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:54.195 01:06:02 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:54.195 01:06:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:54.195 01:06:02 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:54.195 01:06:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:54.195 01:06:02 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:54.195 01:06:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:54.195 01:06:02 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:54.195 01:06:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:54.195 01:06:02 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:54.195 01:06:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:54.195 01:06:02 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:54.195 01:06:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:54.195 01:06:02 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:54.195 01:06:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:54.195 01:06:02 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:54.195 01:06:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:54.195 01:06:02 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:54.195 01:06:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:54.195 01:06:02 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:54.195 01:06:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:54.195 01:06:02 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:54.195 01:06:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:54.195 01:06:02 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:54.195 01:06:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:54.195 01:06:02 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:54.195 01:06:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:54.195 01:06:02 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:54.195 01:06:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:54.454 01:06:02 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:54.454 01:06:02 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount ]] 00:04:54.454 01:06:02 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:54.454 01:06:02 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:04:54.454 01:06:02 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:04:54.454 01:06:02 -- setup/devices.sh@182 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:54.454 01:06:02 -- setup/devices.sh@184 -- # verify 0000:88:00.0 holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 '' '' 00:04:54.454 01:06:02 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:04:54.454 01:06:02 -- setup/devices.sh@49 -- # local mounts=holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 00:04:54.454 01:06:02 -- setup/devices.sh@50 -- # local mount_point= 00:04:54.454 01:06:02 -- setup/devices.sh@51 -- # local test_file= 00:04:54.454 01:06:02 -- setup/devices.sh@53 -- # local found=0 00:04:54.454 01:06:02 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:04:54.454 01:06:02 -- setup/devices.sh@59 -- # local pci status 00:04:54.454 01:06:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:54.454 01:06:02 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:04:54.454 01:06:02 -- setup/devices.sh@47 -- # setup output config 00:04:54.454 01:06:02 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:54.454 01:06:02 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:55.830 01:06:03 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:55.831 01:06:03 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\1\:\d\m\-\0\,\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\2\:\d\m\-\0* ]] 00:04:55.831 01:06:03 -- setup/devices.sh@63 -- # found=1 00:04:55.831 01:06:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:55.831 01:06:03 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:55.831 01:06:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:55.831 01:06:03 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:55.831 01:06:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:55.831 01:06:03 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:55.831 01:06:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:55.831 01:06:03 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:55.831 01:06:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:55.831 01:06:03 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:55.831 01:06:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:55.831 01:06:03 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:55.831 01:06:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:55.831 01:06:03 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:55.831 01:06:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:55.831 01:06:03 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:55.831 01:06:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:55.831 01:06:03 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:55.831 01:06:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:55.831 01:06:03 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:55.831 01:06:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:55.831 01:06:03 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:55.831 01:06:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:55.831 01:06:03 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:55.831 01:06:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:55.831 01:06:03 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:55.831 01:06:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:55.831 01:06:03 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:55.831 01:06:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:55.831 01:06:03 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:55.831 01:06:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:55.831 01:06:03 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:55.831 01:06:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:55.831 01:06:03 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:55.831 01:06:03 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:04:55.831 01:06:03 -- setup/devices.sh@68 -- # return 0 00:04:55.831 01:06:03 -- setup/devices.sh@187 -- # cleanup_dm 00:04:55.831 01:06:03 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:55.831 01:06:03 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:04:55.831 01:06:03 -- setup/devices.sh@37 -- # dmsetup remove --force nvme_dm_test 00:04:55.831 01:06:03 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:55.831 01:06:03 -- setup/devices.sh@40 -- # wipefs --all /dev/nvme0n1p1 00:04:55.831 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:04:55.831 01:06:03 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:04:55.831 01:06:03 -- setup/devices.sh@43 -- # wipefs --all /dev/nvme0n1p2 00:04:55.831 00:04:55.831 real 0m5.802s 00:04:55.831 user 0m0.972s 00:04:55.831 sys 0m1.692s 00:04:55.831 01:06:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:55.831 01:06:03 -- common/autotest_common.sh@10 -- # set +x 00:04:55.831 ************************************ 00:04:55.831 END TEST dm_mount 00:04:55.831 ************************************ 00:04:55.831 01:06:03 -- setup/devices.sh@1 -- # cleanup 00:04:55.831 01:06:03 -- setup/devices.sh@11 -- # cleanup_nvme 00:04:55.831 01:06:03 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:55.831 01:06:03 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:55.831 01:06:03 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:04:55.831 01:06:03 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:04:55.831 01:06:03 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:04:56.089 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:04:56.089 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:04:56.089 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:04:56.089 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:04:56.089 01:06:04 -- setup/devices.sh@12 -- # cleanup_dm 00:04:56.089 01:06:04 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:56.089 01:06:04 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:04:56.089 01:06:04 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:56.089 01:06:04 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:04:56.089 01:06:04 -- setup/devices.sh@14 -- # [[ -b /dev/nvme0n1 ]] 00:04:56.089 01:06:04 -- setup/devices.sh@15 -- # wipefs --all /dev/nvme0n1 00:04:56.089 00:04:56.089 real 0m14.093s 00:04:56.089 user 0m3.184s 00:04:56.089 sys 0m5.126s 00:04:56.089 01:06:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:56.089 01:06:04 -- common/autotest_common.sh@10 -- # set +x 00:04:56.089 ************************************ 00:04:56.089 END TEST devices 00:04:56.089 ************************************ 00:04:56.089 00:04:56.089 real 0m43.947s 00:04:56.089 user 0m12.708s 00:04:56.089 sys 0m19.711s 00:04:56.089 01:06:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:56.089 01:06:04 -- common/autotest_common.sh@10 -- # set +x 00:04:56.089 ************************************ 00:04:56.089 END TEST setup.sh 00:04:56.089 ************************************ 00:04:56.089 01:06:04 -- spdk/autotest.sh@126 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:04:57.466 Hugepages 00:04:57.466 node hugesize free / total 00:04:57.466 node0 1048576kB 0 / 0 00:04:57.466 node0 2048kB 2048 / 2048 00:04:57.466 node1 1048576kB 0 / 0 00:04:57.466 node1 2048kB 0 / 0 00:04:57.466 00:04:57.466 Type BDF Vendor Device NUMA Driver Device Block devices 00:04:57.466 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:04:57.466 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:04:57.466 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:04:57.466 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:04:57.466 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:04:57.466 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:04:57.466 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:04:57.466 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:04:57.466 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:04:57.466 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:04:57.466 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:04:57.466 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:04:57.466 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:04:57.466 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:04:57.466 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:04:57.466 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:04:57.466 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:04:57.466 01:06:05 -- spdk/autotest.sh@128 -- # uname -s 00:04:57.466 01:06:05 -- spdk/autotest.sh@128 -- # [[ Linux == Linux ]] 00:04:57.466 01:06:05 -- spdk/autotest.sh@130 -- # nvme_namespace_revert 00:04:57.466 01:06:05 -- common/autotest_common.sh@1526 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:58.838 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:58.838 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:58.838 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:58.838 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:58.838 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:58.838 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:58.838 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:58.838 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:58.838 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:58.838 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:58.838 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:58.838 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:58.838 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:58.838 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:58.838 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:58.838 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:59.404 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:04:59.663 01:06:07 -- common/autotest_common.sh@1527 -- # sleep 1 00:05:00.600 01:06:08 -- common/autotest_common.sh@1528 -- # bdfs=() 00:05:00.600 01:06:08 -- common/autotest_common.sh@1528 -- # local bdfs 00:05:00.600 01:06:08 -- common/autotest_common.sh@1529 -- # bdfs=($(get_nvme_bdfs)) 00:05:00.600 01:06:08 -- common/autotest_common.sh@1529 -- # get_nvme_bdfs 00:05:00.600 01:06:08 -- common/autotest_common.sh@1508 -- # bdfs=() 00:05:00.600 01:06:08 -- common/autotest_common.sh@1508 -- # local bdfs 00:05:00.600 01:06:08 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:05:00.600 01:06:08 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:05:00.600 01:06:08 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:05:00.859 01:06:08 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:05:00.859 01:06:08 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:05:00.859 01:06:08 -- common/autotest_common.sh@1531 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:05:01.804 Waiting for block devices as requested 00:05:02.063 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:05:02.063 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:05:02.326 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:05:02.326 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:05:02.326 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:05:02.326 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:05:02.654 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:05:02.654 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:05:02.654 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:05:02.654 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:05:02.654 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:05:02.935 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:05:02.935 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:05:02.935 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:05:02.935 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:05:03.193 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:05:03.193 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:05:03.193 01:06:11 -- common/autotest_common.sh@1533 -- # for bdf in "${bdfs[@]}" 00:05:03.193 01:06:11 -- common/autotest_common.sh@1534 -- # get_nvme_ctrlr_from_bdf 0000:88:00.0 00:05:03.193 01:06:11 -- common/autotest_common.sh@1497 -- # readlink -f /sys/class/nvme/nvme0 00:05:03.193 01:06:11 -- common/autotest_common.sh@1497 -- # grep 0000:88:00.0/nvme/nvme 00:05:03.193 01:06:11 -- common/autotest_common.sh@1497 -- # bdf_sysfs_path=/sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:05:03.194 01:06:11 -- common/autotest_common.sh@1498 -- # [[ -z /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 ]] 00:05:03.194 01:06:11 -- common/autotest_common.sh@1502 -- # basename /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:05:03.194 01:06:11 -- common/autotest_common.sh@1502 -- # printf '%s\n' nvme0 00:05:03.194 01:06:11 -- common/autotest_common.sh@1534 -- # nvme_ctrlr=/dev/nvme0 00:05:03.194 01:06:11 -- common/autotest_common.sh@1535 -- # [[ -z /dev/nvme0 ]] 00:05:03.194 01:06:11 -- common/autotest_common.sh@1540 -- # nvme id-ctrl /dev/nvme0 00:05:03.194 01:06:11 -- common/autotest_common.sh@1540 -- # grep oacs 00:05:03.194 01:06:11 -- common/autotest_common.sh@1540 -- # cut -d: -f2 00:05:03.194 01:06:11 -- common/autotest_common.sh@1540 -- # oacs=' 0xf' 00:05:03.194 01:06:11 -- common/autotest_common.sh@1541 -- # oacs_ns_manage=8 00:05:03.194 01:06:11 -- common/autotest_common.sh@1543 -- # [[ 8 -ne 0 ]] 00:05:03.194 01:06:11 -- common/autotest_common.sh@1549 -- # nvme id-ctrl /dev/nvme0 00:05:03.194 01:06:11 -- common/autotest_common.sh@1549 -- # grep unvmcap 00:05:03.194 01:06:11 -- common/autotest_common.sh@1549 -- # cut -d: -f2 00:05:03.194 01:06:11 -- common/autotest_common.sh@1549 -- # unvmcap=' 0' 00:05:03.194 01:06:11 -- common/autotest_common.sh@1550 -- # [[ 0 -eq 0 ]] 00:05:03.194 01:06:11 -- common/autotest_common.sh@1552 -- # continue 00:05:03.194 01:06:11 -- spdk/autotest.sh@133 -- # timing_exit pre_cleanup 00:05:03.194 01:06:11 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:03.194 01:06:11 -- common/autotest_common.sh@10 -- # set +x 00:05:03.451 01:06:11 -- spdk/autotest.sh@136 -- # timing_enter afterboot 00:05:03.451 01:06:11 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:03.451 01:06:11 -- common/autotest_common.sh@10 -- # set +x 00:05:03.451 01:06:11 -- spdk/autotest.sh@137 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:05:04.826 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:04.826 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:04.826 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:04.826 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:04.826 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:04.826 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:04.826 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:04.826 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:04.826 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:04.826 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:04.826 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:04.826 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:04.826 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:04.826 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:04.826 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:04.826 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:05.761 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:05:05.761 01:06:13 -- spdk/autotest.sh@138 -- # timing_exit afterboot 00:05:05.761 01:06:13 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:05.761 01:06:13 -- common/autotest_common.sh@10 -- # set +x 00:05:05.761 01:06:13 -- spdk/autotest.sh@142 -- # opal_revert_cleanup 00:05:05.761 01:06:13 -- common/autotest_common.sh@1586 -- # mapfile -t bdfs 00:05:05.761 01:06:13 -- common/autotest_common.sh@1586 -- # get_nvme_bdfs_by_id 0x0a54 00:05:05.761 01:06:13 -- common/autotest_common.sh@1572 -- # bdfs=() 00:05:05.761 01:06:13 -- common/autotest_common.sh@1572 -- # local bdfs 00:05:05.761 01:06:13 -- common/autotest_common.sh@1574 -- # get_nvme_bdfs 00:05:05.761 01:06:13 -- common/autotest_common.sh@1508 -- # bdfs=() 00:05:05.761 01:06:13 -- common/autotest_common.sh@1508 -- # local bdfs 00:05:05.761 01:06:13 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:05:05.761 01:06:13 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:05:05.761 01:06:13 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:05:05.761 01:06:13 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:05:05.761 01:06:13 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:05:05.761 01:06:13 -- common/autotest_common.sh@1574 -- # for bdf in $(get_nvme_bdfs) 00:05:05.761 01:06:13 -- common/autotest_common.sh@1575 -- # cat /sys/bus/pci/devices/0000:88:00.0/device 00:05:05.761 01:06:13 -- common/autotest_common.sh@1575 -- # device=0x0a54 00:05:05.761 01:06:13 -- common/autotest_common.sh@1576 -- # [[ 0x0a54 == \0\x\0\a\5\4 ]] 00:05:05.761 01:06:13 -- common/autotest_common.sh@1577 -- # bdfs+=($bdf) 00:05:05.761 01:06:13 -- common/autotest_common.sh@1581 -- # printf '%s\n' 0000:88:00.0 00:05:05.761 01:06:13 -- common/autotest_common.sh@1587 -- # [[ -z 0000:88:00.0 ]] 00:05:05.761 01:06:13 -- common/autotest_common.sh@1592 -- # spdk_tgt_pid=1011970 00:05:05.761 01:06:13 -- common/autotest_common.sh@1591 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:05:05.761 01:06:13 -- common/autotest_common.sh@1593 -- # waitforlisten 1011970 00:05:05.761 01:06:13 -- common/autotest_common.sh@829 -- # '[' -z 1011970 ']' 00:05:05.761 01:06:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:05.761 01:06:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:05.761 01:06:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:05.761 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:05.761 01:06:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:05.761 01:06:13 -- common/autotest_common.sh@10 -- # set +x 00:05:05.761 [2024-11-20 01:06:13.968359] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:05.761 [2024-11-20 01:06:13.968448] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1011970 ] 00:05:06.020 EAL: No free 2048 kB hugepages reported on node 1 00:05:06.020 [2024-11-20 01:06:14.028733] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:06.020 [2024-11-20 01:06:14.123278] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:06.020 [2024-11-20 01:06:14.123431] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:06.954 01:06:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:06.954 01:06:14 -- common/autotest_common.sh@862 -- # return 0 00:05:06.954 01:06:14 -- common/autotest_common.sh@1595 -- # bdf_id=0 00:05:06.954 01:06:14 -- common/autotest_common.sh@1596 -- # for bdf in "${bdfs[@]}" 00:05:06.954 01:06:14 -- common/autotest_common.sh@1597 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b nvme0 -t pcie -a 0000:88:00.0 00:05:10.239 nvme0n1 00:05:10.239 01:06:18 -- common/autotest_common.sh@1599 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_opal_revert -b nvme0 -p test 00:05:10.239 [2024-11-20 01:06:18.243384] nvme_opal.c:2059:spdk_opal_cmd_revert_tper: *ERROR*: Error on starting admin SP session with error 18 00:05:10.239 [2024-11-20 01:06:18.243442] vbdev_opal_rpc.c: 134:rpc_bdev_nvme_opal_revert: *ERROR*: Revert TPer failure: 18 00:05:10.239 request: 00:05:10.239 { 00:05:10.239 "nvme_ctrlr_name": "nvme0", 00:05:10.239 "password": "test", 00:05:10.239 "method": "bdev_nvme_opal_revert", 00:05:10.239 "req_id": 1 00:05:10.239 } 00:05:10.239 Got JSON-RPC error response 00:05:10.239 response: 00:05:10.239 { 00:05:10.239 "code": -32603, 00:05:10.239 "message": "Internal error" 00:05:10.239 } 00:05:10.239 01:06:18 -- common/autotest_common.sh@1599 -- # true 00:05:10.239 01:06:18 -- common/autotest_common.sh@1600 -- # (( ++bdf_id )) 00:05:10.239 01:06:18 -- common/autotest_common.sh@1603 -- # killprocess 1011970 00:05:10.239 01:06:18 -- common/autotest_common.sh@936 -- # '[' -z 1011970 ']' 00:05:10.239 01:06:18 -- common/autotest_common.sh@940 -- # kill -0 1011970 00:05:10.239 01:06:18 -- common/autotest_common.sh@941 -- # uname 00:05:10.239 01:06:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:10.239 01:06:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1011970 00:05:10.239 01:06:18 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:10.239 01:06:18 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:10.239 01:06:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1011970' 00:05:10.239 killing process with pid 1011970 00:05:10.239 01:06:18 -- common/autotest_common.sh@955 -- # kill 1011970 00:05:10.239 01:06:18 -- common/autotest_common.sh@960 -- # wait 1011970 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.239 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:10.240 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:12.137 01:06:20 -- spdk/autotest.sh@148 -- # '[' 0 -eq 1 ']' 00:05:12.137 01:06:20 -- spdk/autotest.sh@152 -- # '[' 1 -eq 1 ']' 00:05:12.137 01:06:20 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:05:12.137 01:06:20 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:05:12.137 01:06:20 -- spdk/autotest.sh@160 -- # timing_enter lib 00:05:12.137 01:06:20 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:12.137 01:06:20 -- common/autotest_common.sh@10 -- # set +x 00:05:12.137 01:06:20 -- spdk/autotest.sh@162 -- # run_test env /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:05:12.137 01:06:20 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:12.137 01:06:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:12.137 01:06:20 -- common/autotest_common.sh@10 -- # set +x 00:05:12.137 ************************************ 00:05:12.137 START TEST env 00:05:12.137 ************************************ 00:05:12.137 01:06:20 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:05:12.137 * Looking for test storage... 00:05:12.137 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env 00:05:12.137 01:06:20 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:12.137 01:06:20 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:12.137 01:06:20 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:12.137 01:06:20 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:12.137 01:06:20 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:12.137 01:06:20 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:12.137 01:06:20 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:12.137 01:06:20 -- scripts/common.sh@335 -- # IFS=.-: 00:05:12.137 01:06:20 -- scripts/common.sh@335 -- # read -ra ver1 00:05:12.137 01:06:20 -- scripts/common.sh@336 -- # IFS=.-: 00:05:12.137 01:06:20 -- scripts/common.sh@336 -- # read -ra ver2 00:05:12.137 01:06:20 -- scripts/common.sh@337 -- # local 'op=<' 00:05:12.137 01:06:20 -- scripts/common.sh@339 -- # ver1_l=2 00:05:12.137 01:06:20 -- scripts/common.sh@340 -- # ver2_l=1 00:05:12.137 01:06:20 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:12.138 01:06:20 -- scripts/common.sh@343 -- # case "$op" in 00:05:12.138 01:06:20 -- scripts/common.sh@344 -- # : 1 00:05:12.138 01:06:20 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:12.138 01:06:20 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:12.138 01:06:20 -- scripts/common.sh@364 -- # decimal 1 00:05:12.138 01:06:20 -- scripts/common.sh@352 -- # local d=1 00:05:12.138 01:06:20 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:12.138 01:06:20 -- scripts/common.sh@354 -- # echo 1 00:05:12.138 01:06:20 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:12.138 01:06:20 -- scripts/common.sh@365 -- # decimal 2 00:05:12.138 01:06:20 -- scripts/common.sh@352 -- # local d=2 00:05:12.138 01:06:20 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:12.138 01:06:20 -- scripts/common.sh@354 -- # echo 2 00:05:12.138 01:06:20 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:12.138 01:06:20 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:12.138 01:06:20 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:12.138 01:06:20 -- scripts/common.sh@367 -- # return 0 00:05:12.138 01:06:20 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:12.138 01:06:20 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:12.138 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:12.138 --rc genhtml_branch_coverage=1 00:05:12.138 --rc genhtml_function_coverage=1 00:05:12.138 --rc genhtml_legend=1 00:05:12.138 --rc geninfo_all_blocks=1 00:05:12.138 --rc geninfo_unexecuted_blocks=1 00:05:12.138 00:05:12.138 ' 00:05:12.138 01:06:20 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:12.138 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:12.138 --rc genhtml_branch_coverage=1 00:05:12.138 --rc genhtml_function_coverage=1 00:05:12.138 --rc genhtml_legend=1 00:05:12.138 --rc geninfo_all_blocks=1 00:05:12.138 --rc geninfo_unexecuted_blocks=1 00:05:12.138 00:05:12.138 ' 00:05:12.138 01:06:20 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:12.138 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:12.138 --rc genhtml_branch_coverage=1 00:05:12.138 --rc genhtml_function_coverage=1 00:05:12.138 --rc genhtml_legend=1 00:05:12.138 --rc geninfo_all_blocks=1 00:05:12.138 --rc geninfo_unexecuted_blocks=1 00:05:12.138 00:05:12.138 ' 00:05:12.138 01:06:20 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:12.138 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:12.138 --rc genhtml_branch_coverage=1 00:05:12.138 --rc genhtml_function_coverage=1 00:05:12.138 --rc genhtml_legend=1 00:05:12.138 --rc geninfo_all_blocks=1 00:05:12.138 --rc geninfo_unexecuted_blocks=1 00:05:12.138 00:05:12.138 ' 00:05:12.138 01:06:20 -- env/env.sh@10 -- # run_test env_memory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:05:12.138 01:06:20 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:12.138 01:06:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:12.138 01:06:20 -- common/autotest_common.sh@10 -- # set +x 00:05:12.138 ************************************ 00:05:12.138 START TEST env_memory 00:05:12.138 ************************************ 00:05:12.138 01:06:20 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:05:12.138 00:05:12.138 00:05:12.138 CUnit - A unit testing framework for C - Version 2.1-3 00:05:12.138 http://cunit.sourceforge.net/ 00:05:12.138 00:05:12.138 00:05:12.138 Suite: memory 00:05:12.138 Test: alloc and free memory map ...[2024-11-20 01:06:20.242156] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:05:12.138 passed 00:05:12.138 Test: mem map translation ...[2024-11-20 01:06:20.262921] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:05:12.138 [2024-11-20 01:06:20.262945] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:05:12.138 [2024-11-20 01:06:20.262986] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 584:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:05:12.138 [2024-11-20 01:06:20.262999] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 600:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:05:12.138 passed 00:05:12.138 Test: mem map registration ...[2024-11-20 01:06:20.306775] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x200000 len=1234 00:05:12.138 [2024-11-20 01:06:20.306801] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x4d2 len=2097152 00:05:12.138 passed 00:05:12.397 Test: mem map adjacent registrations ...passed 00:05:12.397 00:05:12.397 Run Summary: Type Total Ran Passed Failed Inactive 00:05:12.397 suites 1 1 n/a 0 0 00:05:12.397 tests 4 4 4 0 0 00:05:12.397 asserts 152 152 152 0 n/a 00:05:12.397 00:05:12.397 Elapsed time = 0.149 seconds 00:05:12.397 00:05:12.397 real 0m0.157s 00:05:12.397 user 0m0.148s 00:05:12.397 sys 0m0.008s 00:05:12.397 01:06:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:12.397 01:06:20 -- common/autotest_common.sh@10 -- # set +x 00:05:12.397 ************************************ 00:05:12.397 END TEST env_memory 00:05:12.397 ************************************ 00:05:12.397 01:06:20 -- env/env.sh@11 -- # run_test env_vtophys /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:05:12.397 01:06:20 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:12.397 01:06:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:12.397 01:06:20 -- common/autotest_common.sh@10 -- # set +x 00:05:12.397 ************************************ 00:05:12.397 START TEST env_vtophys 00:05:12.397 ************************************ 00:05:12.397 01:06:20 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:05:12.397 EAL: lib.eal log level changed from notice to debug 00:05:12.397 EAL: Detected lcore 0 as core 0 on socket 0 00:05:12.397 EAL: Detected lcore 1 as core 1 on socket 0 00:05:12.397 EAL: Detected lcore 2 as core 2 on socket 0 00:05:12.397 EAL: Detected lcore 3 as core 3 on socket 0 00:05:12.397 EAL: Detected lcore 4 as core 4 on socket 0 00:05:12.397 EAL: Detected lcore 5 as core 5 on socket 0 00:05:12.397 EAL: Detected lcore 6 as core 8 on socket 0 00:05:12.397 EAL: Detected lcore 7 as core 9 on socket 0 00:05:12.397 EAL: Detected lcore 8 as core 10 on socket 0 00:05:12.397 EAL: Detected lcore 9 as core 11 on socket 0 00:05:12.397 EAL: Detected lcore 10 as core 12 on socket 0 00:05:12.397 EAL: Detected lcore 11 as core 13 on socket 0 00:05:12.397 EAL: Detected lcore 12 as core 0 on socket 1 00:05:12.397 EAL: Detected lcore 13 as core 1 on socket 1 00:05:12.397 EAL: Detected lcore 14 as core 2 on socket 1 00:05:12.397 EAL: Detected lcore 15 as core 3 on socket 1 00:05:12.397 EAL: Detected lcore 16 as core 4 on socket 1 00:05:12.397 EAL: Detected lcore 17 as core 5 on socket 1 00:05:12.397 EAL: Detected lcore 18 as core 8 on socket 1 00:05:12.397 EAL: Detected lcore 19 as core 9 on socket 1 00:05:12.397 EAL: Detected lcore 20 as core 10 on socket 1 00:05:12.397 EAL: Detected lcore 21 as core 11 on socket 1 00:05:12.397 EAL: Detected lcore 22 as core 12 on socket 1 00:05:12.397 EAL: Detected lcore 23 as core 13 on socket 1 00:05:12.397 EAL: Detected lcore 24 as core 0 on socket 0 00:05:12.397 EAL: Detected lcore 25 as core 1 on socket 0 00:05:12.397 EAL: Detected lcore 26 as core 2 on socket 0 00:05:12.397 EAL: Detected lcore 27 as core 3 on socket 0 00:05:12.397 EAL: Detected lcore 28 as core 4 on socket 0 00:05:12.397 EAL: Detected lcore 29 as core 5 on socket 0 00:05:12.397 EAL: Detected lcore 30 as core 8 on socket 0 00:05:12.397 EAL: Detected lcore 31 as core 9 on socket 0 00:05:12.397 EAL: Detected lcore 32 as core 10 on socket 0 00:05:12.397 EAL: Detected lcore 33 as core 11 on socket 0 00:05:12.397 EAL: Detected lcore 34 as core 12 on socket 0 00:05:12.397 EAL: Detected lcore 35 as core 13 on socket 0 00:05:12.397 EAL: Detected lcore 36 as core 0 on socket 1 00:05:12.397 EAL: Detected lcore 37 as core 1 on socket 1 00:05:12.397 EAL: Detected lcore 38 as core 2 on socket 1 00:05:12.397 EAL: Detected lcore 39 as core 3 on socket 1 00:05:12.397 EAL: Detected lcore 40 as core 4 on socket 1 00:05:12.397 EAL: Detected lcore 41 as core 5 on socket 1 00:05:12.397 EAL: Detected lcore 42 as core 8 on socket 1 00:05:12.397 EAL: Detected lcore 43 as core 9 on socket 1 00:05:12.397 EAL: Detected lcore 44 as core 10 on socket 1 00:05:12.397 EAL: Detected lcore 45 as core 11 on socket 1 00:05:12.397 EAL: Detected lcore 46 as core 12 on socket 1 00:05:12.397 EAL: Detected lcore 47 as core 13 on socket 1 00:05:12.397 EAL: Maximum logical cores by configuration: 128 00:05:12.397 EAL: Detected CPU lcores: 48 00:05:12.397 EAL: Detected NUMA nodes: 2 00:05:12.397 EAL: Checking presence of .so 'librte_eal.so.23.0' 00:05:12.397 EAL: Detected shared linkage of DPDK 00:05:12.397 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_pci.so.23.0 00:05:12.397 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_vdev.so.23.0 00:05:12.397 EAL: Registered [vdev] bus. 00:05:12.397 EAL: bus.vdev log level changed from disabled to notice 00:05:12.397 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_mempool_ring.so.23.0 00:05:12.397 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_net_i40e.so.23.0 00:05:12.397 EAL: pmd.net.i40e.init log level changed from disabled to notice 00:05:12.397 EAL: pmd.net.i40e.driver log level changed from disabled to notice 00:05:12.397 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_pci.so 00:05:12.397 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_vdev.so 00:05:12.397 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_mempool_ring.so 00:05:12.397 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_net_i40e.so 00:05:12.397 EAL: No shared files mode enabled, IPC will be disabled 00:05:12.397 EAL: No shared files mode enabled, IPC is disabled 00:05:12.397 EAL: Bus pci wants IOVA as 'DC' 00:05:12.397 EAL: Bus vdev wants IOVA as 'DC' 00:05:12.397 EAL: Buses did not request a specific IOVA mode. 00:05:12.397 EAL: IOMMU is available, selecting IOVA as VA mode. 00:05:12.397 EAL: Selected IOVA mode 'VA' 00:05:12.397 EAL: No free 2048 kB hugepages reported on node 1 00:05:12.397 EAL: Probing VFIO support... 00:05:12.397 EAL: IOMMU type 1 (Type 1) is supported 00:05:12.397 EAL: IOMMU type 7 (sPAPR) is not supported 00:05:12.397 EAL: IOMMU type 8 (No-IOMMU) is not supported 00:05:12.397 EAL: VFIO support initialized 00:05:12.397 EAL: Ask a virtual area of 0x2e000 bytes 00:05:12.397 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:05:12.397 EAL: Setting up physically contiguous memory... 00:05:12.397 EAL: Setting maximum number of open files to 524288 00:05:12.397 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:05:12.397 EAL: Detected memory type: socket_id:1 hugepage_sz:2097152 00:05:12.397 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:05:12.397 EAL: Ask a virtual area of 0x61000 bytes 00:05:12.397 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:05:12.397 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:12.397 EAL: Ask a virtual area of 0x400000000 bytes 00:05:12.397 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:05:12.397 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:05:12.397 EAL: Ask a virtual area of 0x61000 bytes 00:05:12.397 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:05:12.397 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:12.397 EAL: Ask a virtual area of 0x400000000 bytes 00:05:12.397 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:05:12.397 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:05:12.397 EAL: Ask a virtual area of 0x61000 bytes 00:05:12.397 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:05:12.397 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:12.397 EAL: Ask a virtual area of 0x400000000 bytes 00:05:12.397 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:05:12.397 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:05:12.397 EAL: Ask a virtual area of 0x61000 bytes 00:05:12.397 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:05:12.397 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:12.397 EAL: Ask a virtual area of 0x400000000 bytes 00:05:12.397 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:05:12.397 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:05:12.397 EAL: Creating 4 segment lists: n_segs:8192 socket_id:1 hugepage_sz:2097152 00:05:12.397 EAL: Ask a virtual area of 0x61000 bytes 00:05:12.397 EAL: Virtual area found at 0x201000800000 (size = 0x61000) 00:05:12.397 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:12.397 EAL: Ask a virtual area of 0x400000000 bytes 00:05:12.397 EAL: Virtual area found at 0x201000a00000 (size = 0x400000000) 00:05:12.397 EAL: VA reserved for memseg list at 0x201000a00000, size 400000000 00:05:12.397 EAL: Ask a virtual area of 0x61000 bytes 00:05:12.397 EAL: Virtual area found at 0x201400a00000 (size = 0x61000) 00:05:12.397 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:12.397 EAL: Ask a virtual area of 0x400000000 bytes 00:05:12.397 EAL: Virtual area found at 0x201400c00000 (size = 0x400000000) 00:05:12.397 EAL: VA reserved for memseg list at 0x201400c00000, size 400000000 00:05:12.397 EAL: Ask a virtual area of 0x61000 bytes 00:05:12.397 EAL: Virtual area found at 0x201800c00000 (size = 0x61000) 00:05:12.397 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:12.397 EAL: Ask a virtual area of 0x400000000 bytes 00:05:12.397 EAL: Virtual area found at 0x201800e00000 (size = 0x400000000) 00:05:12.397 EAL: VA reserved for memseg list at 0x201800e00000, size 400000000 00:05:12.398 EAL: Ask a virtual area of 0x61000 bytes 00:05:12.398 EAL: Virtual area found at 0x201c00e00000 (size = 0x61000) 00:05:12.398 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:12.398 EAL: Ask a virtual area of 0x400000000 bytes 00:05:12.398 EAL: Virtual area found at 0x201c01000000 (size = 0x400000000) 00:05:12.398 EAL: VA reserved for memseg list at 0x201c01000000, size 400000000 00:05:12.398 EAL: Hugepages will be freed exactly as allocated. 00:05:12.398 EAL: No shared files mode enabled, IPC is disabled 00:05:12.398 EAL: No shared files mode enabled, IPC is disabled 00:05:12.398 EAL: TSC frequency is ~2700000 KHz 00:05:12.398 EAL: Main lcore 0 is ready (tid=7fb8762e3a00;cpuset=[0]) 00:05:12.398 EAL: Trying to obtain current memory policy. 00:05:12.398 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:12.398 EAL: Restoring previous memory policy: 0 00:05:12.398 EAL: request: mp_malloc_sync 00:05:12.398 EAL: No shared files mode enabled, IPC is disabled 00:05:12.398 EAL: Heap on socket 0 was expanded by 2MB 00:05:12.398 EAL: No shared files mode enabled, IPC is disabled 00:05:12.398 EAL: No shared files mode enabled, IPC is disabled 00:05:12.398 EAL: No PCI address specified using 'addr=' in: bus=pci 00:05:12.398 EAL: Mem event callback 'spdk:(nil)' registered 00:05:12.398 00:05:12.398 00:05:12.398 CUnit - A unit testing framework for C - Version 2.1-3 00:05:12.398 http://cunit.sourceforge.net/ 00:05:12.398 00:05:12.398 00:05:12.398 Suite: components_suite 00:05:12.398 Test: vtophys_malloc_test ...passed 00:05:12.398 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:05:12.398 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:12.398 EAL: Restoring previous memory policy: 4 00:05:12.398 EAL: Calling mem event callback 'spdk:(nil)' 00:05:12.398 EAL: request: mp_malloc_sync 00:05:12.398 EAL: No shared files mode enabled, IPC is disabled 00:05:12.398 EAL: Heap on socket 0 was expanded by 4MB 00:05:12.398 EAL: Calling mem event callback 'spdk:(nil)' 00:05:12.398 EAL: request: mp_malloc_sync 00:05:12.398 EAL: No shared files mode enabled, IPC is disabled 00:05:12.398 EAL: Heap on socket 0 was shrunk by 4MB 00:05:12.398 EAL: Trying to obtain current memory policy. 00:05:12.398 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:12.398 EAL: Restoring previous memory policy: 4 00:05:12.398 EAL: Calling mem event callback 'spdk:(nil)' 00:05:12.398 EAL: request: mp_malloc_sync 00:05:12.398 EAL: No shared files mode enabled, IPC is disabled 00:05:12.398 EAL: Heap on socket 0 was expanded by 6MB 00:05:12.398 EAL: Calling mem event callback 'spdk:(nil)' 00:05:12.398 EAL: request: mp_malloc_sync 00:05:12.398 EAL: No shared files mode enabled, IPC is disabled 00:05:12.398 EAL: Heap on socket 0 was shrunk by 6MB 00:05:12.398 EAL: Trying to obtain current memory policy. 00:05:12.398 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:12.398 EAL: Restoring previous memory policy: 4 00:05:12.398 EAL: Calling mem event callback 'spdk:(nil)' 00:05:12.398 EAL: request: mp_malloc_sync 00:05:12.398 EAL: No shared files mode enabled, IPC is disabled 00:05:12.398 EAL: Heap on socket 0 was expanded by 10MB 00:05:12.398 EAL: Calling mem event callback 'spdk:(nil)' 00:05:12.398 EAL: request: mp_malloc_sync 00:05:12.398 EAL: No shared files mode enabled, IPC is disabled 00:05:12.398 EAL: Heap on socket 0 was shrunk by 10MB 00:05:12.398 EAL: Trying to obtain current memory policy. 00:05:12.398 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:12.398 EAL: Restoring previous memory policy: 4 00:05:12.398 EAL: Calling mem event callback 'spdk:(nil)' 00:05:12.398 EAL: request: mp_malloc_sync 00:05:12.398 EAL: No shared files mode enabled, IPC is disabled 00:05:12.398 EAL: Heap on socket 0 was expanded by 18MB 00:05:12.398 EAL: Calling mem event callback 'spdk:(nil)' 00:05:12.398 EAL: request: mp_malloc_sync 00:05:12.398 EAL: No shared files mode enabled, IPC is disabled 00:05:12.398 EAL: Heap on socket 0 was shrunk by 18MB 00:05:12.398 EAL: Trying to obtain current memory policy. 00:05:12.398 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:12.398 EAL: Restoring previous memory policy: 4 00:05:12.398 EAL: Calling mem event callback 'spdk:(nil)' 00:05:12.398 EAL: request: mp_malloc_sync 00:05:12.398 EAL: No shared files mode enabled, IPC is disabled 00:05:12.398 EAL: Heap on socket 0 was expanded by 34MB 00:05:12.398 EAL: Calling mem event callback 'spdk:(nil)' 00:05:12.398 EAL: request: mp_malloc_sync 00:05:12.398 EAL: No shared files mode enabled, IPC is disabled 00:05:12.398 EAL: Heap on socket 0 was shrunk by 34MB 00:05:12.398 EAL: Trying to obtain current memory policy. 00:05:12.398 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:12.398 EAL: Restoring previous memory policy: 4 00:05:12.398 EAL: Calling mem event callback 'spdk:(nil)' 00:05:12.398 EAL: request: mp_malloc_sync 00:05:12.398 EAL: No shared files mode enabled, IPC is disabled 00:05:12.398 EAL: Heap on socket 0 was expanded by 66MB 00:05:12.398 EAL: Calling mem event callback 'spdk:(nil)' 00:05:12.398 EAL: request: mp_malloc_sync 00:05:12.398 EAL: No shared files mode enabled, IPC is disabled 00:05:12.398 EAL: Heap on socket 0 was shrunk by 66MB 00:05:12.398 EAL: Trying to obtain current memory policy. 00:05:12.398 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:12.398 EAL: Restoring previous memory policy: 4 00:05:12.398 EAL: Calling mem event callback 'spdk:(nil)' 00:05:12.398 EAL: request: mp_malloc_sync 00:05:12.398 EAL: No shared files mode enabled, IPC is disabled 00:05:12.398 EAL: Heap on socket 0 was expanded by 130MB 00:05:12.398 EAL: Calling mem event callback 'spdk:(nil)' 00:05:12.656 EAL: request: mp_malloc_sync 00:05:12.656 EAL: No shared files mode enabled, IPC is disabled 00:05:12.656 EAL: Heap on socket 0 was shrunk by 130MB 00:05:12.656 EAL: Trying to obtain current memory policy. 00:05:12.656 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:12.656 EAL: Restoring previous memory policy: 4 00:05:12.656 EAL: Calling mem event callback 'spdk:(nil)' 00:05:12.656 EAL: request: mp_malloc_sync 00:05:12.656 EAL: No shared files mode enabled, IPC is disabled 00:05:12.656 EAL: Heap on socket 0 was expanded by 258MB 00:05:12.656 EAL: Calling mem event callback 'spdk:(nil)' 00:05:12.656 EAL: request: mp_malloc_sync 00:05:12.656 EAL: No shared files mode enabled, IPC is disabled 00:05:12.656 EAL: Heap on socket 0 was shrunk by 258MB 00:05:12.656 EAL: Trying to obtain current memory policy. 00:05:12.656 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:12.914 EAL: Restoring previous memory policy: 4 00:05:12.914 EAL: Calling mem event callback 'spdk:(nil)' 00:05:12.914 EAL: request: mp_malloc_sync 00:05:12.914 EAL: No shared files mode enabled, IPC is disabled 00:05:12.914 EAL: Heap on socket 0 was expanded by 514MB 00:05:12.914 EAL: Calling mem event callback 'spdk:(nil)' 00:05:13.171 EAL: request: mp_malloc_sync 00:05:13.171 EAL: No shared files mode enabled, IPC is disabled 00:05:13.171 EAL: Heap on socket 0 was shrunk by 514MB 00:05:13.171 EAL: Trying to obtain current memory policy. 00:05:13.171 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:13.429 EAL: Restoring previous memory policy: 4 00:05:13.429 EAL: Calling mem event callback 'spdk:(nil)' 00:05:13.429 EAL: request: mp_malloc_sync 00:05:13.429 EAL: No shared files mode enabled, IPC is disabled 00:05:13.429 EAL: Heap on socket 0 was expanded by 1026MB 00:05:13.709 EAL: Calling mem event callback 'spdk:(nil)' 00:05:13.710 EAL: request: mp_malloc_sync 00:05:13.710 EAL: No shared files mode enabled, IPC is disabled 00:05:13.710 EAL: Heap on socket 0 was shrunk by 1026MB 00:05:13.710 passed 00:05:13.710 00:05:13.710 Run Summary: Type Total Ran Passed Failed Inactive 00:05:13.710 suites 1 1 n/a 0 0 00:05:13.710 tests 2 2 2 0 0 00:05:13.710 asserts 497 497 497 0 n/a 00:05:13.710 00:05:13.710 Elapsed time = 1.370 seconds 00:05:13.710 EAL: Calling mem event callback 'spdk:(nil)' 00:05:13.710 EAL: request: mp_malloc_sync 00:05:13.710 EAL: No shared files mode enabled, IPC is disabled 00:05:13.710 EAL: Heap on socket 0 was shrunk by 2MB 00:05:13.710 EAL: No shared files mode enabled, IPC is disabled 00:05:13.710 EAL: No shared files mode enabled, IPC is disabled 00:05:13.710 EAL: No shared files mode enabled, IPC is disabled 00:05:13.710 00:05:13.710 real 0m1.489s 00:05:13.710 user 0m0.853s 00:05:13.710 sys 0m0.600s 00:05:13.710 01:06:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:13.710 01:06:21 -- common/autotest_common.sh@10 -- # set +x 00:05:13.710 ************************************ 00:05:13.710 END TEST env_vtophys 00:05:13.710 ************************************ 00:05:13.710 01:06:21 -- env/env.sh@12 -- # run_test env_pci /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:05:13.710 01:06:21 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:13.710 01:06:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:13.710 01:06:21 -- common/autotest_common.sh@10 -- # set +x 00:05:13.710 ************************************ 00:05:13.710 START TEST env_pci 00:05:13.710 ************************************ 00:05:13.710 01:06:21 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:05:13.710 00:05:13.710 00:05:13.710 CUnit - A unit testing framework for C - Version 2.1-3 00:05:13.710 http://cunit.sourceforge.net/ 00:05:13.710 00:05:13.710 00:05:13.710 Suite: pci 00:05:13.710 Test: pci_hook ...[2024-11-20 01:06:21.920032] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/pci.c:1040:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 1013016 has claimed it 00:05:13.974 EAL: Cannot find device (10000:00:01.0) 00:05:13.974 EAL: Failed to attach device on primary process 00:05:13.974 passed 00:05:13.974 00:05:13.974 Run Summary: Type Total Ran Passed Failed Inactive 00:05:13.974 suites 1 1 n/a 0 0 00:05:13.974 tests 1 1 1 0 0 00:05:13.974 asserts 25 25 25 0 n/a 00:05:13.974 00:05:13.974 Elapsed time = 0.021 seconds 00:05:13.974 00:05:13.974 real 0m0.034s 00:05:13.974 user 0m0.012s 00:05:13.974 sys 0m0.021s 00:05:13.974 01:06:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:13.974 01:06:21 -- common/autotest_common.sh@10 -- # set +x 00:05:13.974 ************************************ 00:05:13.974 END TEST env_pci 00:05:13.974 ************************************ 00:05:13.974 01:06:21 -- env/env.sh@14 -- # argv='-c 0x1 ' 00:05:13.974 01:06:21 -- env/env.sh@15 -- # uname 00:05:13.974 01:06:21 -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:05:13.974 01:06:21 -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:05:13.974 01:06:21 -- env/env.sh@24 -- # run_test env_dpdk_post_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:05:13.974 01:06:21 -- common/autotest_common.sh@1087 -- # '[' 5 -le 1 ']' 00:05:13.974 01:06:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:13.974 01:06:21 -- common/autotest_common.sh@10 -- # set +x 00:05:13.974 ************************************ 00:05:13.974 START TEST env_dpdk_post_init 00:05:13.974 ************************************ 00:05:13.974 01:06:21 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:05:13.974 EAL: Detected CPU lcores: 48 00:05:13.974 EAL: Detected NUMA nodes: 2 00:05:13.974 EAL: Detected shared linkage of DPDK 00:05:13.974 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:05:13.974 EAL: Selected IOVA mode 'VA' 00:05:13.974 EAL: No free 2048 kB hugepages reported on node 1 00:05:13.974 EAL: VFIO support initialized 00:05:13.974 TELEMETRY: No legacy callbacks, legacy socket not created 00:05:13.974 EAL: Using IOMMU type 1 (Type 1) 00:05:13.974 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:00:04.0 (socket 0) 00:05:13.974 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:00:04.1 (socket 0) 00:05:13.974 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:00:04.2 (socket 0) 00:05:13.974 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:00:04.3 (socket 0) 00:05:13.974 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:00:04.4 (socket 0) 00:05:13.974 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:00:04.5 (socket 0) 00:05:13.974 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:00:04.6 (socket 0) 00:05:13.974 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:00:04.7 (socket 0) 00:05:13.974 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:80:04.0 (socket 1) 00:05:14.233 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:80:04.1 (socket 1) 00:05:14.233 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:80:04.2 (socket 1) 00:05:14.233 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:80:04.3 (socket 1) 00:05:14.233 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:80:04.4 (socket 1) 00:05:14.233 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:80:04.5 (socket 1) 00:05:14.233 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:80:04.6 (socket 1) 00:05:14.233 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:80:04.7 (socket 1) 00:05:15.170 EAL: Probe PCI driver: spdk_nvme (8086:0a54) device: 0000:88:00.0 (socket 1) 00:05:18.452 EAL: Releasing PCI mapped resource for 0000:88:00.0 00:05:18.452 EAL: Calling pci_unmap_resource for 0000:88:00.0 at 0x202001040000 00:05:18.452 Starting DPDK initialization... 00:05:18.452 Starting SPDK post initialization... 00:05:18.452 SPDK NVMe probe 00:05:18.452 Attaching to 0000:88:00.0 00:05:18.452 Attached to 0000:88:00.0 00:05:18.452 Cleaning up... 00:05:18.452 00:05:18.452 real 0m4.399s 00:05:18.452 user 0m3.292s 00:05:18.452 sys 0m0.161s 00:05:18.452 01:06:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:18.452 01:06:26 -- common/autotest_common.sh@10 -- # set +x 00:05:18.452 ************************************ 00:05:18.452 END TEST env_dpdk_post_init 00:05:18.452 ************************************ 00:05:18.452 01:06:26 -- env/env.sh@26 -- # uname 00:05:18.452 01:06:26 -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:05:18.452 01:06:26 -- env/env.sh@29 -- # run_test env_mem_callbacks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:05:18.452 01:06:26 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:18.452 01:06:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:18.452 01:06:26 -- common/autotest_common.sh@10 -- # set +x 00:05:18.452 ************************************ 00:05:18.452 START TEST env_mem_callbacks 00:05:18.452 ************************************ 00:05:18.452 01:06:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:05:18.452 EAL: Detected CPU lcores: 48 00:05:18.452 EAL: Detected NUMA nodes: 2 00:05:18.452 EAL: Detected shared linkage of DPDK 00:05:18.452 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:05:18.452 EAL: Selected IOVA mode 'VA' 00:05:18.452 EAL: No free 2048 kB hugepages reported on node 1 00:05:18.452 EAL: VFIO support initialized 00:05:18.452 TELEMETRY: No legacy callbacks, legacy socket not created 00:05:18.452 00:05:18.452 00:05:18.452 CUnit - A unit testing framework for C - Version 2.1-3 00:05:18.452 http://cunit.sourceforge.net/ 00:05:18.452 00:05:18.452 00:05:18.452 Suite: memory 00:05:18.452 Test: test ... 00:05:18.452 register 0x200000200000 2097152 00:05:18.452 malloc 3145728 00:05:18.452 register 0x200000400000 4194304 00:05:18.452 buf 0x200000500000 len 3145728 PASSED 00:05:18.452 malloc 64 00:05:18.452 buf 0x2000004fff40 len 64 PASSED 00:05:18.452 malloc 4194304 00:05:18.452 register 0x200000800000 6291456 00:05:18.452 buf 0x200000a00000 len 4194304 PASSED 00:05:18.452 free 0x200000500000 3145728 00:05:18.452 free 0x2000004fff40 64 00:05:18.452 unregister 0x200000400000 4194304 PASSED 00:05:18.452 free 0x200000a00000 4194304 00:05:18.452 unregister 0x200000800000 6291456 PASSED 00:05:18.452 malloc 8388608 00:05:18.452 register 0x200000400000 10485760 00:05:18.452 buf 0x200000600000 len 8388608 PASSED 00:05:18.452 free 0x200000600000 8388608 00:05:18.452 unregister 0x200000400000 10485760 PASSED 00:05:18.452 passed 00:05:18.452 00:05:18.452 Run Summary: Type Total Ran Passed Failed Inactive 00:05:18.452 suites 1 1 n/a 0 0 00:05:18.452 tests 1 1 1 0 0 00:05:18.452 asserts 15 15 15 0 n/a 00:05:18.452 00:05:18.452 Elapsed time = 0.005 seconds 00:05:18.452 00:05:18.452 real 0m0.047s 00:05:18.452 user 0m0.009s 00:05:18.452 sys 0m0.038s 00:05:18.452 01:06:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:18.452 01:06:26 -- common/autotest_common.sh@10 -- # set +x 00:05:18.452 ************************************ 00:05:18.452 END TEST env_mem_callbacks 00:05:18.452 ************************************ 00:05:18.452 00:05:18.452 real 0m6.410s 00:05:18.452 user 0m4.468s 00:05:18.452 sys 0m0.989s 00:05:18.452 01:06:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:18.452 01:06:26 -- common/autotest_common.sh@10 -- # set +x 00:05:18.452 ************************************ 00:05:18.452 END TEST env 00:05:18.452 ************************************ 00:05:18.452 01:06:26 -- spdk/autotest.sh@163 -- # run_test rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:05:18.452 01:06:26 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:18.452 01:06:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:18.452 01:06:26 -- common/autotest_common.sh@10 -- # set +x 00:05:18.452 ************************************ 00:05:18.452 START TEST rpc 00:05:18.452 ************************************ 00:05:18.452 01:06:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:05:18.452 * Looking for test storage... 00:05:18.452 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:18.452 01:06:26 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:18.452 01:06:26 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:18.452 01:06:26 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:18.452 01:06:26 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:18.452 01:06:26 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:18.452 01:06:26 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:18.452 01:06:26 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:18.452 01:06:26 -- scripts/common.sh@335 -- # IFS=.-: 00:05:18.452 01:06:26 -- scripts/common.sh@335 -- # read -ra ver1 00:05:18.452 01:06:26 -- scripts/common.sh@336 -- # IFS=.-: 00:05:18.452 01:06:26 -- scripts/common.sh@336 -- # read -ra ver2 00:05:18.452 01:06:26 -- scripts/common.sh@337 -- # local 'op=<' 00:05:18.452 01:06:26 -- scripts/common.sh@339 -- # ver1_l=2 00:05:18.452 01:06:26 -- scripts/common.sh@340 -- # ver2_l=1 00:05:18.452 01:06:26 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:18.452 01:06:26 -- scripts/common.sh@343 -- # case "$op" in 00:05:18.452 01:06:26 -- scripts/common.sh@344 -- # : 1 00:05:18.452 01:06:26 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:18.452 01:06:26 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:18.452 01:06:26 -- scripts/common.sh@364 -- # decimal 1 00:05:18.452 01:06:26 -- scripts/common.sh@352 -- # local d=1 00:05:18.452 01:06:26 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:18.452 01:06:26 -- scripts/common.sh@354 -- # echo 1 00:05:18.452 01:06:26 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:18.452 01:06:26 -- scripts/common.sh@365 -- # decimal 2 00:05:18.452 01:06:26 -- scripts/common.sh@352 -- # local d=2 00:05:18.452 01:06:26 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:18.452 01:06:26 -- scripts/common.sh@354 -- # echo 2 00:05:18.452 01:06:26 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:18.452 01:06:26 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:18.452 01:06:26 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:18.452 01:06:26 -- scripts/common.sh@367 -- # return 0 00:05:18.452 01:06:26 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:18.452 01:06:26 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:18.453 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:18.453 --rc genhtml_branch_coverage=1 00:05:18.453 --rc genhtml_function_coverage=1 00:05:18.453 --rc genhtml_legend=1 00:05:18.453 --rc geninfo_all_blocks=1 00:05:18.453 --rc geninfo_unexecuted_blocks=1 00:05:18.453 00:05:18.453 ' 00:05:18.453 01:06:26 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:18.453 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:18.453 --rc genhtml_branch_coverage=1 00:05:18.453 --rc genhtml_function_coverage=1 00:05:18.453 --rc genhtml_legend=1 00:05:18.453 --rc geninfo_all_blocks=1 00:05:18.453 --rc geninfo_unexecuted_blocks=1 00:05:18.453 00:05:18.453 ' 00:05:18.453 01:06:26 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:18.453 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:18.453 --rc genhtml_branch_coverage=1 00:05:18.453 --rc genhtml_function_coverage=1 00:05:18.453 --rc genhtml_legend=1 00:05:18.453 --rc geninfo_all_blocks=1 00:05:18.453 --rc geninfo_unexecuted_blocks=1 00:05:18.453 00:05:18.453 ' 00:05:18.453 01:06:26 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:18.453 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:18.453 --rc genhtml_branch_coverage=1 00:05:18.453 --rc genhtml_function_coverage=1 00:05:18.453 --rc genhtml_legend=1 00:05:18.453 --rc geninfo_all_blocks=1 00:05:18.453 --rc geninfo_unexecuted_blocks=1 00:05:18.453 00:05:18.453 ' 00:05:18.453 01:06:26 -- rpc/rpc.sh@65 -- # spdk_pid=1013694 00:05:18.453 01:06:26 -- rpc/rpc.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -e bdev 00:05:18.453 01:06:26 -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:05:18.453 01:06:26 -- rpc/rpc.sh@67 -- # waitforlisten 1013694 00:05:18.453 01:06:26 -- common/autotest_common.sh@829 -- # '[' -z 1013694 ']' 00:05:18.453 01:06:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:18.453 01:06:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:18.453 01:06:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:18.453 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:18.453 01:06:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:18.453 01:06:26 -- common/autotest_common.sh@10 -- # set +x 00:05:18.711 [2024-11-20 01:06:26.690084] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:18.711 [2024-11-20 01:06:26.690182] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1013694 ] 00:05:18.711 EAL: No free 2048 kB hugepages reported on node 1 00:05:18.711 [2024-11-20 01:06:26.747987] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:18.711 [2024-11-20 01:06:26.833049] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:18.711 [2024-11-20 01:06:26.833224] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:05:18.711 [2024-11-20 01:06:26.833243] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 1013694' to capture a snapshot of events at runtime. 00:05:18.711 [2024-11-20 01:06:26.833255] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid1013694 for offline analysis/debug. 00:05:18.711 [2024-11-20 01:06:26.833291] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:19.645 01:06:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:19.645 01:06:27 -- common/autotest_common.sh@862 -- # return 0 00:05:19.645 01:06:27 -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:19.645 01:06:27 -- rpc/rpc.sh@69 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:19.645 01:06:27 -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:05:19.645 01:06:27 -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:05:19.645 01:06:27 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:19.645 01:06:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:19.645 01:06:27 -- common/autotest_common.sh@10 -- # set +x 00:05:19.645 ************************************ 00:05:19.645 START TEST rpc_integrity 00:05:19.645 ************************************ 00:05:19.645 01:06:27 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:05:19.645 01:06:27 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:05:19.645 01:06:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:19.645 01:06:27 -- common/autotest_common.sh@10 -- # set +x 00:05:19.645 01:06:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:19.645 01:06:27 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:05:19.645 01:06:27 -- rpc/rpc.sh@13 -- # jq length 00:05:19.645 01:06:27 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:05:19.645 01:06:27 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:05:19.645 01:06:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:19.645 01:06:27 -- common/autotest_common.sh@10 -- # set +x 00:05:19.645 01:06:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:19.645 01:06:27 -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:05:19.645 01:06:27 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:05:19.645 01:06:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:19.645 01:06:27 -- common/autotest_common.sh@10 -- # set +x 00:05:19.645 01:06:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:19.645 01:06:27 -- rpc/rpc.sh@16 -- # bdevs='[ 00:05:19.645 { 00:05:19.645 "name": "Malloc0", 00:05:19.645 "aliases": [ 00:05:19.645 "ef691ed5-316e-422a-8926-eabbf5f41d6c" 00:05:19.645 ], 00:05:19.645 "product_name": "Malloc disk", 00:05:19.645 "block_size": 512, 00:05:19.645 "num_blocks": 16384, 00:05:19.645 "uuid": "ef691ed5-316e-422a-8926-eabbf5f41d6c", 00:05:19.645 "assigned_rate_limits": { 00:05:19.645 "rw_ios_per_sec": 0, 00:05:19.645 "rw_mbytes_per_sec": 0, 00:05:19.645 "r_mbytes_per_sec": 0, 00:05:19.645 "w_mbytes_per_sec": 0 00:05:19.645 }, 00:05:19.645 "claimed": false, 00:05:19.645 "zoned": false, 00:05:19.645 "supported_io_types": { 00:05:19.645 "read": true, 00:05:19.645 "write": true, 00:05:19.645 "unmap": true, 00:05:19.645 "write_zeroes": true, 00:05:19.645 "flush": true, 00:05:19.645 "reset": true, 00:05:19.645 "compare": false, 00:05:19.645 "compare_and_write": false, 00:05:19.645 "abort": true, 00:05:19.645 "nvme_admin": false, 00:05:19.645 "nvme_io": false 00:05:19.645 }, 00:05:19.645 "memory_domains": [ 00:05:19.645 { 00:05:19.646 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:19.646 "dma_device_type": 2 00:05:19.646 } 00:05:19.646 ], 00:05:19.646 "driver_specific": {} 00:05:19.646 } 00:05:19.646 ]' 00:05:19.646 01:06:27 -- rpc/rpc.sh@17 -- # jq length 00:05:19.646 01:06:27 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:05:19.646 01:06:27 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:05:19.646 01:06:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:19.646 01:06:27 -- common/autotest_common.sh@10 -- # set +x 00:05:19.646 [2024-11-20 01:06:27.760405] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:05:19.646 [2024-11-20 01:06:27.760455] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:05:19.646 [2024-11-20 01:06:27.760478] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x1e43b20 00:05:19.646 [2024-11-20 01:06:27.760494] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:05:19.646 [2024-11-20 01:06:27.761944] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:05:19.646 [2024-11-20 01:06:27.761972] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:05:19.646 Passthru0 00:05:19.646 01:06:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:19.646 01:06:27 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:05:19.646 01:06:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:19.646 01:06:27 -- common/autotest_common.sh@10 -- # set +x 00:05:19.646 01:06:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:19.646 01:06:27 -- rpc/rpc.sh@20 -- # bdevs='[ 00:05:19.646 { 00:05:19.646 "name": "Malloc0", 00:05:19.646 "aliases": [ 00:05:19.646 "ef691ed5-316e-422a-8926-eabbf5f41d6c" 00:05:19.646 ], 00:05:19.646 "product_name": "Malloc disk", 00:05:19.646 "block_size": 512, 00:05:19.646 "num_blocks": 16384, 00:05:19.646 "uuid": "ef691ed5-316e-422a-8926-eabbf5f41d6c", 00:05:19.646 "assigned_rate_limits": { 00:05:19.646 "rw_ios_per_sec": 0, 00:05:19.646 "rw_mbytes_per_sec": 0, 00:05:19.646 "r_mbytes_per_sec": 0, 00:05:19.646 "w_mbytes_per_sec": 0 00:05:19.646 }, 00:05:19.646 "claimed": true, 00:05:19.646 "claim_type": "exclusive_write", 00:05:19.646 "zoned": false, 00:05:19.646 "supported_io_types": { 00:05:19.646 "read": true, 00:05:19.646 "write": true, 00:05:19.646 "unmap": true, 00:05:19.646 "write_zeroes": true, 00:05:19.646 "flush": true, 00:05:19.646 "reset": true, 00:05:19.646 "compare": false, 00:05:19.646 "compare_and_write": false, 00:05:19.646 "abort": true, 00:05:19.646 "nvme_admin": false, 00:05:19.646 "nvme_io": false 00:05:19.646 }, 00:05:19.646 "memory_domains": [ 00:05:19.646 { 00:05:19.646 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:19.646 "dma_device_type": 2 00:05:19.646 } 00:05:19.646 ], 00:05:19.646 "driver_specific": {} 00:05:19.646 }, 00:05:19.646 { 00:05:19.646 "name": "Passthru0", 00:05:19.646 "aliases": [ 00:05:19.646 "10768ab7-e619-5f11-b199-dde6152753fb" 00:05:19.646 ], 00:05:19.646 "product_name": "passthru", 00:05:19.646 "block_size": 512, 00:05:19.646 "num_blocks": 16384, 00:05:19.646 "uuid": "10768ab7-e619-5f11-b199-dde6152753fb", 00:05:19.646 "assigned_rate_limits": { 00:05:19.646 "rw_ios_per_sec": 0, 00:05:19.646 "rw_mbytes_per_sec": 0, 00:05:19.646 "r_mbytes_per_sec": 0, 00:05:19.646 "w_mbytes_per_sec": 0 00:05:19.646 }, 00:05:19.646 "claimed": false, 00:05:19.646 "zoned": false, 00:05:19.646 "supported_io_types": { 00:05:19.646 "read": true, 00:05:19.646 "write": true, 00:05:19.646 "unmap": true, 00:05:19.646 "write_zeroes": true, 00:05:19.646 "flush": true, 00:05:19.646 "reset": true, 00:05:19.646 "compare": false, 00:05:19.646 "compare_and_write": false, 00:05:19.646 "abort": true, 00:05:19.646 "nvme_admin": false, 00:05:19.646 "nvme_io": false 00:05:19.646 }, 00:05:19.646 "memory_domains": [ 00:05:19.646 { 00:05:19.646 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:19.646 "dma_device_type": 2 00:05:19.646 } 00:05:19.646 ], 00:05:19.646 "driver_specific": { 00:05:19.646 "passthru": { 00:05:19.646 "name": "Passthru0", 00:05:19.646 "base_bdev_name": "Malloc0" 00:05:19.646 } 00:05:19.646 } 00:05:19.646 } 00:05:19.646 ]' 00:05:19.646 01:06:27 -- rpc/rpc.sh@21 -- # jq length 00:05:19.646 01:06:27 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:05:19.646 01:06:27 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:05:19.646 01:06:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:19.646 01:06:27 -- common/autotest_common.sh@10 -- # set +x 00:05:19.646 01:06:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:19.646 01:06:27 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:05:19.646 01:06:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:19.646 01:06:27 -- common/autotest_common.sh@10 -- # set +x 00:05:19.646 01:06:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:19.646 01:06:27 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:05:19.646 01:06:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:19.646 01:06:27 -- common/autotest_common.sh@10 -- # set +x 00:05:19.646 01:06:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:19.646 01:06:27 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:05:19.646 01:06:27 -- rpc/rpc.sh@26 -- # jq length 00:05:19.904 01:06:27 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:05:19.904 00:05:19.904 real 0m0.229s 00:05:19.904 user 0m0.149s 00:05:19.904 sys 0m0.020s 00:05:19.904 01:06:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:19.904 01:06:27 -- common/autotest_common.sh@10 -- # set +x 00:05:19.904 ************************************ 00:05:19.904 END TEST rpc_integrity 00:05:19.904 ************************************ 00:05:19.904 01:06:27 -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:05:19.904 01:06:27 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:19.904 01:06:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:19.904 01:06:27 -- common/autotest_common.sh@10 -- # set +x 00:05:19.904 ************************************ 00:05:19.904 START TEST rpc_plugins 00:05:19.904 ************************************ 00:05:19.904 01:06:27 -- common/autotest_common.sh@1114 -- # rpc_plugins 00:05:19.904 01:06:27 -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:05:19.904 01:06:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:19.904 01:06:27 -- common/autotest_common.sh@10 -- # set +x 00:05:19.904 01:06:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:19.904 01:06:27 -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:05:19.904 01:06:27 -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:05:19.904 01:06:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:19.904 01:06:27 -- common/autotest_common.sh@10 -- # set +x 00:05:19.904 01:06:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:19.904 01:06:27 -- rpc/rpc.sh@31 -- # bdevs='[ 00:05:19.904 { 00:05:19.904 "name": "Malloc1", 00:05:19.904 "aliases": [ 00:05:19.904 "50719bba-3909-491c-a783-ccf29ccfa9fd" 00:05:19.904 ], 00:05:19.904 "product_name": "Malloc disk", 00:05:19.904 "block_size": 4096, 00:05:19.904 "num_blocks": 256, 00:05:19.904 "uuid": "50719bba-3909-491c-a783-ccf29ccfa9fd", 00:05:19.904 "assigned_rate_limits": { 00:05:19.904 "rw_ios_per_sec": 0, 00:05:19.904 "rw_mbytes_per_sec": 0, 00:05:19.904 "r_mbytes_per_sec": 0, 00:05:19.904 "w_mbytes_per_sec": 0 00:05:19.904 }, 00:05:19.904 "claimed": false, 00:05:19.904 "zoned": false, 00:05:19.904 "supported_io_types": { 00:05:19.904 "read": true, 00:05:19.904 "write": true, 00:05:19.904 "unmap": true, 00:05:19.904 "write_zeroes": true, 00:05:19.904 "flush": true, 00:05:19.904 "reset": true, 00:05:19.904 "compare": false, 00:05:19.904 "compare_and_write": false, 00:05:19.904 "abort": true, 00:05:19.904 "nvme_admin": false, 00:05:19.904 "nvme_io": false 00:05:19.904 }, 00:05:19.904 "memory_domains": [ 00:05:19.904 { 00:05:19.904 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:19.904 "dma_device_type": 2 00:05:19.904 } 00:05:19.904 ], 00:05:19.904 "driver_specific": {} 00:05:19.904 } 00:05:19.904 ]' 00:05:19.904 01:06:27 -- rpc/rpc.sh@32 -- # jq length 00:05:19.904 01:06:27 -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:05:19.904 01:06:27 -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:05:19.904 01:06:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:19.904 01:06:27 -- common/autotest_common.sh@10 -- # set +x 00:05:19.904 01:06:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:19.904 01:06:27 -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:05:19.904 01:06:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:19.904 01:06:27 -- common/autotest_common.sh@10 -- # set +x 00:05:19.904 01:06:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:19.904 01:06:27 -- rpc/rpc.sh@35 -- # bdevs='[]' 00:05:19.904 01:06:27 -- rpc/rpc.sh@36 -- # jq length 00:05:19.904 01:06:28 -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:05:19.904 00:05:19.904 real 0m0.113s 00:05:19.904 user 0m0.073s 00:05:19.904 sys 0m0.011s 00:05:19.904 01:06:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:19.904 01:06:28 -- common/autotest_common.sh@10 -- # set +x 00:05:19.904 ************************************ 00:05:19.904 END TEST rpc_plugins 00:05:19.904 ************************************ 00:05:19.904 01:06:28 -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:05:19.904 01:06:28 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:19.904 01:06:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:19.904 01:06:28 -- common/autotest_common.sh@10 -- # set +x 00:05:19.904 ************************************ 00:05:19.904 START TEST rpc_trace_cmd_test 00:05:19.905 ************************************ 00:05:19.905 01:06:28 -- common/autotest_common.sh@1114 -- # rpc_trace_cmd_test 00:05:19.905 01:06:28 -- rpc/rpc.sh@40 -- # local info 00:05:19.905 01:06:28 -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:05:19.905 01:06:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:19.905 01:06:28 -- common/autotest_common.sh@10 -- # set +x 00:05:19.905 01:06:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:19.905 01:06:28 -- rpc/rpc.sh@42 -- # info='{ 00:05:19.905 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid1013694", 00:05:19.905 "tpoint_group_mask": "0x8", 00:05:19.905 "iscsi_conn": { 00:05:19.905 "mask": "0x2", 00:05:19.905 "tpoint_mask": "0x0" 00:05:19.905 }, 00:05:19.905 "scsi": { 00:05:19.905 "mask": "0x4", 00:05:19.905 "tpoint_mask": "0x0" 00:05:19.905 }, 00:05:19.905 "bdev": { 00:05:19.905 "mask": "0x8", 00:05:19.905 "tpoint_mask": "0xffffffffffffffff" 00:05:19.905 }, 00:05:19.905 "nvmf_rdma": { 00:05:19.905 "mask": "0x10", 00:05:19.905 "tpoint_mask": "0x0" 00:05:19.905 }, 00:05:19.905 "nvmf_tcp": { 00:05:19.905 "mask": "0x20", 00:05:19.905 "tpoint_mask": "0x0" 00:05:19.905 }, 00:05:19.905 "ftl": { 00:05:19.905 "mask": "0x40", 00:05:19.905 "tpoint_mask": "0x0" 00:05:19.905 }, 00:05:19.905 "blobfs": { 00:05:19.905 "mask": "0x80", 00:05:19.905 "tpoint_mask": "0x0" 00:05:19.905 }, 00:05:19.905 "dsa": { 00:05:19.905 "mask": "0x200", 00:05:19.905 "tpoint_mask": "0x0" 00:05:19.905 }, 00:05:19.905 "thread": { 00:05:19.905 "mask": "0x400", 00:05:19.905 "tpoint_mask": "0x0" 00:05:19.905 }, 00:05:19.905 "nvme_pcie": { 00:05:19.905 "mask": "0x800", 00:05:19.905 "tpoint_mask": "0x0" 00:05:19.905 }, 00:05:19.905 "iaa": { 00:05:19.905 "mask": "0x1000", 00:05:19.905 "tpoint_mask": "0x0" 00:05:19.905 }, 00:05:19.905 "nvme_tcp": { 00:05:19.905 "mask": "0x2000", 00:05:19.905 "tpoint_mask": "0x0" 00:05:19.905 }, 00:05:19.905 "bdev_nvme": { 00:05:19.905 "mask": "0x4000", 00:05:19.905 "tpoint_mask": "0x0" 00:05:19.905 } 00:05:19.905 }' 00:05:19.905 01:06:28 -- rpc/rpc.sh@43 -- # jq length 00:05:19.905 01:06:28 -- rpc/rpc.sh@43 -- # '[' 15 -gt 2 ']' 00:05:19.905 01:06:28 -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:05:20.162 01:06:28 -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:05:20.162 01:06:28 -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:05:20.162 01:06:28 -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:05:20.162 01:06:28 -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:05:20.162 01:06:28 -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:05:20.162 01:06:28 -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:05:20.162 01:06:28 -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:05:20.162 00:05:20.162 real 0m0.194s 00:05:20.163 user 0m0.170s 00:05:20.163 sys 0m0.017s 00:05:20.163 01:06:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:20.163 01:06:28 -- common/autotest_common.sh@10 -- # set +x 00:05:20.163 ************************************ 00:05:20.163 END TEST rpc_trace_cmd_test 00:05:20.163 ************************************ 00:05:20.163 01:06:28 -- rpc/rpc.sh@76 -- # [[ 0 -eq 1 ]] 00:05:20.163 01:06:28 -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:05:20.163 01:06:28 -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:05:20.163 01:06:28 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:20.163 01:06:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:20.163 01:06:28 -- common/autotest_common.sh@10 -- # set +x 00:05:20.163 ************************************ 00:05:20.163 START TEST rpc_daemon_integrity 00:05:20.163 ************************************ 00:05:20.163 01:06:28 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:05:20.163 01:06:28 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:05:20.163 01:06:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:20.163 01:06:28 -- common/autotest_common.sh@10 -- # set +x 00:05:20.163 01:06:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:20.163 01:06:28 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:05:20.163 01:06:28 -- rpc/rpc.sh@13 -- # jq length 00:05:20.163 01:06:28 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:05:20.163 01:06:28 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:05:20.163 01:06:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:20.163 01:06:28 -- common/autotest_common.sh@10 -- # set +x 00:05:20.163 01:06:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:20.163 01:06:28 -- rpc/rpc.sh@15 -- # malloc=Malloc2 00:05:20.163 01:06:28 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:05:20.163 01:06:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:20.163 01:06:28 -- common/autotest_common.sh@10 -- # set +x 00:05:20.163 01:06:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:20.163 01:06:28 -- rpc/rpc.sh@16 -- # bdevs='[ 00:05:20.163 { 00:05:20.163 "name": "Malloc2", 00:05:20.163 "aliases": [ 00:05:20.163 "9d632a0b-cfce-427c-b192-b62daa1e87ba" 00:05:20.163 ], 00:05:20.163 "product_name": "Malloc disk", 00:05:20.163 "block_size": 512, 00:05:20.163 "num_blocks": 16384, 00:05:20.163 "uuid": "9d632a0b-cfce-427c-b192-b62daa1e87ba", 00:05:20.163 "assigned_rate_limits": { 00:05:20.163 "rw_ios_per_sec": 0, 00:05:20.163 "rw_mbytes_per_sec": 0, 00:05:20.163 "r_mbytes_per_sec": 0, 00:05:20.163 "w_mbytes_per_sec": 0 00:05:20.163 }, 00:05:20.163 "claimed": false, 00:05:20.163 "zoned": false, 00:05:20.163 "supported_io_types": { 00:05:20.163 "read": true, 00:05:20.163 "write": true, 00:05:20.163 "unmap": true, 00:05:20.163 "write_zeroes": true, 00:05:20.163 "flush": true, 00:05:20.163 "reset": true, 00:05:20.163 "compare": false, 00:05:20.163 "compare_and_write": false, 00:05:20.163 "abort": true, 00:05:20.163 "nvme_admin": false, 00:05:20.163 "nvme_io": false 00:05:20.163 }, 00:05:20.163 "memory_domains": [ 00:05:20.163 { 00:05:20.163 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:20.163 "dma_device_type": 2 00:05:20.163 } 00:05:20.163 ], 00:05:20.163 "driver_specific": {} 00:05:20.163 } 00:05:20.163 ]' 00:05:20.163 01:06:28 -- rpc/rpc.sh@17 -- # jq length 00:05:20.163 01:06:28 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:05:20.163 01:06:28 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc2 -p Passthru0 00:05:20.163 01:06:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:20.163 01:06:28 -- common/autotest_common.sh@10 -- # set +x 00:05:20.163 [2024-11-20 01:06:28.374162] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc2 00:05:20.163 [2024-11-20 01:06:28.374205] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:05:20.163 [2024-11-20 01:06:28.374230] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x1e42ec0 00:05:20.163 [2024-11-20 01:06:28.374244] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:05:20.163 [2024-11-20 01:06:28.375586] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:05:20.163 [2024-11-20 01:06:28.375614] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:05:20.163 Passthru0 00:05:20.163 01:06:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:20.163 01:06:28 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:05:20.420 01:06:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:20.420 01:06:28 -- common/autotest_common.sh@10 -- # set +x 00:05:20.420 01:06:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:20.420 01:06:28 -- rpc/rpc.sh@20 -- # bdevs='[ 00:05:20.420 { 00:05:20.420 "name": "Malloc2", 00:05:20.420 "aliases": [ 00:05:20.420 "9d632a0b-cfce-427c-b192-b62daa1e87ba" 00:05:20.420 ], 00:05:20.420 "product_name": "Malloc disk", 00:05:20.420 "block_size": 512, 00:05:20.420 "num_blocks": 16384, 00:05:20.420 "uuid": "9d632a0b-cfce-427c-b192-b62daa1e87ba", 00:05:20.420 "assigned_rate_limits": { 00:05:20.420 "rw_ios_per_sec": 0, 00:05:20.420 "rw_mbytes_per_sec": 0, 00:05:20.420 "r_mbytes_per_sec": 0, 00:05:20.420 "w_mbytes_per_sec": 0 00:05:20.420 }, 00:05:20.420 "claimed": true, 00:05:20.420 "claim_type": "exclusive_write", 00:05:20.420 "zoned": false, 00:05:20.420 "supported_io_types": { 00:05:20.420 "read": true, 00:05:20.420 "write": true, 00:05:20.420 "unmap": true, 00:05:20.420 "write_zeroes": true, 00:05:20.420 "flush": true, 00:05:20.420 "reset": true, 00:05:20.420 "compare": false, 00:05:20.420 "compare_and_write": false, 00:05:20.420 "abort": true, 00:05:20.420 "nvme_admin": false, 00:05:20.420 "nvme_io": false 00:05:20.420 }, 00:05:20.420 "memory_domains": [ 00:05:20.420 { 00:05:20.420 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:20.420 "dma_device_type": 2 00:05:20.420 } 00:05:20.420 ], 00:05:20.420 "driver_specific": {} 00:05:20.420 }, 00:05:20.420 { 00:05:20.420 "name": "Passthru0", 00:05:20.420 "aliases": [ 00:05:20.420 "82a38a44-c54a-580d-b755-679992323f17" 00:05:20.420 ], 00:05:20.420 "product_name": "passthru", 00:05:20.420 "block_size": 512, 00:05:20.420 "num_blocks": 16384, 00:05:20.420 "uuid": "82a38a44-c54a-580d-b755-679992323f17", 00:05:20.420 "assigned_rate_limits": { 00:05:20.420 "rw_ios_per_sec": 0, 00:05:20.420 "rw_mbytes_per_sec": 0, 00:05:20.420 "r_mbytes_per_sec": 0, 00:05:20.420 "w_mbytes_per_sec": 0 00:05:20.420 }, 00:05:20.420 "claimed": false, 00:05:20.420 "zoned": false, 00:05:20.420 "supported_io_types": { 00:05:20.420 "read": true, 00:05:20.420 "write": true, 00:05:20.420 "unmap": true, 00:05:20.420 "write_zeroes": true, 00:05:20.420 "flush": true, 00:05:20.420 "reset": true, 00:05:20.420 "compare": false, 00:05:20.420 "compare_and_write": false, 00:05:20.420 "abort": true, 00:05:20.420 "nvme_admin": false, 00:05:20.420 "nvme_io": false 00:05:20.420 }, 00:05:20.420 "memory_domains": [ 00:05:20.420 { 00:05:20.420 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:20.420 "dma_device_type": 2 00:05:20.420 } 00:05:20.420 ], 00:05:20.420 "driver_specific": { 00:05:20.420 "passthru": { 00:05:20.420 "name": "Passthru0", 00:05:20.420 "base_bdev_name": "Malloc2" 00:05:20.420 } 00:05:20.420 } 00:05:20.420 } 00:05:20.420 ]' 00:05:20.420 01:06:28 -- rpc/rpc.sh@21 -- # jq length 00:05:20.420 01:06:28 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:05:20.420 01:06:28 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:05:20.420 01:06:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:20.420 01:06:28 -- common/autotest_common.sh@10 -- # set +x 00:05:20.420 01:06:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:20.420 01:06:28 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc2 00:05:20.420 01:06:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:20.420 01:06:28 -- common/autotest_common.sh@10 -- # set +x 00:05:20.420 01:06:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:20.420 01:06:28 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:05:20.420 01:06:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:20.420 01:06:28 -- common/autotest_common.sh@10 -- # set +x 00:05:20.420 01:06:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:20.420 01:06:28 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:05:20.420 01:06:28 -- rpc/rpc.sh@26 -- # jq length 00:05:20.420 01:06:28 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:05:20.420 00:05:20.420 real 0m0.221s 00:05:20.420 user 0m0.136s 00:05:20.420 sys 0m0.028s 00:05:20.420 01:06:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:20.420 01:06:28 -- common/autotest_common.sh@10 -- # set +x 00:05:20.420 ************************************ 00:05:20.420 END TEST rpc_daemon_integrity 00:05:20.420 ************************************ 00:05:20.420 01:06:28 -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:05:20.420 01:06:28 -- rpc/rpc.sh@84 -- # killprocess 1013694 00:05:20.420 01:06:28 -- common/autotest_common.sh@936 -- # '[' -z 1013694 ']' 00:05:20.420 01:06:28 -- common/autotest_common.sh@940 -- # kill -0 1013694 00:05:20.420 01:06:28 -- common/autotest_common.sh@941 -- # uname 00:05:20.420 01:06:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:20.420 01:06:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1013694 00:05:20.420 01:06:28 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:20.420 01:06:28 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:20.420 01:06:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1013694' 00:05:20.420 killing process with pid 1013694 00:05:20.420 01:06:28 -- common/autotest_common.sh@955 -- # kill 1013694 00:05:20.420 01:06:28 -- common/autotest_common.sh@960 -- # wait 1013694 00:05:20.984 00:05:20.984 real 0m2.450s 00:05:20.984 user 0m3.093s 00:05:20.984 sys 0m0.607s 00:05:20.984 01:06:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:20.984 01:06:28 -- common/autotest_common.sh@10 -- # set +x 00:05:20.984 ************************************ 00:05:20.984 END TEST rpc 00:05:20.984 ************************************ 00:05:20.984 01:06:28 -- spdk/autotest.sh@164 -- # run_test rpc_client /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:05:20.984 01:06:28 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:20.984 01:06:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:20.984 01:06:28 -- common/autotest_common.sh@10 -- # set +x 00:05:20.984 ************************************ 00:05:20.984 START TEST rpc_client 00:05:20.984 ************************************ 00:05:20.984 01:06:28 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:05:20.984 * Looking for test storage... 00:05:20.984 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client 00:05:20.984 01:06:29 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:20.984 01:06:29 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:20.984 01:06:29 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:20.984 01:06:29 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:20.984 01:06:29 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:20.984 01:06:29 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:20.984 01:06:29 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:20.984 01:06:29 -- scripts/common.sh@335 -- # IFS=.-: 00:05:20.984 01:06:29 -- scripts/common.sh@335 -- # read -ra ver1 00:05:20.984 01:06:29 -- scripts/common.sh@336 -- # IFS=.-: 00:05:20.984 01:06:29 -- scripts/common.sh@336 -- # read -ra ver2 00:05:20.984 01:06:29 -- scripts/common.sh@337 -- # local 'op=<' 00:05:20.984 01:06:29 -- scripts/common.sh@339 -- # ver1_l=2 00:05:20.984 01:06:29 -- scripts/common.sh@340 -- # ver2_l=1 00:05:20.984 01:06:29 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:20.984 01:06:29 -- scripts/common.sh@343 -- # case "$op" in 00:05:20.984 01:06:29 -- scripts/common.sh@344 -- # : 1 00:05:20.984 01:06:29 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:20.984 01:06:29 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:20.984 01:06:29 -- scripts/common.sh@364 -- # decimal 1 00:05:20.984 01:06:29 -- scripts/common.sh@352 -- # local d=1 00:05:20.984 01:06:29 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:20.984 01:06:29 -- scripts/common.sh@354 -- # echo 1 00:05:20.984 01:06:29 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:20.984 01:06:29 -- scripts/common.sh@365 -- # decimal 2 00:05:20.984 01:06:29 -- scripts/common.sh@352 -- # local d=2 00:05:20.984 01:06:29 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:20.984 01:06:29 -- scripts/common.sh@354 -- # echo 2 00:05:20.984 01:06:29 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:20.984 01:06:29 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:20.984 01:06:29 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:20.984 01:06:29 -- scripts/common.sh@367 -- # return 0 00:05:20.984 01:06:29 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:20.984 01:06:29 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:20.984 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:20.984 --rc genhtml_branch_coverage=1 00:05:20.984 --rc genhtml_function_coverage=1 00:05:20.984 --rc genhtml_legend=1 00:05:20.984 --rc geninfo_all_blocks=1 00:05:20.984 --rc geninfo_unexecuted_blocks=1 00:05:20.984 00:05:20.985 ' 00:05:20.985 01:06:29 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:20.985 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:20.985 --rc genhtml_branch_coverage=1 00:05:20.985 --rc genhtml_function_coverage=1 00:05:20.985 --rc genhtml_legend=1 00:05:20.985 --rc geninfo_all_blocks=1 00:05:20.985 --rc geninfo_unexecuted_blocks=1 00:05:20.985 00:05:20.985 ' 00:05:20.985 01:06:29 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:20.985 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:20.985 --rc genhtml_branch_coverage=1 00:05:20.985 --rc genhtml_function_coverage=1 00:05:20.985 --rc genhtml_legend=1 00:05:20.985 --rc geninfo_all_blocks=1 00:05:20.985 --rc geninfo_unexecuted_blocks=1 00:05:20.985 00:05:20.985 ' 00:05:20.985 01:06:29 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:20.985 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:20.985 --rc genhtml_branch_coverage=1 00:05:20.985 --rc genhtml_function_coverage=1 00:05:20.985 --rc genhtml_legend=1 00:05:20.985 --rc geninfo_all_blocks=1 00:05:20.985 --rc geninfo_unexecuted_blocks=1 00:05:20.985 00:05:20.985 ' 00:05:20.985 01:06:29 -- rpc_client/rpc_client.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client_test 00:05:20.985 OK 00:05:20.985 01:06:29 -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:05:20.985 00:05:20.985 real 0m0.156s 00:05:20.985 user 0m0.107s 00:05:20.985 sys 0m0.059s 00:05:20.985 01:06:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:20.985 01:06:29 -- common/autotest_common.sh@10 -- # set +x 00:05:20.985 ************************************ 00:05:20.985 END TEST rpc_client 00:05:20.985 ************************************ 00:05:20.985 01:06:29 -- spdk/autotest.sh@165 -- # run_test json_config /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:05:20.985 01:06:29 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:20.985 01:06:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:20.985 01:06:29 -- common/autotest_common.sh@10 -- # set +x 00:05:20.985 ************************************ 00:05:20.985 START TEST json_config 00:05:20.985 ************************************ 00:05:20.985 01:06:29 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:05:20.985 01:06:29 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:20.985 01:06:29 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:20.985 01:06:29 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:21.243 01:06:29 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:21.243 01:06:29 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:21.243 01:06:29 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:21.243 01:06:29 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:21.243 01:06:29 -- scripts/common.sh@335 -- # IFS=.-: 00:05:21.243 01:06:29 -- scripts/common.sh@335 -- # read -ra ver1 00:05:21.243 01:06:29 -- scripts/common.sh@336 -- # IFS=.-: 00:05:21.243 01:06:29 -- scripts/common.sh@336 -- # read -ra ver2 00:05:21.243 01:06:29 -- scripts/common.sh@337 -- # local 'op=<' 00:05:21.243 01:06:29 -- scripts/common.sh@339 -- # ver1_l=2 00:05:21.243 01:06:29 -- scripts/common.sh@340 -- # ver2_l=1 00:05:21.243 01:06:29 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:21.243 01:06:29 -- scripts/common.sh@343 -- # case "$op" in 00:05:21.243 01:06:29 -- scripts/common.sh@344 -- # : 1 00:05:21.243 01:06:29 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:21.243 01:06:29 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:21.243 01:06:29 -- scripts/common.sh@364 -- # decimal 1 00:05:21.243 01:06:29 -- scripts/common.sh@352 -- # local d=1 00:05:21.243 01:06:29 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:21.243 01:06:29 -- scripts/common.sh@354 -- # echo 1 00:05:21.243 01:06:29 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:21.243 01:06:29 -- scripts/common.sh@365 -- # decimal 2 00:05:21.243 01:06:29 -- scripts/common.sh@352 -- # local d=2 00:05:21.243 01:06:29 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:21.243 01:06:29 -- scripts/common.sh@354 -- # echo 2 00:05:21.243 01:06:29 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:21.243 01:06:29 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:21.243 01:06:29 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:21.243 01:06:29 -- scripts/common.sh@367 -- # return 0 00:05:21.243 01:06:29 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:21.243 01:06:29 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:21.243 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:21.243 --rc genhtml_branch_coverage=1 00:05:21.243 --rc genhtml_function_coverage=1 00:05:21.243 --rc genhtml_legend=1 00:05:21.243 --rc geninfo_all_blocks=1 00:05:21.243 --rc geninfo_unexecuted_blocks=1 00:05:21.243 00:05:21.243 ' 00:05:21.243 01:06:29 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:21.243 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:21.243 --rc genhtml_branch_coverage=1 00:05:21.243 --rc genhtml_function_coverage=1 00:05:21.243 --rc genhtml_legend=1 00:05:21.243 --rc geninfo_all_blocks=1 00:05:21.243 --rc geninfo_unexecuted_blocks=1 00:05:21.243 00:05:21.243 ' 00:05:21.243 01:06:29 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:21.243 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:21.243 --rc genhtml_branch_coverage=1 00:05:21.243 --rc genhtml_function_coverage=1 00:05:21.243 --rc genhtml_legend=1 00:05:21.243 --rc geninfo_all_blocks=1 00:05:21.243 --rc geninfo_unexecuted_blocks=1 00:05:21.243 00:05:21.243 ' 00:05:21.243 01:06:29 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:21.243 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:21.243 --rc genhtml_branch_coverage=1 00:05:21.243 --rc genhtml_function_coverage=1 00:05:21.243 --rc genhtml_legend=1 00:05:21.243 --rc geninfo_all_blocks=1 00:05:21.243 --rc geninfo_unexecuted_blocks=1 00:05:21.243 00:05:21.243 ' 00:05:21.243 01:06:29 -- json_config/json_config.sh@8 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:05:21.243 01:06:29 -- nvmf/common.sh@7 -- # uname -s 00:05:21.243 01:06:29 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:05:21.243 01:06:29 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:05:21.243 01:06:29 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:05:21.243 01:06:29 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:05:21.243 01:06:29 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:05:21.243 01:06:29 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:05:21.243 01:06:29 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:05:21.243 01:06:29 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:05:21.243 01:06:29 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:05:21.243 01:06:29 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:05:21.243 01:06:29 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:05:21.243 01:06:29 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:05:21.243 01:06:29 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:05:21.243 01:06:29 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:05:21.243 01:06:29 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:05:21.243 01:06:29 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:05:21.243 01:06:29 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:05:21.243 01:06:29 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:05:21.243 01:06:29 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:05:21.243 01:06:29 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:21.243 01:06:29 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:21.243 01:06:29 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:21.243 01:06:29 -- paths/export.sh@5 -- # export PATH 00:05:21.243 01:06:29 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:21.243 01:06:29 -- nvmf/common.sh@46 -- # : 0 00:05:21.243 01:06:29 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:05:21.243 01:06:29 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:05:21.243 01:06:29 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:05:21.243 01:06:29 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:05:21.243 01:06:29 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:05:21.243 01:06:29 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:05:21.243 01:06:29 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:05:21.243 01:06:29 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:05:21.243 01:06:29 -- json_config/json_config.sh@10 -- # [[ 0 -eq 1 ]] 00:05:21.243 01:06:29 -- json_config/json_config.sh@14 -- # [[ 0 -ne 1 ]] 00:05:21.243 01:06:29 -- json_config/json_config.sh@14 -- # [[ 0 -eq 1 ]] 00:05:21.243 01:06:29 -- json_config/json_config.sh@25 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:05:21.243 01:06:29 -- json_config/json_config.sh@30 -- # app_pid=(['target']='' ['initiator']='') 00:05:21.243 01:06:29 -- json_config/json_config.sh@30 -- # declare -A app_pid 00:05:21.243 01:06:29 -- json_config/json_config.sh@31 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:05:21.243 01:06:29 -- json_config/json_config.sh@31 -- # declare -A app_socket 00:05:21.243 01:06:29 -- json_config/json_config.sh@32 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:05:21.243 01:06:29 -- json_config/json_config.sh@32 -- # declare -A app_params 00:05:21.243 01:06:29 -- json_config/json_config.sh@33 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json' ['initiator']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json') 00:05:21.243 01:06:29 -- json_config/json_config.sh@33 -- # declare -A configs_path 00:05:21.243 01:06:29 -- json_config/json_config.sh@43 -- # last_event_id=0 00:05:21.243 01:06:29 -- json_config/json_config.sh@418 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:05:21.243 01:06:29 -- json_config/json_config.sh@419 -- # echo 'INFO: JSON configuration test init' 00:05:21.243 INFO: JSON configuration test init 00:05:21.243 01:06:29 -- json_config/json_config.sh@420 -- # json_config_test_init 00:05:21.243 01:06:29 -- json_config/json_config.sh@315 -- # timing_enter json_config_test_init 00:05:21.243 01:06:29 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:21.243 01:06:29 -- common/autotest_common.sh@10 -- # set +x 00:05:21.243 01:06:29 -- json_config/json_config.sh@316 -- # timing_enter json_config_setup_target 00:05:21.243 01:06:29 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:21.243 01:06:29 -- common/autotest_common.sh@10 -- # set +x 00:05:21.243 01:06:29 -- json_config/json_config.sh@318 -- # json_config_test_start_app target --wait-for-rpc 00:05:21.243 01:06:29 -- json_config/json_config.sh@98 -- # local app=target 00:05:21.243 01:06:29 -- json_config/json_config.sh@99 -- # shift 00:05:21.243 01:06:29 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:05:21.243 01:06:29 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:05:21.243 01:06:29 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:05:21.243 01:06:29 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:21.243 01:06:29 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:21.243 01:06:29 -- json_config/json_config.sh@111 -- # app_pid[$app]=1014187 00:05:21.243 01:06:29 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:05:21.243 01:06:29 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:05:21.243 Waiting for target to run... 00:05:21.243 01:06:29 -- json_config/json_config.sh@114 -- # waitforlisten 1014187 /var/tmp/spdk_tgt.sock 00:05:21.243 01:06:29 -- common/autotest_common.sh@829 -- # '[' -z 1014187 ']' 00:05:21.243 01:06:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:21.243 01:06:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:21.243 01:06:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:21.243 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:21.243 01:06:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:21.243 01:06:29 -- common/autotest_common.sh@10 -- # set +x 00:05:21.243 [2024-11-20 01:06:29.342563] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:21.243 [2024-11-20 01:06:29.342640] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1014187 ] 00:05:21.243 EAL: No free 2048 kB hugepages reported on node 1 00:05:21.809 [2024-11-20 01:06:29.853392] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:21.809 [2024-11-20 01:06:29.933211] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:21.809 [2024-11-20 01:06:29.933424] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:22.373 01:06:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:22.373 01:06:30 -- common/autotest_common.sh@862 -- # return 0 00:05:22.373 01:06:30 -- json_config/json_config.sh@115 -- # echo '' 00:05:22.373 00:05:22.373 01:06:30 -- json_config/json_config.sh@322 -- # create_accel_config 00:05:22.373 01:06:30 -- json_config/json_config.sh@146 -- # timing_enter create_accel_config 00:05:22.373 01:06:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:22.373 01:06:30 -- common/autotest_common.sh@10 -- # set +x 00:05:22.373 01:06:30 -- json_config/json_config.sh@148 -- # [[ 0 -eq 1 ]] 00:05:22.373 01:06:30 -- json_config/json_config.sh@154 -- # timing_exit create_accel_config 00:05:22.373 01:06:30 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:22.373 01:06:30 -- common/autotest_common.sh@10 -- # set +x 00:05:22.373 01:06:30 -- json_config/json_config.sh@326 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:05:22.373 01:06:30 -- json_config/json_config.sh@327 -- # tgt_rpc load_config 00:05:22.373 01:06:30 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:05:25.652 01:06:33 -- json_config/json_config.sh@329 -- # tgt_check_notification_types 00:05:25.652 01:06:33 -- json_config/json_config.sh@46 -- # timing_enter tgt_check_notification_types 00:05:25.652 01:06:33 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:25.652 01:06:33 -- common/autotest_common.sh@10 -- # set +x 00:05:25.652 01:06:33 -- json_config/json_config.sh@48 -- # local ret=0 00:05:25.652 01:06:33 -- json_config/json_config.sh@49 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:05:25.652 01:06:33 -- json_config/json_config.sh@49 -- # local enabled_types 00:05:25.652 01:06:33 -- json_config/json_config.sh@51 -- # tgt_rpc notify_get_types 00:05:25.652 01:06:33 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:05:25.652 01:06:33 -- json_config/json_config.sh@51 -- # jq -r '.[]' 00:05:25.652 01:06:33 -- json_config/json_config.sh@51 -- # get_types=('bdev_register' 'bdev_unregister') 00:05:25.652 01:06:33 -- json_config/json_config.sh@51 -- # local get_types 00:05:25.652 01:06:33 -- json_config/json_config.sh@52 -- # [[ bdev_register bdev_unregister != \b\d\e\v\_\r\e\g\i\s\t\e\r\ \b\d\e\v\_\u\n\r\e\g\i\s\t\e\r ]] 00:05:25.652 01:06:33 -- json_config/json_config.sh@57 -- # timing_exit tgt_check_notification_types 00:05:25.652 01:06:33 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:25.652 01:06:33 -- common/autotest_common.sh@10 -- # set +x 00:05:25.652 01:06:33 -- json_config/json_config.sh@58 -- # return 0 00:05:25.652 01:06:33 -- json_config/json_config.sh@331 -- # [[ 0 -eq 1 ]] 00:05:25.652 01:06:33 -- json_config/json_config.sh@335 -- # [[ 0 -eq 1 ]] 00:05:25.652 01:06:33 -- json_config/json_config.sh@339 -- # [[ 0 -eq 1 ]] 00:05:25.652 01:06:33 -- json_config/json_config.sh@343 -- # [[ 1 -eq 1 ]] 00:05:25.652 01:06:33 -- json_config/json_config.sh@344 -- # create_nvmf_subsystem_config 00:05:25.652 01:06:33 -- json_config/json_config.sh@283 -- # timing_enter create_nvmf_subsystem_config 00:05:25.652 01:06:33 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:25.652 01:06:33 -- common/autotest_common.sh@10 -- # set +x 00:05:25.652 01:06:33 -- json_config/json_config.sh@285 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:05:25.652 01:06:33 -- json_config/json_config.sh@286 -- # [[ tcp == \r\d\m\a ]] 00:05:25.652 01:06:33 -- json_config/json_config.sh@290 -- # [[ -z 127.0.0.1 ]] 00:05:25.652 01:06:33 -- json_config/json_config.sh@295 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:05:25.652 01:06:33 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:05:25.910 MallocForNvmf0 00:05:25.910 01:06:34 -- json_config/json_config.sh@296 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:05:25.910 01:06:34 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:05:26.166 MallocForNvmf1 00:05:26.166 01:06:34 -- json_config/json_config.sh@298 -- # tgt_rpc nvmf_create_transport -t tcp -u 8192 -c 0 00:05:26.166 01:06:34 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t tcp -u 8192 -c 0 00:05:26.424 [2024-11-20 01:06:34.563003] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:05:26.424 01:06:34 -- json_config/json_config.sh@299 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:05:26.424 01:06:34 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:05:26.681 01:06:34 -- json_config/json_config.sh@300 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:05:26.681 01:06:34 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:05:26.939 01:06:35 -- json_config/json_config.sh@301 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:05:26.939 01:06:35 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:05:27.196 01:06:35 -- json_config/json_config.sh@302 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:05:27.196 01:06:35 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:05:27.453 [2024-11-20 01:06:35.566362] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:05:27.453 01:06:35 -- json_config/json_config.sh@304 -- # timing_exit create_nvmf_subsystem_config 00:05:27.454 01:06:35 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:27.454 01:06:35 -- common/autotest_common.sh@10 -- # set +x 00:05:27.454 01:06:35 -- json_config/json_config.sh@346 -- # timing_exit json_config_setup_target 00:05:27.454 01:06:35 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:27.454 01:06:35 -- common/autotest_common.sh@10 -- # set +x 00:05:27.454 01:06:35 -- json_config/json_config.sh@348 -- # [[ 0 -eq 1 ]] 00:05:27.454 01:06:35 -- json_config/json_config.sh@353 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:05:27.454 01:06:35 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:05:27.711 MallocBdevForConfigChangeCheck 00:05:27.711 01:06:35 -- json_config/json_config.sh@355 -- # timing_exit json_config_test_init 00:05:27.711 01:06:35 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:27.711 01:06:35 -- common/autotest_common.sh@10 -- # set +x 00:05:27.711 01:06:35 -- json_config/json_config.sh@422 -- # tgt_rpc save_config 00:05:27.711 01:06:35 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:28.275 01:06:36 -- json_config/json_config.sh@424 -- # echo 'INFO: shutting down applications...' 00:05:28.275 INFO: shutting down applications... 00:05:28.275 01:06:36 -- json_config/json_config.sh@425 -- # [[ 0 -eq 1 ]] 00:05:28.276 01:06:36 -- json_config/json_config.sh@431 -- # json_config_clear target 00:05:28.276 01:06:36 -- json_config/json_config.sh@385 -- # [[ -n 22 ]] 00:05:28.276 01:06:36 -- json_config/json_config.sh@386 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:05:30.172 Calling clear_iscsi_subsystem 00:05:30.172 Calling clear_nvmf_subsystem 00:05:30.172 Calling clear_nbd_subsystem 00:05:30.172 Calling clear_ublk_subsystem 00:05:30.172 Calling clear_vhost_blk_subsystem 00:05:30.172 Calling clear_vhost_scsi_subsystem 00:05:30.172 Calling clear_scheduler_subsystem 00:05:30.172 Calling clear_bdev_subsystem 00:05:30.172 Calling clear_accel_subsystem 00:05:30.172 Calling clear_vmd_subsystem 00:05:30.172 Calling clear_sock_subsystem 00:05:30.172 Calling clear_iobuf_subsystem 00:05:30.172 01:06:37 -- json_config/json_config.sh@390 -- # local config_filter=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py 00:05:30.172 01:06:37 -- json_config/json_config.sh@396 -- # count=100 00:05:30.172 01:06:37 -- json_config/json_config.sh@397 -- # '[' 100 -gt 0 ']' 00:05:30.172 01:06:37 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:05:30.172 01:06:37 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:30.172 01:06:37 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method check_empty 00:05:30.172 01:06:38 -- json_config/json_config.sh@398 -- # break 00:05:30.172 01:06:38 -- json_config/json_config.sh@403 -- # '[' 100 -eq 0 ']' 00:05:30.172 01:06:38 -- json_config/json_config.sh@432 -- # json_config_test_shutdown_app target 00:05:30.172 01:06:38 -- json_config/json_config.sh@120 -- # local app=target 00:05:30.172 01:06:38 -- json_config/json_config.sh@123 -- # [[ -n 22 ]] 00:05:30.172 01:06:38 -- json_config/json_config.sh@124 -- # [[ -n 1014187 ]] 00:05:30.172 01:06:38 -- json_config/json_config.sh@127 -- # kill -SIGINT 1014187 00:05:30.172 01:06:38 -- json_config/json_config.sh@129 -- # (( i = 0 )) 00:05:30.172 01:06:38 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:05:30.172 01:06:38 -- json_config/json_config.sh@130 -- # kill -0 1014187 00:05:30.172 01:06:38 -- json_config/json_config.sh@134 -- # sleep 0.5 00:05:30.738 01:06:38 -- json_config/json_config.sh@129 -- # (( i++ )) 00:05:30.738 01:06:38 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:05:30.738 01:06:38 -- json_config/json_config.sh@130 -- # kill -0 1014187 00:05:30.738 01:06:38 -- json_config/json_config.sh@131 -- # app_pid[$app]= 00:05:30.738 01:06:38 -- json_config/json_config.sh@132 -- # break 00:05:30.738 01:06:38 -- json_config/json_config.sh@137 -- # [[ -n '' ]] 00:05:30.738 01:06:38 -- json_config/json_config.sh@142 -- # echo 'SPDK target shutdown done' 00:05:30.738 SPDK target shutdown done 00:05:30.738 01:06:38 -- json_config/json_config.sh@434 -- # echo 'INFO: relaunching applications...' 00:05:30.738 INFO: relaunching applications... 00:05:30.739 01:06:38 -- json_config/json_config.sh@435 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:30.739 01:06:38 -- json_config/json_config.sh@98 -- # local app=target 00:05:30.739 01:06:38 -- json_config/json_config.sh@99 -- # shift 00:05:30.739 01:06:38 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:05:30.739 01:06:38 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:05:30.739 01:06:38 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:05:30.739 01:06:38 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:30.739 01:06:38 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:30.739 01:06:38 -- json_config/json_config.sh@111 -- # app_pid[$app]=1015536 00:05:30.739 01:06:38 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:05:30.739 01:06:38 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:30.739 Waiting for target to run... 00:05:30.739 01:06:38 -- json_config/json_config.sh@114 -- # waitforlisten 1015536 /var/tmp/spdk_tgt.sock 00:05:30.739 01:06:38 -- common/autotest_common.sh@829 -- # '[' -z 1015536 ']' 00:05:30.739 01:06:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:30.739 01:06:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:30.739 01:06:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:30.739 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:30.739 01:06:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:30.739 01:06:38 -- common/autotest_common.sh@10 -- # set +x 00:05:30.739 [2024-11-20 01:06:38.905494] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:30.739 [2024-11-20 01:06:38.905582] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1015536 ] 00:05:30.739 EAL: No free 2048 kB hugepages reported on node 1 00:05:31.304 [2024-11-20 01:06:39.441456] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:31.304 [2024-11-20 01:06:39.518145] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:31.304 [2024-11-20 01:06:39.518314] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:34.584 [2024-11-20 01:06:42.536085] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:05:34.584 [2024-11-20 01:06:42.568559] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:05:34.842 01:06:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:34.842 01:06:42 -- common/autotest_common.sh@862 -- # return 0 00:05:34.842 01:06:42 -- json_config/json_config.sh@115 -- # echo '' 00:05:34.842 00:05:34.842 01:06:42 -- json_config/json_config.sh@436 -- # [[ 0 -eq 1 ]] 00:05:34.842 01:06:42 -- json_config/json_config.sh@440 -- # echo 'INFO: Checking if target configuration is the same...' 00:05:34.842 INFO: Checking if target configuration is the same... 00:05:34.842 01:06:42 -- json_config/json_config.sh@441 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:34.842 01:06:42 -- json_config/json_config.sh@441 -- # tgt_rpc save_config 00:05:34.842 01:06:42 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:34.842 + '[' 2 -ne 2 ']' 00:05:34.842 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:05:34.842 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:05:34.842 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:05:34.842 +++ basename /dev/fd/62 00:05:34.842 ++ mktemp /tmp/62.XXX 00:05:34.842 + tmp_file_1=/tmp/62.c9D 00:05:34.842 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:34.842 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:05:34.842 + tmp_file_2=/tmp/spdk_tgt_config.json.3Gt 00:05:34.842 + ret=0 00:05:34.842 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:35.100 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:35.100 + diff -u /tmp/62.c9D /tmp/spdk_tgt_config.json.3Gt 00:05:35.100 + echo 'INFO: JSON config files are the same' 00:05:35.100 INFO: JSON config files are the same 00:05:35.100 + rm /tmp/62.c9D /tmp/spdk_tgt_config.json.3Gt 00:05:35.100 + exit 0 00:05:35.100 01:06:43 -- json_config/json_config.sh@442 -- # [[ 0 -eq 1 ]] 00:05:35.100 01:06:43 -- json_config/json_config.sh@447 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:05:35.100 INFO: changing configuration and checking if this can be detected... 00:05:35.100 01:06:43 -- json_config/json_config.sh@449 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:05:35.100 01:06:43 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:05:35.358 01:06:43 -- json_config/json_config.sh@450 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:35.358 01:06:43 -- json_config/json_config.sh@450 -- # tgt_rpc save_config 00:05:35.358 01:06:43 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:35.358 + '[' 2 -ne 2 ']' 00:05:35.358 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:05:35.358 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:05:35.358 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:05:35.358 +++ basename /dev/fd/62 00:05:35.358 ++ mktemp /tmp/62.XXX 00:05:35.358 + tmp_file_1=/tmp/62.vsp 00:05:35.358 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:35.358 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:05:35.358 + tmp_file_2=/tmp/spdk_tgt_config.json.cnl 00:05:35.358 + ret=0 00:05:35.358 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:35.924 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:35.924 + diff -u /tmp/62.vsp /tmp/spdk_tgt_config.json.cnl 00:05:35.924 + ret=1 00:05:35.924 + echo '=== Start of file: /tmp/62.vsp ===' 00:05:35.924 + cat /tmp/62.vsp 00:05:35.924 + echo '=== End of file: /tmp/62.vsp ===' 00:05:35.924 + echo '' 00:05:35.924 + echo '=== Start of file: /tmp/spdk_tgt_config.json.cnl ===' 00:05:35.924 + cat /tmp/spdk_tgt_config.json.cnl 00:05:35.924 + echo '=== End of file: /tmp/spdk_tgt_config.json.cnl ===' 00:05:35.924 + echo '' 00:05:35.924 + rm /tmp/62.vsp /tmp/spdk_tgt_config.json.cnl 00:05:35.924 + exit 1 00:05:35.924 01:06:43 -- json_config/json_config.sh@454 -- # echo 'INFO: configuration change detected.' 00:05:35.924 INFO: configuration change detected. 00:05:35.924 01:06:43 -- json_config/json_config.sh@457 -- # json_config_test_fini 00:05:35.924 01:06:43 -- json_config/json_config.sh@359 -- # timing_enter json_config_test_fini 00:05:35.925 01:06:43 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:35.925 01:06:43 -- common/autotest_common.sh@10 -- # set +x 00:05:35.925 01:06:43 -- json_config/json_config.sh@360 -- # local ret=0 00:05:35.925 01:06:43 -- json_config/json_config.sh@362 -- # [[ -n '' ]] 00:05:35.925 01:06:43 -- json_config/json_config.sh@370 -- # [[ -n 1015536 ]] 00:05:35.925 01:06:43 -- json_config/json_config.sh@373 -- # cleanup_bdev_subsystem_config 00:05:35.925 01:06:43 -- json_config/json_config.sh@237 -- # timing_enter cleanup_bdev_subsystem_config 00:05:35.925 01:06:43 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:35.925 01:06:43 -- common/autotest_common.sh@10 -- # set +x 00:05:35.925 01:06:43 -- json_config/json_config.sh@239 -- # [[ 0 -eq 1 ]] 00:05:35.925 01:06:43 -- json_config/json_config.sh@246 -- # uname -s 00:05:35.925 01:06:43 -- json_config/json_config.sh@246 -- # [[ Linux = Linux ]] 00:05:35.925 01:06:43 -- json_config/json_config.sh@247 -- # rm -f /sample_aio 00:05:35.925 01:06:43 -- json_config/json_config.sh@250 -- # [[ 0 -eq 1 ]] 00:05:35.925 01:06:43 -- json_config/json_config.sh@254 -- # timing_exit cleanup_bdev_subsystem_config 00:05:35.925 01:06:43 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:35.925 01:06:43 -- common/autotest_common.sh@10 -- # set +x 00:05:35.925 01:06:43 -- json_config/json_config.sh@376 -- # killprocess 1015536 00:05:35.925 01:06:43 -- common/autotest_common.sh@936 -- # '[' -z 1015536 ']' 00:05:35.925 01:06:43 -- common/autotest_common.sh@940 -- # kill -0 1015536 00:05:35.925 01:06:43 -- common/autotest_common.sh@941 -- # uname 00:05:35.925 01:06:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:35.925 01:06:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1015536 00:05:35.925 01:06:44 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:35.925 01:06:44 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:35.925 01:06:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1015536' 00:05:35.925 killing process with pid 1015536 00:05:35.925 01:06:44 -- common/autotest_common.sh@955 -- # kill 1015536 00:05:35.925 01:06:44 -- common/autotest_common.sh@960 -- # wait 1015536 00:05:37.824 01:06:45 -- json_config/json_config.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:37.824 01:06:45 -- json_config/json_config.sh@380 -- # timing_exit json_config_test_fini 00:05:37.824 01:06:45 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:37.824 01:06:45 -- common/autotest_common.sh@10 -- # set +x 00:05:37.824 01:06:45 -- json_config/json_config.sh@381 -- # return 0 00:05:37.824 01:06:45 -- json_config/json_config.sh@459 -- # echo 'INFO: Success' 00:05:37.824 INFO: Success 00:05:37.824 00:05:37.824 real 0m16.499s 00:05:37.824 user 0m18.905s 00:05:37.824 sys 0m2.296s 00:05:37.824 01:06:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:37.824 01:06:45 -- common/autotest_common.sh@10 -- # set +x 00:05:37.824 ************************************ 00:05:37.824 END TEST json_config 00:05:37.824 ************************************ 00:05:37.824 01:06:45 -- spdk/autotest.sh@166 -- # run_test json_config_extra_key /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:05:37.824 01:06:45 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:37.824 01:06:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:37.824 01:06:45 -- common/autotest_common.sh@10 -- # set +x 00:05:37.824 ************************************ 00:05:37.824 START TEST json_config_extra_key 00:05:37.824 ************************************ 00:05:37.824 01:06:45 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:05:37.824 01:06:45 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:37.824 01:06:45 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:37.824 01:06:45 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:37.824 01:06:45 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:37.824 01:06:45 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:37.824 01:06:45 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:37.824 01:06:45 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:37.824 01:06:45 -- scripts/common.sh@335 -- # IFS=.-: 00:05:37.824 01:06:45 -- scripts/common.sh@335 -- # read -ra ver1 00:05:37.824 01:06:45 -- scripts/common.sh@336 -- # IFS=.-: 00:05:37.824 01:06:45 -- scripts/common.sh@336 -- # read -ra ver2 00:05:37.824 01:06:45 -- scripts/common.sh@337 -- # local 'op=<' 00:05:37.824 01:06:45 -- scripts/common.sh@339 -- # ver1_l=2 00:05:37.824 01:06:45 -- scripts/common.sh@340 -- # ver2_l=1 00:05:37.824 01:06:45 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:37.824 01:06:45 -- scripts/common.sh@343 -- # case "$op" in 00:05:37.824 01:06:45 -- scripts/common.sh@344 -- # : 1 00:05:37.824 01:06:45 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:37.824 01:06:45 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:37.824 01:06:45 -- scripts/common.sh@364 -- # decimal 1 00:05:37.824 01:06:45 -- scripts/common.sh@352 -- # local d=1 00:05:37.824 01:06:45 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:37.824 01:06:45 -- scripts/common.sh@354 -- # echo 1 00:05:37.824 01:06:45 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:37.824 01:06:45 -- scripts/common.sh@365 -- # decimal 2 00:05:37.824 01:06:45 -- scripts/common.sh@352 -- # local d=2 00:05:37.824 01:06:45 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:37.824 01:06:45 -- scripts/common.sh@354 -- # echo 2 00:05:37.824 01:06:45 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:37.824 01:06:45 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:37.824 01:06:45 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:37.824 01:06:45 -- scripts/common.sh@367 -- # return 0 00:05:37.824 01:06:45 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:37.824 01:06:45 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:37.824 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:37.824 --rc genhtml_branch_coverage=1 00:05:37.824 --rc genhtml_function_coverage=1 00:05:37.824 --rc genhtml_legend=1 00:05:37.824 --rc geninfo_all_blocks=1 00:05:37.824 --rc geninfo_unexecuted_blocks=1 00:05:37.824 00:05:37.824 ' 00:05:37.824 01:06:45 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:37.824 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:37.824 --rc genhtml_branch_coverage=1 00:05:37.824 --rc genhtml_function_coverage=1 00:05:37.824 --rc genhtml_legend=1 00:05:37.824 --rc geninfo_all_blocks=1 00:05:37.824 --rc geninfo_unexecuted_blocks=1 00:05:37.824 00:05:37.824 ' 00:05:37.824 01:06:45 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:37.824 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:37.824 --rc genhtml_branch_coverage=1 00:05:37.824 --rc genhtml_function_coverage=1 00:05:37.824 --rc genhtml_legend=1 00:05:37.824 --rc geninfo_all_blocks=1 00:05:37.824 --rc geninfo_unexecuted_blocks=1 00:05:37.824 00:05:37.824 ' 00:05:37.824 01:06:45 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:37.824 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:37.824 --rc genhtml_branch_coverage=1 00:05:37.824 --rc genhtml_function_coverage=1 00:05:37.824 --rc genhtml_legend=1 00:05:37.824 --rc geninfo_all_blocks=1 00:05:37.824 --rc geninfo_unexecuted_blocks=1 00:05:37.824 00:05:37.824 ' 00:05:37.824 01:06:45 -- json_config/json_config_extra_key.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:05:37.824 01:06:45 -- nvmf/common.sh@7 -- # uname -s 00:05:37.824 01:06:45 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:05:37.824 01:06:45 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:05:37.824 01:06:45 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:05:37.824 01:06:45 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:05:37.824 01:06:45 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:05:37.824 01:06:45 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:05:37.824 01:06:45 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:05:37.824 01:06:45 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:05:37.824 01:06:45 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:05:37.824 01:06:45 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:05:37.824 01:06:45 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:05:37.824 01:06:45 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:05:37.824 01:06:45 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:05:37.824 01:06:45 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:05:37.824 01:06:45 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:05:37.824 01:06:45 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:05:37.824 01:06:45 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:05:37.824 01:06:45 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:05:37.824 01:06:45 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:05:37.824 01:06:45 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:37.824 01:06:45 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:37.824 01:06:45 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:37.824 01:06:45 -- paths/export.sh@5 -- # export PATH 00:05:37.825 01:06:45 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:37.825 01:06:45 -- nvmf/common.sh@46 -- # : 0 00:05:37.825 01:06:45 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:05:37.825 01:06:45 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:05:37.825 01:06:45 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:05:37.825 01:06:45 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:05:37.825 01:06:45 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:05:37.825 01:06:45 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:05:37.825 01:06:45 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:05:37.825 01:06:45 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:05:37.825 01:06:45 -- json_config/json_config_extra_key.sh@16 -- # app_pid=(['target']='') 00:05:37.825 01:06:45 -- json_config/json_config_extra_key.sh@16 -- # declare -A app_pid 00:05:37.825 01:06:45 -- json_config/json_config_extra_key.sh@17 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:05:37.825 01:06:45 -- json_config/json_config_extra_key.sh@17 -- # declare -A app_socket 00:05:37.825 01:06:45 -- json_config/json_config_extra_key.sh@18 -- # app_params=(['target']='-m 0x1 -s 1024') 00:05:37.825 01:06:45 -- json_config/json_config_extra_key.sh@18 -- # declare -A app_params 00:05:37.825 01:06:45 -- json_config/json_config_extra_key.sh@19 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json') 00:05:37.825 01:06:45 -- json_config/json_config_extra_key.sh@19 -- # declare -A configs_path 00:05:37.825 01:06:45 -- json_config/json_config_extra_key.sh@74 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:05:37.825 01:06:45 -- json_config/json_config_extra_key.sh@76 -- # echo 'INFO: launching applications...' 00:05:37.825 INFO: launching applications... 00:05:37.825 01:06:45 -- json_config/json_config_extra_key.sh@77 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:05:37.825 01:06:45 -- json_config/json_config_extra_key.sh@24 -- # local app=target 00:05:37.825 01:06:45 -- json_config/json_config_extra_key.sh@25 -- # shift 00:05:37.825 01:06:45 -- json_config/json_config_extra_key.sh@27 -- # [[ -n 22 ]] 00:05:37.825 01:06:45 -- json_config/json_config_extra_key.sh@28 -- # [[ -z '' ]] 00:05:37.825 01:06:45 -- json_config/json_config_extra_key.sh@31 -- # app_pid[$app]=1016478 00:05:37.825 01:06:45 -- json_config/json_config_extra_key.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:05:37.825 01:06:45 -- json_config/json_config_extra_key.sh@33 -- # echo 'Waiting for target to run...' 00:05:37.825 Waiting for target to run... 00:05:37.825 01:06:45 -- json_config/json_config_extra_key.sh@34 -- # waitforlisten 1016478 /var/tmp/spdk_tgt.sock 00:05:37.825 01:06:45 -- common/autotest_common.sh@829 -- # '[' -z 1016478 ']' 00:05:37.825 01:06:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:37.825 01:06:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:37.825 01:06:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:37.825 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:37.825 01:06:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:37.825 01:06:45 -- common/autotest_common.sh@10 -- # set +x 00:05:37.825 [2024-11-20 01:06:45.873709] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:37.825 [2024-11-20 01:06:45.873793] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1016478 ] 00:05:37.825 EAL: No free 2048 kB hugepages reported on node 1 00:05:38.083 [2024-11-20 01:06:46.213038] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:38.084 [2024-11-20 01:06:46.274969] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:38.084 [2024-11-20 01:06:46.275176] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:38.650 01:06:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:38.650 01:06:46 -- common/autotest_common.sh@862 -- # return 0 00:05:38.650 01:06:46 -- json_config/json_config_extra_key.sh@35 -- # echo '' 00:05:38.650 00:05:38.650 01:06:46 -- json_config/json_config_extra_key.sh@79 -- # echo 'INFO: shutting down applications...' 00:05:38.650 INFO: shutting down applications... 00:05:38.650 01:06:46 -- json_config/json_config_extra_key.sh@80 -- # json_config_test_shutdown_app target 00:05:38.650 01:06:46 -- json_config/json_config_extra_key.sh@40 -- # local app=target 00:05:38.650 01:06:46 -- json_config/json_config_extra_key.sh@43 -- # [[ -n 22 ]] 00:05:38.650 01:06:46 -- json_config/json_config_extra_key.sh@44 -- # [[ -n 1016478 ]] 00:05:38.650 01:06:46 -- json_config/json_config_extra_key.sh@47 -- # kill -SIGINT 1016478 00:05:38.650 01:06:46 -- json_config/json_config_extra_key.sh@49 -- # (( i = 0 )) 00:05:38.650 01:06:46 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:05:38.650 01:06:46 -- json_config/json_config_extra_key.sh@50 -- # kill -0 1016478 00:05:38.650 01:06:46 -- json_config/json_config_extra_key.sh@54 -- # sleep 0.5 00:05:39.218 01:06:47 -- json_config/json_config_extra_key.sh@49 -- # (( i++ )) 00:05:39.218 01:06:47 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:05:39.218 01:06:47 -- json_config/json_config_extra_key.sh@50 -- # kill -0 1016478 00:05:39.218 01:06:47 -- json_config/json_config_extra_key.sh@51 -- # app_pid[$app]= 00:05:39.218 01:06:47 -- json_config/json_config_extra_key.sh@52 -- # break 00:05:39.218 01:06:47 -- json_config/json_config_extra_key.sh@57 -- # [[ -n '' ]] 00:05:39.218 01:06:47 -- json_config/json_config_extra_key.sh@62 -- # echo 'SPDK target shutdown done' 00:05:39.218 SPDK target shutdown done 00:05:39.218 01:06:47 -- json_config/json_config_extra_key.sh@82 -- # echo Success 00:05:39.218 Success 00:05:39.218 00:05:39.218 real 0m1.681s 00:05:39.218 user 0m1.664s 00:05:39.218 sys 0m0.451s 00:05:39.218 01:06:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:39.218 01:06:47 -- common/autotest_common.sh@10 -- # set +x 00:05:39.218 ************************************ 00:05:39.218 END TEST json_config_extra_key 00:05:39.218 ************************************ 00:05:39.218 01:06:47 -- spdk/autotest.sh@167 -- # run_test alias_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:05:39.218 01:06:47 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:39.218 01:06:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:39.218 01:06:47 -- common/autotest_common.sh@10 -- # set +x 00:05:39.218 ************************************ 00:05:39.218 START TEST alias_rpc 00:05:39.218 ************************************ 00:05:39.218 01:06:47 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:05:39.532 * Looking for test storage... 00:05:39.532 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc 00:05:39.532 01:06:47 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:39.532 01:06:47 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:39.532 01:06:47 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:39.532 01:06:47 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:39.532 01:06:47 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:39.532 01:06:47 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:39.532 01:06:47 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:39.532 01:06:47 -- scripts/common.sh@335 -- # IFS=.-: 00:05:39.532 01:06:47 -- scripts/common.sh@335 -- # read -ra ver1 00:05:39.532 01:06:47 -- scripts/common.sh@336 -- # IFS=.-: 00:05:39.532 01:06:47 -- scripts/common.sh@336 -- # read -ra ver2 00:05:39.532 01:06:47 -- scripts/common.sh@337 -- # local 'op=<' 00:05:39.532 01:06:47 -- scripts/common.sh@339 -- # ver1_l=2 00:05:39.532 01:06:47 -- scripts/common.sh@340 -- # ver2_l=1 00:05:39.532 01:06:47 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:39.532 01:06:47 -- scripts/common.sh@343 -- # case "$op" in 00:05:39.532 01:06:47 -- scripts/common.sh@344 -- # : 1 00:05:39.532 01:06:47 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:39.532 01:06:47 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:39.532 01:06:47 -- scripts/common.sh@364 -- # decimal 1 00:05:39.532 01:06:47 -- scripts/common.sh@352 -- # local d=1 00:05:39.532 01:06:47 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:39.532 01:06:47 -- scripts/common.sh@354 -- # echo 1 00:05:39.532 01:06:47 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:39.532 01:06:47 -- scripts/common.sh@365 -- # decimal 2 00:05:39.532 01:06:47 -- scripts/common.sh@352 -- # local d=2 00:05:39.532 01:06:47 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:39.532 01:06:47 -- scripts/common.sh@354 -- # echo 2 00:05:39.532 01:06:47 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:39.532 01:06:47 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:39.532 01:06:47 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:39.532 01:06:47 -- scripts/common.sh@367 -- # return 0 00:05:39.532 01:06:47 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:39.532 01:06:47 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:39.532 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:39.532 --rc genhtml_branch_coverage=1 00:05:39.532 --rc genhtml_function_coverage=1 00:05:39.532 --rc genhtml_legend=1 00:05:39.532 --rc geninfo_all_blocks=1 00:05:39.532 --rc geninfo_unexecuted_blocks=1 00:05:39.532 00:05:39.532 ' 00:05:39.532 01:06:47 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:39.532 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:39.532 --rc genhtml_branch_coverage=1 00:05:39.532 --rc genhtml_function_coverage=1 00:05:39.532 --rc genhtml_legend=1 00:05:39.532 --rc geninfo_all_blocks=1 00:05:39.532 --rc geninfo_unexecuted_blocks=1 00:05:39.532 00:05:39.532 ' 00:05:39.532 01:06:47 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:39.532 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:39.532 --rc genhtml_branch_coverage=1 00:05:39.532 --rc genhtml_function_coverage=1 00:05:39.532 --rc genhtml_legend=1 00:05:39.532 --rc geninfo_all_blocks=1 00:05:39.532 --rc geninfo_unexecuted_blocks=1 00:05:39.532 00:05:39.532 ' 00:05:39.532 01:06:47 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:39.532 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:39.532 --rc genhtml_branch_coverage=1 00:05:39.532 --rc genhtml_function_coverage=1 00:05:39.532 --rc genhtml_legend=1 00:05:39.532 --rc geninfo_all_blocks=1 00:05:39.532 --rc geninfo_unexecuted_blocks=1 00:05:39.532 00:05:39.532 ' 00:05:39.532 01:06:47 -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:05:39.532 01:06:47 -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=1016805 00:05:39.533 01:06:47 -- alias_rpc/alias_rpc.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:05:39.533 01:06:47 -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 1016805 00:05:39.533 01:06:47 -- common/autotest_common.sh@829 -- # '[' -z 1016805 ']' 00:05:39.533 01:06:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:39.533 01:06:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:39.533 01:06:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:39.533 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:39.533 01:06:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:39.533 01:06:47 -- common/autotest_common.sh@10 -- # set +x 00:05:39.533 [2024-11-20 01:06:47.580906] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:39.533 [2024-11-20 01:06:47.580984] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1016805 ] 00:05:39.533 EAL: No free 2048 kB hugepages reported on node 1 00:05:39.533 [2024-11-20 01:06:47.637618] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:39.533 [2024-11-20 01:06:47.724927] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:39.533 [2024-11-20 01:06:47.725112] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:40.479 01:06:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:40.479 01:06:48 -- common/autotest_common.sh@862 -- # return 0 00:05:40.479 01:06:48 -- alias_rpc/alias_rpc.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_config -i 00:05:40.737 01:06:48 -- alias_rpc/alias_rpc.sh@19 -- # killprocess 1016805 00:05:40.737 01:06:48 -- common/autotest_common.sh@936 -- # '[' -z 1016805 ']' 00:05:40.737 01:06:48 -- common/autotest_common.sh@940 -- # kill -0 1016805 00:05:40.737 01:06:48 -- common/autotest_common.sh@941 -- # uname 00:05:40.737 01:06:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:40.737 01:06:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1016805 00:05:40.737 01:06:48 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:40.737 01:06:48 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:40.737 01:06:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1016805' 00:05:40.737 killing process with pid 1016805 00:05:40.737 01:06:48 -- common/autotest_common.sh@955 -- # kill 1016805 00:05:40.737 01:06:48 -- common/autotest_common.sh@960 -- # wait 1016805 00:05:41.303 00:05:41.303 real 0m1.880s 00:05:41.303 user 0m2.156s 00:05:41.303 sys 0m0.488s 00:05:41.303 01:06:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:41.303 01:06:49 -- common/autotest_common.sh@10 -- # set +x 00:05:41.303 ************************************ 00:05:41.303 END TEST alias_rpc 00:05:41.303 ************************************ 00:05:41.303 01:06:49 -- spdk/autotest.sh@169 -- # [[ 0 -eq 0 ]] 00:05:41.303 01:06:49 -- spdk/autotest.sh@170 -- # run_test spdkcli_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:05:41.303 01:06:49 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:41.303 01:06:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:41.303 01:06:49 -- common/autotest_common.sh@10 -- # set +x 00:05:41.303 ************************************ 00:05:41.303 START TEST spdkcli_tcp 00:05:41.303 ************************************ 00:05:41.303 01:06:49 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:05:41.303 * Looking for test storage... 00:05:41.303 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:05:41.303 01:06:49 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:41.303 01:06:49 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:41.303 01:06:49 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:41.303 01:06:49 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:41.303 01:06:49 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:41.303 01:06:49 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:41.303 01:06:49 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:41.303 01:06:49 -- scripts/common.sh@335 -- # IFS=.-: 00:05:41.303 01:06:49 -- scripts/common.sh@335 -- # read -ra ver1 00:05:41.303 01:06:49 -- scripts/common.sh@336 -- # IFS=.-: 00:05:41.303 01:06:49 -- scripts/common.sh@336 -- # read -ra ver2 00:05:41.303 01:06:49 -- scripts/common.sh@337 -- # local 'op=<' 00:05:41.303 01:06:49 -- scripts/common.sh@339 -- # ver1_l=2 00:05:41.303 01:06:49 -- scripts/common.sh@340 -- # ver2_l=1 00:05:41.303 01:06:49 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:41.303 01:06:49 -- scripts/common.sh@343 -- # case "$op" in 00:05:41.303 01:06:49 -- scripts/common.sh@344 -- # : 1 00:05:41.303 01:06:49 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:41.303 01:06:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:41.303 01:06:49 -- scripts/common.sh@364 -- # decimal 1 00:05:41.303 01:06:49 -- scripts/common.sh@352 -- # local d=1 00:05:41.303 01:06:49 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:41.303 01:06:49 -- scripts/common.sh@354 -- # echo 1 00:05:41.303 01:06:49 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:41.303 01:06:49 -- scripts/common.sh@365 -- # decimal 2 00:05:41.303 01:06:49 -- scripts/common.sh@352 -- # local d=2 00:05:41.303 01:06:49 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:41.303 01:06:49 -- scripts/common.sh@354 -- # echo 2 00:05:41.303 01:06:49 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:41.303 01:06:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:41.303 01:06:49 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:41.303 01:06:49 -- scripts/common.sh@367 -- # return 0 00:05:41.303 01:06:49 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:41.303 01:06:49 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:41.303 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:41.303 --rc genhtml_branch_coverage=1 00:05:41.303 --rc genhtml_function_coverage=1 00:05:41.303 --rc genhtml_legend=1 00:05:41.303 --rc geninfo_all_blocks=1 00:05:41.303 --rc geninfo_unexecuted_blocks=1 00:05:41.303 00:05:41.303 ' 00:05:41.303 01:06:49 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:41.303 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:41.303 --rc genhtml_branch_coverage=1 00:05:41.303 --rc genhtml_function_coverage=1 00:05:41.303 --rc genhtml_legend=1 00:05:41.303 --rc geninfo_all_blocks=1 00:05:41.303 --rc geninfo_unexecuted_blocks=1 00:05:41.303 00:05:41.303 ' 00:05:41.303 01:06:49 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:41.303 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:41.303 --rc genhtml_branch_coverage=1 00:05:41.303 --rc genhtml_function_coverage=1 00:05:41.303 --rc genhtml_legend=1 00:05:41.303 --rc geninfo_all_blocks=1 00:05:41.303 --rc geninfo_unexecuted_blocks=1 00:05:41.303 00:05:41.303 ' 00:05:41.303 01:06:49 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:41.303 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:41.303 --rc genhtml_branch_coverage=1 00:05:41.303 --rc genhtml_function_coverage=1 00:05:41.303 --rc genhtml_legend=1 00:05:41.303 --rc geninfo_all_blocks=1 00:05:41.303 --rc geninfo_unexecuted_blocks=1 00:05:41.303 00:05:41.303 ' 00:05:41.303 01:06:49 -- spdkcli/tcp.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:05:41.303 01:06:49 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:05:41.303 01:06:49 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:05:41.303 01:06:49 -- spdkcli/tcp.sh@18 -- # IP_ADDRESS=127.0.0.1 00:05:41.303 01:06:49 -- spdkcli/tcp.sh@19 -- # PORT=9998 00:05:41.303 01:06:49 -- spdkcli/tcp.sh@21 -- # trap 'err_cleanup; exit 1' SIGINT SIGTERM EXIT 00:05:41.303 01:06:49 -- spdkcli/tcp.sh@23 -- # timing_enter run_spdk_tgt_tcp 00:05:41.303 01:06:49 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:41.303 01:06:49 -- common/autotest_common.sh@10 -- # set +x 00:05:41.303 01:06:49 -- spdkcli/tcp.sh@25 -- # spdk_tgt_pid=1017016 00:05:41.303 01:06:49 -- spdkcli/tcp.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x3 -p 0 00:05:41.303 01:06:49 -- spdkcli/tcp.sh@27 -- # waitforlisten 1017016 00:05:41.303 01:06:49 -- common/autotest_common.sh@829 -- # '[' -z 1017016 ']' 00:05:41.303 01:06:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:41.303 01:06:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:41.303 01:06:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:41.303 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:41.303 01:06:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:41.303 01:06:49 -- common/autotest_common.sh@10 -- # set +x 00:05:41.303 [2024-11-20 01:06:49.508482] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:41.303 [2024-11-20 01:06:49.508571] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1017016 ] 00:05:41.561 EAL: No free 2048 kB hugepages reported on node 1 00:05:41.561 [2024-11-20 01:06:49.572109] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:41.561 [2024-11-20 01:06:49.660008] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:41.561 [2024-11-20 01:06:49.660221] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:41.561 [2024-11-20 01:06:49.660227] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:42.494 01:06:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:42.494 01:06:50 -- common/autotest_common.sh@862 -- # return 0 00:05:42.494 01:06:50 -- spdkcli/tcp.sh@31 -- # socat_pid=1017154 00:05:42.494 01:06:50 -- spdkcli/tcp.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -r 100 -t 2 -s 127.0.0.1 -p 9998 rpc_get_methods 00:05:42.494 01:06:50 -- spdkcli/tcp.sh@30 -- # socat TCP-LISTEN:9998 UNIX-CONNECT:/var/tmp/spdk.sock 00:05:42.752 [ 00:05:42.752 "bdev_malloc_delete", 00:05:42.752 "bdev_malloc_create", 00:05:42.752 "bdev_null_resize", 00:05:42.752 "bdev_null_delete", 00:05:42.752 "bdev_null_create", 00:05:42.752 "bdev_nvme_cuse_unregister", 00:05:42.752 "bdev_nvme_cuse_register", 00:05:42.752 "bdev_opal_new_user", 00:05:42.752 "bdev_opal_set_lock_state", 00:05:42.752 "bdev_opal_delete", 00:05:42.752 "bdev_opal_get_info", 00:05:42.752 "bdev_opal_create", 00:05:42.752 "bdev_nvme_opal_revert", 00:05:42.752 "bdev_nvme_opal_init", 00:05:42.752 "bdev_nvme_send_cmd", 00:05:42.752 "bdev_nvme_get_path_iostat", 00:05:42.752 "bdev_nvme_get_mdns_discovery_info", 00:05:42.752 "bdev_nvme_stop_mdns_discovery", 00:05:42.752 "bdev_nvme_start_mdns_discovery", 00:05:42.752 "bdev_nvme_set_multipath_policy", 00:05:42.752 "bdev_nvme_set_preferred_path", 00:05:42.752 "bdev_nvme_get_io_paths", 00:05:42.752 "bdev_nvme_remove_error_injection", 00:05:42.752 "bdev_nvme_add_error_injection", 00:05:42.752 "bdev_nvme_get_discovery_info", 00:05:42.752 "bdev_nvme_stop_discovery", 00:05:42.752 "bdev_nvme_start_discovery", 00:05:42.752 "bdev_nvme_get_controller_health_info", 00:05:42.752 "bdev_nvme_disable_controller", 00:05:42.752 "bdev_nvme_enable_controller", 00:05:42.752 "bdev_nvme_reset_controller", 00:05:42.752 "bdev_nvme_get_transport_statistics", 00:05:42.752 "bdev_nvme_apply_firmware", 00:05:42.752 "bdev_nvme_detach_controller", 00:05:42.752 "bdev_nvme_get_controllers", 00:05:42.752 "bdev_nvme_attach_controller", 00:05:42.752 "bdev_nvme_set_hotplug", 00:05:42.752 "bdev_nvme_set_options", 00:05:42.752 "bdev_passthru_delete", 00:05:42.752 "bdev_passthru_create", 00:05:42.752 "bdev_lvol_grow_lvstore", 00:05:42.752 "bdev_lvol_get_lvols", 00:05:42.752 "bdev_lvol_get_lvstores", 00:05:42.752 "bdev_lvol_delete", 00:05:42.752 "bdev_lvol_set_read_only", 00:05:42.752 "bdev_lvol_resize", 00:05:42.752 "bdev_lvol_decouple_parent", 00:05:42.752 "bdev_lvol_inflate", 00:05:42.752 "bdev_lvol_rename", 00:05:42.752 "bdev_lvol_clone_bdev", 00:05:42.752 "bdev_lvol_clone", 00:05:42.752 "bdev_lvol_snapshot", 00:05:42.752 "bdev_lvol_create", 00:05:42.752 "bdev_lvol_delete_lvstore", 00:05:42.752 "bdev_lvol_rename_lvstore", 00:05:42.752 "bdev_lvol_create_lvstore", 00:05:42.752 "bdev_raid_set_options", 00:05:42.752 "bdev_raid_remove_base_bdev", 00:05:42.752 "bdev_raid_add_base_bdev", 00:05:42.752 "bdev_raid_delete", 00:05:42.752 "bdev_raid_create", 00:05:42.752 "bdev_raid_get_bdevs", 00:05:42.752 "bdev_error_inject_error", 00:05:42.752 "bdev_error_delete", 00:05:42.752 "bdev_error_create", 00:05:42.752 "bdev_split_delete", 00:05:42.752 "bdev_split_create", 00:05:42.752 "bdev_delay_delete", 00:05:42.752 "bdev_delay_create", 00:05:42.752 "bdev_delay_update_latency", 00:05:42.752 "bdev_zone_block_delete", 00:05:42.752 "bdev_zone_block_create", 00:05:42.752 "blobfs_create", 00:05:42.752 "blobfs_detect", 00:05:42.752 "blobfs_set_cache_size", 00:05:42.752 "bdev_aio_delete", 00:05:42.752 "bdev_aio_rescan", 00:05:42.752 "bdev_aio_create", 00:05:42.752 "bdev_ftl_set_property", 00:05:42.752 "bdev_ftl_get_properties", 00:05:42.752 "bdev_ftl_get_stats", 00:05:42.752 "bdev_ftl_unmap", 00:05:42.752 "bdev_ftl_unload", 00:05:42.752 "bdev_ftl_delete", 00:05:42.752 "bdev_ftl_load", 00:05:42.752 "bdev_ftl_create", 00:05:42.752 "bdev_virtio_attach_controller", 00:05:42.752 "bdev_virtio_scsi_get_devices", 00:05:42.752 "bdev_virtio_detach_controller", 00:05:42.752 "bdev_virtio_blk_set_hotplug", 00:05:42.752 "bdev_iscsi_delete", 00:05:42.752 "bdev_iscsi_create", 00:05:42.752 "bdev_iscsi_set_options", 00:05:42.752 "accel_error_inject_error", 00:05:42.752 "ioat_scan_accel_module", 00:05:42.752 "dsa_scan_accel_module", 00:05:42.752 "iaa_scan_accel_module", 00:05:42.752 "vfu_virtio_create_scsi_endpoint", 00:05:42.752 "vfu_virtio_scsi_remove_target", 00:05:42.752 "vfu_virtio_scsi_add_target", 00:05:42.752 "vfu_virtio_create_blk_endpoint", 00:05:42.752 "vfu_virtio_delete_endpoint", 00:05:42.752 "iscsi_set_options", 00:05:42.752 "iscsi_get_auth_groups", 00:05:42.752 "iscsi_auth_group_remove_secret", 00:05:42.752 "iscsi_auth_group_add_secret", 00:05:42.752 "iscsi_delete_auth_group", 00:05:42.752 "iscsi_create_auth_group", 00:05:42.752 "iscsi_set_discovery_auth", 00:05:42.752 "iscsi_get_options", 00:05:42.752 "iscsi_target_node_request_logout", 00:05:42.752 "iscsi_target_node_set_redirect", 00:05:42.752 "iscsi_target_node_set_auth", 00:05:42.752 "iscsi_target_node_add_lun", 00:05:42.752 "iscsi_get_connections", 00:05:42.752 "iscsi_portal_group_set_auth", 00:05:42.752 "iscsi_start_portal_group", 00:05:42.752 "iscsi_delete_portal_group", 00:05:42.752 "iscsi_create_portal_group", 00:05:42.752 "iscsi_get_portal_groups", 00:05:42.752 "iscsi_delete_target_node", 00:05:42.752 "iscsi_target_node_remove_pg_ig_maps", 00:05:42.752 "iscsi_target_node_add_pg_ig_maps", 00:05:42.752 "iscsi_create_target_node", 00:05:42.752 "iscsi_get_target_nodes", 00:05:42.752 "iscsi_delete_initiator_group", 00:05:42.752 "iscsi_initiator_group_remove_initiators", 00:05:42.752 "iscsi_initiator_group_add_initiators", 00:05:42.752 "iscsi_create_initiator_group", 00:05:42.752 "iscsi_get_initiator_groups", 00:05:42.752 "nvmf_set_crdt", 00:05:42.752 "nvmf_set_config", 00:05:42.752 "nvmf_set_max_subsystems", 00:05:42.752 "nvmf_subsystem_get_listeners", 00:05:42.752 "nvmf_subsystem_get_qpairs", 00:05:42.752 "nvmf_subsystem_get_controllers", 00:05:42.752 "nvmf_get_stats", 00:05:42.752 "nvmf_get_transports", 00:05:42.752 "nvmf_create_transport", 00:05:42.752 "nvmf_get_targets", 00:05:42.752 "nvmf_delete_target", 00:05:42.752 "nvmf_create_target", 00:05:42.752 "nvmf_subsystem_allow_any_host", 00:05:42.752 "nvmf_subsystem_remove_host", 00:05:42.752 "nvmf_subsystem_add_host", 00:05:42.752 "nvmf_subsystem_remove_ns", 00:05:42.752 "nvmf_subsystem_add_ns", 00:05:42.752 "nvmf_subsystem_listener_set_ana_state", 00:05:42.752 "nvmf_discovery_get_referrals", 00:05:42.752 "nvmf_discovery_remove_referral", 00:05:42.752 "nvmf_discovery_add_referral", 00:05:42.752 "nvmf_subsystem_remove_listener", 00:05:42.752 "nvmf_subsystem_add_listener", 00:05:42.752 "nvmf_delete_subsystem", 00:05:42.752 "nvmf_create_subsystem", 00:05:42.752 "nvmf_get_subsystems", 00:05:42.752 "env_dpdk_get_mem_stats", 00:05:42.752 "nbd_get_disks", 00:05:42.752 "nbd_stop_disk", 00:05:42.752 "nbd_start_disk", 00:05:42.752 "ublk_recover_disk", 00:05:42.752 "ublk_get_disks", 00:05:42.752 "ublk_stop_disk", 00:05:42.752 "ublk_start_disk", 00:05:42.752 "ublk_destroy_target", 00:05:42.752 "ublk_create_target", 00:05:42.752 "virtio_blk_create_transport", 00:05:42.752 "virtio_blk_get_transports", 00:05:42.752 "vhost_controller_set_coalescing", 00:05:42.752 "vhost_get_controllers", 00:05:42.752 "vhost_delete_controller", 00:05:42.752 "vhost_create_blk_controller", 00:05:42.752 "vhost_scsi_controller_remove_target", 00:05:42.752 "vhost_scsi_controller_add_target", 00:05:42.752 "vhost_start_scsi_controller", 00:05:42.752 "vhost_create_scsi_controller", 00:05:42.752 "thread_set_cpumask", 00:05:42.752 "framework_get_scheduler", 00:05:42.752 "framework_set_scheduler", 00:05:42.752 "framework_get_reactors", 00:05:42.752 "thread_get_io_channels", 00:05:42.753 "thread_get_pollers", 00:05:42.753 "thread_get_stats", 00:05:42.753 "framework_monitor_context_switch", 00:05:42.753 "spdk_kill_instance", 00:05:42.753 "log_enable_timestamps", 00:05:42.753 "log_get_flags", 00:05:42.753 "log_clear_flag", 00:05:42.753 "log_set_flag", 00:05:42.753 "log_get_level", 00:05:42.753 "log_set_level", 00:05:42.753 "log_get_print_level", 00:05:42.753 "log_set_print_level", 00:05:42.753 "framework_enable_cpumask_locks", 00:05:42.753 "framework_disable_cpumask_locks", 00:05:42.753 "framework_wait_init", 00:05:42.753 "framework_start_init", 00:05:42.753 "scsi_get_devices", 00:05:42.753 "bdev_get_histogram", 00:05:42.753 "bdev_enable_histogram", 00:05:42.753 "bdev_set_qos_limit", 00:05:42.753 "bdev_set_qd_sampling_period", 00:05:42.753 "bdev_get_bdevs", 00:05:42.753 "bdev_reset_iostat", 00:05:42.753 "bdev_get_iostat", 00:05:42.753 "bdev_examine", 00:05:42.753 "bdev_wait_for_examine", 00:05:42.753 "bdev_set_options", 00:05:42.753 "notify_get_notifications", 00:05:42.753 "notify_get_types", 00:05:42.753 "accel_get_stats", 00:05:42.753 "accel_set_options", 00:05:42.753 "accel_set_driver", 00:05:42.753 "accel_crypto_key_destroy", 00:05:42.753 "accel_crypto_keys_get", 00:05:42.753 "accel_crypto_key_create", 00:05:42.753 "accel_assign_opc", 00:05:42.753 "accel_get_module_info", 00:05:42.753 "accel_get_opc_assignments", 00:05:42.753 "vmd_rescan", 00:05:42.753 "vmd_remove_device", 00:05:42.753 "vmd_enable", 00:05:42.753 "sock_set_default_impl", 00:05:42.753 "sock_impl_set_options", 00:05:42.753 "sock_impl_get_options", 00:05:42.753 "iobuf_get_stats", 00:05:42.753 "iobuf_set_options", 00:05:42.753 "framework_get_pci_devices", 00:05:42.753 "framework_get_config", 00:05:42.753 "framework_get_subsystems", 00:05:42.753 "vfu_tgt_set_base_path", 00:05:42.753 "trace_get_info", 00:05:42.753 "trace_get_tpoint_group_mask", 00:05:42.753 "trace_disable_tpoint_group", 00:05:42.753 "trace_enable_tpoint_group", 00:05:42.753 "trace_clear_tpoint_mask", 00:05:42.753 "trace_set_tpoint_mask", 00:05:42.753 "spdk_get_version", 00:05:42.753 "rpc_get_methods" 00:05:42.753 ] 00:05:42.753 01:06:50 -- spdkcli/tcp.sh@35 -- # timing_exit run_spdk_tgt_tcp 00:05:42.753 01:06:50 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:42.753 01:06:50 -- common/autotest_common.sh@10 -- # set +x 00:05:42.753 01:06:50 -- spdkcli/tcp.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:05:42.753 01:06:50 -- spdkcli/tcp.sh@38 -- # killprocess 1017016 00:05:42.753 01:06:50 -- common/autotest_common.sh@936 -- # '[' -z 1017016 ']' 00:05:42.753 01:06:50 -- common/autotest_common.sh@940 -- # kill -0 1017016 00:05:42.753 01:06:50 -- common/autotest_common.sh@941 -- # uname 00:05:42.753 01:06:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:42.753 01:06:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1017016 00:05:42.753 01:06:50 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:42.753 01:06:50 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:42.753 01:06:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1017016' 00:05:42.753 killing process with pid 1017016 00:05:42.753 01:06:50 -- common/autotest_common.sh@955 -- # kill 1017016 00:05:42.753 01:06:50 -- common/autotest_common.sh@960 -- # wait 1017016 00:05:43.011 00:05:43.011 real 0m1.906s 00:05:43.011 user 0m3.630s 00:05:43.011 sys 0m0.533s 00:05:43.011 01:06:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:43.011 01:06:51 -- common/autotest_common.sh@10 -- # set +x 00:05:43.011 ************************************ 00:05:43.011 END TEST spdkcli_tcp 00:05:43.011 ************************************ 00:05:43.270 01:06:51 -- spdk/autotest.sh@173 -- # run_test dpdk_mem_utility /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:05:43.270 01:06:51 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:43.270 01:06:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:43.270 01:06:51 -- common/autotest_common.sh@10 -- # set +x 00:05:43.270 ************************************ 00:05:43.270 START TEST dpdk_mem_utility 00:05:43.270 ************************************ 00:05:43.270 01:06:51 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:05:43.270 * Looking for test storage... 00:05:43.270 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility 00:05:43.270 01:06:51 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:43.270 01:06:51 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:43.270 01:06:51 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:43.270 01:06:51 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:43.270 01:06:51 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:43.270 01:06:51 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:43.270 01:06:51 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:43.270 01:06:51 -- scripts/common.sh@335 -- # IFS=.-: 00:05:43.270 01:06:51 -- scripts/common.sh@335 -- # read -ra ver1 00:05:43.270 01:06:51 -- scripts/common.sh@336 -- # IFS=.-: 00:05:43.270 01:06:51 -- scripts/common.sh@336 -- # read -ra ver2 00:05:43.270 01:06:51 -- scripts/common.sh@337 -- # local 'op=<' 00:05:43.270 01:06:51 -- scripts/common.sh@339 -- # ver1_l=2 00:05:43.270 01:06:51 -- scripts/common.sh@340 -- # ver2_l=1 00:05:43.270 01:06:51 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:43.270 01:06:51 -- scripts/common.sh@343 -- # case "$op" in 00:05:43.270 01:06:51 -- scripts/common.sh@344 -- # : 1 00:05:43.270 01:06:51 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:43.270 01:06:51 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:43.270 01:06:51 -- scripts/common.sh@364 -- # decimal 1 00:05:43.270 01:06:51 -- scripts/common.sh@352 -- # local d=1 00:05:43.270 01:06:51 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:43.270 01:06:51 -- scripts/common.sh@354 -- # echo 1 00:05:43.270 01:06:51 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:43.270 01:06:51 -- scripts/common.sh@365 -- # decimal 2 00:05:43.270 01:06:51 -- scripts/common.sh@352 -- # local d=2 00:05:43.270 01:06:51 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:43.270 01:06:51 -- scripts/common.sh@354 -- # echo 2 00:05:43.270 01:06:51 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:43.270 01:06:51 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:43.270 01:06:51 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:43.270 01:06:51 -- scripts/common.sh@367 -- # return 0 00:05:43.270 01:06:51 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:43.270 01:06:51 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:43.270 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:43.270 --rc genhtml_branch_coverage=1 00:05:43.270 --rc genhtml_function_coverage=1 00:05:43.270 --rc genhtml_legend=1 00:05:43.270 --rc geninfo_all_blocks=1 00:05:43.270 --rc geninfo_unexecuted_blocks=1 00:05:43.270 00:05:43.270 ' 00:05:43.270 01:06:51 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:43.270 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:43.270 --rc genhtml_branch_coverage=1 00:05:43.270 --rc genhtml_function_coverage=1 00:05:43.270 --rc genhtml_legend=1 00:05:43.270 --rc geninfo_all_blocks=1 00:05:43.270 --rc geninfo_unexecuted_blocks=1 00:05:43.270 00:05:43.270 ' 00:05:43.270 01:06:51 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:43.270 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:43.270 --rc genhtml_branch_coverage=1 00:05:43.270 --rc genhtml_function_coverage=1 00:05:43.271 --rc genhtml_legend=1 00:05:43.271 --rc geninfo_all_blocks=1 00:05:43.271 --rc geninfo_unexecuted_blocks=1 00:05:43.271 00:05:43.271 ' 00:05:43.271 01:06:51 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:43.271 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:43.271 --rc genhtml_branch_coverage=1 00:05:43.271 --rc genhtml_function_coverage=1 00:05:43.271 --rc genhtml_legend=1 00:05:43.271 --rc geninfo_all_blocks=1 00:05:43.271 --rc geninfo_unexecuted_blocks=1 00:05:43.271 00:05:43.271 ' 00:05:43.271 01:06:51 -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:05:43.271 01:06:51 -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=1017359 00:05:43.271 01:06:51 -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:05:43.271 01:06:51 -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 1017359 00:05:43.271 01:06:51 -- common/autotest_common.sh@829 -- # '[' -z 1017359 ']' 00:05:43.271 01:06:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:43.271 01:06:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:43.271 01:06:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:43.271 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:43.271 01:06:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:43.271 01:06:51 -- common/autotest_common.sh@10 -- # set +x 00:05:43.271 [2024-11-20 01:06:51.422620] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:43.271 [2024-11-20 01:06:51.422720] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1017359 ] 00:05:43.271 EAL: No free 2048 kB hugepages reported on node 1 00:05:43.271 [2024-11-20 01:06:51.479125] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:43.529 [2024-11-20 01:06:51.568102] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:43.529 [2024-11-20 01:06:51.568269] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:44.464 01:06:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:44.464 01:06:52 -- common/autotest_common.sh@862 -- # return 0 00:05:44.464 01:06:52 -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:05:44.464 01:06:52 -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:05:44.464 01:06:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:44.464 01:06:52 -- common/autotest_common.sh@10 -- # set +x 00:05:44.464 { 00:05:44.464 "filename": "/tmp/spdk_mem_dump.txt" 00:05:44.464 } 00:05:44.464 01:06:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:44.464 01:06:52 -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:05:44.464 DPDK memory size 814.000000 MiB in 1 heap(s) 00:05:44.464 1 heaps totaling size 814.000000 MiB 00:05:44.464 size: 814.000000 MiB heap id: 0 00:05:44.464 end heaps---------- 00:05:44.464 8 mempools totaling size 598.116089 MiB 00:05:44.464 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:05:44.464 size: 158.602051 MiB name: PDU_data_out_Pool 00:05:44.464 size: 84.521057 MiB name: bdev_io_1017359 00:05:44.464 size: 51.011292 MiB name: evtpool_1017359 00:05:44.464 size: 50.003479 MiB name: msgpool_1017359 00:05:44.464 size: 21.763794 MiB name: PDU_Pool 00:05:44.464 size: 19.513306 MiB name: SCSI_TASK_Pool 00:05:44.464 size: 0.026123 MiB name: Session_Pool 00:05:44.464 end mempools------- 00:05:44.464 6 memzones totaling size 4.142822 MiB 00:05:44.464 size: 1.000366 MiB name: RG_ring_0_1017359 00:05:44.464 size: 1.000366 MiB name: RG_ring_1_1017359 00:05:44.464 size: 1.000366 MiB name: RG_ring_4_1017359 00:05:44.464 size: 1.000366 MiB name: RG_ring_5_1017359 00:05:44.464 size: 0.125366 MiB name: RG_ring_2_1017359 00:05:44.464 size: 0.015991 MiB name: RG_ring_3_1017359 00:05:44.464 end memzones------- 00:05:44.464 01:06:52 -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py -m 0 00:05:44.464 heap id: 0 total size: 814.000000 MiB number of busy elements: 41 number of free elements: 15 00:05:44.464 list of free elements. size: 12.519348 MiB 00:05:44.464 element at address: 0x200000400000 with size: 1.999512 MiB 00:05:44.464 element at address: 0x200018e00000 with size: 0.999878 MiB 00:05:44.464 element at address: 0x200019000000 with size: 0.999878 MiB 00:05:44.464 element at address: 0x200003e00000 with size: 0.996277 MiB 00:05:44.464 element at address: 0x200031c00000 with size: 0.994446 MiB 00:05:44.464 element at address: 0x200013800000 with size: 0.978699 MiB 00:05:44.464 element at address: 0x200007000000 with size: 0.959839 MiB 00:05:44.464 element at address: 0x200019200000 with size: 0.936584 MiB 00:05:44.464 element at address: 0x200000200000 with size: 0.841614 MiB 00:05:44.464 element at address: 0x20001aa00000 with size: 0.582886 MiB 00:05:44.464 element at address: 0x20000b200000 with size: 0.490723 MiB 00:05:44.464 element at address: 0x200000800000 with size: 0.487793 MiB 00:05:44.464 element at address: 0x200019400000 with size: 0.485657 MiB 00:05:44.464 element at address: 0x200027e00000 with size: 0.410034 MiB 00:05:44.464 element at address: 0x200003a00000 with size: 0.355530 MiB 00:05:44.464 list of standard malloc elements. size: 199.218079 MiB 00:05:44.464 element at address: 0x20000b3fff80 with size: 132.000122 MiB 00:05:44.464 element at address: 0x2000071fff80 with size: 64.000122 MiB 00:05:44.464 element at address: 0x200018efff80 with size: 1.000122 MiB 00:05:44.464 element at address: 0x2000190fff80 with size: 1.000122 MiB 00:05:44.464 element at address: 0x2000192fff80 with size: 1.000122 MiB 00:05:44.464 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:05:44.464 element at address: 0x2000192eff00 with size: 0.062622 MiB 00:05:44.464 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:05:44.464 element at address: 0x2000192efdc0 with size: 0.000305 MiB 00:05:44.464 element at address: 0x2000002d7740 with size: 0.000183 MiB 00:05:44.464 element at address: 0x2000002d7800 with size: 0.000183 MiB 00:05:44.464 element at address: 0x2000002d78c0 with size: 0.000183 MiB 00:05:44.464 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:05:44.464 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:05:44.464 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:05:44.464 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:05:44.464 element at address: 0x20000087ce00 with size: 0.000183 MiB 00:05:44.464 element at address: 0x20000087cec0 with size: 0.000183 MiB 00:05:44.464 element at address: 0x2000008fd180 with size: 0.000183 MiB 00:05:44.464 element at address: 0x200003a5b040 with size: 0.000183 MiB 00:05:44.464 element at address: 0x200003adb300 with size: 0.000183 MiB 00:05:44.464 element at address: 0x200003adb500 with size: 0.000183 MiB 00:05:44.464 element at address: 0x200003adf7c0 with size: 0.000183 MiB 00:05:44.464 element at address: 0x200003affa80 with size: 0.000183 MiB 00:05:44.464 element at address: 0x200003affb40 with size: 0.000183 MiB 00:05:44.464 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:05:44.464 element at address: 0x2000070fdd80 with size: 0.000183 MiB 00:05:44.464 element at address: 0x20000b27da00 with size: 0.000183 MiB 00:05:44.464 element at address: 0x20000b27dac0 with size: 0.000183 MiB 00:05:44.464 element at address: 0x20000b2fdd80 with size: 0.000183 MiB 00:05:44.464 element at address: 0x2000138fa8c0 with size: 0.000183 MiB 00:05:44.464 element at address: 0x2000192efc40 with size: 0.000183 MiB 00:05:44.464 element at address: 0x2000192efd00 with size: 0.000183 MiB 00:05:44.464 element at address: 0x2000194bc740 with size: 0.000183 MiB 00:05:44.464 element at address: 0x20001aa95380 with size: 0.000183 MiB 00:05:44.464 element at address: 0x20001aa95440 with size: 0.000183 MiB 00:05:44.464 element at address: 0x200027e68f80 with size: 0.000183 MiB 00:05:44.464 element at address: 0x200027e69040 with size: 0.000183 MiB 00:05:44.464 element at address: 0x200027e6fc40 with size: 0.000183 MiB 00:05:44.464 element at address: 0x200027e6fe40 with size: 0.000183 MiB 00:05:44.464 element at address: 0x200027e6ff00 with size: 0.000183 MiB 00:05:44.464 list of memzone associated elements. size: 602.262573 MiB 00:05:44.464 element at address: 0x20001aa95500 with size: 211.416748 MiB 00:05:44.464 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:05:44.464 element at address: 0x200027e6ffc0 with size: 157.562561 MiB 00:05:44.464 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:05:44.464 element at address: 0x2000139fab80 with size: 84.020630 MiB 00:05:44.464 associated memzone info: size: 84.020508 MiB name: MP_bdev_io_1017359_0 00:05:44.464 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:05:44.464 associated memzone info: size: 48.002930 MiB name: MP_evtpool_1017359_0 00:05:44.464 element at address: 0x200003fff380 with size: 48.003052 MiB 00:05:44.464 associated memzone info: size: 48.002930 MiB name: MP_msgpool_1017359_0 00:05:44.465 element at address: 0x2000195be940 with size: 20.255554 MiB 00:05:44.465 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:05:44.465 element at address: 0x200031dfeb40 with size: 18.005066 MiB 00:05:44.465 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:05:44.465 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:05:44.465 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_1017359 00:05:44.465 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:05:44.465 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_1017359 00:05:44.465 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:05:44.465 associated memzone info: size: 1.007996 MiB name: MP_evtpool_1017359 00:05:44.465 element at address: 0x20000b2fde40 with size: 1.008118 MiB 00:05:44.465 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:05:44.465 element at address: 0x2000194bc800 with size: 1.008118 MiB 00:05:44.465 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:05:44.465 element at address: 0x2000070fde40 with size: 1.008118 MiB 00:05:44.465 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:05:44.465 element at address: 0x2000008fd240 with size: 1.008118 MiB 00:05:44.465 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:05:44.465 element at address: 0x200003eff180 with size: 1.000488 MiB 00:05:44.465 associated memzone info: size: 1.000366 MiB name: RG_ring_0_1017359 00:05:44.465 element at address: 0x200003affc00 with size: 1.000488 MiB 00:05:44.465 associated memzone info: size: 1.000366 MiB name: RG_ring_1_1017359 00:05:44.465 element at address: 0x2000138fa980 with size: 1.000488 MiB 00:05:44.465 associated memzone info: size: 1.000366 MiB name: RG_ring_4_1017359 00:05:44.465 element at address: 0x200031cfe940 with size: 1.000488 MiB 00:05:44.465 associated memzone info: size: 1.000366 MiB name: RG_ring_5_1017359 00:05:44.465 element at address: 0x200003a5b100 with size: 0.500488 MiB 00:05:44.465 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_1017359 00:05:44.465 element at address: 0x20000b27db80 with size: 0.500488 MiB 00:05:44.465 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:05:44.465 element at address: 0x20000087cf80 with size: 0.500488 MiB 00:05:44.465 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:05:44.465 element at address: 0x20001947c540 with size: 0.250488 MiB 00:05:44.465 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:05:44.465 element at address: 0x200003adf880 with size: 0.125488 MiB 00:05:44.465 associated memzone info: size: 0.125366 MiB name: RG_ring_2_1017359 00:05:44.465 element at address: 0x2000070f5b80 with size: 0.031738 MiB 00:05:44.465 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:05:44.465 element at address: 0x200027e69100 with size: 0.023743 MiB 00:05:44.465 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:05:44.465 element at address: 0x200003adb5c0 with size: 0.016113 MiB 00:05:44.465 associated memzone info: size: 0.015991 MiB name: RG_ring_3_1017359 00:05:44.465 element at address: 0x200027e6f240 with size: 0.002441 MiB 00:05:44.465 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:05:44.465 element at address: 0x2000002d7980 with size: 0.000305 MiB 00:05:44.465 associated memzone info: size: 0.000183 MiB name: MP_msgpool_1017359 00:05:44.465 element at address: 0x200003adb3c0 with size: 0.000305 MiB 00:05:44.465 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_1017359 00:05:44.465 element at address: 0x200027e6fd00 with size: 0.000305 MiB 00:05:44.465 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:05:44.465 01:06:52 -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:05:44.465 01:06:52 -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 1017359 00:05:44.465 01:06:52 -- common/autotest_common.sh@936 -- # '[' -z 1017359 ']' 00:05:44.465 01:06:52 -- common/autotest_common.sh@940 -- # kill -0 1017359 00:05:44.465 01:06:52 -- common/autotest_common.sh@941 -- # uname 00:05:44.465 01:06:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:44.465 01:06:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1017359 00:05:44.465 01:06:52 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:44.465 01:06:52 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:44.465 01:06:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1017359' 00:05:44.465 killing process with pid 1017359 00:05:44.465 01:06:52 -- common/autotest_common.sh@955 -- # kill 1017359 00:05:44.465 01:06:52 -- common/autotest_common.sh@960 -- # wait 1017359 00:05:45.031 00:05:45.031 real 0m1.749s 00:05:45.031 user 0m1.946s 00:05:45.031 sys 0m0.484s 00:05:45.031 01:06:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:45.031 01:06:52 -- common/autotest_common.sh@10 -- # set +x 00:05:45.031 ************************************ 00:05:45.031 END TEST dpdk_mem_utility 00:05:45.031 ************************************ 00:05:45.031 01:06:53 -- spdk/autotest.sh@174 -- # run_test event /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:05:45.031 01:06:53 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:45.031 01:06:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:45.031 01:06:53 -- common/autotest_common.sh@10 -- # set +x 00:05:45.031 ************************************ 00:05:45.031 START TEST event 00:05:45.031 ************************************ 00:05:45.031 01:06:53 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:05:45.031 * Looking for test storage... 00:05:45.031 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:05:45.031 01:06:53 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:45.031 01:06:53 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:45.031 01:06:53 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:45.031 01:06:53 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:45.031 01:06:53 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:45.031 01:06:53 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:45.031 01:06:53 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:45.031 01:06:53 -- scripts/common.sh@335 -- # IFS=.-: 00:05:45.031 01:06:53 -- scripts/common.sh@335 -- # read -ra ver1 00:05:45.031 01:06:53 -- scripts/common.sh@336 -- # IFS=.-: 00:05:45.031 01:06:53 -- scripts/common.sh@336 -- # read -ra ver2 00:05:45.031 01:06:53 -- scripts/common.sh@337 -- # local 'op=<' 00:05:45.031 01:06:53 -- scripts/common.sh@339 -- # ver1_l=2 00:05:45.031 01:06:53 -- scripts/common.sh@340 -- # ver2_l=1 00:05:45.031 01:06:53 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:45.031 01:06:53 -- scripts/common.sh@343 -- # case "$op" in 00:05:45.031 01:06:53 -- scripts/common.sh@344 -- # : 1 00:05:45.031 01:06:53 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:45.031 01:06:53 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:45.031 01:06:53 -- scripts/common.sh@364 -- # decimal 1 00:05:45.031 01:06:53 -- scripts/common.sh@352 -- # local d=1 00:05:45.031 01:06:53 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:45.031 01:06:53 -- scripts/common.sh@354 -- # echo 1 00:05:45.032 01:06:53 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:45.032 01:06:53 -- scripts/common.sh@365 -- # decimal 2 00:05:45.032 01:06:53 -- scripts/common.sh@352 -- # local d=2 00:05:45.032 01:06:53 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:45.032 01:06:53 -- scripts/common.sh@354 -- # echo 2 00:05:45.032 01:06:53 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:45.032 01:06:53 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:45.032 01:06:53 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:45.032 01:06:53 -- scripts/common.sh@367 -- # return 0 00:05:45.032 01:06:53 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:45.032 01:06:53 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:45.032 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:45.032 --rc genhtml_branch_coverage=1 00:05:45.032 --rc genhtml_function_coverage=1 00:05:45.032 --rc genhtml_legend=1 00:05:45.032 --rc geninfo_all_blocks=1 00:05:45.032 --rc geninfo_unexecuted_blocks=1 00:05:45.032 00:05:45.032 ' 00:05:45.032 01:06:53 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:45.032 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:45.032 --rc genhtml_branch_coverage=1 00:05:45.032 --rc genhtml_function_coverage=1 00:05:45.032 --rc genhtml_legend=1 00:05:45.032 --rc geninfo_all_blocks=1 00:05:45.032 --rc geninfo_unexecuted_blocks=1 00:05:45.032 00:05:45.032 ' 00:05:45.032 01:06:53 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:45.032 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:45.032 --rc genhtml_branch_coverage=1 00:05:45.032 --rc genhtml_function_coverage=1 00:05:45.032 --rc genhtml_legend=1 00:05:45.032 --rc geninfo_all_blocks=1 00:05:45.032 --rc geninfo_unexecuted_blocks=1 00:05:45.032 00:05:45.032 ' 00:05:45.032 01:06:53 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:45.032 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:45.032 --rc genhtml_branch_coverage=1 00:05:45.032 --rc genhtml_function_coverage=1 00:05:45.032 --rc genhtml_legend=1 00:05:45.032 --rc geninfo_all_blocks=1 00:05:45.032 --rc geninfo_unexecuted_blocks=1 00:05:45.032 00:05:45.032 ' 00:05:45.032 01:06:53 -- event/event.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/nbd_common.sh 00:05:45.032 01:06:53 -- bdev/nbd_common.sh@6 -- # set -e 00:05:45.032 01:06:53 -- event/event.sh@45 -- # run_test event_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:05:45.032 01:06:53 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:05:45.032 01:06:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:45.032 01:06:53 -- common/autotest_common.sh@10 -- # set +x 00:05:45.032 ************************************ 00:05:45.032 START TEST event_perf 00:05:45.032 ************************************ 00:05:45.032 01:06:53 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:05:45.032 Running I/O for 1 seconds...[2024-11-20 01:06:53.159194] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:45.032 [2024-11-20 01:06:53.159269] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1017693 ] 00:05:45.032 EAL: No free 2048 kB hugepages reported on node 1 00:05:45.032 [2024-11-20 01:06:53.218301] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:05:45.290 [2024-11-20 01:06:53.310869] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:45.290 [2024-11-20 01:06:53.310926] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:45.290 [2024-11-20 01:06:53.311044] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:45.290 [2024-11-20 01:06:53.311047] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:46.224 Running I/O for 1 seconds... 00:05:46.224 lcore 0: 226075 00:05:46.224 lcore 1: 226073 00:05:46.224 lcore 2: 226073 00:05:46.224 lcore 3: 226075 00:05:46.224 done. 00:05:46.224 00:05:46.224 real 0m1.250s 00:05:46.224 user 0m4.159s 00:05:46.224 sys 0m0.086s 00:05:46.224 01:06:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:46.224 01:06:54 -- common/autotest_common.sh@10 -- # set +x 00:05:46.224 ************************************ 00:05:46.224 END TEST event_perf 00:05:46.224 ************************************ 00:05:46.224 01:06:54 -- event/event.sh@46 -- # run_test event_reactor /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:05:46.224 01:06:54 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:05:46.224 01:06:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:46.225 01:06:54 -- common/autotest_common.sh@10 -- # set +x 00:05:46.225 ************************************ 00:05:46.225 START TEST event_reactor 00:05:46.225 ************************************ 00:05:46.225 01:06:54 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:05:46.225 [2024-11-20 01:06:54.438196] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:46.225 [2024-11-20 01:06:54.438283] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1017850 ] 00:05:46.483 EAL: No free 2048 kB hugepages reported on node 1 00:05:46.483 [2024-11-20 01:06:54.503741] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:46.483 [2024-11-20 01:06:54.591051] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:47.857 test_start 00:05:47.857 oneshot 00:05:47.857 tick 100 00:05:47.857 tick 100 00:05:47.857 tick 250 00:05:47.857 tick 100 00:05:47.857 tick 100 00:05:47.857 tick 100 00:05:47.857 tick 250 00:05:47.857 tick 500 00:05:47.857 tick 100 00:05:47.857 tick 100 00:05:47.857 tick 250 00:05:47.857 tick 100 00:05:47.857 tick 100 00:05:47.857 test_end 00:05:47.857 00:05:47.857 real 0m1.250s 00:05:47.857 user 0m1.157s 00:05:47.857 sys 0m0.088s 00:05:47.857 01:06:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:47.857 01:06:55 -- common/autotest_common.sh@10 -- # set +x 00:05:47.857 ************************************ 00:05:47.857 END TEST event_reactor 00:05:47.857 ************************************ 00:05:47.857 01:06:55 -- event/event.sh@47 -- # run_test event_reactor_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:05:47.857 01:06:55 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:05:47.857 01:06:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:47.857 01:06:55 -- common/autotest_common.sh@10 -- # set +x 00:05:47.857 ************************************ 00:05:47.857 START TEST event_reactor_perf 00:05:47.857 ************************************ 00:05:47.857 01:06:55 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:05:47.857 [2024-11-20 01:06:55.717421] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:47.858 [2024-11-20 01:06:55.717507] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1018006 ] 00:05:47.858 EAL: No free 2048 kB hugepages reported on node 1 00:05:47.858 [2024-11-20 01:06:55.779756] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:47.858 [2024-11-20 01:06:55.866875] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:48.791 test_start 00:05:48.791 test_end 00:05:48.791 Performance: 351238 events per second 00:05:48.791 00:05:48.791 real 0m1.246s 00:05:48.791 user 0m1.164s 00:05:48.791 sys 0m0.077s 00:05:48.791 01:06:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:48.791 01:06:56 -- common/autotest_common.sh@10 -- # set +x 00:05:48.791 ************************************ 00:05:48.791 END TEST event_reactor_perf 00:05:48.791 ************************************ 00:05:48.791 01:06:56 -- event/event.sh@49 -- # uname -s 00:05:48.791 01:06:56 -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:05:48.791 01:06:56 -- event/event.sh@50 -- # run_test event_scheduler /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:05:48.791 01:06:56 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:48.791 01:06:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:48.791 01:06:56 -- common/autotest_common.sh@10 -- # set +x 00:05:48.791 ************************************ 00:05:48.791 START TEST event_scheduler 00:05:48.792 ************************************ 00:05:48.792 01:06:56 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:05:49.050 * Looking for test storage... 00:05:49.050 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler 00:05:49.051 01:06:57 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:49.051 01:06:57 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:49.051 01:06:57 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:49.051 01:06:57 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:49.051 01:06:57 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:49.051 01:06:57 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:49.051 01:06:57 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:49.051 01:06:57 -- scripts/common.sh@335 -- # IFS=.-: 00:05:49.051 01:06:57 -- scripts/common.sh@335 -- # read -ra ver1 00:05:49.051 01:06:57 -- scripts/common.sh@336 -- # IFS=.-: 00:05:49.051 01:06:57 -- scripts/common.sh@336 -- # read -ra ver2 00:05:49.051 01:06:57 -- scripts/common.sh@337 -- # local 'op=<' 00:05:49.051 01:06:57 -- scripts/common.sh@339 -- # ver1_l=2 00:05:49.051 01:06:57 -- scripts/common.sh@340 -- # ver2_l=1 00:05:49.051 01:06:57 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:49.051 01:06:57 -- scripts/common.sh@343 -- # case "$op" in 00:05:49.051 01:06:57 -- scripts/common.sh@344 -- # : 1 00:05:49.051 01:06:57 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:49.051 01:06:57 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:49.051 01:06:57 -- scripts/common.sh@364 -- # decimal 1 00:05:49.051 01:06:57 -- scripts/common.sh@352 -- # local d=1 00:05:49.051 01:06:57 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:49.051 01:06:57 -- scripts/common.sh@354 -- # echo 1 00:05:49.051 01:06:57 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:49.051 01:06:57 -- scripts/common.sh@365 -- # decimal 2 00:05:49.051 01:06:57 -- scripts/common.sh@352 -- # local d=2 00:05:49.051 01:06:57 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:49.051 01:06:57 -- scripts/common.sh@354 -- # echo 2 00:05:49.051 01:06:57 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:49.051 01:06:57 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:49.051 01:06:57 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:49.051 01:06:57 -- scripts/common.sh@367 -- # return 0 00:05:49.051 01:06:57 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:49.051 01:06:57 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:49.051 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:49.051 --rc genhtml_branch_coverage=1 00:05:49.051 --rc genhtml_function_coverage=1 00:05:49.051 --rc genhtml_legend=1 00:05:49.051 --rc geninfo_all_blocks=1 00:05:49.051 --rc geninfo_unexecuted_blocks=1 00:05:49.051 00:05:49.051 ' 00:05:49.051 01:06:57 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:49.051 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:49.051 --rc genhtml_branch_coverage=1 00:05:49.051 --rc genhtml_function_coverage=1 00:05:49.051 --rc genhtml_legend=1 00:05:49.051 --rc geninfo_all_blocks=1 00:05:49.051 --rc geninfo_unexecuted_blocks=1 00:05:49.051 00:05:49.051 ' 00:05:49.051 01:06:57 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:49.051 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:49.051 --rc genhtml_branch_coverage=1 00:05:49.051 --rc genhtml_function_coverage=1 00:05:49.051 --rc genhtml_legend=1 00:05:49.051 --rc geninfo_all_blocks=1 00:05:49.051 --rc geninfo_unexecuted_blocks=1 00:05:49.051 00:05:49.051 ' 00:05:49.051 01:06:57 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:49.051 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:49.051 --rc genhtml_branch_coverage=1 00:05:49.051 --rc genhtml_function_coverage=1 00:05:49.051 --rc genhtml_legend=1 00:05:49.051 --rc geninfo_all_blocks=1 00:05:49.051 --rc geninfo_unexecuted_blocks=1 00:05:49.051 00:05:49.051 ' 00:05:49.051 01:06:57 -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:05:49.051 01:06:57 -- scheduler/scheduler.sh@35 -- # scheduler_pid=1018199 00:05:49.051 01:06:57 -- scheduler/scheduler.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:05:49.051 01:06:57 -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:05:49.051 01:06:57 -- scheduler/scheduler.sh@37 -- # waitforlisten 1018199 00:05:49.051 01:06:57 -- common/autotest_common.sh@829 -- # '[' -z 1018199 ']' 00:05:49.051 01:06:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:49.051 01:06:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:49.051 01:06:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:49.051 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:49.051 01:06:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:49.051 01:06:57 -- common/autotest_common.sh@10 -- # set +x 00:05:49.051 [2024-11-20 01:06:57.154201] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:49.051 [2024-11-20 01:06:57.154280] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1018199 ] 00:05:49.051 EAL: No free 2048 kB hugepages reported on node 1 00:05:49.051 [2024-11-20 01:06:57.213807] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:05:49.309 [2024-11-20 01:06:57.301098] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:49.309 [2024-11-20 01:06:57.301138] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:49.309 [2024-11-20 01:06:57.301160] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:49.309 [2024-11-20 01:06:57.301164] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:49.310 01:06:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:49.310 01:06:57 -- common/autotest_common.sh@862 -- # return 0 00:05:49.310 01:06:57 -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:05:49.310 01:06:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:49.310 01:06:57 -- common/autotest_common.sh@10 -- # set +x 00:05:49.310 POWER: Env isn't set yet! 00:05:49.310 POWER: Attempting to initialise ACPI cpufreq power management... 00:05:49.310 POWER: failed to open /sys/devices/system/cpu/cpu%u/cpufreq/scaling_available_frequencies 00:05:49.310 POWER: Cannot get available frequencies of lcore 0 00:05:49.310 POWER: Attempting to initialise PSTAT power management... 00:05:49.310 POWER: Power management governor of lcore 0 has been set to 'performance' successfully 00:05:49.310 POWER: Initialized successfully for lcore 0 power management 00:05:49.310 POWER: Power management governor of lcore 1 has been set to 'performance' successfully 00:05:49.310 POWER: Initialized successfully for lcore 1 power management 00:05:49.310 POWER: Power management governor of lcore 2 has been set to 'performance' successfully 00:05:49.310 POWER: Initialized successfully for lcore 2 power management 00:05:49.310 POWER: Power management governor of lcore 3 has been set to 'performance' successfully 00:05:49.310 POWER: Initialized successfully for lcore 3 power management 00:05:49.310 [2024-11-20 01:06:57.424270] scheduler_dynamic.c: 387:set_opts: *NOTICE*: Setting scheduler load limit to 20 00:05:49.310 [2024-11-20 01:06:57.424288] scheduler_dynamic.c: 389:set_opts: *NOTICE*: Setting scheduler core limit to 80 00:05:49.310 [2024-11-20 01:06:57.424299] scheduler_dynamic.c: 391:set_opts: *NOTICE*: Setting scheduler core busy to 95 00:05:49.310 01:06:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:49.310 01:06:57 -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:05:49.310 01:06:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:49.310 01:06:57 -- common/autotest_common.sh@10 -- # set +x 00:05:49.310 [2024-11-20 01:06:57.522271] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:05:49.310 01:06:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:49.310 01:06:57 -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:05:49.310 01:06:57 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:49.310 01:06:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:49.310 01:06:57 -- common/autotest_common.sh@10 -- # set +x 00:05:49.568 ************************************ 00:05:49.568 START TEST scheduler_create_thread 00:05:49.568 ************************************ 00:05:49.568 01:06:57 -- common/autotest_common.sh@1114 -- # scheduler_create_thread 00:05:49.568 01:06:57 -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:05:49.568 01:06:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:49.568 01:06:57 -- common/autotest_common.sh@10 -- # set +x 00:05:49.568 2 00:05:49.568 01:06:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:49.568 01:06:57 -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:05:49.568 01:06:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:49.568 01:06:57 -- common/autotest_common.sh@10 -- # set +x 00:05:49.568 3 00:05:49.568 01:06:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:49.568 01:06:57 -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:05:49.568 01:06:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:49.568 01:06:57 -- common/autotest_common.sh@10 -- # set +x 00:05:49.568 4 00:05:49.568 01:06:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:49.568 01:06:57 -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:05:49.568 01:06:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:49.568 01:06:57 -- common/autotest_common.sh@10 -- # set +x 00:05:49.568 5 00:05:49.568 01:06:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:49.568 01:06:57 -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:05:49.568 01:06:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:49.568 01:06:57 -- common/autotest_common.sh@10 -- # set +x 00:05:49.568 6 00:05:49.568 01:06:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:49.568 01:06:57 -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:05:49.568 01:06:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:49.568 01:06:57 -- common/autotest_common.sh@10 -- # set +x 00:05:49.568 7 00:05:49.568 01:06:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:49.568 01:06:57 -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:05:49.568 01:06:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:49.568 01:06:57 -- common/autotest_common.sh@10 -- # set +x 00:05:49.568 8 00:05:49.568 01:06:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:49.568 01:06:57 -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:05:49.568 01:06:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:49.568 01:06:57 -- common/autotest_common.sh@10 -- # set +x 00:05:49.568 9 00:05:49.568 01:06:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:49.568 01:06:57 -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:05:49.568 01:06:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:49.568 01:06:57 -- common/autotest_common.sh@10 -- # set +x 00:05:49.568 10 00:05:49.568 01:06:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:49.568 01:06:57 -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:05:49.568 01:06:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:49.568 01:06:57 -- common/autotest_common.sh@10 -- # set +x 00:05:49.568 01:06:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:49.568 01:06:57 -- scheduler/scheduler.sh@22 -- # thread_id=11 00:05:49.568 01:06:57 -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:05:49.568 01:06:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:49.568 01:06:57 -- common/autotest_common.sh@10 -- # set +x 00:05:49.568 01:06:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:49.568 01:06:57 -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:05:49.568 01:06:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:49.568 01:06:57 -- common/autotest_common.sh@10 -- # set +x 00:05:50.963 01:06:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:50.963 01:06:59 -- scheduler/scheduler.sh@25 -- # thread_id=12 00:05:50.963 01:06:59 -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:05:50.963 01:06:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:50.963 01:06:59 -- common/autotest_common.sh@10 -- # set +x 00:05:52.334 01:07:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:52.334 00:05:52.334 real 0m2.618s 00:05:52.334 user 0m0.011s 00:05:52.334 sys 0m0.004s 00:05:52.334 01:07:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:52.334 01:07:00 -- common/autotest_common.sh@10 -- # set +x 00:05:52.334 ************************************ 00:05:52.334 END TEST scheduler_create_thread 00:05:52.334 ************************************ 00:05:52.334 01:07:00 -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:05:52.334 01:07:00 -- scheduler/scheduler.sh@46 -- # killprocess 1018199 00:05:52.334 01:07:00 -- common/autotest_common.sh@936 -- # '[' -z 1018199 ']' 00:05:52.334 01:07:00 -- common/autotest_common.sh@940 -- # kill -0 1018199 00:05:52.334 01:07:00 -- common/autotest_common.sh@941 -- # uname 00:05:52.334 01:07:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:52.334 01:07:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1018199 00:05:52.334 01:07:00 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:05:52.334 01:07:00 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:05:52.334 01:07:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1018199' 00:05:52.334 killing process with pid 1018199 00:05:52.334 01:07:00 -- common/autotest_common.sh@955 -- # kill 1018199 00:05:52.334 01:07:00 -- common/autotest_common.sh@960 -- # wait 1018199 00:05:52.592 [2024-11-20 01:07:00.625663] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:05:52.592 POWER: Power management governor of lcore 0 has been set to 'userspace' successfully 00:05:52.592 POWER: Power management of lcore 0 has exited from 'performance' mode and been set back to the original 00:05:52.592 POWER: Power management governor of lcore 1 has been set to 'schedutil' successfully 00:05:52.592 POWER: Power management of lcore 1 has exited from 'performance' mode and been set back to the original 00:05:52.592 POWER: Power management governor of lcore 2 has been set to 'schedutil' successfully 00:05:52.592 POWER: Power management of lcore 2 has exited from 'performance' mode and been set back to the original 00:05:52.592 POWER: Power management governor of lcore 3 has been set to 'schedutil' successfully 00:05:52.592 POWER: Power management of lcore 3 has exited from 'performance' mode and been set back to the original 00:05:52.850 00:05:52.850 real 0m3.874s 00:05:52.850 user 0m5.905s 00:05:52.850 sys 0m0.317s 00:05:52.850 01:07:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:52.850 01:07:00 -- common/autotest_common.sh@10 -- # set +x 00:05:52.850 ************************************ 00:05:52.850 END TEST event_scheduler 00:05:52.850 ************************************ 00:05:52.850 01:07:00 -- event/event.sh@51 -- # modprobe -n nbd 00:05:52.850 01:07:00 -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:05:52.850 01:07:00 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:52.850 01:07:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:52.850 01:07:00 -- common/autotest_common.sh@10 -- # set +x 00:05:52.850 ************************************ 00:05:52.850 START TEST app_repeat 00:05:52.850 ************************************ 00:05:52.850 01:07:00 -- common/autotest_common.sh@1114 -- # app_repeat_test 00:05:52.850 01:07:00 -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:52.850 01:07:00 -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:52.850 01:07:00 -- event/event.sh@13 -- # local nbd_list 00:05:52.850 01:07:00 -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:52.850 01:07:00 -- event/event.sh@14 -- # local bdev_list 00:05:52.850 01:07:00 -- event/event.sh@15 -- # local repeat_times=4 00:05:52.850 01:07:00 -- event/event.sh@17 -- # modprobe nbd 00:05:52.850 01:07:00 -- event/event.sh@19 -- # repeat_pid=1018780 00:05:52.850 01:07:00 -- event/event.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:05:52.850 01:07:00 -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:05:52.850 01:07:00 -- event/event.sh@21 -- # echo 'Process app_repeat pid: 1018780' 00:05:52.850 Process app_repeat pid: 1018780 00:05:52.850 01:07:00 -- event/event.sh@23 -- # for i in {0..2} 00:05:52.850 01:07:00 -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:05:52.850 spdk_app_start Round 0 00:05:52.850 01:07:00 -- event/event.sh@25 -- # waitforlisten 1018780 /var/tmp/spdk-nbd.sock 00:05:52.850 01:07:00 -- common/autotest_common.sh@829 -- # '[' -z 1018780 ']' 00:05:52.850 01:07:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:52.850 01:07:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:52.850 01:07:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:52.850 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:52.850 01:07:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:52.850 01:07:00 -- common/autotest_common.sh@10 -- # set +x 00:05:52.850 [2024-11-20 01:07:00.908809] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:52.850 [2024-11-20 01:07:00.908892] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1018780 ] 00:05:52.850 EAL: No free 2048 kB hugepages reported on node 1 00:05:52.850 [2024-11-20 01:07:00.965378] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:52.850 [2024-11-20 01:07:01.053727] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:52.850 [2024-11-20 01:07:01.053727] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:53.843 01:07:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:53.843 01:07:01 -- common/autotest_common.sh@862 -- # return 0 00:05:53.843 01:07:01 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:54.101 Malloc0 00:05:54.101 01:07:02 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:54.360 Malloc1 00:05:54.360 01:07:02 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:54.360 01:07:02 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:54.360 01:07:02 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:54.360 01:07:02 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:05:54.360 01:07:02 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:54.360 01:07:02 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:05:54.360 01:07:02 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:54.360 01:07:02 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:54.360 01:07:02 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:54.360 01:07:02 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:05:54.360 01:07:02 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:54.360 01:07:02 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:05:54.360 01:07:02 -- bdev/nbd_common.sh@12 -- # local i 00:05:54.360 01:07:02 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:05:54.360 01:07:02 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:54.360 01:07:02 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:05:54.618 /dev/nbd0 00:05:54.618 01:07:02 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:05:54.618 01:07:02 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:05:54.618 01:07:02 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:05:54.618 01:07:02 -- common/autotest_common.sh@867 -- # local i 00:05:54.618 01:07:02 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:05:54.618 01:07:02 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:05:54.618 01:07:02 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:05:54.618 01:07:02 -- common/autotest_common.sh@871 -- # break 00:05:54.618 01:07:02 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:05:54.618 01:07:02 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:05:54.618 01:07:02 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:54.618 1+0 records in 00:05:54.618 1+0 records out 00:05:54.618 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000257911 s, 15.9 MB/s 00:05:54.618 01:07:02 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:54.618 01:07:02 -- common/autotest_common.sh@884 -- # size=4096 00:05:54.618 01:07:02 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:54.618 01:07:02 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:05:54.618 01:07:02 -- common/autotest_common.sh@887 -- # return 0 00:05:54.618 01:07:02 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:54.618 01:07:02 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:54.618 01:07:02 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:05:54.875 /dev/nbd1 00:05:54.875 01:07:03 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:05:54.875 01:07:03 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:05:54.875 01:07:03 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:05:54.875 01:07:03 -- common/autotest_common.sh@867 -- # local i 00:05:54.875 01:07:03 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:05:54.875 01:07:03 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:05:54.875 01:07:03 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:05:54.875 01:07:03 -- common/autotest_common.sh@871 -- # break 00:05:54.875 01:07:03 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:05:54.875 01:07:03 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:05:54.875 01:07:03 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:54.875 1+0 records in 00:05:54.875 1+0 records out 00:05:54.875 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000177088 s, 23.1 MB/s 00:05:54.875 01:07:03 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:54.875 01:07:03 -- common/autotest_common.sh@884 -- # size=4096 00:05:54.875 01:07:03 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:54.875 01:07:03 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:05:54.875 01:07:03 -- common/autotest_common.sh@887 -- # return 0 00:05:54.875 01:07:03 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:54.875 01:07:03 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:54.875 01:07:03 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:54.875 01:07:03 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:54.875 01:07:03 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:55.133 01:07:03 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:05:55.133 { 00:05:55.133 "nbd_device": "/dev/nbd0", 00:05:55.133 "bdev_name": "Malloc0" 00:05:55.133 }, 00:05:55.133 { 00:05:55.133 "nbd_device": "/dev/nbd1", 00:05:55.133 "bdev_name": "Malloc1" 00:05:55.133 } 00:05:55.133 ]' 00:05:55.133 01:07:03 -- bdev/nbd_common.sh@64 -- # echo '[ 00:05:55.133 { 00:05:55.133 "nbd_device": "/dev/nbd0", 00:05:55.133 "bdev_name": "Malloc0" 00:05:55.133 }, 00:05:55.133 { 00:05:55.133 "nbd_device": "/dev/nbd1", 00:05:55.133 "bdev_name": "Malloc1" 00:05:55.133 } 00:05:55.133 ]' 00:05:55.133 01:07:03 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:55.133 01:07:03 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:05:55.133 /dev/nbd1' 00:05:55.133 01:07:03 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:05:55.133 /dev/nbd1' 00:05:55.133 01:07:03 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:55.133 01:07:03 -- bdev/nbd_common.sh@65 -- # count=2 00:05:55.133 01:07:03 -- bdev/nbd_common.sh@66 -- # echo 2 00:05:55.133 01:07:03 -- bdev/nbd_common.sh@95 -- # count=2 00:05:55.133 01:07:03 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:05:55.133 01:07:03 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:05:55.133 01:07:03 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:55.133 01:07:03 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:55.133 01:07:03 -- bdev/nbd_common.sh@71 -- # local operation=write 00:05:55.133 01:07:03 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:55.133 01:07:03 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:05:55.133 01:07:03 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:05:55.391 256+0 records in 00:05:55.391 256+0 records out 00:05:55.391 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00539455 s, 194 MB/s 00:05:55.391 01:07:03 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:55.391 01:07:03 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:05:55.391 256+0 records in 00:05:55.391 256+0 records out 00:05:55.391 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226207 s, 46.4 MB/s 00:05:55.391 01:07:03 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:55.391 01:07:03 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:05:55.391 256+0 records in 00:05:55.391 256+0 records out 00:05:55.391 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209886 s, 50.0 MB/s 00:05:55.391 01:07:03 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:05:55.391 01:07:03 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:55.391 01:07:03 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:55.391 01:07:03 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:05:55.391 01:07:03 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:55.391 01:07:03 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:05:55.391 01:07:03 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:05:55.391 01:07:03 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:55.391 01:07:03 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:05:55.391 01:07:03 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:55.391 01:07:03 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:05:55.391 01:07:03 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:55.391 01:07:03 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:05:55.391 01:07:03 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:55.391 01:07:03 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:55.391 01:07:03 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:05:55.391 01:07:03 -- bdev/nbd_common.sh@51 -- # local i 00:05:55.391 01:07:03 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:55.391 01:07:03 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:05:55.649 01:07:03 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:05:55.649 01:07:03 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:05:55.649 01:07:03 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:05:55.649 01:07:03 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:55.649 01:07:03 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:55.649 01:07:03 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:05:55.649 01:07:03 -- bdev/nbd_common.sh@41 -- # break 00:05:55.649 01:07:03 -- bdev/nbd_common.sh@45 -- # return 0 00:05:55.649 01:07:03 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:55.649 01:07:03 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:05:55.907 01:07:03 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:05:55.907 01:07:03 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:05:55.907 01:07:03 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:05:55.907 01:07:03 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:55.907 01:07:03 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:55.907 01:07:03 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:05:55.907 01:07:03 -- bdev/nbd_common.sh@41 -- # break 00:05:55.907 01:07:03 -- bdev/nbd_common.sh@45 -- # return 0 00:05:55.907 01:07:03 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:55.907 01:07:03 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:55.907 01:07:03 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:56.164 01:07:04 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:05:56.164 01:07:04 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:05:56.164 01:07:04 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:56.165 01:07:04 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:05:56.165 01:07:04 -- bdev/nbd_common.sh@65 -- # echo '' 00:05:56.165 01:07:04 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:56.165 01:07:04 -- bdev/nbd_common.sh@65 -- # true 00:05:56.165 01:07:04 -- bdev/nbd_common.sh@65 -- # count=0 00:05:56.165 01:07:04 -- bdev/nbd_common.sh@66 -- # echo 0 00:05:56.165 01:07:04 -- bdev/nbd_common.sh@104 -- # count=0 00:05:56.165 01:07:04 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:05:56.165 01:07:04 -- bdev/nbd_common.sh@109 -- # return 0 00:05:56.165 01:07:04 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:05:56.422 01:07:04 -- event/event.sh@35 -- # sleep 3 00:05:56.680 [2024-11-20 01:07:04.787115] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:56.680 [2024-11-20 01:07:04.874905] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:56.680 [2024-11-20 01:07:04.874905] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:56.938 [2024-11-20 01:07:04.936236] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:05:56.938 [2024-11-20 01:07:04.936311] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:05:59.473 01:07:07 -- event/event.sh@23 -- # for i in {0..2} 00:05:59.473 01:07:07 -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:05:59.473 spdk_app_start Round 1 00:05:59.473 01:07:07 -- event/event.sh@25 -- # waitforlisten 1018780 /var/tmp/spdk-nbd.sock 00:05:59.474 01:07:07 -- common/autotest_common.sh@829 -- # '[' -z 1018780 ']' 00:05:59.474 01:07:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:59.474 01:07:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:59.474 01:07:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:59.474 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:59.474 01:07:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:59.474 01:07:07 -- common/autotest_common.sh@10 -- # set +x 00:05:59.730 01:07:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:59.730 01:07:07 -- common/autotest_common.sh@862 -- # return 0 00:05:59.730 01:07:07 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:59.987 Malloc0 00:05:59.987 01:07:08 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:00.246 Malloc1 00:06:00.246 01:07:08 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:00.246 01:07:08 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:00.246 01:07:08 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:00.246 01:07:08 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:06:00.246 01:07:08 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:00.246 01:07:08 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:06:00.246 01:07:08 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:00.246 01:07:08 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:00.246 01:07:08 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:00.246 01:07:08 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:06:00.246 01:07:08 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:00.246 01:07:08 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:06:00.246 01:07:08 -- bdev/nbd_common.sh@12 -- # local i 00:06:00.246 01:07:08 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:06:00.246 01:07:08 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:00.246 01:07:08 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:06:00.503 /dev/nbd0 00:06:00.503 01:07:08 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:06:00.503 01:07:08 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:06:00.503 01:07:08 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:06:00.503 01:07:08 -- common/autotest_common.sh@867 -- # local i 00:06:00.503 01:07:08 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:00.503 01:07:08 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:00.503 01:07:08 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:06:00.503 01:07:08 -- common/autotest_common.sh@871 -- # break 00:06:00.503 01:07:08 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:00.503 01:07:08 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:00.503 01:07:08 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:00.503 1+0 records in 00:06:00.503 1+0 records out 00:06:00.503 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000177302 s, 23.1 MB/s 00:06:00.503 01:07:08 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:00.503 01:07:08 -- common/autotest_common.sh@884 -- # size=4096 00:06:00.503 01:07:08 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:00.503 01:07:08 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:00.503 01:07:08 -- common/autotest_common.sh@887 -- # return 0 00:06:00.503 01:07:08 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:00.503 01:07:08 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:00.503 01:07:08 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:06:00.761 /dev/nbd1 00:06:00.761 01:07:08 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:00.761 01:07:08 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:00.761 01:07:08 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:06:00.761 01:07:08 -- common/autotest_common.sh@867 -- # local i 00:06:00.761 01:07:08 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:00.761 01:07:08 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:00.761 01:07:08 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:06:00.761 01:07:08 -- common/autotest_common.sh@871 -- # break 00:06:00.761 01:07:08 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:00.761 01:07:08 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:00.761 01:07:08 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:00.761 1+0 records in 00:06:00.761 1+0 records out 00:06:00.761 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000184615 s, 22.2 MB/s 00:06:00.761 01:07:08 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:00.761 01:07:08 -- common/autotest_common.sh@884 -- # size=4096 00:06:00.761 01:07:08 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:00.761 01:07:08 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:00.761 01:07:08 -- common/autotest_common.sh@887 -- # return 0 00:06:00.761 01:07:08 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:00.761 01:07:08 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:00.761 01:07:08 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:00.761 01:07:08 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:00.761 01:07:08 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:01.019 01:07:09 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:01.019 { 00:06:01.019 "nbd_device": "/dev/nbd0", 00:06:01.019 "bdev_name": "Malloc0" 00:06:01.019 }, 00:06:01.019 { 00:06:01.019 "nbd_device": "/dev/nbd1", 00:06:01.019 "bdev_name": "Malloc1" 00:06:01.019 } 00:06:01.019 ]' 00:06:01.019 01:07:09 -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:01.019 { 00:06:01.019 "nbd_device": "/dev/nbd0", 00:06:01.019 "bdev_name": "Malloc0" 00:06:01.019 }, 00:06:01.019 { 00:06:01.019 "nbd_device": "/dev/nbd1", 00:06:01.019 "bdev_name": "Malloc1" 00:06:01.019 } 00:06:01.019 ]' 00:06:01.019 01:07:09 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:01.019 01:07:09 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:01.019 /dev/nbd1' 00:06:01.019 01:07:09 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:01.019 /dev/nbd1' 00:06:01.019 01:07:09 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:01.019 01:07:09 -- bdev/nbd_common.sh@65 -- # count=2 00:06:01.019 01:07:09 -- bdev/nbd_common.sh@66 -- # echo 2 00:06:01.019 01:07:09 -- bdev/nbd_common.sh@95 -- # count=2 00:06:01.019 01:07:09 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:01.019 01:07:09 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:01.019 01:07:09 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:01.019 01:07:09 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:01.019 01:07:09 -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:01.019 01:07:09 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:01.019 01:07:09 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:01.019 01:07:09 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:01.019 256+0 records in 00:06:01.019 256+0 records out 00:06:01.019 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00512712 s, 205 MB/s 00:06:01.019 01:07:09 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:01.019 01:07:09 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:01.276 256+0 records in 00:06:01.276 256+0 records out 00:06:01.276 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200025 s, 52.4 MB/s 00:06:01.276 01:07:09 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:01.276 01:07:09 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:01.276 256+0 records in 00:06:01.276 256+0 records out 00:06:01.276 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023304 s, 45.0 MB/s 00:06:01.276 01:07:09 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:01.276 01:07:09 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:01.276 01:07:09 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:01.276 01:07:09 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:01.276 01:07:09 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:01.276 01:07:09 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:01.276 01:07:09 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:01.276 01:07:09 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:01.276 01:07:09 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:01.276 01:07:09 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:01.276 01:07:09 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:01.276 01:07:09 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:01.276 01:07:09 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:01.276 01:07:09 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:01.276 01:07:09 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:01.276 01:07:09 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:01.276 01:07:09 -- bdev/nbd_common.sh@51 -- # local i 00:06:01.276 01:07:09 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:01.276 01:07:09 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:01.534 01:07:09 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:01.534 01:07:09 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:01.534 01:07:09 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:01.534 01:07:09 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:01.534 01:07:09 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:01.534 01:07:09 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:01.534 01:07:09 -- bdev/nbd_common.sh@41 -- # break 00:06:01.534 01:07:09 -- bdev/nbd_common.sh@45 -- # return 0 00:06:01.534 01:07:09 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:01.534 01:07:09 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:01.791 01:07:09 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:01.791 01:07:09 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:01.791 01:07:09 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:01.791 01:07:09 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:01.791 01:07:09 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:01.791 01:07:09 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:01.791 01:07:09 -- bdev/nbd_common.sh@41 -- # break 00:06:01.791 01:07:09 -- bdev/nbd_common.sh@45 -- # return 0 00:06:01.791 01:07:09 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:01.791 01:07:09 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:01.791 01:07:09 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:02.049 01:07:10 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:02.049 01:07:10 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:02.049 01:07:10 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:02.049 01:07:10 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:02.049 01:07:10 -- bdev/nbd_common.sh@65 -- # echo '' 00:06:02.049 01:07:10 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:02.049 01:07:10 -- bdev/nbd_common.sh@65 -- # true 00:06:02.049 01:07:10 -- bdev/nbd_common.sh@65 -- # count=0 00:06:02.049 01:07:10 -- bdev/nbd_common.sh@66 -- # echo 0 00:06:02.049 01:07:10 -- bdev/nbd_common.sh@104 -- # count=0 00:06:02.049 01:07:10 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:02.049 01:07:10 -- bdev/nbd_common.sh@109 -- # return 0 00:06:02.049 01:07:10 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:02.306 01:07:10 -- event/event.sh@35 -- # sleep 3 00:06:02.564 [2024-11-20 01:07:10.671459] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:02.564 [2024-11-20 01:07:10.762088] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:02.564 [2024-11-20 01:07:10.762095] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:02.821 [2024-11-20 01:07:10.818710] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:02.821 [2024-11-20 01:07:10.818764] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:05.347 01:07:13 -- event/event.sh@23 -- # for i in {0..2} 00:06:05.347 01:07:13 -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:06:05.347 spdk_app_start Round 2 00:06:05.347 01:07:13 -- event/event.sh@25 -- # waitforlisten 1018780 /var/tmp/spdk-nbd.sock 00:06:05.347 01:07:13 -- common/autotest_common.sh@829 -- # '[' -z 1018780 ']' 00:06:05.347 01:07:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:05.347 01:07:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:05.347 01:07:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:05.347 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:05.347 01:07:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:05.347 01:07:13 -- common/autotest_common.sh@10 -- # set +x 00:06:05.604 01:07:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:05.604 01:07:13 -- common/autotest_common.sh@862 -- # return 0 00:06:05.604 01:07:13 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:05.863 Malloc0 00:06:05.863 01:07:13 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:06.121 Malloc1 00:06:06.121 01:07:14 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:06.121 01:07:14 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:06.121 01:07:14 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:06.121 01:07:14 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:06:06.121 01:07:14 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:06.121 01:07:14 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:06:06.121 01:07:14 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:06.121 01:07:14 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:06.121 01:07:14 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:06.121 01:07:14 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:06:06.121 01:07:14 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:06.121 01:07:14 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:06:06.121 01:07:14 -- bdev/nbd_common.sh@12 -- # local i 00:06:06.121 01:07:14 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:06:06.121 01:07:14 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:06.121 01:07:14 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:06:06.379 /dev/nbd0 00:06:06.379 01:07:14 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:06:06.379 01:07:14 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:06:06.379 01:07:14 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:06:06.379 01:07:14 -- common/autotest_common.sh@867 -- # local i 00:06:06.379 01:07:14 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:06.379 01:07:14 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:06.379 01:07:14 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:06:06.379 01:07:14 -- common/autotest_common.sh@871 -- # break 00:06:06.379 01:07:14 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:06.379 01:07:14 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:06.379 01:07:14 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:06.379 1+0 records in 00:06:06.379 1+0 records out 00:06:06.379 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000152361 s, 26.9 MB/s 00:06:06.379 01:07:14 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:06.379 01:07:14 -- common/autotest_common.sh@884 -- # size=4096 00:06:06.379 01:07:14 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:06.379 01:07:14 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:06.379 01:07:14 -- common/autotest_common.sh@887 -- # return 0 00:06:06.379 01:07:14 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:06.379 01:07:14 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:06.379 01:07:14 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:06:06.637 /dev/nbd1 00:06:06.637 01:07:14 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:06.637 01:07:14 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:06.637 01:07:14 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:06:06.637 01:07:14 -- common/autotest_common.sh@867 -- # local i 00:06:06.637 01:07:14 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:06.637 01:07:14 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:06.637 01:07:14 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:06:06.637 01:07:14 -- common/autotest_common.sh@871 -- # break 00:06:06.637 01:07:14 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:06.637 01:07:14 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:06.637 01:07:14 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:06.637 1+0 records in 00:06:06.637 1+0 records out 00:06:06.637 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000187286 s, 21.9 MB/s 00:06:06.637 01:07:14 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:06.637 01:07:14 -- common/autotest_common.sh@884 -- # size=4096 00:06:06.637 01:07:14 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:06.637 01:07:14 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:06.637 01:07:14 -- common/autotest_common.sh@887 -- # return 0 00:06:06.637 01:07:14 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:06.637 01:07:14 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:06.637 01:07:14 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:06.637 01:07:14 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:06.637 01:07:14 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:06.895 01:07:15 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:06.895 { 00:06:06.895 "nbd_device": "/dev/nbd0", 00:06:06.895 "bdev_name": "Malloc0" 00:06:06.895 }, 00:06:06.895 { 00:06:06.895 "nbd_device": "/dev/nbd1", 00:06:06.895 "bdev_name": "Malloc1" 00:06:06.895 } 00:06:06.895 ]' 00:06:06.895 01:07:15 -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:06.895 { 00:06:06.895 "nbd_device": "/dev/nbd0", 00:06:06.895 "bdev_name": "Malloc0" 00:06:06.895 }, 00:06:06.895 { 00:06:06.895 "nbd_device": "/dev/nbd1", 00:06:06.895 "bdev_name": "Malloc1" 00:06:06.895 } 00:06:06.895 ]' 00:06:06.895 01:07:15 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:06.895 01:07:15 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:06.895 /dev/nbd1' 00:06:06.895 01:07:15 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:06.895 /dev/nbd1' 00:06:06.895 01:07:15 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:06.895 01:07:15 -- bdev/nbd_common.sh@65 -- # count=2 00:06:06.895 01:07:15 -- bdev/nbd_common.sh@66 -- # echo 2 00:06:06.895 01:07:15 -- bdev/nbd_common.sh@95 -- # count=2 00:06:06.895 01:07:15 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:06.895 01:07:15 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:06.895 01:07:15 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:06.895 01:07:15 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:06.895 01:07:15 -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:06.895 01:07:15 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:06.895 01:07:15 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:06.895 01:07:15 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:06.895 256+0 records in 00:06:06.895 256+0 records out 00:06:06.895 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00510068 s, 206 MB/s 00:06:06.895 01:07:15 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:06.895 01:07:15 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:07.153 256+0 records in 00:06:07.153 256+0 records out 00:06:07.153 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223419 s, 46.9 MB/s 00:06:07.153 01:07:15 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:07.153 01:07:15 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:07.153 256+0 records in 00:06:07.153 256+0 records out 00:06:07.153 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207834 s, 50.5 MB/s 00:06:07.153 01:07:15 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:07.153 01:07:15 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:07.153 01:07:15 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:07.153 01:07:15 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:07.154 01:07:15 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:07.154 01:07:15 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:07.154 01:07:15 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:07.154 01:07:15 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:07.154 01:07:15 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:07.154 01:07:15 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:07.154 01:07:15 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:07.154 01:07:15 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:07.154 01:07:15 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:07.154 01:07:15 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:07.154 01:07:15 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:07.154 01:07:15 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:07.154 01:07:15 -- bdev/nbd_common.sh@51 -- # local i 00:06:07.154 01:07:15 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:07.154 01:07:15 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:07.412 01:07:15 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:07.412 01:07:15 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:07.412 01:07:15 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:07.412 01:07:15 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:07.412 01:07:15 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:07.412 01:07:15 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:07.412 01:07:15 -- bdev/nbd_common.sh@41 -- # break 00:06:07.412 01:07:15 -- bdev/nbd_common.sh@45 -- # return 0 00:06:07.412 01:07:15 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:07.412 01:07:15 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:07.670 01:07:15 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:07.670 01:07:15 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:07.670 01:07:15 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:07.670 01:07:15 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:07.670 01:07:15 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:07.670 01:07:15 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:07.670 01:07:15 -- bdev/nbd_common.sh@41 -- # break 00:06:07.670 01:07:15 -- bdev/nbd_common.sh@45 -- # return 0 00:06:07.670 01:07:15 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:07.670 01:07:15 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:07.670 01:07:15 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:07.928 01:07:15 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:07.928 01:07:15 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:07.928 01:07:15 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:07.928 01:07:16 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:07.928 01:07:16 -- bdev/nbd_common.sh@65 -- # echo '' 00:06:07.928 01:07:16 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:07.928 01:07:16 -- bdev/nbd_common.sh@65 -- # true 00:06:07.928 01:07:16 -- bdev/nbd_common.sh@65 -- # count=0 00:06:07.928 01:07:16 -- bdev/nbd_common.sh@66 -- # echo 0 00:06:07.928 01:07:16 -- bdev/nbd_common.sh@104 -- # count=0 00:06:07.928 01:07:16 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:07.928 01:07:16 -- bdev/nbd_common.sh@109 -- # return 0 00:06:07.928 01:07:16 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:08.185 01:07:16 -- event/event.sh@35 -- # sleep 3 00:06:08.443 [2024-11-20 01:07:16.533202] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:08.443 [2024-11-20 01:07:16.620629] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:08.443 [2024-11-20 01:07:16.620634] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:08.700 [2024-11-20 01:07:16.682112] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:08.700 [2024-11-20 01:07:16.682204] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:11.248 01:07:19 -- event/event.sh@38 -- # waitforlisten 1018780 /var/tmp/spdk-nbd.sock 00:06:11.248 01:07:19 -- common/autotest_common.sh@829 -- # '[' -z 1018780 ']' 00:06:11.248 01:07:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:11.248 01:07:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:11.248 01:07:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:11.248 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:11.248 01:07:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:11.248 01:07:19 -- common/autotest_common.sh@10 -- # set +x 00:06:11.521 01:07:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:11.521 01:07:19 -- common/autotest_common.sh@862 -- # return 0 00:06:11.521 01:07:19 -- event/event.sh@39 -- # killprocess 1018780 00:06:11.521 01:07:19 -- common/autotest_common.sh@936 -- # '[' -z 1018780 ']' 00:06:11.521 01:07:19 -- common/autotest_common.sh@940 -- # kill -0 1018780 00:06:11.521 01:07:19 -- common/autotest_common.sh@941 -- # uname 00:06:11.521 01:07:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:11.521 01:07:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1018780 00:06:11.521 01:07:19 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:11.521 01:07:19 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:11.521 01:07:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1018780' 00:06:11.521 killing process with pid 1018780 00:06:11.521 01:07:19 -- common/autotest_common.sh@955 -- # kill 1018780 00:06:11.521 01:07:19 -- common/autotest_common.sh@960 -- # wait 1018780 00:06:11.780 spdk_app_start is called in Round 0. 00:06:11.780 Shutdown signal received, stop current app iteration 00:06:11.780 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 reinitialization... 00:06:11.780 spdk_app_start is called in Round 1. 00:06:11.780 Shutdown signal received, stop current app iteration 00:06:11.780 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 reinitialization... 00:06:11.780 spdk_app_start is called in Round 2. 00:06:11.780 Shutdown signal received, stop current app iteration 00:06:11.780 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 reinitialization... 00:06:11.780 spdk_app_start is called in Round 3. 00:06:11.780 Shutdown signal received, stop current app iteration 00:06:11.780 01:07:19 -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:06:11.780 01:07:19 -- event/event.sh@42 -- # return 0 00:06:11.780 00:06:11.780 real 0m18.922s 00:06:11.780 user 0m41.650s 00:06:11.780 sys 0m3.115s 00:06:11.780 01:07:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:11.780 01:07:19 -- common/autotest_common.sh@10 -- # set +x 00:06:11.780 ************************************ 00:06:11.780 END TEST app_repeat 00:06:11.780 ************************************ 00:06:11.780 01:07:19 -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:06:11.780 01:07:19 -- event/event.sh@55 -- # run_test cpu_locks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:06:11.780 01:07:19 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:11.780 01:07:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:11.780 01:07:19 -- common/autotest_common.sh@10 -- # set +x 00:06:11.780 ************************************ 00:06:11.780 START TEST cpu_locks 00:06:11.780 ************************************ 00:06:11.780 01:07:19 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:06:11.780 * Looking for test storage... 00:06:11.780 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:06:11.780 01:07:19 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:11.780 01:07:19 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:11.780 01:07:19 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:11.780 01:07:19 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:11.780 01:07:19 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:11.780 01:07:19 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:11.780 01:07:19 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:11.780 01:07:19 -- scripts/common.sh@335 -- # IFS=.-: 00:06:11.780 01:07:19 -- scripts/common.sh@335 -- # read -ra ver1 00:06:11.780 01:07:19 -- scripts/common.sh@336 -- # IFS=.-: 00:06:11.780 01:07:19 -- scripts/common.sh@336 -- # read -ra ver2 00:06:11.780 01:07:19 -- scripts/common.sh@337 -- # local 'op=<' 00:06:11.780 01:07:19 -- scripts/common.sh@339 -- # ver1_l=2 00:06:11.780 01:07:19 -- scripts/common.sh@340 -- # ver2_l=1 00:06:11.780 01:07:19 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:11.780 01:07:19 -- scripts/common.sh@343 -- # case "$op" in 00:06:11.780 01:07:19 -- scripts/common.sh@344 -- # : 1 00:06:11.780 01:07:19 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:11.780 01:07:19 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:11.780 01:07:19 -- scripts/common.sh@364 -- # decimal 1 00:06:11.780 01:07:19 -- scripts/common.sh@352 -- # local d=1 00:06:11.780 01:07:19 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:11.780 01:07:19 -- scripts/common.sh@354 -- # echo 1 00:06:11.780 01:07:19 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:11.780 01:07:19 -- scripts/common.sh@365 -- # decimal 2 00:06:11.780 01:07:19 -- scripts/common.sh@352 -- # local d=2 00:06:11.780 01:07:19 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:11.780 01:07:19 -- scripts/common.sh@354 -- # echo 2 00:06:11.780 01:07:19 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:11.780 01:07:19 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:11.780 01:07:19 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:11.780 01:07:19 -- scripts/common.sh@367 -- # return 0 00:06:11.780 01:07:19 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:11.780 01:07:19 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:11.780 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:11.780 --rc genhtml_branch_coverage=1 00:06:11.780 --rc genhtml_function_coverage=1 00:06:11.780 --rc genhtml_legend=1 00:06:11.780 --rc geninfo_all_blocks=1 00:06:11.780 --rc geninfo_unexecuted_blocks=1 00:06:11.780 00:06:11.780 ' 00:06:11.780 01:07:19 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:11.780 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:11.780 --rc genhtml_branch_coverage=1 00:06:11.780 --rc genhtml_function_coverage=1 00:06:11.780 --rc genhtml_legend=1 00:06:11.780 --rc geninfo_all_blocks=1 00:06:11.780 --rc geninfo_unexecuted_blocks=1 00:06:11.780 00:06:11.780 ' 00:06:11.780 01:07:19 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:11.780 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:11.780 --rc genhtml_branch_coverage=1 00:06:11.780 --rc genhtml_function_coverage=1 00:06:11.780 --rc genhtml_legend=1 00:06:11.780 --rc geninfo_all_blocks=1 00:06:11.780 --rc geninfo_unexecuted_blocks=1 00:06:11.780 00:06:11.780 ' 00:06:11.780 01:07:19 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:11.780 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:11.780 --rc genhtml_branch_coverage=1 00:06:11.780 --rc genhtml_function_coverage=1 00:06:11.780 --rc genhtml_legend=1 00:06:11.780 --rc geninfo_all_blocks=1 00:06:11.780 --rc geninfo_unexecuted_blocks=1 00:06:11.780 00:06:11.780 ' 00:06:11.780 01:07:19 -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:06:11.780 01:07:19 -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:06:11.780 01:07:19 -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:06:11.780 01:07:19 -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:06:11.780 01:07:19 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:11.780 01:07:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:11.780 01:07:19 -- common/autotest_common.sh@10 -- # set +x 00:06:11.780 ************************************ 00:06:11.780 START TEST default_locks 00:06:11.780 ************************************ 00:06:11.780 01:07:19 -- common/autotest_common.sh@1114 -- # default_locks 00:06:11.780 01:07:19 -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=1021340 00:06:11.780 01:07:19 -- event/cpu_locks.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:11.780 01:07:19 -- event/cpu_locks.sh@47 -- # waitforlisten 1021340 00:06:11.780 01:07:19 -- common/autotest_common.sh@829 -- # '[' -z 1021340 ']' 00:06:11.780 01:07:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:11.780 01:07:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:11.780 01:07:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:11.780 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:11.780 01:07:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:11.780 01:07:19 -- common/autotest_common.sh@10 -- # set +x 00:06:12.039 [2024-11-20 01:07:20.021602] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:12.039 [2024-11-20 01:07:20.021693] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1021340 ] 00:06:12.039 EAL: No free 2048 kB hugepages reported on node 1 00:06:12.039 [2024-11-20 01:07:20.086215] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:12.039 [2024-11-20 01:07:20.173198] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:12.039 [2024-11-20 01:07:20.173393] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:12.972 01:07:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:12.972 01:07:20 -- common/autotest_common.sh@862 -- # return 0 00:06:12.972 01:07:20 -- event/cpu_locks.sh@49 -- # locks_exist 1021340 00:06:12.972 01:07:20 -- event/cpu_locks.sh@22 -- # lslocks -p 1021340 00:06:12.972 01:07:20 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:13.230 lslocks: write error 00:06:13.230 01:07:21 -- event/cpu_locks.sh@50 -- # killprocess 1021340 00:06:13.230 01:07:21 -- common/autotest_common.sh@936 -- # '[' -z 1021340 ']' 00:06:13.230 01:07:21 -- common/autotest_common.sh@940 -- # kill -0 1021340 00:06:13.230 01:07:21 -- common/autotest_common.sh@941 -- # uname 00:06:13.230 01:07:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:13.230 01:07:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1021340 00:06:13.230 01:07:21 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:13.230 01:07:21 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:13.230 01:07:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1021340' 00:06:13.230 killing process with pid 1021340 00:06:13.230 01:07:21 -- common/autotest_common.sh@955 -- # kill 1021340 00:06:13.230 01:07:21 -- common/autotest_common.sh@960 -- # wait 1021340 00:06:13.796 01:07:21 -- event/cpu_locks.sh@52 -- # NOT waitforlisten 1021340 00:06:13.796 01:07:21 -- common/autotest_common.sh@650 -- # local es=0 00:06:13.796 01:07:21 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 1021340 00:06:13.796 01:07:21 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:06:13.796 01:07:21 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:13.796 01:07:21 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:06:13.796 01:07:21 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:13.796 01:07:21 -- common/autotest_common.sh@653 -- # waitforlisten 1021340 00:06:13.796 01:07:21 -- common/autotest_common.sh@829 -- # '[' -z 1021340 ']' 00:06:13.796 01:07:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:13.796 01:07:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:13.796 01:07:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:13.796 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:13.796 01:07:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:13.796 01:07:21 -- common/autotest_common.sh@10 -- # set +x 00:06:13.796 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (1021340) - No such process 00:06:13.796 ERROR: process (pid: 1021340) is no longer running 00:06:13.796 01:07:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:13.796 01:07:21 -- common/autotest_common.sh@862 -- # return 1 00:06:13.796 01:07:21 -- common/autotest_common.sh@653 -- # es=1 00:06:13.796 01:07:21 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:13.796 01:07:21 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:13.796 01:07:21 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:13.796 01:07:21 -- event/cpu_locks.sh@54 -- # no_locks 00:06:13.796 01:07:21 -- event/cpu_locks.sh@26 -- # lock_files=() 00:06:13.796 01:07:21 -- event/cpu_locks.sh@26 -- # local lock_files 00:06:13.796 01:07:21 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:06:13.796 00:06:13.796 real 0m1.849s 00:06:13.796 user 0m1.962s 00:06:13.796 sys 0m0.594s 00:06:13.796 01:07:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:13.796 01:07:21 -- common/autotest_common.sh@10 -- # set +x 00:06:13.796 ************************************ 00:06:13.796 END TEST default_locks 00:06:13.796 ************************************ 00:06:13.796 01:07:21 -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:06:13.796 01:07:21 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:13.796 01:07:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:13.796 01:07:21 -- common/autotest_common.sh@10 -- # set +x 00:06:13.796 ************************************ 00:06:13.796 START TEST default_locks_via_rpc 00:06:13.796 ************************************ 00:06:13.796 01:07:21 -- common/autotest_common.sh@1114 -- # default_locks_via_rpc 00:06:13.796 01:07:21 -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=1021516 00:06:13.796 01:07:21 -- event/cpu_locks.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:13.796 01:07:21 -- event/cpu_locks.sh@63 -- # waitforlisten 1021516 00:06:13.796 01:07:21 -- common/autotest_common.sh@829 -- # '[' -z 1021516 ']' 00:06:13.796 01:07:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:13.796 01:07:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:13.796 01:07:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:13.796 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:13.796 01:07:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:13.796 01:07:21 -- common/autotest_common.sh@10 -- # set +x 00:06:13.796 [2024-11-20 01:07:21.891167] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:13.796 [2024-11-20 01:07:21.891260] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1021516 ] 00:06:13.796 EAL: No free 2048 kB hugepages reported on node 1 00:06:13.796 [2024-11-20 01:07:21.949176] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:14.054 [2024-11-20 01:07:22.039744] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:14.054 [2024-11-20 01:07:22.039907] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:14.988 01:07:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:14.988 01:07:22 -- common/autotest_common.sh@862 -- # return 0 00:06:14.988 01:07:22 -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:06:14.988 01:07:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:14.988 01:07:22 -- common/autotest_common.sh@10 -- # set +x 00:06:14.988 01:07:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:14.988 01:07:22 -- event/cpu_locks.sh@67 -- # no_locks 00:06:14.988 01:07:22 -- event/cpu_locks.sh@26 -- # lock_files=() 00:06:14.988 01:07:22 -- event/cpu_locks.sh@26 -- # local lock_files 00:06:14.988 01:07:22 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:06:14.988 01:07:22 -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:06:14.988 01:07:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:14.988 01:07:22 -- common/autotest_common.sh@10 -- # set +x 00:06:14.988 01:07:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:14.988 01:07:22 -- event/cpu_locks.sh@71 -- # locks_exist 1021516 00:06:14.988 01:07:22 -- event/cpu_locks.sh@22 -- # lslocks -p 1021516 00:06:14.988 01:07:22 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:14.988 01:07:23 -- event/cpu_locks.sh@73 -- # killprocess 1021516 00:06:14.988 01:07:23 -- common/autotest_common.sh@936 -- # '[' -z 1021516 ']' 00:06:14.988 01:07:23 -- common/autotest_common.sh@940 -- # kill -0 1021516 00:06:14.988 01:07:23 -- common/autotest_common.sh@941 -- # uname 00:06:14.988 01:07:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:14.988 01:07:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1021516 00:06:14.988 01:07:23 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:14.988 01:07:23 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:14.988 01:07:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1021516' 00:06:14.988 killing process with pid 1021516 00:06:14.988 01:07:23 -- common/autotest_common.sh@955 -- # kill 1021516 00:06:14.988 01:07:23 -- common/autotest_common.sh@960 -- # wait 1021516 00:06:15.553 00:06:15.553 real 0m1.744s 00:06:15.553 user 0m1.920s 00:06:15.553 sys 0m0.540s 00:06:15.553 01:07:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:15.553 01:07:23 -- common/autotest_common.sh@10 -- # set +x 00:06:15.553 ************************************ 00:06:15.553 END TEST default_locks_via_rpc 00:06:15.553 ************************************ 00:06:15.553 01:07:23 -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:06:15.553 01:07:23 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:15.553 01:07:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:15.553 01:07:23 -- common/autotest_common.sh@10 -- # set +x 00:06:15.553 ************************************ 00:06:15.553 START TEST non_locking_app_on_locked_coremask 00:06:15.553 ************************************ 00:06:15.553 01:07:23 -- common/autotest_common.sh@1114 -- # non_locking_app_on_locked_coremask 00:06:15.553 01:07:23 -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=1021812 00:06:15.553 01:07:23 -- event/cpu_locks.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:15.553 01:07:23 -- event/cpu_locks.sh@81 -- # waitforlisten 1021812 /var/tmp/spdk.sock 00:06:15.553 01:07:23 -- common/autotest_common.sh@829 -- # '[' -z 1021812 ']' 00:06:15.553 01:07:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:15.553 01:07:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:15.553 01:07:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:15.553 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:15.553 01:07:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:15.553 01:07:23 -- common/autotest_common.sh@10 -- # set +x 00:06:15.553 [2024-11-20 01:07:23.660833] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:15.553 [2024-11-20 01:07:23.660942] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1021812 ] 00:06:15.553 EAL: No free 2048 kB hugepages reported on node 1 00:06:15.553 [2024-11-20 01:07:23.722640] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:15.811 [2024-11-20 01:07:23.817923] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:15.811 [2024-11-20 01:07:23.818144] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:16.745 01:07:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:16.745 01:07:24 -- common/autotest_common.sh@862 -- # return 0 00:06:16.745 01:07:24 -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=1021952 00:06:16.745 01:07:24 -- event/cpu_locks.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:06:16.745 01:07:24 -- event/cpu_locks.sh@85 -- # waitforlisten 1021952 /var/tmp/spdk2.sock 00:06:16.745 01:07:24 -- common/autotest_common.sh@829 -- # '[' -z 1021952 ']' 00:06:16.745 01:07:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:16.745 01:07:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:16.745 01:07:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:16.745 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:16.745 01:07:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:16.745 01:07:24 -- common/autotest_common.sh@10 -- # set +x 00:06:16.745 [2024-11-20 01:07:24.702194] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:16.745 [2024-11-20 01:07:24.702273] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1021952 ] 00:06:16.745 EAL: No free 2048 kB hugepages reported on node 1 00:06:16.745 [2024-11-20 01:07:24.793105] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:16.745 [2024-11-20 01:07:24.793137] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:17.004 [2024-11-20 01:07:24.974922] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:17.004 [2024-11-20 01:07:24.975120] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:17.569 01:07:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:17.569 01:07:25 -- common/autotest_common.sh@862 -- # return 0 00:06:17.569 01:07:25 -- event/cpu_locks.sh@87 -- # locks_exist 1021812 00:06:17.569 01:07:25 -- event/cpu_locks.sh@22 -- # lslocks -p 1021812 00:06:17.569 01:07:25 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:17.827 lslocks: write error 00:06:17.827 01:07:25 -- event/cpu_locks.sh@89 -- # killprocess 1021812 00:06:17.827 01:07:25 -- common/autotest_common.sh@936 -- # '[' -z 1021812 ']' 00:06:17.827 01:07:25 -- common/autotest_common.sh@940 -- # kill -0 1021812 00:06:17.827 01:07:25 -- common/autotest_common.sh@941 -- # uname 00:06:17.827 01:07:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:17.827 01:07:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1021812 00:06:17.827 01:07:26 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:17.827 01:07:26 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:17.827 01:07:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1021812' 00:06:17.827 killing process with pid 1021812 00:06:17.827 01:07:26 -- common/autotest_common.sh@955 -- # kill 1021812 00:06:17.827 01:07:26 -- common/autotest_common.sh@960 -- # wait 1021812 00:06:18.760 01:07:26 -- event/cpu_locks.sh@90 -- # killprocess 1021952 00:06:18.760 01:07:26 -- common/autotest_common.sh@936 -- # '[' -z 1021952 ']' 00:06:18.760 01:07:26 -- common/autotest_common.sh@940 -- # kill -0 1021952 00:06:18.760 01:07:26 -- common/autotest_common.sh@941 -- # uname 00:06:18.760 01:07:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:18.760 01:07:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1021952 00:06:18.760 01:07:26 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:18.760 01:07:26 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:18.760 01:07:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1021952' 00:06:18.760 killing process with pid 1021952 00:06:18.760 01:07:26 -- common/autotest_common.sh@955 -- # kill 1021952 00:06:18.760 01:07:26 -- common/autotest_common.sh@960 -- # wait 1021952 00:06:19.326 00:06:19.326 real 0m3.650s 00:06:19.326 user 0m4.050s 00:06:19.326 sys 0m1.042s 00:06:19.326 01:07:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:19.326 01:07:27 -- common/autotest_common.sh@10 -- # set +x 00:06:19.326 ************************************ 00:06:19.326 END TEST non_locking_app_on_locked_coremask 00:06:19.326 ************************************ 00:06:19.326 01:07:27 -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:06:19.326 01:07:27 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:19.326 01:07:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:19.326 01:07:27 -- common/autotest_common.sh@10 -- # set +x 00:06:19.326 ************************************ 00:06:19.326 START TEST locking_app_on_unlocked_coremask 00:06:19.326 ************************************ 00:06:19.326 01:07:27 -- common/autotest_common.sh@1114 -- # locking_app_on_unlocked_coremask 00:06:19.326 01:07:27 -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=1022258 00:06:19.326 01:07:27 -- event/cpu_locks.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:06:19.326 01:07:27 -- event/cpu_locks.sh@99 -- # waitforlisten 1022258 /var/tmp/spdk.sock 00:06:19.326 01:07:27 -- common/autotest_common.sh@829 -- # '[' -z 1022258 ']' 00:06:19.326 01:07:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:19.326 01:07:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:19.326 01:07:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:19.326 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:19.326 01:07:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:19.326 01:07:27 -- common/autotest_common.sh@10 -- # set +x 00:06:19.326 [2024-11-20 01:07:27.341813] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:19.326 [2024-11-20 01:07:27.341896] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1022258 ] 00:06:19.326 EAL: No free 2048 kB hugepages reported on node 1 00:06:19.326 [2024-11-20 01:07:27.403076] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:19.326 [2024-11-20 01:07:27.403117] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:19.326 [2024-11-20 01:07:27.491853] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:19.326 [2024-11-20 01:07:27.492055] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:20.261 01:07:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:20.261 01:07:28 -- common/autotest_common.sh@862 -- # return 0 00:06:20.261 01:07:28 -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=1022400 00:06:20.261 01:07:28 -- event/cpu_locks.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:06:20.261 01:07:28 -- event/cpu_locks.sh@103 -- # waitforlisten 1022400 /var/tmp/spdk2.sock 00:06:20.261 01:07:28 -- common/autotest_common.sh@829 -- # '[' -z 1022400 ']' 00:06:20.261 01:07:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:20.261 01:07:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:20.261 01:07:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:20.261 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:20.261 01:07:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:20.261 01:07:28 -- common/autotest_common.sh@10 -- # set +x 00:06:20.261 [2024-11-20 01:07:28.327272] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:20.261 [2024-11-20 01:07:28.327352] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1022400 ] 00:06:20.261 EAL: No free 2048 kB hugepages reported on node 1 00:06:20.261 [2024-11-20 01:07:28.422733] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:20.519 [2024-11-20 01:07:28.600237] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:20.519 [2024-11-20 01:07:28.600455] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:21.109 01:07:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:21.109 01:07:29 -- common/autotest_common.sh@862 -- # return 0 00:06:21.109 01:07:29 -- event/cpu_locks.sh@105 -- # locks_exist 1022400 00:06:21.109 01:07:29 -- event/cpu_locks.sh@22 -- # lslocks -p 1022400 00:06:21.109 01:07:29 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:21.680 lslocks: write error 00:06:21.680 01:07:29 -- event/cpu_locks.sh@107 -- # killprocess 1022258 00:06:21.680 01:07:29 -- common/autotest_common.sh@936 -- # '[' -z 1022258 ']' 00:06:21.680 01:07:29 -- common/autotest_common.sh@940 -- # kill -0 1022258 00:06:21.680 01:07:29 -- common/autotest_common.sh@941 -- # uname 00:06:21.680 01:07:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:21.680 01:07:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1022258 00:06:21.680 01:07:29 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:21.680 01:07:29 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:21.680 01:07:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1022258' 00:06:21.680 killing process with pid 1022258 00:06:21.680 01:07:29 -- common/autotest_common.sh@955 -- # kill 1022258 00:06:21.680 01:07:29 -- common/autotest_common.sh@960 -- # wait 1022258 00:06:22.613 01:07:30 -- event/cpu_locks.sh@108 -- # killprocess 1022400 00:06:22.613 01:07:30 -- common/autotest_common.sh@936 -- # '[' -z 1022400 ']' 00:06:22.613 01:07:30 -- common/autotest_common.sh@940 -- # kill -0 1022400 00:06:22.613 01:07:30 -- common/autotest_common.sh@941 -- # uname 00:06:22.613 01:07:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:22.613 01:07:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1022400 00:06:22.613 01:07:30 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:22.613 01:07:30 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:22.613 01:07:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1022400' 00:06:22.613 killing process with pid 1022400 00:06:22.613 01:07:30 -- common/autotest_common.sh@955 -- # kill 1022400 00:06:22.613 01:07:30 -- common/autotest_common.sh@960 -- # wait 1022400 00:06:22.871 00:06:22.871 real 0m3.727s 00:06:22.871 user 0m4.071s 00:06:22.871 sys 0m1.076s 00:06:22.871 01:07:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:22.871 01:07:31 -- common/autotest_common.sh@10 -- # set +x 00:06:22.871 ************************************ 00:06:22.871 END TEST locking_app_on_unlocked_coremask 00:06:22.871 ************************************ 00:06:22.871 01:07:31 -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:06:22.871 01:07:31 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:22.871 01:07:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:22.871 01:07:31 -- common/autotest_common.sh@10 -- # set +x 00:06:22.871 ************************************ 00:06:22.871 START TEST locking_app_on_locked_coremask 00:06:22.871 ************************************ 00:06:22.871 01:07:31 -- common/autotest_common.sh@1114 -- # locking_app_on_locked_coremask 00:06:22.871 01:07:31 -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=1022761 00:06:22.871 01:07:31 -- event/cpu_locks.sh@114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:22.871 01:07:31 -- event/cpu_locks.sh@116 -- # waitforlisten 1022761 /var/tmp/spdk.sock 00:06:22.871 01:07:31 -- common/autotest_common.sh@829 -- # '[' -z 1022761 ']' 00:06:22.871 01:07:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:22.871 01:07:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:22.871 01:07:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:22.871 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:22.871 01:07:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:22.871 01:07:31 -- common/autotest_common.sh@10 -- # set +x 00:06:23.129 [2024-11-20 01:07:31.095608] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:23.129 [2024-11-20 01:07:31.095687] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1022761 ] 00:06:23.129 EAL: No free 2048 kB hugepages reported on node 1 00:06:23.129 [2024-11-20 01:07:31.158524] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:23.129 [2024-11-20 01:07:31.250796] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:23.129 [2024-11-20 01:07:31.251004] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:24.061 01:07:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:24.061 01:07:32 -- common/autotest_common.sh@862 -- # return 0 00:06:24.061 01:07:32 -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=1022858 00:06:24.061 01:07:32 -- event/cpu_locks.sh@118 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:06:24.061 01:07:32 -- event/cpu_locks.sh@120 -- # NOT waitforlisten 1022858 /var/tmp/spdk2.sock 00:06:24.061 01:07:32 -- common/autotest_common.sh@650 -- # local es=0 00:06:24.061 01:07:32 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 1022858 /var/tmp/spdk2.sock 00:06:24.061 01:07:32 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:06:24.061 01:07:32 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:24.061 01:07:32 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:06:24.061 01:07:32 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:24.061 01:07:32 -- common/autotest_common.sh@653 -- # waitforlisten 1022858 /var/tmp/spdk2.sock 00:06:24.061 01:07:32 -- common/autotest_common.sh@829 -- # '[' -z 1022858 ']' 00:06:24.061 01:07:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:24.061 01:07:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:24.061 01:07:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:24.061 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:24.061 01:07:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:24.061 01:07:32 -- common/autotest_common.sh@10 -- # set +x 00:06:24.061 [2024-11-20 01:07:32.133814] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:24.061 [2024-11-20 01:07:32.133886] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1022858 ] 00:06:24.062 EAL: No free 2048 kB hugepages reported on node 1 00:06:24.062 [2024-11-20 01:07:32.234523] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 1022761 has claimed it. 00:06:24.062 [2024-11-20 01:07:32.234577] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:06:24.996 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (1022858) - No such process 00:06:24.996 ERROR: process (pid: 1022858) is no longer running 00:06:24.996 01:07:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:24.996 01:07:32 -- common/autotest_common.sh@862 -- # return 1 00:06:24.996 01:07:32 -- common/autotest_common.sh@653 -- # es=1 00:06:24.996 01:07:32 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:24.996 01:07:32 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:24.996 01:07:32 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:24.996 01:07:32 -- event/cpu_locks.sh@122 -- # locks_exist 1022761 00:06:24.996 01:07:32 -- event/cpu_locks.sh@22 -- # lslocks -p 1022761 00:06:24.996 01:07:32 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:25.253 lslocks: write error 00:06:25.253 01:07:33 -- event/cpu_locks.sh@124 -- # killprocess 1022761 00:06:25.253 01:07:33 -- common/autotest_common.sh@936 -- # '[' -z 1022761 ']' 00:06:25.253 01:07:33 -- common/autotest_common.sh@940 -- # kill -0 1022761 00:06:25.253 01:07:33 -- common/autotest_common.sh@941 -- # uname 00:06:25.253 01:07:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:25.253 01:07:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1022761 00:06:25.253 01:07:33 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:25.253 01:07:33 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:25.253 01:07:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1022761' 00:06:25.253 killing process with pid 1022761 00:06:25.253 01:07:33 -- common/autotest_common.sh@955 -- # kill 1022761 00:06:25.253 01:07:33 -- common/autotest_common.sh@960 -- # wait 1022761 00:06:25.512 00:06:25.512 real 0m2.603s 00:06:25.512 user 0m3.023s 00:06:25.512 sys 0m0.682s 00:06:25.512 01:07:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:25.512 01:07:33 -- common/autotest_common.sh@10 -- # set +x 00:06:25.512 ************************************ 00:06:25.512 END TEST locking_app_on_locked_coremask 00:06:25.512 ************************************ 00:06:25.512 01:07:33 -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:06:25.512 01:07:33 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:25.512 01:07:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:25.512 01:07:33 -- common/autotest_common.sh@10 -- # set +x 00:06:25.512 ************************************ 00:06:25.512 START TEST locking_overlapped_coremask 00:06:25.512 ************************************ 00:06:25.512 01:07:33 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask 00:06:25.512 01:07:33 -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=1023152 00:06:25.512 01:07:33 -- event/cpu_locks.sh@131 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 00:06:25.512 01:07:33 -- event/cpu_locks.sh@133 -- # waitforlisten 1023152 /var/tmp/spdk.sock 00:06:25.512 01:07:33 -- common/autotest_common.sh@829 -- # '[' -z 1023152 ']' 00:06:25.512 01:07:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:25.512 01:07:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:25.512 01:07:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:25.512 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:25.512 01:07:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:25.512 01:07:33 -- common/autotest_common.sh@10 -- # set +x 00:06:25.512 [2024-11-20 01:07:33.725964] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:25.512 [2024-11-20 01:07:33.726039] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1023152 ] 00:06:25.770 EAL: No free 2048 kB hugepages reported on node 1 00:06:25.770 [2024-11-20 01:07:33.783497] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:25.770 [2024-11-20 01:07:33.873526] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:25.770 [2024-11-20 01:07:33.873740] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:25.770 [2024-11-20 01:07:33.877088] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:25.770 [2024-11-20 01:07:33.877099] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:26.702 01:07:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:26.702 01:07:34 -- common/autotest_common.sh@862 -- # return 0 00:06:26.702 01:07:34 -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=1023296 00:06:26.702 01:07:34 -- event/cpu_locks.sh@135 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:06:26.702 01:07:34 -- event/cpu_locks.sh@137 -- # NOT waitforlisten 1023296 /var/tmp/spdk2.sock 00:06:26.702 01:07:34 -- common/autotest_common.sh@650 -- # local es=0 00:06:26.702 01:07:34 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 1023296 /var/tmp/spdk2.sock 00:06:26.702 01:07:34 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:06:26.702 01:07:34 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:26.702 01:07:34 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:06:26.702 01:07:34 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:26.702 01:07:34 -- common/autotest_common.sh@653 -- # waitforlisten 1023296 /var/tmp/spdk2.sock 00:06:26.702 01:07:34 -- common/autotest_common.sh@829 -- # '[' -z 1023296 ']' 00:06:26.702 01:07:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:26.702 01:07:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:26.702 01:07:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:26.702 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:26.702 01:07:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:26.702 01:07:34 -- common/autotest_common.sh@10 -- # set +x 00:06:26.702 [2024-11-20 01:07:34.755686] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:26.702 [2024-11-20 01:07:34.755772] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1023296 ] 00:06:26.702 EAL: No free 2048 kB hugepages reported on node 1 00:06:26.702 [2024-11-20 01:07:34.843605] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 1023152 has claimed it. 00:06:26.702 [2024-11-20 01:07:34.843657] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:06:27.267 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (1023296) - No such process 00:06:27.267 ERROR: process (pid: 1023296) is no longer running 00:06:27.267 01:07:35 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:27.267 01:07:35 -- common/autotest_common.sh@862 -- # return 1 00:06:27.267 01:07:35 -- common/autotest_common.sh@653 -- # es=1 00:06:27.267 01:07:35 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:27.267 01:07:35 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:27.267 01:07:35 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:27.267 01:07:35 -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:06:27.267 01:07:35 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:06:27.267 01:07:35 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:06:27.267 01:07:35 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:06:27.267 01:07:35 -- event/cpu_locks.sh@141 -- # killprocess 1023152 00:06:27.267 01:07:35 -- common/autotest_common.sh@936 -- # '[' -z 1023152 ']' 00:06:27.267 01:07:35 -- common/autotest_common.sh@940 -- # kill -0 1023152 00:06:27.267 01:07:35 -- common/autotest_common.sh@941 -- # uname 00:06:27.267 01:07:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:27.267 01:07:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1023152 00:06:27.525 01:07:35 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:27.525 01:07:35 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:27.525 01:07:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1023152' 00:06:27.525 killing process with pid 1023152 00:06:27.525 01:07:35 -- common/autotest_common.sh@955 -- # kill 1023152 00:06:27.525 01:07:35 -- common/autotest_common.sh@960 -- # wait 1023152 00:06:27.783 00:06:27.783 real 0m2.194s 00:06:27.783 user 0m6.317s 00:06:27.783 sys 0m0.500s 00:06:27.783 01:07:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:27.783 01:07:35 -- common/autotest_common.sh@10 -- # set +x 00:06:27.783 ************************************ 00:06:27.783 END TEST locking_overlapped_coremask 00:06:27.783 ************************************ 00:06:27.783 01:07:35 -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:06:27.783 01:07:35 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:27.783 01:07:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:27.783 01:07:35 -- common/autotest_common.sh@10 -- # set +x 00:06:27.783 ************************************ 00:06:27.783 START TEST locking_overlapped_coremask_via_rpc 00:06:27.783 ************************************ 00:06:27.783 01:07:35 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask_via_rpc 00:06:27.783 01:07:35 -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=1023460 00:06:27.783 01:07:35 -- event/cpu_locks.sh@147 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:06:27.783 01:07:35 -- event/cpu_locks.sh@149 -- # waitforlisten 1023460 /var/tmp/spdk.sock 00:06:27.783 01:07:35 -- common/autotest_common.sh@829 -- # '[' -z 1023460 ']' 00:06:27.783 01:07:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:27.783 01:07:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:27.783 01:07:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:27.783 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:27.783 01:07:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:27.783 01:07:35 -- common/autotest_common.sh@10 -- # set +x 00:06:27.783 [2024-11-20 01:07:35.949543] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:27.783 [2024-11-20 01:07:35.949634] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1023460 ] 00:06:27.783 EAL: No free 2048 kB hugepages reported on node 1 00:06:28.041 [2024-11-20 01:07:36.010718] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:28.041 [2024-11-20 01:07:36.010764] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:28.041 [2024-11-20 01:07:36.097626] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:28.041 [2024-11-20 01:07:36.097881] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:28.041 [2024-11-20 01:07:36.097940] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:28.041 [2024-11-20 01:07:36.097959] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:28.974 01:07:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:28.974 01:07:36 -- common/autotest_common.sh@862 -- # return 0 00:06:28.974 01:07:36 -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=1023602 00:06:28.974 01:07:36 -- event/cpu_locks.sh@151 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:06:28.974 01:07:36 -- event/cpu_locks.sh@153 -- # waitforlisten 1023602 /var/tmp/spdk2.sock 00:06:28.974 01:07:36 -- common/autotest_common.sh@829 -- # '[' -z 1023602 ']' 00:06:28.974 01:07:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:28.974 01:07:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:28.974 01:07:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:28.974 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:28.974 01:07:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:28.974 01:07:36 -- common/autotest_common.sh@10 -- # set +x 00:06:28.974 [2024-11-20 01:07:36.947025] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:28.974 [2024-11-20 01:07:36.947124] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1023602 ] 00:06:28.974 EAL: No free 2048 kB hugepages reported on node 1 00:06:28.974 [2024-11-20 01:07:37.032528] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:28.974 [2024-11-20 01:07:37.032568] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:29.232 [2024-11-20 01:07:37.201661] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:29.232 [2024-11-20 01:07:37.201882] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:29.232 [2024-11-20 01:07:37.205130] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:06:29.232 [2024-11-20 01:07:37.205133] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:29.796 01:07:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:29.796 01:07:37 -- common/autotest_common.sh@862 -- # return 0 00:06:29.796 01:07:37 -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:06:29.796 01:07:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:29.796 01:07:37 -- common/autotest_common.sh@10 -- # set +x 00:06:29.796 01:07:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:29.796 01:07:37 -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:29.796 01:07:37 -- common/autotest_common.sh@650 -- # local es=0 00:06:29.796 01:07:37 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:29.796 01:07:37 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:06:29.796 01:07:37 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:29.796 01:07:37 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:06:29.796 01:07:37 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:29.796 01:07:37 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:29.796 01:07:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:29.796 01:07:37 -- common/autotest_common.sh@10 -- # set +x 00:06:29.796 [2024-11-20 01:07:37.922167] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 1023460 has claimed it. 00:06:29.796 request: 00:06:29.796 { 00:06:29.796 "method": "framework_enable_cpumask_locks", 00:06:29.796 "req_id": 1 00:06:29.796 } 00:06:29.796 Got JSON-RPC error response 00:06:29.796 response: 00:06:29.796 { 00:06:29.796 "code": -32603, 00:06:29.796 "message": "Failed to claim CPU core: 2" 00:06:29.796 } 00:06:29.796 01:07:37 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:06:29.796 01:07:37 -- common/autotest_common.sh@653 -- # es=1 00:06:29.796 01:07:37 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:29.796 01:07:37 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:29.796 01:07:37 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:29.796 01:07:37 -- event/cpu_locks.sh@158 -- # waitforlisten 1023460 /var/tmp/spdk.sock 00:06:29.796 01:07:37 -- common/autotest_common.sh@829 -- # '[' -z 1023460 ']' 00:06:29.796 01:07:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:29.796 01:07:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:29.796 01:07:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:29.796 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:29.796 01:07:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:29.796 01:07:37 -- common/autotest_common.sh@10 -- # set +x 00:06:30.054 01:07:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:30.054 01:07:38 -- common/autotest_common.sh@862 -- # return 0 00:06:30.054 01:07:38 -- event/cpu_locks.sh@159 -- # waitforlisten 1023602 /var/tmp/spdk2.sock 00:06:30.054 01:07:38 -- common/autotest_common.sh@829 -- # '[' -z 1023602 ']' 00:06:30.054 01:07:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:30.054 01:07:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:30.054 01:07:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:30.054 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:30.054 01:07:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:30.054 01:07:38 -- common/autotest_common.sh@10 -- # set +x 00:06:30.312 01:07:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:30.312 01:07:38 -- common/autotest_common.sh@862 -- # return 0 00:06:30.312 01:07:38 -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:06:30.312 01:07:38 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:06:30.312 01:07:38 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:06:30.312 01:07:38 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:06:30.312 00:06:30.312 real 0m2.522s 00:06:30.312 user 0m1.281s 00:06:30.312 sys 0m0.177s 00:06:30.312 01:07:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:30.312 01:07:38 -- common/autotest_common.sh@10 -- # set +x 00:06:30.312 ************************************ 00:06:30.312 END TEST locking_overlapped_coremask_via_rpc 00:06:30.312 ************************************ 00:06:30.312 01:07:38 -- event/cpu_locks.sh@174 -- # cleanup 00:06:30.312 01:07:38 -- event/cpu_locks.sh@15 -- # [[ -z 1023460 ]] 00:06:30.312 01:07:38 -- event/cpu_locks.sh@15 -- # killprocess 1023460 00:06:30.312 01:07:38 -- common/autotest_common.sh@936 -- # '[' -z 1023460 ']' 00:06:30.312 01:07:38 -- common/autotest_common.sh@940 -- # kill -0 1023460 00:06:30.312 01:07:38 -- common/autotest_common.sh@941 -- # uname 00:06:30.312 01:07:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:30.312 01:07:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1023460 00:06:30.312 01:07:38 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:30.312 01:07:38 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:30.312 01:07:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1023460' 00:06:30.312 killing process with pid 1023460 00:06:30.312 01:07:38 -- common/autotest_common.sh@955 -- # kill 1023460 00:06:30.312 01:07:38 -- common/autotest_common.sh@960 -- # wait 1023460 00:06:30.879 01:07:38 -- event/cpu_locks.sh@16 -- # [[ -z 1023602 ]] 00:06:30.879 01:07:38 -- event/cpu_locks.sh@16 -- # killprocess 1023602 00:06:30.879 01:07:38 -- common/autotest_common.sh@936 -- # '[' -z 1023602 ']' 00:06:30.879 01:07:38 -- common/autotest_common.sh@940 -- # kill -0 1023602 00:06:30.879 01:07:38 -- common/autotest_common.sh@941 -- # uname 00:06:30.879 01:07:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:30.879 01:07:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1023602 00:06:30.879 01:07:38 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:06:30.879 01:07:38 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:06:30.879 01:07:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1023602' 00:06:30.879 killing process with pid 1023602 00:06:30.879 01:07:38 -- common/autotest_common.sh@955 -- # kill 1023602 00:06:30.879 01:07:38 -- common/autotest_common.sh@960 -- # wait 1023602 00:06:31.137 01:07:39 -- event/cpu_locks.sh@18 -- # rm -f 00:06:31.137 01:07:39 -- event/cpu_locks.sh@1 -- # cleanup 00:06:31.137 01:07:39 -- event/cpu_locks.sh@15 -- # [[ -z 1023460 ]] 00:06:31.137 01:07:39 -- event/cpu_locks.sh@15 -- # killprocess 1023460 00:06:31.137 01:07:39 -- common/autotest_common.sh@936 -- # '[' -z 1023460 ']' 00:06:31.137 01:07:39 -- common/autotest_common.sh@940 -- # kill -0 1023460 00:06:31.137 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1023460) - No such process 00:06:31.137 01:07:39 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1023460 is not found' 00:06:31.137 Process with pid 1023460 is not found 00:06:31.137 01:07:39 -- event/cpu_locks.sh@16 -- # [[ -z 1023602 ]] 00:06:31.137 01:07:39 -- event/cpu_locks.sh@16 -- # killprocess 1023602 00:06:31.137 01:07:39 -- common/autotest_common.sh@936 -- # '[' -z 1023602 ']' 00:06:31.137 01:07:39 -- common/autotest_common.sh@940 -- # kill -0 1023602 00:06:31.137 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1023602) - No such process 00:06:31.137 01:07:39 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1023602 is not found' 00:06:31.137 Process with pid 1023602 is not found 00:06:31.137 01:07:39 -- event/cpu_locks.sh@18 -- # rm -f 00:06:31.137 00:06:31.137 real 0m19.496s 00:06:31.137 user 0m35.202s 00:06:31.137 sys 0m5.448s 00:06:31.137 01:07:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:31.137 01:07:39 -- common/autotest_common.sh@10 -- # set +x 00:06:31.137 ************************************ 00:06:31.137 END TEST cpu_locks 00:06:31.137 ************************************ 00:06:31.396 00:06:31.396 real 0m46.350s 00:06:31.396 user 1m29.405s 00:06:31.396 sys 0m9.309s 00:06:31.396 01:07:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:31.396 01:07:39 -- common/autotest_common.sh@10 -- # set +x 00:06:31.396 ************************************ 00:06:31.396 END TEST event 00:06:31.396 ************************************ 00:06:31.396 01:07:39 -- spdk/autotest.sh@175 -- # run_test thread /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:06:31.396 01:07:39 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:31.396 01:07:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:31.396 01:07:39 -- common/autotest_common.sh@10 -- # set +x 00:06:31.396 ************************************ 00:06:31.396 START TEST thread 00:06:31.396 ************************************ 00:06:31.396 01:07:39 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:06:31.396 * Looking for test storage... 00:06:31.396 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread 00:06:31.396 01:07:39 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:31.396 01:07:39 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:31.396 01:07:39 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:31.396 01:07:39 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:31.396 01:07:39 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:31.396 01:07:39 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:31.396 01:07:39 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:31.396 01:07:39 -- scripts/common.sh@335 -- # IFS=.-: 00:06:31.396 01:07:39 -- scripts/common.sh@335 -- # read -ra ver1 00:06:31.396 01:07:39 -- scripts/common.sh@336 -- # IFS=.-: 00:06:31.396 01:07:39 -- scripts/common.sh@336 -- # read -ra ver2 00:06:31.396 01:07:39 -- scripts/common.sh@337 -- # local 'op=<' 00:06:31.396 01:07:39 -- scripts/common.sh@339 -- # ver1_l=2 00:06:31.396 01:07:39 -- scripts/common.sh@340 -- # ver2_l=1 00:06:31.396 01:07:39 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:31.396 01:07:39 -- scripts/common.sh@343 -- # case "$op" in 00:06:31.396 01:07:39 -- scripts/common.sh@344 -- # : 1 00:06:31.396 01:07:39 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:31.396 01:07:39 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:31.396 01:07:39 -- scripts/common.sh@364 -- # decimal 1 00:06:31.396 01:07:39 -- scripts/common.sh@352 -- # local d=1 00:06:31.396 01:07:39 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:31.396 01:07:39 -- scripts/common.sh@354 -- # echo 1 00:06:31.396 01:07:39 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:31.396 01:07:39 -- scripts/common.sh@365 -- # decimal 2 00:06:31.396 01:07:39 -- scripts/common.sh@352 -- # local d=2 00:06:31.396 01:07:39 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:31.396 01:07:39 -- scripts/common.sh@354 -- # echo 2 00:06:31.396 01:07:39 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:31.396 01:07:39 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:31.396 01:07:39 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:31.396 01:07:39 -- scripts/common.sh@367 -- # return 0 00:06:31.396 01:07:39 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:31.396 01:07:39 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:31.396 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:31.396 --rc genhtml_branch_coverage=1 00:06:31.396 --rc genhtml_function_coverage=1 00:06:31.396 --rc genhtml_legend=1 00:06:31.396 --rc geninfo_all_blocks=1 00:06:31.396 --rc geninfo_unexecuted_blocks=1 00:06:31.396 00:06:31.396 ' 00:06:31.396 01:07:39 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:31.396 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:31.396 --rc genhtml_branch_coverage=1 00:06:31.396 --rc genhtml_function_coverage=1 00:06:31.396 --rc genhtml_legend=1 00:06:31.396 --rc geninfo_all_blocks=1 00:06:31.396 --rc geninfo_unexecuted_blocks=1 00:06:31.396 00:06:31.396 ' 00:06:31.396 01:07:39 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:31.396 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:31.396 --rc genhtml_branch_coverage=1 00:06:31.396 --rc genhtml_function_coverage=1 00:06:31.396 --rc genhtml_legend=1 00:06:31.396 --rc geninfo_all_blocks=1 00:06:31.396 --rc geninfo_unexecuted_blocks=1 00:06:31.396 00:06:31.396 ' 00:06:31.396 01:07:39 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:31.396 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:31.396 --rc genhtml_branch_coverage=1 00:06:31.396 --rc genhtml_function_coverage=1 00:06:31.396 --rc genhtml_legend=1 00:06:31.396 --rc geninfo_all_blocks=1 00:06:31.396 --rc geninfo_unexecuted_blocks=1 00:06:31.396 00:06:31.396 ' 00:06:31.396 01:07:39 -- thread/thread.sh@11 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:06:31.396 01:07:39 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:06:31.396 01:07:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:31.396 01:07:39 -- common/autotest_common.sh@10 -- # set +x 00:06:31.396 ************************************ 00:06:31.396 START TEST thread_poller_perf 00:06:31.396 ************************************ 00:06:31.396 01:07:39 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:06:31.396 [2024-11-20 01:07:39.539310] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:31.396 [2024-11-20 01:07:39.539407] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1023976 ] 00:06:31.396 EAL: No free 2048 kB hugepages reported on node 1 00:06:31.396 [2024-11-20 01:07:39.595400] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:31.654 [2024-11-20 01:07:39.683862] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:31.654 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:06:32.589 [2024-11-20T00:07:40.808Z] ====================================== 00:06:32.589 [2024-11-20T00:07:40.808Z] busy:2715466675 (cyc) 00:06:32.589 [2024-11-20T00:07:40.808Z] total_run_count: 280000 00:06:32.589 [2024-11-20T00:07:40.808Z] tsc_hz: 2700000000 (cyc) 00:06:32.589 [2024-11-20T00:07:40.808Z] ====================================== 00:06:32.589 [2024-11-20T00:07:40.808Z] poller_cost: 9698 (cyc), 3591 (nsec) 00:06:32.589 00:06:32.589 real 0m1.246s 00:06:32.589 user 0m1.163s 00:06:32.589 sys 0m0.076s 00:06:32.589 01:07:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:32.589 01:07:40 -- common/autotest_common.sh@10 -- # set +x 00:06:32.589 ************************************ 00:06:32.589 END TEST thread_poller_perf 00:06:32.589 ************************************ 00:06:32.589 01:07:40 -- thread/thread.sh@12 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:06:32.589 01:07:40 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:06:32.589 01:07:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:32.589 01:07:40 -- common/autotest_common.sh@10 -- # set +x 00:06:32.589 ************************************ 00:06:32.589 START TEST thread_poller_perf 00:06:32.589 ************************************ 00:06:32.589 01:07:40 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:06:32.848 [2024-11-20 01:07:40.815590] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:32.848 [2024-11-20 01:07:40.815675] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1024138 ] 00:06:32.848 EAL: No free 2048 kB hugepages reported on node 1 00:06:32.848 [2024-11-20 01:07:40.877760] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:32.848 [2024-11-20 01:07:40.964985] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:32.848 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:06:34.223 [2024-11-20T00:07:42.442Z] ====================================== 00:06:34.223 [2024-11-20T00:07:42.442Z] busy:2703775348 (cyc) 00:06:34.223 [2024-11-20T00:07:42.442Z] total_run_count: 3826000 00:06:34.223 [2024-11-20T00:07:42.442Z] tsc_hz: 2700000000 (cyc) 00:06:34.223 [2024-11-20T00:07:42.442Z] ====================================== 00:06:34.223 [2024-11-20T00:07:42.442Z] poller_cost: 706 (cyc), 261 (nsec) 00:06:34.223 00:06:34.223 real 0m1.247s 00:06:34.223 user 0m1.154s 00:06:34.223 sys 0m0.086s 00:06:34.223 01:07:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:34.223 01:07:42 -- common/autotest_common.sh@10 -- # set +x 00:06:34.223 ************************************ 00:06:34.223 END TEST thread_poller_perf 00:06:34.223 ************************************ 00:06:34.223 01:07:42 -- thread/thread.sh@17 -- # [[ y != \y ]] 00:06:34.223 00:06:34.223 real 0m2.691s 00:06:34.223 user 0m2.435s 00:06:34.223 sys 0m0.260s 00:06:34.223 01:07:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:34.223 01:07:42 -- common/autotest_common.sh@10 -- # set +x 00:06:34.223 ************************************ 00:06:34.223 END TEST thread 00:06:34.223 ************************************ 00:06:34.223 01:07:42 -- spdk/autotest.sh@176 -- # run_test accel /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:06:34.223 01:07:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:34.223 01:07:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:34.223 01:07:42 -- common/autotest_common.sh@10 -- # set +x 00:06:34.223 ************************************ 00:06:34.223 START TEST accel 00:06:34.223 ************************************ 00:06:34.223 01:07:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:06:34.223 * Looking for test storage... 00:06:34.223 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:06:34.223 01:07:42 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:34.223 01:07:42 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:34.223 01:07:42 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:34.223 01:07:42 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:34.223 01:07:42 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:34.223 01:07:42 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:34.223 01:07:42 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:34.223 01:07:42 -- scripts/common.sh@335 -- # IFS=.-: 00:06:34.223 01:07:42 -- scripts/common.sh@335 -- # read -ra ver1 00:06:34.223 01:07:42 -- scripts/common.sh@336 -- # IFS=.-: 00:06:34.223 01:07:42 -- scripts/common.sh@336 -- # read -ra ver2 00:06:34.223 01:07:42 -- scripts/common.sh@337 -- # local 'op=<' 00:06:34.223 01:07:42 -- scripts/common.sh@339 -- # ver1_l=2 00:06:34.223 01:07:42 -- scripts/common.sh@340 -- # ver2_l=1 00:06:34.223 01:07:42 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:34.223 01:07:42 -- scripts/common.sh@343 -- # case "$op" in 00:06:34.223 01:07:42 -- scripts/common.sh@344 -- # : 1 00:06:34.223 01:07:42 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:34.223 01:07:42 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:34.223 01:07:42 -- scripts/common.sh@364 -- # decimal 1 00:06:34.223 01:07:42 -- scripts/common.sh@352 -- # local d=1 00:06:34.223 01:07:42 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:34.223 01:07:42 -- scripts/common.sh@354 -- # echo 1 00:06:34.223 01:07:42 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:34.223 01:07:42 -- scripts/common.sh@365 -- # decimal 2 00:06:34.223 01:07:42 -- scripts/common.sh@352 -- # local d=2 00:06:34.223 01:07:42 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:34.223 01:07:42 -- scripts/common.sh@354 -- # echo 2 00:06:34.223 01:07:42 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:34.223 01:07:42 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:34.223 01:07:42 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:34.223 01:07:42 -- scripts/common.sh@367 -- # return 0 00:06:34.223 01:07:42 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:34.223 01:07:42 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:34.223 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:34.223 --rc genhtml_branch_coverage=1 00:06:34.223 --rc genhtml_function_coverage=1 00:06:34.223 --rc genhtml_legend=1 00:06:34.223 --rc geninfo_all_blocks=1 00:06:34.223 --rc geninfo_unexecuted_blocks=1 00:06:34.223 00:06:34.223 ' 00:06:34.223 01:07:42 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:34.223 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:34.223 --rc genhtml_branch_coverage=1 00:06:34.223 --rc genhtml_function_coverage=1 00:06:34.223 --rc genhtml_legend=1 00:06:34.223 --rc geninfo_all_blocks=1 00:06:34.223 --rc geninfo_unexecuted_blocks=1 00:06:34.223 00:06:34.223 ' 00:06:34.223 01:07:42 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:34.223 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:34.223 --rc genhtml_branch_coverage=1 00:06:34.223 --rc genhtml_function_coverage=1 00:06:34.223 --rc genhtml_legend=1 00:06:34.223 --rc geninfo_all_blocks=1 00:06:34.223 --rc geninfo_unexecuted_blocks=1 00:06:34.223 00:06:34.223 ' 00:06:34.223 01:07:42 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:34.223 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:34.223 --rc genhtml_branch_coverage=1 00:06:34.223 --rc genhtml_function_coverage=1 00:06:34.223 --rc genhtml_legend=1 00:06:34.223 --rc geninfo_all_blocks=1 00:06:34.223 --rc geninfo_unexecuted_blocks=1 00:06:34.223 00:06:34.223 ' 00:06:34.223 01:07:42 -- accel/accel.sh@73 -- # declare -A expected_opcs 00:06:34.223 01:07:42 -- accel/accel.sh@74 -- # get_expected_opcs 00:06:34.223 01:07:42 -- accel/accel.sh@57 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:06:34.223 01:07:42 -- accel/accel.sh@59 -- # spdk_tgt_pid=1024401 00:06:34.223 01:07:42 -- accel/accel.sh@60 -- # waitforlisten 1024401 00:06:34.223 01:07:42 -- common/autotest_common.sh@829 -- # '[' -z 1024401 ']' 00:06:34.223 01:07:42 -- accel/accel.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -c /dev/fd/63 00:06:34.223 01:07:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:34.223 01:07:42 -- accel/accel.sh@58 -- # build_accel_config 00:06:34.223 01:07:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:34.223 01:07:42 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:34.223 01:07:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:34.223 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:34.223 01:07:42 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:34.223 01:07:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:34.223 01:07:42 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:34.223 01:07:42 -- common/autotest_common.sh@10 -- # set +x 00:06:34.223 01:07:42 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:34.223 01:07:42 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:34.223 01:07:42 -- accel/accel.sh@41 -- # local IFS=, 00:06:34.223 01:07:42 -- accel/accel.sh@42 -- # jq -r . 00:06:34.223 [2024-11-20 01:07:42.294979] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:34.223 [2024-11-20 01:07:42.295086] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1024401 ] 00:06:34.223 EAL: No free 2048 kB hugepages reported on node 1 00:06:34.223 [2024-11-20 01:07:42.356133] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:34.481 [2024-11-20 01:07:42.445991] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:34.481 [2024-11-20 01:07:42.446182] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:35.414 01:07:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:35.414 01:07:43 -- common/autotest_common.sh@862 -- # return 0 00:06:35.414 01:07:43 -- accel/accel.sh@62 -- # exp_opcs=($($rpc_py accel_get_opc_assignments | jq -r ". | to_entries | map(\"\(.key)=\(.value)\") | .[]")) 00:06:35.414 01:07:43 -- accel/accel.sh@62 -- # rpc_cmd accel_get_opc_assignments 00:06:35.414 01:07:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:35.414 01:07:43 -- accel/accel.sh@62 -- # jq -r '. | to_entries | map("\(.key)=\(.value)") | .[]' 00:06:35.414 01:07:43 -- common/autotest_common.sh@10 -- # set +x 00:06:35.414 01:07:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:35.414 01:07:43 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:35.414 01:07:43 -- accel/accel.sh@64 -- # IFS== 00:06:35.414 01:07:43 -- accel/accel.sh@64 -- # read -r opc module 00:06:35.414 01:07:43 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:35.414 01:07:43 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:35.414 01:07:43 -- accel/accel.sh@64 -- # IFS== 00:06:35.414 01:07:43 -- accel/accel.sh@64 -- # read -r opc module 00:06:35.414 01:07:43 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:35.414 01:07:43 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:35.414 01:07:43 -- accel/accel.sh@64 -- # IFS== 00:06:35.414 01:07:43 -- accel/accel.sh@64 -- # read -r opc module 00:06:35.414 01:07:43 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:35.414 01:07:43 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:35.414 01:07:43 -- accel/accel.sh@64 -- # IFS== 00:06:35.414 01:07:43 -- accel/accel.sh@64 -- # read -r opc module 00:06:35.414 01:07:43 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:35.414 01:07:43 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:35.414 01:07:43 -- accel/accel.sh@64 -- # IFS== 00:06:35.414 01:07:43 -- accel/accel.sh@64 -- # read -r opc module 00:06:35.414 01:07:43 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:35.414 01:07:43 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:35.414 01:07:43 -- accel/accel.sh@64 -- # IFS== 00:06:35.414 01:07:43 -- accel/accel.sh@64 -- # read -r opc module 00:06:35.414 01:07:43 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:35.414 01:07:43 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:35.414 01:07:43 -- accel/accel.sh@64 -- # IFS== 00:06:35.414 01:07:43 -- accel/accel.sh@64 -- # read -r opc module 00:06:35.414 01:07:43 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:35.414 01:07:43 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:35.414 01:07:43 -- accel/accel.sh@64 -- # IFS== 00:06:35.414 01:07:43 -- accel/accel.sh@64 -- # read -r opc module 00:06:35.414 01:07:43 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:35.414 01:07:43 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:35.414 01:07:43 -- accel/accel.sh@64 -- # IFS== 00:06:35.414 01:07:43 -- accel/accel.sh@64 -- # read -r opc module 00:06:35.414 01:07:43 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:35.414 01:07:43 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:35.414 01:07:43 -- accel/accel.sh@64 -- # IFS== 00:06:35.414 01:07:43 -- accel/accel.sh@64 -- # read -r opc module 00:06:35.414 01:07:43 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:35.414 01:07:43 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:35.414 01:07:43 -- accel/accel.sh@64 -- # IFS== 00:06:35.414 01:07:43 -- accel/accel.sh@64 -- # read -r opc module 00:06:35.414 01:07:43 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:35.414 01:07:43 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:35.414 01:07:43 -- accel/accel.sh@64 -- # IFS== 00:06:35.414 01:07:43 -- accel/accel.sh@64 -- # read -r opc module 00:06:35.414 01:07:43 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:35.414 01:07:43 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:35.414 01:07:43 -- accel/accel.sh@64 -- # IFS== 00:06:35.414 01:07:43 -- accel/accel.sh@64 -- # read -r opc module 00:06:35.414 01:07:43 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:35.414 01:07:43 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:35.414 01:07:43 -- accel/accel.sh@64 -- # IFS== 00:06:35.414 01:07:43 -- accel/accel.sh@64 -- # read -r opc module 00:06:35.414 01:07:43 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:35.414 01:07:43 -- accel/accel.sh@67 -- # killprocess 1024401 00:06:35.414 01:07:43 -- common/autotest_common.sh@936 -- # '[' -z 1024401 ']' 00:06:35.414 01:07:43 -- common/autotest_common.sh@940 -- # kill -0 1024401 00:06:35.414 01:07:43 -- common/autotest_common.sh@941 -- # uname 00:06:35.414 01:07:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:35.414 01:07:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1024401 00:06:35.414 01:07:43 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:35.414 01:07:43 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:35.414 01:07:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1024401' 00:06:35.414 killing process with pid 1024401 00:06:35.414 01:07:43 -- common/autotest_common.sh@955 -- # kill 1024401 00:06:35.414 01:07:43 -- common/autotest_common.sh@960 -- # wait 1024401 00:06:35.672 01:07:43 -- accel/accel.sh@68 -- # trap - ERR 00:06:35.672 01:07:43 -- accel/accel.sh@81 -- # run_test accel_help accel_perf -h 00:06:35.672 01:07:43 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:35.672 01:07:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:35.672 01:07:43 -- common/autotest_common.sh@10 -- # set +x 00:06:35.672 01:07:43 -- common/autotest_common.sh@1114 -- # accel_perf -h 00:06:35.672 01:07:43 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -h 00:06:35.672 01:07:43 -- accel/accel.sh@12 -- # build_accel_config 00:06:35.672 01:07:43 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:35.672 01:07:43 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:35.672 01:07:43 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:35.672 01:07:43 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:35.672 01:07:43 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:35.673 01:07:43 -- accel/accel.sh@41 -- # local IFS=, 00:06:35.673 01:07:43 -- accel/accel.sh@42 -- # jq -r . 00:06:35.673 01:07:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:35.673 01:07:43 -- common/autotest_common.sh@10 -- # set +x 00:06:35.673 01:07:43 -- accel/accel.sh@83 -- # run_test accel_missing_filename NOT accel_perf -t 1 -w compress 00:06:35.673 01:07:43 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:35.673 01:07:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:35.673 01:07:43 -- common/autotest_common.sh@10 -- # set +x 00:06:35.673 ************************************ 00:06:35.673 START TEST accel_missing_filename 00:06:35.673 ************************************ 00:06:35.673 01:07:43 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress 00:06:35.673 01:07:43 -- common/autotest_common.sh@650 -- # local es=0 00:06:35.673 01:07:43 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress 00:06:35.673 01:07:43 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:06:35.673 01:07:43 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:35.673 01:07:43 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:06:35.673 01:07:43 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:35.673 01:07:43 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress 00:06:35.673 01:07:43 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress 00:06:35.673 01:07:43 -- accel/accel.sh@12 -- # build_accel_config 00:06:35.673 01:07:43 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:35.673 01:07:43 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:35.673 01:07:43 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:35.673 01:07:43 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:35.673 01:07:43 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:35.673 01:07:43 -- accel/accel.sh@41 -- # local IFS=, 00:06:35.673 01:07:43 -- accel/accel.sh@42 -- # jq -r . 00:06:35.673 [2024-11-20 01:07:43.822230] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:35.673 [2024-11-20 01:07:43.822309] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1024645 ] 00:06:35.673 EAL: No free 2048 kB hugepages reported on node 1 00:06:35.673 [2024-11-20 01:07:43.882258] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:35.931 [2024-11-20 01:07:43.972927] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:35.931 [2024-11-20 01:07:44.034542] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:06:35.931 [2024-11-20 01:07:44.123139] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:06:36.190 A filename is required. 00:06:36.190 01:07:44 -- common/autotest_common.sh@653 -- # es=234 00:06:36.190 01:07:44 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:36.190 01:07:44 -- common/autotest_common.sh@662 -- # es=106 00:06:36.190 01:07:44 -- common/autotest_common.sh@663 -- # case "$es" in 00:06:36.190 01:07:44 -- common/autotest_common.sh@670 -- # es=1 00:06:36.190 01:07:44 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:36.190 00:06:36.190 real 0m0.399s 00:06:36.190 user 0m0.286s 00:06:36.190 sys 0m0.144s 00:06:36.190 01:07:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:36.190 01:07:44 -- common/autotest_common.sh@10 -- # set +x 00:06:36.190 ************************************ 00:06:36.190 END TEST accel_missing_filename 00:06:36.190 ************************************ 00:06:36.190 01:07:44 -- accel/accel.sh@85 -- # run_test accel_compress_verify NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:36.190 01:07:44 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:06:36.190 01:07:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:36.190 01:07:44 -- common/autotest_common.sh@10 -- # set +x 00:06:36.190 ************************************ 00:06:36.190 START TEST accel_compress_verify 00:06:36.190 ************************************ 00:06:36.190 01:07:44 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:36.190 01:07:44 -- common/autotest_common.sh@650 -- # local es=0 00:06:36.190 01:07:44 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:36.190 01:07:44 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:06:36.190 01:07:44 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:36.190 01:07:44 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:06:36.190 01:07:44 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:36.190 01:07:44 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:36.190 01:07:44 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:36.190 01:07:44 -- accel/accel.sh@12 -- # build_accel_config 00:06:36.190 01:07:44 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:36.190 01:07:44 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:36.190 01:07:44 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:36.190 01:07:44 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:36.190 01:07:44 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:36.190 01:07:44 -- accel/accel.sh@41 -- # local IFS=, 00:06:36.190 01:07:44 -- accel/accel.sh@42 -- # jq -r . 00:06:36.190 [2024-11-20 01:07:44.253296] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:36.190 [2024-11-20 01:07:44.253369] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1024664 ] 00:06:36.190 EAL: No free 2048 kB hugepages reported on node 1 00:06:36.190 [2024-11-20 01:07:44.314526] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:36.190 [2024-11-20 01:07:44.402713] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:36.449 [2024-11-20 01:07:44.462650] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:06:36.449 [2024-11-20 01:07:44.544804] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:06:36.449 00:06:36.449 Compression does not support the verify option, aborting. 00:06:36.449 01:07:44 -- common/autotest_common.sh@653 -- # es=161 00:06:36.449 01:07:44 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:36.449 01:07:44 -- common/autotest_common.sh@662 -- # es=33 00:06:36.449 01:07:44 -- common/autotest_common.sh@663 -- # case "$es" in 00:06:36.449 01:07:44 -- common/autotest_common.sh@670 -- # es=1 00:06:36.449 01:07:44 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:36.449 00:06:36.449 real 0m0.386s 00:06:36.449 user 0m0.278s 00:06:36.449 sys 0m0.140s 00:06:36.449 01:07:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:36.449 01:07:44 -- common/autotest_common.sh@10 -- # set +x 00:06:36.449 ************************************ 00:06:36.449 END TEST accel_compress_verify 00:06:36.449 ************************************ 00:06:36.449 01:07:44 -- accel/accel.sh@87 -- # run_test accel_wrong_workload NOT accel_perf -t 1 -w foobar 00:06:36.449 01:07:44 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:36.449 01:07:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:36.449 01:07:44 -- common/autotest_common.sh@10 -- # set +x 00:06:36.449 ************************************ 00:06:36.449 START TEST accel_wrong_workload 00:06:36.449 ************************************ 00:06:36.449 01:07:44 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w foobar 00:06:36.449 01:07:44 -- common/autotest_common.sh@650 -- # local es=0 00:06:36.449 01:07:44 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w foobar 00:06:36.449 01:07:44 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:06:36.449 01:07:44 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:36.449 01:07:44 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:06:36.449 01:07:44 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:36.449 01:07:44 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w foobar 00:06:36.449 01:07:44 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w foobar 00:06:36.449 01:07:44 -- accel/accel.sh@12 -- # build_accel_config 00:06:36.449 01:07:44 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:36.449 01:07:44 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:36.449 01:07:44 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:36.449 01:07:44 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:36.449 01:07:44 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:36.449 01:07:44 -- accel/accel.sh@41 -- # local IFS=, 00:06:36.449 01:07:44 -- accel/accel.sh@42 -- # jq -r . 00:06:36.449 Unsupported workload type: foobar 00:06:36.449 [2024-11-20 01:07:44.660854] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'w' failed: 1 00:06:36.449 accel_perf options: 00:06:36.449 [-h help message] 00:06:36.449 [-q queue depth per core] 00:06:36.449 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:06:36.449 [-T number of threads per core 00:06:36.449 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:06:36.449 [-t time in seconds] 00:06:36.449 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:06:36.449 [ dif_verify, , dif_generate, dif_generate_copy 00:06:36.449 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:06:36.449 [-l for compress/decompress workloads, name of uncompressed input file 00:06:36.449 [-S for crc32c workload, use this seed value (default 0) 00:06:36.449 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:06:36.449 [-f for fill workload, use this BYTE value (default 255) 00:06:36.449 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:06:36.449 [-y verify result if this switch is on] 00:06:36.449 [-a tasks to allocate per core (default: same value as -q)] 00:06:36.449 Can be used to spread operations across a wider range of memory. 00:06:36.707 01:07:44 -- common/autotest_common.sh@653 -- # es=1 00:06:36.708 01:07:44 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:36.708 01:07:44 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:36.708 01:07:44 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:36.708 00:06:36.708 real 0m0.022s 00:06:36.708 user 0m0.011s 00:06:36.708 sys 0m0.011s 00:06:36.708 01:07:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:36.708 01:07:44 -- common/autotest_common.sh@10 -- # set +x 00:06:36.708 ************************************ 00:06:36.708 END TEST accel_wrong_workload 00:06:36.708 ************************************ 00:06:36.708 Error: writing output failed: Broken pipe 00:06:36.708 01:07:44 -- accel/accel.sh@89 -- # run_test accel_negative_buffers NOT accel_perf -t 1 -w xor -y -x -1 00:06:36.708 01:07:44 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:06:36.708 01:07:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:36.708 01:07:44 -- common/autotest_common.sh@10 -- # set +x 00:06:36.708 ************************************ 00:06:36.708 START TEST accel_negative_buffers 00:06:36.708 ************************************ 00:06:36.708 01:07:44 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w xor -y -x -1 00:06:36.708 01:07:44 -- common/autotest_common.sh@650 -- # local es=0 00:06:36.708 01:07:44 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w xor -y -x -1 00:06:36.708 01:07:44 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:06:36.708 01:07:44 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:36.708 01:07:44 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:06:36.708 01:07:44 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:36.708 01:07:44 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w xor -y -x -1 00:06:36.708 01:07:44 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x -1 00:06:36.708 01:07:44 -- accel/accel.sh@12 -- # build_accel_config 00:06:36.708 01:07:44 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:36.708 01:07:44 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:36.708 01:07:44 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:36.708 01:07:44 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:36.708 01:07:44 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:36.708 01:07:44 -- accel/accel.sh@41 -- # local IFS=, 00:06:36.708 01:07:44 -- accel/accel.sh@42 -- # jq -r . 00:06:36.708 -x option must be non-negative. 00:06:36.708 [2024-11-20 01:07:44.700430] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'x' failed: 1 00:06:36.708 accel_perf options: 00:06:36.708 [-h help message] 00:06:36.708 [-q queue depth per core] 00:06:36.708 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:06:36.708 [-T number of threads per core 00:06:36.708 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:06:36.708 [-t time in seconds] 00:06:36.708 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:06:36.708 [ dif_verify, , dif_generate, dif_generate_copy 00:06:36.708 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:06:36.708 [-l for compress/decompress workloads, name of uncompressed input file 00:06:36.708 [-S for crc32c workload, use this seed value (default 0) 00:06:36.708 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:06:36.708 [-f for fill workload, use this BYTE value (default 255) 00:06:36.708 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:06:36.708 [-y verify result if this switch is on] 00:06:36.708 [-a tasks to allocate per core (default: same value as -q)] 00:06:36.708 Can be used to spread operations across a wider range of memory. 00:06:36.708 01:07:44 -- common/autotest_common.sh@653 -- # es=1 00:06:36.708 01:07:44 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:36.708 01:07:44 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:36.708 01:07:44 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:36.708 00:06:36.708 real 0m0.018s 00:06:36.708 user 0m0.008s 00:06:36.708 sys 0m0.010s 00:06:36.708 01:07:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:36.708 01:07:44 -- common/autotest_common.sh@10 -- # set +x 00:06:36.708 ************************************ 00:06:36.708 END TEST accel_negative_buffers 00:06:36.708 ************************************ 00:06:36.708 Error: writing output failed: Broken pipe 00:06:36.708 01:07:44 -- accel/accel.sh@93 -- # run_test accel_crc32c accel_test -t 1 -w crc32c -S 32 -y 00:06:36.708 01:07:44 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:36.708 01:07:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:36.708 01:07:44 -- common/autotest_common.sh@10 -- # set +x 00:06:36.708 ************************************ 00:06:36.708 START TEST accel_crc32c 00:06:36.708 ************************************ 00:06:36.708 01:07:44 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -S 32 -y 00:06:36.708 01:07:44 -- accel/accel.sh@16 -- # local accel_opc 00:06:36.708 01:07:44 -- accel/accel.sh@17 -- # local accel_module 00:06:36.708 01:07:44 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:06:36.708 01:07:44 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:06:36.708 01:07:44 -- accel/accel.sh@12 -- # build_accel_config 00:06:36.708 01:07:44 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:36.708 01:07:44 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:36.708 01:07:44 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:36.708 01:07:44 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:36.708 01:07:44 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:36.708 01:07:44 -- accel/accel.sh@41 -- # local IFS=, 00:06:36.708 01:07:44 -- accel/accel.sh@42 -- # jq -r . 00:06:36.708 [2024-11-20 01:07:44.742689] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:36.708 [2024-11-20 01:07:44.742754] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1024851 ] 00:06:36.708 EAL: No free 2048 kB hugepages reported on node 1 00:06:36.708 [2024-11-20 01:07:44.804322] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:36.708 [2024-11-20 01:07:44.894791] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:38.082 01:07:46 -- accel/accel.sh@18 -- # out=' 00:06:38.082 SPDK Configuration: 00:06:38.082 Core mask: 0x1 00:06:38.082 00:06:38.082 Accel Perf Configuration: 00:06:38.082 Workload Type: crc32c 00:06:38.082 CRC-32C seed: 32 00:06:38.082 Transfer size: 4096 bytes 00:06:38.082 Vector count 1 00:06:38.082 Module: software 00:06:38.082 Queue depth: 32 00:06:38.082 Allocate depth: 32 00:06:38.082 # threads/core: 1 00:06:38.082 Run time: 1 seconds 00:06:38.082 Verify: Yes 00:06:38.082 00:06:38.082 Running for 1 seconds... 00:06:38.082 00:06:38.082 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:38.082 ------------------------------------------------------------------------------------ 00:06:38.082 0,0 402048/s 1570 MiB/s 0 0 00:06:38.082 ==================================================================================== 00:06:38.082 Total 402048/s 1570 MiB/s 0 0' 00:06:38.082 01:07:46 -- accel/accel.sh@20 -- # IFS=: 00:06:38.082 01:07:46 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:06:38.082 01:07:46 -- accel/accel.sh@20 -- # read -r var val 00:06:38.082 01:07:46 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:06:38.082 01:07:46 -- accel/accel.sh@12 -- # build_accel_config 00:06:38.082 01:07:46 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:38.082 01:07:46 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:38.082 01:07:46 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:38.082 01:07:46 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:38.083 01:07:46 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:38.083 01:07:46 -- accel/accel.sh@41 -- # local IFS=, 00:06:38.083 01:07:46 -- accel/accel.sh@42 -- # jq -r . 00:06:38.083 [2024-11-20 01:07:46.139660] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:38.083 [2024-11-20 01:07:46.139748] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1025006 ] 00:06:38.083 EAL: No free 2048 kB hugepages reported on node 1 00:06:38.083 [2024-11-20 01:07:46.202503] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:38.083 [2024-11-20 01:07:46.292479] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:38.341 01:07:46 -- accel/accel.sh@21 -- # val= 00:06:38.341 01:07:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.341 01:07:46 -- accel/accel.sh@20 -- # IFS=: 00:06:38.341 01:07:46 -- accel/accel.sh@20 -- # read -r var val 00:06:38.341 01:07:46 -- accel/accel.sh@21 -- # val= 00:06:38.341 01:07:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.341 01:07:46 -- accel/accel.sh@20 -- # IFS=: 00:06:38.341 01:07:46 -- accel/accel.sh@20 -- # read -r var val 00:06:38.341 01:07:46 -- accel/accel.sh@21 -- # val=0x1 00:06:38.341 01:07:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.341 01:07:46 -- accel/accel.sh@20 -- # IFS=: 00:06:38.341 01:07:46 -- accel/accel.sh@20 -- # read -r var val 00:06:38.341 01:07:46 -- accel/accel.sh@21 -- # val= 00:06:38.341 01:07:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.341 01:07:46 -- accel/accel.sh@20 -- # IFS=: 00:06:38.341 01:07:46 -- accel/accel.sh@20 -- # read -r var val 00:06:38.341 01:07:46 -- accel/accel.sh@21 -- # val= 00:06:38.341 01:07:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.341 01:07:46 -- accel/accel.sh@20 -- # IFS=: 00:06:38.341 01:07:46 -- accel/accel.sh@20 -- # read -r var val 00:06:38.341 01:07:46 -- accel/accel.sh@21 -- # val=crc32c 00:06:38.341 01:07:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.341 01:07:46 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:06:38.341 01:07:46 -- accel/accel.sh@20 -- # IFS=: 00:06:38.341 01:07:46 -- accel/accel.sh@20 -- # read -r var val 00:06:38.341 01:07:46 -- accel/accel.sh@21 -- # val=32 00:06:38.341 01:07:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.341 01:07:46 -- accel/accel.sh@20 -- # IFS=: 00:06:38.341 01:07:46 -- accel/accel.sh@20 -- # read -r var val 00:06:38.341 01:07:46 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:38.341 01:07:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.341 01:07:46 -- accel/accel.sh@20 -- # IFS=: 00:06:38.341 01:07:46 -- accel/accel.sh@20 -- # read -r var val 00:06:38.341 01:07:46 -- accel/accel.sh@21 -- # val= 00:06:38.341 01:07:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.341 01:07:46 -- accel/accel.sh@20 -- # IFS=: 00:06:38.341 01:07:46 -- accel/accel.sh@20 -- # read -r var val 00:06:38.341 01:07:46 -- accel/accel.sh@21 -- # val=software 00:06:38.341 01:07:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.341 01:07:46 -- accel/accel.sh@23 -- # accel_module=software 00:06:38.341 01:07:46 -- accel/accel.sh@20 -- # IFS=: 00:06:38.341 01:07:46 -- accel/accel.sh@20 -- # read -r var val 00:06:38.341 01:07:46 -- accel/accel.sh@21 -- # val=32 00:06:38.341 01:07:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.341 01:07:46 -- accel/accel.sh@20 -- # IFS=: 00:06:38.341 01:07:46 -- accel/accel.sh@20 -- # read -r var val 00:06:38.341 01:07:46 -- accel/accel.sh@21 -- # val=32 00:06:38.341 01:07:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.341 01:07:46 -- accel/accel.sh@20 -- # IFS=: 00:06:38.341 01:07:46 -- accel/accel.sh@20 -- # read -r var val 00:06:38.341 01:07:46 -- accel/accel.sh@21 -- # val=1 00:06:38.341 01:07:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.341 01:07:46 -- accel/accel.sh@20 -- # IFS=: 00:06:38.341 01:07:46 -- accel/accel.sh@20 -- # read -r var val 00:06:38.341 01:07:46 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:38.341 01:07:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.341 01:07:46 -- accel/accel.sh@20 -- # IFS=: 00:06:38.341 01:07:46 -- accel/accel.sh@20 -- # read -r var val 00:06:38.341 01:07:46 -- accel/accel.sh@21 -- # val=Yes 00:06:38.341 01:07:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.341 01:07:46 -- accel/accel.sh@20 -- # IFS=: 00:06:38.341 01:07:46 -- accel/accel.sh@20 -- # read -r var val 00:06:38.341 01:07:46 -- accel/accel.sh@21 -- # val= 00:06:38.341 01:07:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.341 01:07:46 -- accel/accel.sh@20 -- # IFS=: 00:06:38.341 01:07:46 -- accel/accel.sh@20 -- # read -r var val 00:06:38.341 01:07:46 -- accel/accel.sh@21 -- # val= 00:06:38.341 01:07:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.341 01:07:46 -- accel/accel.sh@20 -- # IFS=: 00:06:38.341 01:07:46 -- accel/accel.sh@20 -- # read -r var val 00:06:39.720 01:07:47 -- accel/accel.sh@21 -- # val= 00:06:39.720 01:07:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.720 01:07:47 -- accel/accel.sh@20 -- # IFS=: 00:06:39.720 01:07:47 -- accel/accel.sh@20 -- # read -r var val 00:06:39.720 01:07:47 -- accel/accel.sh@21 -- # val= 00:06:39.720 01:07:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.720 01:07:47 -- accel/accel.sh@20 -- # IFS=: 00:06:39.720 01:07:47 -- accel/accel.sh@20 -- # read -r var val 00:06:39.720 01:07:47 -- accel/accel.sh@21 -- # val= 00:06:39.720 01:07:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.720 01:07:47 -- accel/accel.sh@20 -- # IFS=: 00:06:39.720 01:07:47 -- accel/accel.sh@20 -- # read -r var val 00:06:39.720 01:07:47 -- accel/accel.sh@21 -- # val= 00:06:39.720 01:07:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.720 01:07:47 -- accel/accel.sh@20 -- # IFS=: 00:06:39.720 01:07:47 -- accel/accel.sh@20 -- # read -r var val 00:06:39.720 01:07:47 -- accel/accel.sh@21 -- # val= 00:06:39.720 01:07:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.720 01:07:47 -- accel/accel.sh@20 -- # IFS=: 00:06:39.720 01:07:47 -- accel/accel.sh@20 -- # read -r var val 00:06:39.720 01:07:47 -- accel/accel.sh@21 -- # val= 00:06:39.720 01:07:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.720 01:07:47 -- accel/accel.sh@20 -- # IFS=: 00:06:39.720 01:07:47 -- accel/accel.sh@20 -- # read -r var val 00:06:39.720 01:07:47 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:39.720 01:07:47 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:06:39.720 01:07:47 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:39.720 00:06:39.720 real 0m2.797s 00:06:39.720 user 0m2.493s 00:06:39.720 sys 0m0.296s 00:06:39.720 01:07:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:39.720 01:07:47 -- common/autotest_common.sh@10 -- # set +x 00:06:39.720 ************************************ 00:06:39.720 END TEST accel_crc32c 00:06:39.720 ************************************ 00:06:39.720 01:07:47 -- accel/accel.sh@94 -- # run_test accel_crc32c_C2 accel_test -t 1 -w crc32c -y -C 2 00:06:39.720 01:07:47 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:39.720 01:07:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:39.720 01:07:47 -- common/autotest_common.sh@10 -- # set +x 00:06:39.720 ************************************ 00:06:39.720 START TEST accel_crc32c_C2 00:06:39.720 ************************************ 00:06:39.720 01:07:47 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -y -C 2 00:06:39.720 01:07:47 -- accel/accel.sh@16 -- # local accel_opc 00:06:39.720 01:07:47 -- accel/accel.sh@17 -- # local accel_module 00:06:39.720 01:07:47 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -y -C 2 00:06:39.720 01:07:47 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:06:39.720 01:07:47 -- accel/accel.sh@12 -- # build_accel_config 00:06:39.720 01:07:47 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:39.720 01:07:47 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:39.720 01:07:47 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:39.720 01:07:47 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:39.720 01:07:47 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:39.720 01:07:47 -- accel/accel.sh@41 -- # local IFS=, 00:06:39.720 01:07:47 -- accel/accel.sh@42 -- # jq -r . 00:06:39.720 [2024-11-20 01:07:47.563643] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:39.720 [2024-11-20 01:07:47.563729] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1025159 ] 00:06:39.720 EAL: No free 2048 kB hugepages reported on node 1 00:06:39.720 [2024-11-20 01:07:47.624772] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:39.720 [2024-11-20 01:07:47.715822] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:41.094 01:07:48 -- accel/accel.sh@18 -- # out=' 00:06:41.094 SPDK Configuration: 00:06:41.094 Core mask: 0x1 00:06:41.094 00:06:41.094 Accel Perf Configuration: 00:06:41.094 Workload Type: crc32c 00:06:41.094 CRC-32C seed: 0 00:06:41.094 Transfer size: 4096 bytes 00:06:41.094 Vector count 2 00:06:41.094 Module: software 00:06:41.094 Queue depth: 32 00:06:41.094 Allocate depth: 32 00:06:41.094 # threads/core: 1 00:06:41.094 Run time: 1 seconds 00:06:41.094 Verify: Yes 00:06:41.094 00:06:41.094 Running for 1 seconds... 00:06:41.094 00:06:41.094 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:41.094 ------------------------------------------------------------------------------------ 00:06:41.094 0,0 314816/s 2459 MiB/s 0 0 00:06:41.094 ==================================================================================== 00:06:41.094 Total 314816/s 1229 MiB/s 0 0' 00:06:41.094 01:07:48 -- accel/accel.sh@20 -- # IFS=: 00:06:41.094 01:07:48 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -y -C 2 00:06:41.094 01:07:48 -- accel/accel.sh@20 -- # read -r var val 00:06:41.094 01:07:48 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:06:41.094 01:07:48 -- accel/accel.sh@12 -- # build_accel_config 00:06:41.094 01:07:48 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:41.094 01:07:48 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:41.094 01:07:48 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:41.094 01:07:48 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:41.094 01:07:48 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:41.094 01:07:48 -- accel/accel.sh@41 -- # local IFS=, 00:06:41.094 01:07:48 -- accel/accel.sh@42 -- # jq -r . 00:06:41.094 [2024-11-20 01:07:48.964254] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:41.094 [2024-11-20 01:07:48.964333] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1025347 ] 00:06:41.094 EAL: No free 2048 kB hugepages reported on node 1 00:06:41.094 [2024-11-20 01:07:49.025650] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:41.094 [2024-11-20 01:07:49.115389] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:41.094 01:07:49 -- accel/accel.sh@21 -- # val= 00:06:41.094 01:07:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.094 01:07:49 -- accel/accel.sh@20 -- # IFS=: 00:06:41.094 01:07:49 -- accel/accel.sh@20 -- # read -r var val 00:06:41.094 01:07:49 -- accel/accel.sh@21 -- # val= 00:06:41.094 01:07:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.094 01:07:49 -- accel/accel.sh@20 -- # IFS=: 00:06:41.094 01:07:49 -- accel/accel.sh@20 -- # read -r var val 00:06:41.094 01:07:49 -- accel/accel.sh@21 -- # val=0x1 00:06:41.094 01:07:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.094 01:07:49 -- accel/accel.sh@20 -- # IFS=: 00:06:41.094 01:07:49 -- accel/accel.sh@20 -- # read -r var val 00:06:41.094 01:07:49 -- accel/accel.sh@21 -- # val= 00:06:41.094 01:07:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.094 01:07:49 -- accel/accel.sh@20 -- # IFS=: 00:06:41.094 01:07:49 -- accel/accel.sh@20 -- # read -r var val 00:06:41.094 01:07:49 -- accel/accel.sh@21 -- # val= 00:06:41.094 01:07:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.094 01:07:49 -- accel/accel.sh@20 -- # IFS=: 00:06:41.094 01:07:49 -- accel/accel.sh@20 -- # read -r var val 00:06:41.094 01:07:49 -- accel/accel.sh@21 -- # val=crc32c 00:06:41.094 01:07:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.094 01:07:49 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:06:41.094 01:07:49 -- accel/accel.sh@20 -- # IFS=: 00:06:41.094 01:07:49 -- accel/accel.sh@20 -- # read -r var val 00:06:41.094 01:07:49 -- accel/accel.sh@21 -- # val=0 00:06:41.094 01:07:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.094 01:07:49 -- accel/accel.sh@20 -- # IFS=: 00:06:41.094 01:07:49 -- accel/accel.sh@20 -- # read -r var val 00:06:41.094 01:07:49 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:41.094 01:07:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.094 01:07:49 -- accel/accel.sh@20 -- # IFS=: 00:06:41.094 01:07:49 -- accel/accel.sh@20 -- # read -r var val 00:06:41.094 01:07:49 -- accel/accel.sh@21 -- # val= 00:06:41.094 01:07:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.094 01:07:49 -- accel/accel.sh@20 -- # IFS=: 00:06:41.094 01:07:49 -- accel/accel.sh@20 -- # read -r var val 00:06:41.094 01:07:49 -- accel/accel.sh@21 -- # val=software 00:06:41.094 01:07:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.094 01:07:49 -- accel/accel.sh@23 -- # accel_module=software 00:06:41.094 01:07:49 -- accel/accel.sh@20 -- # IFS=: 00:06:41.094 01:07:49 -- accel/accel.sh@20 -- # read -r var val 00:06:41.094 01:07:49 -- accel/accel.sh@21 -- # val=32 00:06:41.094 01:07:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.094 01:07:49 -- accel/accel.sh@20 -- # IFS=: 00:06:41.094 01:07:49 -- accel/accel.sh@20 -- # read -r var val 00:06:41.094 01:07:49 -- accel/accel.sh@21 -- # val=32 00:06:41.094 01:07:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.094 01:07:49 -- accel/accel.sh@20 -- # IFS=: 00:06:41.094 01:07:49 -- accel/accel.sh@20 -- # read -r var val 00:06:41.094 01:07:49 -- accel/accel.sh@21 -- # val=1 00:06:41.094 01:07:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.094 01:07:49 -- accel/accel.sh@20 -- # IFS=: 00:06:41.094 01:07:49 -- accel/accel.sh@20 -- # read -r var val 00:06:41.094 01:07:49 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:41.094 01:07:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.094 01:07:49 -- accel/accel.sh@20 -- # IFS=: 00:06:41.094 01:07:49 -- accel/accel.sh@20 -- # read -r var val 00:06:41.094 01:07:49 -- accel/accel.sh@21 -- # val=Yes 00:06:41.094 01:07:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.094 01:07:49 -- accel/accel.sh@20 -- # IFS=: 00:06:41.094 01:07:49 -- accel/accel.sh@20 -- # read -r var val 00:06:41.094 01:07:49 -- accel/accel.sh@21 -- # val= 00:06:41.094 01:07:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.094 01:07:49 -- accel/accel.sh@20 -- # IFS=: 00:06:41.094 01:07:49 -- accel/accel.sh@20 -- # read -r var val 00:06:41.094 01:07:49 -- accel/accel.sh@21 -- # val= 00:06:41.094 01:07:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.094 01:07:49 -- accel/accel.sh@20 -- # IFS=: 00:06:41.094 01:07:49 -- accel/accel.sh@20 -- # read -r var val 00:06:42.466 01:07:50 -- accel/accel.sh@21 -- # val= 00:06:42.466 01:07:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.466 01:07:50 -- accel/accel.sh@20 -- # IFS=: 00:06:42.466 01:07:50 -- accel/accel.sh@20 -- # read -r var val 00:06:42.466 01:07:50 -- accel/accel.sh@21 -- # val= 00:06:42.466 01:07:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.466 01:07:50 -- accel/accel.sh@20 -- # IFS=: 00:06:42.466 01:07:50 -- accel/accel.sh@20 -- # read -r var val 00:06:42.466 01:07:50 -- accel/accel.sh@21 -- # val= 00:06:42.466 01:07:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.466 01:07:50 -- accel/accel.sh@20 -- # IFS=: 00:06:42.466 01:07:50 -- accel/accel.sh@20 -- # read -r var val 00:06:42.466 01:07:50 -- accel/accel.sh@21 -- # val= 00:06:42.466 01:07:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.466 01:07:50 -- accel/accel.sh@20 -- # IFS=: 00:06:42.466 01:07:50 -- accel/accel.sh@20 -- # read -r var val 00:06:42.466 01:07:50 -- accel/accel.sh@21 -- # val= 00:06:42.466 01:07:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.466 01:07:50 -- accel/accel.sh@20 -- # IFS=: 00:06:42.466 01:07:50 -- accel/accel.sh@20 -- # read -r var val 00:06:42.466 01:07:50 -- accel/accel.sh@21 -- # val= 00:06:42.466 01:07:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.466 01:07:50 -- accel/accel.sh@20 -- # IFS=: 00:06:42.466 01:07:50 -- accel/accel.sh@20 -- # read -r var val 00:06:42.466 01:07:50 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:42.466 01:07:50 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:06:42.466 01:07:50 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:42.466 00:06:42.466 real 0m2.799s 00:06:42.466 user 0m2.503s 00:06:42.466 sys 0m0.288s 00:06:42.466 01:07:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:42.466 01:07:50 -- common/autotest_common.sh@10 -- # set +x 00:06:42.466 ************************************ 00:06:42.466 END TEST accel_crc32c_C2 00:06:42.466 ************************************ 00:06:42.466 01:07:50 -- accel/accel.sh@95 -- # run_test accel_copy accel_test -t 1 -w copy -y 00:06:42.466 01:07:50 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:42.466 01:07:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:42.466 01:07:50 -- common/autotest_common.sh@10 -- # set +x 00:06:42.466 ************************************ 00:06:42.466 START TEST accel_copy 00:06:42.466 ************************************ 00:06:42.466 01:07:50 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy -y 00:06:42.466 01:07:50 -- accel/accel.sh@16 -- # local accel_opc 00:06:42.466 01:07:50 -- accel/accel.sh@17 -- # local accel_module 00:06:42.466 01:07:50 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy -y 00:06:42.466 01:07:50 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:06:42.466 01:07:50 -- accel/accel.sh@12 -- # build_accel_config 00:06:42.466 01:07:50 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:42.466 01:07:50 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:42.466 01:07:50 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:42.466 01:07:50 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:42.466 01:07:50 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:42.466 01:07:50 -- accel/accel.sh@41 -- # local IFS=, 00:06:42.466 01:07:50 -- accel/accel.sh@42 -- # jq -r . 00:06:42.467 [2024-11-20 01:07:50.385005] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:42.467 [2024-11-20 01:07:50.385116] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1025585 ] 00:06:42.467 EAL: No free 2048 kB hugepages reported on node 1 00:06:42.467 [2024-11-20 01:07:50.448730] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:42.467 [2024-11-20 01:07:50.539147] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:43.903 01:07:51 -- accel/accel.sh@18 -- # out=' 00:06:43.903 SPDK Configuration: 00:06:43.903 Core mask: 0x1 00:06:43.903 00:06:43.903 Accel Perf Configuration: 00:06:43.903 Workload Type: copy 00:06:43.903 Transfer size: 4096 bytes 00:06:43.903 Vector count 1 00:06:43.903 Module: software 00:06:43.903 Queue depth: 32 00:06:43.903 Allocate depth: 32 00:06:43.903 # threads/core: 1 00:06:43.903 Run time: 1 seconds 00:06:43.903 Verify: Yes 00:06:43.903 00:06:43.903 Running for 1 seconds... 00:06:43.903 00:06:43.903 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:43.903 ------------------------------------------------------------------------------------ 00:06:43.903 0,0 279488/s 1091 MiB/s 0 0 00:06:43.903 ==================================================================================== 00:06:43.903 Total 279488/s 1091 MiB/s 0 0' 00:06:43.903 01:07:51 -- accel/accel.sh@20 -- # IFS=: 00:06:43.903 01:07:51 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy -y 00:06:43.903 01:07:51 -- accel/accel.sh@20 -- # read -r var val 00:06:43.903 01:07:51 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:06:43.903 01:07:51 -- accel/accel.sh@12 -- # build_accel_config 00:06:43.903 01:07:51 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:43.903 01:07:51 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:43.903 01:07:51 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:43.903 01:07:51 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:43.903 01:07:51 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:43.903 01:07:51 -- accel/accel.sh@41 -- # local IFS=, 00:06:43.903 01:07:51 -- accel/accel.sh@42 -- # jq -r . 00:06:43.903 [2024-11-20 01:07:51.788658] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:43.903 [2024-11-20 01:07:51.788748] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1025735 ] 00:06:43.903 EAL: No free 2048 kB hugepages reported on node 1 00:06:43.903 [2024-11-20 01:07:51.853469] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:43.903 [2024-11-20 01:07:51.943253] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:43.903 01:07:52 -- accel/accel.sh@21 -- # val= 00:06:43.903 01:07:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:43.903 01:07:52 -- accel/accel.sh@20 -- # IFS=: 00:06:43.903 01:07:52 -- accel/accel.sh@20 -- # read -r var val 00:06:43.903 01:07:52 -- accel/accel.sh@21 -- # val= 00:06:43.903 01:07:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:43.903 01:07:52 -- accel/accel.sh@20 -- # IFS=: 00:06:43.903 01:07:52 -- accel/accel.sh@20 -- # read -r var val 00:06:43.903 01:07:52 -- accel/accel.sh@21 -- # val=0x1 00:06:43.903 01:07:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:43.903 01:07:52 -- accel/accel.sh@20 -- # IFS=: 00:06:43.903 01:07:52 -- accel/accel.sh@20 -- # read -r var val 00:06:43.903 01:07:52 -- accel/accel.sh@21 -- # val= 00:06:43.903 01:07:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:43.903 01:07:52 -- accel/accel.sh@20 -- # IFS=: 00:06:43.903 01:07:52 -- accel/accel.sh@20 -- # read -r var val 00:06:43.903 01:07:52 -- accel/accel.sh@21 -- # val= 00:06:43.903 01:07:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:43.903 01:07:52 -- accel/accel.sh@20 -- # IFS=: 00:06:43.903 01:07:52 -- accel/accel.sh@20 -- # read -r var val 00:06:43.903 01:07:52 -- accel/accel.sh@21 -- # val=copy 00:06:43.903 01:07:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:43.903 01:07:52 -- accel/accel.sh@24 -- # accel_opc=copy 00:06:43.903 01:07:52 -- accel/accel.sh@20 -- # IFS=: 00:06:43.903 01:07:52 -- accel/accel.sh@20 -- # read -r var val 00:06:43.903 01:07:52 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:43.903 01:07:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:43.903 01:07:52 -- accel/accel.sh@20 -- # IFS=: 00:06:43.903 01:07:52 -- accel/accel.sh@20 -- # read -r var val 00:06:43.903 01:07:52 -- accel/accel.sh@21 -- # val= 00:06:43.903 01:07:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:43.903 01:07:52 -- accel/accel.sh@20 -- # IFS=: 00:06:43.903 01:07:52 -- accel/accel.sh@20 -- # read -r var val 00:06:43.903 01:07:52 -- accel/accel.sh@21 -- # val=software 00:06:43.903 01:07:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:43.903 01:07:52 -- accel/accel.sh@23 -- # accel_module=software 00:06:43.903 01:07:52 -- accel/accel.sh@20 -- # IFS=: 00:06:43.903 01:07:52 -- accel/accel.sh@20 -- # read -r var val 00:06:43.903 01:07:52 -- accel/accel.sh@21 -- # val=32 00:06:43.903 01:07:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:43.903 01:07:52 -- accel/accel.sh@20 -- # IFS=: 00:06:43.903 01:07:52 -- accel/accel.sh@20 -- # read -r var val 00:06:43.903 01:07:52 -- accel/accel.sh@21 -- # val=32 00:06:43.903 01:07:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:43.903 01:07:52 -- accel/accel.sh@20 -- # IFS=: 00:06:43.903 01:07:52 -- accel/accel.sh@20 -- # read -r var val 00:06:43.903 01:07:52 -- accel/accel.sh@21 -- # val=1 00:06:43.903 01:07:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:43.903 01:07:52 -- accel/accel.sh@20 -- # IFS=: 00:06:43.903 01:07:52 -- accel/accel.sh@20 -- # read -r var val 00:06:43.903 01:07:52 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:43.903 01:07:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:43.903 01:07:52 -- accel/accel.sh@20 -- # IFS=: 00:06:43.903 01:07:52 -- accel/accel.sh@20 -- # read -r var val 00:06:43.903 01:07:52 -- accel/accel.sh@21 -- # val=Yes 00:06:43.903 01:07:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:43.903 01:07:52 -- accel/accel.sh@20 -- # IFS=: 00:06:43.903 01:07:52 -- accel/accel.sh@20 -- # read -r var val 00:06:43.903 01:07:52 -- accel/accel.sh@21 -- # val= 00:06:43.903 01:07:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:43.903 01:07:52 -- accel/accel.sh@20 -- # IFS=: 00:06:43.903 01:07:52 -- accel/accel.sh@20 -- # read -r var val 00:06:43.903 01:07:52 -- accel/accel.sh@21 -- # val= 00:06:43.903 01:07:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:43.903 01:07:52 -- accel/accel.sh@20 -- # IFS=: 00:06:43.903 01:07:52 -- accel/accel.sh@20 -- # read -r var val 00:06:45.277 01:07:53 -- accel/accel.sh@21 -- # val= 00:06:45.277 01:07:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.277 01:07:53 -- accel/accel.sh@20 -- # IFS=: 00:06:45.277 01:07:53 -- accel/accel.sh@20 -- # read -r var val 00:06:45.277 01:07:53 -- accel/accel.sh@21 -- # val= 00:06:45.277 01:07:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.277 01:07:53 -- accel/accel.sh@20 -- # IFS=: 00:06:45.277 01:07:53 -- accel/accel.sh@20 -- # read -r var val 00:06:45.277 01:07:53 -- accel/accel.sh@21 -- # val= 00:06:45.277 01:07:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.277 01:07:53 -- accel/accel.sh@20 -- # IFS=: 00:06:45.277 01:07:53 -- accel/accel.sh@20 -- # read -r var val 00:06:45.277 01:07:53 -- accel/accel.sh@21 -- # val= 00:06:45.277 01:07:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.277 01:07:53 -- accel/accel.sh@20 -- # IFS=: 00:06:45.277 01:07:53 -- accel/accel.sh@20 -- # read -r var val 00:06:45.277 01:07:53 -- accel/accel.sh@21 -- # val= 00:06:45.277 01:07:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.277 01:07:53 -- accel/accel.sh@20 -- # IFS=: 00:06:45.277 01:07:53 -- accel/accel.sh@20 -- # read -r var val 00:06:45.277 01:07:53 -- accel/accel.sh@21 -- # val= 00:06:45.277 01:07:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.277 01:07:53 -- accel/accel.sh@20 -- # IFS=: 00:06:45.277 01:07:53 -- accel/accel.sh@20 -- # read -r var val 00:06:45.277 01:07:53 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:45.277 01:07:53 -- accel/accel.sh@28 -- # [[ -n copy ]] 00:06:45.277 01:07:53 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:45.277 00:06:45.277 real 0m2.807s 00:06:45.277 user 0m2.511s 00:06:45.277 sys 0m0.285s 00:06:45.277 01:07:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:45.277 01:07:53 -- common/autotest_common.sh@10 -- # set +x 00:06:45.277 ************************************ 00:06:45.277 END TEST accel_copy 00:06:45.277 ************************************ 00:06:45.277 01:07:53 -- accel/accel.sh@96 -- # run_test accel_fill accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:45.277 01:07:53 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:06:45.277 01:07:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:45.277 01:07:53 -- common/autotest_common.sh@10 -- # set +x 00:06:45.277 ************************************ 00:06:45.277 START TEST accel_fill 00:06:45.277 ************************************ 00:06:45.277 01:07:53 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:45.277 01:07:53 -- accel/accel.sh@16 -- # local accel_opc 00:06:45.277 01:07:53 -- accel/accel.sh@17 -- # local accel_module 00:06:45.277 01:07:53 -- accel/accel.sh@18 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:45.277 01:07:53 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:45.277 01:07:53 -- accel/accel.sh@12 -- # build_accel_config 00:06:45.277 01:07:53 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:45.277 01:07:53 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:45.277 01:07:53 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:45.277 01:07:53 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:45.277 01:07:53 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:45.277 01:07:53 -- accel/accel.sh@41 -- # local IFS=, 00:06:45.277 01:07:53 -- accel/accel.sh@42 -- # jq -r . 00:06:45.277 [2024-11-20 01:07:53.216890] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:45.277 [2024-11-20 01:07:53.216981] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1025890 ] 00:06:45.277 EAL: No free 2048 kB hugepages reported on node 1 00:06:45.277 [2024-11-20 01:07:53.279575] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:45.277 [2024-11-20 01:07:53.369863] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:46.651 01:07:54 -- accel/accel.sh@18 -- # out=' 00:06:46.651 SPDK Configuration: 00:06:46.651 Core mask: 0x1 00:06:46.651 00:06:46.651 Accel Perf Configuration: 00:06:46.651 Workload Type: fill 00:06:46.651 Fill pattern: 0x80 00:06:46.651 Transfer size: 4096 bytes 00:06:46.651 Vector count 1 00:06:46.651 Module: software 00:06:46.651 Queue depth: 64 00:06:46.651 Allocate depth: 64 00:06:46.651 # threads/core: 1 00:06:46.651 Run time: 1 seconds 00:06:46.651 Verify: Yes 00:06:46.651 00:06:46.651 Running for 1 seconds... 00:06:46.651 00:06:46.651 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:46.651 ------------------------------------------------------------------------------------ 00:06:46.651 0,0 413760/s 1616 MiB/s 0 0 00:06:46.651 ==================================================================================== 00:06:46.651 Total 413760/s 1616 MiB/s 0 0' 00:06:46.651 01:07:54 -- accel/accel.sh@20 -- # IFS=: 00:06:46.651 01:07:54 -- accel/accel.sh@15 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:46.651 01:07:54 -- accel/accel.sh@20 -- # read -r var val 00:06:46.651 01:07:54 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:46.651 01:07:54 -- accel/accel.sh@12 -- # build_accel_config 00:06:46.651 01:07:54 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:46.651 01:07:54 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:46.651 01:07:54 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:46.651 01:07:54 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:46.651 01:07:54 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:46.651 01:07:54 -- accel/accel.sh@41 -- # local IFS=, 00:06:46.651 01:07:54 -- accel/accel.sh@42 -- # jq -r . 00:06:46.651 [2024-11-20 01:07:54.620902] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:46.651 [2024-11-20 01:07:54.621004] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1026051 ] 00:06:46.651 EAL: No free 2048 kB hugepages reported on node 1 00:06:46.651 [2024-11-20 01:07:54.680579] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:46.651 [2024-11-20 01:07:54.769972] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:46.651 01:07:54 -- accel/accel.sh@21 -- # val= 00:06:46.651 01:07:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.651 01:07:54 -- accel/accel.sh@20 -- # IFS=: 00:06:46.651 01:07:54 -- accel/accel.sh@20 -- # read -r var val 00:06:46.651 01:07:54 -- accel/accel.sh@21 -- # val= 00:06:46.651 01:07:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.651 01:07:54 -- accel/accel.sh@20 -- # IFS=: 00:06:46.651 01:07:54 -- accel/accel.sh@20 -- # read -r var val 00:06:46.651 01:07:54 -- accel/accel.sh@21 -- # val=0x1 00:06:46.651 01:07:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.651 01:07:54 -- accel/accel.sh@20 -- # IFS=: 00:06:46.651 01:07:54 -- accel/accel.sh@20 -- # read -r var val 00:06:46.651 01:07:54 -- accel/accel.sh@21 -- # val= 00:06:46.651 01:07:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.651 01:07:54 -- accel/accel.sh@20 -- # IFS=: 00:06:46.651 01:07:54 -- accel/accel.sh@20 -- # read -r var val 00:06:46.651 01:07:54 -- accel/accel.sh@21 -- # val= 00:06:46.651 01:07:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.651 01:07:54 -- accel/accel.sh@20 -- # IFS=: 00:06:46.651 01:07:54 -- accel/accel.sh@20 -- # read -r var val 00:06:46.651 01:07:54 -- accel/accel.sh@21 -- # val=fill 00:06:46.651 01:07:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.651 01:07:54 -- accel/accel.sh@24 -- # accel_opc=fill 00:06:46.651 01:07:54 -- accel/accel.sh@20 -- # IFS=: 00:06:46.651 01:07:54 -- accel/accel.sh@20 -- # read -r var val 00:06:46.651 01:07:54 -- accel/accel.sh@21 -- # val=0x80 00:06:46.651 01:07:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.651 01:07:54 -- accel/accel.sh@20 -- # IFS=: 00:06:46.651 01:07:54 -- accel/accel.sh@20 -- # read -r var val 00:06:46.651 01:07:54 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:46.651 01:07:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.651 01:07:54 -- accel/accel.sh@20 -- # IFS=: 00:06:46.651 01:07:54 -- accel/accel.sh@20 -- # read -r var val 00:06:46.651 01:07:54 -- accel/accel.sh@21 -- # val= 00:06:46.651 01:07:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.651 01:07:54 -- accel/accel.sh@20 -- # IFS=: 00:06:46.651 01:07:54 -- accel/accel.sh@20 -- # read -r var val 00:06:46.651 01:07:54 -- accel/accel.sh@21 -- # val=software 00:06:46.651 01:07:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.651 01:07:54 -- accel/accel.sh@23 -- # accel_module=software 00:06:46.651 01:07:54 -- accel/accel.sh@20 -- # IFS=: 00:06:46.651 01:07:54 -- accel/accel.sh@20 -- # read -r var val 00:06:46.651 01:07:54 -- accel/accel.sh@21 -- # val=64 00:06:46.651 01:07:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.651 01:07:54 -- accel/accel.sh@20 -- # IFS=: 00:06:46.651 01:07:54 -- accel/accel.sh@20 -- # read -r var val 00:06:46.651 01:07:54 -- accel/accel.sh@21 -- # val=64 00:06:46.651 01:07:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.651 01:07:54 -- accel/accel.sh@20 -- # IFS=: 00:06:46.651 01:07:54 -- accel/accel.sh@20 -- # read -r var val 00:06:46.651 01:07:54 -- accel/accel.sh@21 -- # val=1 00:06:46.651 01:07:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.651 01:07:54 -- accel/accel.sh@20 -- # IFS=: 00:06:46.651 01:07:54 -- accel/accel.sh@20 -- # read -r var val 00:06:46.651 01:07:54 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:46.651 01:07:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.651 01:07:54 -- accel/accel.sh@20 -- # IFS=: 00:06:46.651 01:07:54 -- accel/accel.sh@20 -- # read -r var val 00:06:46.651 01:07:54 -- accel/accel.sh@21 -- # val=Yes 00:06:46.651 01:07:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.651 01:07:54 -- accel/accel.sh@20 -- # IFS=: 00:06:46.651 01:07:54 -- accel/accel.sh@20 -- # read -r var val 00:06:46.651 01:07:54 -- accel/accel.sh@21 -- # val= 00:06:46.651 01:07:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.651 01:07:54 -- accel/accel.sh@20 -- # IFS=: 00:06:46.651 01:07:54 -- accel/accel.sh@20 -- # read -r var val 00:06:46.651 01:07:54 -- accel/accel.sh@21 -- # val= 00:06:46.651 01:07:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.651 01:07:54 -- accel/accel.sh@20 -- # IFS=: 00:06:46.651 01:07:54 -- accel/accel.sh@20 -- # read -r var val 00:06:48.026 01:07:55 -- accel/accel.sh@21 -- # val= 00:06:48.026 01:07:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:48.026 01:07:55 -- accel/accel.sh@20 -- # IFS=: 00:06:48.026 01:07:56 -- accel/accel.sh@20 -- # read -r var val 00:06:48.026 01:07:56 -- accel/accel.sh@21 -- # val= 00:06:48.026 01:07:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:48.026 01:07:56 -- accel/accel.sh@20 -- # IFS=: 00:06:48.026 01:07:56 -- accel/accel.sh@20 -- # read -r var val 00:06:48.026 01:07:56 -- accel/accel.sh@21 -- # val= 00:06:48.026 01:07:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:48.026 01:07:56 -- accel/accel.sh@20 -- # IFS=: 00:06:48.026 01:07:56 -- accel/accel.sh@20 -- # read -r var val 00:06:48.026 01:07:56 -- accel/accel.sh@21 -- # val= 00:06:48.026 01:07:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:48.026 01:07:56 -- accel/accel.sh@20 -- # IFS=: 00:06:48.026 01:07:56 -- accel/accel.sh@20 -- # read -r var val 00:06:48.026 01:07:56 -- accel/accel.sh@21 -- # val= 00:06:48.026 01:07:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:48.026 01:07:56 -- accel/accel.sh@20 -- # IFS=: 00:06:48.026 01:07:56 -- accel/accel.sh@20 -- # read -r var val 00:06:48.026 01:07:56 -- accel/accel.sh@21 -- # val= 00:06:48.026 01:07:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:48.026 01:07:56 -- accel/accel.sh@20 -- # IFS=: 00:06:48.026 01:07:56 -- accel/accel.sh@20 -- # read -r var val 00:06:48.026 01:07:56 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:48.026 01:07:56 -- accel/accel.sh@28 -- # [[ -n fill ]] 00:06:48.026 01:07:56 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:48.026 00:06:48.026 real 0m2.804s 00:06:48.026 user 0m2.518s 00:06:48.026 sys 0m0.277s 00:06:48.026 01:07:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:48.026 01:07:56 -- common/autotest_common.sh@10 -- # set +x 00:06:48.026 ************************************ 00:06:48.026 END TEST accel_fill 00:06:48.026 ************************************ 00:06:48.026 01:07:56 -- accel/accel.sh@97 -- # run_test accel_copy_crc32c accel_test -t 1 -w copy_crc32c -y 00:06:48.026 01:07:56 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:48.026 01:07:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:48.026 01:07:56 -- common/autotest_common.sh@10 -- # set +x 00:06:48.026 ************************************ 00:06:48.026 START TEST accel_copy_crc32c 00:06:48.026 ************************************ 00:06:48.026 01:07:56 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y 00:06:48.026 01:07:56 -- accel/accel.sh@16 -- # local accel_opc 00:06:48.026 01:07:56 -- accel/accel.sh@17 -- # local accel_module 00:06:48.026 01:07:56 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y 00:06:48.026 01:07:56 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:06:48.026 01:07:56 -- accel/accel.sh@12 -- # build_accel_config 00:06:48.026 01:07:56 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:48.026 01:07:56 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:48.026 01:07:56 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:48.026 01:07:56 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:48.026 01:07:56 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:48.026 01:07:56 -- accel/accel.sh@41 -- # local IFS=, 00:06:48.026 01:07:56 -- accel/accel.sh@42 -- # jq -r . 00:06:48.026 [2024-11-20 01:07:56.044099] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:48.026 [2024-11-20 01:07:56.044204] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1026315 ] 00:06:48.026 EAL: No free 2048 kB hugepages reported on node 1 00:06:48.026 [2024-11-20 01:07:56.103538] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:48.026 [2024-11-20 01:07:56.195239] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:49.400 01:07:57 -- accel/accel.sh@18 -- # out=' 00:06:49.400 SPDK Configuration: 00:06:49.400 Core mask: 0x1 00:06:49.400 00:06:49.400 Accel Perf Configuration: 00:06:49.400 Workload Type: copy_crc32c 00:06:49.400 CRC-32C seed: 0 00:06:49.400 Vector size: 4096 bytes 00:06:49.400 Transfer size: 4096 bytes 00:06:49.400 Vector count 1 00:06:49.400 Module: software 00:06:49.400 Queue depth: 32 00:06:49.400 Allocate depth: 32 00:06:49.400 # threads/core: 1 00:06:49.400 Run time: 1 seconds 00:06:49.400 Verify: Yes 00:06:49.400 00:06:49.400 Running for 1 seconds... 00:06:49.400 00:06:49.400 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:49.400 ------------------------------------------------------------------------------------ 00:06:49.400 0,0 220512/s 861 MiB/s 0 0 00:06:49.400 ==================================================================================== 00:06:49.400 Total 220512/s 861 MiB/s 0 0' 00:06:49.400 01:07:57 -- accel/accel.sh@20 -- # IFS=: 00:06:49.400 01:07:57 -- accel/accel.sh@20 -- # read -r var val 00:06:49.400 01:07:57 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y 00:06:49.400 01:07:57 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:06:49.400 01:07:57 -- accel/accel.sh@12 -- # build_accel_config 00:06:49.400 01:07:57 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:49.400 01:07:57 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:49.400 01:07:57 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:49.400 01:07:57 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:49.400 01:07:57 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:49.400 01:07:57 -- accel/accel.sh@41 -- # local IFS=, 00:06:49.400 01:07:57 -- accel/accel.sh@42 -- # jq -r . 00:06:49.401 [2024-11-20 01:07:57.440288] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:49.401 [2024-11-20 01:07:57.440383] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1026457 ] 00:06:49.401 EAL: No free 2048 kB hugepages reported on node 1 00:06:49.401 [2024-11-20 01:07:57.502717] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:49.401 [2024-11-20 01:07:57.592520] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:49.659 01:07:57 -- accel/accel.sh@21 -- # val= 00:06:49.659 01:07:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.659 01:07:57 -- accel/accel.sh@20 -- # IFS=: 00:06:49.659 01:07:57 -- accel/accel.sh@20 -- # read -r var val 00:06:49.659 01:07:57 -- accel/accel.sh@21 -- # val= 00:06:49.659 01:07:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.659 01:07:57 -- accel/accel.sh@20 -- # IFS=: 00:06:49.659 01:07:57 -- accel/accel.sh@20 -- # read -r var val 00:06:49.659 01:07:57 -- accel/accel.sh@21 -- # val=0x1 00:06:49.659 01:07:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.659 01:07:57 -- accel/accel.sh@20 -- # IFS=: 00:06:49.659 01:07:57 -- accel/accel.sh@20 -- # read -r var val 00:06:49.659 01:07:57 -- accel/accel.sh@21 -- # val= 00:06:49.659 01:07:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.659 01:07:57 -- accel/accel.sh@20 -- # IFS=: 00:06:49.659 01:07:57 -- accel/accel.sh@20 -- # read -r var val 00:06:49.659 01:07:57 -- accel/accel.sh@21 -- # val= 00:06:49.659 01:07:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.659 01:07:57 -- accel/accel.sh@20 -- # IFS=: 00:06:49.659 01:07:57 -- accel/accel.sh@20 -- # read -r var val 00:06:49.659 01:07:57 -- accel/accel.sh@21 -- # val=copy_crc32c 00:06:49.659 01:07:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.659 01:07:57 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:06:49.659 01:07:57 -- accel/accel.sh@20 -- # IFS=: 00:06:49.659 01:07:57 -- accel/accel.sh@20 -- # read -r var val 00:06:49.659 01:07:57 -- accel/accel.sh@21 -- # val=0 00:06:49.659 01:07:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.659 01:07:57 -- accel/accel.sh@20 -- # IFS=: 00:06:49.659 01:07:57 -- accel/accel.sh@20 -- # read -r var val 00:06:49.659 01:07:57 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:49.659 01:07:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.659 01:07:57 -- accel/accel.sh@20 -- # IFS=: 00:06:49.659 01:07:57 -- accel/accel.sh@20 -- # read -r var val 00:06:49.659 01:07:57 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:49.659 01:07:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.659 01:07:57 -- accel/accel.sh@20 -- # IFS=: 00:06:49.659 01:07:57 -- accel/accel.sh@20 -- # read -r var val 00:06:49.659 01:07:57 -- accel/accel.sh@21 -- # val= 00:06:49.659 01:07:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.659 01:07:57 -- accel/accel.sh@20 -- # IFS=: 00:06:49.659 01:07:57 -- accel/accel.sh@20 -- # read -r var val 00:06:49.659 01:07:57 -- accel/accel.sh@21 -- # val=software 00:06:49.659 01:07:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.659 01:07:57 -- accel/accel.sh@23 -- # accel_module=software 00:06:49.659 01:07:57 -- accel/accel.sh@20 -- # IFS=: 00:06:49.659 01:07:57 -- accel/accel.sh@20 -- # read -r var val 00:06:49.659 01:07:57 -- accel/accel.sh@21 -- # val=32 00:06:49.659 01:07:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.659 01:07:57 -- accel/accel.sh@20 -- # IFS=: 00:06:49.659 01:07:57 -- accel/accel.sh@20 -- # read -r var val 00:06:49.659 01:07:57 -- accel/accel.sh@21 -- # val=32 00:06:49.659 01:07:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.659 01:07:57 -- accel/accel.sh@20 -- # IFS=: 00:06:49.659 01:07:57 -- accel/accel.sh@20 -- # read -r var val 00:06:49.659 01:07:57 -- accel/accel.sh@21 -- # val=1 00:06:49.659 01:07:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.659 01:07:57 -- accel/accel.sh@20 -- # IFS=: 00:06:49.659 01:07:57 -- accel/accel.sh@20 -- # read -r var val 00:06:49.659 01:07:57 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:49.659 01:07:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.659 01:07:57 -- accel/accel.sh@20 -- # IFS=: 00:06:49.659 01:07:57 -- accel/accel.sh@20 -- # read -r var val 00:06:49.659 01:07:57 -- accel/accel.sh@21 -- # val=Yes 00:06:49.659 01:07:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.659 01:07:57 -- accel/accel.sh@20 -- # IFS=: 00:06:49.660 01:07:57 -- accel/accel.sh@20 -- # read -r var val 00:06:49.660 01:07:57 -- accel/accel.sh@21 -- # val= 00:06:49.660 01:07:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.660 01:07:57 -- accel/accel.sh@20 -- # IFS=: 00:06:49.660 01:07:57 -- accel/accel.sh@20 -- # read -r var val 00:06:49.660 01:07:57 -- accel/accel.sh@21 -- # val= 00:06:49.660 01:07:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.660 01:07:57 -- accel/accel.sh@20 -- # IFS=: 00:06:49.660 01:07:57 -- accel/accel.sh@20 -- # read -r var val 00:06:51.034 01:07:58 -- accel/accel.sh@21 -- # val= 00:06:51.034 01:07:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.034 01:07:58 -- accel/accel.sh@20 -- # IFS=: 00:06:51.034 01:07:58 -- accel/accel.sh@20 -- # read -r var val 00:06:51.034 01:07:58 -- accel/accel.sh@21 -- # val= 00:06:51.034 01:07:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.034 01:07:58 -- accel/accel.sh@20 -- # IFS=: 00:06:51.034 01:07:58 -- accel/accel.sh@20 -- # read -r var val 00:06:51.034 01:07:58 -- accel/accel.sh@21 -- # val= 00:06:51.034 01:07:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.034 01:07:58 -- accel/accel.sh@20 -- # IFS=: 00:06:51.034 01:07:58 -- accel/accel.sh@20 -- # read -r var val 00:06:51.034 01:07:58 -- accel/accel.sh@21 -- # val= 00:06:51.034 01:07:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.034 01:07:58 -- accel/accel.sh@20 -- # IFS=: 00:06:51.034 01:07:58 -- accel/accel.sh@20 -- # read -r var val 00:06:51.034 01:07:58 -- accel/accel.sh@21 -- # val= 00:06:51.034 01:07:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.034 01:07:58 -- accel/accel.sh@20 -- # IFS=: 00:06:51.034 01:07:58 -- accel/accel.sh@20 -- # read -r var val 00:06:51.034 01:07:58 -- accel/accel.sh@21 -- # val= 00:06:51.034 01:07:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.034 01:07:58 -- accel/accel.sh@20 -- # IFS=: 00:06:51.034 01:07:58 -- accel/accel.sh@20 -- # read -r var val 00:06:51.034 01:07:58 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:51.034 01:07:58 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:06:51.034 01:07:58 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:51.034 00:06:51.034 real 0m2.797s 00:06:51.034 user 0m2.505s 00:06:51.034 sys 0m0.284s 00:06:51.034 01:07:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:51.034 01:07:58 -- common/autotest_common.sh@10 -- # set +x 00:06:51.034 ************************************ 00:06:51.034 END TEST accel_copy_crc32c 00:06:51.034 ************************************ 00:06:51.034 01:07:58 -- accel/accel.sh@98 -- # run_test accel_copy_crc32c_C2 accel_test -t 1 -w copy_crc32c -y -C 2 00:06:51.034 01:07:58 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:51.034 01:07:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:51.034 01:07:58 -- common/autotest_common.sh@10 -- # set +x 00:06:51.034 ************************************ 00:06:51.034 START TEST accel_copy_crc32c_C2 00:06:51.034 ************************************ 00:06:51.034 01:07:58 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y -C 2 00:06:51.034 01:07:58 -- accel/accel.sh@16 -- # local accel_opc 00:06:51.034 01:07:58 -- accel/accel.sh@17 -- # local accel_module 00:06:51.034 01:07:58 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:06:51.034 01:07:58 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:06:51.034 01:07:58 -- accel/accel.sh@12 -- # build_accel_config 00:06:51.034 01:07:58 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:51.034 01:07:58 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:51.034 01:07:58 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:51.034 01:07:58 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:51.034 01:07:58 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:51.034 01:07:58 -- accel/accel.sh@41 -- # local IFS=, 00:06:51.034 01:07:58 -- accel/accel.sh@42 -- # jq -r . 00:06:51.034 [2024-11-20 01:07:58.864500] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:51.034 [2024-11-20 01:07:58.864593] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1026613 ] 00:06:51.034 EAL: No free 2048 kB hugepages reported on node 1 00:06:51.034 [2024-11-20 01:07:58.927990] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:51.034 [2024-11-20 01:07:59.018155] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:52.408 01:08:00 -- accel/accel.sh@18 -- # out=' 00:06:52.408 SPDK Configuration: 00:06:52.408 Core mask: 0x1 00:06:52.408 00:06:52.408 Accel Perf Configuration: 00:06:52.408 Workload Type: copy_crc32c 00:06:52.408 CRC-32C seed: 0 00:06:52.408 Vector size: 4096 bytes 00:06:52.408 Transfer size: 8192 bytes 00:06:52.408 Vector count 2 00:06:52.408 Module: software 00:06:52.408 Queue depth: 32 00:06:52.408 Allocate depth: 32 00:06:52.408 # threads/core: 1 00:06:52.408 Run time: 1 seconds 00:06:52.408 Verify: Yes 00:06:52.408 00:06:52.408 Running for 1 seconds... 00:06:52.408 00:06:52.408 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:52.408 ------------------------------------------------------------------------------------ 00:06:52.408 0,0 158752/s 1240 MiB/s 0 0 00:06:52.408 ==================================================================================== 00:06:52.408 Total 158752/s 620 MiB/s 0 0' 00:06:52.408 01:08:00 -- accel/accel.sh@20 -- # IFS=: 00:06:52.408 01:08:00 -- accel/accel.sh@20 -- # read -r var val 00:06:52.408 01:08:00 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:06:52.408 01:08:00 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:06:52.408 01:08:00 -- accel/accel.sh@12 -- # build_accel_config 00:06:52.408 01:08:00 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:52.408 01:08:00 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:52.408 01:08:00 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:52.408 01:08:00 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:52.408 01:08:00 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:52.408 01:08:00 -- accel/accel.sh@41 -- # local IFS=, 00:06:52.408 01:08:00 -- accel/accel.sh@42 -- # jq -r . 00:06:52.408 [2024-11-20 01:08:00.268962] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:52.408 [2024-11-20 01:08:00.269059] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1026759 ] 00:06:52.408 EAL: No free 2048 kB hugepages reported on node 1 00:06:52.408 [2024-11-20 01:08:00.331851] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:52.408 [2024-11-20 01:08:00.420874] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:52.408 01:08:00 -- accel/accel.sh@21 -- # val= 00:06:52.408 01:08:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.408 01:08:00 -- accel/accel.sh@20 -- # IFS=: 00:06:52.408 01:08:00 -- accel/accel.sh@20 -- # read -r var val 00:06:52.408 01:08:00 -- accel/accel.sh@21 -- # val= 00:06:52.408 01:08:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.408 01:08:00 -- accel/accel.sh@20 -- # IFS=: 00:06:52.408 01:08:00 -- accel/accel.sh@20 -- # read -r var val 00:06:52.408 01:08:00 -- accel/accel.sh@21 -- # val=0x1 00:06:52.408 01:08:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.408 01:08:00 -- accel/accel.sh@20 -- # IFS=: 00:06:52.408 01:08:00 -- accel/accel.sh@20 -- # read -r var val 00:06:52.408 01:08:00 -- accel/accel.sh@21 -- # val= 00:06:52.408 01:08:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.408 01:08:00 -- accel/accel.sh@20 -- # IFS=: 00:06:52.408 01:08:00 -- accel/accel.sh@20 -- # read -r var val 00:06:52.408 01:08:00 -- accel/accel.sh@21 -- # val= 00:06:52.408 01:08:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.408 01:08:00 -- accel/accel.sh@20 -- # IFS=: 00:06:52.408 01:08:00 -- accel/accel.sh@20 -- # read -r var val 00:06:52.408 01:08:00 -- accel/accel.sh@21 -- # val=copy_crc32c 00:06:52.408 01:08:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.408 01:08:00 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:06:52.408 01:08:00 -- accel/accel.sh@20 -- # IFS=: 00:06:52.408 01:08:00 -- accel/accel.sh@20 -- # read -r var val 00:06:52.408 01:08:00 -- accel/accel.sh@21 -- # val=0 00:06:52.408 01:08:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.408 01:08:00 -- accel/accel.sh@20 -- # IFS=: 00:06:52.408 01:08:00 -- accel/accel.sh@20 -- # read -r var val 00:06:52.408 01:08:00 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:52.408 01:08:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.408 01:08:00 -- accel/accel.sh@20 -- # IFS=: 00:06:52.408 01:08:00 -- accel/accel.sh@20 -- # read -r var val 00:06:52.408 01:08:00 -- accel/accel.sh@21 -- # val='8192 bytes' 00:06:52.408 01:08:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.408 01:08:00 -- accel/accel.sh@20 -- # IFS=: 00:06:52.408 01:08:00 -- accel/accel.sh@20 -- # read -r var val 00:06:52.408 01:08:00 -- accel/accel.sh@21 -- # val= 00:06:52.408 01:08:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.408 01:08:00 -- accel/accel.sh@20 -- # IFS=: 00:06:52.408 01:08:00 -- accel/accel.sh@20 -- # read -r var val 00:06:52.408 01:08:00 -- accel/accel.sh@21 -- # val=software 00:06:52.408 01:08:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.408 01:08:00 -- accel/accel.sh@23 -- # accel_module=software 00:06:52.408 01:08:00 -- accel/accel.sh@20 -- # IFS=: 00:06:52.408 01:08:00 -- accel/accel.sh@20 -- # read -r var val 00:06:52.408 01:08:00 -- accel/accel.sh@21 -- # val=32 00:06:52.408 01:08:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.408 01:08:00 -- accel/accel.sh@20 -- # IFS=: 00:06:52.408 01:08:00 -- accel/accel.sh@20 -- # read -r var val 00:06:52.408 01:08:00 -- accel/accel.sh@21 -- # val=32 00:06:52.408 01:08:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.408 01:08:00 -- accel/accel.sh@20 -- # IFS=: 00:06:52.408 01:08:00 -- accel/accel.sh@20 -- # read -r var val 00:06:52.408 01:08:00 -- accel/accel.sh@21 -- # val=1 00:06:52.408 01:08:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.408 01:08:00 -- accel/accel.sh@20 -- # IFS=: 00:06:52.408 01:08:00 -- accel/accel.sh@20 -- # read -r var val 00:06:52.408 01:08:00 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:52.408 01:08:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.408 01:08:00 -- accel/accel.sh@20 -- # IFS=: 00:06:52.408 01:08:00 -- accel/accel.sh@20 -- # read -r var val 00:06:52.408 01:08:00 -- accel/accel.sh@21 -- # val=Yes 00:06:52.408 01:08:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.408 01:08:00 -- accel/accel.sh@20 -- # IFS=: 00:06:52.408 01:08:00 -- accel/accel.sh@20 -- # read -r var val 00:06:52.408 01:08:00 -- accel/accel.sh@21 -- # val= 00:06:52.408 01:08:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.408 01:08:00 -- accel/accel.sh@20 -- # IFS=: 00:06:52.408 01:08:00 -- accel/accel.sh@20 -- # read -r var val 00:06:52.408 01:08:00 -- accel/accel.sh@21 -- # val= 00:06:52.408 01:08:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.408 01:08:00 -- accel/accel.sh@20 -- # IFS=: 00:06:52.408 01:08:00 -- accel/accel.sh@20 -- # read -r var val 00:06:53.782 01:08:01 -- accel/accel.sh@21 -- # val= 00:06:53.782 01:08:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.782 01:08:01 -- accel/accel.sh@20 -- # IFS=: 00:06:53.782 01:08:01 -- accel/accel.sh@20 -- # read -r var val 00:06:53.782 01:08:01 -- accel/accel.sh@21 -- # val= 00:06:53.782 01:08:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.782 01:08:01 -- accel/accel.sh@20 -- # IFS=: 00:06:53.782 01:08:01 -- accel/accel.sh@20 -- # read -r var val 00:06:53.782 01:08:01 -- accel/accel.sh@21 -- # val= 00:06:53.782 01:08:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.782 01:08:01 -- accel/accel.sh@20 -- # IFS=: 00:06:53.782 01:08:01 -- accel/accel.sh@20 -- # read -r var val 00:06:53.782 01:08:01 -- accel/accel.sh@21 -- # val= 00:06:53.782 01:08:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.782 01:08:01 -- accel/accel.sh@20 -- # IFS=: 00:06:53.782 01:08:01 -- accel/accel.sh@20 -- # read -r var val 00:06:53.782 01:08:01 -- accel/accel.sh@21 -- # val= 00:06:53.782 01:08:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.782 01:08:01 -- accel/accel.sh@20 -- # IFS=: 00:06:53.782 01:08:01 -- accel/accel.sh@20 -- # read -r var val 00:06:53.782 01:08:01 -- accel/accel.sh@21 -- # val= 00:06:53.782 01:08:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.782 01:08:01 -- accel/accel.sh@20 -- # IFS=: 00:06:53.782 01:08:01 -- accel/accel.sh@20 -- # read -r var val 00:06:53.782 01:08:01 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:53.782 01:08:01 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:06:53.782 01:08:01 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:53.782 00:06:53.782 real 0m2.803s 00:06:53.782 user 0m2.506s 00:06:53.782 sys 0m0.288s 00:06:53.782 01:08:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:53.782 01:08:01 -- common/autotest_common.sh@10 -- # set +x 00:06:53.782 ************************************ 00:06:53.782 END TEST accel_copy_crc32c_C2 00:06:53.782 ************************************ 00:06:53.782 01:08:01 -- accel/accel.sh@99 -- # run_test accel_dualcast accel_test -t 1 -w dualcast -y 00:06:53.782 01:08:01 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:53.782 01:08:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:53.782 01:08:01 -- common/autotest_common.sh@10 -- # set +x 00:06:53.782 ************************************ 00:06:53.782 START TEST accel_dualcast 00:06:53.782 ************************************ 00:06:53.782 01:08:01 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dualcast -y 00:06:53.782 01:08:01 -- accel/accel.sh@16 -- # local accel_opc 00:06:53.782 01:08:01 -- accel/accel.sh@17 -- # local accel_module 00:06:53.782 01:08:01 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dualcast -y 00:06:53.782 01:08:01 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:06:53.782 01:08:01 -- accel/accel.sh@12 -- # build_accel_config 00:06:53.782 01:08:01 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:53.782 01:08:01 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:53.782 01:08:01 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:53.782 01:08:01 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:53.782 01:08:01 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:53.782 01:08:01 -- accel/accel.sh@41 -- # local IFS=, 00:06:53.782 01:08:01 -- accel/accel.sh@42 -- # jq -r . 00:06:53.782 [2024-11-20 01:08:01.689471] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:53.782 [2024-11-20 01:08:01.689560] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1027030 ] 00:06:53.782 EAL: No free 2048 kB hugepages reported on node 1 00:06:53.782 [2024-11-20 01:08:01.753114] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:53.782 [2024-11-20 01:08:01.842614] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:55.155 01:08:03 -- accel/accel.sh@18 -- # out=' 00:06:55.155 SPDK Configuration: 00:06:55.155 Core mask: 0x1 00:06:55.155 00:06:55.155 Accel Perf Configuration: 00:06:55.155 Workload Type: dualcast 00:06:55.155 Transfer size: 4096 bytes 00:06:55.155 Vector count 1 00:06:55.155 Module: software 00:06:55.155 Queue depth: 32 00:06:55.155 Allocate depth: 32 00:06:55.155 # threads/core: 1 00:06:55.155 Run time: 1 seconds 00:06:55.155 Verify: Yes 00:06:55.155 00:06:55.155 Running for 1 seconds... 00:06:55.155 00:06:55.155 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:55.155 ------------------------------------------------------------------------------------ 00:06:55.155 0,0 299072/s 1168 MiB/s 0 0 00:06:55.155 ==================================================================================== 00:06:55.155 Total 299072/s 1168 MiB/s 0 0' 00:06:55.155 01:08:03 -- accel/accel.sh@20 -- # IFS=: 00:06:55.155 01:08:03 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dualcast -y 00:06:55.155 01:08:03 -- accel/accel.sh@20 -- # read -r var val 00:06:55.155 01:08:03 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:06:55.155 01:08:03 -- accel/accel.sh@12 -- # build_accel_config 00:06:55.155 01:08:03 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:55.155 01:08:03 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:55.155 01:08:03 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:55.155 01:08:03 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:55.155 01:08:03 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:55.155 01:08:03 -- accel/accel.sh@41 -- # local IFS=, 00:06:55.155 01:08:03 -- accel/accel.sh@42 -- # jq -r . 00:06:55.155 [2024-11-20 01:08:03.073203] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:55.155 [2024-11-20 01:08:03.073282] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1027184 ] 00:06:55.155 EAL: No free 2048 kB hugepages reported on node 1 00:06:55.155 [2024-11-20 01:08:03.134694] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:55.155 [2024-11-20 01:08:03.224363] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:55.155 01:08:03 -- accel/accel.sh@21 -- # val= 00:06:55.155 01:08:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.155 01:08:03 -- accel/accel.sh@20 -- # IFS=: 00:06:55.155 01:08:03 -- accel/accel.sh@20 -- # read -r var val 00:06:55.155 01:08:03 -- accel/accel.sh@21 -- # val= 00:06:55.155 01:08:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.155 01:08:03 -- accel/accel.sh@20 -- # IFS=: 00:06:55.155 01:08:03 -- accel/accel.sh@20 -- # read -r var val 00:06:55.155 01:08:03 -- accel/accel.sh@21 -- # val=0x1 00:06:55.155 01:08:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.155 01:08:03 -- accel/accel.sh@20 -- # IFS=: 00:06:55.155 01:08:03 -- accel/accel.sh@20 -- # read -r var val 00:06:55.155 01:08:03 -- accel/accel.sh@21 -- # val= 00:06:55.155 01:08:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.155 01:08:03 -- accel/accel.sh@20 -- # IFS=: 00:06:55.155 01:08:03 -- accel/accel.sh@20 -- # read -r var val 00:06:55.155 01:08:03 -- accel/accel.sh@21 -- # val= 00:06:55.155 01:08:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.155 01:08:03 -- accel/accel.sh@20 -- # IFS=: 00:06:55.155 01:08:03 -- accel/accel.sh@20 -- # read -r var val 00:06:55.155 01:08:03 -- accel/accel.sh@21 -- # val=dualcast 00:06:55.155 01:08:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.155 01:08:03 -- accel/accel.sh@24 -- # accel_opc=dualcast 00:06:55.155 01:08:03 -- accel/accel.sh@20 -- # IFS=: 00:06:55.155 01:08:03 -- accel/accel.sh@20 -- # read -r var val 00:06:55.155 01:08:03 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:55.155 01:08:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.155 01:08:03 -- accel/accel.sh@20 -- # IFS=: 00:06:55.155 01:08:03 -- accel/accel.sh@20 -- # read -r var val 00:06:55.155 01:08:03 -- accel/accel.sh@21 -- # val= 00:06:55.155 01:08:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.155 01:08:03 -- accel/accel.sh@20 -- # IFS=: 00:06:55.155 01:08:03 -- accel/accel.sh@20 -- # read -r var val 00:06:55.155 01:08:03 -- accel/accel.sh@21 -- # val=software 00:06:55.155 01:08:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.156 01:08:03 -- accel/accel.sh@23 -- # accel_module=software 00:06:55.156 01:08:03 -- accel/accel.sh@20 -- # IFS=: 00:06:55.156 01:08:03 -- accel/accel.sh@20 -- # read -r var val 00:06:55.156 01:08:03 -- accel/accel.sh@21 -- # val=32 00:06:55.156 01:08:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.156 01:08:03 -- accel/accel.sh@20 -- # IFS=: 00:06:55.156 01:08:03 -- accel/accel.sh@20 -- # read -r var val 00:06:55.156 01:08:03 -- accel/accel.sh@21 -- # val=32 00:06:55.156 01:08:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.156 01:08:03 -- accel/accel.sh@20 -- # IFS=: 00:06:55.156 01:08:03 -- accel/accel.sh@20 -- # read -r var val 00:06:55.156 01:08:03 -- accel/accel.sh@21 -- # val=1 00:06:55.156 01:08:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.156 01:08:03 -- accel/accel.sh@20 -- # IFS=: 00:06:55.156 01:08:03 -- accel/accel.sh@20 -- # read -r var val 00:06:55.156 01:08:03 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:55.156 01:08:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.156 01:08:03 -- accel/accel.sh@20 -- # IFS=: 00:06:55.156 01:08:03 -- accel/accel.sh@20 -- # read -r var val 00:06:55.156 01:08:03 -- accel/accel.sh@21 -- # val=Yes 00:06:55.156 01:08:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.156 01:08:03 -- accel/accel.sh@20 -- # IFS=: 00:06:55.156 01:08:03 -- accel/accel.sh@20 -- # read -r var val 00:06:55.156 01:08:03 -- accel/accel.sh@21 -- # val= 00:06:55.156 01:08:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.156 01:08:03 -- accel/accel.sh@20 -- # IFS=: 00:06:55.156 01:08:03 -- accel/accel.sh@20 -- # read -r var val 00:06:55.156 01:08:03 -- accel/accel.sh@21 -- # val= 00:06:55.156 01:08:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.156 01:08:03 -- accel/accel.sh@20 -- # IFS=: 00:06:55.156 01:08:03 -- accel/accel.sh@20 -- # read -r var val 00:06:56.537 01:08:04 -- accel/accel.sh@21 -- # val= 00:06:56.537 01:08:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.537 01:08:04 -- accel/accel.sh@20 -- # IFS=: 00:06:56.537 01:08:04 -- accel/accel.sh@20 -- # read -r var val 00:06:56.537 01:08:04 -- accel/accel.sh@21 -- # val= 00:06:56.537 01:08:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.537 01:08:04 -- accel/accel.sh@20 -- # IFS=: 00:06:56.537 01:08:04 -- accel/accel.sh@20 -- # read -r var val 00:06:56.537 01:08:04 -- accel/accel.sh@21 -- # val= 00:06:56.537 01:08:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.537 01:08:04 -- accel/accel.sh@20 -- # IFS=: 00:06:56.537 01:08:04 -- accel/accel.sh@20 -- # read -r var val 00:06:56.537 01:08:04 -- accel/accel.sh@21 -- # val= 00:06:56.537 01:08:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.537 01:08:04 -- accel/accel.sh@20 -- # IFS=: 00:06:56.537 01:08:04 -- accel/accel.sh@20 -- # read -r var val 00:06:56.537 01:08:04 -- accel/accel.sh@21 -- # val= 00:06:56.537 01:08:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.537 01:08:04 -- accel/accel.sh@20 -- # IFS=: 00:06:56.537 01:08:04 -- accel/accel.sh@20 -- # read -r var val 00:06:56.537 01:08:04 -- accel/accel.sh@21 -- # val= 00:06:56.537 01:08:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.537 01:08:04 -- accel/accel.sh@20 -- # IFS=: 00:06:56.537 01:08:04 -- accel/accel.sh@20 -- # read -r var val 00:06:56.537 01:08:04 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:56.537 01:08:04 -- accel/accel.sh@28 -- # [[ -n dualcast ]] 00:06:56.537 01:08:04 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:56.537 00:06:56.537 real 0m2.787s 00:06:56.537 user 0m2.497s 00:06:56.537 sys 0m0.281s 00:06:56.537 01:08:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:56.537 01:08:04 -- common/autotest_common.sh@10 -- # set +x 00:06:56.537 ************************************ 00:06:56.537 END TEST accel_dualcast 00:06:56.537 ************************************ 00:06:56.537 01:08:04 -- accel/accel.sh@100 -- # run_test accel_compare accel_test -t 1 -w compare -y 00:06:56.537 01:08:04 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:56.537 01:08:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:56.537 01:08:04 -- common/autotest_common.sh@10 -- # set +x 00:06:56.537 ************************************ 00:06:56.537 START TEST accel_compare 00:06:56.537 ************************************ 00:06:56.537 01:08:04 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compare -y 00:06:56.537 01:08:04 -- accel/accel.sh@16 -- # local accel_opc 00:06:56.537 01:08:04 -- accel/accel.sh@17 -- # local accel_module 00:06:56.537 01:08:04 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compare -y 00:06:56.537 01:08:04 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:06:56.537 01:08:04 -- accel/accel.sh@12 -- # build_accel_config 00:06:56.537 01:08:04 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:56.537 01:08:04 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:56.537 01:08:04 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:56.537 01:08:04 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:56.537 01:08:04 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:56.537 01:08:04 -- accel/accel.sh@41 -- # local IFS=, 00:06:56.537 01:08:04 -- accel/accel.sh@42 -- # jq -r . 00:06:56.537 [2024-11-20 01:08:04.500972] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:56.537 [2024-11-20 01:08:04.501058] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1027339 ] 00:06:56.537 EAL: No free 2048 kB hugepages reported on node 1 00:06:56.537 [2024-11-20 01:08:04.563064] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:56.537 [2024-11-20 01:08:04.653242] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:57.910 01:08:05 -- accel/accel.sh@18 -- # out=' 00:06:57.910 SPDK Configuration: 00:06:57.910 Core mask: 0x1 00:06:57.910 00:06:57.910 Accel Perf Configuration: 00:06:57.910 Workload Type: compare 00:06:57.910 Transfer size: 4096 bytes 00:06:57.910 Vector count 1 00:06:57.910 Module: software 00:06:57.910 Queue depth: 32 00:06:57.910 Allocate depth: 32 00:06:57.910 # threads/core: 1 00:06:57.910 Run time: 1 seconds 00:06:57.910 Verify: Yes 00:06:57.910 00:06:57.910 Running for 1 seconds... 00:06:57.910 00:06:57.910 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:57.910 ------------------------------------------------------------------------------------ 00:06:57.910 0,0 398976/s 1558 MiB/s 0 0 00:06:57.910 ==================================================================================== 00:06:57.910 Total 398976/s 1558 MiB/s 0 0' 00:06:57.910 01:08:05 -- accel/accel.sh@20 -- # IFS=: 00:06:57.910 01:08:05 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compare -y 00:06:57.910 01:08:05 -- accel/accel.sh@20 -- # read -r var val 00:06:57.910 01:08:05 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:06:57.910 01:08:05 -- accel/accel.sh@12 -- # build_accel_config 00:06:57.910 01:08:05 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:57.910 01:08:05 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:57.910 01:08:05 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:57.910 01:08:05 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:57.910 01:08:05 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:57.910 01:08:05 -- accel/accel.sh@41 -- # local IFS=, 00:06:57.910 01:08:05 -- accel/accel.sh@42 -- # jq -r . 00:06:57.910 [2024-11-20 01:08:05.908012] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:57.910 [2024-11-20 01:08:05.908122] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1027477 ] 00:06:57.910 EAL: No free 2048 kB hugepages reported on node 1 00:06:57.910 [2024-11-20 01:08:05.968408] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:57.910 [2024-11-20 01:08:06.059164] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:57.910 01:08:06 -- accel/accel.sh@21 -- # val= 00:06:57.910 01:08:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.910 01:08:06 -- accel/accel.sh@20 -- # IFS=: 00:06:57.910 01:08:06 -- accel/accel.sh@20 -- # read -r var val 00:06:57.910 01:08:06 -- accel/accel.sh@21 -- # val= 00:06:57.910 01:08:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.910 01:08:06 -- accel/accel.sh@20 -- # IFS=: 00:06:57.910 01:08:06 -- accel/accel.sh@20 -- # read -r var val 00:06:57.910 01:08:06 -- accel/accel.sh@21 -- # val=0x1 00:06:57.910 01:08:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.910 01:08:06 -- accel/accel.sh@20 -- # IFS=: 00:06:57.910 01:08:06 -- accel/accel.sh@20 -- # read -r var val 00:06:57.910 01:08:06 -- accel/accel.sh@21 -- # val= 00:06:57.910 01:08:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.910 01:08:06 -- accel/accel.sh@20 -- # IFS=: 00:06:57.910 01:08:06 -- accel/accel.sh@20 -- # read -r var val 00:06:57.910 01:08:06 -- accel/accel.sh@21 -- # val= 00:06:57.910 01:08:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.910 01:08:06 -- accel/accel.sh@20 -- # IFS=: 00:06:57.910 01:08:06 -- accel/accel.sh@20 -- # read -r var val 00:06:57.910 01:08:06 -- accel/accel.sh@21 -- # val=compare 00:06:57.910 01:08:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.911 01:08:06 -- accel/accel.sh@24 -- # accel_opc=compare 00:06:57.911 01:08:06 -- accel/accel.sh@20 -- # IFS=: 00:06:57.911 01:08:06 -- accel/accel.sh@20 -- # read -r var val 00:06:57.911 01:08:06 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:57.911 01:08:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.911 01:08:06 -- accel/accel.sh@20 -- # IFS=: 00:06:57.911 01:08:06 -- accel/accel.sh@20 -- # read -r var val 00:06:57.911 01:08:06 -- accel/accel.sh@21 -- # val= 00:06:57.911 01:08:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.911 01:08:06 -- accel/accel.sh@20 -- # IFS=: 00:06:57.911 01:08:06 -- accel/accel.sh@20 -- # read -r var val 00:06:57.911 01:08:06 -- accel/accel.sh@21 -- # val=software 00:06:57.911 01:08:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.911 01:08:06 -- accel/accel.sh@23 -- # accel_module=software 00:06:57.911 01:08:06 -- accel/accel.sh@20 -- # IFS=: 00:06:57.911 01:08:06 -- accel/accel.sh@20 -- # read -r var val 00:06:57.911 01:08:06 -- accel/accel.sh@21 -- # val=32 00:06:57.911 01:08:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.911 01:08:06 -- accel/accel.sh@20 -- # IFS=: 00:06:57.911 01:08:06 -- accel/accel.sh@20 -- # read -r var val 00:06:57.911 01:08:06 -- accel/accel.sh@21 -- # val=32 00:06:57.911 01:08:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.911 01:08:06 -- accel/accel.sh@20 -- # IFS=: 00:06:57.911 01:08:06 -- accel/accel.sh@20 -- # read -r var val 00:06:57.911 01:08:06 -- accel/accel.sh@21 -- # val=1 00:06:57.911 01:08:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.911 01:08:06 -- accel/accel.sh@20 -- # IFS=: 00:06:57.911 01:08:06 -- accel/accel.sh@20 -- # read -r var val 00:06:57.911 01:08:06 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:57.911 01:08:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.911 01:08:06 -- accel/accel.sh@20 -- # IFS=: 00:06:57.911 01:08:06 -- accel/accel.sh@20 -- # read -r var val 00:06:57.911 01:08:06 -- accel/accel.sh@21 -- # val=Yes 00:06:57.911 01:08:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.911 01:08:06 -- accel/accel.sh@20 -- # IFS=: 00:06:57.911 01:08:06 -- accel/accel.sh@20 -- # read -r var val 00:06:57.911 01:08:06 -- accel/accel.sh@21 -- # val= 00:06:57.911 01:08:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.911 01:08:06 -- accel/accel.sh@20 -- # IFS=: 00:06:57.911 01:08:06 -- accel/accel.sh@20 -- # read -r var val 00:06:57.911 01:08:06 -- accel/accel.sh@21 -- # val= 00:06:58.168 01:08:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.168 01:08:06 -- accel/accel.sh@20 -- # IFS=: 00:06:58.168 01:08:06 -- accel/accel.sh@20 -- # read -r var val 00:06:59.102 01:08:07 -- accel/accel.sh@21 -- # val= 00:06:59.102 01:08:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.102 01:08:07 -- accel/accel.sh@20 -- # IFS=: 00:06:59.102 01:08:07 -- accel/accel.sh@20 -- # read -r var val 00:06:59.102 01:08:07 -- accel/accel.sh@21 -- # val= 00:06:59.102 01:08:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.102 01:08:07 -- accel/accel.sh@20 -- # IFS=: 00:06:59.102 01:08:07 -- accel/accel.sh@20 -- # read -r var val 00:06:59.102 01:08:07 -- accel/accel.sh@21 -- # val= 00:06:59.102 01:08:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.102 01:08:07 -- accel/accel.sh@20 -- # IFS=: 00:06:59.102 01:08:07 -- accel/accel.sh@20 -- # read -r var val 00:06:59.102 01:08:07 -- accel/accel.sh@21 -- # val= 00:06:59.102 01:08:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.102 01:08:07 -- accel/accel.sh@20 -- # IFS=: 00:06:59.102 01:08:07 -- accel/accel.sh@20 -- # read -r var val 00:06:59.102 01:08:07 -- accel/accel.sh@21 -- # val= 00:06:59.102 01:08:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.102 01:08:07 -- accel/accel.sh@20 -- # IFS=: 00:06:59.102 01:08:07 -- accel/accel.sh@20 -- # read -r var val 00:06:59.102 01:08:07 -- accel/accel.sh@21 -- # val= 00:06:59.102 01:08:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.102 01:08:07 -- accel/accel.sh@20 -- # IFS=: 00:06:59.102 01:08:07 -- accel/accel.sh@20 -- # read -r var val 00:06:59.102 01:08:07 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:59.102 01:08:07 -- accel/accel.sh@28 -- # [[ -n compare ]] 00:06:59.102 01:08:07 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:59.102 00:06:59.102 real 0m2.809s 00:06:59.102 user 0m2.517s 00:06:59.102 sys 0m0.283s 00:06:59.102 01:08:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:59.102 01:08:07 -- common/autotest_common.sh@10 -- # set +x 00:06:59.102 ************************************ 00:06:59.102 END TEST accel_compare 00:06:59.102 ************************************ 00:06:59.102 01:08:07 -- accel/accel.sh@101 -- # run_test accel_xor accel_test -t 1 -w xor -y 00:06:59.102 01:08:07 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:59.102 01:08:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:59.102 01:08:07 -- common/autotest_common.sh@10 -- # set +x 00:06:59.102 ************************************ 00:06:59.102 START TEST accel_xor 00:06:59.102 ************************************ 00:06:59.102 01:08:07 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y 00:06:59.102 01:08:07 -- accel/accel.sh@16 -- # local accel_opc 00:06:59.102 01:08:07 -- accel/accel.sh@17 -- # local accel_module 00:06:59.102 01:08:07 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y 00:06:59.102 01:08:07 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:06:59.102 01:08:07 -- accel/accel.sh@12 -- # build_accel_config 00:06:59.102 01:08:07 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:59.102 01:08:07 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:59.102 01:08:07 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:59.102 01:08:07 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:59.102 01:08:07 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:59.102 01:08:07 -- accel/accel.sh@41 -- # local IFS=, 00:06:59.102 01:08:07 -- accel/accel.sh@42 -- # jq -r . 00:06:59.361 [2024-11-20 01:08:07.331879] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:59.361 [2024-11-20 01:08:07.331966] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1027757 ] 00:06:59.361 EAL: No free 2048 kB hugepages reported on node 1 00:06:59.361 [2024-11-20 01:08:07.394923] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:59.361 [2024-11-20 01:08:07.487569] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:00.734 01:08:08 -- accel/accel.sh@18 -- # out=' 00:07:00.734 SPDK Configuration: 00:07:00.734 Core mask: 0x1 00:07:00.734 00:07:00.734 Accel Perf Configuration: 00:07:00.734 Workload Type: xor 00:07:00.734 Source buffers: 2 00:07:00.734 Transfer size: 4096 bytes 00:07:00.734 Vector count 1 00:07:00.734 Module: software 00:07:00.734 Queue depth: 32 00:07:00.734 Allocate depth: 32 00:07:00.734 # threads/core: 1 00:07:00.734 Run time: 1 seconds 00:07:00.734 Verify: Yes 00:07:00.734 00:07:00.734 Running for 1 seconds... 00:07:00.734 00:07:00.734 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:00.734 ------------------------------------------------------------------------------------ 00:07:00.734 0,0 194432/s 759 MiB/s 0 0 00:07:00.734 ==================================================================================== 00:07:00.734 Total 194432/s 759 MiB/s 0 0' 00:07:00.734 01:08:08 -- accel/accel.sh@20 -- # IFS=: 00:07:00.734 01:08:08 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y 00:07:00.734 01:08:08 -- accel/accel.sh@20 -- # read -r var val 00:07:00.734 01:08:08 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:07:00.734 01:08:08 -- accel/accel.sh@12 -- # build_accel_config 00:07:00.734 01:08:08 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:00.734 01:08:08 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:00.734 01:08:08 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:00.734 01:08:08 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:00.734 01:08:08 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:00.734 01:08:08 -- accel/accel.sh@41 -- # local IFS=, 00:07:00.734 01:08:08 -- accel/accel.sh@42 -- # jq -r . 00:07:00.734 [2024-11-20 01:08:08.720250] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:00.734 [2024-11-20 01:08:08.720327] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1027903 ] 00:07:00.734 EAL: No free 2048 kB hugepages reported on node 1 00:07:00.734 [2024-11-20 01:08:08.780623] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:00.734 [2024-11-20 01:08:08.871728] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:00.734 01:08:08 -- accel/accel.sh@21 -- # val= 00:07:00.734 01:08:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.734 01:08:08 -- accel/accel.sh@20 -- # IFS=: 00:07:00.734 01:08:08 -- accel/accel.sh@20 -- # read -r var val 00:07:00.734 01:08:08 -- accel/accel.sh@21 -- # val= 00:07:00.734 01:08:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.734 01:08:08 -- accel/accel.sh@20 -- # IFS=: 00:07:00.734 01:08:08 -- accel/accel.sh@20 -- # read -r var val 00:07:00.734 01:08:08 -- accel/accel.sh@21 -- # val=0x1 00:07:00.734 01:08:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.734 01:08:08 -- accel/accel.sh@20 -- # IFS=: 00:07:00.734 01:08:08 -- accel/accel.sh@20 -- # read -r var val 00:07:00.734 01:08:08 -- accel/accel.sh@21 -- # val= 00:07:00.734 01:08:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.734 01:08:08 -- accel/accel.sh@20 -- # IFS=: 00:07:00.734 01:08:08 -- accel/accel.sh@20 -- # read -r var val 00:07:00.734 01:08:08 -- accel/accel.sh@21 -- # val= 00:07:00.734 01:08:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.734 01:08:08 -- accel/accel.sh@20 -- # IFS=: 00:07:00.734 01:08:08 -- accel/accel.sh@20 -- # read -r var val 00:07:00.734 01:08:08 -- accel/accel.sh@21 -- # val=xor 00:07:00.734 01:08:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.734 01:08:08 -- accel/accel.sh@24 -- # accel_opc=xor 00:07:00.734 01:08:08 -- accel/accel.sh@20 -- # IFS=: 00:07:00.734 01:08:08 -- accel/accel.sh@20 -- # read -r var val 00:07:00.734 01:08:08 -- accel/accel.sh@21 -- # val=2 00:07:00.734 01:08:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.734 01:08:08 -- accel/accel.sh@20 -- # IFS=: 00:07:00.734 01:08:08 -- accel/accel.sh@20 -- # read -r var val 00:07:00.734 01:08:08 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:00.734 01:08:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.734 01:08:08 -- accel/accel.sh@20 -- # IFS=: 00:07:00.734 01:08:08 -- accel/accel.sh@20 -- # read -r var val 00:07:00.734 01:08:08 -- accel/accel.sh@21 -- # val= 00:07:00.734 01:08:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.734 01:08:08 -- accel/accel.sh@20 -- # IFS=: 00:07:00.734 01:08:08 -- accel/accel.sh@20 -- # read -r var val 00:07:00.734 01:08:08 -- accel/accel.sh@21 -- # val=software 00:07:00.734 01:08:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.734 01:08:08 -- accel/accel.sh@23 -- # accel_module=software 00:07:00.734 01:08:08 -- accel/accel.sh@20 -- # IFS=: 00:07:00.734 01:08:08 -- accel/accel.sh@20 -- # read -r var val 00:07:00.734 01:08:08 -- accel/accel.sh@21 -- # val=32 00:07:00.734 01:08:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.734 01:08:08 -- accel/accel.sh@20 -- # IFS=: 00:07:00.734 01:08:08 -- accel/accel.sh@20 -- # read -r var val 00:07:00.734 01:08:08 -- accel/accel.sh@21 -- # val=32 00:07:00.734 01:08:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.734 01:08:08 -- accel/accel.sh@20 -- # IFS=: 00:07:00.734 01:08:08 -- accel/accel.sh@20 -- # read -r var val 00:07:00.734 01:08:08 -- accel/accel.sh@21 -- # val=1 00:07:00.734 01:08:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.734 01:08:08 -- accel/accel.sh@20 -- # IFS=: 00:07:00.734 01:08:08 -- accel/accel.sh@20 -- # read -r var val 00:07:00.734 01:08:08 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:00.734 01:08:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.734 01:08:08 -- accel/accel.sh@20 -- # IFS=: 00:07:00.734 01:08:08 -- accel/accel.sh@20 -- # read -r var val 00:07:00.734 01:08:08 -- accel/accel.sh@21 -- # val=Yes 00:07:00.734 01:08:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.734 01:08:08 -- accel/accel.sh@20 -- # IFS=: 00:07:00.734 01:08:08 -- accel/accel.sh@20 -- # read -r var val 00:07:00.734 01:08:08 -- accel/accel.sh@21 -- # val= 00:07:00.734 01:08:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.734 01:08:08 -- accel/accel.sh@20 -- # IFS=: 00:07:00.734 01:08:08 -- accel/accel.sh@20 -- # read -r var val 00:07:00.734 01:08:08 -- accel/accel.sh@21 -- # val= 00:07:00.734 01:08:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.734 01:08:08 -- accel/accel.sh@20 -- # IFS=: 00:07:00.734 01:08:08 -- accel/accel.sh@20 -- # read -r var val 00:07:02.106 01:08:10 -- accel/accel.sh@21 -- # val= 00:07:02.106 01:08:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.106 01:08:10 -- accel/accel.sh@20 -- # IFS=: 00:07:02.106 01:08:10 -- accel/accel.sh@20 -- # read -r var val 00:07:02.106 01:08:10 -- accel/accel.sh@21 -- # val= 00:07:02.106 01:08:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.106 01:08:10 -- accel/accel.sh@20 -- # IFS=: 00:07:02.106 01:08:10 -- accel/accel.sh@20 -- # read -r var val 00:07:02.106 01:08:10 -- accel/accel.sh@21 -- # val= 00:07:02.106 01:08:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.106 01:08:10 -- accel/accel.sh@20 -- # IFS=: 00:07:02.106 01:08:10 -- accel/accel.sh@20 -- # read -r var val 00:07:02.106 01:08:10 -- accel/accel.sh@21 -- # val= 00:07:02.106 01:08:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.106 01:08:10 -- accel/accel.sh@20 -- # IFS=: 00:07:02.106 01:08:10 -- accel/accel.sh@20 -- # read -r var val 00:07:02.106 01:08:10 -- accel/accel.sh@21 -- # val= 00:07:02.106 01:08:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.106 01:08:10 -- accel/accel.sh@20 -- # IFS=: 00:07:02.106 01:08:10 -- accel/accel.sh@20 -- # read -r var val 00:07:02.106 01:08:10 -- accel/accel.sh@21 -- # val= 00:07:02.106 01:08:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.106 01:08:10 -- accel/accel.sh@20 -- # IFS=: 00:07:02.106 01:08:10 -- accel/accel.sh@20 -- # read -r var val 00:07:02.106 01:08:10 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:02.106 01:08:10 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:07:02.106 01:08:10 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:02.106 00:07:02.106 real 0m2.795s 00:07:02.106 user 0m2.508s 00:07:02.106 sys 0m0.279s 00:07:02.106 01:08:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:02.106 01:08:10 -- common/autotest_common.sh@10 -- # set +x 00:07:02.106 ************************************ 00:07:02.106 END TEST accel_xor 00:07:02.106 ************************************ 00:07:02.106 01:08:10 -- accel/accel.sh@102 -- # run_test accel_xor accel_test -t 1 -w xor -y -x 3 00:07:02.106 01:08:10 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:02.106 01:08:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:02.106 01:08:10 -- common/autotest_common.sh@10 -- # set +x 00:07:02.106 ************************************ 00:07:02.106 START TEST accel_xor 00:07:02.106 ************************************ 00:07:02.106 01:08:10 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y -x 3 00:07:02.106 01:08:10 -- accel/accel.sh@16 -- # local accel_opc 00:07:02.106 01:08:10 -- accel/accel.sh@17 -- # local accel_module 00:07:02.106 01:08:10 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y -x 3 00:07:02.106 01:08:10 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:07:02.106 01:08:10 -- accel/accel.sh@12 -- # build_accel_config 00:07:02.106 01:08:10 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:02.106 01:08:10 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:02.106 01:08:10 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:02.106 01:08:10 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:02.106 01:08:10 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:02.106 01:08:10 -- accel/accel.sh@41 -- # local IFS=, 00:07:02.106 01:08:10 -- accel/accel.sh@42 -- # jq -r . 00:07:02.106 [2024-11-20 01:08:10.148093] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:02.106 [2024-11-20 01:08:10.148184] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1028066 ] 00:07:02.106 EAL: No free 2048 kB hugepages reported on node 1 00:07:02.106 [2024-11-20 01:08:10.210403] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:02.106 [2024-11-20 01:08:10.302604] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:03.478 01:08:11 -- accel/accel.sh@18 -- # out=' 00:07:03.478 SPDK Configuration: 00:07:03.478 Core mask: 0x1 00:07:03.478 00:07:03.478 Accel Perf Configuration: 00:07:03.478 Workload Type: xor 00:07:03.478 Source buffers: 3 00:07:03.478 Transfer size: 4096 bytes 00:07:03.478 Vector count 1 00:07:03.478 Module: software 00:07:03.478 Queue depth: 32 00:07:03.478 Allocate depth: 32 00:07:03.478 # threads/core: 1 00:07:03.478 Run time: 1 seconds 00:07:03.478 Verify: Yes 00:07:03.478 00:07:03.478 Running for 1 seconds... 00:07:03.478 00:07:03.478 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:03.478 ------------------------------------------------------------------------------------ 00:07:03.478 0,0 183872/s 718 MiB/s 0 0 00:07:03.479 ==================================================================================== 00:07:03.479 Total 183872/s 718 MiB/s 0 0' 00:07:03.479 01:08:11 -- accel/accel.sh@20 -- # IFS=: 00:07:03.479 01:08:11 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y -x 3 00:07:03.479 01:08:11 -- accel/accel.sh@20 -- # read -r var val 00:07:03.479 01:08:11 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:07:03.479 01:08:11 -- accel/accel.sh@12 -- # build_accel_config 00:07:03.479 01:08:11 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:03.479 01:08:11 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:03.479 01:08:11 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:03.479 01:08:11 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:03.479 01:08:11 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:03.479 01:08:11 -- accel/accel.sh@41 -- # local IFS=, 00:07:03.479 01:08:11 -- accel/accel.sh@42 -- # jq -r . 00:07:03.479 [2024-11-20 01:08:11.552046] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:03.479 [2024-11-20 01:08:11.552222] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1028204 ] 00:07:03.479 EAL: No free 2048 kB hugepages reported on node 1 00:07:03.479 [2024-11-20 01:08:11.612092] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:03.737 [2024-11-20 01:08:11.701148] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:03.737 01:08:11 -- accel/accel.sh@21 -- # val= 00:07:03.737 01:08:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.737 01:08:11 -- accel/accel.sh@20 -- # IFS=: 00:07:03.737 01:08:11 -- accel/accel.sh@20 -- # read -r var val 00:07:03.737 01:08:11 -- accel/accel.sh@21 -- # val= 00:07:03.737 01:08:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.737 01:08:11 -- accel/accel.sh@20 -- # IFS=: 00:07:03.737 01:08:11 -- accel/accel.sh@20 -- # read -r var val 00:07:03.737 01:08:11 -- accel/accel.sh@21 -- # val=0x1 00:07:03.737 01:08:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.737 01:08:11 -- accel/accel.sh@20 -- # IFS=: 00:07:03.737 01:08:11 -- accel/accel.sh@20 -- # read -r var val 00:07:03.737 01:08:11 -- accel/accel.sh@21 -- # val= 00:07:03.737 01:08:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.737 01:08:11 -- accel/accel.sh@20 -- # IFS=: 00:07:03.737 01:08:11 -- accel/accel.sh@20 -- # read -r var val 00:07:03.737 01:08:11 -- accel/accel.sh@21 -- # val= 00:07:03.737 01:08:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.737 01:08:11 -- accel/accel.sh@20 -- # IFS=: 00:07:03.737 01:08:11 -- accel/accel.sh@20 -- # read -r var val 00:07:03.737 01:08:11 -- accel/accel.sh@21 -- # val=xor 00:07:03.737 01:08:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.737 01:08:11 -- accel/accel.sh@24 -- # accel_opc=xor 00:07:03.737 01:08:11 -- accel/accel.sh@20 -- # IFS=: 00:07:03.737 01:08:11 -- accel/accel.sh@20 -- # read -r var val 00:07:03.737 01:08:11 -- accel/accel.sh@21 -- # val=3 00:07:03.737 01:08:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.737 01:08:11 -- accel/accel.sh@20 -- # IFS=: 00:07:03.737 01:08:11 -- accel/accel.sh@20 -- # read -r var val 00:07:03.737 01:08:11 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:03.737 01:08:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.737 01:08:11 -- accel/accel.sh@20 -- # IFS=: 00:07:03.737 01:08:11 -- accel/accel.sh@20 -- # read -r var val 00:07:03.737 01:08:11 -- accel/accel.sh@21 -- # val= 00:07:03.737 01:08:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.737 01:08:11 -- accel/accel.sh@20 -- # IFS=: 00:07:03.737 01:08:11 -- accel/accel.sh@20 -- # read -r var val 00:07:03.737 01:08:11 -- accel/accel.sh@21 -- # val=software 00:07:03.737 01:08:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.737 01:08:11 -- accel/accel.sh@23 -- # accel_module=software 00:07:03.737 01:08:11 -- accel/accel.sh@20 -- # IFS=: 00:07:03.737 01:08:11 -- accel/accel.sh@20 -- # read -r var val 00:07:03.737 01:08:11 -- accel/accel.sh@21 -- # val=32 00:07:03.737 01:08:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.737 01:08:11 -- accel/accel.sh@20 -- # IFS=: 00:07:03.737 01:08:11 -- accel/accel.sh@20 -- # read -r var val 00:07:03.737 01:08:11 -- accel/accel.sh@21 -- # val=32 00:07:03.737 01:08:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.737 01:08:11 -- accel/accel.sh@20 -- # IFS=: 00:07:03.737 01:08:11 -- accel/accel.sh@20 -- # read -r var val 00:07:03.737 01:08:11 -- accel/accel.sh@21 -- # val=1 00:07:03.737 01:08:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.737 01:08:11 -- accel/accel.sh@20 -- # IFS=: 00:07:03.737 01:08:11 -- accel/accel.sh@20 -- # read -r var val 00:07:03.737 01:08:11 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:03.737 01:08:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.737 01:08:11 -- accel/accel.sh@20 -- # IFS=: 00:07:03.737 01:08:11 -- accel/accel.sh@20 -- # read -r var val 00:07:03.737 01:08:11 -- accel/accel.sh@21 -- # val=Yes 00:07:03.737 01:08:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.737 01:08:11 -- accel/accel.sh@20 -- # IFS=: 00:07:03.737 01:08:11 -- accel/accel.sh@20 -- # read -r var val 00:07:03.737 01:08:11 -- accel/accel.sh@21 -- # val= 00:07:03.737 01:08:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.737 01:08:11 -- accel/accel.sh@20 -- # IFS=: 00:07:03.737 01:08:11 -- accel/accel.sh@20 -- # read -r var val 00:07:03.737 01:08:11 -- accel/accel.sh@21 -- # val= 00:07:03.737 01:08:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.737 01:08:11 -- accel/accel.sh@20 -- # IFS=: 00:07:03.737 01:08:11 -- accel/accel.sh@20 -- # read -r var val 00:07:05.111 01:08:12 -- accel/accel.sh@21 -- # val= 00:07:05.111 01:08:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.111 01:08:12 -- accel/accel.sh@20 -- # IFS=: 00:07:05.111 01:08:12 -- accel/accel.sh@20 -- # read -r var val 00:07:05.111 01:08:12 -- accel/accel.sh@21 -- # val= 00:07:05.111 01:08:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.111 01:08:12 -- accel/accel.sh@20 -- # IFS=: 00:07:05.111 01:08:12 -- accel/accel.sh@20 -- # read -r var val 00:07:05.111 01:08:12 -- accel/accel.sh@21 -- # val= 00:07:05.111 01:08:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.111 01:08:12 -- accel/accel.sh@20 -- # IFS=: 00:07:05.111 01:08:12 -- accel/accel.sh@20 -- # read -r var val 00:07:05.111 01:08:12 -- accel/accel.sh@21 -- # val= 00:07:05.111 01:08:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.111 01:08:12 -- accel/accel.sh@20 -- # IFS=: 00:07:05.111 01:08:12 -- accel/accel.sh@20 -- # read -r var val 00:07:05.111 01:08:12 -- accel/accel.sh@21 -- # val= 00:07:05.111 01:08:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.111 01:08:12 -- accel/accel.sh@20 -- # IFS=: 00:07:05.111 01:08:12 -- accel/accel.sh@20 -- # read -r var val 00:07:05.111 01:08:12 -- accel/accel.sh@21 -- # val= 00:07:05.111 01:08:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.111 01:08:12 -- accel/accel.sh@20 -- # IFS=: 00:07:05.111 01:08:12 -- accel/accel.sh@20 -- # read -r var val 00:07:05.111 01:08:12 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:05.111 01:08:12 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:07:05.111 01:08:12 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:05.111 00:07:05.111 real 0m2.797s 00:07:05.111 user 0m2.502s 00:07:05.111 sys 0m0.286s 00:07:05.111 01:08:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:05.111 01:08:12 -- common/autotest_common.sh@10 -- # set +x 00:07:05.111 ************************************ 00:07:05.111 END TEST accel_xor 00:07:05.111 ************************************ 00:07:05.111 01:08:12 -- accel/accel.sh@103 -- # run_test accel_dif_verify accel_test -t 1 -w dif_verify 00:07:05.111 01:08:12 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:07:05.111 01:08:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:05.111 01:08:12 -- common/autotest_common.sh@10 -- # set +x 00:07:05.111 ************************************ 00:07:05.111 START TEST accel_dif_verify 00:07:05.111 ************************************ 00:07:05.111 01:08:12 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_verify 00:07:05.111 01:08:12 -- accel/accel.sh@16 -- # local accel_opc 00:07:05.111 01:08:12 -- accel/accel.sh@17 -- # local accel_module 00:07:05.111 01:08:12 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_verify 00:07:05.111 01:08:12 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:07:05.111 01:08:12 -- accel/accel.sh@12 -- # build_accel_config 00:07:05.111 01:08:12 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:05.111 01:08:12 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:05.111 01:08:12 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:05.111 01:08:12 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:05.111 01:08:12 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:05.111 01:08:12 -- accel/accel.sh@41 -- # local IFS=, 00:07:05.111 01:08:12 -- accel/accel.sh@42 -- # jq -r . 00:07:05.111 [2024-11-20 01:08:12.969890] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:05.111 [2024-11-20 01:08:12.969976] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1028476 ] 00:07:05.111 EAL: No free 2048 kB hugepages reported on node 1 00:07:05.111 [2024-11-20 01:08:13.031255] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:05.111 [2024-11-20 01:08:13.122887] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:06.484 01:08:14 -- accel/accel.sh@18 -- # out=' 00:07:06.484 SPDK Configuration: 00:07:06.484 Core mask: 0x1 00:07:06.484 00:07:06.484 Accel Perf Configuration: 00:07:06.484 Workload Type: dif_verify 00:07:06.484 Vector size: 4096 bytes 00:07:06.484 Transfer size: 4096 bytes 00:07:06.484 Block size: 512 bytes 00:07:06.484 Metadata size: 8 bytes 00:07:06.484 Vector count 1 00:07:06.484 Module: software 00:07:06.484 Queue depth: 32 00:07:06.484 Allocate depth: 32 00:07:06.484 # threads/core: 1 00:07:06.484 Run time: 1 seconds 00:07:06.484 Verify: No 00:07:06.484 00:07:06.484 Running for 1 seconds... 00:07:06.484 00:07:06.484 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:06.484 ------------------------------------------------------------------------------------ 00:07:06.484 0,0 81120/s 321 MiB/s 0 0 00:07:06.484 ==================================================================================== 00:07:06.484 Total 81120/s 316 MiB/s 0 0' 00:07:06.484 01:08:14 -- accel/accel.sh@20 -- # IFS=: 00:07:06.484 01:08:14 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_verify 00:07:06.484 01:08:14 -- accel/accel.sh@20 -- # read -r var val 00:07:06.484 01:08:14 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:07:06.484 01:08:14 -- accel/accel.sh@12 -- # build_accel_config 00:07:06.484 01:08:14 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:06.484 01:08:14 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:06.484 01:08:14 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:06.484 01:08:14 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:06.484 01:08:14 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:06.484 01:08:14 -- accel/accel.sh@41 -- # local IFS=, 00:07:06.484 01:08:14 -- accel/accel.sh@42 -- # jq -r . 00:07:06.484 [2024-11-20 01:08:14.369248] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:06.484 [2024-11-20 01:08:14.369326] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1028628 ] 00:07:06.484 EAL: No free 2048 kB hugepages reported on node 1 00:07:06.484 [2024-11-20 01:08:14.430566] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:06.484 [2024-11-20 01:08:14.521361] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:06.484 01:08:14 -- accel/accel.sh@21 -- # val= 00:07:06.484 01:08:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.484 01:08:14 -- accel/accel.sh@20 -- # IFS=: 00:07:06.484 01:08:14 -- accel/accel.sh@20 -- # read -r var val 00:07:06.484 01:08:14 -- accel/accel.sh@21 -- # val= 00:07:06.484 01:08:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.484 01:08:14 -- accel/accel.sh@20 -- # IFS=: 00:07:06.484 01:08:14 -- accel/accel.sh@20 -- # read -r var val 00:07:06.484 01:08:14 -- accel/accel.sh@21 -- # val=0x1 00:07:06.484 01:08:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.484 01:08:14 -- accel/accel.sh@20 -- # IFS=: 00:07:06.484 01:08:14 -- accel/accel.sh@20 -- # read -r var val 00:07:06.484 01:08:14 -- accel/accel.sh@21 -- # val= 00:07:06.484 01:08:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.484 01:08:14 -- accel/accel.sh@20 -- # IFS=: 00:07:06.484 01:08:14 -- accel/accel.sh@20 -- # read -r var val 00:07:06.484 01:08:14 -- accel/accel.sh@21 -- # val= 00:07:06.484 01:08:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.484 01:08:14 -- accel/accel.sh@20 -- # IFS=: 00:07:06.484 01:08:14 -- accel/accel.sh@20 -- # read -r var val 00:07:06.484 01:08:14 -- accel/accel.sh@21 -- # val=dif_verify 00:07:06.484 01:08:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.484 01:08:14 -- accel/accel.sh@24 -- # accel_opc=dif_verify 00:07:06.484 01:08:14 -- accel/accel.sh@20 -- # IFS=: 00:07:06.484 01:08:14 -- accel/accel.sh@20 -- # read -r var val 00:07:06.484 01:08:14 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:06.484 01:08:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.484 01:08:14 -- accel/accel.sh@20 -- # IFS=: 00:07:06.484 01:08:14 -- accel/accel.sh@20 -- # read -r var val 00:07:06.484 01:08:14 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:06.484 01:08:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.484 01:08:14 -- accel/accel.sh@20 -- # IFS=: 00:07:06.484 01:08:14 -- accel/accel.sh@20 -- # read -r var val 00:07:06.484 01:08:14 -- accel/accel.sh@21 -- # val='512 bytes' 00:07:06.484 01:08:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.484 01:08:14 -- accel/accel.sh@20 -- # IFS=: 00:07:06.484 01:08:14 -- accel/accel.sh@20 -- # read -r var val 00:07:06.484 01:08:14 -- accel/accel.sh@21 -- # val='8 bytes' 00:07:06.484 01:08:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.484 01:08:14 -- accel/accel.sh@20 -- # IFS=: 00:07:06.484 01:08:14 -- accel/accel.sh@20 -- # read -r var val 00:07:06.484 01:08:14 -- accel/accel.sh@21 -- # val= 00:07:06.484 01:08:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.484 01:08:14 -- accel/accel.sh@20 -- # IFS=: 00:07:06.484 01:08:14 -- accel/accel.sh@20 -- # read -r var val 00:07:06.484 01:08:14 -- accel/accel.sh@21 -- # val=software 00:07:06.484 01:08:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.484 01:08:14 -- accel/accel.sh@23 -- # accel_module=software 00:07:06.484 01:08:14 -- accel/accel.sh@20 -- # IFS=: 00:07:06.484 01:08:14 -- accel/accel.sh@20 -- # read -r var val 00:07:06.484 01:08:14 -- accel/accel.sh@21 -- # val=32 00:07:06.484 01:08:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.484 01:08:14 -- accel/accel.sh@20 -- # IFS=: 00:07:06.484 01:08:14 -- accel/accel.sh@20 -- # read -r var val 00:07:06.484 01:08:14 -- accel/accel.sh@21 -- # val=32 00:07:06.484 01:08:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.484 01:08:14 -- accel/accel.sh@20 -- # IFS=: 00:07:06.484 01:08:14 -- accel/accel.sh@20 -- # read -r var val 00:07:06.484 01:08:14 -- accel/accel.sh@21 -- # val=1 00:07:06.484 01:08:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.484 01:08:14 -- accel/accel.sh@20 -- # IFS=: 00:07:06.484 01:08:14 -- accel/accel.sh@20 -- # read -r var val 00:07:06.484 01:08:14 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:06.484 01:08:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.484 01:08:14 -- accel/accel.sh@20 -- # IFS=: 00:07:06.484 01:08:14 -- accel/accel.sh@20 -- # read -r var val 00:07:06.485 01:08:14 -- accel/accel.sh@21 -- # val=No 00:07:06.485 01:08:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.485 01:08:14 -- accel/accel.sh@20 -- # IFS=: 00:07:06.485 01:08:14 -- accel/accel.sh@20 -- # read -r var val 00:07:06.485 01:08:14 -- accel/accel.sh@21 -- # val= 00:07:06.485 01:08:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.485 01:08:14 -- accel/accel.sh@20 -- # IFS=: 00:07:06.485 01:08:14 -- accel/accel.sh@20 -- # read -r var val 00:07:06.485 01:08:14 -- accel/accel.sh@21 -- # val= 00:07:06.485 01:08:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.485 01:08:14 -- accel/accel.sh@20 -- # IFS=: 00:07:06.485 01:08:14 -- accel/accel.sh@20 -- # read -r var val 00:07:07.858 01:08:15 -- accel/accel.sh@21 -- # val= 00:07:07.858 01:08:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.858 01:08:15 -- accel/accel.sh@20 -- # IFS=: 00:07:07.858 01:08:15 -- accel/accel.sh@20 -- # read -r var val 00:07:07.858 01:08:15 -- accel/accel.sh@21 -- # val= 00:07:07.858 01:08:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.858 01:08:15 -- accel/accel.sh@20 -- # IFS=: 00:07:07.858 01:08:15 -- accel/accel.sh@20 -- # read -r var val 00:07:07.858 01:08:15 -- accel/accel.sh@21 -- # val= 00:07:07.858 01:08:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.858 01:08:15 -- accel/accel.sh@20 -- # IFS=: 00:07:07.858 01:08:15 -- accel/accel.sh@20 -- # read -r var val 00:07:07.858 01:08:15 -- accel/accel.sh@21 -- # val= 00:07:07.858 01:08:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.858 01:08:15 -- accel/accel.sh@20 -- # IFS=: 00:07:07.858 01:08:15 -- accel/accel.sh@20 -- # read -r var val 00:07:07.858 01:08:15 -- accel/accel.sh@21 -- # val= 00:07:07.858 01:08:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.858 01:08:15 -- accel/accel.sh@20 -- # IFS=: 00:07:07.858 01:08:15 -- accel/accel.sh@20 -- # read -r var val 00:07:07.858 01:08:15 -- accel/accel.sh@21 -- # val= 00:07:07.858 01:08:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.858 01:08:15 -- accel/accel.sh@20 -- # IFS=: 00:07:07.859 01:08:15 -- accel/accel.sh@20 -- # read -r var val 00:07:07.859 01:08:15 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:07.859 01:08:15 -- accel/accel.sh@28 -- # [[ -n dif_verify ]] 00:07:07.859 01:08:15 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:07.859 00:07:07.859 real 0m2.805s 00:07:07.859 user 0m2.498s 00:07:07.859 sys 0m0.301s 00:07:07.859 01:08:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:07.859 01:08:15 -- common/autotest_common.sh@10 -- # set +x 00:07:07.859 ************************************ 00:07:07.859 END TEST accel_dif_verify 00:07:07.859 ************************************ 00:07:07.859 01:08:15 -- accel/accel.sh@104 -- # run_test accel_dif_generate accel_test -t 1 -w dif_generate 00:07:07.859 01:08:15 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:07:07.859 01:08:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:07.859 01:08:15 -- common/autotest_common.sh@10 -- # set +x 00:07:07.859 ************************************ 00:07:07.859 START TEST accel_dif_generate 00:07:07.859 ************************************ 00:07:07.859 01:08:15 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate 00:07:07.859 01:08:15 -- accel/accel.sh@16 -- # local accel_opc 00:07:07.859 01:08:15 -- accel/accel.sh@17 -- # local accel_module 00:07:07.859 01:08:15 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate 00:07:07.859 01:08:15 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:07:07.859 01:08:15 -- accel/accel.sh@12 -- # build_accel_config 00:07:07.859 01:08:15 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:07.859 01:08:15 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:07.859 01:08:15 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:07.859 01:08:15 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:07.859 01:08:15 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:07.859 01:08:15 -- accel/accel.sh@41 -- # local IFS=, 00:07:07.859 01:08:15 -- accel/accel.sh@42 -- # jq -r . 00:07:07.859 [2024-11-20 01:08:15.800294] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:07.859 [2024-11-20 01:08:15.800385] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1028787 ] 00:07:07.859 EAL: No free 2048 kB hugepages reported on node 1 00:07:07.859 [2024-11-20 01:08:15.861677] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:07.859 [2024-11-20 01:08:15.955650] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:09.232 01:08:17 -- accel/accel.sh@18 -- # out=' 00:07:09.232 SPDK Configuration: 00:07:09.232 Core mask: 0x1 00:07:09.232 00:07:09.232 Accel Perf Configuration: 00:07:09.232 Workload Type: dif_generate 00:07:09.232 Vector size: 4096 bytes 00:07:09.232 Transfer size: 4096 bytes 00:07:09.232 Block size: 512 bytes 00:07:09.232 Metadata size: 8 bytes 00:07:09.232 Vector count 1 00:07:09.232 Module: software 00:07:09.232 Queue depth: 32 00:07:09.232 Allocate depth: 32 00:07:09.232 # threads/core: 1 00:07:09.232 Run time: 1 seconds 00:07:09.232 Verify: No 00:07:09.232 00:07:09.232 Running for 1 seconds... 00:07:09.232 00:07:09.232 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:09.232 ------------------------------------------------------------------------------------ 00:07:09.232 0,0 94848/s 376 MiB/s 0 0 00:07:09.233 ==================================================================================== 00:07:09.233 Total 94848/s 370 MiB/s 0 0' 00:07:09.233 01:08:17 -- accel/accel.sh@20 -- # IFS=: 00:07:09.233 01:08:17 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate 00:07:09.233 01:08:17 -- accel/accel.sh@20 -- # read -r var val 00:07:09.233 01:08:17 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:07:09.233 01:08:17 -- accel/accel.sh@12 -- # build_accel_config 00:07:09.233 01:08:17 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:09.233 01:08:17 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:09.233 01:08:17 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:09.233 01:08:17 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:09.233 01:08:17 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:09.233 01:08:17 -- accel/accel.sh@41 -- # local IFS=, 00:07:09.233 01:08:17 -- accel/accel.sh@42 -- # jq -r . 00:07:09.233 [2024-11-20 01:08:17.211059] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:09.233 [2024-11-20 01:08:17.211161] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1028933 ] 00:07:09.233 EAL: No free 2048 kB hugepages reported on node 1 00:07:09.233 [2024-11-20 01:08:17.271582] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:09.233 [2024-11-20 01:08:17.364061] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:09.233 01:08:17 -- accel/accel.sh@21 -- # val= 00:07:09.233 01:08:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.233 01:08:17 -- accel/accel.sh@20 -- # IFS=: 00:07:09.233 01:08:17 -- accel/accel.sh@20 -- # read -r var val 00:07:09.233 01:08:17 -- accel/accel.sh@21 -- # val= 00:07:09.233 01:08:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.233 01:08:17 -- accel/accel.sh@20 -- # IFS=: 00:07:09.233 01:08:17 -- accel/accel.sh@20 -- # read -r var val 00:07:09.233 01:08:17 -- accel/accel.sh@21 -- # val=0x1 00:07:09.233 01:08:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.233 01:08:17 -- accel/accel.sh@20 -- # IFS=: 00:07:09.233 01:08:17 -- accel/accel.sh@20 -- # read -r var val 00:07:09.233 01:08:17 -- accel/accel.sh@21 -- # val= 00:07:09.233 01:08:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.233 01:08:17 -- accel/accel.sh@20 -- # IFS=: 00:07:09.233 01:08:17 -- accel/accel.sh@20 -- # read -r var val 00:07:09.233 01:08:17 -- accel/accel.sh@21 -- # val= 00:07:09.233 01:08:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.233 01:08:17 -- accel/accel.sh@20 -- # IFS=: 00:07:09.233 01:08:17 -- accel/accel.sh@20 -- # read -r var val 00:07:09.233 01:08:17 -- accel/accel.sh@21 -- # val=dif_generate 00:07:09.233 01:08:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.233 01:08:17 -- accel/accel.sh@24 -- # accel_opc=dif_generate 00:07:09.233 01:08:17 -- accel/accel.sh@20 -- # IFS=: 00:07:09.233 01:08:17 -- accel/accel.sh@20 -- # read -r var val 00:07:09.233 01:08:17 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:09.233 01:08:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.233 01:08:17 -- accel/accel.sh@20 -- # IFS=: 00:07:09.233 01:08:17 -- accel/accel.sh@20 -- # read -r var val 00:07:09.233 01:08:17 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:09.233 01:08:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.233 01:08:17 -- accel/accel.sh@20 -- # IFS=: 00:07:09.233 01:08:17 -- accel/accel.sh@20 -- # read -r var val 00:07:09.233 01:08:17 -- accel/accel.sh@21 -- # val='512 bytes' 00:07:09.233 01:08:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.233 01:08:17 -- accel/accel.sh@20 -- # IFS=: 00:07:09.233 01:08:17 -- accel/accel.sh@20 -- # read -r var val 00:07:09.233 01:08:17 -- accel/accel.sh@21 -- # val='8 bytes' 00:07:09.233 01:08:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.233 01:08:17 -- accel/accel.sh@20 -- # IFS=: 00:07:09.233 01:08:17 -- accel/accel.sh@20 -- # read -r var val 00:07:09.233 01:08:17 -- accel/accel.sh@21 -- # val= 00:07:09.233 01:08:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.233 01:08:17 -- accel/accel.sh@20 -- # IFS=: 00:07:09.233 01:08:17 -- accel/accel.sh@20 -- # read -r var val 00:07:09.233 01:08:17 -- accel/accel.sh@21 -- # val=software 00:07:09.233 01:08:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.233 01:08:17 -- accel/accel.sh@23 -- # accel_module=software 00:07:09.233 01:08:17 -- accel/accel.sh@20 -- # IFS=: 00:07:09.233 01:08:17 -- accel/accel.sh@20 -- # read -r var val 00:07:09.233 01:08:17 -- accel/accel.sh@21 -- # val=32 00:07:09.233 01:08:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.233 01:08:17 -- accel/accel.sh@20 -- # IFS=: 00:07:09.233 01:08:17 -- accel/accel.sh@20 -- # read -r var val 00:07:09.233 01:08:17 -- accel/accel.sh@21 -- # val=32 00:07:09.233 01:08:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.233 01:08:17 -- accel/accel.sh@20 -- # IFS=: 00:07:09.233 01:08:17 -- accel/accel.sh@20 -- # read -r var val 00:07:09.233 01:08:17 -- accel/accel.sh@21 -- # val=1 00:07:09.233 01:08:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.233 01:08:17 -- accel/accel.sh@20 -- # IFS=: 00:07:09.233 01:08:17 -- accel/accel.sh@20 -- # read -r var val 00:07:09.233 01:08:17 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:09.233 01:08:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.233 01:08:17 -- accel/accel.sh@20 -- # IFS=: 00:07:09.233 01:08:17 -- accel/accel.sh@20 -- # read -r var val 00:07:09.233 01:08:17 -- accel/accel.sh@21 -- # val=No 00:07:09.233 01:08:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.233 01:08:17 -- accel/accel.sh@20 -- # IFS=: 00:07:09.233 01:08:17 -- accel/accel.sh@20 -- # read -r var val 00:07:09.233 01:08:17 -- accel/accel.sh@21 -- # val= 00:07:09.233 01:08:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.233 01:08:17 -- accel/accel.sh@20 -- # IFS=: 00:07:09.233 01:08:17 -- accel/accel.sh@20 -- # read -r var val 00:07:09.233 01:08:17 -- accel/accel.sh@21 -- # val= 00:07:09.233 01:08:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.233 01:08:17 -- accel/accel.sh@20 -- # IFS=: 00:07:09.233 01:08:17 -- accel/accel.sh@20 -- # read -r var val 00:07:10.606 01:08:18 -- accel/accel.sh@21 -- # val= 00:07:10.606 01:08:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.606 01:08:18 -- accel/accel.sh@20 -- # IFS=: 00:07:10.606 01:08:18 -- accel/accel.sh@20 -- # read -r var val 00:07:10.606 01:08:18 -- accel/accel.sh@21 -- # val= 00:07:10.606 01:08:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.606 01:08:18 -- accel/accel.sh@20 -- # IFS=: 00:07:10.606 01:08:18 -- accel/accel.sh@20 -- # read -r var val 00:07:10.606 01:08:18 -- accel/accel.sh@21 -- # val= 00:07:10.606 01:08:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.606 01:08:18 -- accel/accel.sh@20 -- # IFS=: 00:07:10.606 01:08:18 -- accel/accel.sh@20 -- # read -r var val 00:07:10.606 01:08:18 -- accel/accel.sh@21 -- # val= 00:07:10.606 01:08:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.606 01:08:18 -- accel/accel.sh@20 -- # IFS=: 00:07:10.606 01:08:18 -- accel/accel.sh@20 -- # read -r var val 00:07:10.606 01:08:18 -- accel/accel.sh@21 -- # val= 00:07:10.606 01:08:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.606 01:08:18 -- accel/accel.sh@20 -- # IFS=: 00:07:10.606 01:08:18 -- accel/accel.sh@20 -- # read -r var val 00:07:10.606 01:08:18 -- accel/accel.sh@21 -- # val= 00:07:10.606 01:08:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.606 01:08:18 -- accel/accel.sh@20 -- # IFS=: 00:07:10.606 01:08:18 -- accel/accel.sh@20 -- # read -r var val 00:07:10.606 01:08:18 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:10.606 01:08:18 -- accel/accel.sh@28 -- # [[ -n dif_generate ]] 00:07:10.606 01:08:18 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:10.606 00:07:10.606 real 0m2.816s 00:07:10.606 user 0m2.526s 00:07:10.606 sys 0m0.284s 00:07:10.606 01:08:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:10.606 01:08:18 -- common/autotest_common.sh@10 -- # set +x 00:07:10.606 ************************************ 00:07:10.606 END TEST accel_dif_generate 00:07:10.606 ************************************ 00:07:10.606 01:08:18 -- accel/accel.sh@105 -- # run_test accel_dif_generate_copy accel_test -t 1 -w dif_generate_copy 00:07:10.606 01:08:18 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:07:10.606 01:08:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:10.606 01:08:18 -- common/autotest_common.sh@10 -- # set +x 00:07:10.606 ************************************ 00:07:10.606 START TEST accel_dif_generate_copy 00:07:10.606 ************************************ 00:07:10.606 01:08:18 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate_copy 00:07:10.606 01:08:18 -- accel/accel.sh@16 -- # local accel_opc 00:07:10.606 01:08:18 -- accel/accel.sh@17 -- # local accel_module 00:07:10.606 01:08:18 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate_copy 00:07:10.606 01:08:18 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:07:10.606 01:08:18 -- accel/accel.sh@12 -- # build_accel_config 00:07:10.606 01:08:18 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:10.606 01:08:18 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:10.606 01:08:18 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:10.606 01:08:18 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:10.606 01:08:18 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:10.606 01:08:18 -- accel/accel.sh@41 -- # local IFS=, 00:07:10.606 01:08:18 -- accel/accel.sh@42 -- # jq -r . 00:07:10.606 [2024-11-20 01:08:18.638842] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:10.606 [2024-11-20 01:08:18.638933] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1029206 ] 00:07:10.606 EAL: No free 2048 kB hugepages reported on node 1 00:07:10.606 [2024-11-20 01:08:18.703922] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:10.606 [2024-11-20 01:08:18.797687] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:11.987 01:08:20 -- accel/accel.sh@18 -- # out=' 00:07:11.987 SPDK Configuration: 00:07:11.987 Core mask: 0x1 00:07:11.987 00:07:11.987 Accel Perf Configuration: 00:07:11.987 Workload Type: dif_generate_copy 00:07:11.987 Vector size: 4096 bytes 00:07:11.987 Transfer size: 4096 bytes 00:07:11.987 Vector count 1 00:07:11.987 Module: software 00:07:11.987 Queue depth: 32 00:07:11.987 Allocate depth: 32 00:07:11.987 # threads/core: 1 00:07:11.987 Run time: 1 seconds 00:07:11.987 Verify: No 00:07:11.987 00:07:11.987 Running for 1 seconds... 00:07:11.987 00:07:11.987 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:11.987 ------------------------------------------------------------------------------------ 00:07:11.987 0,0 75712/s 300 MiB/s 0 0 00:07:11.987 ==================================================================================== 00:07:11.987 Total 75712/s 295 MiB/s 0 0' 00:07:11.987 01:08:20 -- accel/accel.sh@20 -- # IFS=: 00:07:11.987 01:08:20 -- accel/accel.sh@20 -- # read -r var val 00:07:11.987 01:08:20 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate_copy 00:07:11.987 01:08:20 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:07:11.987 01:08:20 -- accel/accel.sh@12 -- # build_accel_config 00:07:11.987 01:08:20 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:11.987 01:08:20 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:11.987 01:08:20 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:11.987 01:08:20 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:11.987 01:08:20 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:11.987 01:08:20 -- accel/accel.sh@41 -- # local IFS=, 00:07:11.987 01:08:20 -- accel/accel.sh@42 -- # jq -r . 00:07:11.987 [2024-11-20 01:08:20.058638] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:11.987 [2024-11-20 01:08:20.058723] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1029349 ] 00:07:11.987 EAL: No free 2048 kB hugepages reported on node 1 00:07:11.987 [2024-11-20 01:08:20.123177] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:12.246 [2024-11-20 01:08:20.217350] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:12.246 01:08:20 -- accel/accel.sh@21 -- # val= 00:07:12.246 01:08:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.246 01:08:20 -- accel/accel.sh@20 -- # IFS=: 00:07:12.246 01:08:20 -- accel/accel.sh@20 -- # read -r var val 00:07:12.246 01:08:20 -- accel/accel.sh@21 -- # val= 00:07:12.246 01:08:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.246 01:08:20 -- accel/accel.sh@20 -- # IFS=: 00:07:12.246 01:08:20 -- accel/accel.sh@20 -- # read -r var val 00:07:12.246 01:08:20 -- accel/accel.sh@21 -- # val=0x1 00:07:12.246 01:08:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.246 01:08:20 -- accel/accel.sh@20 -- # IFS=: 00:07:12.246 01:08:20 -- accel/accel.sh@20 -- # read -r var val 00:07:12.246 01:08:20 -- accel/accel.sh@21 -- # val= 00:07:12.246 01:08:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.246 01:08:20 -- accel/accel.sh@20 -- # IFS=: 00:07:12.246 01:08:20 -- accel/accel.sh@20 -- # read -r var val 00:07:12.246 01:08:20 -- accel/accel.sh@21 -- # val= 00:07:12.246 01:08:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.246 01:08:20 -- accel/accel.sh@20 -- # IFS=: 00:07:12.246 01:08:20 -- accel/accel.sh@20 -- # read -r var val 00:07:12.246 01:08:20 -- accel/accel.sh@21 -- # val=dif_generate_copy 00:07:12.246 01:08:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.246 01:08:20 -- accel/accel.sh@24 -- # accel_opc=dif_generate_copy 00:07:12.246 01:08:20 -- accel/accel.sh@20 -- # IFS=: 00:07:12.246 01:08:20 -- accel/accel.sh@20 -- # read -r var val 00:07:12.246 01:08:20 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:12.246 01:08:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.246 01:08:20 -- accel/accel.sh@20 -- # IFS=: 00:07:12.246 01:08:20 -- accel/accel.sh@20 -- # read -r var val 00:07:12.246 01:08:20 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:12.246 01:08:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.246 01:08:20 -- accel/accel.sh@20 -- # IFS=: 00:07:12.246 01:08:20 -- accel/accel.sh@20 -- # read -r var val 00:07:12.246 01:08:20 -- accel/accel.sh@21 -- # val= 00:07:12.246 01:08:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.246 01:08:20 -- accel/accel.sh@20 -- # IFS=: 00:07:12.246 01:08:20 -- accel/accel.sh@20 -- # read -r var val 00:07:12.246 01:08:20 -- accel/accel.sh@21 -- # val=software 00:07:12.246 01:08:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.246 01:08:20 -- accel/accel.sh@23 -- # accel_module=software 00:07:12.246 01:08:20 -- accel/accel.sh@20 -- # IFS=: 00:07:12.246 01:08:20 -- accel/accel.sh@20 -- # read -r var val 00:07:12.246 01:08:20 -- accel/accel.sh@21 -- # val=32 00:07:12.246 01:08:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.246 01:08:20 -- accel/accel.sh@20 -- # IFS=: 00:07:12.246 01:08:20 -- accel/accel.sh@20 -- # read -r var val 00:07:12.246 01:08:20 -- accel/accel.sh@21 -- # val=32 00:07:12.246 01:08:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.246 01:08:20 -- accel/accel.sh@20 -- # IFS=: 00:07:12.246 01:08:20 -- accel/accel.sh@20 -- # read -r var val 00:07:12.246 01:08:20 -- accel/accel.sh@21 -- # val=1 00:07:12.246 01:08:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.246 01:08:20 -- accel/accel.sh@20 -- # IFS=: 00:07:12.246 01:08:20 -- accel/accel.sh@20 -- # read -r var val 00:07:12.246 01:08:20 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:12.246 01:08:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.246 01:08:20 -- accel/accel.sh@20 -- # IFS=: 00:07:12.246 01:08:20 -- accel/accel.sh@20 -- # read -r var val 00:07:12.246 01:08:20 -- accel/accel.sh@21 -- # val=No 00:07:12.246 01:08:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.246 01:08:20 -- accel/accel.sh@20 -- # IFS=: 00:07:12.246 01:08:20 -- accel/accel.sh@20 -- # read -r var val 00:07:12.246 01:08:20 -- accel/accel.sh@21 -- # val= 00:07:12.246 01:08:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.246 01:08:20 -- accel/accel.sh@20 -- # IFS=: 00:07:12.246 01:08:20 -- accel/accel.sh@20 -- # read -r var val 00:07:12.246 01:08:20 -- accel/accel.sh@21 -- # val= 00:07:12.246 01:08:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.246 01:08:20 -- accel/accel.sh@20 -- # IFS=: 00:07:12.246 01:08:20 -- accel/accel.sh@20 -- # read -r var val 00:07:13.620 01:08:21 -- accel/accel.sh@21 -- # val= 00:07:13.620 01:08:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.620 01:08:21 -- accel/accel.sh@20 -- # IFS=: 00:07:13.620 01:08:21 -- accel/accel.sh@20 -- # read -r var val 00:07:13.620 01:08:21 -- accel/accel.sh@21 -- # val= 00:07:13.620 01:08:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.620 01:08:21 -- accel/accel.sh@20 -- # IFS=: 00:07:13.620 01:08:21 -- accel/accel.sh@20 -- # read -r var val 00:07:13.620 01:08:21 -- accel/accel.sh@21 -- # val= 00:07:13.620 01:08:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.620 01:08:21 -- accel/accel.sh@20 -- # IFS=: 00:07:13.620 01:08:21 -- accel/accel.sh@20 -- # read -r var val 00:07:13.620 01:08:21 -- accel/accel.sh@21 -- # val= 00:07:13.620 01:08:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.620 01:08:21 -- accel/accel.sh@20 -- # IFS=: 00:07:13.620 01:08:21 -- accel/accel.sh@20 -- # read -r var val 00:07:13.620 01:08:21 -- accel/accel.sh@21 -- # val= 00:07:13.620 01:08:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.620 01:08:21 -- accel/accel.sh@20 -- # IFS=: 00:07:13.620 01:08:21 -- accel/accel.sh@20 -- # read -r var val 00:07:13.620 01:08:21 -- accel/accel.sh@21 -- # val= 00:07:13.620 01:08:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.620 01:08:21 -- accel/accel.sh@20 -- # IFS=: 00:07:13.620 01:08:21 -- accel/accel.sh@20 -- # read -r var val 00:07:13.620 01:08:21 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:13.620 01:08:21 -- accel/accel.sh@28 -- # [[ -n dif_generate_copy ]] 00:07:13.620 01:08:21 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:13.620 00:07:13.620 real 0m2.823s 00:07:13.620 user 0m2.517s 00:07:13.620 sys 0m0.297s 00:07:13.620 01:08:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:13.620 01:08:21 -- common/autotest_common.sh@10 -- # set +x 00:07:13.620 ************************************ 00:07:13.620 END TEST accel_dif_generate_copy 00:07:13.620 ************************************ 00:07:13.620 01:08:21 -- accel/accel.sh@107 -- # [[ y == y ]] 00:07:13.620 01:08:21 -- accel/accel.sh@108 -- # run_test accel_comp accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:13.620 01:08:21 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:07:13.620 01:08:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:13.620 01:08:21 -- common/autotest_common.sh@10 -- # set +x 00:07:13.620 ************************************ 00:07:13.620 START TEST accel_comp 00:07:13.620 ************************************ 00:07:13.620 01:08:21 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:13.620 01:08:21 -- accel/accel.sh@16 -- # local accel_opc 00:07:13.620 01:08:21 -- accel/accel.sh@17 -- # local accel_module 00:07:13.620 01:08:21 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:13.620 01:08:21 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:13.620 01:08:21 -- accel/accel.sh@12 -- # build_accel_config 00:07:13.620 01:08:21 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:13.620 01:08:21 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:13.620 01:08:21 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:13.620 01:08:21 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:13.620 01:08:21 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:13.620 01:08:21 -- accel/accel.sh@41 -- # local IFS=, 00:07:13.620 01:08:21 -- accel/accel.sh@42 -- # jq -r . 00:07:13.620 [2024-11-20 01:08:21.488118] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:13.620 [2024-11-20 01:08:21.488204] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1029516 ] 00:07:13.620 EAL: No free 2048 kB hugepages reported on node 1 00:07:13.620 [2024-11-20 01:08:21.549407] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:13.620 [2024-11-20 01:08:21.643211] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:14.995 01:08:22 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:14.995 00:07:14.995 SPDK Configuration: 00:07:14.995 Core mask: 0x1 00:07:14.995 00:07:14.995 Accel Perf Configuration: 00:07:14.995 Workload Type: compress 00:07:14.995 Transfer size: 4096 bytes 00:07:14.995 Vector count 1 00:07:14.995 Module: software 00:07:14.995 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:14.995 Queue depth: 32 00:07:14.995 Allocate depth: 32 00:07:14.995 # threads/core: 1 00:07:14.995 Run time: 1 seconds 00:07:14.995 Verify: No 00:07:14.995 00:07:14.995 Running for 1 seconds... 00:07:14.995 00:07:14.995 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:14.995 ------------------------------------------------------------------------------------ 00:07:14.995 0,0 31520/s 131 MiB/s 0 0 00:07:14.995 ==================================================================================== 00:07:14.995 Total 31520/s 123 MiB/s 0 0' 00:07:14.995 01:08:22 -- accel/accel.sh@20 -- # IFS=: 00:07:14.995 01:08:22 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:14.995 01:08:22 -- accel/accel.sh@20 -- # read -r var val 00:07:14.995 01:08:22 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:14.995 01:08:22 -- accel/accel.sh@12 -- # build_accel_config 00:07:14.995 01:08:22 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:14.995 01:08:22 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:14.995 01:08:22 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:14.995 01:08:22 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:14.995 01:08:22 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:14.995 01:08:22 -- accel/accel.sh@41 -- # local IFS=, 00:07:14.995 01:08:22 -- accel/accel.sh@42 -- # jq -r . 00:07:14.995 [2024-11-20 01:08:22.903204] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:14.995 [2024-11-20 01:08:22.903295] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1029656 ] 00:07:14.995 EAL: No free 2048 kB hugepages reported on node 1 00:07:14.995 [2024-11-20 01:08:22.965023] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:14.995 [2024-11-20 01:08:23.059305] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:14.995 01:08:23 -- accel/accel.sh@21 -- # val= 00:07:14.995 01:08:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.995 01:08:23 -- accel/accel.sh@20 -- # IFS=: 00:07:14.995 01:08:23 -- accel/accel.sh@20 -- # read -r var val 00:07:14.995 01:08:23 -- accel/accel.sh@21 -- # val= 00:07:14.995 01:08:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.995 01:08:23 -- accel/accel.sh@20 -- # IFS=: 00:07:14.995 01:08:23 -- accel/accel.sh@20 -- # read -r var val 00:07:14.995 01:08:23 -- accel/accel.sh@21 -- # val= 00:07:14.995 01:08:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.995 01:08:23 -- accel/accel.sh@20 -- # IFS=: 00:07:14.995 01:08:23 -- accel/accel.sh@20 -- # read -r var val 00:07:14.995 01:08:23 -- accel/accel.sh@21 -- # val=0x1 00:07:14.995 01:08:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.995 01:08:23 -- accel/accel.sh@20 -- # IFS=: 00:07:14.995 01:08:23 -- accel/accel.sh@20 -- # read -r var val 00:07:14.995 01:08:23 -- accel/accel.sh@21 -- # val= 00:07:14.995 01:08:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.995 01:08:23 -- accel/accel.sh@20 -- # IFS=: 00:07:14.995 01:08:23 -- accel/accel.sh@20 -- # read -r var val 00:07:14.995 01:08:23 -- accel/accel.sh@21 -- # val= 00:07:14.995 01:08:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.995 01:08:23 -- accel/accel.sh@20 -- # IFS=: 00:07:14.995 01:08:23 -- accel/accel.sh@20 -- # read -r var val 00:07:14.995 01:08:23 -- accel/accel.sh@21 -- # val=compress 00:07:14.995 01:08:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.995 01:08:23 -- accel/accel.sh@24 -- # accel_opc=compress 00:07:14.995 01:08:23 -- accel/accel.sh@20 -- # IFS=: 00:07:14.995 01:08:23 -- accel/accel.sh@20 -- # read -r var val 00:07:14.995 01:08:23 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:14.995 01:08:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.995 01:08:23 -- accel/accel.sh@20 -- # IFS=: 00:07:14.995 01:08:23 -- accel/accel.sh@20 -- # read -r var val 00:07:14.995 01:08:23 -- accel/accel.sh@21 -- # val= 00:07:14.995 01:08:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.995 01:08:23 -- accel/accel.sh@20 -- # IFS=: 00:07:14.995 01:08:23 -- accel/accel.sh@20 -- # read -r var val 00:07:14.995 01:08:23 -- accel/accel.sh@21 -- # val=software 00:07:14.995 01:08:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.995 01:08:23 -- accel/accel.sh@23 -- # accel_module=software 00:07:14.995 01:08:23 -- accel/accel.sh@20 -- # IFS=: 00:07:14.995 01:08:23 -- accel/accel.sh@20 -- # read -r var val 00:07:14.995 01:08:23 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:14.995 01:08:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.995 01:08:23 -- accel/accel.sh@20 -- # IFS=: 00:07:14.995 01:08:23 -- accel/accel.sh@20 -- # read -r var val 00:07:14.995 01:08:23 -- accel/accel.sh@21 -- # val=32 00:07:14.995 01:08:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.995 01:08:23 -- accel/accel.sh@20 -- # IFS=: 00:07:14.995 01:08:23 -- accel/accel.sh@20 -- # read -r var val 00:07:14.995 01:08:23 -- accel/accel.sh@21 -- # val=32 00:07:14.995 01:08:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.995 01:08:23 -- accel/accel.sh@20 -- # IFS=: 00:07:14.995 01:08:23 -- accel/accel.sh@20 -- # read -r var val 00:07:14.995 01:08:23 -- accel/accel.sh@21 -- # val=1 00:07:14.995 01:08:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.995 01:08:23 -- accel/accel.sh@20 -- # IFS=: 00:07:14.995 01:08:23 -- accel/accel.sh@20 -- # read -r var val 00:07:14.995 01:08:23 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:14.995 01:08:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.995 01:08:23 -- accel/accel.sh@20 -- # IFS=: 00:07:14.995 01:08:23 -- accel/accel.sh@20 -- # read -r var val 00:07:14.995 01:08:23 -- accel/accel.sh@21 -- # val=No 00:07:14.995 01:08:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.995 01:08:23 -- accel/accel.sh@20 -- # IFS=: 00:07:14.995 01:08:23 -- accel/accel.sh@20 -- # read -r var val 00:07:14.995 01:08:23 -- accel/accel.sh@21 -- # val= 00:07:14.995 01:08:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.995 01:08:23 -- accel/accel.sh@20 -- # IFS=: 00:07:14.995 01:08:23 -- accel/accel.sh@20 -- # read -r var val 00:07:14.995 01:08:23 -- accel/accel.sh@21 -- # val= 00:07:14.995 01:08:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.995 01:08:23 -- accel/accel.sh@20 -- # IFS=: 00:07:14.995 01:08:23 -- accel/accel.sh@20 -- # read -r var val 00:07:16.369 01:08:24 -- accel/accel.sh@21 -- # val= 00:07:16.369 01:08:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.369 01:08:24 -- accel/accel.sh@20 -- # IFS=: 00:07:16.369 01:08:24 -- accel/accel.sh@20 -- # read -r var val 00:07:16.369 01:08:24 -- accel/accel.sh@21 -- # val= 00:07:16.369 01:08:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.369 01:08:24 -- accel/accel.sh@20 -- # IFS=: 00:07:16.369 01:08:24 -- accel/accel.sh@20 -- # read -r var val 00:07:16.369 01:08:24 -- accel/accel.sh@21 -- # val= 00:07:16.369 01:08:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.369 01:08:24 -- accel/accel.sh@20 -- # IFS=: 00:07:16.369 01:08:24 -- accel/accel.sh@20 -- # read -r var val 00:07:16.369 01:08:24 -- accel/accel.sh@21 -- # val= 00:07:16.369 01:08:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.369 01:08:24 -- accel/accel.sh@20 -- # IFS=: 00:07:16.369 01:08:24 -- accel/accel.sh@20 -- # read -r var val 00:07:16.369 01:08:24 -- accel/accel.sh@21 -- # val= 00:07:16.369 01:08:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.369 01:08:24 -- accel/accel.sh@20 -- # IFS=: 00:07:16.369 01:08:24 -- accel/accel.sh@20 -- # read -r var val 00:07:16.369 01:08:24 -- accel/accel.sh@21 -- # val= 00:07:16.369 01:08:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.369 01:08:24 -- accel/accel.sh@20 -- # IFS=: 00:07:16.369 01:08:24 -- accel/accel.sh@20 -- # read -r var val 00:07:16.369 01:08:24 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:16.369 01:08:24 -- accel/accel.sh@28 -- # [[ -n compress ]] 00:07:16.369 01:08:24 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:16.369 00:07:16.369 real 0m2.828s 00:07:16.369 user 0m2.529s 00:07:16.369 sys 0m0.291s 00:07:16.369 01:08:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:16.369 01:08:24 -- common/autotest_common.sh@10 -- # set +x 00:07:16.369 ************************************ 00:07:16.369 END TEST accel_comp 00:07:16.369 ************************************ 00:07:16.369 01:08:24 -- accel/accel.sh@109 -- # run_test accel_decomp accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:16.369 01:08:24 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:16.369 01:08:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:16.369 01:08:24 -- common/autotest_common.sh@10 -- # set +x 00:07:16.369 ************************************ 00:07:16.369 START TEST accel_decomp 00:07:16.369 ************************************ 00:07:16.369 01:08:24 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:16.369 01:08:24 -- accel/accel.sh@16 -- # local accel_opc 00:07:16.369 01:08:24 -- accel/accel.sh@17 -- # local accel_module 00:07:16.369 01:08:24 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:16.369 01:08:24 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:16.369 01:08:24 -- accel/accel.sh@12 -- # build_accel_config 00:07:16.369 01:08:24 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:16.369 01:08:24 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:16.369 01:08:24 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:16.369 01:08:24 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:16.369 01:08:24 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:16.369 01:08:24 -- accel/accel.sh@41 -- # local IFS=, 00:07:16.369 01:08:24 -- accel/accel.sh@42 -- # jq -r . 00:07:16.369 [2024-11-20 01:08:24.339774] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:16.369 [2024-11-20 01:08:24.339864] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1029934 ] 00:07:16.369 EAL: No free 2048 kB hugepages reported on node 1 00:07:16.369 [2024-11-20 01:08:24.404764] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:16.369 [2024-11-20 01:08:24.499778] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:17.743 01:08:25 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:17.743 00:07:17.743 SPDK Configuration: 00:07:17.743 Core mask: 0x1 00:07:17.743 00:07:17.743 Accel Perf Configuration: 00:07:17.743 Workload Type: decompress 00:07:17.743 Transfer size: 4096 bytes 00:07:17.743 Vector count 1 00:07:17.743 Module: software 00:07:17.743 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:17.743 Queue depth: 32 00:07:17.743 Allocate depth: 32 00:07:17.743 # threads/core: 1 00:07:17.743 Run time: 1 seconds 00:07:17.743 Verify: Yes 00:07:17.743 00:07:17.743 Running for 1 seconds... 00:07:17.743 00:07:17.743 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:17.743 ------------------------------------------------------------------------------------ 00:07:17.743 0,0 55232/s 101 MiB/s 0 0 00:07:17.743 ==================================================================================== 00:07:17.743 Total 55232/s 215 MiB/s 0 0' 00:07:17.743 01:08:25 -- accel/accel.sh@20 -- # IFS=: 00:07:17.743 01:08:25 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:17.743 01:08:25 -- accel/accel.sh@20 -- # read -r var val 00:07:17.743 01:08:25 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:17.743 01:08:25 -- accel/accel.sh@12 -- # build_accel_config 00:07:17.743 01:08:25 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:17.743 01:08:25 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:17.743 01:08:25 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:17.743 01:08:25 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:17.743 01:08:25 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:17.743 01:08:25 -- accel/accel.sh@41 -- # local IFS=, 00:07:17.743 01:08:25 -- accel/accel.sh@42 -- # jq -r . 00:07:17.743 [2024-11-20 01:08:25.759975] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:17.743 [2024-11-20 01:08:25.760067] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1030074 ] 00:07:17.743 EAL: No free 2048 kB hugepages reported on node 1 00:07:17.743 [2024-11-20 01:08:25.819989] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:17.743 [2024-11-20 01:08:25.916604] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:18.001 01:08:25 -- accel/accel.sh@21 -- # val= 00:07:18.001 01:08:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.001 01:08:25 -- accel/accel.sh@20 -- # IFS=: 00:07:18.001 01:08:25 -- accel/accel.sh@20 -- # read -r var val 00:07:18.001 01:08:25 -- accel/accel.sh@21 -- # val= 00:07:18.001 01:08:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.001 01:08:25 -- accel/accel.sh@20 -- # IFS=: 00:07:18.001 01:08:25 -- accel/accel.sh@20 -- # read -r var val 00:07:18.001 01:08:25 -- accel/accel.sh@21 -- # val= 00:07:18.001 01:08:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.001 01:08:25 -- accel/accel.sh@20 -- # IFS=: 00:07:18.001 01:08:25 -- accel/accel.sh@20 -- # read -r var val 00:07:18.001 01:08:25 -- accel/accel.sh@21 -- # val=0x1 00:07:18.001 01:08:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.001 01:08:25 -- accel/accel.sh@20 -- # IFS=: 00:07:18.001 01:08:25 -- accel/accel.sh@20 -- # read -r var val 00:07:18.001 01:08:25 -- accel/accel.sh@21 -- # val= 00:07:18.001 01:08:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.001 01:08:25 -- accel/accel.sh@20 -- # IFS=: 00:07:18.001 01:08:25 -- accel/accel.sh@20 -- # read -r var val 00:07:18.001 01:08:25 -- accel/accel.sh@21 -- # val= 00:07:18.001 01:08:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.001 01:08:25 -- accel/accel.sh@20 -- # IFS=: 00:07:18.001 01:08:25 -- accel/accel.sh@20 -- # read -r var val 00:07:18.001 01:08:25 -- accel/accel.sh@21 -- # val=decompress 00:07:18.001 01:08:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.001 01:08:25 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:18.001 01:08:25 -- accel/accel.sh@20 -- # IFS=: 00:07:18.001 01:08:25 -- accel/accel.sh@20 -- # read -r var val 00:07:18.001 01:08:25 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:18.001 01:08:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.001 01:08:25 -- accel/accel.sh@20 -- # IFS=: 00:07:18.001 01:08:25 -- accel/accel.sh@20 -- # read -r var val 00:07:18.001 01:08:25 -- accel/accel.sh@21 -- # val= 00:07:18.001 01:08:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.001 01:08:25 -- accel/accel.sh@20 -- # IFS=: 00:07:18.001 01:08:25 -- accel/accel.sh@20 -- # read -r var val 00:07:18.001 01:08:25 -- accel/accel.sh@21 -- # val=software 00:07:18.001 01:08:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.001 01:08:25 -- accel/accel.sh@23 -- # accel_module=software 00:07:18.001 01:08:25 -- accel/accel.sh@20 -- # IFS=: 00:07:18.001 01:08:25 -- accel/accel.sh@20 -- # read -r var val 00:07:18.001 01:08:25 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:18.001 01:08:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.001 01:08:25 -- accel/accel.sh@20 -- # IFS=: 00:07:18.001 01:08:25 -- accel/accel.sh@20 -- # read -r var val 00:07:18.001 01:08:25 -- accel/accel.sh@21 -- # val=32 00:07:18.001 01:08:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.001 01:08:25 -- accel/accel.sh@20 -- # IFS=: 00:07:18.001 01:08:25 -- accel/accel.sh@20 -- # read -r var val 00:07:18.001 01:08:25 -- accel/accel.sh@21 -- # val=32 00:07:18.001 01:08:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.001 01:08:25 -- accel/accel.sh@20 -- # IFS=: 00:07:18.001 01:08:25 -- accel/accel.sh@20 -- # read -r var val 00:07:18.001 01:08:25 -- accel/accel.sh@21 -- # val=1 00:07:18.001 01:08:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.001 01:08:25 -- accel/accel.sh@20 -- # IFS=: 00:07:18.001 01:08:25 -- accel/accel.sh@20 -- # read -r var val 00:07:18.001 01:08:25 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:18.001 01:08:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.001 01:08:25 -- accel/accel.sh@20 -- # IFS=: 00:07:18.001 01:08:25 -- accel/accel.sh@20 -- # read -r var val 00:07:18.001 01:08:25 -- accel/accel.sh@21 -- # val=Yes 00:07:18.001 01:08:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.001 01:08:25 -- accel/accel.sh@20 -- # IFS=: 00:07:18.001 01:08:25 -- accel/accel.sh@20 -- # read -r var val 00:07:18.001 01:08:25 -- accel/accel.sh@21 -- # val= 00:07:18.001 01:08:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.001 01:08:25 -- accel/accel.sh@20 -- # IFS=: 00:07:18.001 01:08:25 -- accel/accel.sh@20 -- # read -r var val 00:07:18.001 01:08:25 -- accel/accel.sh@21 -- # val= 00:07:18.001 01:08:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.001 01:08:25 -- accel/accel.sh@20 -- # IFS=: 00:07:18.001 01:08:25 -- accel/accel.sh@20 -- # read -r var val 00:07:19.005 01:08:27 -- accel/accel.sh@21 -- # val= 00:07:19.005 01:08:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.005 01:08:27 -- accel/accel.sh@20 -- # IFS=: 00:07:19.005 01:08:27 -- accel/accel.sh@20 -- # read -r var val 00:07:19.005 01:08:27 -- accel/accel.sh@21 -- # val= 00:07:19.005 01:08:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.005 01:08:27 -- accel/accel.sh@20 -- # IFS=: 00:07:19.005 01:08:27 -- accel/accel.sh@20 -- # read -r var val 00:07:19.005 01:08:27 -- accel/accel.sh@21 -- # val= 00:07:19.005 01:08:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.005 01:08:27 -- accel/accel.sh@20 -- # IFS=: 00:07:19.005 01:08:27 -- accel/accel.sh@20 -- # read -r var val 00:07:19.005 01:08:27 -- accel/accel.sh@21 -- # val= 00:07:19.005 01:08:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.005 01:08:27 -- accel/accel.sh@20 -- # IFS=: 00:07:19.005 01:08:27 -- accel/accel.sh@20 -- # read -r var val 00:07:19.005 01:08:27 -- accel/accel.sh@21 -- # val= 00:07:19.005 01:08:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.005 01:08:27 -- accel/accel.sh@20 -- # IFS=: 00:07:19.005 01:08:27 -- accel/accel.sh@20 -- # read -r var val 00:07:19.005 01:08:27 -- accel/accel.sh@21 -- # val= 00:07:19.005 01:08:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.005 01:08:27 -- accel/accel.sh@20 -- # IFS=: 00:07:19.005 01:08:27 -- accel/accel.sh@20 -- # read -r var val 00:07:19.005 01:08:27 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:19.005 01:08:27 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:19.005 01:08:27 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:19.005 00:07:19.005 real 0m2.824s 00:07:19.005 user 0m2.515s 00:07:19.005 sys 0m0.301s 00:07:19.005 01:08:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:19.005 01:08:27 -- common/autotest_common.sh@10 -- # set +x 00:07:19.005 ************************************ 00:07:19.005 END TEST accel_decomp 00:07:19.005 ************************************ 00:07:19.005 01:08:27 -- accel/accel.sh@110 -- # run_test accel_decmop_full accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:19.005 01:08:27 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:07:19.005 01:08:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:19.005 01:08:27 -- common/autotest_common.sh@10 -- # set +x 00:07:19.005 ************************************ 00:07:19.005 START TEST accel_decmop_full 00:07:19.005 ************************************ 00:07:19.005 01:08:27 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:19.005 01:08:27 -- accel/accel.sh@16 -- # local accel_opc 00:07:19.005 01:08:27 -- accel/accel.sh@17 -- # local accel_module 00:07:19.005 01:08:27 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:19.005 01:08:27 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:19.005 01:08:27 -- accel/accel.sh@12 -- # build_accel_config 00:07:19.005 01:08:27 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:19.005 01:08:27 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:19.005 01:08:27 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:19.005 01:08:27 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:19.005 01:08:27 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:19.005 01:08:27 -- accel/accel.sh@41 -- # local IFS=, 00:07:19.005 01:08:27 -- accel/accel.sh@42 -- # jq -r . 00:07:19.005 [2024-11-20 01:08:27.188603] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:19.005 [2024-11-20 01:08:27.188692] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1030239 ] 00:07:19.005 EAL: No free 2048 kB hugepages reported on node 1 00:07:19.264 [2024-11-20 01:08:27.254672] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:19.264 [2024-11-20 01:08:27.348818] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:20.636 01:08:28 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:20.636 00:07:20.636 SPDK Configuration: 00:07:20.636 Core mask: 0x1 00:07:20.636 00:07:20.636 Accel Perf Configuration: 00:07:20.636 Workload Type: decompress 00:07:20.636 Transfer size: 111250 bytes 00:07:20.636 Vector count 1 00:07:20.636 Module: software 00:07:20.636 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:20.636 Queue depth: 32 00:07:20.636 Allocate depth: 32 00:07:20.636 # threads/core: 1 00:07:20.636 Run time: 1 seconds 00:07:20.636 Verify: Yes 00:07:20.636 00:07:20.636 Running for 1 seconds... 00:07:20.636 00:07:20.636 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:20.636 ------------------------------------------------------------------------------------ 00:07:20.636 0,0 3808/s 157 MiB/s 0 0 00:07:20.636 ==================================================================================== 00:07:20.636 Total 3808/s 404 MiB/s 0 0' 00:07:20.636 01:08:28 -- accel/accel.sh@20 -- # IFS=: 00:07:20.636 01:08:28 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:20.636 01:08:28 -- accel/accel.sh@20 -- # read -r var val 00:07:20.636 01:08:28 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:20.636 01:08:28 -- accel/accel.sh@12 -- # build_accel_config 00:07:20.637 01:08:28 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:20.637 01:08:28 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:20.637 01:08:28 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:20.637 01:08:28 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:20.637 01:08:28 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:20.637 01:08:28 -- accel/accel.sh@41 -- # local IFS=, 00:07:20.637 01:08:28 -- accel/accel.sh@42 -- # jq -r . 00:07:20.637 [2024-11-20 01:08:28.622301] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:20.637 [2024-11-20 01:08:28.622386] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1030393 ] 00:07:20.637 EAL: No free 2048 kB hugepages reported on node 1 00:07:20.637 [2024-11-20 01:08:28.683801] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:20.637 [2024-11-20 01:08:28.776548] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:20.637 01:08:28 -- accel/accel.sh@21 -- # val= 00:07:20.637 01:08:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.637 01:08:28 -- accel/accel.sh@20 -- # IFS=: 00:07:20.637 01:08:28 -- accel/accel.sh@20 -- # read -r var val 00:07:20.637 01:08:28 -- accel/accel.sh@21 -- # val= 00:07:20.637 01:08:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.637 01:08:28 -- accel/accel.sh@20 -- # IFS=: 00:07:20.637 01:08:28 -- accel/accel.sh@20 -- # read -r var val 00:07:20.637 01:08:28 -- accel/accel.sh@21 -- # val= 00:07:20.637 01:08:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.637 01:08:28 -- accel/accel.sh@20 -- # IFS=: 00:07:20.637 01:08:28 -- accel/accel.sh@20 -- # read -r var val 00:07:20.637 01:08:28 -- accel/accel.sh@21 -- # val=0x1 00:07:20.637 01:08:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.637 01:08:28 -- accel/accel.sh@20 -- # IFS=: 00:07:20.637 01:08:28 -- accel/accel.sh@20 -- # read -r var val 00:07:20.637 01:08:28 -- accel/accel.sh@21 -- # val= 00:07:20.637 01:08:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.637 01:08:28 -- accel/accel.sh@20 -- # IFS=: 00:07:20.637 01:08:28 -- accel/accel.sh@20 -- # read -r var val 00:07:20.637 01:08:28 -- accel/accel.sh@21 -- # val= 00:07:20.637 01:08:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.637 01:08:28 -- accel/accel.sh@20 -- # IFS=: 00:07:20.637 01:08:28 -- accel/accel.sh@20 -- # read -r var val 00:07:20.637 01:08:28 -- accel/accel.sh@21 -- # val=decompress 00:07:20.637 01:08:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.637 01:08:28 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:20.637 01:08:28 -- accel/accel.sh@20 -- # IFS=: 00:07:20.637 01:08:28 -- accel/accel.sh@20 -- # read -r var val 00:07:20.637 01:08:28 -- accel/accel.sh@21 -- # val='111250 bytes' 00:07:20.637 01:08:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.637 01:08:28 -- accel/accel.sh@20 -- # IFS=: 00:07:20.637 01:08:28 -- accel/accel.sh@20 -- # read -r var val 00:07:20.637 01:08:28 -- accel/accel.sh@21 -- # val= 00:07:20.637 01:08:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.637 01:08:28 -- accel/accel.sh@20 -- # IFS=: 00:07:20.637 01:08:28 -- accel/accel.sh@20 -- # read -r var val 00:07:20.637 01:08:28 -- accel/accel.sh@21 -- # val=software 00:07:20.637 01:08:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.637 01:08:28 -- accel/accel.sh@23 -- # accel_module=software 00:07:20.637 01:08:28 -- accel/accel.sh@20 -- # IFS=: 00:07:20.637 01:08:28 -- accel/accel.sh@20 -- # read -r var val 00:07:20.637 01:08:28 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:20.637 01:08:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.637 01:08:28 -- accel/accel.sh@20 -- # IFS=: 00:07:20.637 01:08:28 -- accel/accel.sh@20 -- # read -r var val 00:07:20.637 01:08:28 -- accel/accel.sh@21 -- # val=32 00:07:20.637 01:08:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.637 01:08:28 -- accel/accel.sh@20 -- # IFS=: 00:07:20.637 01:08:28 -- accel/accel.sh@20 -- # read -r var val 00:07:20.637 01:08:28 -- accel/accel.sh@21 -- # val=32 00:07:20.637 01:08:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.637 01:08:28 -- accel/accel.sh@20 -- # IFS=: 00:07:20.637 01:08:28 -- accel/accel.sh@20 -- # read -r var val 00:07:20.637 01:08:28 -- accel/accel.sh@21 -- # val=1 00:07:20.637 01:08:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.637 01:08:28 -- accel/accel.sh@20 -- # IFS=: 00:07:20.637 01:08:28 -- accel/accel.sh@20 -- # read -r var val 00:07:20.637 01:08:28 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:20.637 01:08:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.637 01:08:28 -- accel/accel.sh@20 -- # IFS=: 00:07:20.637 01:08:28 -- accel/accel.sh@20 -- # read -r var val 00:07:20.637 01:08:28 -- accel/accel.sh@21 -- # val=Yes 00:07:20.637 01:08:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.637 01:08:28 -- accel/accel.sh@20 -- # IFS=: 00:07:20.637 01:08:28 -- accel/accel.sh@20 -- # read -r var val 00:07:20.637 01:08:28 -- accel/accel.sh@21 -- # val= 00:07:20.637 01:08:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.637 01:08:28 -- accel/accel.sh@20 -- # IFS=: 00:07:20.637 01:08:28 -- accel/accel.sh@20 -- # read -r var val 00:07:20.637 01:08:28 -- accel/accel.sh@21 -- # val= 00:07:20.637 01:08:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.637 01:08:28 -- accel/accel.sh@20 -- # IFS=: 00:07:20.637 01:08:28 -- accel/accel.sh@20 -- # read -r var val 00:07:22.010 01:08:30 -- accel/accel.sh@21 -- # val= 00:07:22.010 01:08:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.010 01:08:30 -- accel/accel.sh@20 -- # IFS=: 00:07:22.010 01:08:30 -- accel/accel.sh@20 -- # read -r var val 00:07:22.010 01:08:30 -- accel/accel.sh@21 -- # val= 00:07:22.010 01:08:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.010 01:08:30 -- accel/accel.sh@20 -- # IFS=: 00:07:22.010 01:08:30 -- accel/accel.sh@20 -- # read -r var val 00:07:22.010 01:08:30 -- accel/accel.sh@21 -- # val= 00:07:22.010 01:08:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.010 01:08:30 -- accel/accel.sh@20 -- # IFS=: 00:07:22.010 01:08:30 -- accel/accel.sh@20 -- # read -r var val 00:07:22.010 01:08:30 -- accel/accel.sh@21 -- # val= 00:07:22.010 01:08:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.010 01:08:30 -- accel/accel.sh@20 -- # IFS=: 00:07:22.010 01:08:30 -- accel/accel.sh@20 -- # read -r var val 00:07:22.010 01:08:30 -- accel/accel.sh@21 -- # val= 00:07:22.010 01:08:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.010 01:08:30 -- accel/accel.sh@20 -- # IFS=: 00:07:22.010 01:08:30 -- accel/accel.sh@20 -- # read -r var val 00:07:22.010 01:08:30 -- accel/accel.sh@21 -- # val= 00:07:22.010 01:08:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.010 01:08:30 -- accel/accel.sh@20 -- # IFS=: 00:07:22.010 01:08:30 -- accel/accel.sh@20 -- # read -r var val 00:07:22.010 01:08:30 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:22.010 01:08:30 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:22.010 01:08:30 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:22.010 00:07:22.010 real 0m2.862s 00:07:22.010 user 0m2.561s 00:07:22.010 sys 0m0.294s 00:07:22.010 01:08:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:22.010 01:08:30 -- common/autotest_common.sh@10 -- # set +x 00:07:22.010 ************************************ 00:07:22.010 END TEST accel_decmop_full 00:07:22.010 ************************************ 00:07:22.010 01:08:30 -- accel/accel.sh@111 -- # run_test accel_decomp_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:22.010 01:08:30 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:07:22.010 01:08:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:22.010 01:08:30 -- common/autotest_common.sh@10 -- # set +x 00:07:22.010 ************************************ 00:07:22.010 START TEST accel_decomp_mcore 00:07:22.010 ************************************ 00:07:22.010 01:08:30 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:22.010 01:08:30 -- accel/accel.sh@16 -- # local accel_opc 00:07:22.010 01:08:30 -- accel/accel.sh@17 -- # local accel_module 00:07:22.010 01:08:30 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:22.010 01:08:30 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:22.010 01:08:30 -- accel/accel.sh@12 -- # build_accel_config 00:07:22.010 01:08:30 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:22.010 01:08:30 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:22.010 01:08:30 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:22.010 01:08:30 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:22.010 01:08:30 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:22.010 01:08:30 -- accel/accel.sh@41 -- # local IFS=, 00:07:22.010 01:08:30 -- accel/accel.sh@42 -- # jq -r . 00:07:22.010 [2024-11-20 01:08:30.073163] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:22.010 [2024-11-20 01:08:30.073249] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1030659 ] 00:07:22.010 EAL: No free 2048 kB hugepages reported on node 1 00:07:22.010 [2024-11-20 01:08:30.139854] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:22.268 [2024-11-20 01:08:30.238042] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:22.268 [2024-11-20 01:08:30.238104] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:22.268 [2024-11-20 01:08:30.238134] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:22.268 [2024-11-20 01:08:30.238137] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:23.641 01:08:31 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:23.641 00:07:23.641 SPDK Configuration: 00:07:23.641 Core mask: 0xf 00:07:23.641 00:07:23.641 Accel Perf Configuration: 00:07:23.641 Workload Type: decompress 00:07:23.641 Transfer size: 4096 bytes 00:07:23.641 Vector count 1 00:07:23.641 Module: software 00:07:23.641 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:23.641 Queue depth: 32 00:07:23.641 Allocate depth: 32 00:07:23.641 # threads/core: 1 00:07:23.641 Run time: 1 seconds 00:07:23.641 Verify: Yes 00:07:23.641 00:07:23.641 Running for 1 seconds... 00:07:23.641 00:07:23.641 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:23.641 ------------------------------------------------------------------------------------ 00:07:23.641 0,0 50432/s 92 MiB/s 0 0 00:07:23.641 3,0 50784/s 93 MiB/s 0 0 00:07:23.641 2,0 50400/s 92 MiB/s 0 0 00:07:23.641 1,0 50656/s 93 MiB/s 0 0 00:07:23.641 ==================================================================================== 00:07:23.641 Total 202272/s 790 MiB/s 0 0' 00:07:23.641 01:08:31 -- accel/accel.sh@20 -- # IFS=: 00:07:23.641 01:08:31 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:23.641 01:08:31 -- accel/accel.sh@20 -- # read -r var val 00:07:23.641 01:08:31 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:23.641 01:08:31 -- accel/accel.sh@12 -- # build_accel_config 00:07:23.641 01:08:31 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:23.641 01:08:31 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:23.641 01:08:31 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:23.641 01:08:31 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:23.641 01:08:31 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:23.641 01:08:31 -- accel/accel.sh@41 -- # local IFS=, 00:07:23.641 01:08:31 -- accel/accel.sh@42 -- # jq -r . 00:07:23.641 [2024-11-20 01:08:31.504713] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:23.641 [2024-11-20 01:08:31.504801] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1030810 ] 00:07:23.641 EAL: No free 2048 kB hugepages reported on node 1 00:07:23.641 [2024-11-20 01:08:31.566852] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:23.641 [2024-11-20 01:08:31.663009] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:23.641 [2024-11-20 01:08:31.663083] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:23.641 [2024-11-20 01:08:31.663126] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:23.641 [2024-11-20 01:08:31.663130] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:23.641 01:08:31 -- accel/accel.sh@21 -- # val= 00:07:23.641 01:08:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.641 01:08:31 -- accel/accel.sh@20 -- # IFS=: 00:07:23.641 01:08:31 -- accel/accel.sh@20 -- # read -r var val 00:07:23.641 01:08:31 -- accel/accel.sh@21 -- # val= 00:07:23.641 01:08:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.641 01:08:31 -- accel/accel.sh@20 -- # IFS=: 00:07:23.641 01:08:31 -- accel/accel.sh@20 -- # read -r var val 00:07:23.641 01:08:31 -- accel/accel.sh@21 -- # val= 00:07:23.641 01:08:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.641 01:08:31 -- accel/accel.sh@20 -- # IFS=: 00:07:23.641 01:08:31 -- accel/accel.sh@20 -- # read -r var val 00:07:23.641 01:08:31 -- accel/accel.sh@21 -- # val=0xf 00:07:23.641 01:08:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.641 01:08:31 -- accel/accel.sh@20 -- # IFS=: 00:07:23.642 01:08:31 -- accel/accel.sh@20 -- # read -r var val 00:07:23.642 01:08:31 -- accel/accel.sh@21 -- # val= 00:07:23.642 01:08:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.642 01:08:31 -- accel/accel.sh@20 -- # IFS=: 00:07:23.642 01:08:31 -- accel/accel.sh@20 -- # read -r var val 00:07:23.642 01:08:31 -- accel/accel.sh@21 -- # val= 00:07:23.642 01:08:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.642 01:08:31 -- accel/accel.sh@20 -- # IFS=: 00:07:23.642 01:08:31 -- accel/accel.sh@20 -- # read -r var val 00:07:23.642 01:08:31 -- accel/accel.sh@21 -- # val=decompress 00:07:23.642 01:08:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.642 01:08:31 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:23.642 01:08:31 -- accel/accel.sh@20 -- # IFS=: 00:07:23.642 01:08:31 -- accel/accel.sh@20 -- # read -r var val 00:07:23.642 01:08:31 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:23.642 01:08:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.642 01:08:31 -- accel/accel.sh@20 -- # IFS=: 00:07:23.642 01:08:31 -- accel/accel.sh@20 -- # read -r var val 00:07:23.642 01:08:31 -- accel/accel.sh@21 -- # val= 00:07:23.642 01:08:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.642 01:08:31 -- accel/accel.sh@20 -- # IFS=: 00:07:23.642 01:08:31 -- accel/accel.sh@20 -- # read -r var val 00:07:23.642 01:08:31 -- accel/accel.sh@21 -- # val=software 00:07:23.642 01:08:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.642 01:08:31 -- accel/accel.sh@23 -- # accel_module=software 00:07:23.642 01:08:31 -- accel/accel.sh@20 -- # IFS=: 00:07:23.642 01:08:31 -- accel/accel.sh@20 -- # read -r var val 00:07:23.642 01:08:31 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:23.642 01:08:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.642 01:08:31 -- accel/accel.sh@20 -- # IFS=: 00:07:23.642 01:08:31 -- accel/accel.sh@20 -- # read -r var val 00:07:23.642 01:08:31 -- accel/accel.sh@21 -- # val=32 00:07:23.642 01:08:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.642 01:08:31 -- accel/accel.sh@20 -- # IFS=: 00:07:23.642 01:08:31 -- accel/accel.sh@20 -- # read -r var val 00:07:23.642 01:08:31 -- accel/accel.sh@21 -- # val=32 00:07:23.642 01:08:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.642 01:08:31 -- accel/accel.sh@20 -- # IFS=: 00:07:23.642 01:08:31 -- accel/accel.sh@20 -- # read -r var val 00:07:23.642 01:08:31 -- accel/accel.sh@21 -- # val=1 00:07:23.642 01:08:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.642 01:08:31 -- accel/accel.sh@20 -- # IFS=: 00:07:23.642 01:08:31 -- accel/accel.sh@20 -- # read -r var val 00:07:23.642 01:08:31 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:23.642 01:08:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.642 01:08:31 -- accel/accel.sh@20 -- # IFS=: 00:07:23.642 01:08:31 -- accel/accel.sh@20 -- # read -r var val 00:07:23.642 01:08:31 -- accel/accel.sh@21 -- # val=Yes 00:07:23.642 01:08:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.642 01:08:31 -- accel/accel.sh@20 -- # IFS=: 00:07:23.642 01:08:31 -- accel/accel.sh@20 -- # read -r var val 00:07:23.642 01:08:31 -- accel/accel.sh@21 -- # val= 00:07:23.642 01:08:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.642 01:08:31 -- accel/accel.sh@20 -- # IFS=: 00:07:23.642 01:08:31 -- accel/accel.sh@20 -- # read -r var val 00:07:23.642 01:08:31 -- accel/accel.sh@21 -- # val= 00:07:23.642 01:08:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.642 01:08:31 -- accel/accel.sh@20 -- # IFS=: 00:07:23.642 01:08:31 -- accel/accel.sh@20 -- # read -r var val 00:07:25.016 01:08:32 -- accel/accel.sh@21 -- # val= 00:07:25.016 01:08:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.016 01:08:32 -- accel/accel.sh@20 -- # IFS=: 00:07:25.016 01:08:32 -- accel/accel.sh@20 -- # read -r var val 00:07:25.016 01:08:32 -- accel/accel.sh@21 -- # val= 00:07:25.016 01:08:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.016 01:08:32 -- accel/accel.sh@20 -- # IFS=: 00:07:25.016 01:08:32 -- accel/accel.sh@20 -- # read -r var val 00:07:25.016 01:08:32 -- accel/accel.sh@21 -- # val= 00:07:25.016 01:08:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.016 01:08:32 -- accel/accel.sh@20 -- # IFS=: 00:07:25.016 01:08:32 -- accel/accel.sh@20 -- # read -r var val 00:07:25.016 01:08:32 -- accel/accel.sh@21 -- # val= 00:07:25.016 01:08:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.016 01:08:32 -- accel/accel.sh@20 -- # IFS=: 00:07:25.016 01:08:32 -- accel/accel.sh@20 -- # read -r var val 00:07:25.016 01:08:32 -- accel/accel.sh@21 -- # val= 00:07:25.016 01:08:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.016 01:08:32 -- accel/accel.sh@20 -- # IFS=: 00:07:25.016 01:08:32 -- accel/accel.sh@20 -- # read -r var val 00:07:25.016 01:08:32 -- accel/accel.sh@21 -- # val= 00:07:25.016 01:08:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.016 01:08:32 -- accel/accel.sh@20 -- # IFS=: 00:07:25.016 01:08:32 -- accel/accel.sh@20 -- # read -r var val 00:07:25.016 01:08:32 -- accel/accel.sh@21 -- # val= 00:07:25.016 01:08:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.016 01:08:32 -- accel/accel.sh@20 -- # IFS=: 00:07:25.016 01:08:32 -- accel/accel.sh@20 -- # read -r var val 00:07:25.016 01:08:32 -- accel/accel.sh@21 -- # val= 00:07:25.016 01:08:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.016 01:08:32 -- accel/accel.sh@20 -- # IFS=: 00:07:25.016 01:08:32 -- accel/accel.sh@20 -- # read -r var val 00:07:25.016 01:08:32 -- accel/accel.sh@21 -- # val= 00:07:25.016 01:08:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.016 01:08:32 -- accel/accel.sh@20 -- # IFS=: 00:07:25.016 01:08:32 -- accel/accel.sh@20 -- # read -r var val 00:07:25.016 01:08:32 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:25.016 01:08:32 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:25.016 01:08:32 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:25.016 00:07:25.016 real 0m2.840s 00:07:25.016 user 0m9.451s 00:07:25.016 sys 0m0.296s 00:07:25.016 01:08:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:25.016 01:08:32 -- common/autotest_common.sh@10 -- # set +x 00:07:25.016 ************************************ 00:07:25.016 END TEST accel_decomp_mcore 00:07:25.016 ************************************ 00:07:25.016 01:08:32 -- accel/accel.sh@112 -- # run_test accel_decomp_full_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:25.016 01:08:32 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:07:25.016 01:08:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:25.016 01:08:32 -- common/autotest_common.sh@10 -- # set +x 00:07:25.016 ************************************ 00:07:25.016 START TEST accel_decomp_full_mcore 00:07:25.016 ************************************ 00:07:25.016 01:08:32 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:25.016 01:08:32 -- accel/accel.sh@16 -- # local accel_opc 00:07:25.016 01:08:32 -- accel/accel.sh@17 -- # local accel_module 00:07:25.016 01:08:32 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:25.016 01:08:32 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:25.016 01:08:32 -- accel/accel.sh@12 -- # build_accel_config 00:07:25.016 01:08:32 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:25.016 01:08:32 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:25.016 01:08:32 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:25.016 01:08:32 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:25.016 01:08:32 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:25.016 01:08:32 -- accel/accel.sh@41 -- # local IFS=, 00:07:25.016 01:08:32 -- accel/accel.sh@42 -- # jq -r . 00:07:25.016 [2024-11-20 01:08:32.940901] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:25.016 [2024-11-20 01:08:32.940990] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1030974 ] 00:07:25.016 EAL: No free 2048 kB hugepages reported on node 1 00:07:25.016 [2024-11-20 01:08:33.004859] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:25.016 [2024-11-20 01:08:33.102271] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:25.016 [2024-11-20 01:08:33.102327] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:25.016 [2024-11-20 01:08:33.102380] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:25.016 [2024-11-20 01:08:33.102383] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:26.390 01:08:34 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:26.390 00:07:26.390 SPDK Configuration: 00:07:26.390 Core mask: 0xf 00:07:26.390 00:07:26.390 Accel Perf Configuration: 00:07:26.390 Workload Type: decompress 00:07:26.390 Transfer size: 111250 bytes 00:07:26.390 Vector count 1 00:07:26.390 Module: software 00:07:26.390 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:26.390 Queue depth: 32 00:07:26.390 Allocate depth: 32 00:07:26.390 # threads/core: 1 00:07:26.390 Run time: 1 seconds 00:07:26.390 Verify: Yes 00:07:26.390 00:07:26.390 Running for 1 seconds... 00:07:26.390 00:07:26.390 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:26.390 ------------------------------------------------------------------------------------ 00:07:26.390 0,0 3776/s 155 MiB/s 0 0 00:07:26.390 3,0 3776/s 155 MiB/s 0 0 00:07:26.390 2,0 3776/s 155 MiB/s 0 0 00:07:26.390 1,0 3776/s 155 MiB/s 0 0 00:07:26.390 ==================================================================================== 00:07:26.390 Total 15104/s 1602 MiB/s 0 0' 00:07:26.390 01:08:34 -- accel/accel.sh@20 -- # IFS=: 00:07:26.390 01:08:34 -- accel/accel.sh@20 -- # read -r var val 00:07:26.390 01:08:34 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:26.390 01:08:34 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:26.390 01:08:34 -- accel/accel.sh@12 -- # build_accel_config 00:07:26.390 01:08:34 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:26.390 01:08:34 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:26.390 01:08:34 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:26.390 01:08:34 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:26.390 01:08:34 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:26.390 01:08:34 -- accel/accel.sh@41 -- # local IFS=, 00:07:26.390 01:08:34 -- accel/accel.sh@42 -- # jq -r . 00:07:26.390 [2024-11-20 01:08:34.374261] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:26.390 [2024-11-20 01:08:34.374349] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1031192 ] 00:07:26.390 EAL: No free 2048 kB hugepages reported on node 1 00:07:26.390 [2024-11-20 01:08:34.437337] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:26.390 [2024-11-20 01:08:34.533964] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:26.390 [2024-11-20 01:08:34.534081] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:26.390 [2024-11-20 01:08:34.534021] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:26.390 [2024-11-20 01:08:34.534133] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:26.390 01:08:34 -- accel/accel.sh@21 -- # val= 00:07:26.390 01:08:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.390 01:08:34 -- accel/accel.sh@20 -- # IFS=: 00:07:26.390 01:08:34 -- accel/accel.sh@20 -- # read -r var val 00:07:26.390 01:08:34 -- accel/accel.sh@21 -- # val= 00:07:26.390 01:08:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.390 01:08:34 -- accel/accel.sh@20 -- # IFS=: 00:07:26.390 01:08:34 -- accel/accel.sh@20 -- # read -r var val 00:07:26.390 01:08:34 -- accel/accel.sh@21 -- # val= 00:07:26.390 01:08:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.390 01:08:34 -- accel/accel.sh@20 -- # IFS=: 00:07:26.390 01:08:34 -- accel/accel.sh@20 -- # read -r var val 00:07:26.390 01:08:34 -- accel/accel.sh@21 -- # val=0xf 00:07:26.390 01:08:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.390 01:08:34 -- accel/accel.sh@20 -- # IFS=: 00:07:26.390 01:08:34 -- accel/accel.sh@20 -- # read -r var val 00:07:26.390 01:08:34 -- accel/accel.sh@21 -- # val= 00:07:26.390 01:08:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.390 01:08:34 -- accel/accel.sh@20 -- # IFS=: 00:07:26.390 01:08:34 -- accel/accel.sh@20 -- # read -r var val 00:07:26.390 01:08:34 -- accel/accel.sh@21 -- # val= 00:07:26.390 01:08:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.390 01:08:34 -- accel/accel.sh@20 -- # IFS=: 00:07:26.390 01:08:34 -- accel/accel.sh@20 -- # read -r var val 00:07:26.390 01:08:34 -- accel/accel.sh@21 -- # val=decompress 00:07:26.390 01:08:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.390 01:08:34 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:26.390 01:08:34 -- accel/accel.sh@20 -- # IFS=: 00:07:26.390 01:08:34 -- accel/accel.sh@20 -- # read -r var val 00:07:26.390 01:08:34 -- accel/accel.sh@21 -- # val='111250 bytes' 00:07:26.390 01:08:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.390 01:08:34 -- accel/accel.sh@20 -- # IFS=: 00:07:26.390 01:08:34 -- accel/accel.sh@20 -- # read -r var val 00:07:26.390 01:08:34 -- accel/accel.sh@21 -- # val= 00:07:26.390 01:08:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.390 01:08:34 -- accel/accel.sh@20 -- # IFS=: 00:07:26.390 01:08:34 -- accel/accel.sh@20 -- # read -r var val 00:07:26.390 01:08:34 -- accel/accel.sh@21 -- # val=software 00:07:26.390 01:08:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.390 01:08:34 -- accel/accel.sh@23 -- # accel_module=software 00:07:26.390 01:08:34 -- accel/accel.sh@20 -- # IFS=: 00:07:26.390 01:08:34 -- accel/accel.sh@20 -- # read -r var val 00:07:26.390 01:08:34 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:26.390 01:08:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.390 01:08:34 -- accel/accel.sh@20 -- # IFS=: 00:07:26.390 01:08:34 -- accel/accel.sh@20 -- # read -r var val 00:07:26.390 01:08:34 -- accel/accel.sh@21 -- # val=32 00:07:26.390 01:08:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.390 01:08:34 -- accel/accel.sh@20 -- # IFS=: 00:07:26.390 01:08:34 -- accel/accel.sh@20 -- # read -r var val 00:07:26.390 01:08:34 -- accel/accel.sh@21 -- # val=32 00:07:26.390 01:08:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.390 01:08:34 -- accel/accel.sh@20 -- # IFS=: 00:07:26.390 01:08:34 -- accel/accel.sh@20 -- # read -r var val 00:07:26.648 01:08:34 -- accel/accel.sh@21 -- # val=1 00:07:26.648 01:08:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.648 01:08:34 -- accel/accel.sh@20 -- # IFS=: 00:07:26.648 01:08:34 -- accel/accel.sh@20 -- # read -r var val 00:07:26.648 01:08:34 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:26.648 01:08:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.648 01:08:34 -- accel/accel.sh@20 -- # IFS=: 00:07:26.648 01:08:34 -- accel/accel.sh@20 -- # read -r var val 00:07:26.648 01:08:34 -- accel/accel.sh@21 -- # val=Yes 00:07:26.648 01:08:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.648 01:08:34 -- accel/accel.sh@20 -- # IFS=: 00:07:26.648 01:08:34 -- accel/accel.sh@20 -- # read -r var val 00:07:26.648 01:08:34 -- accel/accel.sh@21 -- # val= 00:07:26.648 01:08:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.648 01:08:34 -- accel/accel.sh@20 -- # IFS=: 00:07:26.648 01:08:34 -- accel/accel.sh@20 -- # read -r var val 00:07:26.648 01:08:34 -- accel/accel.sh@21 -- # val= 00:07:26.648 01:08:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.648 01:08:34 -- accel/accel.sh@20 -- # IFS=: 00:07:26.648 01:08:34 -- accel/accel.sh@20 -- # read -r var val 00:07:28.021 01:08:35 -- accel/accel.sh@21 -- # val= 00:07:28.021 01:08:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.021 01:08:35 -- accel/accel.sh@20 -- # IFS=: 00:07:28.021 01:08:35 -- accel/accel.sh@20 -- # read -r var val 00:07:28.021 01:08:35 -- accel/accel.sh@21 -- # val= 00:07:28.021 01:08:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.021 01:08:35 -- accel/accel.sh@20 -- # IFS=: 00:07:28.021 01:08:35 -- accel/accel.sh@20 -- # read -r var val 00:07:28.021 01:08:35 -- accel/accel.sh@21 -- # val= 00:07:28.021 01:08:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.021 01:08:35 -- accel/accel.sh@20 -- # IFS=: 00:07:28.021 01:08:35 -- accel/accel.sh@20 -- # read -r var val 00:07:28.021 01:08:35 -- accel/accel.sh@21 -- # val= 00:07:28.021 01:08:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.021 01:08:35 -- accel/accel.sh@20 -- # IFS=: 00:07:28.021 01:08:35 -- accel/accel.sh@20 -- # read -r var val 00:07:28.021 01:08:35 -- accel/accel.sh@21 -- # val= 00:07:28.021 01:08:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.021 01:08:35 -- accel/accel.sh@20 -- # IFS=: 00:07:28.021 01:08:35 -- accel/accel.sh@20 -- # read -r var val 00:07:28.021 01:08:35 -- accel/accel.sh@21 -- # val= 00:07:28.021 01:08:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.021 01:08:35 -- accel/accel.sh@20 -- # IFS=: 00:07:28.021 01:08:35 -- accel/accel.sh@20 -- # read -r var val 00:07:28.021 01:08:35 -- accel/accel.sh@21 -- # val= 00:07:28.021 01:08:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.021 01:08:35 -- accel/accel.sh@20 -- # IFS=: 00:07:28.021 01:08:35 -- accel/accel.sh@20 -- # read -r var val 00:07:28.021 01:08:35 -- accel/accel.sh@21 -- # val= 00:07:28.021 01:08:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.021 01:08:35 -- accel/accel.sh@20 -- # IFS=: 00:07:28.021 01:08:35 -- accel/accel.sh@20 -- # read -r var val 00:07:28.021 01:08:35 -- accel/accel.sh@21 -- # val= 00:07:28.021 01:08:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.021 01:08:35 -- accel/accel.sh@20 -- # IFS=: 00:07:28.021 01:08:35 -- accel/accel.sh@20 -- # read -r var val 00:07:28.021 01:08:35 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:28.021 01:08:35 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:28.021 01:08:35 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:28.021 00:07:28.021 real 0m2.879s 00:07:28.021 user 0m9.582s 00:07:28.021 sys 0m0.316s 00:07:28.021 01:08:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:28.021 01:08:35 -- common/autotest_common.sh@10 -- # set +x 00:07:28.021 ************************************ 00:07:28.021 END TEST accel_decomp_full_mcore 00:07:28.021 ************************************ 00:07:28.021 01:08:35 -- accel/accel.sh@113 -- # run_test accel_decomp_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:28.021 01:08:35 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:07:28.021 01:08:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:28.021 01:08:35 -- common/autotest_common.sh@10 -- # set +x 00:07:28.021 ************************************ 00:07:28.021 START TEST accel_decomp_mthread 00:07:28.021 ************************************ 00:07:28.021 01:08:35 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:28.021 01:08:35 -- accel/accel.sh@16 -- # local accel_opc 00:07:28.021 01:08:35 -- accel/accel.sh@17 -- # local accel_module 00:07:28.021 01:08:35 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:28.021 01:08:35 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:28.021 01:08:35 -- accel/accel.sh@12 -- # build_accel_config 00:07:28.021 01:08:35 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:28.021 01:08:35 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:28.021 01:08:35 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:28.021 01:08:35 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:28.021 01:08:35 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:28.021 01:08:35 -- accel/accel.sh@41 -- # local IFS=, 00:07:28.021 01:08:35 -- accel/accel.sh@42 -- # jq -r . 00:07:28.021 [2024-11-20 01:08:35.848238] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:28.021 [2024-11-20 01:08:35.848322] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1031398 ] 00:07:28.021 EAL: No free 2048 kB hugepages reported on node 1 00:07:28.021 [2024-11-20 01:08:35.909155] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:28.021 [2024-11-20 01:08:36.002885] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:29.395 01:08:37 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:29.395 00:07:29.395 SPDK Configuration: 00:07:29.395 Core mask: 0x1 00:07:29.395 00:07:29.395 Accel Perf Configuration: 00:07:29.395 Workload Type: decompress 00:07:29.395 Transfer size: 4096 bytes 00:07:29.395 Vector count 1 00:07:29.395 Module: software 00:07:29.395 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:29.395 Queue depth: 32 00:07:29.395 Allocate depth: 32 00:07:29.395 # threads/core: 2 00:07:29.395 Run time: 1 seconds 00:07:29.395 Verify: Yes 00:07:29.395 00:07:29.395 Running for 1 seconds... 00:07:29.395 00:07:29.395 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:29.395 ------------------------------------------------------------------------------------ 00:07:29.395 0,1 27808/s 51 MiB/s 0 0 00:07:29.395 0,0 27712/s 51 MiB/s 0 0 00:07:29.395 ==================================================================================== 00:07:29.395 Total 55520/s 216 MiB/s 0 0' 00:07:29.395 01:08:37 -- accel/accel.sh@20 -- # IFS=: 00:07:29.395 01:08:37 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:29.395 01:08:37 -- accel/accel.sh@20 -- # read -r var val 00:07:29.395 01:08:37 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:29.395 01:08:37 -- accel/accel.sh@12 -- # build_accel_config 00:07:29.395 01:08:37 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:29.395 01:08:37 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:29.395 01:08:37 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:29.395 01:08:37 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:29.395 01:08:37 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:29.395 01:08:37 -- accel/accel.sh@41 -- # local IFS=, 00:07:29.395 01:08:37 -- accel/accel.sh@42 -- # jq -r . 00:07:29.395 [2024-11-20 01:08:37.263867] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:29.395 [2024-11-20 01:08:37.263958] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1031540 ] 00:07:29.395 EAL: No free 2048 kB hugepages reported on node 1 00:07:29.396 [2024-11-20 01:08:37.325425] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:29.396 [2024-11-20 01:08:37.422631] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:29.396 01:08:37 -- accel/accel.sh@21 -- # val= 00:07:29.396 01:08:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.396 01:08:37 -- accel/accel.sh@20 -- # IFS=: 00:07:29.396 01:08:37 -- accel/accel.sh@20 -- # read -r var val 00:07:29.396 01:08:37 -- accel/accel.sh@21 -- # val= 00:07:29.396 01:08:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.396 01:08:37 -- accel/accel.sh@20 -- # IFS=: 00:07:29.396 01:08:37 -- accel/accel.sh@20 -- # read -r var val 00:07:29.396 01:08:37 -- accel/accel.sh@21 -- # val= 00:07:29.396 01:08:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.396 01:08:37 -- accel/accel.sh@20 -- # IFS=: 00:07:29.396 01:08:37 -- accel/accel.sh@20 -- # read -r var val 00:07:29.396 01:08:37 -- accel/accel.sh@21 -- # val=0x1 00:07:29.396 01:08:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.396 01:08:37 -- accel/accel.sh@20 -- # IFS=: 00:07:29.396 01:08:37 -- accel/accel.sh@20 -- # read -r var val 00:07:29.396 01:08:37 -- accel/accel.sh@21 -- # val= 00:07:29.396 01:08:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.396 01:08:37 -- accel/accel.sh@20 -- # IFS=: 00:07:29.396 01:08:37 -- accel/accel.sh@20 -- # read -r var val 00:07:29.396 01:08:37 -- accel/accel.sh@21 -- # val= 00:07:29.396 01:08:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.396 01:08:37 -- accel/accel.sh@20 -- # IFS=: 00:07:29.396 01:08:37 -- accel/accel.sh@20 -- # read -r var val 00:07:29.396 01:08:37 -- accel/accel.sh@21 -- # val=decompress 00:07:29.396 01:08:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.396 01:08:37 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:29.396 01:08:37 -- accel/accel.sh@20 -- # IFS=: 00:07:29.396 01:08:37 -- accel/accel.sh@20 -- # read -r var val 00:07:29.396 01:08:37 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:29.396 01:08:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.396 01:08:37 -- accel/accel.sh@20 -- # IFS=: 00:07:29.396 01:08:37 -- accel/accel.sh@20 -- # read -r var val 00:07:29.396 01:08:37 -- accel/accel.sh@21 -- # val= 00:07:29.396 01:08:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.396 01:08:37 -- accel/accel.sh@20 -- # IFS=: 00:07:29.396 01:08:37 -- accel/accel.sh@20 -- # read -r var val 00:07:29.396 01:08:37 -- accel/accel.sh@21 -- # val=software 00:07:29.396 01:08:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.396 01:08:37 -- accel/accel.sh@23 -- # accel_module=software 00:07:29.396 01:08:37 -- accel/accel.sh@20 -- # IFS=: 00:07:29.396 01:08:37 -- accel/accel.sh@20 -- # read -r var val 00:07:29.396 01:08:37 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:29.396 01:08:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.396 01:08:37 -- accel/accel.sh@20 -- # IFS=: 00:07:29.396 01:08:37 -- accel/accel.sh@20 -- # read -r var val 00:07:29.396 01:08:37 -- accel/accel.sh@21 -- # val=32 00:07:29.396 01:08:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.396 01:08:37 -- accel/accel.sh@20 -- # IFS=: 00:07:29.396 01:08:37 -- accel/accel.sh@20 -- # read -r var val 00:07:29.396 01:08:37 -- accel/accel.sh@21 -- # val=32 00:07:29.396 01:08:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.396 01:08:37 -- accel/accel.sh@20 -- # IFS=: 00:07:29.396 01:08:37 -- accel/accel.sh@20 -- # read -r var val 00:07:29.396 01:08:37 -- accel/accel.sh@21 -- # val=2 00:07:29.396 01:08:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.396 01:08:37 -- accel/accel.sh@20 -- # IFS=: 00:07:29.396 01:08:37 -- accel/accel.sh@20 -- # read -r var val 00:07:29.396 01:08:37 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:29.396 01:08:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.396 01:08:37 -- accel/accel.sh@20 -- # IFS=: 00:07:29.396 01:08:37 -- accel/accel.sh@20 -- # read -r var val 00:07:29.396 01:08:37 -- accel/accel.sh@21 -- # val=Yes 00:07:29.396 01:08:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.396 01:08:37 -- accel/accel.sh@20 -- # IFS=: 00:07:29.396 01:08:37 -- accel/accel.sh@20 -- # read -r var val 00:07:29.396 01:08:37 -- accel/accel.sh@21 -- # val= 00:07:29.396 01:08:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.396 01:08:37 -- accel/accel.sh@20 -- # IFS=: 00:07:29.396 01:08:37 -- accel/accel.sh@20 -- # read -r var val 00:07:29.396 01:08:37 -- accel/accel.sh@21 -- # val= 00:07:29.396 01:08:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.396 01:08:37 -- accel/accel.sh@20 -- # IFS=: 00:07:29.396 01:08:37 -- accel/accel.sh@20 -- # read -r var val 00:07:30.800 01:08:38 -- accel/accel.sh@21 -- # val= 00:07:30.800 01:08:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.800 01:08:38 -- accel/accel.sh@20 -- # IFS=: 00:07:30.800 01:08:38 -- accel/accel.sh@20 -- # read -r var val 00:07:30.800 01:08:38 -- accel/accel.sh@21 -- # val= 00:07:30.800 01:08:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.800 01:08:38 -- accel/accel.sh@20 -- # IFS=: 00:07:30.800 01:08:38 -- accel/accel.sh@20 -- # read -r var val 00:07:30.800 01:08:38 -- accel/accel.sh@21 -- # val= 00:07:30.800 01:08:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.800 01:08:38 -- accel/accel.sh@20 -- # IFS=: 00:07:30.800 01:08:38 -- accel/accel.sh@20 -- # read -r var val 00:07:30.800 01:08:38 -- accel/accel.sh@21 -- # val= 00:07:30.800 01:08:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.800 01:08:38 -- accel/accel.sh@20 -- # IFS=: 00:07:30.800 01:08:38 -- accel/accel.sh@20 -- # read -r var val 00:07:30.800 01:08:38 -- accel/accel.sh@21 -- # val= 00:07:30.800 01:08:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.800 01:08:38 -- accel/accel.sh@20 -- # IFS=: 00:07:30.800 01:08:38 -- accel/accel.sh@20 -- # read -r var val 00:07:30.800 01:08:38 -- accel/accel.sh@21 -- # val= 00:07:30.800 01:08:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.800 01:08:38 -- accel/accel.sh@20 -- # IFS=: 00:07:30.800 01:08:38 -- accel/accel.sh@20 -- # read -r var val 00:07:30.800 01:08:38 -- accel/accel.sh@21 -- # val= 00:07:30.800 01:08:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.800 01:08:38 -- accel/accel.sh@20 -- # IFS=: 00:07:30.800 01:08:38 -- accel/accel.sh@20 -- # read -r var val 00:07:30.800 01:08:38 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:30.800 01:08:38 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:30.800 01:08:38 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:30.800 00:07:30.800 real 0m2.834s 00:07:30.800 user 0m2.526s 00:07:30.800 sys 0m0.298s 00:07:30.800 01:08:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:30.800 01:08:38 -- common/autotest_common.sh@10 -- # set +x 00:07:30.800 ************************************ 00:07:30.800 END TEST accel_decomp_mthread 00:07:30.800 ************************************ 00:07:30.800 01:08:38 -- accel/accel.sh@114 -- # run_test accel_deomp_full_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:30.800 01:08:38 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:07:30.800 01:08:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:30.800 01:08:38 -- common/autotest_common.sh@10 -- # set +x 00:07:30.800 ************************************ 00:07:30.800 START TEST accel_deomp_full_mthread 00:07:30.800 ************************************ 00:07:30.800 01:08:38 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:30.800 01:08:38 -- accel/accel.sh@16 -- # local accel_opc 00:07:30.800 01:08:38 -- accel/accel.sh@17 -- # local accel_module 00:07:30.800 01:08:38 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:30.800 01:08:38 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:30.800 01:08:38 -- accel/accel.sh@12 -- # build_accel_config 00:07:30.800 01:08:38 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:30.801 01:08:38 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:30.801 01:08:38 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:30.801 01:08:38 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:30.801 01:08:38 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:30.801 01:08:38 -- accel/accel.sh@41 -- # local IFS=, 00:07:30.801 01:08:38 -- accel/accel.sh@42 -- # jq -r . 00:07:30.801 [2024-11-20 01:08:38.704168] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:30.801 [2024-11-20 01:08:38.704260] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1031707 ] 00:07:30.801 EAL: No free 2048 kB hugepages reported on node 1 00:07:30.801 [2024-11-20 01:08:38.764949] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:30.801 [2024-11-20 01:08:38.858840] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:32.176 01:08:40 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:32.176 00:07:32.176 SPDK Configuration: 00:07:32.176 Core mask: 0x1 00:07:32.176 00:07:32.176 Accel Perf Configuration: 00:07:32.176 Workload Type: decompress 00:07:32.176 Transfer size: 111250 bytes 00:07:32.176 Vector count 1 00:07:32.176 Module: software 00:07:32.176 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:32.176 Queue depth: 32 00:07:32.176 Allocate depth: 32 00:07:32.176 # threads/core: 2 00:07:32.176 Run time: 1 seconds 00:07:32.176 Verify: Yes 00:07:32.176 00:07:32.176 Running for 1 seconds... 00:07:32.176 00:07:32.176 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:32.176 ------------------------------------------------------------------------------------ 00:07:32.176 0,1 1952/s 80 MiB/s 0 0 00:07:32.176 0,0 1920/s 79 MiB/s 0 0 00:07:32.176 ==================================================================================== 00:07:32.176 Total 3872/s 410 MiB/s 0 0' 00:07:32.176 01:08:40 -- accel/accel.sh@20 -- # IFS=: 00:07:32.176 01:08:40 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:32.176 01:08:40 -- accel/accel.sh@20 -- # read -r var val 00:07:32.176 01:08:40 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:32.176 01:08:40 -- accel/accel.sh@12 -- # build_accel_config 00:07:32.176 01:08:40 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:32.176 01:08:40 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:32.176 01:08:40 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:32.176 01:08:40 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:32.176 01:08:40 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:32.176 01:08:40 -- accel/accel.sh@41 -- # local IFS=, 00:07:32.176 01:08:40 -- accel/accel.sh@42 -- # jq -r . 00:07:32.176 [2024-11-20 01:08:40.141020] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:32.176 [2024-11-20 01:08:40.141122] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1031965 ] 00:07:32.176 EAL: No free 2048 kB hugepages reported on node 1 00:07:32.176 [2024-11-20 01:08:40.205331] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:32.176 [2024-11-20 01:08:40.299076] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:32.176 01:08:40 -- accel/accel.sh@21 -- # val= 00:07:32.176 01:08:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.176 01:08:40 -- accel/accel.sh@20 -- # IFS=: 00:07:32.176 01:08:40 -- accel/accel.sh@20 -- # read -r var val 00:07:32.176 01:08:40 -- accel/accel.sh@21 -- # val= 00:07:32.176 01:08:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.176 01:08:40 -- accel/accel.sh@20 -- # IFS=: 00:07:32.176 01:08:40 -- accel/accel.sh@20 -- # read -r var val 00:07:32.176 01:08:40 -- accel/accel.sh@21 -- # val= 00:07:32.176 01:08:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.176 01:08:40 -- accel/accel.sh@20 -- # IFS=: 00:07:32.176 01:08:40 -- accel/accel.sh@20 -- # read -r var val 00:07:32.176 01:08:40 -- accel/accel.sh@21 -- # val=0x1 00:07:32.176 01:08:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.176 01:08:40 -- accel/accel.sh@20 -- # IFS=: 00:07:32.176 01:08:40 -- accel/accel.sh@20 -- # read -r var val 00:07:32.176 01:08:40 -- accel/accel.sh@21 -- # val= 00:07:32.176 01:08:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.176 01:08:40 -- accel/accel.sh@20 -- # IFS=: 00:07:32.176 01:08:40 -- accel/accel.sh@20 -- # read -r var val 00:07:32.176 01:08:40 -- accel/accel.sh@21 -- # val= 00:07:32.176 01:08:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.176 01:08:40 -- accel/accel.sh@20 -- # IFS=: 00:07:32.177 01:08:40 -- accel/accel.sh@20 -- # read -r var val 00:07:32.177 01:08:40 -- accel/accel.sh@21 -- # val=decompress 00:07:32.177 01:08:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.177 01:08:40 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:32.177 01:08:40 -- accel/accel.sh@20 -- # IFS=: 00:07:32.177 01:08:40 -- accel/accel.sh@20 -- # read -r var val 00:07:32.177 01:08:40 -- accel/accel.sh@21 -- # val='111250 bytes' 00:07:32.177 01:08:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.177 01:08:40 -- accel/accel.sh@20 -- # IFS=: 00:07:32.177 01:08:40 -- accel/accel.sh@20 -- # read -r var val 00:07:32.177 01:08:40 -- accel/accel.sh@21 -- # val= 00:07:32.177 01:08:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.177 01:08:40 -- accel/accel.sh@20 -- # IFS=: 00:07:32.177 01:08:40 -- accel/accel.sh@20 -- # read -r var val 00:07:32.177 01:08:40 -- accel/accel.sh@21 -- # val=software 00:07:32.177 01:08:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.177 01:08:40 -- accel/accel.sh@23 -- # accel_module=software 00:07:32.177 01:08:40 -- accel/accel.sh@20 -- # IFS=: 00:07:32.177 01:08:40 -- accel/accel.sh@20 -- # read -r var val 00:07:32.177 01:08:40 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:32.177 01:08:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.177 01:08:40 -- accel/accel.sh@20 -- # IFS=: 00:07:32.177 01:08:40 -- accel/accel.sh@20 -- # read -r var val 00:07:32.177 01:08:40 -- accel/accel.sh@21 -- # val=32 00:07:32.177 01:08:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.177 01:08:40 -- accel/accel.sh@20 -- # IFS=: 00:07:32.177 01:08:40 -- accel/accel.sh@20 -- # read -r var val 00:07:32.177 01:08:40 -- accel/accel.sh@21 -- # val=32 00:07:32.177 01:08:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.177 01:08:40 -- accel/accel.sh@20 -- # IFS=: 00:07:32.177 01:08:40 -- accel/accel.sh@20 -- # read -r var val 00:07:32.177 01:08:40 -- accel/accel.sh@21 -- # val=2 00:07:32.177 01:08:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.177 01:08:40 -- accel/accel.sh@20 -- # IFS=: 00:07:32.177 01:08:40 -- accel/accel.sh@20 -- # read -r var val 00:07:32.177 01:08:40 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:32.177 01:08:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.177 01:08:40 -- accel/accel.sh@20 -- # IFS=: 00:07:32.177 01:08:40 -- accel/accel.sh@20 -- # read -r var val 00:07:32.177 01:08:40 -- accel/accel.sh@21 -- # val=Yes 00:07:32.177 01:08:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.177 01:08:40 -- accel/accel.sh@20 -- # IFS=: 00:07:32.177 01:08:40 -- accel/accel.sh@20 -- # read -r var val 00:07:32.177 01:08:40 -- accel/accel.sh@21 -- # val= 00:07:32.177 01:08:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.177 01:08:40 -- accel/accel.sh@20 -- # IFS=: 00:07:32.177 01:08:40 -- accel/accel.sh@20 -- # read -r var val 00:07:32.177 01:08:40 -- accel/accel.sh@21 -- # val= 00:07:32.177 01:08:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.177 01:08:40 -- accel/accel.sh@20 -- # IFS=: 00:07:32.177 01:08:40 -- accel/accel.sh@20 -- # read -r var val 00:07:33.546 01:08:41 -- accel/accel.sh@21 -- # val= 00:07:33.546 01:08:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.546 01:08:41 -- accel/accel.sh@20 -- # IFS=: 00:07:33.546 01:08:41 -- accel/accel.sh@20 -- # read -r var val 00:07:33.546 01:08:41 -- accel/accel.sh@21 -- # val= 00:07:33.546 01:08:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.546 01:08:41 -- accel/accel.sh@20 -- # IFS=: 00:07:33.546 01:08:41 -- accel/accel.sh@20 -- # read -r var val 00:07:33.546 01:08:41 -- accel/accel.sh@21 -- # val= 00:07:33.546 01:08:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.546 01:08:41 -- accel/accel.sh@20 -- # IFS=: 00:07:33.546 01:08:41 -- accel/accel.sh@20 -- # read -r var val 00:07:33.546 01:08:41 -- accel/accel.sh@21 -- # val= 00:07:33.546 01:08:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.546 01:08:41 -- accel/accel.sh@20 -- # IFS=: 00:07:33.546 01:08:41 -- accel/accel.sh@20 -- # read -r var val 00:07:33.546 01:08:41 -- accel/accel.sh@21 -- # val= 00:07:33.546 01:08:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.546 01:08:41 -- accel/accel.sh@20 -- # IFS=: 00:07:33.546 01:08:41 -- accel/accel.sh@20 -- # read -r var val 00:07:33.546 01:08:41 -- accel/accel.sh@21 -- # val= 00:07:33.546 01:08:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.546 01:08:41 -- accel/accel.sh@20 -- # IFS=: 00:07:33.546 01:08:41 -- accel/accel.sh@20 -- # read -r var val 00:07:33.546 01:08:41 -- accel/accel.sh@21 -- # val= 00:07:33.546 01:08:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.546 01:08:41 -- accel/accel.sh@20 -- # IFS=: 00:07:33.546 01:08:41 -- accel/accel.sh@20 -- # read -r var val 00:07:33.546 01:08:41 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:33.546 01:08:41 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:33.546 01:08:41 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:33.546 00:07:33.546 real 0m2.890s 00:07:33.546 user 0m2.580s 00:07:33.546 sys 0m0.302s 00:07:33.546 01:08:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:33.546 01:08:41 -- common/autotest_common.sh@10 -- # set +x 00:07:33.546 ************************************ 00:07:33.546 END TEST accel_deomp_full_mthread 00:07:33.546 ************************************ 00:07:33.546 01:08:41 -- accel/accel.sh@116 -- # [[ n == y ]] 00:07:33.546 01:08:41 -- accel/accel.sh@129 -- # run_test accel_dif_functional_tests /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:07:33.546 01:08:41 -- accel/accel.sh@129 -- # build_accel_config 00:07:33.546 01:08:41 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:33.546 01:08:41 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:33.547 01:08:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:33.547 01:08:41 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:33.547 01:08:41 -- common/autotest_common.sh@10 -- # set +x 00:07:33.547 01:08:41 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:33.547 01:08:41 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:33.547 01:08:41 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:33.547 01:08:41 -- accel/accel.sh@41 -- # local IFS=, 00:07:33.547 01:08:41 -- accel/accel.sh@42 -- # jq -r . 00:07:33.547 ************************************ 00:07:33.547 START TEST accel_dif_functional_tests 00:07:33.547 ************************************ 00:07:33.547 01:08:41 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:07:33.547 [2024-11-20 01:08:41.640170] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:33.547 [2024-11-20 01:08:41.640255] [ DPDK EAL parameters: DIF --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1032127 ] 00:07:33.547 EAL: No free 2048 kB hugepages reported on node 1 00:07:33.547 [2024-11-20 01:08:41.700926] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:07:33.804 [2024-11-20 01:08:41.797453] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:33.804 [2024-11-20 01:08:41.797509] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:33.804 [2024-11-20 01:08:41.797512] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:33.804 00:07:33.804 00:07:33.804 CUnit - A unit testing framework for C - Version 2.1-3 00:07:33.804 http://cunit.sourceforge.net/ 00:07:33.804 00:07:33.804 00:07:33.804 Suite: accel_dif 00:07:33.804 Test: verify: DIF generated, GUARD check ...passed 00:07:33.804 Test: verify: DIF generated, APPTAG check ...passed 00:07:33.804 Test: verify: DIF generated, REFTAG check ...passed 00:07:33.804 Test: verify: DIF not generated, GUARD check ...[2024-11-20 01:08:41.893061] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:07:33.804 [2024-11-20 01:08:41.893155] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:07:33.804 passed 00:07:33.804 Test: verify: DIF not generated, APPTAG check ...[2024-11-20 01:08:41.893213] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:07:33.804 [2024-11-20 01:08:41.893258] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:07:33.804 passed 00:07:33.804 Test: verify: DIF not generated, REFTAG check ...[2024-11-20 01:08:41.893308] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:07:33.804 [2024-11-20 01:08:41.893353] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:07:33.804 passed 00:07:33.804 Test: verify: APPTAG correct, APPTAG check ...passed 00:07:33.804 Test: verify: APPTAG incorrect, APPTAG check ...[2024-11-20 01:08:41.893469] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=30, Expected=28, Actual=14 00:07:33.804 passed 00:07:33.804 Test: verify: APPTAG incorrect, no APPTAG check ...passed 00:07:33.804 Test: verify: REFTAG incorrect, REFTAG ignore ...passed 00:07:33.804 Test: verify: REFTAG_INIT correct, REFTAG check ...passed 00:07:33.804 Test: verify: REFTAG_INIT incorrect, REFTAG check ...[2024-11-20 01:08:41.893678] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=10 00:07:33.804 passed 00:07:33.804 Test: generate copy: DIF generated, GUARD check ...passed 00:07:33.804 Test: generate copy: DIF generated, APTTAG check ...passed 00:07:33.804 Test: generate copy: DIF generated, REFTAG check ...passed 00:07:33.804 Test: generate copy: DIF generated, no GUARD check flag set ...passed 00:07:33.804 Test: generate copy: DIF generated, no APPTAG check flag set ...passed 00:07:33.804 Test: generate copy: DIF generated, no REFTAG check flag set ...passed 00:07:33.804 Test: generate copy: iovecs-len validate ...[2024-11-20 01:08:41.893967] dif.c:1167:spdk_dif_generate_copy: *ERROR*: Size of bounce_iovs arrays are not valid or misaligned with block_size. 00:07:33.804 passed 00:07:33.804 Test: generate copy: buffer alignment validate ...passed 00:07:33.804 00:07:33.804 Run Summary: Type Total Ran Passed Failed Inactive 00:07:33.804 suites 1 1 n/a 0 0 00:07:33.804 tests 20 20 20 0 0 00:07:33.804 asserts 204 204 204 0 n/a 00:07:33.804 00:07:33.804 Elapsed time = 0.003 seconds 00:07:34.062 00:07:34.062 real 0m0.504s 00:07:34.062 user 0m0.793s 00:07:34.062 sys 0m0.179s 00:07:34.062 01:08:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:34.062 01:08:42 -- common/autotest_common.sh@10 -- # set +x 00:07:34.062 ************************************ 00:07:34.062 END TEST accel_dif_functional_tests 00:07:34.062 ************************************ 00:07:34.062 00:07:34.062 real 1m0.029s 00:07:34.062 user 1m7.860s 00:07:34.062 sys 0m7.301s 00:07:34.062 01:08:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:34.062 01:08:42 -- common/autotest_common.sh@10 -- # set +x 00:07:34.062 ************************************ 00:07:34.062 END TEST accel 00:07:34.062 ************************************ 00:07:34.062 01:08:42 -- spdk/autotest.sh@177 -- # run_test accel_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:07:34.062 01:08:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:34.062 01:08:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:34.062 01:08:42 -- common/autotest_common.sh@10 -- # set +x 00:07:34.062 ************************************ 00:07:34.062 START TEST accel_rpc 00:07:34.062 ************************************ 00:07:34.062 01:08:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:07:34.062 * Looking for test storage... 00:07:34.062 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:07:34.062 01:08:42 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:34.062 01:08:42 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:34.062 01:08:42 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:34.062 01:08:42 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:34.062 01:08:42 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:34.062 01:08:42 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:34.062 01:08:42 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:34.062 01:08:42 -- scripts/common.sh@335 -- # IFS=.-: 00:07:34.062 01:08:42 -- scripts/common.sh@335 -- # read -ra ver1 00:07:34.062 01:08:42 -- scripts/common.sh@336 -- # IFS=.-: 00:07:34.062 01:08:42 -- scripts/common.sh@336 -- # read -ra ver2 00:07:34.062 01:08:42 -- scripts/common.sh@337 -- # local 'op=<' 00:07:34.062 01:08:42 -- scripts/common.sh@339 -- # ver1_l=2 00:07:34.062 01:08:42 -- scripts/common.sh@340 -- # ver2_l=1 00:07:34.062 01:08:42 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:34.062 01:08:42 -- scripts/common.sh@343 -- # case "$op" in 00:07:34.063 01:08:42 -- scripts/common.sh@344 -- # : 1 00:07:34.063 01:08:42 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:34.063 01:08:42 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:34.063 01:08:42 -- scripts/common.sh@364 -- # decimal 1 00:07:34.063 01:08:42 -- scripts/common.sh@352 -- # local d=1 00:07:34.063 01:08:42 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:34.063 01:08:42 -- scripts/common.sh@354 -- # echo 1 00:07:34.063 01:08:42 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:34.320 01:08:42 -- scripts/common.sh@365 -- # decimal 2 00:07:34.320 01:08:42 -- scripts/common.sh@352 -- # local d=2 00:07:34.320 01:08:42 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:34.320 01:08:42 -- scripts/common.sh@354 -- # echo 2 00:07:34.320 01:08:42 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:34.320 01:08:42 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:34.320 01:08:42 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:34.321 01:08:42 -- scripts/common.sh@367 -- # return 0 00:07:34.321 01:08:42 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:34.321 01:08:42 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:34.321 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:34.321 --rc genhtml_branch_coverage=1 00:07:34.321 --rc genhtml_function_coverage=1 00:07:34.321 --rc genhtml_legend=1 00:07:34.321 --rc geninfo_all_blocks=1 00:07:34.321 --rc geninfo_unexecuted_blocks=1 00:07:34.321 00:07:34.321 ' 00:07:34.321 01:08:42 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:34.321 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:34.321 --rc genhtml_branch_coverage=1 00:07:34.321 --rc genhtml_function_coverage=1 00:07:34.321 --rc genhtml_legend=1 00:07:34.321 --rc geninfo_all_blocks=1 00:07:34.321 --rc geninfo_unexecuted_blocks=1 00:07:34.321 00:07:34.321 ' 00:07:34.321 01:08:42 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:34.321 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:34.321 --rc genhtml_branch_coverage=1 00:07:34.321 --rc genhtml_function_coverage=1 00:07:34.321 --rc genhtml_legend=1 00:07:34.321 --rc geninfo_all_blocks=1 00:07:34.321 --rc geninfo_unexecuted_blocks=1 00:07:34.321 00:07:34.321 ' 00:07:34.321 01:08:42 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:34.321 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:34.321 --rc genhtml_branch_coverage=1 00:07:34.321 --rc genhtml_function_coverage=1 00:07:34.321 --rc genhtml_legend=1 00:07:34.321 --rc geninfo_all_blocks=1 00:07:34.321 --rc geninfo_unexecuted_blocks=1 00:07:34.321 00:07:34.321 ' 00:07:34.321 01:08:42 -- accel/accel_rpc.sh@11 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:07:34.321 01:08:42 -- accel/accel_rpc.sh@14 -- # spdk_tgt_pid=1032253 00:07:34.321 01:08:42 -- accel/accel_rpc.sh@13 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --wait-for-rpc 00:07:34.321 01:08:42 -- accel/accel_rpc.sh@15 -- # waitforlisten 1032253 00:07:34.321 01:08:42 -- common/autotest_common.sh@829 -- # '[' -z 1032253 ']' 00:07:34.321 01:08:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:34.321 01:08:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:34.321 01:08:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:34.321 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:34.321 01:08:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:34.321 01:08:42 -- common/autotest_common.sh@10 -- # set +x 00:07:34.321 [2024-11-20 01:08:42.334843] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:34.321 [2024-11-20 01:08:42.334939] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1032253 ] 00:07:34.321 EAL: No free 2048 kB hugepages reported on node 1 00:07:34.321 [2024-11-20 01:08:42.395269] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:34.321 [2024-11-20 01:08:42.480999] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:34.321 [2024-11-20 01:08:42.481202] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:34.579 01:08:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:34.579 01:08:42 -- common/autotest_common.sh@862 -- # return 0 00:07:34.579 01:08:42 -- accel/accel_rpc.sh@45 -- # [[ y == y ]] 00:07:34.579 01:08:42 -- accel/accel_rpc.sh@45 -- # [[ 0 -gt 0 ]] 00:07:34.579 01:08:42 -- accel/accel_rpc.sh@49 -- # [[ y == y ]] 00:07:34.579 01:08:42 -- accel/accel_rpc.sh@49 -- # [[ 0 -gt 0 ]] 00:07:34.579 01:08:42 -- accel/accel_rpc.sh@53 -- # run_test accel_assign_opcode accel_assign_opcode_test_suite 00:07:34.579 01:08:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:34.579 01:08:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:34.579 01:08:42 -- common/autotest_common.sh@10 -- # set +x 00:07:34.579 ************************************ 00:07:34.579 START TEST accel_assign_opcode 00:07:34.579 ************************************ 00:07:34.579 01:08:42 -- common/autotest_common.sh@1114 -- # accel_assign_opcode_test_suite 00:07:34.579 01:08:42 -- accel/accel_rpc.sh@38 -- # rpc_cmd accel_assign_opc -o copy -m incorrect 00:07:34.579 01:08:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:34.579 01:08:42 -- common/autotest_common.sh@10 -- # set +x 00:07:34.579 [2024-11-20 01:08:42.549832] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module incorrect 00:07:34.579 01:08:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:34.579 01:08:42 -- accel/accel_rpc.sh@40 -- # rpc_cmd accel_assign_opc -o copy -m software 00:07:34.579 01:08:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:34.579 01:08:42 -- common/autotest_common.sh@10 -- # set +x 00:07:34.579 [2024-11-20 01:08:42.557850] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module software 00:07:34.579 01:08:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:34.579 01:08:42 -- accel/accel_rpc.sh@41 -- # rpc_cmd framework_start_init 00:07:34.579 01:08:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:34.579 01:08:42 -- common/autotest_common.sh@10 -- # set +x 00:07:34.835 01:08:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:34.835 01:08:42 -- accel/accel_rpc.sh@42 -- # rpc_cmd accel_get_opc_assignments 00:07:34.835 01:08:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:34.835 01:08:42 -- common/autotest_common.sh@10 -- # set +x 00:07:34.835 01:08:42 -- accel/accel_rpc.sh@42 -- # grep software 00:07:34.835 01:08:42 -- accel/accel_rpc.sh@42 -- # jq -r .copy 00:07:34.835 01:08:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:34.835 software 00:07:34.835 00:07:34.835 real 0m0.301s 00:07:34.835 user 0m0.036s 00:07:34.835 sys 0m0.007s 00:07:34.835 01:08:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:34.835 01:08:42 -- common/autotest_common.sh@10 -- # set +x 00:07:34.835 ************************************ 00:07:34.835 END TEST accel_assign_opcode 00:07:34.835 ************************************ 00:07:34.835 01:08:42 -- accel/accel_rpc.sh@55 -- # killprocess 1032253 00:07:34.835 01:08:42 -- common/autotest_common.sh@936 -- # '[' -z 1032253 ']' 00:07:34.835 01:08:42 -- common/autotest_common.sh@940 -- # kill -0 1032253 00:07:34.835 01:08:42 -- common/autotest_common.sh@941 -- # uname 00:07:34.835 01:08:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:34.835 01:08:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1032253 00:07:34.835 01:08:42 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:34.835 01:08:42 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:34.835 01:08:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1032253' 00:07:34.835 killing process with pid 1032253 00:07:34.835 01:08:42 -- common/autotest_common.sh@955 -- # kill 1032253 00:07:34.835 01:08:42 -- common/autotest_common.sh@960 -- # wait 1032253 00:07:35.093 00:07:35.093 real 0m1.156s 00:07:35.093 user 0m1.069s 00:07:35.093 sys 0m0.432s 00:07:35.093 01:08:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:35.093 01:08:43 -- common/autotest_common.sh@10 -- # set +x 00:07:35.093 ************************************ 00:07:35.093 END TEST accel_rpc 00:07:35.093 ************************************ 00:07:35.351 01:08:43 -- spdk/autotest.sh@178 -- # run_test app_cmdline /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:07:35.351 01:08:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:35.351 01:08:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:35.351 01:08:43 -- common/autotest_common.sh@10 -- # set +x 00:07:35.351 ************************************ 00:07:35.351 START TEST app_cmdline 00:07:35.351 ************************************ 00:07:35.351 01:08:43 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:07:35.351 * Looking for test storage... 00:07:35.351 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:07:35.351 01:08:43 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:35.351 01:08:43 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:35.351 01:08:43 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:35.351 01:08:43 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:35.351 01:08:43 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:35.351 01:08:43 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:35.351 01:08:43 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:35.351 01:08:43 -- scripts/common.sh@335 -- # IFS=.-: 00:07:35.351 01:08:43 -- scripts/common.sh@335 -- # read -ra ver1 00:07:35.351 01:08:43 -- scripts/common.sh@336 -- # IFS=.-: 00:07:35.351 01:08:43 -- scripts/common.sh@336 -- # read -ra ver2 00:07:35.351 01:08:43 -- scripts/common.sh@337 -- # local 'op=<' 00:07:35.351 01:08:43 -- scripts/common.sh@339 -- # ver1_l=2 00:07:35.351 01:08:43 -- scripts/common.sh@340 -- # ver2_l=1 00:07:35.351 01:08:43 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:35.351 01:08:43 -- scripts/common.sh@343 -- # case "$op" in 00:07:35.351 01:08:43 -- scripts/common.sh@344 -- # : 1 00:07:35.351 01:08:43 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:35.351 01:08:43 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:35.351 01:08:43 -- scripts/common.sh@364 -- # decimal 1 00:07:35.351 01:08:43 -- scripts/common.sh@352 -- # local d=1 00:07:35.351 01:08:43 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:35.351 01:08:43 -- scripts/common.sh@354 -- # echo 1 00:07:35.351 01:08:43 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:35.351 01:08:43 -- scripts/common.sh@365 -- # decimal 2 00:07:35.351 01:08:43 -- scripts/common.sh@352 -- # local d=2 00:07:35.351 01:08:43 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:35.351 01:08:43 -- scripts/common.sh@354 -- # echo 2 00:07:35.351 01:08:43 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:35.351 01:08:43 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:35.351 01:08:43 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:35.351 01:08:43 -- scripts/common.sh@367 -- # return 0 00:07:35.351 01:08:43 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:35.351 01:08:43 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:35.351 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:35.351 --rc genhtml_branch_coverage=1 00:07:35.351 --rc genhtml_function_coverage=1 00:07:35.351 --rc genhtml_legend=1 00:07:35.351 --rc geninfo_all_blocks=1 00:07:35.351 --rc geninfo_unexecuted_blocks=1 00:07:35.351 00:07:35.351 ' 00:07:35.351 01:08:43 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:35.351 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:35.351 --rc genhtml_branch_coverage=1 00:07:35.351 --rc genhtml_function_coverage=1 00:07:35.351 --rc genhtml_legend=1 00:07:35.351 --rc geninfo_all_blocks=1 00:07:35.351 --rc geninfo_unexecuted_blocks=1 00:07:35.351 00:07:35.351 ' 00:07:35.351 01:08:43 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:35.351 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:35.351 --rc genhtml_branch_coverage=1 00:07:35.351 --rc genhtml_function_coverage=1 00:07:35.351 --rc genhtml_legend=1 00:07:35.351 --rc geninfo_all_blocks=1 00:07:35.351 --rc geninfo_unexecuted_blocks=1 00:07:35.351 00:07:35.351 ' 00:07:35.352 01:08:43 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:35.352 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:35.352 --rc genhtml_branch_coverage=1 00:07:35.352 --rc genhtml_function_coverage=1 00:07:35.352 --rc genhtml_legend=1 00:07:35.352 --rc geninfo_all_blocks=1 00:07:35.352 --rc geninfo_unexecuted_blocks=1 00:07:35.352 00:07:35.352 ' 00:07:35.352 01:08:43 -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:07:35.352 01:08:43 -- app/cmdline.sh@17 -- # spdk_tgt_pid=1032536 00:07:35.352 01:08:43 -- app/cmdline.sh@16 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:07:35.352 01:08:43 -- app/cmdline.sh@18 -- # waitforlisten 1032536 00:07:35.352 01:08:43 -- common/autotest_common.sh@829 -- # '[' -z 1032536 ']' 00:07:35.352 01:08:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:35.352 01:08:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:35.352 01:08:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:35.352 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:35.352 01:08:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:35.352 01:08:43 -- common/autotest_common.sh@10 -- # set +x 00:07:35.352 [2024-11-20 01:08:43.518573] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:35.352 [2024-11-20 01:08:43.518671] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1032536 ] 00:07:35.352 EAL: No free 2048 kB hugepages reported on node 1 00:07:35.609 [2024-11-20 01:08:43.575261] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:35.609 [2024-11-20 01:08:43.659517] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:35.609 [2024-11-20 01:08:43.659713] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:36.541 01:08:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:36.541 01:08:44 -- common/autotest_common.sh@862 -- # return 0 00:07:36.541 01:08:44 -- app/cmdline.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py spdk_get_version 00:07:36.798 { 00:07:36.798 "version": "SPDK v24.01.1-pre git sha1 c13c99a5e", 00:07:36.798 "fields": { 00:07:36.798 "major": 24, 00:07:36.798 "minor": 1, 00:07:36.798 "patch": 1, 00:07:36.798 "suffix": "-pre", 00:07:36.798 "commit": "c13c99a5e" 00:07:36.798 } 00:07:36.798 } 00:07:36.798 01:08:44 -- app/cmdline.sh@22 -- # expected_methods=() 00:07:36.798 01:08:44 -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:07:36.798 01:08:44 -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:07:36.798 01:08:44 -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:07:36.798 01:08:44 -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:07:36.798 01:08:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:36.798 01:08:44 -- common/autotest_common.sh@10 -- # set +x 00:07:36.798 01:08:44 -- app/cmdline.sh@26 -- # jq -r '.[]' 00:07:36.798 01:08:44 -- app/cmdline.sh@26 -- # sort 00:07:36.798 01:08:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:36.798 01:08:44 -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:07:36.798 01:08:44 -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:07:36.798 01:08:44 -- app/cmdline.sh@30 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:36.798 01:08:44 -- common/autotest_common.sh@650 -- # local es=0 00:07:36.798 01:08:44 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:36.798 01:08:44 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:36.798 01:08:44 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:36.798 01:08:44 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:36.798 01:08:44 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:36.798 01:08:44 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:36.798 01:08:44 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:36.798 01:08:44 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:36.798 01:08:44 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:07:36.798 01:08:44 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:37.055 request: 00:07:37.055 { 00:07:37.055 "method": "env_dpdk_get_mem_stats", 00:07:37.055 "req_id": 1 00:07:37.055 } 00:07:37.055 Got JSON-RPC error response 00:07:37.055 response: 00:07:37.055 { 00:07:37.055 "code": -32601, 00:07:37.055 "message": "Method not found" 00:07:37.055 } 00:07:37.055 01:08:45 -- common/autotest_common.sh@653 -- # es=1 00:07:37.055 01:08:45 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:07:37.055 01:08:45 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:07:37.055 01:08:45 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:07:37.055 01:08:45 -- app/cmdline.sh@1 -- # killprocess 1032536 00:07:37.055 01:08:45 -- common/autotest_common.sh@936 -- # '[' -z 1032536 ']' 00:07:37.055 01:08:45 -- common/autotest_common.sh@940 -- # kill -0 1032536 00:07:37.055 01:08:45 -- common/autotest_common.sh@941 -- # uname 00:07:37.055 01:08:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:37.055 01:08:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1032536 00:07:37.055 01:08:45 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:37.055 01:08:45 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:37.055 01:08:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1032536' 00:07:37.055 killing process with pid 1032536 00:07:37.055 01:08:45 -- common/autotest_common.sh@955 -- # kill 1032536 00:07:37.055 01:08:45 -- common/autotest_common.sh@960 -- # wait 1032536 00:07:37.621 00:07:37.621 real 0m2.203s 00:07:37.622 user 0m2.796s 00:07:37.622 sys 0m0.521s 00:07:37.622 01:08:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:37.622 01:08:45 -- common/autotest_common.sh@10 -- # set +x 00:07:37.622 ************************************ 00:07:37.622 END TEST app_cmdline 00:07:37.622 ************************************ 00:07:37.622 01:08:45 -- spdk/autotest.sh@179 -- # run_test version /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:07:37.622 01:08:45 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:37.622 01:08:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:37.622 01:08:45 -- common/autotest_common.sh@10 -- # set +x 00:07:37.622 ************************************ 00:07:37.622 START TEST version 00:07:37.622 ************************************ 00:07:37.622 01:08:45 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:07:37.622 * Looking for test storage... 00:07:37.622 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:07:37.622 01:08:45 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:37.622 01:08:45 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:37.622 01:08:45 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:37.622 01:08:45 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:37.622 01:08:45 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:37.622 01:08:45 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:37.622 01:08:45 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:37.622 01:08:45 -- scripts/common.sh@335 -- # IFS=.-: 00:07:37.622 01:08:45 -- scripts/common.sh@335 -- # read -ra ver1 00:07:37.622 01:08:45 -- scripts/common.sh@336 -- # IFS=.-: 00:07:37.622 01:08:45 -- scripts/common.sh@336 -- # read -ra ver2 00:07:37.622 01:08:45 -- scripts/common.sh@337 -- # local 'op=<' 00:07:37.622 01:08:45 -- scripts/common.sh@339 -- # ver1_l=2 00:07:37.622 01:08:45 -- scripts/common.sh@340 -- # ver2_l=1 00:07:37.622 01:08:45 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:37.622 01:08:45 -- scripts/common.sh@343 -- # case "$op" in 00:07:37.622 01:08:45 -- scripts/common.sh@344 -- # : 1 00:07:37.622 01:08:45 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:37.622 01:08:45 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:37.622 01:08:45 -- scripts/common.sh@364 -- # decimal 1 00:07:37.622 01:08:45 -- scripts/common.sh@352 -- # local d=1 00:07:37.622 01:08:45 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:37.622 01:08:45 -- scripts/common.sh@354 -- # echo 1 00:07:37.622 01:08:45 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:37.622 01:08:45 -- scripts/common.sh@365 -- # decimal 2 00:07:37.622 01:08:45 -- scripts/common.sh@352 -- # local d=2 00:07:37.622 01:08:45 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:37.622 01:08:45 -- scripts/common.sh@354 -- # echo 2 00:07:37.622 01:08:45 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:37.622 01:08:45 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:37.622 01:08:45 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:37.622 01:08:45 -- scripts/common.sh@367 -- # return 0 00:07:37.622 01:08:45 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:37.622 01:08:45 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:37.622 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:37.622 --rc genhtml_branch_coverage=1 00:07:37.622 --rc genhtml_function_coverage=1 00:07:37.622 --rc genhtml_legend=1 00:07:37.622 --rc geninfo_all_blocks=1 00:07:37.622 --rc geninfo_unexecuted_blocks=1 00:07:37.622 00:07:37.622 ' 00:07:37.622 01:08:45 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:37.622 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:37.622 --rc genhtml_branch_coverage=1 00:07:37.622 --rc genhtml_function_coverage=1 00:07:37.622 --rc genhtml_legend=1 00:07:37.622 --rc geninfo_all_blocks=1 00:07:37.622 --rc geninfo_unexecuted_blocks=1 00:07:37.622 00:07:37.622 ' 00:07:37.622 01:08:45 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:37.622 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:37.622 --rc genhtml_branch_coverage=1 00:07:37.622 --rc genhtml_function_coverage=1 00:07:37.622 --rc genhtml_legend=1 00:07:37.622 --rc geninfo_all_blocks=1 00:07:37.622 --rc geninfo_unexecuted_blocks=1 00:07:37.622 00:07:37.622 ' 00:07:37.622 01:08:45 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:37.622 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:37.622 --rc genhtml_branch_coverage=1 00:07:37.622 --rc genhtml_function_coverage=1 00:07:37.622 --rc genhtml_legend=1 00:07:37.622 --rc geninfo_all_blocks=1 00:07:37.622 --rc geninfo_unexecuted_blocks=1 00:07:37.622 00:07:37.622 ' 00:07:37.622 01:08:45 -- app/version.sh@17 -- # get_header_version major 00:07:37.622 01:08:45 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:37.622 01:08:45 -- app/version.sh@14 -- # cut -f2 00:07:37.622 01:08:45 -- app/version.sh@14 -- # tr -d '"' 00:07:37.622 01:08:45 -- app/version.sh@17 -- # major=24 00:07:37.622 01:08:45 -- app/version.sh@18 -- # get_header_version minor 00:07:37.622 01:08:45 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:37.622 01:08:45 -- app/version.sh@14 -- # cut -f2 00:07:37.622 01:08:45 -- app/version.sh@14 -- # tr -d '"' 00:07:37.622 01:08:45 -- app/version.sh@18 -- # minor=1 00:07:37.622 01:08:45 -- app/version.sh@19 -- # get_header_version patch 00:07:37.622 01:08:45 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:37.622 01:08:45 -- app/version.sh@14 -- # cut -f2 00:07:37.622 01:08:45 -- app/version.sh@14 -- # tr -d '"' 00:07:37.622 01:08:45 -- app/version.sh@19 -- # patch=1 00:07:37.622 01:08:45 -- app/version.sh@20 -- # get_header_version suffix 00:07:37.622 01:08:45 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:37.622 01:08:45 -- app/version.sh@14 -- # cut -f2 00:07:37.622 01:08:45 -- app/version.sh@14 -- # tr -d '"' 00:07:37.622 01:08:45 -- app/version.sh@20 -- # suffix=-pre 00:07:37.622 01:08:45 -- app/version.sh@22 -- # version=24.1 00:07:37.622 01:08:45 -- app/version.sh@25 -- # (( patch != 0 )) 00:07:37.622 01:08:45 -- app/version.sh@25 -- # version=24.1.1 00:07:37.622 01:08:45 -- app/version.sh@28 -- # version=24.1.1rc0 00:07:37.622 01:08:45 -- app/version.sh@30 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:07:37.622 01:08:45 -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:07:37.622 01:08:45 -- app/version.sh@30 -- # py_version=24.1.1rc0 00:07:37.622 01:08:45 -- app/version.sh@31 -- # [[ 24.1.1rc0 == \2\4\.\1\.\1\r\c\0 ]] 00:07:37.622 00:07:37.622 real 0m0.190s 00:07:37.622 user 0m0.122s 00:07:37.622 sys 0m0.093s 00:07:37.622 01:08:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:37.622 01:08:45 -- common/autotest_common.sh@10 -- # set +x 00:07:37.622 ************************************ 00:07:37.622 END TEST version 00:07:37.622 ************************************ 00:07:37.622 01:08:45 -- spdk/autotest.sh@181 -- # '[' 0 -eq 1 ']' 00:07:37.622 01:08:45 -- spdk/autotest.sh@191 -- # uname -s 00:07:37.622 01:08:45 -- spdk/autotest.sh@191 -- # [[ Linux == Linux ]] 00:07:37.622 01:08:45 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:07:37.622 01:08:45 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:07:37.622 01:08:45 -- spdk/autotest.sh@204 -- # '[' 0 -eq 1 ']' 00:07:37.622 01:08:45 -- spdk/autotest.sh@251 -- # '[' 0 -eq 1 ']' 00:07:37.622 01:08:45 -- spdk/autotest.sh@255 -- # timing_exit lib 00:07:37.622 01:08:45 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:37.622 01:08:45 -- common/autotest_common.sh@10 -- # set +x 00:07:37.622 01:08:45 -- spdk/autotest.sh@257 -- # '[' 0 -eq 1 ']' 00:07:37.622 01:08:45 -- spdk/autotest.sh@265 -- # '[' 0 -eq 1 ']' 00:07:37.622 01:08:45 -- spdk/autotest.sh@274 -- # '[' 1 -eq 1 ']' 00:07:37.622 01:08:45 -- spdk/autotest.sh@275 -- # export NET_TYPE 00:07:37.622 01:08:45 -- spdk/autotest.sh@278 -- # '[' tcp = rdma ']' 00:07:37.622 01:08:45 -- spdk/autotest.sh@281 -- # '[' tcp = tcp ']' 00:07:37.622 01:08:45 -- spdk/autotest.sh@282 -- # run_test nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:07:37.622 01:08:45 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:37.622 01:08:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:37.622 01:08:45 -- common/autotest_common.sh@10 -- # set +x 00:07:37.622 ************************************ 00:07:37.622 START TEST nvmf_tcp 00:07:37.622 ************************************ 00:07:37.622 01:08:45 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:07:37.881 * Looking for test storage... 00:07:37.881 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf 00:07:37.881 01:08:45 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:37.881 01:08:45 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:37.881 01:08:45 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:37.881 01:08:45 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:37.881 01:08:45 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:37.881 01:08:45 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:37.881 01:08:45 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:37.881 01:08:45 -- scripts/common.sh@335 -- # IFS=.-: 00:07:37.881 01:08:45 -- scripts/common.sh@335 -- # read -ra ver1 00:07:37.881 01:08:45 -- scripts/common.sh@336 -- # IFS=.-: 00:07:37.881 01:08:45 -- scripts/common.sh@336 -- # read -ra ver2 00:07:37.881 01:08:45 -- scripts/common.sh@337 -- # local 'op=<' 00:07:37.881 01:08:45 -- scripts/common.sh@339 -- # ver1_l=2 00:07:37.881 01:08:45 -- scripts/common.sh@340 -- # ver2_l=1 00:07:37.881 01:08:45 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:37.881 01:08:45 -- scripts/common.sh@343 -- # case "$op" in 00:07:37.881 01:08:45 -- scripts/common.sh@344 -- # : 1 00:07:37.881 01:08:45 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:37.881 01:08:45 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:37.881 01:08:45 -- scripts/common.sh@364 -- # decimal 1 00:07:37.881 01:08:45 -- scripts/common.sh@352 -- # local d=1 00:07:37.881 01:08:45 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:37.881 01:08:45 -- scripts/common.sh@354 -- # echo 1 00:07:37.881 01:08:45 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:37.881 01:08:45 -- scripts/common.sh@365 -- # decimal 2 00:07:37.881 01:08:45 -- scripts/common.sh@352 -- # local d=2 00:07:37.881 01:08:45 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:37.881 01:08:45 -- scripts/common.sh@354 -- # echo 2 00:07:37.881 01:08:45 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:37.881 01:08:45 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:37.881 01:08:45 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:37.881 01:08:45 -- scripts/common.sh@367 -- # return 0 00:07:37.881 01:08:45 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:37.881 01:08:45 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:37.881 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:37.881 --rc genhtml_branch_coverage=1 00:07:37.881 --rc genhtml_function_coverage=1 00:07:37.881 --rc genhtml_legend=1 00:07:37.881 --rc geninfo_all_blocks=1 00:07:37.881 --rc geninfo_unexecuted_blocks=1 00:07:37.881 00:07:37.881 ' 00:07:37.881 01:08:45 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:37.881 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:37.881 --rc genhtml_branch_coverage=1 00:07:37.881 --rc genhtml_function_coverage=1 00:07:37.881 --rc genhtml_legend=1 00:07:37.881 --rc geninfo_all_blocks=1 00:07:37.881 --rc geninfo_unexecuted_blocks=1 00:07:37.881 00:07:37.881 ' 00:07:37.881 01:08:45 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:37.881 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:37.881 --rc genhtml_branch_coverage=1 00:07:37.881 --rc genhtml_function_coverage=1 00:07:37.881 --rc genhtml_legend=1 00:07:37.881 --rc geninfo_all_blocks=1 00:07:37.881 --rc geninfo_unexecuted_blocks=1 00:07:37.881 00:07:37.881 ' 00:07:37.881 01:08:45 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:37.881 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:37.881 --rc genhtml_branch_coverage=1 00:07:37.881 --rc genhtml_function_coverage=1 00:07:37.881 --rc genhtml_legend=1 00:07:37.881 --rc geninfo_all_blocks=1 00:07:37.881 --rc geninfo_unexecuted_blocks=1 00:07:37.881 00:07:37.881 ' 00:07:37.881 01:08:45 -- nvmf/nvmf.sh@10 -- # uname -s 00:07:37.881 01:08:45 -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:07:37.881 01:08:45 -- nvmf/nvmf.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:37.881 01:08:45 -- nvmf/common.sh@7 -- # uname -s 00:07:37.881 01:08:45 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:37.881 01:08:45 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:37.881 01:08:45 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:37.881 01:08:45 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:37.881 01:08:45 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:37.881 01:08:45 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:37.881 01:08:45 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:37.881 01:08:45 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:37.881 01:08:45 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:37.881 01:08:45 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:37.881 01:08:45 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:37.881 01:08:45 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:37.882 01:08:45 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:37.882 01:08:45 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:37.882 01:08:45 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:37.882 01:08:45 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:37.882 01:08:45 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:37.882 01:08:45 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:37.882 01:08:45 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:37.882 01:08:45 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:37.882 01:08:45 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:37.882 01:08:45 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:37.882 01:08:45 -- paths/export.sh@5 -- # export PATH 00:07:37.882 01:08:45 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:37.882 01:08:45 -- nvmf/common.sh@46 -- # : 0 00:07:37.882 01:08:45 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:37.882 01:08:45 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:37.882 01:08:45 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:37.882 01:08:45 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:37.882 01:08:45 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:37.882 01:08:45 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:37.882 01:08:45 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:37.882 01:08:45 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:37.882 01:08:45 -- nvmf/nvmf.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:07:37.882 01:08:45 -- nvmf/nvmf.sh@18 -- # TEST_ARGS=("$@") 00:07:37.882 01:08:45 -- nvmf/nvmf.sh@20 -- # timing_enter target 00:07:37.882 01:08:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:37.882 01:08:45 -- common/autotest_common.sh@10 -- # set +x 00:07:37.882 01:08:45 -- nvmf/nvmf.sh@22 -- # [[ 0 -eq 0 ]] 00:07:37.882 01:08:45 -- nvmf/nvmf.sh@23 -- # run_test nvmf_example /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:07:37.882 01:08:45 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:37.882 01:08:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:37.882 01:08:45 -- common/autotest_common.sh@10 -- # set +x 00:07:37.882 ************************************ 00:07:37.882 START TEST nvmf_example 00:07:37.882 ************************************ 00:07:37.882 01:08:45 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:07:37.882 * Looking for test storage... 00:07:37.882 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:37.882 01:08:46 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:37.882 01:08:46 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:37.882 01:08:46 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:37.882 01:08:46 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:37.882 01:08:46 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:37.882 01:08:46 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:37.882 01:08:46 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:37.882 01:08:46 -- scripts/common.sh@335 -- # IFS=.-: 00:07:37.882 01:08:46 -- scripts/common.sh@335 -- # read -ra ver1 00:07:37.882 01:08:46 -- scripts/common.sh@336 -- # IFS=.-: 00:07:37.882 01:08:46 -- scripts/common.sh@336 -- # read -ra ver2 00:07:38.141 01:08:46 -- scripts/common.sh@337 -- # local 'op=<' 00:07:38.141 01:08:46 -- scripts/common.sh@339 -- # ver1_l=2 00:07:38.141 01:08:46 -- scripts/common.sh@340 -- # ver2_l=1 00:07:38.141 01:08:46 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:38.141 01:08:46 -- scripts/common.sh@343 -- # case "$op" in 00:07:38.141 01:08:46 -- scripts/common.sh@344 -- # : 1 00:07:38.141 01:08:46 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:38.141 01:08:46 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:38.141 01:08:46 -- scripts/common.sh@364 -- # decimal 1 00:07:38.141 01:08:46 -- scripts/common.sh@352 -- # local d=1 00:07:38.141 01:08:46 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:38.141 01:08:46 -- scripts/common.sh@354 -- # echo 1 00:07:38.141 01:08:46 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:38.141 01:08:46 -- scripts/common.sh@365 -- # decimal 2 00:07:38.141 01:08:46 -- scripts/common.sh@352 -- # local d=2 00:07:38.141 01:08:46 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:38.141 01:08:46 -- scripts/common.sh@354 -- # echo 2 00:07:38.141 01:08:46 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:38.141 01:08:46 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:38.141 01:08:46 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:38.141 01:08:46 -- scripts/common.sh@367 -- # return 0 00:07:38.141 01:08:46 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:38.141 01:08:46 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:38.141 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:38.141 --rc genhtml_branch_coverage=1 00:07:38.141 --rc genhtml_function_coverage=1 00:07:38.141 --rc genhtml_legend=1 00:07:38.141 --rc geninfo_all_blocks=1 00:07:38.141 --rc geninfo_unexecuted_blocks=1 00:07:38.141 00:07:38.141 ' 00:07:38.141 01:08:46 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:38.141 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:38.141 --rc genhtml_branch_coverage=1 00:07:38.141 --rc genhtml_function_coverage=1 00:07:38.141 --rc genhtml_legend=1 00:07:38.141 --rc geninfo_all_blocks=1 00:07:38.141 --rc geninfo_unexecuted_blocks=1 00:07:38.141 00:07:38.141 ' 00:07:38.141 01:08:46 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:38.141 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:38.141 --rc genhtml_branch_coverage=1 00:07:38.141 --rc genhtml_function_coverage=1 00:07:38.141 --rc genhtml_legend=1 00:07:38.141 --rc geninfo_all_blocks=1 00:07:38.141 --rc geninfo_unexecuted_blocks=1 00:07:38.141 00:07:38.141 ' 00:07:38.141 01:08:46 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:38.141 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:38.141 --rc genhtml_branch_coverage=1 00:07:38.141 --rc genhtml_function_coverage=1 00:07:38.141 --rc genhtml_legend=1 00:07:38.141 --rc geninfo_all_blocks=1 00:07:38.141 --rc geninfo_unexecuted_blocks=1 00:07:38.141 00:07:38.141 ' 00:07:38.141 01:08:46 -- target/nvmf_example.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:38.141 01:08:46 -- nvmf/common.sh@7 -- # uname -s 00:07:38.141 01:08:46 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:38.141 01:08:46 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:38.141 01:08:46 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:38.141 01:08:46 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:38.141 01:08:46 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:38.141 01:08:46 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:38.141 01:08:46 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:38.141 01:08:46 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:38.141 01:08:46 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:38.141 01:08:46 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:38.141 01:08:46 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:38.141 01:08:46 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:38.141 01:08:46 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:38.141 01:08:46 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:38.141 01:08:46 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:38.141 01:08:46 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:38.141 01:08:46 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:38.141 01:08:46 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:38.141 01:08:46 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:38.141 01:08:46 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:38.141 01:08:46 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:38.141 01:08:46 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:38.141 01:08:46 -- paths/export.sh@5 -- # export PATH 00:07:38.141 01:08:46 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:38.141 01:08:46 -- nvmf/common.sh@46 -- # : 0 00:07:38.141 01:08:46 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:38.141 01:08:46 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:38.141 01:08:46 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:38.141 01:08:46 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:38.141 01:08:46 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:38.141 01:08:46 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:38.141 01:08:46 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:38.141 01:08:46 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:38.141 01:08:46 -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:07:38.141 01:08:46 -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:07:38.141 01:08:46 -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:07:38.141 01:08:46 -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:07:38.142 01:08:46 -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:07:38.142 01:08:46 -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:07:38.142 01:08:46 -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:07:38.142 01:08:46 -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:07:38.142 01:08:46 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:38.142 01:08:46 -- common/autotest_common.sh@10 -- # set +x 00:07:38.142 01:08:46 -- target/nvmf_example.sh@41 -- # nvmftestinit 00:07:38.142 01:08:46 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:38.142 01:08:46 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:38.142 01:08:46 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:38.142 01:08:46 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:38.142 01:08:46 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:38.142 01:08:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:38.142 01:08:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:38.142 01:08:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:38.142 01:08:46 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:38.142 01:08:46 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:38.142 01:08:46 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:38.142 01:08:46 -- common/autotest_common.sh@10 -- # set +x 00:07:40.043 01:08:48 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:40.043 01:08:48 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:40.043 01:08:48 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:40.043 01:08:48 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:40.043 01:08:48 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:40.043 01:08:48 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:40.043 01:08:48 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:40.043 01:08:48 -- nvmf/common.sh@294 -- # net_devs=() 00:07:40.044 01:08:48 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:40.044 01:08:48 -- nvmf/common.sh@295 -- # e810=() 00:07:40.044 01:08:48 -- nvmf/common.sh@295 -- # local -ga e810 00:07:40.044 01:08:48 -- nvmf/common.sh@296 -- # x722=() 00:07:40.044 01:08:48 -- nvmf/common.sh@296 -- # local -ga x722 00:07:40.044 01:08:48 -- nvmf/common.sh@297 -- # mlx=() 00:07:40.044 01:08:48 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:40.044 01:08:48 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:40.044 01:08:48 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:40.044 01:08:48 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:40.044 01:08:48 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:40.044 01:08:48 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:40.044 01:08:48 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:40.044 01:08:48 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:40.044 01:08:48 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:40.044 01:08:48 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:40.044 01:08:48 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:40.044 01:08:48 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:40.044 01:08:48 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:40.044 01:08:48 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:40.044 01:08:48 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:40.044 01:08:48 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:40.044 01:08:48 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:40.044 01:08:48 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:40.044 01:08:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:40.044 01:08:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:40.044 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:40.044 01:08:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:40.044 01:08:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:40.044 01:08:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:40.044 01:08:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:40.044 01:08:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:40.044 01:08:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:40.044 01:08:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:40.044 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:40.044 01:08:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:40.044 01:08:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:40.044 01:08:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:40.044 01:08:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:40.044 01:08:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:40.044 01:08:48 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:40.044 01:08:48 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:40.044 01:08:48 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:40.044 01:08:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:40.044 01:08:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:40.044 01:08:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:40.044 01:08:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:40.044 01:08:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:40.044 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:40.044 01:08:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:40.044 01:08:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:40.044 01:08:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:40.044 01:08:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:40.044 01:08:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:40.044 01:08:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:40.044 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:40.044 01:08:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:40.044 01:08:48 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:40.044 01:08:48 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:40.044 01:08:48 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:40.044 01:08:48 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:40.044 01:08:48 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:40.044 01:08:48 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:40.044 01:08:48 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:40.044 01:08:48 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:40.044 01:08:48 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:40.044 01:08:48 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:40.044 01:08:48 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:40.044 01:08:48 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:40.044 01:08:48 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:40.044 01:08:48 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:40.044 01:08:48 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:40.044 01:08:48 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:40.044 01:08:48 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:40.044 01:08:48 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:40.044 01:08:48 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:40.044 01:08:48 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:40.044 01:08:48 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:40.044 01:08:48 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:40.044 01:08:48 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:40.044 01:08:48 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:40.044 01:08:48 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:40.044 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:40.044 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.294 ms 00:07:40.044 00:07:40.044 --- 10.0.0.2 ping statistics --- 00:07:40.044 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:40.044 rtt min/avg/max/mdev = 0.294/0.294/0.294/0.000 ms 00:07:40.044 01:08:48 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:40.044 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:40.044 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.084 ms 00:07:40.044 00:07:40.044 --- 10.0.0.1 ping statistics --- 00:07:40.044 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:40.044 rtt min/avg/max/mdev = 0.084/0.084/0.084/0.000 ms 00:07:40.044 01:08:48 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:40.044 01:08:48 -- nvmf/common.sh@410 -- # return 0 00:07:40.044 01:08:48 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:40.044 01:08:48 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:40.044 01:08:48 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:40.044 01:08:48 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:40.044 01:08:48 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:40.044 01:08:48 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:40.044 01:08:48 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:40.302 01:08:48 -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:07:40.302 01:08:48 -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:07:40.302 01:08:48 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:40.302 01:08:48 -- common/autotest_common.sh@10 -- # set +x 00:07:40.302 01:08:48 -- target/nvmf_example.sh@29 -- # '[' tcp == tcp ']' 00:07:40.302 01:08:48 -- target/nvmf_example.sh@30 -- # NVMF_EXAMPLE=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_EXAMPLE[@]}") 00:07:40.303 01:08:48 -- target/nvmf_example.sh@34 -- # nvmfpid=1034596 00:07:40.303 01:08:48 -- target/nvmf_example.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:07:40.303 01:08:48 -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:07:40.303 01:08:48 -- target/nvmf_example.sh@36 -- # waitforlisten 1034596 00:07:40.303 01:08:48 -- common/autotest_common.sh@829 -- # '[' -z 1034596 ']' 00:07:40.303 01:08:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:40.303 01:08:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:40.303 01:08:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:40.303 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:40.303 01:08:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:40.303 01:08:48 -- common/autotest_common.sh@10 -- # set +x 00:07:40.303 EAL: No free 2048 kB hugepages reported on node 1 00:07:40.561 01:08:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:40.561 01:08:48 -- common/autotest_common.sh@862 -- # return 0 00:07:40.561 01:08:48 -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:07:40.561 01:08:48 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:40.561 01:08:48 -- common/autotest_common.sh@10 -- # set +x 00:07:40.561 01:08:48 -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:40.561 01:08:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:40.561 01:08:48 -- common/autotest_common.sh@10 -- # set +x 00:07:40.561 01:08:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:40.561 01:08:48 -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:07:40.561 01:08:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:40.561 01:08:48 -- common/autotest_common.sh@10 -- # set +x 00:07:40.561 01:08:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:40.561 01:08:48 -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:07:40.561 01:08:48 -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:07:40.561 01:08:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:40.561 01:08:48 -- common/autotest_common.sh@10 -- # set +x 00:07:40.561 01:08:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:40.561 01:08:48 -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:07:40.561 01:08:48 -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:07:40.561 01:08:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:40.561 01:08:48 -- common/autotest_common.sh@10 -- # set +x 00:07:40.561 01:08:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:40.561 01:08:48 -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:40.561 01:08:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:40.561 01:08:48 -- common/autotest_common.sh@10 -- # set +x 00:07:40.561 01:08:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:40.561 01:08:48 -- target/nvmf_example.sh@59 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:07:40.561 01:08:48 -- target/nvmf_example.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:07:40.561 EAL: No free 2048 kB hugepages reported on node 1 00:07:52.759 Initializing NVMe Controllers 00:07:52.759 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:07:52.759 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:07:52.759 Initialization complete. Launching workers. 00:07:52.759 ======================================================== 00:07:52.759 Latency(us) 00:07:52.759 Device Information : IOPS MiB/s Average min max 00:07:52.759 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 15472.05 60.44 4136.13 885.25 20171.43 00:07:52.759 ======================================================== 00:07:52.759 Total : 15472.05 60.44 4136.13 885.25 20171.43 00:07:52.759 00:07:52.759 01:08:58 -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:07:52.759 01:08:58 -- target/nvmf_example.sh@66 -- # nvmftestfini 00:07:52.759 01:08:58 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:52.759 01:08:58 -- nvmf/common.sh@116 -- # sync 00:07:52.759 01:08:58 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:52.759 01:08:58 -- nvmf/common.sh@119 -- # set +e 00:07:52.759 01:08:58 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:52.759 01:08:58 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:52.759 rmmod nvme_tcp 00:07:52.759 rmmod nvme_fabrics 00:07:52.759 rmmod nvme_keyring 00:07:52.759 01:08:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:52.759 01:08:58 -- nvmf/common.sh@123 -- # set -e 00:07:52.759 01:08:58 -- nvmf/common.sh@124 -- # return 0 00:07:52.759 01:08:58 -- nvmf/common.sh@477 -- # '[' -n 1034596 ']' 00:07:52.759 01:08:58 -- nvmf/common.sh@478 -- # killprocess 1034596 00:07:52.759 01:08:58 -- common/autotest_common.sh@936 -- # '[' -z 1034596 ']' 00:07:52.759 01:08:58 -- common/autotest_common.sh@940 -- # kill -0 1034596 00:07:52.759 01:08:58 -- common/autotest_common.sh@941 -- # uname 00:07:52.759 01:08:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:52.759 01:08:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1034596 00:07:52.759 01:08:58 -- common/autotest_common.sh@942 -- # process_name=nvmf 00:07:52.759 01:08:58 -- common/autotest_common.sh@946 -- # '[' nvmf = sudo ']' 00:07:52.759 01:08:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1034596' 00:07:52.759 killing process with pid 1034596 00:07:52.759 01:08:58 -- common/autotest_common.sh@955 -- # kill 1034596 00:07:52.759 01:08:58 -- common/autotest_common.sh@960 -- # wait 1034596 00:07:52.759 nvmf threads initialize successfully 00:07:52.759 bdev subsystem init successfully 00:07:52.759 created a nvmf target service 00:07:52.759 create targets's poll groups done 00:07:52.759 all subsystems of target started 00:07:52.759 nvmf target is running 00:07:52.759 all subsystems of target stopped 00:07:52.759 destroy targets's poll groups done 00:07:52.759 destroyed the nvmf target service 00:07:52.759 bdev subsystem finish successfully 00:07:52.759 nvmf threads destroy successfully 00:07:52.759 01:08:59 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:52.759 01:08:59 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:52.759 01:08:59 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:52.759 01:08:59 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:52.759 01:08:59 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:52.759 01:08:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:52.759 01:08:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:52.759 01:08:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:53.017 01:09:01 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:53.017 01:09:01 -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:07:53.017 01:09:01 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:53.017 01:09:01 -- common/autotest_common.sh@10 -- # set +x 00:07:53.017 00:07:53.017 real 0m15.225s 00:07:53.017 user 0m42.040s 00:07:53.017 sys 0m3.249s 00:07:53.017 01:09:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:53.017 01:09:01 -- common/autotest_common.sh@10 -- # set +x 00:07:53.017 ************************************ 00:07:53.017 END TEST nvmf_example 00:07:53.017 ************************************ 00:07:53.017 01:09:01 -- nvmf/nvmf.sh@24 -- # run_test nvmf_filesystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:07:53.017 01:09:01 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:53.017 01:09:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:53.017 01:09:01 -- common/autotest_common.sh@10 -- # set +x 00:07:53.018 ************************************ 00:07:53.018 START TEST nvmf_filesystem 00:07:53.018 ************************************ 00:07:53.018 01:09:01 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:07:53.279 * Looking for test storage... 00:07:53.279 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:53.279 01:09:01 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:53.279 01:09:01 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:53.279 01:09:01 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:53.279 01:09:01 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:53.279 01:09:01 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:53.279 01:09:01 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:53.279 01:09:01 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:53.279 01:09:01 -- scripts/common.sh@335 -- # IFS=.-: 00:07:53.279 01:09:01 -- scripts/common.sh@335 -- # read -ra ver1 00:07:53.279 01:09:01 -- scripts/common.sh@336 -- # IFS=.-: 00:07:53.279 01:09:01 -- scripts/common.sh@336 -- # read -ra ver2 00:07:53.279 01:09:01 -- scripts/common.sh@337 -- # local 'op=<' 00:07:53.279 01:09:01 -- scripts/common.sh@339 -- # ver1_l=2 00:07:53.279 01:09:01 -- scripts/common.sh@340 -- # ver2_l=1 00:07:53.279 01:09:01 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:53.279 01:09:01 -- scripts/common.sh@343 -- # case "$op" in 00:07:53.279 01:09:01 -- scripts/common.sh@344 -- # : 1 00:07:53.279 01:09:01 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:53.279 01:09:01 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:53.279 01:09:01 -- scripts/common.sh@364 -- # decimal 1 00:07:53.279 01:09:01 -- scripts/common.sh@352 -- # local d=1 00:07:53.279 01:09:01 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:53.279 01:09:01 -- scripts/common.sh@354 -- # echo 1 00:07:53.279 01:09:01 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:53.279 01:09:01 -- scripts/common.sh@365 -- # decimal 2 00:07:53.279 01:09:01 -- scripts/common.sh@352 -- # local d=2 00:07:53.279 01:09:01 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:53.279 01:09:01 -- scripts/common.sh@354 -- # echo 2 00:07:53.279 01:09:01 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:53.279 01:09:01 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:53.279 01:09:01 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:53.279 01:09:01 -- scripts/common.sh@367 -- # return 0 00:07:53.279 01:09:01 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:53.279 01:09:01 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:53.279 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:53.279 --rc genhtml_branch_coverage=1 00:07:53.279 --rc genhtml_function_coverage=1 00:07:53.279 --rc genhtml_legend=1 00:07:53.279 --rc geninfo_all_blocks=1 00:07:53.279 --rc geninfo_unexecuted_blocks=1 00:07:53.279 00:07:53.279 ' 00:07:53.279 01:09:01 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:53.279 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:53.279 --rc genhtml_branch_coverage=1 00:07:53.279 --rc genhtml_function_coverage=1 00:07:53.279 --rc genhtml_legend=1 00:07:53.279 --rc geninfo_all_blocks=1 00:07:53.279 --rc geninfo_unexecuted_blocks=1 00:07:53.279 00:07:53.279 ' 00:07:53.279 01:09:01 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:53.279 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:53.279 --rc genhtml_branch_coverage=1 00:07:53.279 --rc genhtml_function_coverage=1 00:07:53.279 --rc genhtml_legend=1 00:07:53.279 --rc geninfo_all_blocks=1 00:07:53.279 --rc geninfo_unexecuted_blocks=1 00:07:53.279 00:07:53.279 ' 00:07:53.279 01:09:01 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:53.279 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:53.279 --rc genhtml_branch_coverage=1 00:07:53.279 --rc genhtml_function_coverage=1 00:07:53.279 --rc genhtml_legend=1 00:07:53.279 --rc geninfo_all_blocks=1 00:07:53.279 --rc geninfo_unexecuted_blocks=1 00:07:53.279 00:07:53.279 ' 00:07:53.279 01:09:01 -- target/filesystem.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh 00:07:53.279 01:09:01 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:07:53.279 01:09:01 -- common/autotest_common.sh@34 -- # set -e 00:07:53.279 01:09:01 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:07:53.279 01:09:01 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:07:53.279 01:09:01 -- common/autotest_common.sh@38 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh ]] 00:07:53.279 01:09:01 -- common/autotest_common.sh@39 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh 00:07:53.279 01:09:01 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:07:53.279 01:09:01 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:07:53.279 01:09:01 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:07:53.279 01:09:01 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:07:53.279 01:09:01 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:07:53.279 01:09:01 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:07:53.279 01:09:01 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:07:53.279 01:09:01 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:07:53.279 01:09:01 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:07:53.279 01:09:01 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:07:53.279 01:09:01 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:07:53.279 01:09:01 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:07:53.279 01:09:01 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:07:53.279 01:09:01 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:07:53.279 01:09:01 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:07:53.279 01:09:01 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:07:53.279 01:09:01 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:07:53.279 01:09:01 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:07:53.279 01:09:01 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:07:53.279 01:09:01 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:07:53.279 01:09:01 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:07:53.279 01:09:01 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:07:53.279 01:09:01 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:07:53.279 01:09:01 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:07:53.279 01:09:01 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:07:53.279 01:09:01 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:07:53.279 01:09:01 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:07:53.279 01:09:01 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:07:53.279 01:09:01 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:07:53.279 01:09:01 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:07:53.279 01:09:01 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:07:53.279 01:09:01 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:07:53.279 01:09:01 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:07:53.279 01:09:01 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:07:53.279 01:09:01 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:07:53.279 01:09:01 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:07:53.279 01:09:01 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:07:53.279 01:09:01 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:07:53.279 01:09:01 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:07:53.279 01:09:01 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:07:53.279 01:09:01 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR=//var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:07:53.279 01:09:01 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:07:53.279 01:09:01 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:07:53.279 01:09:01 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:07:53.279 01:09:01 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:07:53.279 01:09:01 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:07:53.279 01:09:01 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:07:53.279 01:09:01 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:07:53.279 01:09:01 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:07:53.279 01:09:01 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:07:53.279 01:09:01 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=y 00:07:53.279 01:09:01 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:07:53.279 01:09:01 -- common/build_config.sh@53 -- # CONFIG_URING_ZNS=n 00:07:53.279 01:09:01 -- common/build_config.sh@54 -- # CONFIG_WERROR=y 00:07:53.279 01:09:01 -- common/build_config.sh@55 -- # CONFIG_HAVE_LIBBSD=n 00:07:53.279 01:09:01 -- common/build_config.sh@56 -- # CONFIG_UBSAN=y 00:07:53.279 01:09:01 -- common/build_config.sh@57 -- # CONFIG_IPSEC_MB_DIR= 00:07:53.279 01:09:01 -- common/build_config.sh@58 -- # CONFIG_GOLANG=n 00:07:53.279 01:09:01 -- common/build_config.sh@59 -- # CONFIG_ISAL=y 00:07:53.279 01:09:01 -- common/build_config.sh@60 -- # CONFIG_IDXD_KERNEL=y 00:07:53.280 01:09:01 -- common/build_config.sh@61 -- # CONFIG_DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:07:53.280 01:09:01 -- common/build_config.sh@62 -- # CONFIG_RDMA_PROV=verbs 00:07:53.280 01:09:01 -- common/build_config.sh@63 -- # CONFIG_APPS=y 00:07:53.280 01:09:01 -- common/build_config.sh@64 -- # CONFIG_SHARED=y 00:07:53.280 01:09:01 -- common/build_config.sh@65 -- # CONFIG_FC_PATH= 00:07:53.280 01:09:01 -- common/build_config.sh@66 -- # CONFIG_DPDK_PKG_CONFIG=n 00:07:53.280 01:09:01 -- common/build_config.sh@67 -- # CONFIG_FC=n 00:07:53.280 01:09:01 -- common/build_config.sh@68 -- # CONFIG_AVAHI=n 00:07:53.280 01:09:01 -- common/build_config.sh@69 -- # CONFIG_FIO_PLUGIN=y 00:07:53.280 01:09:01 -- common/build_config.sh@70 -- # CONFIG_RAID5F=n 00:07:53.280 01:09:01 -- common/build_config.sh@71 -- # CONFIG_EXAMPLES=y 00:07:53.280 01:09:01 -- common/build_config.sh@72 -- # CONFIG_TESTS=y 00:07:53.280 01:09:01 -- common/build_config.sh@73 -- # CONFIG_CRYPTO_MLX5=n 00:07:53.280 01:09:01 -- common/build_config.sh@74 -- # CONFIG_MAX_LCORES= 00:07:53.280 01:09:01 -- common/build_config.sh@75 -- # CONFIG_IPSEC_MB=n 00:07:53.280 01:09:01 -- common/build_config.sh@76 -- # CONFIG_DEBUG=y 00:07:53.280 01:09:01 -- common/build_config.sh@77 -- # CONFIG_DPDK_COMPRESSDEV=n 00:07:53.280 01:09:01 -- common/build_config.sh@78 -- # CONFIG_CROSS_PREFIX= 00:07:53.280 01:09:01 -- common/build_config.sh@79 -- # CONFIG_URING=n 00:07:53.280 01:09:01 -- common/autotest_common.sh@48 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:07:53.280 01:09:01 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:07:53.280 01:09:01 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:07:53.280 01:09:01 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:07:53.280 01:09:01 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:07:53.280 01:09:01 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:07:53.280 01:09:01 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:07:53.280 01:09:01 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:07:53.280 01:09:01 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:07:53.280 01:09:01 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:07:53.280 01:09:01 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:07:53.280 01:09:01 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:07:53.280 01:09:01 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:07:53.280 01:09:01 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:07:53.280 01:09:01 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/config.h ]] 00:07:53.280 01:09:01 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:07:53.280 #define SPDK_CONFIG_H 00:07:53.280 #define SPDK_CONFIG_APPS 1 00:07:53.280 #define SPDK_CONFIG_ARCH native 00:07:53.280 #undef SPDK_CONFIG_ASAN 00:07:53.280 #undef SPDK_CONFIG_AVAHI 00:07:53.280 #undef SPDK_CONFIG_CET 00:07:53.280 #define SPDK_CONFIG_COVERAGE 1 00:07:53.280 #define SPDK_CONFIG_CROSS_PREFIX 00:07:53.280 #undef SPDK_CONFIG_CRYPTO 00:07:53.280 #undef SPDK_CONFIG_CRYPTO_MLX5 00:07:53.280 #undef SPDK_CONFIG_CUSTOMOCF 00:07:53.280 #undef SPDK_CONFIG_DAOS 00:07:53.280 #define SPDK_CONFIG_DAOS_DIR 00:07:53.280 #define SPDK_CONFIG_DEBUG 1 00:07:53.280 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:07:53.280 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:07:53.280 #define SPDK_CONFIG_DPDK_INC_DIR //var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:07:53.280 #define SPDK_CONFIG_DPDK_LIB_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:07:53.280 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:07:53.280 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:07:53.280 #define SPDK_CONFIG_EXAMPLES 1 00:07:53.280 #undef SPDK_CONFIG_FC 00:07:53.280 #define SPDK_CONFIG_FC_PATH 00:07:53.280 #define SPDK_CONFIG_FIO_PLUGIN 1 00:07:53.280 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:07:53.280 #undef SPDK_CONFIG_FUSE 00:07:53.280 #undef SPDK_CONFIG_FUZZER 00:07:53.280 #define SPDK_CONFIG_FUZZER_LIB 00:07:53.280 #undef SPDK_CONFIG_GOLANG 00:07:53.280 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:07:53.280 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:07:53.280 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:07:53.280 #undef SPDK_CONFIG_HAVE_LIBBSD 00:07:53.280 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:07:53.280 #define SPDK_CONFIG_IDXD 1 00:07:53.280 #define SPDK_CONFIG_IDXD_KERNEL 1 00:07:53.280 #undef SPDK_CONFIG_IPSEC_MB 00:07:53.280 #define SPDK_CONFIG_IPSEC_MB_DIR 00:07:53.280 #define SPDK_CONFIG_ISAL 1 00:07:53.280 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:07:53.280 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:07:53.280 #define SPDK_CONFIG_LIBDIR 00:07:53.280 #undef SPDK_CONFIG_LTO 00:07:53.280 #define SPDK_CONFIG_MAX_LCORES 00:07:53.280 #define SPDK_CONFIG_NVME_CUSE 1 00:07:53.280 #undef SPDK_CONFIG_OCF 00:07:53.280 #define SPDK_CONFIG_OCF_PATH 00:07:53.280 #define SPDK_CONFIG_OPENSSL_PATH 00:07:53.280 #undef SPDK_CONFIG_PGO_CAPTURE 00:07:53.280 #undef SPDK_CONFIG_PGO_USE 00:07:53.280 #define SPDK_CONFIG_PREFIX /usr/local 00:07:53.280 #undef SPDK_CONFIG_RAID5F 00:07:53.280 #undef SPDK_CONFIG_RBD 00:07:53.280 #define SPDK_CONFIG_RDMA 1 00:07:53.280 #define SPDK_CONFIG_RDMA_PROV verbs 00:07:53.280 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:07:53.280 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:07:53.280 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:07:53.280 #define SPDK_CONFIG_SHARED 1 00:07:53.280 #undef SPDK_CONFIG_SMA 00:07:53.280 #define SPDK_CONFIG_TESTS 1 00:07:53.280 #undef SPDK_CONFIG_TSAN 00:07:53.280 #define SPDK_CONFIG_UBLK 1 00:07:53.280 #define SPDK_CONFIG_UBSAN 1 00:07:53.280 #undef SPDK_CONFIG_UNIT_TESTS 00:07:53.280 #undef SPDK_CONFIG_URING 00:07:53.280 #define SPDK_CONFIG_URING_PATH 00:07:53.280 #undef SPDK_CONFIG_URING_ZNS 00:07:53.280 #undef SPDK_CONFIG_USDT 00:07:53.280 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:07:53.280 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:07:53.280 #define SPDK_CONFIG_VFIO_USER 1 00:07:53.280 #define SPDK_CONFIG_VFIO_USER_DIR 00:07:53.280 #define SPDK_CONFIG_VHOST 1 00:07:53.280 #define SPDK_CONFIG_VIRTIO 1 00:07:53.280 #undef SPDK_CONFIG_VTUNE 00:07:53.280 #define SPDK_CONFIG_VTUNE_DIR 00:07:53.280 #define SPDK_CONFIG_WERROR 1 00:07:53.280 #define SPDK_CONFIG_WPDK_DIR 00:07:53.280 #undef SPDK_CONFIG_XNVME 00:07:53.280 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:07:53.280 01:09:01 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:07:53.280 01:09:01 -- common/autotest_common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:53.280 01:09:01 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:53.280 01:09:01 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:53.280 01:09:01 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:53.280 01:09:01 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:53.280 01:09:01 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:53.280 01:09:01 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:53.280 01:09:01 -- paths/export.sh@5 -- # export PATH 00:07:53.280 01:09:01 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:53.280 01:09:01 -- common/autotest_common.sh@50 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:07:53.280 01:09:01 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:07:53.280 01:09:01 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:07:53.280 01:09:01 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:07:53.280 01:09:01 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/../../../ 00:07:53.280 01:09:01 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:07:53.280 01:09:01 -- pm/common@16 -- # TEST_TAG=N/A 00:07:53.281 01:09:01 -- pm/common@17 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/.run_test_name 00:07:53.281 01:09:01 -- common/autotest_common.sh@52 -- # : 1 00:07:53.281 01:09:01 -- common/autotest_common.sh@53 -- # export RUN_NIGHTLY 00:07:53.281 01:09:01 -- common/autotest_common.sh@56 -- # : 0 00:07:53.281 01:09:01 -- common/autotest_common.sh@57 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:07:53.281 01:09:01 -- common/autotest_common.sh@58 -- # : 0 00:07:53.281 01:09:01 -- common/autotest_common.sh@59 -- # export SPDK_RUN_VALGRIND 00:07:53.281 01:09:01 -- common/autotest_common.sh@60 -- # : 1 00:07:53.281 01:09:01 -- common/autotest_common.sh@61 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:07:53.281 01:09:01 -- common/autotest_common.sh@62 -- # : 0 00:07:53.281 01:09:01 -- common/autotest_common.sh@63 -- # export SPDK_TEST_UNITTEST 00:07:53.281 01:09:01 -- common/autotest_common.sh@64 -- # : 00:07:53.281 01:09:01 -- common/autotest_common.sh@65 -- # export SPDK_TEST_AUTOBUILD 00:07:53.281 01:09:01 -- common/autotest_common.sh@66 -- # : 0 00:07:53.281 01:09:01 -- common/autotest_common.sh@67 -- # export SPDK_TEST_RELEASE_BUILD 00:07:53.281 01:09:01 -- common/autotest_common.sh@68 -- # : 0 00:07:53.281 01:09:01 -- common/autotest_common.sh@69 -- # export SPDK_TEST_ISAL 00:07:53.281 01:09:01 -- common/autotest_common.sh@70 -- # : 0 00:07:53.281 01:09:01 -- common/autotest_common.sh@71 -- # export SPDK_TEST_ISCSI 00:07:53.281 01:09:01 -- common/autotest_common.sh@72 -- # : 0 00:07:53.281 01:09:01 -- common/autotest_common.sh@73 -- # export SPDK_TEST_ISCSI_INITIATOR 00:07:53.281 01:09:01 -- common/autotest_common.sh@74 -- # : 0 00:07:53.281 01:09:01 -- common/autotest_common.sh@75 -- # export SPDK_TEST_NVME 00:07:53.281 01:09:01 -- common/autotest_common.sh@76 -- # : 0 00:07:53.281 01:09:01 -- common/autotest_common.sh@77 -- # export SPDK_TEST_NVME_PMR 00:07:53.281 01:09:01 -- common/autotest_common.sh@78 -- # : 0 00:07:53.281 01:09:01 -- common/autotest_common.sh@79 -- # export SPDK_TEST_NVME_BP 00:07:53.281 01:09:01 -- common/autotest_common.sh@80 -- # : 1 00:07:53.281 01:09:01 -- common/autotest_common.sh@81 -- # export SPDK_TEST_NVME_CLI 00:07:53.281 01:09:01 -- common/autotest_common.sh@82 -- # : 0 00:07:53.281 01:09:01 -- common/autotest_common.sh@83 -- # export SPDK_TEST_NVME_CUSE 00:07:53.281 01:09:01 -- common/autotest_common.sh@84 -- # : 0 00:07:53.281 01:09:01 -- common/autotest_common.sh@85 -- # export SPDK_TEST_NVME_FDP 00:07:53.281 01:09:01 -- common/autotest_common.sh@86 -- # : 1 00:07:53.281 01:09:01 -- common/autotest_common.sh@87 -- # export SPDK_TEST_NVMF 00:07:53.281 01:09:01 -- common/autotest_common.sh@88 -- # : 1 00:07:53.281 01:09:01 -- common/autotest_common.sh@89 -- # export SPDK_TEST_VFIOUSER 00:07:53.281 01:09:01 -- common/autotest_common.sh@90 -- # : 0 00:07:53.281 01:09:01 -- common/autotest_common.sh@91 -- # export SPDK_TEST_VFIOUSER_QEMU 00:07:53.281 01:09:01 -- common/autotest_common.sh@92 -- # : 0 00:07:53.281 01:09:01 -- common/autotest_common.sh@93 -- # export SPDK_TEST_FUZZER 00:07:53.281 01:09:01 -- common/autotest_common.sh@94 -- # : 0 00:07:53.281 01:09:01 -- common/autotest_common.sh@95 -- # export SPDK_TEST_FUZZER_SHORT 00:07:53.281 01:09:01 -- common/autotest_common.sh@96 -- # : tcp 00:07:53.281 01:09:01 -- common/autotest_common.sh@97 -- # export SPDK_TEST_NVMF_TRANSPORT 00:07:53.281 01:09:01 -- common/autotest_common.sh@98 -- # : 0 00:07:53.281 01:09:01 -- common/autotest_common.sh@99 -- # export SPDK_TEST_RBD 00:07:53.281 01:09:01 -- common/autotest_common.sh@100 -- # : 0 00:07:53.281 01:09:01 -- common/autotest_common.sh@101 -- # export SPDK_TEST_VHOST 00:07:53.281 01:09:01 -- common/autotest_common.sh@102 -- # : 0 00:07:53.281 01:09:01 -- common/autotest_common.sh@103 -- # export SPDK_TEST_BLOCKDEV 00:07:53.281 01:09:01 -- common/autotest_common.sh@104 -- # : 0 00:07:53.281 01:09:01 -- common/autotest_common.sh@105 -- # export SPDK_TEST_IOAT 00:07:53.281 01:09:01 -- common/autotest_common.sh@106 -- # : 0 00:07:53.281 01:09:01 -- common/autotest_common.sh@107 -- # export SPDK_TEST_BLOBFS 00:07:53.281 01:09:01 -- common/autotest_common.sh@108 -- # : 0 00:07:53.281 01:09:01 -- common/autotest_common.sh@109 -- # export SPDK_TEST_VHOST_INIT 00:07:53.281 01:09:01 -- common/autotest_common.sh@110 -- # : 0 00:07:53.281 01:09:01 -- common/autotest_common.sh@111 -- # export SPDK_TEST_LVOL 00:07:53.281 01:09:01 -- common/autotest_common.sh@112 -- # : 0 00:07:53.281 01:09:01 -- common/autotest_common.sh@113 -- # export SPDK_TEST_VBDEV_COMPRESS 00:07:53.281 01:09:01 -- common/autotest_common.sh@114 -- # : 0 00:07:53.281 01:09:01 -- common/autotest_common.sh@115 -- # export SPDK_RUN_ASAN 00:07:53.281 01:09:01 -- common/autotest_common.sh@116 -- # : 1 00:07:53.281 01:09:01 -- common/autotest_common.sh@117 -- # export SPDK_RUN_UBSAN 00:07:53.281 01:09:01 -- common/autotest_common.sh@118 -- # : /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:07:53.281 01:09:01 -- common/autotest_common.sh@119 -- # export SPDK_RUN_EXTERNAL_DPDK 00:07:53.281 01:09:01 -- common/autotest_common.sh@120 -- # : 0 00:07:53.281 01:09:01 -- common/autotest_common.sh@121 -- # export SPDK_RUN_NON_ROOT 00:07:53.281 01:09:01 -- common/autotest_common.sh@122 -- # : 0 00:07:53.281 01:09:01 -- common/autotest_common.sh@123 -- # export SPDK_TEST_CRYPTO 00:07:53.281 01:09:01 -- common/autotest_common.sh@124 -- # : 0 00:07:53.281 01:09:01 -- common/autotest_common.sh@125 -- # export SPDK_TEST_FTL 00:07:53.281 01:09:01 -- common/autotest_common.sh@126 -- # : 0 00:07:53.281 01:09:01 -- common/autotest_common.sh@127 -- # export SPDK_TEST_OCF 00:07:53.281 01:09:01 -- common/autotest_common.sh@128 -- # : 0 00:07:53.281 01:09:01 -- common/autotest_common.sh@129 -- # export SPDK_TEST_VMD 00:07:53.281 01:09:01 -- common/autotest_common.sh@130 -- # : 0 00:07:53.281 01:09:01 -- common/autotest_common.sh@131 -- # export SPDK_TEST_OPAL 00:07:53.281 01:09:01 -- common/autotest_common.sh@132 -- # : v22.11.4 00:07:53.281 01:09:01 -- common/autotest_common.sh@133 -- # export SPDK_TEST_NATIVE_DPDK 00:07:53.281 01:09:01 -- common/autotest_common.sh@134 -- # : true 00:07:53.281 01:09:01 -- common/autotest_common.sh@135 -- # export SPDK_AUTOTEST_X 00:07:53.281 01:09:01 -- common/autotest_common.sh@136 -- # : 0 00:07:53.281 01:09:01 -- common/autotest_common.sh@137 -- # export SPDK_TEST_RAID5 00:07:53.281 01:09:01 -- common/autotest_common.sh@138 -- # : 0 00:07:53.281 01:09:01 -- common/autotest_common.sh@139 -- # export SPDK_TEST_URING 00:07:53.281 01:09:01 -- common/autotest_common.sh@140 -- # : 0 00:07:53.281 01:09:01 -- common/autotest_common.sh@141 -- # export SPDK_TEST_USDT 00:07:53.281 01:09:01 -- common/autotest_common.sh@142 -- # : 0 00:07:53.281 01:09:01 -- common/autotest_common.sh@143 -- # export SPDK_TEST_USE_IGB_UIO 00:07:53.281 01:09:01 -- common/autotest_common.sh@144 -- # : 0 00:07:53.281 01:09:01 -- common/autotest_common.sh@145 -- # export SPDK_TEST_SCHEDULER 00:07:53.281 01:09:01 -- common/autotest_common.sh@146 -- # : 0 00:07:53.281 01:09:01 -- common/autotest_common.sh@147 -- # export SPDK_TEST_SCANBUILD 00:07:53.281 01:09:01 -- common/autotest_common.sh@148 -- # : e810 00:07:53.281 01:09:01 -- common/autotest_common.sh@149 -- # export SPDK_TEST_NVMF_NICS 00:07:53.281 01:09:01 -- common/autotest_common.sh@150 -- # : 0 00:07:53.281 01:09:01 -- common/autotest_common.sh@151 -- # export SPDK_TEST_SMA 00:07:53.281 01:09:01 -- common/autotest_common.sh@152 -- # : 0 00:07:53.281 01:09:01 -- common/autotest_common.sh@153 -- # export SPDK_TEST_DAOS 00:07:53.281 01:09:01 -- common/autotest_common.sh@154 -- # : 0 00:07:53.281 01:09:01 -- common/autotest_common.sh@155 -- # export SPDK_TEST_XNVME 00:07:53.281 01:09:01 -- common/autotest_common.sh@156 -- # : 0 00:07:53.281 01:09:01 -- common/autotest_common.sh@157 -- # export SPDK_TEST_ACCEL_DSA 00:07:53.281 01:09:01 -- common/autotest_common.sh@158 -- # : 0 00:07:53.281 01:09:01 -- common/autotest_common.sh@159 -- # export SPDK_TEST_ACCEL_IAA 00:07:53.281 01:09:01 -- common/autotest_common.sh@160 -- # : 0 00:07:53.281 01:09:01 -- common/autotest_common.sh@161 -- # export SPDK_TEST_ACCEL_IOAT 00:07:53.281 01:09:01 -- common/autotest_common.sh@163 -- # : 00:07:53.281 01:09:01 -- common/autotest_common.sh@164 -- # export SPDK_TEST_FUZZER_TARGET 00:07:53.281 01:09:01 -- common/autotest_common.sh@165 -- # : 0 00:07:53.281 01:09:01 -- common/autotest_common.sh@166 -- # export SPDK_TEST_NVMF_MDNS 00:07:53.281 01:09:01 -- common/autotest_common.sh@167 -- # : 0 00:07:53.281 01:09:01 -- common/autotest_common.sh@168 -- # export SPDK_JSONRPC_GO_CLIENT 00:07:53.281 01:09:01 -- common/autotest_common.sh@171 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:07:53.281 01:09:01 -- common/autotest_common.sh@171 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:07:53.281 01:09:01 -- common/autotest_common.sh@172 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:07:53.281 01:09:01 -- common/autotest_common.sh@172 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:07:53.281 01:09:01 -- common/autotest_common.sh@173 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:07:53.281 01:09:01 -- common/autotest_common.sh@173 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:07:53.281 01:09:01 -- common/autotest_common.sh@174 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:07:53.282 01:09:01 -- common/autotest_common.sh@174 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:07:53.282 01:09:01 -- common/autotest_common.sh@177 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:07:53.282 01:09:01 -- common/autotest_common.sh@177 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:07:53.282 01:09:01 -- common/autotest_common.sh@181 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:07:53.282 01:09:01 -- common/autotest_common.sh@181 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:07:53.282 01:09:01 -- common/autotest_common.sh@185 -- # export PYTHONDONTWRITEBYTECODE=1 00:07:53.282 01:09:01 -- common/autotest_common.sh@185 -- # PYTHONDONTWRITEBYTECODE=1 00:07:53.282 01:09:01 -- common/autotest_common.sh@189 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:07:53.282 01:09:01 -- common/autotest_common.sh@189 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:07:53.282 01:09:01 -- common/autotest_common.sh@190 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:07:53.282 01:09:01 -- common/autotest_common.sh@190 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:07:53.282 01:09:01 -- common/autotest_common.sh@194 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:07:53.282 01:09:01 -- common/autotest_common.sh@195 -- # rm -rf /var/tmp/asan_suppression_file 00:07:53.282 01:09:01 -- common/autotest_common.sh@196 -- # cat 00:07:53.282 01:09:01 -- common/autotest_common.sh@222 -- # echo leak:libfuse3.so 00:07:53.282 01:09:01 -- common/autotest_common.sh@224 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:07:53.282 01:09:01 -- common/autotest_common.sh@224 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:07:53.282 01:09:01 -- common/autotest_common.sh@226 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:07:53.282 01:09:01 -- common/autotest_common.sh@226 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:07:53.282 01:09:01 -- common/autotest_common.sh@228 -- # '[' -z /var/spdk/dependencies ']' 00:07:53.282 01:09:01 -- common/autotest_common.sh@231 -- # export DEPENDENCY_DIR 00:07:53.282 01:09:01 -- common/autotest_common.sh@235 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:07:53.282 01:09:01 -- common/autotest_common.sh@235 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:07:53.282 01:09:01 -- common/autotest_common.sh@236 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:07:53.282 01:09:01 -- common/autotest_common.sh@236 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:07:53.282 01:09:01 -- common/autotest_common.sh@239 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:07:53.282 01:09:01 -- common/autotest_common.sh@239 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:07:53.282 01:09:01 -- common/autotest_common.sh@240 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:07:53.282 01:09:01 -- common/autotest_common.sh@240 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:07:53.282 01:09:01 -- common/autotest_common.sh@242 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:07:53.282 01:09:01 -- common/autotest_common.sh@242 -- # AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:07:53.282 01:09:01 -- common/autotest_common.sh@245 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:07:53.282 01:09:01 -- common/autotest_common.sh@245 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:07:53.282 01:09:01 -- common/autotest_common.sh@247 -- # _LCOV_MAIN=0 00:07:53.282 01:09:01 -- common/autotest_common.sh@248 -- # _LCOV_LLVM=1 00:07:53.282 01:09:01 -- common/autotest_common.sh@249 -- # _LCOV= 00:07:53.282 01:09:01 -- common/autotest_common.sh@250 -- # [[ '' == *clang* ]] 00:07:53.282 01:09:01 -- common/autotest_common.sh@250 -- # [[ 0 -eq 1 ]] 00:07:53.282 01:09:01 -- common/autotest_common.sh@252 -- # _lcov_opt[_LCOV_LLVM]='--gcov-tool /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/fuzz/llvm/llvm-gcov.sh' 00:07:53.282 01:09:01 -- common/autotest_common.sh@253 -- # _lcov_opt[_LCOV_MAIN]= 00:07:53.282 01:09:01 -- common/autotest_common.sh@255 -- # lcov_opt= 00:07:53.282 01:09:01 -- common/autotest_common.sh@258 -- # '[' 0 -eq 0 ']' 00:07:53.282 01:09:01 -- common/autotest_common.sh@259 -- # export valgrind= 00:07:53.282 01:09:01 -- common/autotest_common.sh@259 -- # valgrind= 00:07:53.282 01:09:01 -- common/autotest_common.sh@265 -- # uname -s 00:07:53.282 01:09:01 -- common/autotest_common.sh@265 -- # '[' Linux = Linux ']' 00:07:53.282 01:09:01 -- common/autotest_common.sh@266 -- # HUGEMEM=4096 00:07:53.282 01:09:01 -- common/autotest_common.sh@267 -- # export CLEAR_HUGE=yes 00:07:53.282 01:09:01 -- common/autotest_common.sh@267 -- # CLEAR_HUGE=yes 00:07:53.282 01:09:01 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:07:53.282 01:09:01 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:07:53.282 01:09:01 -- common/autotest_common.sh@275 -- # MAKE=make 00:07:53.282 01:09:01 -- common/autotest_common.sh@276 -- # MAKEFLAGS=-j48 00:07:53.282 01:09:01 -- common/autotest_common.sh@292 -- # export HUGEMEM=4096 00:07:53.282 01:09:01 -- common/autotest_common.sh@292 -- # HUGEMEM=4096 00:07:53.282 01:09:01 -- common/autotest_common.sh@294 -- # '[' -z /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output ']' 00:07:53.282 01:09:01 -- common/autotest_common.sh@299 -- # NO_HUGE=() 00:07:53.282 01:09:01 -- common/autotest_common.sh@300 -- # TEST_MODE= 00:07:53.282 01:09:01 -- common/autotest_common.sh@301 -- # for i in "$@" 00:07:53.282 01:09:01 -- common/autotest_common.sh@302 -- # case "$i" in 00:07:53.282 01:09:01 -- common/autotest_common.sh@307 -- # TEST_TRANSPORT=tcp 00:07:53.282 01:09:01 -- common/autotest_common.sh@319 -- # [[ -z 1036291 ]] 00:07:53.282 01:09:01 -- common/autotest_common.sh@319 -- # kill -0 1036291 00:07:53.282 01:09:01 -- common/autotest_common.sh@1675 -- # set_test_storage 2147483648 00:07:53.282 01:09:01 -- common/autotest_common.sh@329 -- # [[ -v testdir ]] 00:07:53.282 01:09:01 -- common/autotest_common.sh@331 -- # local requested_size=2147483648 00:07:53.282 01:09:01 -- common/autotest_common.sh@332 -- # local mount target_dir 00:07:53.282 01:09:01 -- common/autotest_common.sh@334 -- # local -A mounts fss sizes avails uses 00:07:53.282 01:09:01 -- common/autotest_common.sh@335 -- # local source fs size avail mount use 00:07:53.282 01:09:01 -- common/autotest_common.sh@337 -- # local storage_fallback storage_candidates 00:07:53.282 01:09:01 -- common/autotest_common.sh@339 -- # mktemp -udt spdk.XXXXXX 00:07:53.282 01:09:01 -- common/autotest_common.sh@339 -- # storage_fallback=/tmp/spdk.7ZExXS 00:07:53.282 01:09:01 -- common/autotest_common.sh@344 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:07:53.282 01:09:01 -- common/autotest_common.sh@346 -- # [[ -n '' ]] 00:07:53.282 01:09:01 -- common/autotest_common.sh@351 -- # [[ -n '' ]] 00:07:53.282 01:09:01 -- common/autotest_common.sh@356 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target /tmp/spdk.7ZExXS/tests/target /tmp/spdk.7ZExXS 00:07:53.282 01:09:01 -- common/autotest_common.sh@359 -- # requested_size=2214592512 00:07:53.282 01:09:01 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:07:53.282 01:09:01 -- common/autotest_common.sh@328 -- # df -T 00:07:53.282 01:09:01 -- common/autotest_common.sh@328 -- # grep -v Filesystem 00:07:53.282 01:09:01 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_devtmpfs 00:07:53.282 01:09:01 -- common/autotest_common.sh@362 -- # fss["$mount"]=devtmpfs 00:07:53.282 01:09:01 -- common/autotest_common.sh@363 -- # avails["$mount"]=67108864 00:07:53.282 01:09:01 -- common/autotest_common.sh@363 -- # sizes["$mount"]=67108864 00:07:53.282 01:09:01 -- common/autotest_common.sh@364 -- # uses["$mount"]=0 00:07:53.282 01:09:01 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:07:53.282 01:09:01 -- common/autotest_common.sh@362 -- # mounts["$mount"]=/dev/pmem0 00:07:53.282 01:09:01 -- common/autotest_common.sh@362 -- # fss["$mount"]=ext2 00:07:53.282 01:09:01 -- common/autotest_common.sh@363 -- # avails["$mount"]=4096 00:07:53.282 01:09:01 -- common/autotest_common.sh@363 -- # sizes["$mount"]=5284429824 00:07:53.282 01:09:01 -- common/autotest_common.sh@364 -- # uses["$mount"]=5284425728 00:07:53.282 01:09:01 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:07:53.282 01:09:01 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_root 00:07:53.282 01:09:01 -- common/autotest_common.sh@362 -- # fss["$mount"]=overlay 00:07:53.282 01:09:01 -- common/autotest_common.sh@363 -- # avails["$mount"]=53335302144 00:07:53.282 01:09:01 -- common/autotest_common.sh@363 -- # sizes["$mount"]=61988528128 00:07:53.282 01:09:01 -- common/autotest_common.sh@364 -- # uses["$mount"]=8653225984 00:07:53.282 01:09:01 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:07:53.282 01:09:01 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:07:53.282 01:09:01 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:07:53.282 01:09:01 -- common/autotest_common.sh@363 -- # avails["$mount"]=30991671296 00:07:53.282 01:09:01 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994264064 00:07:53.282 01:09:01 -- common/autotest_common.sh@364 -- # uses["$mount"]=2592768 00:07:53.282 01:09:01 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:07:53.282 01:09:01 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:07:53.282 01:09:01 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:07:53.282 01:09:01 -- common/autotest_common.sh@363 -- # avails["$mount"]=12388917248 00:07:53.283 01:09:01 -- common/autotest_common.sh@363 -- # sizes["$mount"]=12397707264 00:07:53.283 01:09:01 -- common/autotest_common.sh@364 -- # uses["$mount"]=8790016 00:07:53.283 01:09:01 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:07:53.283 01:09:01 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:07:53.283 01:09:01 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:07:53.283 01:09:01 -- common/autotest_common.sh@363 -- # avails["$mount"]=30993768448 00:07:53.283 01:09:01 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994264064 00:07:53.283 01:09:01 -- common/autotest_common.sh@364 -- # uses["$mount"]=495616 00:07:53.283 01:09:01 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:07:53.283 01:09:01 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:07:53.283 01:09:01 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:07:53.283 01:09:01 -- common/autotest_common.sh@363 -- # avails["$mount"]=6198837248 00:07:53.283 01:09:01 -- common/autotest_common.sh@363 -- # sizes["$mount"]=6198849536 00:07:53.283 01:09:01 -- common/autotest_common.sh@364 -- # uses["$mount"]=12288 00:07:53.283 01:09:01 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:07:53.283 01:09:01 -- common/autotest_common.sh@367 -- # printf '* Looking for test storage...\n' 00:07:53.283 * Looking for test storage... 00:07:53.283 01:09:01 -- common/autotest_common.sh@369 -- # local target_space new_size 00:07:53.283 01:09:01 -- common/autotest_common.sh@370 -- # for target_dir in "${storage_candidates[@]}" 00:07:53.283 01:09:01 -- common/autotest_common.sh@373 -- # df /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:53.283 01:09:01 -- common/autotest_common.sh@373 -- # awk '$1 !~ /Filesystem/{print $6}' 00:07:53.283 01:09:01 -- common/autotest_common.sh@373 -- # mount=/ 00:07:53.283 01:09:01 -- common/autotest_common.sh@375 -- # target_space=53335302144 00:07:53.283 01:09:01 -- common/autotest_common.sh@376 -- # (( target_space == 0 || target_space < requested_size )) 00:07:53.283 01:09:01 -- common/autotest_common.sh@379 -- # (( target_space >= requested_size )) 00:07:53.283 01:09:01 -- common/autotest_common.sh@381 -- # [[ overlay == tmpfs ]] 00:07:53.283 01:09:01 -- common/autotest_common.sh@381 -- # [[ overlay == ramfs ]] 00:07:53.283 01:09:01 -- common/autotest_common.sh@381 -- # [[ / == / ]] 00:07:53.283 01:09:01 -- common/autotest_common.sh@382 -- # new_size=10867818496 00:07:53.283 01:09:01 -- common/autotest_common.sh@383 -- # (( new_size * 100 / sizes[/] > 95 )) 00:07:53.283 01:09:01 -- common/autotest_common.sh@388 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:53.283 01:09:01 -- common/autotest_common.sh@388 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:53.283 01:09:01 -- common/autotest_common.sh@389 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:53.283 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:53.283 01:09:01 -- common/autotest_common.sh@390 -- # return 0 00:07:53.283 01:09:01 -- common/autotest_common.sh@1677 -- # set -o errtrace 00:07:53.283 01:09:01 -- common/autotest_common.sh@1678 -- # shopt -s extdebug 00:07:53.283 01:09:01 -- common/autotest_common.sh@1679 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:07:53.283 01:09:01 -- common/autotest_common.sh@1681 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:07:53.283 01:09:01 -- common/autotest_common.sh@1682 -- # true 00:07:53.283 01:09:01 -- common/autotest_common.sh@1684 -- # xtrace_fd 00:07:53.283 01:09:01 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:07:53.283 01:09:01 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:07:53.283 01:09:01 -- common/autotest_common.sh@27 -- # exec 00:07:53.283 01:09:01 -- common/autotest_common.sh@29 -- # exec 00:07:53.283 01:09:01 -- common/autotest_common.sh@31 -- # xtrace_restore 00:07:53.283 01:09:01 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:07:53.283 01:09:01 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:07:53.283 01:09:01 -- common/autotest_common.sh@18 -- # set -x 00:07:53.283 01:09:01 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:53.283 01:09:01 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:53.283 01:09:01 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:53.542 01:09:01 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:53.542 01:09:01 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:53.542 01:09:01 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:53.542 01:09:01 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:53.542 01:09:01 -- scripts/common.sh@335 -- # IFS=.-: 00:07:53.542 01:09:01 -- scripts/common.sh@335 -- # read -ra ver1 00:07:53.542 01:09:01 -- scripts/common.sh@336 -- # IFS=.-: 00:07:53.542 01:09:01 -- scripts/common.sh@336 -- # read -ra ver2 00:07:53.542 01:09:01 -- scripts/common.sh@337 -- # local 'op=<' 00:07:53.542 01:09:01 -- scripts/common.sh@339 -- # ver1_l=2 00:07:53.542 01:09:01 -- scripts/common.sh@340 -- # ver2_l=1 00:07:53.542 01:09:01 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:53.542 01:09:01 -- scripts/common.sh@343 -- # case "$op" in 00:07:53.542 01:09:01 -- scripts/common.sh@344 -- # : 1 00:07:53.542 01:09:01 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:53.542 01:09:01 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:53.542 01:09:01 -- scripts/common.sh@364 -- # decimal 1 00:07:53.542 01:09:01 -- scripts/common.sh@352 -- # local d=1 00:07:53.542 01:09:01 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:53.542 01:09:01 -- scripts/common.sh@354 -- # echo 1 00:07:53.542 01:09:01 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:53.542 01:09:01 -- scripts/common.sh@365 -- # decimal 2 00:07:53.542 01:09:01 -- scripts/common.sh@352 -- # local d=2 00:07:53.542 01:09:01 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:53.542 01:09:01 -- scripts/common.sh@354 -- # echo 2 00:07:53.542 01:09:01 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:53.542 01:09:01 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:53.542 01:09:01 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:53.542 01:09:01 -- scripts/common.sh@367 -- # return 0 00:07:53.542 01:09:01 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:53.542 01:09:01 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:53.542 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:53.542 --rc genhtml_branch_coverage=1 00:07:53.542 --rc genhtml_function_coverage=1 00:07:53.542 --rc genhtml_legend=1 00:07:53.542 --rc geninfo_all_blocks=1 00:07:53.542 --rc geninfo_unexecuted_blocks=1 00:07:53.542 00:07:53.542 ' 00:07:53.542 01:09:01 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:53.542 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:53.542 --rc genhtml_branch_coverage=1 00:07:53.542 --rc genhtml_function_coverage=1 00:07:53.542 --rc genhtml_legend=1 00:07:53.542 --rc geninfo_all_blocks=1 00:07:53.542 --rc geninfo_unexecuted_blocks=1 00:07:53.542 00:07:53.542 ' 00:07:53.542 01:09:01 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:53.542 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:53.542 --rc genhtml_branch_coverage=1 00:07:53.542 --rc genhtml_function_coverage=1 00:07:53.542 --rc genhtml_legend=1 00:07:53.542 --rc geninfo_all_blocks=1 00:07:53.542 --rc geninfo_unexecuted_blocks=1 00:07:53.542 00:07:53.542 ' 00:07:53.542 01:09:01 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:53.542 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:53.542 --rc genhtml_branch_coverage=1 00:07:53.542 --rc genhtml_function_coverage=1 00:07:53.542 --rc genhtml_legend=1 00:07:53.542 --rc geninfo_all_blocks=1 00:07:53.542 --rc geninfo_unexecuted_blocks=1 00:07:53.542 00:07:53.542 ' 00:07:53.542 01:09:01 -- target/filesystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:53.542 01:09:01 -- nvmf/common.sh@7 -- # uname -s 00:07:53.542 01:09:01 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:53.542 01:09:01 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:53.542 01:09:01 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:53.542 01:09:01 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:53.542 01:09:01 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:53.542 01:09:01 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:53.542 01:09:01 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:53.542 01:09:01 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:53.542 01:09:01 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:53.542 01:09:01 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:53.542 01:09:01 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:53.542 01:09:01 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:53.542 01:09:01 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:53.542 01:09:01 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:53.542 01:09:01 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:53.542 01:09:01 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:53.542 01:09:01 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:53.542 01:09:01 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:53.542 01:09:01 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:53.542 01:09:01 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:53.543 01:09:01 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:53.543 01:09:01 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:53.543 01:09:01 -- paths/export.sh@5 -- # export PATH 00:07:53.543 01:09:01 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:53.543 01:09:01 -- nvmf/common.sh@46 -- # : 0 00:07:53.543 01:09:01 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:53.543 01:09:01 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:53.543 01:09:01 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:53.543 01:09:01 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:53.543 01:09:01 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:53.543 01:09:01 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:53.543 01:09:01 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:53.543 01:09:01 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:53.543 01:09:01 -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:07:53.543 01:09:01 -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:07:53.543 01:09:01 -- target/filesystem.sh@15 -- # nvmftestinit 00:07:53.543 01:09:01 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:53.543 01:09:01 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:53.543 01:09:01 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:53.543 01:09:01 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:53.543 01:09:01 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:53.543 01:09:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:53.543 01:09:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:53.543 01:09:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:53.543 01:09:01 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:53.543 01:09:01 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:53.543 01:09:01 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:53.543 01:09:01 -- common/autotest_common.sh@10 -- # set +x 00:07:55.446 01:09:03 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:55.446 01:09:03 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:55.446 01:09:03 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:55.446 01:09:03 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:55.446 01:09:03 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:55.446 01:09:03 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:55.446 01:09:03 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:55.446 01:09:03 -- nvmf/common.sh@294 -- # net_devs=() 00:07:55.446 01:09:03 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:55.446 01:09:03 -- nvmf/common.sh@295 -- # e810=() 00:07:55.446 01:09:03 -- nvmf/common.sh@295 -- # local -ga e810 00:07:55.446 01:09:03 -- nvmf/common.sh@296 -- # x722=() 00:07:55.446 01:09:03 -- nvmf/common.sh@296 -- # local -ga x722 00:07:55.446 01:09:03 -- nvmf/common.sh@297 -- # mlx=() 00:07:55.446 01:09:03 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:55.446 01:09:03 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:55.446 01:09:03 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:55.446 01:09:03 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:55.446 01:09:03 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:55.446 01:09:03 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:55.446 01:09:03 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:55.446 01:09:03 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:55.446 01:09:03 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:55.446 01:09:03 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:55.446 01:09:03 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:55.446 01:09:03 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:55.446 01:09:03 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:55.446 01:09:03 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:55.446 01:09:03 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:55.446 01:09:03 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:55.446 01:09:03 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:55.446 01:09:03 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:55.446 01:09:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:55.446 01:09:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:55.446 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:55.446 01:09:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:55.446 01:09:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:55.446 01:09:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:55.446 01:09:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:55.446 01:09:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:55.446 01:09:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:55.446 01:09:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:55.446 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:55.446 01:09:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:55.446 01:09:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:55.446 01:09:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:55.446 01:09:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:55.446 01:09:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:55.446 01:09:03 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:55.446 01:09:03 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:55.446 01:09:03 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:55.446 01:09:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:55.446 01:09:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:55.446 01:09:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:55.446 01:09:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:55.446 01:09:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:55.446 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:55.446 01:09:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:55.446 01:09:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:55.447 01:09:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:55.447 01:09:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:55.447 01:09:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:55.447 01:09:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:55.447 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:55.447 01:09:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:55.447 01:09:03 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:55.447 01:09:03 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:55.447 01:09:03 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:55.447 01:09:03 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:55.447 01:09:03 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:55.447 01:09:03 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:55.447 01:09:03 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:55.447 01:09:03 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:55.447 01:09:03 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:55.447 01:09:03 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:55.447 01:09:03 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:55.447 01:09:03 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:55.447 01:09:03 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:55.447 01:09:03 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:55.447 01:09:03 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:55.447 01:09:03 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:55.705 01:09:03 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:55.705 01:09:03 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:55.705 01:09:03 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:55.705 01:09:03 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:55.705 01:09:03 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:55.705 01:09:03 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:55.705 01:09:03 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:55.705 01:09:03 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:55.705 01:09:03 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:55.705 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:55.705 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.222 ms 00:07:55.705 00:07:55.705 --- 10.0.0.2 ping statistics --- 00:07:55.705 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:55.705 rtt min/avg/max/mdev = 0.222/0.222/0.222/0.000 ms 00:07:55.705 01:09:03 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:55.705 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:55.705 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.106 ms 00:07:55.705 00:07:55.705 --- 10.0.0.1 ping statistics --- 00:07:55.705 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:55.705 rtt min/avg/max/mdev = 0.106/0.106/0.106/0.000 ms 00:07:55.705 01:09:03 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:55.705 01:09:03 -- nvmf/common.sh@410 -- # return 0 00:07:55.705 01:09:03 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:55.705 01:09:03 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:55.705 01:09:03 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:55.705 01:09:03 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:55.705 01:09:03 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:55.705 01:09:03 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:55.705 01:09:03 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:55.705 01:09:03 -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:07:55.705 01:09:03 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:55.705 01:09:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:55.705 01:09:03 -- common/autotest_common.sh@10 -- # set +x 00:07:55.705 ************************************ 00:07:55.705 START TEST nvmf_filesystem_no_in_capsule 00:07:55.705 ************************************ 00:07:55.705 01:09:03 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 0 00:07:55.705 01:09:03 -- target/filesystem.sh@47 -- # in_capsule=0 00:07:55.705 01:09:03 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:07:55.705 01:09:03 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:55.705 01:09:03 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:55.705 01:09:03 -- common/autotest_common.sh@10 -- # set +x 00:07:55.705 01:09:03 -- nvmf/common.sh@469 -- # nvmfpid=1038087 00:07:55.705 01:09:03 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:55.705 01:09:03 -- nvmf/common.sh@470 -- # waitforlisten 1038087 00:07:55.705 01:09:03 -- common/autotest_common.sh@829 -- # '[' -z 1038087 ']' 00:07:55.705 01:09:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:55.705 01:09:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:55.705 01:09:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:55.705 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:55.705 01:09:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:55.705 01:09:03 -- common/autotest_common.sh@10 -- # set +x 00:07:55.705 [2024-11-20 01:09:03.873948] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:55.705 [2024-11-20 01:09:03.874038] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:55.705 EAL: No free 2048 kB hugepages reported on node 1 00:07:55.963 [2024-11-20 01:09:03.942277] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:55.963 [2024-11-20 01:09:04.035326] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:55.963 [2024-11-20 01:09:04.035506] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:55.963 [2024-11-20 01:09:04.035538] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:55.963 [2024-11-20 01:09:04.035560] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:55.963 [2024-11-20 01:09:04.035653] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:55.963 [2024-11-20 01:09:04.035709] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:55.963 [2024-11-20 01:09:04.035769] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:55.963 [2024-11-20 01:09:04.035777] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:56.898 01:09:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:56.898 01:09:04 -- common/autotest_common.sh@862 -- # return 0 00:07:56.898 01:09:04 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:56.898 01:09:04 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:56.898 01:09:04 -- common/autotest_common.sh@10 -- # set +x 00:07:56.898 01:09:04 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:56.898 01:09:04 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:07:56.898 01:09:04 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:07:56.898 01:09:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:56.898 01:09:04 -- common/autotest_common.sh@10 -- # set +x 00:07:56.898 [2024-11-20 01:09:04.853717] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:56.898 01:09:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:56.898 01:09:04 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:07:56.898 01:09:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:56.898 01:09:04 -- common/autotest_common.sh@10 -- # set +x 00:07:56.898 Malloc1 00:07:56.898 01:09:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:56.898 01:09:05 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:56.898 01:09:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:56.898 01:09:05 -- common/autotest_common.sh@10 -- # set +x 00:07:56.898 01:09:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:56.898 01:09:05 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:07:56.898 01:09:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:56.898 01:09:05 -- common/autotest_common.sh@10 -- # set +x 00:07:56.898 01:09:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:56.898 01:09:05 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:56.898 01:09:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:56.898 01:09:05 -- common/autotest_common.sh@10 -- # set +x 00:07:56.898 [2024-11-20 01:09:05.040356] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:56.898 01:09:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:56.898 01:09:05 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:07:56.898 01:09:05 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:07:56.898 01:09:05 -- common/autotest_common.sh@1368 -- # local bdev_info 00:07:56.898 01:09:05 -- common/autotest_common.sh@1369 -- # local bs 00:07:56.898 01:09:05 -- common/autotest_common.sh@1370 -- # local nb 00:07:56.898 01:09:05 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:07:56.898 01:09:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:56.898 01:09:05 -- common/autotest_common.sh@10 -- # set +x 00:07:56.898 01:09:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:56.898 01:09:05 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:07:56.898 { 00:07:56.898 "name": "Malloc1", 00:07:56.898 "aliases": [ 00:07:56.898 "8f61026e-e02d-4f82-9248-fc92641c611c" 00:07:56.898 ], 00:07:56.898 "product_name": "Malloc disk", 00:07:56.898 "block_size": 512, 00:07:56.898 "num_blocks": 1048576, 00:07:56.898 "uuid": "8f61026e-e02d-4f82-9248-fc92641c611c", 00:07:56.898 "assigned_rate_limits": { 00:07:56.898 "rw_ios_per_sec": 0, 00:07:56.898 "rw_mbytes_per_sec": 0, 00:07:56.898 "r_mbytes_per_sec": 0, 00:07:56.898 "w_mbytes_per_sec": 0 00:07:56.898 }, 00:07:56.898 "claimed": true, 00:07:56.898 "claim_type": "exclusive_write", 00:07:56.898 "zoned": false, 00:07:56.898 "supported_io_types": { 00:07:56.898 "read": true, 00:07:56.898 "write": true, 00:07:56.898 "unmap": true, 00:07:56.898 "write_zeroes": true, 00:07:56.898 "flush": true, 00:07:56.898 "reset": true, 00:07:56.898 "compare": false, 00:07:56.898 "compare_and_write": false, 00:07:56.898 "abort": true, 00:07:56.898 "nvme_admin": false, 00:07:56.898 "nvme_io": false 00:07:56.898 }, 00:07:56.898 "memory_domains": [ 00:07:56.898 { 00:07:56.898 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:07:56.898 "dma_device_type": 2 00:07:56.898 } 00:07:56.898 ], 00:07:56.898 "driver_specific": {} 00:07:56.898 } 00:07:56.898 ]' 00:07:56.899 01:09:05 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:07:56.899 01:09:05 -- common/autotest_common.sh@1372 -- # bs=512 00:07:56.899 01:09:05 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:07:57.158 01:09:05 -- common/autotest_common.sh@1373 -- # nb=1048576 00:07:57.158 01:09:05 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:07:57.158 01:09:05 -- common/autotest_common.sh@1377 -- # echo 512 00:07:57.158 01:09:05 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:07:57.158 01:09:05 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:07:57.725 01:09:05 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:07:57.725 01:09:05 -- common/autotest_common.sh@1187 -- # local i=0 00:07:57.725 01:09:05 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:07:57.725 01:09:05 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:07:57.725 01:09:05 -- common/autotest_common.sh@1194 -- # sleep 2 00:07:59.630 01:09:07 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:07:59.630 01:09:07 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:07:59.630 01:09:07 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:07:59.630 01:09:07 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:07:59.630 01:09:07 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:07:59.630 01:09:07 -- common/autotest_common.sh@1197 -- # return 0 00:07:59.630 01:09:07 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:07:59.630 01:09:07 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:07:59.630 01:09:07 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:07:59.630 01:09:07 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:07:59.630 01:09:07 -- setup/common.sh@76 -- # local dev=nvme0n1 00:07:59.630 01:09:07 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:07:59.630 01:09:07 -- setup/common.sh@80 -- # echo 536870912 00:07:59.630 01:09:07 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:07:59.631 01:09:07 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:07:59.631 01:09:07 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:07:59.631 01:09:07 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:08:00.199 01:09:08 -- target/filesystem.sh@69 -- # partprobe 00:08:00.784 01:09:08 -- target/filesystem.sh@70 -- # sleep 1 00:08:01.720 01:09:09 -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:08:01.720 01:09:09 -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:08:01.720 01:09:09 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:01.720 01:09:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:01.720 01:09:09 -- common/autotest_common.sh@10 -- # set +x 00:08:01.720 ************************************ 00:08:01.720 START TEST filesystem_ext4 00:08:01.720 ************************************ 00:08:01.720 01:09:09 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:08:01.720 01:09:09 -- target/filesystem.sh@18 -- # fstype=ext4 00:08:01.720 01:09:09 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:01.720 01:09:09 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:08:01.720 01:09:09 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:08:01.720 01:09:09 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:01.720 01:09:09 -- common/autotest_common.sh@914 -- # local i=0 00:08:01.720 01:09:09 -- common/autotest_common.sh@915 -- # local force 00:08:01.720 01:09:09 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:08:01.720 01:09:09 -- common/autotest_common.sh@918 -- # force=-F 00:08:01.720 01:09:09 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:08:01.720 mke2fs 1.47.0 (5-Feb-2023) 00:08:01.979 Discarding device blocks: 0/522240 done 00:08:01.979 Creating filesystem with 522240 1k blocks and 130560 inodes 00:08:01.979 Filesystem UUID: d87e0fc7-b771-4382-a1ae-19ccff5c70d6 00:08:01.979 Superblock backups stored on blocks: 00:08:01.979 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:08:01.979 00:08:01.979 Allocating group tables: 0/64 done 00:08:01.979 Writing inode tables: 0/64 done 00:08:01.979 Creating journal (8192 blocks): done 00:08:01.979 Writing superblocks and filesystem accounting information: 0/64 done 00:08:01.979 00:08:01.979 01:09:10 -- common/autotest_common.sh@931 -- # return 0 00:08:01.979 01:09:10 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:08.550 01:09:15 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:08.550 01:09:15 -- target/filesystem.sh@25 -- # sync 00:08:08.550 01:09:15 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:08.550 01:09:15 -- target/filesystem.sh@27 -- # sync 00:08:08.550 01:09:15 -- target/filesystem.sh@29 -- # i=0 00:08:08.550 01:09:15 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:08.550 01:09:15 -- target/filesystem.sh@37 -- # kill -0 1038087 00:08:08.550 01:09:15 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:08.550 01:09:15 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:08.550 01:09:15 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:08.550 01:09:15 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:08.550 00:08:08.550 real 0m5.866s 00:08:08.550 user 0m0.023s 00:08:08.550 sys 0m0.059s 00:08:08.550 01:09:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:08.550 01:09:15 -- common/autotest_common.sh@10 -- # set +x 00:08:08.550 ************************************ 00:08:08.550 END TEST filesystem_ext4 00:08:08.550 ************************************ 00:08:08.550 01:09:15 -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:08:08.550 01:09:15 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:08.550 01:09:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:08.550 01:09:15 -- common/autotest_common.sh@10 -- # set +x 00:08:08.550 ************************************ 00:08:08.550 START TEST filesystem_btrfs 00:08:08.550 ************************************ 00:08:08.550 01:09:15 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:08:08.550 01:09:15 -- target/filesystem.sh@18 -- # fstype=btrfs 00:08:08.550 01:09:15 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:08.550 01:09:15 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:08:08.550 01:09:15 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:08:08.550 01:09:15 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:08.550 01:09:15 -- common/autotest_common.sh@914 -- # local i=0 00:08:08.550 01:09:15 -- common/autotest_common.sh@915 -- # local force 00:08:08.550 01:09:15 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:08:08.550 01:09:15 -- common/autotest_common.sh@920 -- # force=-f 00:08:08.550 01:09:15 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:08:08.550 btrfs-progs v6.8.1 00:08:08.550 See https://btrfs.readthedocs.io for more information. 00:08:08.550 00:08:08.550 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:08:08.550 NOTE: several default settings have changed in version 5.15, please make sure 00:08:08.550 this does not affect your deployments: 00:08:08.550 - DUP for metadata (-m dup) 00:08:08.550 - enabled no-holes (-O no-holes) 00:08:08.550 - enabled free-space-tree (-R free-space-tree) 00:08:08.550 00:08:08.550 Label: (null) 00:08:08.550 UUID: a636d135-6fbc-43e9-971a-11fd0d70fd4c 00:08:08.550 Node size: 16384 00:08:08.550 Sector size: 4096 (CPU page size: 4096) 00:08:08.550 Filesystem size: 510.00MiB 00:08:08.550 Block group profiles: 00:08:08.550 Data: single 8.00MiB 00:08:08.550 Metadata: DUP 32.00MiB 00:08:08.550 System: DUP 8.00MiB 00:08:08.550 SSD detected: yes 00:08:08.550 Zoned device: no 00:08:08.550 Features: extref, skinny-metadata, no-holes, free-space-tree 00:08:08.550 Checksum: crc32c 00:08:08.550 Number of devices: 1 00:08:08.550 Devices: 00:08:08.550 ID SIZE PATH 00:08:08.550 1 510.00MiB /dev/nvme0n1p1 00:08:08.550 00:08:08.550 01:09:16 -- common/autotest_common.sh@931 -- # return 0 00:08:08.550 01:09:16 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:08.550 01:09:16 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:08.550 01:09:16 -- target/filesystem.sh@25 -- # sync 00:08:08.550 01:09:16 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:08.550 01:09:16 -- target/filesystem.sh@27 -- # sync 00:08:08.550 01:09:16 -- target/filesystem.sh@29 -- # i=0 00:08:08.550 01:09:16 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:08.550 01:09:16 -- target/filesystem.sh@37 -- # kill -0 1038087 00:08:08.550 01:09:16 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:08.550 01:09:16 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:08.550 01:09:16 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:08.550 01:09:16 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:08.550 00:08:08.550 real 0m0.871s 00:08:08.550 user 0m0.011s 00:08:08.550 sys 0m0.104s 00:08:08.550 01:09:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:08.550 01:09:16 -- common/autotest_common.sh@10 -- # set +x 00:08:08.550 ************************************ 00:08:08.550 END TEST filesystem_btrfs 00:08:08.550 ************************************ 00:08:08.550 01:09:16 -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:08:08.550 01:09:16 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:08.550 01:09:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:08.550 01:09:16 -- common/autotest_common.sh@10 -- # set +x 00:08:08.550 ************************************ 00:08:08.550 START TEST filesystem_xfs 00:08:08.550 ************************************ 00:08:08.550 01:09:16 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:08:08.550 01:09:16 -- target/filesystem.sh@18 -- # fstype=xfs 00:08:08.550 01:09:16 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:08.550 01:09:16 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:08:08.550 01:09:16 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:08:08.550 01:09:16 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:08.550 01:09:16 -- common/autotest_common.sh@914 -- # local i=0 00:08:08.550 01:09:16 -- common/autotest_common.sh@915 -- # local force 00:08:08.550 01:09:16 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:08:08.550 01:09:16 -- common/autotest_common.sh@920 -- # force=-f 00:08:08.550 01:09:16 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:08:08.550 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:08:08.550 = sectsz=512 attr=2, projid32bit=1 00:08:08.550 = crc=1 finobt=1, sparse=1, rmapbt=0 00:08:08.550 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:08:08.550 data = bsize=4096 blocks=130560, imaxpct=25 00:08:08.550 = sunit=0 swidth=0 blks 00:08:08.550 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:08:08.550 log =internal log bsize=4096 blocks=16384, version=2 00:08:08.550 = sectsz=512 sunit=0 blks, lazy-count=1 00:08:08.550 realtime =none extsz=4096 blocks=0, rtextents=0 00:08:09.489 Discarding blocks...Done. 00:08:09.489 01:09:17 -- common/autotest_common.sh@931 -- # return 0 00:08:09.489 01:09:17 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:12.026 01:09:20 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:12.026 01:09:20 -- target/filesystem.sh@25 -- # sync 00:08:12.026 01:09:20 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:12.026 01:09:20 -- target/filesystem.sh@27 -- # sync 00:08:12.026 01:09:20 -- target/filesystem.sh@29 -- # i=0 00:08:12.026 01:09:20 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:12.026 01:09:20 -- target/filesystem.sh@37 -- # kill -0 1038087 00:08:12.026 01:09:20 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:12.026 01:09:20 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:12.026 01:09:20 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:12.026 01:09:20 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:12.026 00:08:12.026 real 0m3.458s 00:08:12.026 user 0m0.019s 00:08:12.026 sys 0m0.061s 00:08:12.026 01:09:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:12.026 01:09:20 -- common/autotest_common.sh@10 -- # set +x 00:08:12.026 ************************************ 00:08:12.026 END TEST filesystem_xfs 00:08:12.026 ************************************ 00:08:12.026 01:09:20 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:08:12.026 01:09:20 -- target/filesystem.sh@93 -- # sync 00:08:12.026 01:09:20 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:08:12.285 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:12.285 01:09:20 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:08:12.285 01:09:20 -- common/autotest_common.sh@1208 -- # local i=0 00:08:12.285 01:09:20 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:08:12.285 01:09:20 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:12.285 01:09:20 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:08:12.285 01:09:20 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:12.285 01:09:20 -- common/autotest_common.sh@1220 -- # return 0 00:08:12.285 01:09:20 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:12.285 01:09:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:12.285 01:09:20 -- common/autotest_common.sh@10 -- # set +x 00:08:12.285 01:09:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:12.285 01:09:20 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:08:12.285 01:09:20 -- target/filesystem.sh@101 -- # killprocess 1038087 00:08:12.285 01:09:20 -- common/autotest_common.sh@936 -- # '[' -z 1038087 ']' 00:08:12.285 01:09:20 -- common/autotest_common.sh@940 -- # kill -0 1038087 00:08:12.285 01:09:20 -- common/autotest_common.sh@941 -- # uname 00:08:12.285 01:09:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:12.285 01:09:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1038087 00:08:12.285 01:09:20 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:12.285 01:09:20 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:12.285 01:09:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1038087' 00:08:12.285 killing process with pid 1038087 00:08:12.285 01:09:20 -- common/autotest_common.sh@955 -- # kill 1038087 00:08:12.285 01:09:20 -- common/autotest_common.sh@960 -- # wait 1038087 00:08:12.856 01:09:20 -- target/filesystem.sh@102 -- # nvmfpid= 00:08:12.856 00:08:12.856 real 0m17.022s 00:08:12.856 user 1m5.922s 00:08:12.856 sys 0m2.121s 00:08:12.856 01:09:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:12.856 01:09:20 -- common/autotest_common.sh@10 -- # set +x 00:08:12.856 ************************************ 00:08:12.856 END TEST nvmf_filesystem_no_in_capsule 00:08:12.856 ************************************ 00:08:12.856 01:09:20 -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:08:12.856 01:09:20 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:12.856 01:09:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:12.856 01:09:20 -- common/autotest_common.sh@10 -- # set +x 00:08:12.856 ************************************ 00:08:12.856 START TEST nvmf_filesystem_in_capsule 00:08:12.856 ************************************ 00:08:12.856 01:09:20 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 4096 00:08:12.856 01:09:20 -- target/filesystem.sh@47 -- # in_capsule=4096 00:08:12.856 01:09:20 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:08:12.856 01:09:20 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:12.856 01:09:20 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:12.856 01:09:20 -- common/autotest_common.sh@10 -- # set +x 00:08:12.856 01:09:20 -- nvmf/common.sh@469 -- # nvmfpid=1040871 00:08:12.856 01:09:20 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:12.856 01:09:20 -- nvmf/common.sh@470 -- # waitforlisten 1040871 00:08:12.856 01:09:20 -- common/autotest_common.sh@829 -- # '[' -z 1040871 ']' 00:08:12.856 01:09:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:12.856 01:09:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:12.856 01:09:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:12.856 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:12.856 01:09:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:12.856 01:09:20 -- common/autotest_common.sh@10 -- # set +x 00:08:12.856 [2024-11-20 01:09:20.930681] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:08:12.856 [2024-11-20 01:09:20.930767] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:12.856 EAL: No free 2048 kB hugepages reported on node 1 00:08:12.856 [2024-11-20 01:09:20.996227] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:13.115 [2024-11-20 01:09:21.086422] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:13.115 [2024-11-20 01:09:21.086555] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:13.115 [2024-11-20 01:09:21.086572] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:13.115 [2024-11-20 01:09:21.086585] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:13.115 [2024-11-20 01:09:21.086732] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:13.115 [2024-11-20 01:09:21.086797] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:13.115 [2024-11-20 01:09:21.086863] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:13.115 [2024-11-20 01:09:21.086866] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:14.052 01:09:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:14.052 01:09:21 -- common/autotest_common.sh@862 -- # return 0 00:08:14.052 01:09:21 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:14.052 01:09:21 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:14.052 01:09:21 -- common/autotest_common.sh@10 -- # set +x 00:08:14.052 01:09:21 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:14.052 01:09:21 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:08:14.052 01:09:21 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 4096 00:08:14.052 01:09:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:14.052 01:09:21 -- common/autotest_common.sh@10 -- # set +x 00:08:14.052 [2024-11-20 01:09:21.979013] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:14.052 01:09:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:14.052 01:09:21 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:08:14.052 01:09:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:14.052 01:09:21 -- common/autotest_common.sh@10 -- # set +x 00:08:14.052 Malloc1 00:08:14.052 01:09:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:14.052 01:09:22 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:08:14.052 01:09:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:14.052 01:09:22 -- common/autotest_common.sh@10 -- # set +x 00:08:14.052 01:09:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:14.052 01:09:22 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:08:14.052 01:09:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:14.052 01:09:22 -- common/autotest_common.sh@10 -- # set +x 00:08:14.052 01:09:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:14.052 01:09:22 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:14.052 01:09:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:14.052 01:09:22 -- common/autotest_common.sh@10 -- # set +x 00:08:14.052 [2024-11-20 01:09:22.162548] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:14.052 01:09:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:14.052 01:09:22 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:08:14.052 01:09:22 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:08:14.052 01:09:22 -- common/autotest_common.sh@1368 -- # local bdev_info 00:08:14.052 01:09:22 -- common/autotest_common.sh@1369 -- # local bs 00:08:14.052 01:09:22 -- common/autotest_common.sh@1370 -- # local nb 00:08:14.052 01:09:22 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:08:14.052 01:09:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:14.052 01:09:22 -- common/autotest_common.sh@10 -- # set +x 00:08:14.052 01:09:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:14.052 01:09:22 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:08:14.052 { 00:08:14.052 "name": "Malloc1", 00:08:14.052 "aliases": [ 00:08:14.052 "3d0e9f89-db1d-40ca-b937-d1e4fee9c88f" 00:08:14.053 ], 00:08:14.053 "product_name": "Malloc disk", 00:08:14.053 "block_size": 512, 00:08:14.053 "num_blocks": 1048576, 00:08:14.053 "uuid": "3d0e9f89-db1d-40ca-b937-d1e4fee9c88f", 00:08:14.053 "assigned_rate_limits": { 00:08:14.053 "rw_ios_per_sec": 0, 00:08:14.053 "rw_mbytes_per_sec": 0, 00:08:14.053 "r_mbytes_per_sec": 0, 00:08:14.053 "w_mbytes_per_sec": 0 00:08:14.053 }, 00:08:14.053 "claimed": true, 00:08:14.053 "claim_type": "exclusive_write", 00:08:14.053 "zoned": false, 00:08:14.053 "supported_io_types": { 00:08:14.053 "read": true, 00:08:14.053 "write": true, 00:08:14.053 "unmap": true, 00:08:14.053 "write_zeroes": true, 00:08:14.053 "flush": true, 00:08:14.053 "reset": true, 00:08:14.053 "compare": false, 00:08:14.053 "compare_and_write": false, 00:08:14.053 "abort": true, 00:08:14.053 "nvme_admin": false, 00:08:14.053 "nvme_io": false 00:08:14.053 }, 00:08:14.053 "memory_domains": [ 00:08:14.053 { 00:08:14.053 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:08:14.053 "dma_device_type": 2 00:08:14.053 } 00:08:14.053 ], 00:08:14.053 "driver_specific": {} 00:08:14.053 } 00:08:14.053 ]' 00:08:14.053 01:09:22 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:08:14.053 01:09:22 -- common/autotest_common.sh@1372 -- # bs=512 00:08:14.053 01:09:22 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:08:14.053 01:09:22 -- common/autotest_common.sh@1373 -- # nb=1048576 00:08:14.053 01:09:22 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:08:14.053 01:09:22 -- common/autotest_common.sh@1377 -- # echo 512 00:08:14.053 01:09:22 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:08:14.053 01:09:22 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:08:14.993 01:09:22 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:08:14.993 01:09:22 -- common/autotest_common.sh@1187 -- # local i=0 00:08:14.993 01:09:22 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:08:14.993 01:09:22 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:08:14.993 01:09:22 -- common/autotest_common.sh@1194 -- # sleep 2 00:08:16.905 01:09:24 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:08:16.905 01:09:24 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:08:16.905 01:09:24 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:08:16.905 01:09:24 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:08:16.905 01:09:24 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:08:16.905 01:09:24 -- common/autotest_common.sh@1197 -- # return 0 00:08:16.905 01:09:24 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:08:16.905 01:09:24 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:08:16.905 01:09:24 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:08:16.905 01:09:24 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:08:16.905 01:09:24 -- setup/common.sh@76 -- # local dev=nvme0n1 00:08:16.905 01:09:24 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:08:16.905 01:09:24 -- setup/common.sh@80 -- # echo 536870912 00:08:16.905 01:09:24 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:08:16.905 01:09:24 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:08:16.905 01:09:24 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:08:16.905 01:09:24 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:08:17.163 01:09:25 -- target/filesystem.sh@69 -- # partprobe 00:08:17.731 01:09:25 -- target/filesystem.sh@70 -- # sleep 1 00:08:19.112 01:09:26 -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:08:19.112 01:09:26 -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:08:19.112 01:09:26 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:19.112 01:09:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:19.112 01:09:26 -- common/autotest_common.sh@10 -- # set +x 00:08:19.112 ************************************ 00:08:19.112 START TEST filesystem_in_capsule_ext4 00:08:19.112 ************************************ 00:08:19.112 01:09:26 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:08:19.112 01:09:26 -- target/filesystem.sh@18 -- # fstype=ext4 00:08:19.112 01:09:26 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:19.112 01:09:26 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:08:19.112 01:09:26 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:08:19.112 01:09:26 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:19.112 01:09:26 -- common/autotest_common.sh@914 -- # local i=0 00:08:19.112 01:09:26 -- common/autotest_common.sh@915 -- # local force 00:08:19.112 01:09:26 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:08:19.112 01:09:26 -- common/autotest_common.sh@918 -- # force=-F 00:08:19.112 01:09:26 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:08:19.112 mke2fs 1.47.0 (5-Feb-2023) 00:08:19.112 Discarding device blocks: 0/522240 done 00:08:19.112 Creating filesystem with 522240 1k blocks and 130560 inodes 00:08:19.112 Filesystem UUID: 4c9b7e44-e944-4bb3-8359-39eb3a28a22d 00:08:19.112 Superblock backups stored on blocks: 00:08:19.112 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:08:19.112 00:08:19.112 Allocating group tables: 0/64 done 00:08:19.112 Writing inode tables: 0/64 done 00:08:19.112 Creating journal (8192 blocks): done 00:08:21.320 Writing superblocks and filesystem accounting information: 0/64 8/64 done 00:08:21.320 00:08:21.320 01:09:29 -- common/autotest_common.sh@931 -- # return 0 00:08:21.320 01:09:29 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:27.895 01:09:35 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:27.895 01:09:35 -- target/filesystem.sh@25 -- # sync 00:08:27.895 01:09:35 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:27.895 01:09:35 -- target/filesystem.sh@27 -- # sync 00:08:27.895 01:09:35 -- target/filesystem.sh@29 -- # i=0 00:08:27.895 01:09:35 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:27.895 01:09:35 -- target/filesystem.sh@37 -- # kill -0 1040871 00:08:27.895 01:09:35 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:27.895 01:09:35 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:27.895 01:09:35 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:27.895 01:09:35 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:27.895 00:08:27.895 real 0m8.846s 00:08:27.895 user 0m0.017s 00:08:27.895 sys 0m0.064s 00:08:27.895 01:09:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:27.895 01:09:35 -- common/autotest_common.sh@10 -- # set +x 00:08:27.895 ************************************ 00:08:27.895 END TEST filesystem_in_capsule_ext4 00:08:27.895 ************************************ 00:08:27.895 01:09:35 -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:08:27.895 01:09:35 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:27.895 01:09:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:27.895 01:09:35 -- common/autotest_common.sh@10 -- # set +x 00:08:27.895 ************************************ 00:08:27.895 START TEST filesystem_in_capsule_btrfs 00:08:27.895 ************************************ 00:08:27.895 01:09:35 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:08:27.895 01:09:35 -- target/filesystem.sh@18 -- # fstype=btrfs 00:08:27.895 01:09:35 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:27.895 01:09:35 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:08:27.895 01:09:35 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:08:27.895 01:09:35 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:27.895 01:09:35 -- common/autotest_common.sh@914 -- # local i=0 00:08:27.895 01:09:35 -- common/autotest_common.sh@915 -- # local force 00:08:27.895 01:09:35 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:08:27.895 01:09:35 -- common/autotest_common.sh@920 -- # force=-f 00:08:27.895 01:09:35 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:08:28.154 btrfs-progs v6.8.1 00:08:28.154 See https://btrfs.readthedocs.io for more information. 00:08:28.154 00:08:28.154 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:08:28.154 NOTE: several default settings have changed in version 5.15, please make sure 00:08:28.154 this does not affect your deployments: 00:08:28.154 - DUP for metadata (-m dup) 00:08:28.154 - enabled no-holes (-O no-holes) 00:08:28.154 - enabled free-space-tree (-R free-space-tree) 00:08:28.154 00:08:28.154 Label: (null) 00:08:28.154 UUID: 6ba3178e-8c87-4385-ad28-d2e4eb568dcc 00:08:28.154 Node size: 16384 00:08:28.154 Sector size: 4096 (CPU page size: 4096) 00:08:28.154 Filesystem size: 510.00MiB 00:08:28.154 Block group profiles: 00:08:28.154 Data: single 8.00MiB 00:08:28.154 Metadata: DUP 32.00MiB 00:08:28.154 System: DUP 8.00MiB 00:08:28.154 SSD detected: yes 00:08:28.154 Zoned device: no 00:08:28.154 Features: extref, skinny-metadata, no-holes, free-space-tree 00:08:28.154 Checksum: crc32c 00:08:28.154 Number of devices: 1 00:08:28.154 Devices: 00:08:28.154 ID SIZE PATH 00:08:28.154 1 510.00MiB /dev/nvme0n1p1 00:08:28.154 00:08:28.154 01:09:36 -- common/autotest_common.sh@931 -- # return 0 00:08:28.154 01:09:36 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:29.092 01:09:37 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:29.092 01:09:37 -- target/filesystem.sh@25 -- # sync 00:08:29.092 01:09:37 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:29.092 01:09:37 -- target/filesystem.sh@27 -- # sync 00:08:29.092 01:09:37 -- target/filesystem.sh@29 -- # i=0 00:08:29.092 01:09:37 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:29.092 01:09:37 -- target/filesystem.sh@37 -- # kill -0 1040871 00:08:29.092 01:09:37 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:29.092 01:09:37 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:29.092 01:09:37 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:29.092 01:09:37 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:29.092 00:08:29.092 real 0m1.296s 00:08:29.092 user 0m0.019s 00:08:29.092 sys 0m0.094s 00:08:29.092 01:09:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:29.092 01:09:37 -- common/autotest_common.sh@10 -- # set +x 00:08:29.092 ************************************ 00:08:29.092 END TEST filesystem_in_capsule_btrfs 00:08:29.092 ************************************ 00:08:29.092 01:09:37 -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:08:29.092 01:09:37 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:29.092 01:09:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:29.092 01:09:37 -- common/autotest_common.sh@10 -- # set +x 00:08:29.092 ************************************ 00:08:29.092 START TEST filesystem_in_capsule_xfs 00:08:29.092 ************************************ 00:08:29.092 01:09:37 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:08:29.092 01:09:37 -- target/filesystem.sh@18 -- # fstype=xfs 00:08:29.092 01:09:37 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:29.092 01:09:37 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:08:29.092 01:09:37 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:08:29.092 01:09:37 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:29.092 01:09:37 -- common/autotest_common.sh@914 -- # local i=0 00:08:29.092 01:09:37 -- common/autotest_common.sh@915 -- # local force 00:08:29.092 01:09:37 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:08:29.092 01:09:37 -- common/autotest_common.sh@920 -- # force=-f 00:08:29.092 01:09:37 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:08:29.092 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:08:29.092 = sectsz=512 attr=2, projid32bit=1 00:08:29.092 = crc=1 finobt=1, sparse=1, rmapbt=0 00:08:29.092 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:08:29.092 data = bsize=4096 blocks=130560, imaxpct=25 00:08:29.092 = sunit=0 swidth=0 blks 00:08:29.092 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:08:29.092 log =internal log bsize=4096 blocks=16384, version=2 00:08:29.092 = sectsz=512 sunit=0 blks, lazy-count=1 00:08:29.092 realtime =none extsz=4096 blocks=0, rtextents=0 00:08:30.030 Discarding blocks...Done. 00:08:30.030 01:09:38 -- common/autotest_common.sh@931 -- # return 0 00:08:30.030 01:09:38 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:32.569 01:09:40 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:32.569 01:09:40 -- target/filesystem.sh@25 -- # sync 00:08:32.829 01:09:40 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:32.829 01:09:40 -- target/filesystem.sh@27 -- # sync 00:08:32.829 01:09:40 -- target/filesystem.sh@29 -- # i=0 00:08:32.829 01:09:40 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:32.829 01:09:40 -- target/filesystem.sh@37 -- # kill -0 1040871 00:08:32.829 01:09:40 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:32.829 01:09:40 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:32.829 01:09:40 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:32.829 01:09:40 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:32.829 00:08:32.829 real 0m3.734s 00:08:32.829 user 0m0.008s 00:08:32.829 sys 0m0.068s 00:08:32.829 01:09:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:32.829 01:09:40 -- common/autotest_common.sh@10 -- # set +x 00:08:32.829 ************************************ 00:08:32.829 END TEST filesystem_in_capsule_xfs 00:08:32.829 ************************************ 00:08:32.829 01:09:40 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:08:33.090 01:09:41 -- target/filesystem.sh@93 -- # sync 00:08:33.090 01:09:41 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:08:33.090 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:33.090 01:09:41 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:08:33.090 01:09:41 -- common/autotest_common.sh@1208 -- # local i=0 00:08:33.090 01:09:41 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:08:33.090 01:09:41 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:33.090 01:09:41 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:08:33.090 01:09:41 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:33.090 01:09:41 -- common/autotest_common.sh@1220 -- # return 0 00:08:33.090 01:09:41 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:33.090 01:09:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:33.090 01:09:41 -- common/autotest_common.sh@10 -- # set +x 00:08:33.090 01:09:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:33.090 01:09:41 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:08:33.090 01:09:41 -- target/filesystem.sh@101 -- # killprocess 1040871 00:08:33.090 01:09:41 -- common/autotest_common.sh@936 -- # '[' -z 1040871 ']' 00:08:33.090 01:09:41 -- common/autotest_common.sh@940 -- # kill -0 1040871 00:08:33.090 01:09:41 -- common/autotest_common.sh@941 -- # uname 00:08:33.090 01:09:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:33.090 01:09:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1040871 00:08:33.090 01:09:41 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:33.090 01:09:41 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:33.090 01:09:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1040871' 00:08:33.090 killing process with pid 1040871 00:08:33.090 01:09:41 -- common/autotest_common.sh@955 -- # kill 1040871 00:08:33.090 01:09:41 -- common/autotest_common.sh@960 -- # wait 1040871 00:08:33.660 01:09:41 -- target/filesystem.sh@102 -- # nvmfpid= 00:08:33.660 00:08:33.660 real 0m20.828s 00:08:33.660 user 1m20.944s 00:08:33.660 sys 0m2.390s 00:08:33.660 01:09:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:33.660 01:09:41 -- common/autotest_common.sh@10 -- # set +x 00:08:33.660 ************************************ 00:08:33.660 END TEST nvmf_filesystem_in_capsule 00:08:33.660 ************************************ 00:08:33.660 01:09:41 -- target/filesystem.sh@108 -- # nvmftestfini 00:08:33.660 01:09:41 -- nvmf/common.sh@476 -- # nvmfcleanup 00:08:33.660 01:09:41 -- nvmf/common.sh@116 -- # sync 00:08:33.660 01:09:41 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:08:33.660 01:09:41 -- nvmf/common.sh@119 -- # set +e 00:08:33.660 01:09:41 -- nvmf/common.sh@120 -- # for i in {1..20} 00:08:33.660 01:09:41 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:08:33.660 rmmod nvme_tcp 00:08:33.660 rmmod nvme_fabrics 00:08:33.660 rmmod nvme_keyring 00:08:33.660 01:09:41 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:08:33.660 01:09:41 -- nvmf/common.sh@123 -- # set -e 00:08:33.660 01:09:41 -- nvmf/common.sh@124 -- # return 0 00:08:33.660 01:09:41 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:08:33.660 01:09:41 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:08:33.660 01:09:41 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:08:33.660 01:09:41 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:08:33.661 01:09:41 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:33.661 01:09:41 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:08:33.661 01:09:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:33.661 01:09:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:33.661 01:09:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:36.205 01:09:43 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:08:36.205 00:08:36.205 real 0m42.607s 00:08:36.205 user 2m27.916s 00:08:36.205 sys 0m6.221s 00:08:36.205 01:09:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:36.205 01:09:43 -- common/autotest_common.sh@10 -- # set +x 00:08:36.205 ************************************ 00:08:36.205 END TEST nvmf_filesystem 00:08:36.205 ************************************ 00:08:36.205 01:09:43 -- nvmf/nvmf.sh@25 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:08:36.205 01:09:43 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:36.205 01:09:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:36.205 01:09:43 -- common/autotest_common.sh@10 -- # set +x 00:08:36.205 ************************************ 00:08:36.205 START TEST nvmf_discovery 00:08:36.205 ************************************ 00:08:36.205 01:09:43 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:08:36.205 * Looking for test storage... 00:08:36.205 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:36.205 01:09:43 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:36.205 01:09:43 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:36.205 01:09:43 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:36.205 01:09:43 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:36.205 01:09:43 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:36.205 01:09:43 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:36.205 01:09:43 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:36.205 01:09:43 -- scripts/common.sh@335 -- # IFS=.-: 00:08:36.205 01:09:43 -- scripts/common.sh@335 -- # read -ra ver1 00:08:36.205 01:09:43 -- scripts/common.sh@336 -- # IFS=.-: 00:08:36.205 01:09:43 -- scripts/common.sh@336 -- # read -ra ver2 00:08:36.205 01:09:43 -- scripts/common.sh@337 -- # local 'op=<' 00:08:36.205 01:09:43 -- scripts/common.sh@339 -- # ver1_l=2 00:08:36.205 01:09:43 -- scripts/common.sh@340 -- # ver2_l=1 00:08:36.205 01:09:43 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:36.205 01:09:43 -- scripts/common.sh@343 -- # case "$op" in 00:08:36.205 01:09:43 -- scripts/common.sh@344 -- # : 1 00:08:36.205 01:09:43 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:36.205 01:09:43 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:36.205 01:09:43 -- scripts/common.sh@364 -- # decimal 1 00:08:36.205 01:09:43 -- scripts/common.sh@352 -- # local d=1 00:08:36.205 01:09:43 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:36.205 01:09:43 -- scripts/common.sh@354 -- # echo 1 00:08:36.205 01:09:43 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:36.205 01:09:43 -- scripts/common.sh@365 -- # decimal 2 00:08:36.205 01:09:43 -- scripts/common.sh@352 -- # local d=2 00:08:36.205 01:09:43 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:36.205 01:09:43 -- scripts/common.sh@354 -- # echo 2 00:08:36.205 01:09:43 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:36.205 01:09:43 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:36.205 01:09:43 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:36.205 01:09:43 -- scripts/common.sh@367 -- # return 0 00:08:36.205 01:09:43 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:36.205 01:09:43 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:36.205 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:36.205 --rc genhtml_branch_coverage=1 00:08:36.205 --rc genhtml_function_coverage=1 00:08:36.205 --rc genhtml_legend=1 00:08:36.205 --rc geninfo_all_blocks=1 00:08:36.205 --rc geninfo_unexecuted_blocks=1 00:08:36.205 00:08:36.205 ' 00:08:36.205 01:09:43 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:36.205 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:36.205 --rc genhtml_branch_coverage=1 00:08:36.205 --rc genhtml_function_coverage=1 00:08:36.205 --rc genhtml_legend=1 00:08:36.205 --rc geninfo_all_blocks=1 00:08:36.205 --rc geninfo_unexecuted_blocks=1 00:08:36.205 00:08:36.205 ' 00:08:36.205 01:09:43 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:36.205 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:36.205 --rc genhtml_branch_coverage=1 00:08:36.205 --rc genhtml_function_coverage=1 00:08:36.205 --rc genhtml_legend=1 00:08:36.205 --rc geninfo_all_blocks=1 00:08:36.205 --rc geninfo_unexecuted_blocks=1 00:08:36.205 00:08:36.205 ' 00:08:36.205 01:09:43 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:36.205 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:36.205 --rc genhtml_branch_coverage=1 00:08:36.205 --rc genhtml_function_coverage=1 00:08:36.205 --rc genhtml_legend=1 00:08:36.205 --rc geninfo_all_blocks=1 00:08:36.205 --rc geninfo_unexecuted_blocks=1 00:08:36.205 00:08:36.205 ' 00:08:36.205 01:09:43 -- target/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:36.205 01:09:43 -- nvmf/common.sh@7 -- # uname -s 00:08:36.205 01:09:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:36.205 01:09:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:36.205 01:09:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:36.205 01:09:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:36.205 01:09:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:36.205 01:09:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:36.205 01:09:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:36.205 01:09:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:36.205 01:09:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:36.205 01:09:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:36.205 01:09:44 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:36.205 01:09:44 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:36.205 01:09:44 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:36.205 01:09:44 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:36.205 01:09:44 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:36.205 01:09:44 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:36.205 01:09:44 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:36.205 01:09:44 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:36.205 01:09:44 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:36.205 01:09:44 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:36.205 01:09:44 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:36.205 01:09:44 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:36.205 01:09:44 -- paths/export.sh@5 -- # export PATH 00:08:36.205 01:09:44 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:36.205 01:09:44 -- nvmf/common.sh@46 -- # : 0 00:08:36.205 01:09:44 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:36.206 01:09:44 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:36.206 01:09:44 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:36.206 01:09:44 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:36.206 01:09:44 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:36.206 01:09:44 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:36.206 01:09:44 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:36.206 01:09:44 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:36.206 01:09:44 -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:08:36.206 01:09:44 -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:08:36.206 01:09:44 -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:08:36.206 01:09:44 -- target/discovery.sh@15 -- # hash nvme 00:08:36.206 01:09:44 -- target/discovery.sh@20 -- # nvmftestinit 00:08:36.206 01:09:44 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:36.206 01:09:44 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:36.206 01:09:44 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:36.206 01:09:44 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:36.206 01:09:44 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:36.206 01:09:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:36.206 01:09:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:36.206 01:09:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:36.206 01:09:44 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:36.206 01:09:44 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:36.206 01:09:44 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:36.206 01:09:44 -- common/autotest_common.sh@10 -- # set +x 00:08:38.112 01:09:46 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:38.112 01:09:46 -- nvmf/common.sh@290 -- # pci_devs=() 00:08:38.112 01:09:46 -- nvmf/common.sh@290 -- # local -a pci_devs 00:08:38.112 01:09:46 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:08:38.112 01:09:46 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:08:38.112 01:09:46 -- nvmf/common.sh@292 -- # pci_drivers=() 00:08:38.112 01:09:46 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:08:38.112 01:09:46 -- nvmf/common.sh@294 -- # net_devs=() 00:08:38.112 01:09:46 -- nvmf/common.sh@294 -- # local -ga net_devs 00:08:38.112 01:09:46 -- nvmf/common.sh@295 -- # e810=() 00:08:38.112 01:09:46 -- nvmf/common.sh@295 -- # local -ga e810 00:08:38.112 01:09:46 -- nvmf/common.sh@296 -- # x722=() 00:08:38.112 01:09:46 -- nvmf/common.sh@296 -- # local -ga x722 00:08:38.112 01:09:46 -- nvmf/common.sh@297 -- # mlx=() 00:08:38.112 01:09:46 -- nvmf/common.sh@297 -- # local -ga mlx 00:08:38.112 01:09:46 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:38.112 01:09:46 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:38.112 01:09:46 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:38.112 01:09:46 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:38.112 01:09:46 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:38.112 01:09:46 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:38.112 01:09:46 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:38.112 01:09:46 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:38.112 01:09:46 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:38.112 01:09:46 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:38.112 01:09:46 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:38.112 01:09:46 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:08:38.112 01:09:46 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:08:38.112 01:09:46 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:08:38.112 01:09:46 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:08:38.112 01:09:46 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:08:38.112 01:09:46 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:08:38.112 01:09:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:38.112 01:09:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:08:38.112 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:08:38.112 01:09:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:38.112 01:09:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:38.112 01:09:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:38.112 01:09:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:38.112 01:09:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:38.112 01:09:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:38.112 01:09:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:08:38.112 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:08:38.112 01:09:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:38.112 01:09:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:38.112 01:09:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:38.112 01:09:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:38.112 01:09:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:38.112 01:09:46 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:08:38.112 01:09:46 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:08:38.112 01:09:46 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:08:38.112 01:09:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:38.112 01:09:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:38.112 01:09:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:38.112 01:09:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:38.112 01:09:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:08:38.112 Found net devices under 0000:0a:00.0: cvl_0_0 00:08:38.112 01:09:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:38.112 01:09:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:38.112 01:09:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:38.112 01:09:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:38.112 01:09:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:38.112 01:09:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:08:38.112 Found net devices under 0000:0a:00.1: cvl_0_1 00:08:38.112 01:09:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:38.112 01:09:46 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:08:38.112 01:09:46 -- nvmf/common.sh@402 -- # is_hw=yes 00:08:38.112 01:09:46 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:08:38.112 01:09:46 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:08:38.112 01:09:46 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:08:38.112 01:09:46 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:38.112 01:09:46 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:38.112 01:09:46 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:38.112 01:09:46 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:08:38.112 01:09:46 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:38.112 01:09:46 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:38.112 01:09:46 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:08:38.112 01:09:46 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:38.113 01:09:46 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:38.113 01:09:46 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:08:38.113 01:09:46 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:08:38.113 01:09:46 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:08:38.113 01:09:46 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:38.113 01:09:46 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:38.113 01:09:46 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:38.113 01:09:46 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:08:38.113 01:09:46 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:38.113 01:09:46 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:38.113 01:09:46 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:38.113 01:09:46 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:08:38.113 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:38.113 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.250 ms 00:08:38.113 00:08:38.113 --- 10.0.0.2 ping statistics --- 00:08:38.113 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:38.113 rtt min/avg/max/mdev = 0.250/0.250/0.250/0.000 ms 00:08:38.113 01:09:46 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:38.113 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:38.113 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.100 ms 00:08:38.113 00:08:38.113 --- 10.0.0.1 ping statistics --- 00:08:38.113 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:38.113 rtt min/avg/max/mdev = 0.100/0.100/0.100/0.000 ms 00:08:38.113 01:09:46 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:38.113 01:09:46 -- nvmf/common.sh@410 -- # return 0 00:08:38.113 01:09:46 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:08:38.113 01:09:46 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:38.113 01:09:46 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:08:38.113 01:09:46 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:08:38.113 01:09:46 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:38.113 01:09:46 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:08:38.113 01:09:46 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:08:38.371 01:09:46 -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:08:38.371 01:09:46 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:38.371 01:09:46 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:38.371 01:09:46 -- common/autotest_common.sh@10 -- # set +x 00:08:38.372 01:09:46 -- nvmf/common.sh@469 -- # nvmfpid=1045537 00:08:38.372 01:09:46 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:38.372 01:09:46 -- nvmf/common.sh@470 -- # waitforlisten 1045537 00:08:38.372 01:09:46 -- common/autotest_common.sh@829 -- # '[' -z 1045537 ']' 00:08:38.372 01:09:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:38.372 01:09:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:38.372 01:09:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:38.372 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:38.372 01:09:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:38.372 01:09:46 -- common/autotest_common.sh@10 -- # set +x 00:08:38.372 [2024-11-20 01:09:46.388114] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:08:38.372 [2024-11-20 01:09:46.388186] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:38.372 EAL: No free 2048 kB hugepages reported on node 1 00:08:38.372 [2024-11-20 01:09:46.453036] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:38.372 [2024-11-20 01:09:46.544666] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:38.372 [2024-11-20 01:09:46.544835] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:38.372 [2024-11-20 01:09:46.544866] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:38.372 [2024-11-20 01:09:46.544890] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:38.372 [2024-11-20 01:09:46.544981] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:38.372 [2024-11-20 01:09:46.545038] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:38.372 [2024-11-20 01:09:46.545102] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:38.372 [2024-11-20 01:09:46.545110] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:39.309 01:09:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:39.309 01:09:47 -- common/autotest_common.sh@862 -- # return 0 00:08:39.309 01:09:47 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:39.309 01:09:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:39.309 01:09:47 -- common/autotest_common.sh@10 -- # set +x 00:08:39.309 01:09:47 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:39.309 01:09:47 -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:08:39.309 01:09:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:39.309 01:09:47 -- common/autotest_common.sh@10 -- # set +x 00:08:39.309 [2024-11-20 01:09:47.381758] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:39.309 01:09:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:39.309 01:09:47 -- target/discovery.sh@26 -- # seq 1 4 00:08:39.309 01:09:47 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:39.309 01:09:47 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:08:39.309 01:09:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:39.309 01:09:47 -- common/autotest_common.sh@10 -- # set +x 00:08:39.309 Null1 00:08:39.309 01:09:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:39.309 01:09:47 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:08:39.309 01:09:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:39.309 01:09:47 -- common/autotest_common.sh@10 -- # set +x 00:08:39.309 01:09:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:39.309 01:09:47 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:08:39.309 01:09:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:39.309 01:09:47 -- common/autotest_common.sh@10 -- # set +x 00:08:39.309 01:09:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:39.309 01:09:47 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:39.309 01:09:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:39.309 01:09:47 -- common/autotest_common.sh@10 -- # set +x 00:08:39.309 [2024-11-20 01:09:47.422104] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:39.309 01:09:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:39.309 01:09:47 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:39.309 01:09:47 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:08:39.309 01:09:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:39.309 01:09:47 -- common/autotest_common.sh@10 -- # set +x 00:08:39.309 Null2 00:08:39.309 01:09:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:39.309 01:09:47 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:08:39.309 01:09:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:39.309 01:09:47 -- common/autotest_common.sh@10 -- # set +x 00:08:39.309 01:09:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:39.309 01:09:47 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:08:39.309 01:09:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:39.309 01:09:47 -- common/autotest_common.sh@10 -- # set +x 00:08:39.309 01:09:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:39.309 01:09:47 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:08:39.309 01:09:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:39.309 01:09:47 -- common/autotest_common.sh@10 -- # set +x 00:08:39.309 01:09:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:39.309 01:09:47 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:39.309 01:09:47 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:08:39.309 01:09:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:39.309 01:09:47 -- common/autotest_common.sh@10 -- # set +x 00:08:39.309 Null3 00:08:39.309 01:09:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:39.309 01:09:47 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:08:39.309 01:09:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:39.309 01:09:47 -- common/autotest_common.sh@10 -- # set +x 00:08:39.309 01:09:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:39.309 01:09:47 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:08:39.309 01:09:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:39.309 01:09:47 -- common/autotest_common.sh@10 -- # set +x 00:08:39.309 01:09:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:39.309 01:09:47 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:08:39.309 01:09:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:39.309 01:09:47 -- common/autotest_common.sh@10 -- # set +x 00:08:39.309 01:09:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:39.309 01:09:47 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:39.309 01:09:47 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:08:39.309 01:09:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:39.309 01:09:47 -- common/autotest_common.sh@10 -- # set +x 00:08:39.309 Null4 00:08:39.309 01:09:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:39.309 01:09:47 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:08:39.309 01:09:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:39.309 01:09:47 -- common/autotest_common.sh@10 -- # set +x 00:08:39.309 01:09:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:39.309 01:09:47 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:08:39.310 01:09:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:39.310 01:09:47 -- common/autotest_common.sh@10 -- # set +x 00:08:39.310 01:09:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:39.310 01:09:47 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:08:39.310 01:09:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:39.310 01:09:47 -- common/autotest_common.sh@10 -- # set +x 00:08:39.310 01:09:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:39.310 01:09:47 -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:08:39.310 01:09:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:39.310 01:09:47 -- common/autotest_common.sh@10 -- # set +x 00:08:39.568 01:09:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:39.568 01:09:47 -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 10.0.0.2 -s 4430 00:08:39.568 01:09:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:39.568 01:09:47 -- common/autotest_common.sh@10 -- # set +x 00:08:39.568 01:09:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:39.568 01:09:47 -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:08:39.568 00:08:39.568 Discovery Log Number of Records 6, Generation counter 6 00:08:39.568 =====Discovery Log Entry 0====== 00:08:39.568 trtype: tcp 00:08:39.568 adrfam: ipv4 00:08:39.568 subtype: current discovery subsystem 00:08:39.568 treq: not required 00:08:39.568 portid: 0 00:08:39.568 trsvcid: 4420 00:08:39.568 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:08:39.568 traddr: 10.0.0.2 00:08:39.568 eflags: explicit discovery connections, duplicate discovery information 00:08:39.568 sectype: none 00:08:39.568 =====Discovery Log Entry 1====== 00:08:39.568 trtype: tcp 00:08:39.568 adrfam: ipv4 00:08:39.568 subtype: nvme subsystem 00:08:39.568 treq: not required 00:08:39.568 portid: 0 00:08:39.568 trsvcid: 4420 00:08:39.568 subnqn: nqn.2016-06.io.spdk:cnode1 00:08:39.568 traddr: 10.0.0.2 00:08:39.568 eflags: none 00:08:39.568 sectype: none 00:08:39.568 =====Discovery Log Entry 2====== 00:08:39.568 trtype: tcp 00:08:39.568 adrfam: ipv4 00:08:39.568 subtype: nvme subsystem 00:08:39.568 treq: not required 00:08:39.568 portid: 0 00:08:39.568 trsvcid: 4420 00:08:39.568 subnqn: nqn.2016-06.io.spdk:cnode2 00:08:39.568 traddr: 10.0.0.2 00:08:39.568 eflags: none 00:08:39.568 sectype: none 00:08:39.568 =====Discovery Log Entry 3====== 00:08:39.568 trtype: tcp 00:08:39.568 adrfam: ipv4 00:08:39.568 subtype: nvme subsystem 00:08:39.568 treq: not required 00:08:39.568 portid: 0 00:08:39.568 trsvcid: 4420 00:08:39.568 subnqn: nqn.2016-06.io.spdk:cnode3 00:08:39.568 traddr: 10.0.0.2 00:08:39.568 eflags: none 00:08:39.568 sectype: none 00:08:39.568 =====Discovery Log Entry 4====== 00:08:39.568 trtype: tcp 00:08:39.568 adrfam: ipv4 00:08:39.568 subtype: nvme subsystem 00:08:39.568 treq: not required 00:08:39.568 portid: 0 00:08:39.568 trsvcid: 4420 00:08:39.568 subnqn: nqn.2016-06.io.spdk:cnode4 00:08:39.568 traddr: 10.0.0.2 00:08:39.568 eflags: none 00:08:39.568 sectype: none 00:08:39.568 =====Discovery Log Entry 5====== 00:08:39.568 trtype: tcp 00:08:39.568 adrfam: ipv4 00:08:39.568 subtype: discovery subsystem referral 00:08:39.568 treq: not required 00:08:39.568 portid: 0 00:08:39.568 trsvcid: 4430 00:08:39.568 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:08:39.568 traddr: 10.0.0.2 00:08:39.568 eflags: none 00:08:39.568 sectype: none 00:08:39.568 01:09:47 -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:08:39.568 Perform nvmf subsystem discovery via RPC 00:08:39.568 01:09:47 -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:08:39.568 01:09:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:39.568 01:09:47 -- common/autotest_common.sh@10 -- # set +x 00:08:39.568 [2024-11-20 01:09:47.755046] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:08:39.568 [ 00:08:39.568 { 00:08:39.568 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:08:39.568 "subtype": "Discovery", 00:08:39.568 "listen_addresses": [ 00:08:39.568 { 00:08:39.568 "transport": "TCP", 00:08:39.568 "trtype": "TCP", 00:08:39.568 "adrfam": "IPv4", 00:08:39.568 "traddr": "10.0.0.2", 00:08:39.568 "trsvcid": "4420" 00:08:39.568 } 00:08:39.568 ], 00:08:39.568 "allow_any_host": true, 00:08:39.568 "hosts": [] 00:08:39.568 }, 00:08:39.568 { 00:08:39.568 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:08:39.568 "subtype": "NVMe", 00:08:39.568 "listen_addresses": [ 00:08:39.568 { 00:08:39.568 "transport": "TCP", 00:08:39.568 "trtype": "TCP", 00:08:39.568 "adrfam": "IPv4", 00:08:39.568 "traddr": "10.0.0.2", 00:08:39.568 "trsvcid": "4420" 00:08:39.568 } 00:08:39.568 ], 00:08:39.568 "allow_any_host": true, 00:08:39.568 "hosts": [], 00:08:39.568 "serial_number": "SPDK00000000000001", 00:08:39.568 "model_number": "SPDK bdev Controller", 00:08:39.568 "max_namespaces": 32, 00:08:39.568 "min_cntlid": 1, 00:08:39.568 "max_cntlid": 65519, 00:08:39.568 "namespaces": [ 00:08:39.568 { 00:08:39.568 "nsid": 1, 00:08:39.568 "bdev_name": "Null1", 00:08:39.568 "name": "Null1", 00:08:39.568 "nguid": "DBE89A38F80F4B06A9B9776ABAEDBEB6", 00:08:39.568 "uuid": "dbe89a38-f80f-4b06-a9b9-776abaedbeb6" 00:08:39.568 } 00:08:39.568 ] 00:08:39.568 }, 00:08:39.568 { 00:08:39.568 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:08:39.568 "subtype": "NVMe", 00:08:39.568 "listen_addresses": [ 00:08:39.568 { 00:08:39.568 "transport": "TCP", 00:08:39.568 "trtype": "TCP", 00:08:39.568 "adrfam": "IPv4", 00:08:39.568 "traddr": "10.0.0.2", 00:08:39.568 "trsvcid": "4420" 00:08:39.568 } 00:08:39.568 ], 00:08:39.568 "allow_any_host": true, 00:08:39.568 "hosts": [], 00:08:39.568 "serial_number": "SPDK00000000000002", 00:08:39.568 "model_number": "SPDK bdev Controller", 00:08:39.568 "max_namespaces": 32, 00:08:39.568 "min_cntlid": 1, 00:08:39.568 "max_cntlid": 65519, 00:08:39.568 "namespaces": [ 00:08:39.568 { 00:08:39.568 "nsid": 1, 00:08:39.568 "bdev_name": "Null2", 00:08:39.568 "name": "Null2", 00:08:39.568 "nguid": "B5A3BF2D2A944C8F9E85AE9D3970F856", 00:08:39.568 "uuid": "b5a3bf2d-2a94-4c8f-9e85-ae9d3970f856" 00:08:39.568 } 00:08:39.568 ] 00:08:39.568 }, 00:08:39.568 { 00:08:39.568 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:08:39.568 "subtype": "NVMe", 00:08:39.568 "listen_addresses": [ 00:08:39.568 { 00:08:39.568 "transport": "TCP", 00:08:39.568 "trtype": "TCP", 00:08:39.568 "adrfam": "IPv4", 00:08:39.568 "traddr": "10.0.0.2", 00:08:39.568 "trsvcid": "4420" 00:08:39.568 } 00:08:39.568 ], 00:08:39.568 "allow_any_host": true, 00:08:39.568 "hosts": [], 00:08:39.568 "serial_number": "SPDK00000000000003", 00:08:39.568 "model_number": "SPDK bdev Controller", 00:08:39.568 "max_namespaces": 32, 00:08:39.568 "min_cntlid": 1, 00:08:39.568 "max_cntlid": 65519, 00:08:39.568 "namespaces": [ 00:08:39.568 { 00:08:39.568 "nsid": 1, 00:08:39.568 "bdev_name": "Null3", 00:08:39.568 "name": "Null3", 00:08:39.568 "nguid": "6183D36150054E6285B75E8B652CF940", 00:08:39.568 "uuid": "6183d361-5005-4e62-85b7-5e8b652cf940" 00:08:39.568 } 00:08:39.568 ] 00:08:39.568 }, 00:08:39.568 { 00:08:39.568 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:08:39.568 "subtype": "NVMe", 00:08:39.568 "listen_addresses": [ 00:08:39.568 { 00:08:39.568 "transport": "TCP", 00:08:39.568 "trtype": "TCP", 00:08:39.568 "adrfam": "IPv4", 00:08:39.568 "traddr": "10.0.0.2", 00:08:39.568 "trsvcid": "4420" 00:08:39.568 } 00:08:39.568 ], 00:08:39.568 "allow_any_host": true, 00:08:39.568 "hosts": [], 00:08:39.568 "serial_number": "SPDK00000000000004", 00:08:39.568 "model_number": "SPDK bdev Controller", 00:08:39.568 "max_namespaces": 32, 00:08:39.568 "min_cntlid": 1, 00:08:39.569 "max_cntlid": 65519, 00:08:39.569 "namespaces": [ 00:08:39.569 { 00:08:39.569 "nsid": 1, 00:08:39.569 "bdev_name": "Null4", 00:08:39.569 "name": "Null4", 00:08:39.569 "nguid": "8294FAB94E434FAC9680AEEAC005A236", 00:08:39.569 "uuid": "8294fab9-4e43-4fac-9680-aeeac005a236" 00:08:39.569 } 00:08:39.569 ] 00:08:39.569 } 00:08:39.569 ] 00:08:39.569 01:09:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:39.569 01:09:47 -- target/discovery.sh@42 -- # seq 1 4 00:08:39.569 01:09:47 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:39.569 01:09:47 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:39.569 01:09:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:39.569 01:09:47 -- common/autotest_common.sh@10 -- # set +x 00:08:39.569 01:09:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:39.569 01:09:47 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:08:39.569 01:09:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:39.569 01:09:47 -- common/autotest_common.sh@10 -- # set +x 00:08:39.829 01:09:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:39.829 01:09:47 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:39.829 01:09:47 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:08:39.829 01:09:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:39.829 01:09:47 -- common/autotest_common.sh@10 -- # set +x 00:08:39.829 01:09:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:39.829 01:09:47 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:08:39.829 01:09:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:39.829 01:09:47 -- common/autotest_common.sh@10 -- # set +x 00:08:39.829 01:09:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:39.829 01:09:47 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:39.829 01:09:47 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:08:39.829 01:09:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:39.829 01:09:47 -- common/autotest_common.sh@10 -- # set +x 00:08:39.829 01:09:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:39.829 01:09:47 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:08:39.829 01:09:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:39.829 01:09:47 -- common/autotest_common.sh@10 -- # set +x 00:08:39.829 01:09:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:39.829 01:09:47 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:39.829 01:09:47 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:08:39.829 01:09:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:39.829 01:09:47 -- common/autotest_common.sh@10 -- # set +x 00:08:39.829 01:09:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:39.829 01:09:47 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:08:39.829 01:09:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:39.829 01:09:47 -- common/autotest_common.sh@10 -- # set +x 00:08:39.829 01:09:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:39.829 01:09:47 -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 10.0.0.2 -s 4430 00:08:39.829 01:09:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:39.829 01:09:47 -- common/autotest_common.sh@10 -- # set +x 00:08:39.829 01:09:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:39.829 01:09:47 -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:08:39.829 01:09:47 -- target/discovery.sh@49 -- # jq -r '.[].name' 00:08:39.829 01:09:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:39.829 01:09:47 -- common/autotest_common.sh@10 -- # set +x 00:08:39.830 01:09:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:39.830 01:09:47 -- target/discovery.sh@49 -- # check_bdevs= 00:08:39.830 01:09:47 -- target/discovery.sh@50 -- # '[' -n '' ']' 00:08:39.830 01:09:47 -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:08:39.830 01:09:47 -- target/discovery.sh@57 -- # nvmftestfini 00:08:39.830 01:09:47 -- nvmf/common.sh@476 -- # nvmfcleanup 00:08:39.830 01:09:47 -- nvmf/common.sh@116 -- # sync 00:08:39.830 01:09:47 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:08:39.830 01:09:47 -- nvmf/common.sh@119 -- # set +e 00:08:39.830 01:09:47 -- nvmf/common.sh@120 -- # for i in {1..20} 00:08:39.830 01:09:47 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:08:39.830 rmmod nvme_tcp 00:08:39.830 rmmod nvme_fabrics 00:08:39.830 rmmod nvme_keyring 00:08:39.830 01:09:47 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:08:39.830 01:09:47 -- nvmf/common.sh@123 -- # set -e 00:08:39.830 01:09:47 -- nvmf/common.sh@124 -- # return 0 00:08:39.830 01:09:47 -- nvmf/common.sh@477 -- # '[' -n 1045537 ']' 00:08:39.830 01:09:47 -- nvmf/common.sh@478 -- # killprocess 1045537 00:08:39.830 01:09:47 -- common/autotest_common.sh@936 -- # '[' -z 1045537 ']' 00:08:39.830 01:09:47 -- common/autotest_common.sh@940 -- # kill -0 1045537 00:08:39.830 01:09:47 -- common/autotest_common.sh@941 -- # uname 00:08:39.830 01:09:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:39.830 01:09:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1045537 00:08:39.830 01:09:47 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:39.830 01:09:47 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:39.830 01:09:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1045537' 00:08:39.830 killing process with pid 1045537 00:08:39.830 01:09:47 -- common/autotest_common.sh@955 -- # kill 1045537 00:08:39.830 [2024-11-20 01:09:47.980541] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:08:39.830 01:09:47 -- common/autotest_common.sh@960 -- # wait 1045537 00:08:40.089 01:09:48 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:08:40.089 01:09:48 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:08:40.089 01:09:48 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:08:40.089 01:09:48 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:40.089 01:09:48 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:08:40.089 01:09:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:40.089 01:09:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:40.089 01:09:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:42.631 01:09:50 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:08:42.631 00:08:42.631 real 0m6.397s 00:08:42.631 user 0m7.736s 00:08:42.631 sys 0m1.962s 00:08:42.631 01:09:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:42.631 01:09:50 -- common/autotest_common.sh@10 -- # set +x 00:08:42.631 ************************************ 00:08:42.631 END TEST nvmf_discovery 00:08:42.631 ************************************ 00:08:42.631 01:09:50 -- nvmf/nvmf.sh@26 -- # run_test nvmf_referrals /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:08:42.631 01:09:50 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:42.631 01:09:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:42.631 01:09:50 -- common/autotest_common.sh@10 -- # set +x 00:08:42.631 ************************************ 00:08:42.631 START TEST nvmf_referrals 00:08:42.631 ************************************ 00:08:42.631 01:09:50 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:08:42.631 * Looking for test storage... 00:08:42.631 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:42.631 01:09:50 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:42.631 01:09:50 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:42.631 01:09:50 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:42.631 01:09:50 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:42.631 01:09:50 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:42.631 01:09:50 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:42.631 01:09:50 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:42.631 01:09:50 -- scripts/common.sh@335 -- # IFS=.-: 00:08:42.631 01:09:50 -- scripts/common.sh@335 -- # read -ra ver1 00:08:42.631 01:09:50 -- scripts/common.sh@336 -- # IFS=.-: 00:08:42.631 01:09:50 -- scripts/common.sh@336 -- # read -ra ver2 00:08:42.631 01:09:50 -- scripts/common.sh@337 -- # local 'op=<' 00:08:42.631 01:09:50 -- scripts/common.sh@339 -- # ver1_l=2 00:08:42.631 01:09:50 -- scripts/common.sh@340 -- # ver2_l=1 00:08:42.631 01:09:50 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:42.631 01:09:50 -- scripts/common.sh@343 -- # case "$op" in 00:08:42.631 01:09:50 -- scripts/common.sh@344 -- # : 1 00:08:42.631 01:09:50 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:42.631 01:09:50 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:42.631 01:09:50 -- scripts/common.sh@364 -- # decimal 1 00:08:42.631 01:09:50 -- scripts/common.sh@352 -- # local d=1 00:08:42.631 01:09:50 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:42.631 01:09:50 -- scripts/common.sh@354 -- # echo 1 00:08:42.631 01:09:50 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:42.631 01:09:50 -- scripts/common.sh@365 -- # decimal 2 00:08:42.631 01:09:50 -- scripts/common.sh@352 -- # local d=2 00:08:42.631 01:09:50 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:42.631 01:09:50 -- scripts/common.sh@354 -- # echo 2 00:08:42.631 01:09:50 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:42.631 01:09:50 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:42.631 01:09:50 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:42.631 01:09:50 -- scripts/common.sh@367 -- # return 0 00:08:42.631 01:09:50 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:42.631 01:09:50 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:42.631 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:42.631 --rc genhtml_branch_coverage=1 00:08:42.631 --rc genhtml_function_coverage=1 00:08:42.631 --rc genhtml_legend=1 00:08:42.631 --rc geninfo_all_blocks=1 00:08:42.631 --rc geninfo_unexecuted_blocks=1 00:08:42.631 00:08:42.631 ' 00:08:42.631 01:09:50 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:42.631 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:42.631 --rc genhtml_branch_coverage=1 00:08:42.631 --rc genhtml_function_coverage=1 00:08:42.631 --rc genhtml_legend=1 00:08:42.631 --rc geninfo_all_blocks=1 00:08:42.631 --rc geninfo_unexecuted_blocks=1 00:08:42.631 00:08:42.631 ' 00:08:42.631 01:09:50 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:42.631 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:42.631 --rc genhtml_branch_coverage=1 00:08:42.631 --rc genhtml_function_coverage=1 00:08:42.631 --rc genhtml_legend=1 00:08:42.631 --rc geninfo_all_blocks=1 00:08:42.631 --rc geninfo_unexecuted_blocks=1 00:08:42.631 00:08:42.631 ' 00:08:42.631 01:09:50 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:42.631 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:42.631 --rc genhtml_branch_coverage=1 00:08:42.631 --rc genhtml_function_coverage=1 00:08:42.631 --rc genhtml_legend=1 00:08:42.631 --rc geninfo_all_blocks=1 00:08:42.631 --rc geninfo_unexecuted_blocks=1 00:08:42.631 00:08:42.631 ' 00:08:42.631 01:09:50 -- target/referrals.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:42.631 01:09:50 -- nvmf/common.sh@7 -- # uname -s 00:08:42.631 01:09:50 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:42.631 01:09:50 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:42.631 01:09:50 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:42.631 01:09:50 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:42.631 01:09:50 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:42.631 01:09:50 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:42.631 01:09:50 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:42.631 01:09:50 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:42.631 01:09:50 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:42.631 01:09:50 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:42.631 01:09:50 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:42.631 01:09:50 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:42.631 01:09:50 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:42.631 01:09:50 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:42.631 01:09:50 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:42.631 01:09:50 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:42.631 01:09:50 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:42.631 01:09:50 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:42.631 01:09:50 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:42.631 01:09:50 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:42.631 01:09:50 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:42.631 01:09:50 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:42.631 01:09:50 -- paths/export.sh@5 -- # export PATH 00:08:42.631 01:09:50 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:42.631 01:09:50 -- nvmf/common.sh@46 -- # : 0 00:08:42.631 01:09:50 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:42.631 01:09:50 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:42.631 01:09:50 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:42.631 01:09:50 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:42.631 01:09:50 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:42.631 01:09:50 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:42.631 01:09:50 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:42.631 01:09:50 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:42.631 01:09:50 -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:08:42.631 01:09:50 -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:08:42.631 01:09:50 -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:08:42.631 01:09:50 -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:08:42.631 01:09:50 -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:08:42.631 01:09:50 -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:08:42.631 01:09:50 -- target/referrals.sh@37 -- # nvmftestinit 00:08:42.631 01:09:50 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:42.631 01:09:50 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:42.632 01:09:50 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:42.632 01:09:50 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:42.632 01:09:50 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:42.632 01:09:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:42.632 01:09:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:42.632 01:09:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:42.632 01:09:50 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:42.632 01:09:50 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:42.632 01:09:50 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:42.632 01:09:50 -- common/autotest_common.sh@10 -- # set +x 00:08:44.561 01:09:52 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:44.561 01:09:52 -- nvmf/common.sh@290 -- # pci_devs=() 00:08:44.561 01:09:52 -- nvmf/common.sh@290 -- # local -a pci_devs 00:08:44.561 01:09:52 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:08:44.561 01:09:52 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:08:44.561 01:09:52 -- nvmf/common.sh@292 -- # pci_drivers=() 00:08:44.561 01:09:52 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:08:44.561 01:09:52 -- nvmf/common.sh@294 -- # net_devs=() 00:08:44.561 01:09:52 -- nvmf/common.sh@294 -- # local -ga net_devs 00:08:44.561 01:09:52 -- nvmf/common.sh@295 -- # e810=() 00:08:44.561 01:09:52 -- nvmf/common.sh@295 -- # local -ga e810 00:08:44.561 01:09:52 -- nvmf/common.sh@296 -- # x722=() 00:08:44.561 01:09:52 -- nvmf/common.sh@296 -- # local -ga x722 00:08:44.561 01:09:52 -- nvmf/common.sh@297 -- # mlx=() 00:08:44.561 01:09:52 -- nvmf/common.sh@297 -- # local -ga mlx 00:08:44.561 01:09:52 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:44.561 01:09:52 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:44.561 01:09:52 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:44.561 01:09:52 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:44.561 01:09:52 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:44.561 01:09:52 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:44.561 01:09:52 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:44.561 01:09:52 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:44.561 01:09:52 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:44.561 01:09:52 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:44.561 01:09:52 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:44.561 01:09:52 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:08:44.561 01:09:52 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:08:44.561 01:09:52 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:08:44.561 01:09:52 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:08:44.561 01:09:52 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:08:44.561 01:09:52 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:08:44.561 01:09:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:44.561 01:09:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:08:44.561 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:08:44.561 01:09:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:44.561 01:09:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:44.561 01:09:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:44.561 01:09:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:44.561 01:09:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:44.561 01:09:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:44.561 01:09:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:08:44.561 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:08:44.561 01:09:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:44.561 01:09:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:44.561 01:09:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:44.561 01:09:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:44.561 01:09:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:44.561 01:09:52 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:08:44.561 01:09:52 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:08:44.561 01:09:52 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:08:44.561 01:09:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:44.561 01:09:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:44.561 01:09:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:44.561 01:09:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:44.561 01:09:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:08:44.561 Found net devices under 0000:0a:00.0: cvl_0_0 00:08:44.561 01:09:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:44.561 01:09:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:44.562 01:09:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:44.562 01:09:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:44.562 01:09:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:44.562 01:09:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:08:44.562 Found net devices under 0000:0a:00.1: cvl_0_1 00:08:44.562 01:09:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:44.562 01:09:52 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:08:44.562 01:09:52 -- nvmf/common.sh@402 -- # is_hw=yes 00:08:44.562 01:09:52 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:08:44.562 01:09:52 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:08:44.562 01:09:52 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:08:44.562 01:09:52 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:44.562 01:09:52 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:44.562 01:09:52 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:44.562 01:09:52 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:08:44.562 01:09:52 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:44.562 01:09:52 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:44.562 01:09:52 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:08:44.562 01:09:52 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:44.562 01:09:52 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:44.562 01:09:52 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:08:44.562 01:09:52 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:08:44.562 01:09:52 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:08:44.562 01:09:52 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:44.562 01:09:52 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:44.562 01:09:52 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:44.562 01:09:52 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:08:44.562 01:09:52 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:44.562 01:09:52 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:44.562 01:09:52 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:44.562 01:09:52 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:08:44.562 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:44.562 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.239 ms 00:08:44.562 00:08:44.562 --- 10.0.0.2 ping statistics --- 00:08:44.562 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:44.562 rtt min/avg/max/mdev = 0.239/0.239/0.239/0.000 ms 00:08:44.562 01:09:52 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:44.562 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:44.562 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.165 ms 00:08:44.562 00:08:44.562 --- 10.0.0.1 ping statistics --- 00:08:44.562 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:44.562 rtt min/avg/max/mdev = 0.165/0.165/0.165/0.000 ms 00:08:44.562 01:09:52 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:44.562 01:09:52 -- nvmf/common.sh@410 -- # return 0 00:08:44.562 01:09:52 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:08:44.562 01:09:52 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:44.562 01:09:52 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:08:44.562 01:09:52 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:08:44.562 01:09:52 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:44.562 01:09:52 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:08:44.562 01:09:52 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:08:44.562 01:09:52 -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:08:44.562 01:09:52 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:44.562 01:09:52 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:44.562 01:09:52 -- common/autotest_common.sh@10 -- # set +x 00:08:44.562 01:09:52 -- nvmf/common.sh@469 -- # nvmfpid=1047666 00:08:44.562 01:09:52 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:44.562 01:09:52 -- nvmf/common.sh@470 -- # waitforlisten 1047666 00:08:44.562 01:09:52 -- common/autotest_common.sh@829 -- # '[' -z 1047666 ']' 00:08:44.562 01:09:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:44.562 01:09:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:44.562 01:09:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:44.562 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:44.562 01:09:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:44.562 01:09:52 -- common/autotest_common.sh@10 -- # set +x 00:08:44.562 [2024-11-20 01:09:52.663691] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:08:44.562 [2024-11-20 01:09:52.663773] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:44.562 EAL: No free 2048 kB hugepages reported on node 1 00:08:44.562 [2024-11-20 01:09:52.732870] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:44.821 [2024-11-20 01:09:52.828981] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:44.821 [2024-11-20 01:09:52.829152] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:44.821 [2024-11-20 01:09:52.829174] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:44.821 [2024-11-20 01:09:52.829189] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:44.821 [2024-11-20 01:09:52.829265] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:44.821 [2024-11-20 01:09:52.829305] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:44.821 [2024-11-20 01:09:52.829364] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:44.821 [2024-11-20 01:09:52.829366] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:45.757 01:09:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:45.757 01:09:53 -- common/autotest_common.sh@862 -- # return 0 00:08:45.757 01:09:53 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:45.757 01:09:53 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:45.757 01:09:53 -- common/autotest_common.sh@10 -- # set +x 00:08:45.757 01:09:53 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:45.757 01:09:53 -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:08:45.757 01:09:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:45.757 01:09:53 -- common/autotest_common.sh@10 -- # set +x 00:08:45.757 [2024-11-20 01:09:53.670803] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:45.757 01:09:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:45.757 01:09:53 -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t tcp -a 10.0.0.2 -s 8009 discovery 00:08:45.757 01:09:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:45.757 01:09:53 -- common/autotest_common.sh@10 -- # set +x 00:08:45.757 [2024-11-20 01:09:53.682992] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:08:45.757 01:09:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:45.757 01:09:53 -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 00:08:45.757 01:09:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:45.757 01:09:53 -- common/autotest_common.sh@10 -- # set +x 00:08:45.757 01:09:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:45.757 01:09:53 -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.3 -s 4430 00:08:45.757 01:09:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:45.757 01:09:53 -- common/autotest_common.sh@10 -- # set +x 00:08:45.757 01:09:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:45.757 01:09:53 -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.4 -s 4430 00:08:45.757 01:09:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:45.757 01:09:53 -- common/autotest_common.sh@10 -- # set +x 00:08:45.757 01:09:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:45.757 01:09:53 -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:45.757 01:09:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:45.757 01:09:53 -- target/referrals.sh@48 -- # jq length 00:08:45.757 01:09:53 -- common/autotest_common.sh@10 -- # set +x 00:08:45.757 01:09:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:45.757 01:09:53 -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:08:45.757 01:09:53 -- target/referrals.sh@49 -- # get_referral_ips rpc 00:08:45.757 01:09:53 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:08:45.757 01:09:53 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:45.757 01:09:53 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:08:45.757 01:09:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:45.757 01:09:53 -- common/autotest_common.sh@10 -- # set +x 00:08:45.757 01:09:53 -- target/referrals.sh@21 -- # sort 00:08:45.757 01:09:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:45.757 01:09:53 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:08:45.757 01:09:53 -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:08:45.757 01:09:53 -- target/referrals.sh@50 -- # get_referral_ips nvme 00:08:45.757 01:09:53 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:45.757 01:09:53 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:45.757 01:09:53 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:45.757 01:09:53 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:45.757 01:09:53 -- target/referrals.sh@26 -- # sort 00:08:46.016 01:09:53 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:08:46.016 01:09:53 -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:08:46.016 01:09:53 -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 00:08:46.016 01:09:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:46.016 01:09:53 -- common/autotest_common.sh@10 -- # set +x 00:08:46.016 01:09:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:46.016 01:09:54 -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.3 -s 4430 00:08:46.016 01:09:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:46.016 01:09:54 -- common/autotest_common.sh@10 -- # set +x 00:08:46.016 01:09:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:46.016 01:09:54 -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.4 -s 4430 00:08:46.016 01:09:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:46.016 01:09:54 -- common/autotest_common.sh@10 -- # set +x 00:08:46.016 01:09:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:46.016 01:09:54 -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:46.016 01:09:54 -- target/referrals.sh@56 -- # jq length 00:08:46.016 01:09:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:46.016 01:09:54 -- common/autotest_common.sh@10 -- # set +x 00:08:46.016 01:09:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:46.016 01:09:54 -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:08:46.016 01:09:54 -- target/referrals.sh@57 -- # get_referral_ips nvme 00:08:46.016 01:09:54 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:46.016 01:09:54 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:46.016 01:09:54 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:46.016 01:09:54 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:46.016 01:09:54 -- target/referrals.sh@26 -- # sort 00:08:46.016 01:09:54 -- target/referrals.sh@26 -- # echo 00:08:46.016 01:09:54 -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:08:46.016 01:09:54 -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n discovery 00:08:46.016 01:09:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:46.016 01:09:54 -- common/autotest_common.sh@10 -- # set +x 00:08:46.276 01:09:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:46.276 01:09:54 -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:08:46.276 01:09:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:46.276 01:09:54 -- common/autotest_common.sh@10 -- # set +x 00:08:46.276 01:09:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:46.276 01:09:54 -- target/referrals.sh@65 -- # get_referral_ips rpc 00:08:46.276 01:09:54 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:08:46.276 01:09:54 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:46.276 01:09:54 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:08:46.276 01:09:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:46.276 01:09:54 -- target/referrals.sh@21 -- # sort 00:08:46.276 01:09:54 -- common/autotest_common.sh@10 -- # set +x 00:08:46.276 01:09:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:46.276 01:09:54 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:08:46.276 01:09:54 -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:08:46.276 01:09:54 -- target/referrals.sh@66 -- # get_referral_ips nvme 00:08:46.276 01:09:54 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:46.276 01:09:54 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:46.276 01:09:54 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:46.276 01:09:54 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:46.276 01:09:54 -- target/referrals.sh@26 -- # sort 00:08:46.276 01:09:54 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:08:46.276 01:09:54 -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:08:46.535 01:09:54 -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:08:46.535 01:09:54 -- target/referrals.sh@67 -- # jq -r .subnqn 00:08:46.535 01:09:54 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:08:46.535 01:09:54 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:46.535 01:09:54 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:08:46.535 01:09:54 -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:08:46.535 01:09:54 -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:08:46.535 01:09:54 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:08:46.535 01:09:54 -- target/referrals.sh@68 -- # jq -r .subnqn 00:08:46.535 01:09:54 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:46.535 01:09:54 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:08:46.794 01:09:54 -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:08:46.794 01:09:54 -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:08:46.794 01:09:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:46.794 01:09:54 -- common/autotest_common.sh@10 -- # set +x 00:08:46.794 01:09:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:46.794 01:09:54 -- target/referrals.sh@73 -- # get_referral_ips rpc 00:08:46.794 01:09:54 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:08:46.794 01:09:54 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:46.794 01:09:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:46.794 01:09:54 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:08:46.794 01:09:54 -- common/autotest_common.sh@10 -- # set +x 00:08:46.794 01:09:54 -- target/referrals.sh@21 -- # sort 00:08:46.794 01:09:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:46.794 01:09:54 -- target/referrals.sh@21 -- # echo 127.0.0.2 00:08:46.794 01:09:54 -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:08:46.794 01:09:54 -- target/referrals.sh@74 -- # get_referral_ips nvme 00:08:46.794 01:09:54 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:46.794 01:09:54 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:46.794 01:09:54 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:46.794 01:09:54 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:46.794 01:09:54 -- target/referrals.sh@26 -- # sort 00:08:47.053 01:09:55 -- target/referrals.sh@26 -- # echo 127.0.0.2 00:08:47.053 01:09:55 -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:08:47.053 01:09:55 -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:08:47.053 01:09:55 -- target/referrals.sh@75 -- # jq -r .subnqn 00:08:47.053 01:09:55 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:08:47.053 01:09:55 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:47.053 01:09:55 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:08:47.053 01:09:55 -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:08:47.053 01:09:55 -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:08:47.053 01:09:55 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:08:47.053 01:09:55 -- target/referrals.sh@76 -- # jq -r .subnqn 00:08:47.053 01:09:55 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:47.053 01:09:55 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:08:47.311 01:09:55 -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:08:47.311 01:09:55 -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:08:47.311 01:09:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:47.311 01:09:55 -- common/autotest_common.sh@10 -- # set +x 00:08:47.311 01:09:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:47.311 01:09:55 -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:47.311 01:09:55 -- target/referrals.sh@82 -- # jq length 00:08:47.311 01:09:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:47.311 01:09:55 -- common/autotest_common.sh@10 -- # set +x 00:08:47.311 01:09:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:47.311 01:09:55 -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:08:47.311 01:09:55 -- target/referrals.sh@83 -- # get_referral_ips nvme 00:08:47.311 01:09:55 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:47.311 01:09:55 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:47.311 01:09:55 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:47.311 01:09:55 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:47.311 01:09:55 -- target/referrals.sh@26 -- # sort 00:08:47.569 01:09:55 -- target/referrals.sh@26 -- # echo 00:08:47.569 01:09:55 -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:08:47.569 01:09:55 -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:08:47.569 01:09:55 -- target/referrals.sh@86 -- # nvmftestfini 00:08:47.569 01:09:55 -- nvmf/common.sh@476 -- # nvmfcleanup 00:08:47.569 01:09:55 -- nvmf/common.sh@116 -- # sync 00:08:47.569 01:09:55 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:08:47.569 01:09:55 -- nvmf/common.sh@119 -- # set +e 00:08:47.569 01:09:55 -- nvmf/common.sh@120 -- # for i in {1..20} 00:08:47.569 01:09:55 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:08:47.569 rmmod nvme_tcp 00:08:47.569 rmmod nvme_fabrics 00:08:47.569 rmmod nvme_keyring 00:08:47.569 01:09:55 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:08:47.569 01:09:55 -- nvmf/common.sh@123 -- # set -e 00:08:47.569 01:09:55 -- nvmf/common.sh@124 -- # return 0 00:08:47.569 01:09:55 -- nvmf/common.sh@477 -- # '[' -n 1047666 ']' 00:08:47.569 01:09:55 -- nvmf/common.sh@478 -- # killprocess 1047666 00:08:47.569 01:09:55 -- common/autotest_common.sh@936 -- # '[' -z 1047666 ']' 00:08:47.569 01:09:55 -- common/autotest_common.sh@940 -- # kill -0 1047666 00:08:47.569 01:09:55 -- common/autotest_common.sh@941 -- # uname 00:08:47.569 01:09:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:47.569 01:09:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1047666 00:08:47.829 01:09:55 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:47.829 01:09:55 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:47.829 01:09:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1047666' 00:08:47.829 killing process with pid 1047666 00:08:47.829 01:09:55 -- common/autotest_common.sh@955 -- # kill 1047666 00:08:47.829 01:09:55 -- common/autotest_common.sh@960 -- # wait 1047666 00:08:47.829 01:09:56 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:08:47.829 01:09:56 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:08:47.829 01:09:56 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:08:47.829 01:09:56 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:47.829 01:09:56 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:08:47.829 01:09:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:47.829 01:09:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:47.829 01:09:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:50.368 01:09:58 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:08:50.368 00:08:50.368 real 0m7.788s 00:08:50.368 user 0m14.451s 00:08:50.368 sys 0m2.258s 00:08:50.368 01:09:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:50.368 01:09:58 -- common/autotest_common.sh@10 -- # set +x 00:08:50.368 ************************************ 00:08:50.368 END TEST nvmf_referrals 00:08:50.368 ************************************ 00:08:50.368 01:09:58 -- nvmf/nvmf.sh@27 -- # run_test nvmf_connect_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:08:50.368 01:09:58 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:50.368 01:09:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:50.368 01:09:58 -- common/autotest_common.sh@10 -- # set +x 00:08:50.368 ************************************ 00:08:50.368 START TEST nvmf_connect_disconnect 00:08:50.368 ************************************ 00:08:50.368 01:09:58 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:08:50.368 * Looking for test storage... 00:08:50.368 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:50.368 01:09:58 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:50.368 01:09:58 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:50.368 01:09:58 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:50.368 01:09:58 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:50.368 01:09:58 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:50.368 01:09:58 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:50.368 01:09:58 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:50.369 01:09:58 -- scripts/common.sh@335 -- # IFS=.-: 00:08:50.369 01:09:58 -- scripts/common.sh@335 -- # read -ra ver1 00:08:50.369 01:09:58 -- scripts/common.sh@336 -- # IFS=.-: 00:08:50.369 01:09:58 -- scripts/common.sh@336 -- # read -ra ver2 00:08:50.369 01:09:58 -- scripts/common.sh@337 -- # local 'op=<' 00:08:50.369 01:09:58 -- scripts/common.sh@339 -- # ver1_l=2 00:08:50.369 01:09:58 -- scripts/common.sh@340 -- # ver2_l=1 00:08:50.369 01:09:58 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:50.369 01:09:58 -- scripts/common.sh@343 -- # case "$op" in 00:08:50.369 01:09:58 -- scripts/common.sh@344 -- # : 1 00:08:50.369 01:09:58 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:50.369 01:09:58 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:50.369 01:09:58 -- scripts/common.sh@364 -- # decimal 1 00:08:50.369 01:09:58 -- scripts/common.sh@352 -- # local d=1 00:08:50.369 01:09:58 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:50.369 01:09:58 -- scripts/common.sh@354 -- # echo 1 00:08:50.369 01:09:58 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:50.369 01:09:58 -- scripts/common.sh@365 -- # decimal 2 00:08:50.369 01:09:58 -- scripts/common.sh@352 -- # local d=2 00:08:50.369 01:09:58 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:50.369 01:09:58 -- scripts/common.sh@354 -- # echo 2 00:08:50.369 01:09:58 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:50.369 01:09:58 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:50.369 01:09:58 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:50.369 01:09:58 -- scripts/common.sh@367 -- # return 0 00:08:50.369 01:09:58 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:50.369 01:09:58 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:50.369 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:50.369 --rc genhtml_branch_coverage=1 00:08:50.369 --rc genhtml_function_coverage=1 00:08:50.369 --rc genhtml_legend=1 00:08:50.369 --rc geninfo_all_blocks=1 00:08:50.369 --rc geninfo_unexecuted_blocks=1 00:08:50.369 00:08:50.369 ' 00:08:50.369 01:09:58 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:50.369 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:50.369 --rc genhtml_branch_coverage=1 00:08:50.369 --rc genhtml_function_coverage=1 00:08:50.369 --rc genhtml_legend=1 00:08:50.369 --rc geninfo_all_blocks=1 00:08:50.369 --rc geninfo_unexecuted_blocks=1 00:08:50.369 00:08:50.369 ' 00:08:50.369 01:09:58 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:50.369 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:50.369 --rc genhtml_branch_coverage=1 00:08:50.369 --rc genhtml_function_coverage=1 00:08:50.369 --rc genhtml_legend=1 00:08:50.369 --rc geninfo_all_blocks=1 00:08:50.369 --rc geninfo_unexecuted_blocks=1 00:08:50.369 00:08:50.369 ' 00:08:50.369 01:09:58 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:50.369 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:50.369 --rc genhtml_branch_coverage=1 00:08:50.369 --rc genhtml_function_coverage=1 00:08:50.369 --rc genhtml_legend=1 00:08:50.369 --rc geninfo_all_blocks=1 00:08:50.369 --rc geninfo_unexecuted_blocks=1 00:08:50.369 00:08:50.369 ' 00:08:50.369 01:09:58 -- target/connect_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:50.369 01:09:58 -- nvmf/common.sh@7 -- # uname -s 00:08:50.369 01:09:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:50.369 01:09:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:50.369 01:09:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:50.369 01:09:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:50.369 01:09:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:50.369 01:09:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:50.369 01:09:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:50.369 01:09:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:50.369 01:09:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:50.369 01:09:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:50.369 01:09:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:50.369 01:09:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:50.369 01:09:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:50.369 01:09:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:50.369 01:09:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:50.369 01:09:58 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:50.369 01:09:58 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:50.369 01:09:58 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:50.369 01:09:58 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:50.369 01:09:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:50.369 01:09:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:50.369 01:09:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:50.369 01:09:58 -- paths/export.sh@5 -- # export PATH 00:08:50.369 01:09:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:50.369 01:09:58 -- nvmf/common.sh@46 -- # : 0 00:08:50.369 01:09:58 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:50.369 01:09:58 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:50.369 01:09:58 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:50.369 01:09:58 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:50.369 01:09:58 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:50.369 01:09:58 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:50.369 01:09:58 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:50.369 01:09:58 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:50.369 01:09:58 -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:08:50.369 01:09:58 -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:08:50.369 01:09:58 -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:08:50.369 01:09:58 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:50.369 01:09:58 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:50.369 01:09:58 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:50.369 01:09:58 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:50.369 01:09:58 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:50.369 01:09:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:50.369 01:09:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:50.369 01:09:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:50.369 01:09:58 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:50.369 01:09:58 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:50.369 01:09:58 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:50.369 01:09:58 -- common/autotest_common.sh@10 -- # set +x 00:08:52.276 01:10:00 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:52.276 01:10:00 -- nvmf/common.sh@290 -- # pci_devs=() 00:08:52.276 01:10:00 -- nvmf/common.sh@290 -- # local -a pci_devs 00:08:52.276 01:10:00 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:08:52.276 01:10:00 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:08:52.276 01:10:00 -- nvmf/common.sh@292 -- # pci_drivers=() 00:08:52.276 01:10:00 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:08:52.276 01:10:00 -- nvmf/common.sh@294 -- # net_devs=() 00:08:52.276 01:10:00 -- nvmf/common.sh@294 -- # local -ga net_devs 00:08:52.276 01:10:00 -- nvmf/common.sh@295 -- # e810=() 00:08:52.276 01:10:00 -- nvmf/common.sh@295 -- # local -ga e810 00:08:52.276 01:10:00 -- nvmf/common.sh@296 -- # x722=() 00:08:52.276 01:10:00 -- nvmf/common.sh@296 -- # local -ga x722 00:08:52.276 01:10:00 -- nvmf/common.sh@297 -- # mlx=() 00:08:52.276 01:10:00 -- nvmf/common.sh@297 -- # local -ga mlx 00:08:52.276 01:10:00 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:52.276 01:10:00 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:52.276 01:10:00 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:52.276 01:10:00 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:52.276 01:10:00 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:52.276 01:10:00 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:52.276 01:10:00 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:52.276 01:10:00 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:52.276 01:10:00 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:52.276 01:10:00 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:52.276 01:10:00 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:52.276 01:10:00 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:08:52.276 01:10:00 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:08:52.276 01:10:00 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:08:52.276 01:10:00 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:08:52.276 01:10:00 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:08:52.276 01:10:00 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:08:52.276 01:10:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:52.276 01:10:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:08:52.276 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:08:52.276 01:10:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:52.276 01:10:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:52.276 01:10:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:52.276 01:10:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:52.276 01:10:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:52.276 01:10:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:52.276 01:10:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:08:52.276 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:08:52.276 01:10:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:52.276 01:10:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:52.276 01:10:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:52.276 01:10:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:52.276 01:10:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:52.276 01:10:00 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:08:52.276 01:10:00 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:08:52.276 01:10:00 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:08:52.276 01:10:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:52.276 01:10:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:52.276 01:10:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:52.276 01:10:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:52.276 01:10:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:08:52.276 Found net devices under 0000:0a:00.0: cvl_0_0 00:08:52.276 01:10:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:52.276 01:10:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:52.276 01:10:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:52.276 01:10:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:52.276 01:10:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:52.276 01:10:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:08:52.276 Found net devices under 0000:0a:00.1: cvl_0_1 00:08:52.276 01:10:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:52.276 01:10:00 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:08:52.276 01:10:00 -- nvmf/common.sh@402 -- # is_hw=yes 00:08:52.276 01:10:00 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:08:52.276 01:10:00 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:08:52.276 01:10:00 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:08:52.276 01:10:00 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:52.276 01:10:00 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:52.276 01:10:00 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:52.276 01:10:00 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:08:52.276 01:10:00 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:52.276 01:10:00 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:52.276 01:10:00 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:08:52.276 01:10:00 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:52.276 01:10:00 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:52.276 01:10:00 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:08:52.276 01:10:00 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:08:52.276 01:10:00 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:08:52.276 01:10:00 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:52.276 01:10:00 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:52.276 01:10:00 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:52.276 01:10:00 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:08:52.276 01:10:00 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:52.534 01:10:00 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:52.534 01:10:00 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:52.534 01:10:00 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:08:52.534 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:52.534 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.339 ms 00:08:52.534 00:08:52.534 --- 10.0.0.2 ping statistics --- 00:08:52.534 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:52.534 rtt min/avg/max/mdev = 0.339/0.339/0.339/0.000 ms 00:08:52.535 01:10:00 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:52.535 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:52.535 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.149 ms 00:08:52.535 00:08:52.535 --- 10.0.0.1 ping statistics --- 00:08:52.535 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:52.535 rtt min/avg/max/mdev = 0.149/0.149/0.149/0.000 ms 00:08:52.535 01:10:00 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:52.535 01:10:00 -- nvmf/common.sh@410 -- # return 0 00:08:52.535 01:10:00 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:08:52.535 01:10:00 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:52.535 01:10:00 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:08:52.535 01:10:00 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:08:52.535 01:10:00 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:52.535 01:10:00 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:08:52.535 01:10:00 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:08:52.535 01:10:00 -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:08:52.535 01:10:00 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:52.535 01:10:00 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:52.535 01:10:00 -- common/autotest_common.sh@10 -- # set +x 00:08:52.535 01:10:00 -- nvmf/common.sh@469 -- # nvmfpid=1050125 00:08:52.535 01:10:00 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:52.535 01:10:00 -- nvmf/common.sh@470 -- # waitforlisten 1050125 00:08:52.535 01:10:00 -- common/autotest_common.sh@829 -- # '[' -z 1050125 ']' 00:08:52.535 01:10:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:52.535 01:10:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:52.535 01:10:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:52.535 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:52.535 01:10:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:52.535 01:10:00 -- common/autotest_common.sh@10 -- # set +x 00:08:52.535 [2024-11-20 01:10:00.613970] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:08:52.535 [2024-11-20 01:10:00.614064] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:52.535 EAL: No free 2048 kB hugepages reported on node 1 00:08:52.535 [2024-11-20 01:10:00.684320] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:52.792 [2024-11-20 01:10:00.775041] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:52.792 [2024-11-20 01:10:00.775202] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:52.792 [2024-11-20 01:10:00.775221] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:52.792 [2024-11-20 01:10:00.775234] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:52.793 [2024-11-20 01:10:00.775282] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:52.793 [2024-11-20 01:10:00.775307] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:52.793 [2024-11-20 01:10:00.775368] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:52.793 [2024-11-20 01:10:00.775372] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:53.729 01:10:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:53.729 01:10:01 -- common/autotest_common.sh@862 -- # return 0 00:08:53.729 01:10:01 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:53.729 01:10:01 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:53.729 01:10:01 -- common/autotest_common.sh@10 -- # set +x 00:08:53.729 01:10:01 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:53.729 01:10:01 -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:08:53.729 01:10:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:53.729 01:10:01 -- common/autotest_common.sh@10 -- # set +x 00:08:53.729 [2024-11-20 01:10:01.655820] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:53.729 01:10:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:53.729 01:10:01 -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:08:53.729 01:10:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:53.729 01:10:01 -- common/autotest_common.sh@10 -- # set +x 00:08:53.729 01:10:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:53.729 01:10:01 -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:08:53.729 01:10:01 -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:08:53.729 01:10:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:53.729 01:10:01 -- common/autotest_common.sh@10 -- # set +x 00:08:53.729 01:10:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:53.729 01:10:01 -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:08:53.729 01:10:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:53.729 01:10:01 -- common/autotest_common.sh@10 -- # set +x 00:08:53.729 01:10:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:53.729 01:10:01 -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:53.729 01:10:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:53.729 01:10:01 -- common/autotest_common.sh@10 -- # set +x 00:08:53.729 [2024-11-20 01:10:01.708903] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:53.729 01:10:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:53.729 01:10:01 -- target/connect_disconnect.sh@26 -- # '[' 1 -eq 1 ']' 00:08:53.729 01:10:01 -- target/connect_disconnect.sh@27 -- # num_iterations=100 00:08:53.729 01:10:01 -- target/connect_disconnect.sh@29 -- # NVME_CONNECT='nvme connect -i 8' 00:08:53.729 01:10:01 -- target/connect_disconnect.sh@34 -- # set +x 00:08:56.262 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:58.166 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:00.698 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:02.608 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:05.153 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:07.686 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:09.595 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:12.131 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:14.668 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:16.575 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:19.107 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:21.646 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:23.553 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:26.177 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:28.084 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:30.622 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:32.547 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:35.082 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:36.990 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:39.530 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:42.069 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:43.974 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:46.512 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:49.049 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:50.956 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:53.497 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:56.037 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:57.946 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:00.483 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:02.388 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:04.925 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:07.461 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:09.367 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:11.968 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:13.874 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:16.410 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:18.952 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:20.860 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:23.394 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:25.302 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:27.833 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:30.371 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:32.276 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:34.809 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:37.346 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:39.254 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:41.791 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:43.700 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:46.236 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:48.774 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:50.681 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:53.220 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:55.831 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:57.740 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:00.276 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:02.809 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:04.715 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:07.248 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:09.780 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:11.685 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:14.220 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:16.759 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:18.668 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:21.206 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:23.738 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:25.644 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:28.181 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:30.718 [2024-11-20 01:12:38.382864] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb490a0 is same with the state(5) to be set 00:11:30.718 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:32.625 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:35.164 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:37.071 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:39.676 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:42.216 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:44.125 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:46.667 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:48.573 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:51.113 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:53.650 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:55.566 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:58.103 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:00.016 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:02.559 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:05.107 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:07.643 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:09.554 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:12.100 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:14.642 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:16.557 [2024-11-20 01:13:24.586804] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb490a0 is same with the state(5) to be set 00:12:16.557 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:19.104 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:21.017 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:23.591 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:26.128 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:28.664 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:30.568 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:33.107 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:35.643 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:37.548 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:40.086 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:42.623 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:44.529 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:44.529 01:13:52 -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:12:44.529 01:13:52 -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:12:44.529 01:13:52 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:44.529 01:13:52 -- nvmf/common.sh@116 -- # sync 00:12:44.529 01:13:52 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:44.529 01:13:52 -- nvmf/common.sh@119 -- # set +e 00:12:44.529 01:13:52 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:44.529 01:13:52 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:44.529 rmmod nvme_tcp 00:12:44.529 rmmod nvme_fabrics 00:12:44.529 rmmod nvme_keyring 00:12:44.529 01:13:52 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:44.529 01:13:52 -- nvmf/common.sh@123 -- # set -e 00:12:44.529 01:13:52 -- nvmf/common.sh@124 -- # return 0 00:12:44.529 01:13:52 -- nvmf/common.sh@477 -- # '[' -n 1050125 ']' 00:12:44.529 01:13:52 -- nvmf/common.sh@478 -- # killprocess 1050125 00:12:44.529 01:13:52 -- common/autotest_common.sh@936 -- # '[' -z 1050125 ']' 00:12:44.529 01:13:52 -- common/autotest_common.sh@940 -- # kill -0 1050125 00:12:44.529 01:13:52 -- common/autotest_common.sh@941 -- # uname 00:12:44.529 01:13:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:44.529 01:13:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1050125 00:12:44.529 01:13:52 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:12:44.529 01:13:52 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:12:44.529 01:13:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1050125' 00:12:44.529 killing process with pid 1050125 00:12:44.529 01:13:52 -- common/autotest_common.sh@955 -- # kill 1050125 00:12:44.529 01:13:52 -- common/autotest_common.sh@960 -- # wait 1050125 00:12:44.787 01:13:52 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:44.787 01:13:52 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:44.787 01:13:52 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:44.787 01:13:52 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:44.787 01:13:52 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:44.787 01:13:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:44.787 01:13:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:44.787 01:13:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:47.319 01:13:54 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:47.319 00:12:47.319 real 3m56.839s 00:12:47.319 user 15m3.159s 00:12:47.319 sys 0m34.487s 00:12:47.319 01:13:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:47.319 01:13:54 -- common/autotest_common.sh@10 -- # set +x 00:12:47.319 ************************************ 00:12:47.319 END TEST nvmf_connect_disconnect 00:12:47.319 ************************************ 00:12:47.319 01:13:54 -- nvmf/nvmf.sh@28 -- # run_test nvmf_multitarget /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:12:47.319 01:13:54 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:47.319 01:13:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:47.319 01:13:54 -- common/autotest_common.sh@10 -- # set +x 00:12:47.319 ************************************ 00:12:47.319 START TEST nvmf_multitarget 00:12:47.319 ************************************ 00:12:47.319 01:13:54 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:12:47.319 * Looking for test storage... 00:12:47.319 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:47.319 01:13:55 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:47.319 01:13:55 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:47.319 01:13:55 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:47.319 01:13:55 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:47.319 01:13:55 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:47.320 01:13:55 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:47.320 01:13:55 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:47.320 01:13:55 -- scripts/common.sh@335 -- # IFS=.-: 00:12:47.320 01:13:55 -- scripts/common.sh@335 -- # read -ra ver1 00:12:47.320 01:13:55 -- scripts/common.sh@336 -- # IFS=.-: 00:12:47.320 01:13:55 -- scripts/common.sh@336 -- # read -ra ver2 00:12:47.320 01:13:55 -- scripts/common.sh@337 -- # local 'op=<' 00:12:47.320 01:13:55 -- scripts/common.sh@339 -- # ver1_l=2 00:12:47.320 01:13:55 -- scripts/common.sh@340 -- # ver2_l=1 00:12:47.320 01:13:55 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:47.320 01:13:55 -- scripts/common.sh@343 -- # case "$op" in 00:12:47.320 01:13:55 -- scripts/common.sh@344 -- # : 1 00:12:47.320 01:13:55 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:47.320 01:13:55 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:47.320 01:13:55 -- scripts/common.sh@364 -- # decimal 1 00:12:47.320 01:13:55 -- scripts/common.sh@352 -- # local d=1 00:12:47.320 01:13:55 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:47.320 01:13:55 -- scripts/common.sh@354 -- # echo 1 00:12:47.320 01:13:55 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:47.320 01:13:55 -- scripts/common.sh@365 -- # decimal 2 00:12:47.320 01:13:55 -- scripts/common.sh@352 -- # local d=2 00:12:47.320 01:13:55 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:47.320 01:13:55 -- scripts/common.sh@354 -- # echo 2 00:12:47.320 01:13:55 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:47.320 01:13:55 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:47.320 01:13:55 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:47.320 01:13:55 -- scripts/common.sh@367 -- # return 0 00:12:47.320 01:13:55 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:47.320 01:13:55 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:47.320 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:47.320 --rc genhtml_branch_coverage=1 00:12:47.320 --rc genhtml_function_coverage=1 00:12:47.320 --rc genhtml_legend=1 00:12:47.320 --rc geninfo_all_blocks=1 00:12:47.320 --rc geninfo_unexecuted_blocks=1 00:12:47.320 00:12:47.320 ' 00:12:47.320 01:13:55 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:47.320 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:47.320 --rc genhtml_branch_coverage=1 00:12:47.320 --rc genhtml_function_coverage=1 00:12:47.320 --rc genhtml_legend=1 00:12:47.320 --rc geninfo_all_blocks=1 00:12:47.320 --rc geninfo_unexecuted_blocks=1 00:12:47.320 00:12:47.320 ' 00:12:47.320 01:13:55 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:47.320 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:47.320 --rc genhtml_branch_coverage=1 00:12:47.320 --rc genhtml_function_coverage=1 00:12:47.320 --rc genhtml_legend=1 00:12:47.320 --rc geninfo_all_blocks=1 00:12:47.320 --rc geninfo_unexecuted_blocks=1 00:12:47.320 00:12:47.320 ' 00:12:47.320 01:13:55 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:47.320 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:47.320 --rc genhtml_branch_coverage=1 00:12:47.320 --rc genhtml_function_coverage=1 00:12:47.320 --rc genhtml_legend=1 00:12:47.320 --rc geninfo_all_blocks=1 00:12:47.320 --rc geninfo_unexecuted_blocks=1 00:12:47.320 00:12:47.320 ' 00:12:47.320 01:13:55 -- target/multitarget.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:47.320 01:13:55 -- nvmf/common.sh@7 -- # uname -s 00:12:47.320 01:13:55 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:47.320 01:13:55 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:47.320 01:13:55 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:47.320 01:13:55 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:47.320 01:13:55 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:47.320 01:13:55 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:47.320 01:13:55 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:47.320 01:13:55 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:47.320 01:13:55 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:47.320 01:13:55 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:47.320 01:13:55 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:47.320 01:13:55 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:47.320 01:13:55 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:47.320 01:13:55 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:47.320 01:13:55 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:47.320 01:13:55 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:47.320 01:13:55 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:47.320 01:13:55 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:47.320 01:13:55 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:47.320 01:13:55 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:47.320 01:13:55 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:47.320 01:13:55 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:47.320 01:13:55 -- paths/export.sh@5 -- # export PATH 00:12:47.320 01:13:55 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:47.320 01:13:55 -- nvmf/common.sh@46 -- # : 0 00:12:47.320 01:13:55 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:47.320 01:13:55 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:47.320 01:13:55 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:47.320 01:13:55 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:47.320 01:13:55 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:47.320 01:13:55 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:47.320 01:13:55 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:47.320 01:13:55 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:47.320 01:13:55 -- target/multitarget.sh@13 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:12:47.320 01:13:55 -- target/multitarget.sh@15 -- # nvmftestinit 00:12:47.320 01:13:55 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:47.320 01:13:55 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:47.320 01:13:55 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:47.320 01:13:55 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:47.320 01:13:55 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:47.320 01:13:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:47.320 01:13:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:47.320 01:13:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:47.320 01:13:55 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:47.320 01:13:55 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:47.320 01:13:55 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:47.320 01:13:55 -- common/autotest_common.sh@10 -- # set +x 00:12:49.225 01:13:57 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:49.225 01:13:57 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:49.225 01:13:57 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:49.225 01:13:57 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:49.225 01:13:57 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:49.225 01:13:57 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:49.225 01:13:57 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:49.225 01:13:57 -- nvmf/common.sh@294 -- # net_devs=() 00:12:49.225 01:13:57 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:49.225 01:13:57 -- nvmf/common.sh@295 -- # e810=() 00:12:49.225 01:13:57 -- nvmf/common.sh@295 -- # local -ga e810 00:12:49.225 01:13:57 -- nvmf/common.sh@296 -- # x722=() 00:12:49.225 01:13:57 -- nvmf/common.sh@296 -- # local -ga x722 00:12:49.225 01:13:57 -- nvmf/common.sh@297 -- # mlx=() 00:12:49.225 01:13:57 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:49.225 01:13:57 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:49.225 01:13:57 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:49.225 01:13:57 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:49.225 01:13:57 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:49.225 01:13:57 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:49.225 01:13:57 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:49.225 01:13:57 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:49.225 01:13:57 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:49.225 01:13:57 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:49.225 01:13:57 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:49.225 01:13:57 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:49.225 01:13:57 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:49.225 01:13:57 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:49.225 01:13:57 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:49.225 01:13:57 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:49.225 01:13:57 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:49.225 01:13:57 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:49.226 01:13:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:49.226 01:13:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:49.226 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:49.226 01:13:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:49.226 01:13:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:49.226 01:13:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:49.226 01:13:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:49.226 01:13:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:49.226 01:13:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:49.226 01:13:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:49.226 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:49.226 01:13:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:49.226 01:13:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:49.226 01:13:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:49.226 01:13:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:49.226 01:13:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:49.226 01:13:57 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:49.226 01:13:57 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:49.226 01:13:57 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:49.226 01:13:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:49.226 01:13:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:49.226 01:13:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:49.226 01:13:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:49.226 01:13:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:49.226 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:49.226 01:13:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:49.226 01:13:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:49.226 01:13:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:49.226 01:13:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:49.226 01:13:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:49.226 01:13:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:49.226 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:49.226 01:13:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:49.226 01:13:57 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:49.226 01:13:57 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:49.226 01:13:57 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:49.226 01:13:57 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:49.226 01:13:57 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:49.226 01:13:57 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:49.226 01:13:57 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:49.226 01:13:57 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:49.226 01:13:57 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:49.226 01:13:57 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:49.226 01:13:57 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:49.226 01:13:57 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:49.226 01:13:57 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:49.226 01:13:57 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:49.226 01:13:57 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:49.226 01:13:57 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:49.226 01:13:57 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:49.226 01:13:57 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:49.226 01:13:57 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:49.226 01:13:57 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:49.226 01:13:57 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:49.226 01:13:57 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:49.485 01:13:57 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:49.485 01:13:57 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:49.485 01:13:57 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:49.485 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:49.485 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.213 ms 00:12:49.485 00:12:49.485 --- 10.0.0.2 ping statistics --- 00:12:49.485 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:49.485 rtt min/avg/max/mdev = 0.213/0.213/0.213/0.000 ms 00:12:49.485 01:13:57 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:49.485 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:49.485 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.110 ms 00:12:49.485 00:12:49.485 --- 10.0.0.1 ping statistics --- 00:12:49.485 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:49.485 rtt min/avg/max/mdev = 0.110/0.110/0.110/0.000 ms 00:12:49.485 01:13:57 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:49.485 01:13:57 -- nvmf/common.sh@410 -- # return 0 00:12:49.485 01:13:57 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:49.485 01:13:57 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:49.485 01:13:57 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:49.485 01:13:57 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:49.485 01:13:57 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:49.485 01:13:57 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:49.485 01:13:57 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:49.485 01:13:57 -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:12:49.485 01:13:57 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:49.485 01:13:57 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:49.485 01:13:57 -- common/autotest_common.sh@10 -- # set +x 00:12:49.485 01:13:57 -- nvmf/common.sh@469 -- # nvmfpid=1082155 00:12:49.485 01:13:57 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:12:49.485 01:13:57 -- nvmf/common.sh@470 -- # waitforlisten 1082155 00:12:49.485 01:13:57 -- common/autotest_common.sh@829 -- # '[' -z 1082155 ']' 00:12:49.485 01:13:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:49.485 01:13:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:49.485 01:13:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:49.485 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:49.485 01:13:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:49.485 01:13:57 -- common/autotest_common.sh@10 -- # set +x 00:12:49.485 [2024-11-20 01:13:57.549406] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:12:49.485 [2024-11-20 01:13:57.549502] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:49.485 EAL: No free 2048 kB hugepages reported on node 1 00:12:49.485 [2024-11-20 01:13:57.619156] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:49.745 [2024-11-20 01:13:57.714016] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:49.745 [2024-11-20 01:13:57.714199] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:49.745 [2024-11-20 01:13:57.714223] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:49.745 [2024-11-20 01:13:57.714239] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:49.745 [2024-11-20 01:13:57.714305] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:49.745 [2024-11-20 01:13:57.714362] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:49.745 [2024-11-20 01:13:57.714417] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:49.745 [2024-11-20 01:13:57.714420] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:50.311 01:13:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:50.311 01:13:58 -- common/autotest_common.sh@862 -- # return 0 00:12:50.311 01:13:58 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:50.311 01:13:58 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:50.311 01:13:58 -- common/autotest_common.sh@10 -- # set +x 00:12:50.570 01:13:58 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:50.570 01:13:58 -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:12:50.570 01:13:58 -- target/multitarget.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:12:50.570 01:13:58 -- target/multitarget.sh@21 -- # jq length 00:12:50.570 01:13:58 -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:12:50.570 01:13:58 -- target/multitarget.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:12:50.570 "nvmf_tgt_1" 00:12:50.570 01:13:58 -- target/multitarget.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:12:50.828 "nvmf_tgt_2" 00:12:50.828 01:13:58 -- target/multitarget.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:12:50.828 01:13:58 -- target/multitarget.sh@28 -- # jq length 00:12:50.828 01:13:58 -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:12:50.828 01:13:59 -- target/multitarget.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:12:51.086 true 00:12:51.086 01:13:59 -- target/multitarget.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:12:51.086 true 00:12:51.086 01:13:59 -- target/multitarget.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:12:51.086 01:13:59 -- target/multitarget.sh@35 -- # jq length 00:12:51.344 01:13:59 -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:12:51.344 01:13:59 -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:12:51.344 01:13:59 -- target/multitarget.sh@41 -- # nvmftestfini 00:12:51.344 01:13:59 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:51.344 01:13:59 -- nvmf/common.sh@116 -- # sync 00:12:51.344 01:13:59 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:51.344 01:13:59 -- nvmf/common.sh@119 -- # set +e 00:12:51.344 01:13:59 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:51.344 01:13:59 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:51.344 rmmod nvme_tcp 00:12:51.344 rmmod nvme_fabrics 00:12:51.344 rmmod nvme_keyring 00:12:51.344 01:13:59 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:51.344 01:13:59 -- nvmf/common.sh@123 -- # set -e 00:12:51.344 01:13:59 -- nvmf/common.sh@124 -- # return 0 00:12:51.344 01:13:59 -- nvmf/common.sh@477 -- # '[' -n 1082155 ']' 00:12:51.344 01:13:59 -- nvmf/common.sh@478 -- # killprocess 1082155 00:12:51.344 01:13:59 -- common/autotest_common.sh@936 -- # '[' -z 1082155 ']' 00:12:51.344 01:13:59 -- common/autotest_common.sh@940 -- # kill -0 1082155 00:12:51.344 01:13:59 -- common/autotest_common.sh@941 -- # uname 00:12:51.344 01:13:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:51.344 01:13:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1082155 00:12:51.344 01:13:59 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:12:51.344 01:13:59 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:12:51.344 01:13:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1082155' 00:12:51.344 killing process with pid 1082155 00:12:51.344 01:13:59 -- common/autotest_common.sh@955 -- # kill 1082155 00:12:51.344 01:13:59 -- common/autotest_common.sh@960 -- # wait 1082155 00:12:51.603 01:13:59 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:51.603 01:13:59 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:51.603 01:13:59 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:51.603 01:13:59 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:51.603 01:13:59 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:51.603 01:13:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:51.603 01:13:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:51.603 01:13:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:53.508 01:14:01 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:53.508 00:12:53.508 real 0m6.716s 00:12:53.508 user 0m9.555s 00:12:53.508 sys 0m2.001s 00:12:53.508 01:14:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:53.508 01:14:01 -- common/autotest_common.sh@10 -- # set +x 00:12:53.508 ************************************ 00:12:53.508 END TEST nvmf_multitarget 00:12:53.508 ************************************ 00:12:53.508 01:14:01 -- nvmf/nvmf.sh@29 -- # run_test nvmf_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:12:53.508 01:14:01 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:53.508 01:14:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:53.508 01:14:01 -- common/autotest_common.sh@10 -- # set +x 00:12:53.508 ************************************ 00:12:53.508 START TEST nvmf_rpc 00:12:53.508 ************************************ 00:12:53.509 01:14:01 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:12:53.769 * Looking for test storage... 00:12:53.769 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:53.769 01:14:01 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:53.769 01:14:01 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:53.769 01:14:01 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:53.769 01:14:01 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:53.769 01:14:01 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:53.769 01:14:01 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:53.769 01:14:01 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:53.769 01:14:01 -- scripts/common.sh@335 -- # IFS=.-: 00:12:53.769 01:14:01 -- scripts/common.sh@335 -- # read -ra ver1 00:12:53.769 01:14:01 -- scripts/common.sh@336 -- # IFS=.-: 00:12:53.769 01:14:01 -- scripts/common.sh@336 -- # read -ra ver2 00:12:53.769 01:14:01 -- scripts/common.sh@337 -- # local 'op=<' 00:12:53.769 01:14:01 -- scripts/common.sh@339 -- # ver1_l=2 00:12:53.769 01:14:01 -- scripts/common.sh@340 -- # ver2_l=1 00:12:53.769 01:14:01 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:53.769 01:14:01 -- scripts/common.sh@343 -- # case "$op" in 00:12:53.769 01:14:01 -- scripts/common.sh@344 -- # : 1 00:12:53.769 01:14:01 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:53.769 01:14:01 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:53.769 01:14:01 -- scripts/common.sh@364 -- # decimal 1 00:12:53.769 01:14:01 -- scripts/common.sh@352 -- # local d=1 00:12:53.769 01:14:01 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:53.769 01:14:01 -- scripts/common.sh@354 -- # echo 1 00:12:53.769 01:14:01 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:53.769 01:14:01 -- scripts/common.sh@365 -- # decimal 2 00:12:53.769 01:14:01 -- scripts/common.sh@352 -- # local d=2 00:12:53.769 01:14:01 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:53.769 01:14:01 -- scripts/common.sh@354 -- # echo 2 00:12:53.769 01:14:01 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:53.769 01:14:01 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:53.769 01:14:01 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:53.769 01:14:01 -- scripts/common.sh@367 -- # return 0 00:12:53.769 01:14:01 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:53.769 01:14:01 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:53.769 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:53.769 --rc genhtml_branch_coverage=1 00:12:53.769 --rc genhtml_function_coverage=1 00:12:53.769 --rc genhtml_legend=1 00:12:53.769 --rc geninfo_all_blocks=1 00:12:53.769 --rc geninfo_unexecuted_blocks=1 00:12:53.769 00:12:53.769 ' 00:12:53.769 01:14:01 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:53.769 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:53.769 --rc genhtml_branch_coverage=1 00:12:53.769 --rc genhtml_function_coverage=1 00:12:53.769 --rc genhtml_legend=1 00:12:53.769 --rc geninfo_all_blocks=1 00:12:53.769 --rc geninfo_unexecuted_blocks=1 00:12:53.769 00:12:53.769 ' 00:12:53.769 01:14:01 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:53.769 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:53.769 --rc genhtml_branch_coverage=1 00:12:53.769 --rc genhtml_function_coverage=1 00:12:53.769 --rc genhtml_legend=1 00:12:53.769 --rc geninfo_all_blocks=1 00:12:53.769 --rc geninfo_unexecuted_blocks=1 00:12:53.769 00:12:53.769 ' 00:12:53.769 01:14:01 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:53.769 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:53.769 --rc genhtml_branch_coverage=1 00:12:53.769 --rc genhtml_function_coverage=1 00:12:53.769 --rc genhtml_legend=1 00:12:53.769 --rc geninfo_all_blocks=1 00:12:53.769 --rc geninfo_unexecuted_blocks=1 00:12:53.769 00:12:53.769 ' 00:12:53.769 01:14:01 -- target/rpc.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:53.769 01:14:01 -- nvmf/common.sh@7 -- # uname -s 00:12:53.769 01:14:01 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:53.769 01:14:01 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:53.769 01:14:01 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:53.769 01:14:01 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:53.769 01:14:01 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:53.769 01:14:01 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:53.769 01:14:01 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:53.769 01:14:01 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:53.769 01:14:01 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:53.769 01:14:01 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:53.769 01:14:01 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:53.769 01:14:01 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:53.769 01:14:01 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:53.769 01:14:01 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:53.769 01:14:01 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:53.769 01:14:01 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:53.769 01:14:01 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:53.769 01:14:01 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:53.769 01:14:01 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:53.769 01:14:01 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:53.770 01:14:01 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:53.770 01:14:01 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:53.770 01:14:01 -- paths/export.sh@5 -- # export PATH 00:12:53.770 01:14:01 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:53.770 01:14:01 -- nvmf/common.sh@46 -- # : 0 00:12:53.770 01:14:01 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:53.770 01:14:01 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:53.770 01:14:01 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:53.770 01:14:01 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:53.770 01:14:01 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:53.770 01:14:01 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:53.770 01:14:01 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:53.770 01:14:01 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:53.770 01:14:01 -- target/rpc.sh@11 -- # loops=5 00:12:53.770 01:14:01 -- target/rpc.sh@23 -- # nvmftestinit 00:12:53.770 01:14:01 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:53.770 01:14:01 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:53.770 01:14:01 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:53.770 01:14:01 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:53.770 01:14:01 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:53.770 01:14:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:53.770 01:14:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:53.770 01:14:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:53.770 01:14:01 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:53.770 01:14:01 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:53.770 01:14:01 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:53.770 01:14:01 -- common/autotest_common.sh@10 -- # set +x 00:12:56.309 01:14:03 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:56.309 01:14:03 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:56.309 01:14:03 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:56.309 01:14:03 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:56.309 01:14:03 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:56.309 01:14:03 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:56.309 01:14:03 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:56.309 01:14:03 -- nvmf/common.sh@294 -- # net_devs=() 00:12:56.309 01:14:03 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:56.309 01:14:03 -- nvmf/common.sh@295 -- # e810=() 00:12:56.309 01:14:03 -- nvmf/common.sh@295 -- # local -ga e810 00:12:56.309 01:14:03 -- nvmf/common.sh@296 -- # x722=() 00:12:56.309 01:14:03 -- nvmf/common.sh@296 -- # local -ga x722 00:12:56.309 01:14:03 -- nvmf/common.sh@297 -- # mlx=() 00:12:56.309 01:14:03 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:56.309 01:14:03 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:56.309 01:14:04 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:56.309 01:14:04 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:56.309 01:14:04 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:56.309 01:14:04 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:56.309 01:14:04 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:56.309 01:14:04 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:56.309 01:14:04 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:56.309 01:14:04 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:56.309 01:14:04 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:56.309 01:14:04 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:56.309 01:14:04 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:56.309 01:14:04 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:56.309 01:14:04 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:56.309 01:14:04 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:56.309 01:14:04 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:56.309 01:14:04 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:56.309 01:14:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:56.309 01:14:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:56.309 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:56.309 01:14:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:56.309 01:14:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:56.309 01:14:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:56.309 01:14:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:56.309 01:14:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:56.309 01:14:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:56.309 01:14:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:56.309 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:56.309 01:14:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:56.309 01:14:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:56.309 01:14:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:56.309 01:14:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:56.309 01:14:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:56.309 01:14:04 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:56.309 01:14:04 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:56.309 01:14:04 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:56.309 01:14:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:56.309 01:14:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:56.309 01:14:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:56.309 01:14:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:56.309 01:14:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:56.309 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:56.309 01:14:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:56.309 01:14:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:56.309 01:14:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:56.309 01:14:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:56.309 01:14:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:56.309 01:14:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:56.309 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:56.309 01:14:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:56.309 01:14:04 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:56.309 01:14:04 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:56.309 01:14:04 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:56.309 01:14:04 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:56.309 01:14:04 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:56.309 01:14:04 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:56.309 01:14:04 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:56.309 01:14:04 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:56.309 01:14:04 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:56.309 01:14:04 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:56.309 01:14:04 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:56.309 01:14:04 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:56.309 01:14:04 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:56.309 01:14:04 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:56.309 01:14:04 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:56.309 01:14:04 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:56.309 01:14:04 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:56.309 01:14:04 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:56.309 01:14:04 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:56.309 01:14:04 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:56.309 01:14:04 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:56.310 01:14:04 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:56.310 01:14:04 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:56.310 01:14:04 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:56.310 01:14:04 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:56.310 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:56.310 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.228 ms 00:12:56.310 00:12:56.310 --- 10.0.0.2 ping statistics --- 00:12:56.310 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:56.310 rtt min/avg/max/mdev = 0.228/0.228/0.228/0.000 ms 00:12:56.310 01:14:04 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:56.310 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:56.310 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.088 ms 00:12:56.310 00:12:56.310 --- 10.0.0.1 ping statistics --- 00:12:56.310 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:56.310 rtt min/avg/max/mdev = 0.088/0.088/0.088/0.000 ms 00:12:56.310 01:14:04 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:56.310 01:14:04 -- nvmf/common.sh@410 -- # return 0 00:12:56.310 01:14:04 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:56.310 01:14:04 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:56.310 01:14:04 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:56.310 01:14:04 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:56.310 01:14:04 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:56.310 01:14:04 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:56.310 01:14:04 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:56.310 01:14:04 -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:12:56.310 01:14:04 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:56.310 01:14:04 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:56.310 01:14:04 -- common/autotest_common.sh@10 -- # set +x 00:12:56.310 01:14:04 -- nvmf/common.sh@469 -- # nvmfpid=1084414 00:12:56.310 01:14:04 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:12:56.310 01:14:04 -- nvmf/common.sh@470 -- # waitforlisten 1084414 00:12:56.310 01:14:04 -- common/autotest_common.sh@829 -- # '[' -z 1084414 ']' 00:12:56.310 01:14:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:56.310 01:14:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:56.310 01:14:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:56.310 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:56.310 01:14:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:56.310 01:14:04 -- common/autotest_common.sh@10 -- # set +x 00:12:56.310 [2024-11-20 01:14:04.209869] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:12:56.310 [2024-11-20 01:14:04.209962] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:56.310 EAL: No free 2048 kB hugepages reported on node 1 00:12:56.310 [2024-11-20 01:14:04.280022] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:56.310 [2024-11-20 01:14:04.374572] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:56.310 [2024-11-20 01:14:04.374767] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:56.310 [2024-11-20 01:14:04.374787] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:56.310 [2024-11-20 01:14:04.374801] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:56.310 [2024-11-20 01:14:04.374893] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:56.310 [2024-11-20 01:14:04.374947] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:56.310 [2024-11-20 01:14:04.374999] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:56.310 [2024-11-20 01:14:04.375002] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:57.247 01:14:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:57.247 01:14:05 -- common/autotest_common.sh@862 -- # return 0 00:12:57.247 01:14:05 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:57.247 01:14:05 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:57.247 01:14:05 -- common/autotest_common.sh@10 -- # set +x 00:12:57.247 01:14:05 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:57.247 01:14:05 -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:12:57.247 01:14:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:57.247 01:14:05 -- common/autotest_common.sh@10 -- # set +x 00:12:57.247 01:14:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:57.247 01:14:05 -- target/rpc.sh@26 -- # stats='{ 00:12:57.247 "tick_rate": 2700000000, 00:12:57.247 "poll_groups": [ 00:12:57.247 { 00:12:57.247 "name": "nvmf_tgt_poll_group_0", 00:12:57.247 "admin_qpairs": 0, 00:12:57.247 "io_qpairs": 0, 00:12:57.247 "current_admin_qpairs": 0, 00:12:57.247 "current_io_qpairs": 0, 00:12:57.247 "pending_bdev_io": 0, 00:12:57.247 "completed_nvme_io": 0, 00:12:57.247 "transports": [] 00:12:57.247 }, 00:12:57.247 { 00:12:57.247 "name": "nvmf_tgt_poll_group_1", 00:12:57.247 "admin_qpairs": 0, 00:12:57.247 "io_qpairs": 0, 00:12:57.247 "current_admin_qpairs": 0, 00:12:57.247 "current_io_qpairs": 0, 00:12:57.247 "pending_bdev_io": 0, 00:12:57.247 "completed_nvme_io": 0, 00:12:57.247 "transports": [] 00:12:57.247 }, 00:12:57.247 { 00:12:57.247 "name": "nvmf_tgt_poll_group_2", 00:12:57.247 "admin_qpairs": 0, 00:12:57.247 "io_qpairs": 0, 00:12:57.247 "current_admin_qpairs": 0, 00:12:57.247 "current_io_qpairs": 0, 00:12:57.247 "pending_bdev_io": 0, 00:12:57.247 "completed_nvme_io": 0, 00:12:57.247 "transports": [] 00:12:57.247 }, 00:12:57.247 { 00:12:57.247 "name": "nvmf_tgt_poll_group_3", 00:12:57.247 "admin_qpairs": 0, 00:12:57.247 "io_qpairs": 0, 00:12:57.247 "current_admin_qpairs": 0, 00:12:57.247 "current_io_qpairs": 0, 00:12:57.247 "pending_bdev_io": 0, 00:12:57.247 "completed_nvme_io": 0, 00:12:57.247 "transports": [] 00:12:57.247 } 00:12:57.247 ] 00:12:57.247 }' 00:12:57.247 01:14:05 -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:12:57.247 01:14:05 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:12:57.247 01:14:05 -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:12:57.247 01:14:05 -- target/rpc.sh@15 -- # wc -l 00:12:57.247 01:14:05 -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:12:57.247 01:14:05 -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:12:57.247 01:14:05 -- target/rpc.sh@29 -- # [[ null == null ]] 00:12:57.247 01:14:05 -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:12:57.247 01:14:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:57.247 01:14:05 -- common/autotest_common.sh@10 -- # set +x 00:12:57.247 [2024-11-20 01:14:05.279925] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:57.247 01:14:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:57.247 01:14:05 -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:12:57.247 01:14:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:57.247 01:14:05 -- common/autotest_common.sh@10 -- # set +x 00:12:57.247 01:14:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:57.247 01:14:05 -- target/rpc.sh@33 -- # stats='{ 00:12:57.247 "tick_rate": 2700000000, 00:12:57.247 "poll_groups": [ 00:12:57.247 { 00:12:57.247 "name": "nvmf_tgt_poll_group_0", 00:12:57.247 "admin_qpairs": 0, 00:12:57.247 "io_qpairs": 0, 00:12:57.247 "current_admin_qpairs": 0, 00:12:57.247 "current_io_qpairs": 0, 00:12:57.247 "pending_bdev_io": 0, 00:12:57.247 "completed_nvme_io": 0, 00:12:57.247 "transports": [ 00:12:57.247 { 00:12:57.247 "trtype": "TCP" 00:12:57.247 } 00:12:57.247 ] 00:12:57.247 }, 00:12:57.247 { 00:12:57.247 "name": "nvmf_tgt_poll_group_1", 00:12:57.247 "admin_qpairs": 0, 00:12:57.247 "io_qpairs": 0, 00:12:57.247 "current_admin_qpairs": 0, 00:12:57.247 "current_io_qpairs": 0, 00:12:57.247 "pending_bdev_io": 0, 00:12:57.247 "completed_nvme_io": 0, 00:12:57.247 "transports": [ 00:12:57.247 { 00:12:57.247 "trtype": "TCP" 00:12:57.247 } 00:12:57.247 ] 00:12:57.247 }, 00:12:57.247 { 00:12:57.247 "name": "nvmf_tgt_poll_group_2", 00:12:57.247 "admin_qpairs": 0, 00:12:57.247 "io_qpairs": 0, 00:12:57.247 "current_admin_qpairs": 0, 00:12:57.247 "current_io_qpairs": 0, 00:12:57.247 "pending_bdev_io": 0, 00:12:57.247 "completed_nvme_io": 0, 00:12:57.247 "transports": [ 00:12:57.247 { 00:12:57.247 "trtype": "TCP" 00:12:57.247 } 00:12:57.247 ] 00:12:57.247 }, 00:12:57.247 { 00:12:57.247 "name": "nvmf_tgt_poll_group_3", 00:12:57.247 "admin_qpairs": 0, 00:12:57.247 "io_qpairs": 0, 00:12:57.247 "current_admin_qpairs": 0, 00:12:57.247 "current_io_qpairs": 0, 00:12:57.247 "pending_bdev_io": 0, 00:12:57.247 "completed_nvme_io": 0, 00:12:57.247 "transports": [ 00:12:57.247 { 00:12:57.247 "trtype": "TCP" 00:12:57.247 } 00:12:57.247 ] 00:12:57.247 } 00:12:57.247 ] 00:12:57.247 }' 00:12:57.247 01:14:05 -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:12:57.247 01:14:05 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:12:57.247 01:14:05 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:12:57.247 01:14:05 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:57.247 01:14:05 -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:12:57.247 01:14:05 -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:12:57.248 01:14:05 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:12:57.248 01:14:05 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:12:57.248 01:14:05 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:57.248 01:14:05 -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:12:57.248 01:14:05 -- target/rpc.sh@38 -- # '[' rdma == tcp ']' 00:12:57.248 01:14:05 -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:12:57.248 01:14:05 -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:12:57.248 01:14:05 -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:12:57.248 01:14:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:57.248 01:14:05 -- common/autotest_common.sh@10 -- # set +x 00:12:57.248 Malloc1 00:12:57.248 01:14:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:57.248 01:14:05 -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:12:57.248 01:14:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:57.248 01:14:05 -- common/autotest_common.sh@10 -- # set +x 00:12:57.248 01:14:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:57.248 01:14:05 -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:57.248 01:14:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:57.248 01:14:05 -- common/autotest_common.sh@10 -- # set +x 00:12:57.248 01:14:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:57.248 01:14:05 -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:12:57.248 01:14:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:57.248 01:14:05 -- common/autotest_common.sh@10 -- # set +x 00:12:57.248 01:14:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:57.248 01:14:05 -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:57.248 01:14:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:57.248 01:14:05 -- common/autotest_common.sh@10 -- # set +x 00:12:57.248 [2024-11-20 01:14:05.433330] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:57.248 01:14:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:57.248 01:14:05 -- target/rpc.sh@58 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:12:57.248 01:14:05 -- common/autotest_common.sh@650 -- # local es=0 00:12:57.248 01:14:05 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:12:57.248 01:14:05 -- common/autotest_common.sh@638 -- # local arg=nvme 00:12:57.248 01:14:05 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:57.248 01:14:05 -- common/autotest_common.sh@642 -- # type -t nvme 00:12:57.248 01:14:05 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:57.248 01:14:05 -- common/autotest_common.sh@644 -- # type -P nvme 00:12:57.248 01:14:05 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:57.248 01:14:05 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:12:57.248 01:14:05 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:12:57.248 01:14:05 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:12:57.248 [2024-11-20 01:14:05.455915] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:12:57.508 Failed to write to /dev/nvme-fabrics: Input/output error 00:12:57.508 could not add new controller: failed to write to nvme-fabrics device 00:12:57.508 01:14:05 -- common/autotest_common.sh@653 -- # es=1 00:12:57.508 01:14:05 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:12:57.508 01:14:05 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:12:57.508 01:14:05 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:12:57.508 01:14:05 -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:57.508 01:14:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:57.508 01:14:05 -- common/autotest_common.sh@10 -- # set +x 00:12:57.508 01:14:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:57.508 01:14:05 -- target/rpc.sh@62 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:58.077 01:14:06 -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:12:58.077 01:14:06 -- common/autotest_common.sh@1187 -- # local i=0 00:12:58.077 01:14:06 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:58.077 01:14:06 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:58.077 01:14:06 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:59.980 01:14:08 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:59.980 01:14:08 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:59.980 01:14:08 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:59.980 01:14:08 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:59.980 01:14:08 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:59.980 01:14:08 -- common/autotest_common.sh@1197 -- # return 0 00:12:59.980 01:14:08 -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:00.240 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:00.240 01:14:08 -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:00.240 01:14:08 -- common/autotest_common.sh@1208 -- # local i=0 00:13:00.240 01:14:08 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:00.240 01:14:08 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:00.240 01:14:08 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:00.240 01:14:08 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:00.240 01:14:08 -- common/autotest_common.sh@1220 -- # return 0 00:13:00.240 01:14:08 -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:00.240 01:14:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:00.240 01:14:08 -- common/autotest_common.sh@10 -- # set +x 00:13:00.240 01:14:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:00.240 01:14:08 -- target/rpc.sh@69 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:00.240 01:14:08 -- common/autotest_common.sh@650 -- # local es=0 00:13:00.240 01:14:08 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:00.240 01:14:08 -- common/autotest_common.sh@638 -- # local arg=nvme 00:13:00.240 01:14:08 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:00.240 01:14:08 -- common/autotest_common.sh@642 -- # type -t nvme 00:13:00.240 01:14:08 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:00.240 01:14:08 -- common/autotest_common.sh@644 -- # type -P nvme 00:13:00.240 01:14:08 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:00.240 01:14:08 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:13:00.240 01:14:08 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:13:00.240 01:14:08 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:00.240 [2024-11-20 01:14:08.254805] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:13:00.240 Failed to write to /dev/nvme-fabrics: Input/output error 00:13:00.240 could not add new controller: failed to write to nvme-fabrics device 00:13:00.240 01:14:08 -- common/autotest_common.sh@653 -- # es=1 00:13:00.240 01:14:08 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:13:00.240 01:14:08 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:13:00.240 01:14:08 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:13:00.240 01:14:08 -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:13:00.240 01:14:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:00.240 01:14:08 -- common/autotest_common.sh@10 -- # set +x 00:13:00.240 01:14:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:00.240 01:14:08 -- target/rpc.sh@73 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:00.810 01:14:08 -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:13:00.810 01:14:08 -- common/autotest_common.sh@1187 -- # local i=0 00:13:00.810 01:14:08 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:00.810 01:14:08 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:00.810 01:14:08 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:02.809 01:14:10 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:02.809 01:14:10 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:02.809 01:14:10 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:02.809 01:14:10 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:02.809 01:14:10 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:02.809 01:14:10 -- common/autotest_common.sh@1197 -- # return 0 00:13:02.809 01:14:10 -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:02.809 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:02.809 01:14:10 -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:02.809 01:14:10 -- common/autotest_common.sh@1208 -- # local i=0 00:13:02.809 01:14:10 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:02.809 01:14:10 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:02.809 01:14:11 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:02.809 01:14:11 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:02.809 01:14:11 -- common/autotest_common.sh@1220 -- # return 0 00:13:02.809 01:14:11 -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:02.809 01:14:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:02.809 01:14:11 -- common/autotest_common.sh@10 -- # set +x 00:13:03.069 01:14:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:03.069 01:14:11 -- target/rpc.sh@81 -- # seq 1 5 00:13:03.069 01:14:11 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:03.069 01:14:11 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:03.069 01:14:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:03.069 01:14:11 -- common/autotest_common.sh@10 -- # set +x 00:13:03.069 01:14:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:03.069 01:14:11 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:03.069 01:14:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:03.069 01:14:11 -- common/autotest_common.sh@10 -- # set +x 00:13:03.069 [2024-11-20 01:14:11.041492] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:03.069 01:14:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:03.069 01:14:11 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:03.069 01:14:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:03.069 01:14:11 -- common/autotest_common.sh@10 -- # set +x 00:13:03.069 01:14:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:03.069 01:14:11 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:03.069 01:14:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:03.069 01:14:11 -- common/autotest_common.sh@10 -- # set +x 00:13:03.069 01:14:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:03.069 01:14:11 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:03.636 01:14:11 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:03.636 01:14:11 -- common/autotest_common.sh@1187 -- # local i=0 00:13:03.636 01:14:11 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:03.636 01:14:11 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:03.636 01:14:11 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:05.538 01:14:13 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:05.538 01:14:13 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:05.538 01:14:13 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:05.538 01:14:13 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:05.538 01:14:13 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:05.538 01:14:13 -- common/autotest_common.sh@1197 -- # return 0 00:13:05.538 01:14:13 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:05.798 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:05.798 01:14:13 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:05.798 01:14:13 -- common/autotest_common.sh@1208 -- # local i=0 00:13:05.798 01:14:13 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:05.798 01:14:13 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:05.798 01:14:13 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:05.798 01:14:13 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:05.798 01:14:13 -- common/autotest_common.sh@1220 -- # return 0 00:13:05.798 01:14:13 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:05.798 01:14:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:05.798 01:14:13 -- common/autotest_common.sh@10 -- # set +x 00:13:05.798 01:14:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:05.798 01:14:13 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:05.798 01:14:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:05.798 01:14:13 -- common/autotest_common.sh@10 -- # set +x 00:13:05.798 01:14:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:05.798 01:14:13 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:05.798 01:14:13 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:05.798 01:14:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:05.798 01:14:13 -- common/autotest_common.sh@10 -- # set +x 00:13:05.798 01:14:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:05.798 01:14:13 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:05.798 01:14:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:05.798 01:14:13 -- common/autotest_common.sh@10 -- # set +x 00:13:05.798 [2024-11-20 01:14:13.819339] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:05.798 01:14:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:05.798 01:14:13 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:05.798 01:14:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:05.798 01:14:13 -- common/autotest_common.sh@10 -- # set +x 00:13:05.798 01:14:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:05.798 01:14:13 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:05.798 01:14:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:05.798 01:14:13 -- common/autotest_common.sh@10 -- # set +x 00:13:05.798 01:14:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:05.798 01:14:13 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:06.367 01:14:14 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:06.367 01:14:14 -- common/autotest_common.sh@1187 -- # local i=0 00:13:06.367 01:14:14 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:06.367 01:14:14 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:06.367 01:14:14 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:08.906 01:14:16 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:08.906 01:14:16 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:08.906 01:14:16 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:08.907 01:14:16 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:08.907 01:14:16 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:08.907 01:14:16 -- common/autotest_common.sh@1197 -- # return 0 00:13:08.907 01:14:16 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:08.907 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:08.907 01:14:16 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:08.907 01:14:16 -- common/autotest_common.sh@1208 -- # local i=0 00:13:08.907 01:14:16 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:08.907 01:14:16 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:08.907 01:14:16 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:08.907 01:14:16 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:08.907 01:14:16 -- common/autotest_common.sh@1220 -- # return 0 00:13:08.907 01:14:16 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:08.907 01:14:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:08.907 01:14:16 -- common/autotest_common.sh@10 -- # set +x 00:13:08.907 01:14:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:08.907 01:14:16 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:08.907 01:14:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:08.907 01:14:16 -- common/autotest_common.sh@10 -- # set +x 00:13:08.907 01:14:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:08.907 01:14:16 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:08.907 01:14:16 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:08.907 01:14:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:08.907 01:14:16 -- common/autotest_common.sh@10 -- # set +x 00:13:08.907 01:14:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:08.907 01:14:16 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:08.907 01:14:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:08.907 01:14:16 -- common/autotest_common.sh@10 -- # set +x 00:13:08.907 [2024-11-20 01:14:16.684816] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:08.907 01:14:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:08.907 01:14:16 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:08.907 01:14:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:08.907 01:14:16 -- common/autotest_common.sh@10 -- # set +x 00:13:08.907 01:14:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:08.907 01:14:16 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:08.907 01:14:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:08.907 01:14:16 -- common/autotest_common.sh@10 -- # set +x 00:13:08.907 01:14:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:08.907 01:14:16 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:09.475 01:14:17 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:09.475 01:14:17 -- common/autotest_common.sh@1187 -- # local i=0 00:13:09.475 01:14:17 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:09.475 01:14:17 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:09.475 01:14:17 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:11.380 01:14:19 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:11.380 01:14:19 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:11.380 01:14:19 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:11.380 01:14:19 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:11.380 01:14:19 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:11.380 01:14:19 -- common/autotest_common.sh@1197 -- # return 0 00:13:11.380 01:14:19 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:11.380 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:11.380 01:14:19 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:11.380 01:14:19 -- common/autotest_common.sh@1208 -- # local i=0 00:13:11.380 01:14:19 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:11.380 01:14:19 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:11.380 01:14:19 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:11.380 01:14:19 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:11.380 01:14:19 -- common/autotest_common.sh@1220 -- # return 0 00:13:11.380 01:14:19 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:11.380 01:14:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.380 01:14:19 -- common/autotest_common.sh@10 -- # set +x 00:13:11.380 01:14:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.381 01:14:19 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:11.381 01:14:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.381 01:14:19 -- common/autotest_common.sh@10 -- # set +x 00:13:11.381 01:14:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.381 01:14:19 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:11.381 01:14:19 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:11.381 01:14:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.381 01:14:19 -- common/autotest_common.sh@10 -- # set +x 00:13:11.381 01:14:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.381 01:14:19 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:11.381 01:14:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.381 01:14:19 -- common/autotest_common.sh@10 -- # set +x 00:13:11.381 [2024-11-20 01:14:19.524667] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:11.381 01:14:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.381 01:14:19 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:11.381 01:14:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.381 01:14:19 -- common/autotest_common.sh@10 -- # set +x 00:13:11.381 01:14:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.381 01:14:19 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:11.381 01:14:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.381 01:14:19 -- common/autotest_common.sh@10 -- # set +x 00:13:11.381 01:14:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.381 01:14:19 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:12.317 01:14:20 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:12.317 01:14:20 -- common/autotest_common.sh@1187 -- # local i=0 00:13:12.317 01:14:20 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:12.317 01:14:20 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:12.317 01:14:20 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:14.224 01:14:22 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:14.224 01:14:22 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:14.224 01:14:22 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:14.224 01:14:22 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:14.224 01:14:22 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:14.224 01:14:22 -- common/autotest_common.sh@1197 -- # return 0 00:13:14.224 01:14:22 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:14.224 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:14.225 01:14:22 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:14.225 01:14:22 -- common/autotest_common.sh@1208 -- # local i=0 00:13:14.225 01:14:22 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:14.225 01:14:22 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:14.225 01:14:22 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:14.225 01:14:22 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:14.225 01:14:22 -- common/autotest_common.sh@1220 -- # return 0 00:13:14.225 01:14:22 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:14.225 01:14:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:14.225 01:14:22 -- common/autotest_common.sh@10 -- # set +x 00:13:14.225 01:14:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:14.225 01:14:22 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:14.225 01:14:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:14.225 01:14:22 -- common/autotest_common.sh@10 -- # set +x 00:13:14.225 01:14:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:14.225 01:14:22 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:14.225 01:14:22 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:14.225 01:14:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:14.225 01:14:22 -- common/autotest_common.sh@10 -- # set +x 00:13:14.225 01:14:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:14.225 01:14:22 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:14.225 01:14:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:14.225 01:14:22 -- common/autotest_common.sh@10 -- # set +x 00:13:14.225 [2024-11-20 01:14:22.348334] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:14.225 01:14:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:14.225 01:14:22 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:14.225 01:14:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:14.225 01:14:22 -- common/autotest_common.sh@10 -- # set +x 00:13:14.225 01:14:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:14.225 01:14:22 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:14.225 01:14:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:14.225 01:14:22 -- common/autotest_common.sh@10 -- # set +x 00:13:14.225 01:14:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:14.225 01:14:22 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:15.161 01:14:23 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:15.161 01:14:23 -- common/autotest_common.sh@1187 -- # local i=0 00:13:15.161 01:14:23 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:15.161 01:14:23 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:15.161 01:14:23 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:17.071 01:14:25 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:17.071 01:14:25 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:17.071 01:14:25 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:17.071 01:14:25 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:17.071 01:14:25 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:17.071 01:14:25 -- common/autotest_common.sh@1197 -- # return 0 00:13:17.071 01:14:25 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:17.071 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:17.071 01:14:25 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:17.071 01:14:25 -- common/autotest_common.sh@1208 -- # local i=0 00:13:17.071 01:14:25 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:17.071 01:14:25 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:17.071 01:14:25 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:17.071 01:14:25 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:17.071 01:14:25 -- common/autotest_common.sh@1220 -- # return 0 00:13:17.071 01:14:25 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:17.071 01:14:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:17.071 01:14:25 -- common/autotest_common.sh@10 -- # set +x 00:13:17.071 01:14:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:17.071 01:14:25 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:17.071 01:14:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:17.071 01:14:25 -- common/autotest_common.sh@10 -- # set +x 00:13:17.071 01:14:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:17.071 01:14:25 -- target/rpc.sh@99 -- # seq 1 5 00:13:17.071 01:14:25 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:17.071 01:14:25 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:17.071 01:14:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:17.071 01:14:25 -- common/autotest_common.sh@10 -- # set +x 00:13:17.071 01:14:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:17.071 01:14:25 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:17.071 01:14:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:17.071 01:14:25 -- common/autotest_common.sh@10 -- # set +x 00:13:17.071 [2024-11-20 01:14:25.220629] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:17.071 01:14:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:17.071 01:14:25 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:17.071 01:14:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:17.071 01:14:25 -- common/autotest_common.sh@10 -- # set +x 00:13:17.071 01:14:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:17.071 01:14:25 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:17.071 01:14:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:17.071 01:14:25 -- common/autotest_common.sh@10 -- # set +x 00:13:17.071 01:14:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:17.071 01:14:25 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:17.071 01:14:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:17.071 01:14:25 -- common/autotest_common.sh@10 -- # set +x 00:13:17.071 01:14:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:17.071 01:14:25 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:17.071 01:14:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:17.071 01:14:25 -- common/autotest_common.sh@10 -- # set +x 00:13:17.071 01:14:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:17.071 01:14:25 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:17.071 01:14:25 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:17.071 01:14:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:17.071 01:14:25 -- common/autotest_common.sh@10 -- # set +x 00:13:17.071 01:14:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:17.071 01:14:25 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:17.071 01:14:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:17.071 01:14:25 -- common/autotest_common.sh@10 -- # set +x 00:13:17.071 [2024-11-20 01:14:25.268658] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:17.071 01:14:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:17.071 01:14:25 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:17.071 01:14:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:17.071 01:14:25 -- common/autotest_common.sh@10 -- # set +x 00:13:17.071 01:14:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:17.071 01:14:25 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:17.071 01:14:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:17.071 01:14:25 -- common/autotest_common.sh@10 -- # set +x 00:13:17.330 01:14:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:17.330 01:14:25 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:17.330 01:14:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:17.330 01:14:25 -- common/autotest_common.sh@10 -- # set +x 00:13:17.330 01:14:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:17.330 01:14:25 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:17.330 01:14:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:17.330 01:14:25 -- common/autotest_common.sh@10 -- # set +x 00:13:17.330 01:14:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:17.330 01:14:25 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:17.330 01:14:25 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:17.330 01:14:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:17.330 01:14:25 -- common/autotest_common.sh@10 -- # set +x 00:13:17.330 01:14:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:17.331 01:14:25 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:17.331 01:14:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:17.331 01:14:25 -- common/autotest_common.sh@10 -- # set +x 00:13:17.331 [2024-11-20 01:14:25.316840] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:17.331 01:14:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:17.331 01:14:25 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:17.331 01:14:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:17.331 01:14:25 -- common/autotest_common.sh@10 -- # set +x 00:13:17.331 01:14:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:17.331 01:14:25 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:17.331 01:14:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:17.331 01:14:25 -- common/autotest_common.sh@10 -- # set +x 00:13:17.331 01:14:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:17.331 01:14:25 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:17.331 01:14:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:17.331 01:14:25 -- common/autotest_common.sh@10 -- # set +x 00:13:17.331 01:14:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:17.331 01:14:25 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:17.331 01:14:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:17.331 01:14:25 -- common/autotest_common.sh@10 -- # set +x 00:13:17.331 01:14:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:17.331 01:14:25 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:17.331 01:14:25 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:17.331 01:14:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:17.331 01:14:25 -- common/autotest_common.sh@10 -- # set +x 00:13:17.331 01:14:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:17.331 01:14:25 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:17.331 01:14:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:17.331 01:14:25 -- common/autotest_common.sh@10 -- # set +x 00:13:17.331 [2024-11-20 01:14:25.365000] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:17.331 01:14:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:17.331 01:14:25 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:17.331 01:14:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:17.331 01:14:25 -- common/autotest_common.sh@10 -- # set +x 00:13:17.331 01:14:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:17.331 01:14:25 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:17.331 01:14:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:17.331 01:14:25 -- common/autotest_common.sh@10 -- # set +x 00:13:17.331 01:14:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:17.331 01:14:25 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:17.331 01:14:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:17.331 01:14:25 -- common/autotest_common.sh@10 -- # set +x 00:13:17.331 01:14:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:17.331 01:14:25 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:17.331 01:14:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:17.331 01:14:25 -- common/autotest_common.sh@10 -- # set +x 00:13:17.331 01:14:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:17.331 01:14:25 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:17.331 01:14:25 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:17.331 01:14:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:17.331 01:14:25 -- common/autotest_common.sh@10 -- # set +x 00:13:17.331 01:14:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:17.331 01:14:25 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:17.331 01:14:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:17.331 01:14:25 -- common/autotest_common.sh@10 -- # set +x 00:13:17.331 [2024-11-20 01:14:25.413198] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:17.331 01:14:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:17.331 01:14:25 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:17.331 01:14:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:17.331 01:14:25 -- common/autotest_common.sh@10 -- # set +x 00:13:17.331 01:14:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:17.331 01:14:25 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:17.331 01:14:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:17.331 01:14:25 -- common/autotest_common.sh@10 -- # set +x 00:13:17.331 01:14:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:17.331 01:14:25 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:17.331 01:14:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:17.331 01:14:25 -- common/autotest_common.sh@10 -- # set +x 00:13:17.331 01:14:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:17.331 01:14:25 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:17.331 01:14:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:17.331 01:14:25 -- common/autotest_common.sh@10 -- # set +x 00:13:17.331 01:14:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:17.331 01:14:25 -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:13:17.331 01:14:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:17.331 01:14:25 -- common/autotest_common.sh@10 -- # set +x 00:13:17.331 01:14:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:17.331 01:14:25 -- target/rpc.sh@110 -- # stats='{ 00:13:17.331 "tick_rate": 2700000000, 00:13:17.331 "poll_groups": [ 00:13:17.331 { 00:13:17.331 "name": "nvmf_tgt_poll_group_0", 00:13:17.331 "admin_qpairs": 2, 00:13:17.331 "io_qpairs": 84, 00:13:17.331 "current_admin_qpairs": 0, 00:13:17.331 "current_io_qpairs": 0, 00:13:17.331 "pending_bdev_io": 0, 00:13:17.331 "completed_nvme_io": 183, 00:13:17.331 "transports": [ 00:13:17.331 { 00:13:17.331 "trtype": "TCP" 00:13:17.331 } 00:13:17.331 ] 00:13:17.331 }, 00:13:17.331 { 00:13:17.331 "name": "nvmf_tgt_poll_group_1", 00:13:17.331 "admin_qpairs": 2, 00:13:17.331 "io_qpairs": 84, 00:13:17.331 "current_admin_qpairs": 0, 00:13:17.331 "current_io_qpairs": 0, 00:13:17.331 "pending_bdev_io": 0, 00:13:17.331 "completed_nvme_io": 182, 00:13:17.331 "transports": [ 00:13:17.331 { 00:13:17.331 "trtype": "TCP" 00:13:17.331 } 00:13:17.331 ] 00:13:17.331 }, 00:13:17.331 { 00:13:17.331 "name": "nvmf_tgt_poll_group_2", 00:13:17.331 "admin_qpairs": 1, 00:13:17.331 "io_qpairs": 84, 00:13:17.331 "current_admin_qpairs": 0, 00:13:17.331 "current_io_qpairs": 0, 00:13:17.331 "pending_bdev_io": 0, 00:13:17.331 "completed_nvme_io": 185, 00:13:17.331 "transports": [ 00:13:17.331 { 00:13:17.331 "trtype": "TCP" 00:13:17.331 } 00:13:17.331 ] 00:13:17.331 }, 00:13:17.331 { 00:13:17.331 "name": "nvmf_tgt_poll_group_3", 00:13:17.331 "admin_qpairs": 2, 00:13:17.331 "io_qpairs": 84, 00:13:17.331 "current_admin_qpairs": 0, 00:13:17.331 "current_io_qpairs": 0, 00:13:17.331 "pending_bdev_io": 0, 00:13:17.331 "completed_nvme_io": 136, 00:13:17.331 "transports": [ 00:13:17.331 { 00:13:17.331 "trtype": "TCP" 00:13:17.331 } 00:13:17.331 ] 00:13:17.331 } 00:13:17.331 ] 00:13:17.331 }' 00:13:17.331 01:14:25 -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:13:17.331 01:14:25 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:13:17.331 01:14:25 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:13:17.331 01:14:25 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:17.331 01:14:25 -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:13:17.331 01:14:25 -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:13:17.331 01:14:25 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:13:17.331 01:14:25 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:13:17.331 01:14:25 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:17.331 01:14:25 -- target/rpc.sh@113 -- # (( 336 > 0 )) 00:13:17.331 01:14:25 -- target/rpc.sh@115 -- # '[' rdma == tcp ']' 00:13:17.331 01:14:25 -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:13:17.331 01:14:25 -- target/rpc.sh@123 -- # nvmftestfini 00:13:17.331 01:14:25 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:17.331 01:14:25 -- nvmf/common.sh@116 -- # sync 00:13:17.331 01:14:25 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:17.331 01:14:25 -- nvmf/common.sh@119 -- # set +e 00:13:17.331 01:14:25 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:17.331 01:14:25 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:17.331 rmmod nvme_tcp 00:13:17.592 rmmod nvme_fabrics 00:13:17.592 rmmod nvme_keyring 00:13:17.592 01:14:25 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:17.592 01:14:25 -- nvmf/common.sh@123 -- # set -e 00:13:17.592 01:14:25 -- nvmf/common.sh@124 -- # return 0 00:13:17.592 01:14:25 -- nvmf/common.sh@477 -- # '[' -n 1084414 ']' 00:13:17.592 01:14:25 -- nvmf/common.sh@478 -- # killprocess 1084414 00:13:17.592 01:14:25 -- common/autotest_common.sh@936 -- # '[' -z 1084414 ']' 00:13:17.592 01:14:25 -- common/autotest_common.sh@940 -- # kill -0 1084414 00:13:17.592 01:14:25 -- common/autotest_common.sh@941 -- # uname 00:13:17.592 01:14:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:17.592 01:14:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1084414 00:13:17.592 01:14:25 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:17.592 01:14:25 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:17.592 01:14:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1084414' 00:13:17.592 killing process with pid 1084414 00:13:17.592 01:14:25 -- common/autotest_common.sh@955 -- # kill 1084414 00:13:17.592 01:14:25 -- common/autotest_common.sh@960 -- # wait 1084414 00:13:17.852 01:14:25 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:17.852 01:14:25 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:17.852 01:14:25 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:17.852 01:14:25 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:17.852 01:14:25 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:17.852 01:14:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:17.852 01:14:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:17.852 01:14:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:19.764 01:14:27 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:19.764 00:13:19.764 real 0m26.194s 00:13:19.764 user 1m25.406s 00:13:19.764 sys 0m4.284s 00:13:19.764 01:14:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:19.764 01:14:27 -- common/autotest_common.sh@10 -- # set +x 00:13:19.764 ************************************ 00:13:19.764 END TEST nvmf_rpc 00:13:19.764 ************************************ 00:13:19.764 01:14:27 -- nvmf/nvmf.sh@30 -- # run_test nvmf_invalid /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:13:19.764 01:14:27 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:19.764 01:14:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:19.764 01:14:27 -- common/autotest_common.sh@10 -- # set +x 00:13:19.764 ************************************ 00:13:19.764 START TEST nvmf_invalid 00:13:19.764 ************************************ 00:13:19.764 01:14:27 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:13:20.023 * Looking for test storage... 00:13:20.023 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:20.023 01:14:27 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:20.023 01:14:27 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:20.023 01:14:27 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:20.023 01:14:28 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:20.023 01:14:28 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:20.023 01:14:28 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:20.023 01:14:28 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:20.023 01:14:28 -- scripts/common.sh@335 -- # IFS=.-: 00:13:20.023 01:14:28 -- scripts/common.sh@335 -- # read -ra ver1 00:13:20.023 01:14:28 -- scripts/common.sh@336 -- # IFS=.-: 00:13:20.023 01:14:28 -- scripts/common.sh@336 -- # read -ra ver2 00:13:20.023 01:14:28 -- scripts/common.sh@337 -- # local 'op=<' 00:13:20.023 01:14:28 -- scripts/common.sh@339 -- # ver1_l=2 00:13:20.023 01:14:28 -- scripts/common.sh@340 -- # ver2_l=1 00:13:20.023 01:14:28 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:20.023 01:14:28 -- scripts/common.sh@343 -- # case "$op" in 00:13:20.023 01:14:28 -- scripts/common.sh@344 -- # : 1 00:13:20.023 01:14:28 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:20.023 01:14:28 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:20.023 01:14:28 -- scripts/common.sh@364 -- # decimal 1 00:13:20.023 01:14:28 -- scripts/common.sh@352 -- # local d=1 00:13:20.023 01:14:28 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:20.023 01:14:28 -- scripts/common.sh@354 -- # echo 1 00:13:20.023 01:14:28 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:20.023 01:14:28 -- scripts/common.sh@365 -- # decimal 2 00:13:20.023 01:14:28 -- scripts/common.sh@352 -- # local d=2 00:13:20.023 01:14:28 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:20.023 01:14:28 -- scripts/common.sh@354 -- # echo 2 00:13:20.023 01:14:28 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:20.023 01:14:28 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:20.023 01:14:28 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:20.023 01:14:28 -- scripts/common.sh@367 -- # return 0 00:13:20.023 01:14:28 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:20.023 01:14:28 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:20.023 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:20.023 --rc genhtml_branch_coverage=1 00:13:20.023 --rc genhtml_function_coverage=1 00:13:20.023 --rc genhtml_legend=1 00:13:20.023 --rc geninfo_all_blocks=1 00:13:20.023 --rc geninfo_unexecuted_blocks=1 00:13:20.023 00:13:20.023 ' 00:13:20.023 01:14:28 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:20.023 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:20.023 --rc genhtml_branch_coverage=1 00:13:20.023 --rc genhtml_function_coverage=1 00:13:20.023 --rc genhtml_legend=1 00:13:20.023 --rc geninfo_all_blocks=1 00:13:20.023 --rc geninfo_unexecuted_blocks=1 00:13:20.023 00:13:20.023 ' 00:13:20.023 01:14:28 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:20.023 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:20.023 --rc genhtml_branch_coverage=1 00:13:20.023 --rc genhtml_function_coverage=1 00:13:20.023 --rc genhtml_legend=1 00:13:20.023 --rc geninfo_all_blocks=1 00:13:20.023 --rc geninfo_unexecuted_blocks=1 00:13:20.023 00:13:20.023 ' 00:13:20.023 01:14:28 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:20.023 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:20.023 --rc genhtml_branch_coverage=1 00:13:20.023 --rc genhtml_function_coverage=1 00:13:20.023 --rc genhtml_legend=1 00:13:20.023 --rc geninfo_all_blocks=1 00:13:20.023 --rc geninfo_unexecuted_blocks=1 00:13:20.023 00:13:20.023 ' 00:13:20.023 01:14:28 -- target/invalid.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:20.023 01:14:28 -- nvmf/common.sh@7 -- # uname -s 00:13:20.023 01:14:28 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:20.023 01:14:28 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:20.023 01:14:28 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:20.023 01:14:28 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:20.023 01:14:28 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:20.023 01:14:28 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:20.023 01:14:28 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:20.023 01:14:28 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:20.023 01:14:28 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:20.023 01:14:28 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:20.023 01:14:28 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:20.023 01:14:28 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:20.023 01:14:28 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:20.023 01:14:28 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:20.023 01:14:28 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:20.023 01:14:28 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:20.023 01:14:28 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:20.023 01:14:28 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:20.023 01:14:28 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:20.023 01:14:28 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:20.024 01:14:28 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:20.024 01:14:28 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:20.024 01:14:28 -- paths/export.sh@5 -- # export PATH 00:13:20.024 01:14:28 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:20.024 01:14:28 -- nvmf/common.sh@46 -- # : 0 00:13:20.024 01:14:28 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:20.024 01:14:28 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:20.024 01:14:28 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:20.024 01:14:28 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:20.024 01:14:28 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:20.024 01:14:28 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:20.024 01:14:28 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:20.024 01:14:28 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:20.024 01:14:28 -- target/invalid.sh@11 -- # multi_target_rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:13:20.024 01:14:28 -- target/invalid.sh@12 -- # rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:13:20.024 01:14:28 -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:13:20.024 01:14:28 -- target/invalid.sh@14 -- # target=foobar 00:13:20.024 01:14:28 -- target/invalid.sh@16 -- # RANDOM=0 00:13:20.024 01:14:28 -- target/invalid.sh@34 -- # nvmftestinit 00:13:20.024 01:14:28 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:20.024 01:14:28 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:20.024 01:14:28 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:20.024 01:14:28 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:20.024 01:14:28 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:20.024 01:14:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:20.024 01:14:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:20.024 01:14:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:20.024 01:14:28 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:20.024 01:14:28 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:20.024 01:14:28 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:20.024 01:14:28 -- common/autotest_common.sh@10 -- # set +x 00:13:22.560 01:14:30 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:22.560 01:14:30 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:22.560 01:14:30 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:22.560 01:14:30 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:22.560 01:14:30 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:22.560 01:14:30 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:22.560 01:14:30 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:22.560 01:14:30 -- nvmf/common.sh@294 -- # net_devs=() 00:13:22.560 01:14:30 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:22.560 01:14:30 -- nvmf/common.sh@295 -- # e810=() 00:13:22.560 01:14:30 -- nvmf/common.sh@295 -- # local -ga e810 00:13:22.560 01:14:30 -- nvmf/common.sh@296 -- # x722=() 00:13:22.560 01:14:30 -- nvmf/common.sh@296 -- # local -ga x722 00:13:22.560 01:14:30 -- nvmf/common.sh@297 -- # mlx=() 00:13:22.560 01:14:30 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:22.560 01:14:30 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:22.560 01:14:30 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:22.560 01:14:30 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:22.560 01:14:30 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:22.560 01:14:30 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:22.560 01:14:30 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:22.560 01:14:30 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:22.560 01:14:30 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:22.560 01:14:30 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:22.560 01:14:30 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:22.560 01:14:30 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:22.560 01:14:30 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:22.560 01:14:30 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:22.560 01:14:30 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:22.560 01:14:30 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:22.560 01:14:30 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:22.560 01:14:30 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:22.560 01:14:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:22.560 01:14:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:22.560 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:22.560 01:14:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:22.560 01:14:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:22.560 01:14:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:22.560 01:14:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:22.560 01:14:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:22.560 01:14:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:22.560 01:14:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:22.560 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:22.560 01:14:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:22.560 01:14:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:22.560 01:14:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:22.560 01:14:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:22.560 01:14:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:22.560 01:14:30 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:22.560 01:14:30 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:22.560 01:14:30 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:22.560 01:14:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:22.560 01:14:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:22.560 01:14:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:22.560 01:14:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:22.560 01:14:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:22.560 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:22.560 01:14:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:22.560 01:14:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:22.560 01:14:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:22.560 01:14:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:22.560 01:14:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:22.560 01:14:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:22.560 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:22.560 01:14:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:22.560 01:14:30 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:22.560 01:14:30 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:22.560 01:14:30 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:22.560 01:14:30 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:22.560 01:14:30 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:22.560 01:14:30 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:22.560 01:14:30 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:22.560 01:14:30 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:22.560 01:14:30 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:22.560 01:14:30 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:22.560 01:14:30 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:22.560 01:14:30 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:22.560 01:14:30 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:22.560 01:14:30 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:22.560 01:14:30 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:22.560 01:14:30 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:22.560 01:14:30 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:22.560 01:14:30 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:22.560 01:14:30 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:22.560 01:14:30 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:22.560 01:14:30 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:22.560 01:14:30 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:22.560 01:14:30 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:22.560 01:14:30 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:22.560 01:14:30 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:22.560 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:22.560 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.400 ms 00:13:22.560 00:13:22.560 --- 10.0.0.2 ping statistics --- 00:13:22.560 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:22.560 rtt min/avg/max/mdev = 0.400/0.400/0.400/0.000 ms 00:13:22.560 01:14:30 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:22.560 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:22.560 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.144 ms 00:13:22.560 00:13:22.560 --- 10.0.0.1 ping statistics --- 00:13:22.560 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:22.560 rtt min/avg/max/mdev = 0.144/0.144/0.144/0.000 ms 00:13:22.560 01:14:30 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:22.560 01:14:30 -- nvmf/common.sh@410 -- # return 0 00:13:22.560 01:14:30 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:22.560 01:14:30 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:22.560 01:14:30 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:22.560 01:14:30 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:22.560 01:14:30 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:22.560 01:14:30 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:22.560 01:14:30 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:22.560 01:14:30 -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:13:22.560 01:14:30 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:22.561 01:14:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:22.561 01:14:30 -- common/autotest_common.sh@10 -- # set +x 00:13:22.561 01:14:30 -- nvmf/common.sh@469 -- # nvmfpid=1089130 00:13:22.561 01:14:30 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:22.561 01:14:30 -- nvmf/common.sh@470 -- # waitforlisten 1089130 00:13:22.561 01:14:30 -- common/autotest_common.sh@829 -- # '[' -z 1089130 ']' 00:13:22.561 01:14:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:22.561 01:14:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:22.561 01:14:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:22.561 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:22.561 01:14:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:22.561 01:14:30 -- common/autotest_common.sh@10 -- # set +x 00:13:22.561 [2024-11-20 01:14:30.483229] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:13:22.561 [2024-11-20 01:14:30.483328] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:22.561 EAL: No free 2048 kB hugepages reported on node 1 00:13:22.561 [2024-11-20 01:14:30.553228] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:22.561 [2024-11-20 01:14:30.644136] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:22.561 [2024-11-20 01:14:30.644303] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:22.561 [2024-11-20 01:14:30.644321] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:22.561 [2024-11-20 01:14:30.644334] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:22.561 [2024-11-20 01:14:30.644390] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:22.561 [2024-11-20 01:14:30.644443] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:22.561 [2024-11-20 01:14:30.644493] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:22.561 [2024-11-20 01:14:30.644496] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:23.493 01:14:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:23.493 01:14:31 -- common/autotest_common.sh@862 -- # return 0 00:13:23.493 01:14:31 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:23.494 01:14:31 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:23.494 01:14:31 -- common/autotest_common.sh@10 -- # set +x 00:13:23.494 01:14:31 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:23.494 01:14:31 -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:13:23.494 01:14:31 -- target/invalid.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode26151 00:13:23.751 [2024-11-20 01:14:31.725534] nvmf_rpc.c: 401:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:13:23.751 01:14:31 -- target/invalid.sh@40 -- # out='request: 00:13:23.751 { 00:13:23.751 "nqn": "nqn.2016-06.io.spdk:cnode26151", 00:13:23.751 "tgt_name": "foobar", 00:13:23.751 "method": "nvmf_create_subsystem", 00:13:23.751 "req_id": 1 00:13:23.751 } 00:13:23.751 Got JSON-RPC error response 00:13:23.751 response: 00:13:23.751 { 00:13:23.751 "code": -32603, 00:13:23.751 "message": "Unable to find target foobar" 00:13:23.751 }' 00:13:23.751 01:14:31 -- target/invalid.sh@41 -- # [[ request: 00:13:23.751 { 00:13:23.751 "nqn": "nqn.2016-06.io.spdk:cnode26151", 00:13:23.751 "tgt_name": "foobar", 00:13:23.751 "method": "nvmf_create_subsystem", 00:13:23.751 "req_id": 1 00:13:23.751 } 00:13:23.751 Got JSON-RPC error response 00:13:23.751 response: 00:13:23.751 { 00:13:23.751 "code": -32603, 00:13:23.751 "message": "Unable to find target foobar" 00:13:23.751 } == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:13:23.751 01:14:31 -- target/invalid.sh@45 -- # echo -e '\x1f' 00:13:23.751 01:14:31 -- target/invalid.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode17214 00:13:24.009 [2024-11-20 01:14:31.974442] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode17214: invalid serial number 'SPDKISFASTANDAWESOME' 00:13:24.009 01:14:31 -- target/invalid.sh@45 -- # out='request: 00:13:24.009 { 00:13:24.009 "nqn": "nqn.2016-06.io.spdk:cnode17214", 00:13:24.009 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:13:24.009 "method": "nvmf_create_subsystem", 00:13:24.009 "req_id": 1 00:13:24.009 } 00:13:24.009 Got JSON-RPC error response 00:13:24.009 response: 00:13:24.009 { 00:13:24.009 "code": -32602, 00:13:24.009 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:13:24.009 }' 00:13:24.009 01:14:31 -- target/invalid.sh@46 -- # [[ request: 00:13:24.009 { 00:13:24.009 "nqn": "nqn.2016-06.io.spdk:cnode17214", 00:13:24.009 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:13:24.009 "method": "nvmf_create_subsystem", 00:13:24.009 "req_id": 1 00:13:24.009 } 00:13:24.009 Got JSON-RPC error response 00:13:24.009 response: 00:13:24.009 { 00:13:24.009 "code": -32602, 00:13:24.009 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:13:24.009 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:13:24.009 01:14:31 -- target/invalid.sh@50 -- # echo -e '\x1f' 00:13:24.009 01:14:31 -- target/invalid.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode611 00:13:24.267 [2024-11-20 01:14:32.227285] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode611: invalid model number 'SPDK_Controller' 00:13:24.267 01:14:32 -- target/invalid.sh@50 -- # out='request: 00:13:24.267 { 00:13:24.267 "nqn": "nqn.2016-06.io.spdk:cnode611", 00:13:24.267 "model_number": "SPDK_Controller\u001f", 00:13:24.267 "method": "nvmf_create_subsystem", 00:13:24.267 "req_id": 1 00:13:24.267 } 00:13:24.267 Got JSON-RPC error response 00:13:24.267 response: 00:13:24.267 { 00:13:24.267 "code": -32602, 00:13:24.267 "message": "Invalid MN SPDK_Controller\u001f" 00:13:24.267 }' 00:13:24.267 01:14:32 -- target/invalid.sh@51 -- # [[ request: 00:13:24.267 { 00:13:24.267 "nqn": "nqn.2016-06.io.spdk:cnode611", 00:13:24.267 "model_number": "SPDK_Controller\u001f", 00:13:24.267 "method": "nvmf_create_subsystem", 00:13:24.267 "req_id": 1 00:13:24.267 } 00:13:24.267 Got JSON-RPC error response 00:13:24.267 response: 00:13:24.267 { 00:13:24.267 "code": -32602, 00:13:24.267 "message": "Invalid MN SPDK_Controller\u001f" 00:13:24.267 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:13:24.267 01:14:32 -- target/invalid.sh@54 -- # gen_random_s 21 00:13:24.267 01:14:32 -- target/invalid.sh@19 -- # local length=21 ll 00:13:24.267 01:14:32 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:13:24.267 01:14:32 -- target/invalid.sh@21 -- # local chars 00:13:24.267 01:14:32 -- target/invalid.sh@22 -- # local string 00:13:24.267 01:14:32 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:13:24.267 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.267 01:14:32 -- target/invalid.sh@25 -- # printf %x 40 00:13:24.267 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x28' 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # string+='(' 00:13:24.268 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.268 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # printf %x 46 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x2e' 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # string+=. 00:13:24.268 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.268 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # printf %x 75 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x4b' 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # string+=K 00:13:24.268 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.268 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # printf %x 77 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x4d' 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # string+=M 00:13:24.268 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.268 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # printf %x 93 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x5d' 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # string+=']' 00:13:24.268 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.268 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # printf %x 82 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x52' 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # string+=R 00:13:24.268 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.268 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # printf %x 78 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x4e' 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # string+=N 00:13:24.268 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.268 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # printf %x 54 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x36' 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # string+=6 00:13:24.268 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.268 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # printf %x 38 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x26' 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # string+='&' 00:13:24.268 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.268 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # printf %x 123 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x7b' 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # string+='{' 00:13:24.268 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.268 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # printf %x 57 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x39' 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # string+=9 00:13:24.268 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.268 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # printf %x 40 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x28' 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # string+='(' 00:13:24.268 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.268 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # printf %x 78 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x4e' 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # string+=N 00:13:24.268 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.268 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # printf %x 53 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x35' 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # string+=5 00:13:24.268 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.268 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # printf %x 112 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x70' 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # string+=p 00:13:24.268 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.268 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # printf %x 48 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x30' 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # string+=0 00:13:24.268 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.268 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # printf %x 92 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x5c' 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # string+='\' 00:13:24.268 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.268 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # printf %x 47 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x2f' 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # string+=/ 00:13:24.268 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.268 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # printf %x 64 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x40' 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # string+=@ 00:13:24.268 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.268 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # printf %x 94 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x5e' 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # string+='^' 00:13:24.268 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.268 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # printf %x 70 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x46' 00:13:24.268 01:14:32 -- target/invalid.sh@25 -- # string+=F 00:13:24.268 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.268 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.268 01:14:32 -- target/invalid.sh@28 -- # [[ ( == \- ]] 00:13:24.268 01:14:32 -- target/invalid.sh@31 -- # echo '(.KM]RN6&{9(N5p0\/@^F' 00:13:24.268 01:14:32 -- target/invalid.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s '(.KM]RN6&{9(N5p0\/@^F' nqn.2016-06.io.spdk:cnode10418 00:13:24.527 [2024-11-20 01:14:32.556345] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode10418: invalid serial number '(.KM]RN6&{9(N5p0\/@^F' 00:13:24.527 01:14:32 -- target/invalid.sh@54 -- # out='request: 00:13:24.527 { 00:13:24.527 "nqn": "nqn.2016-06.io.spdk:cnode10418", 00:13:24.527 "serial_number": "(.KM]RN6&{9(N5p0\\/@^F", 00:13:24.527 "method": "nvmf_create_subsystem", 00:13:24.527 "req_id": 1 00:13:24.527 } 00:13:24.527 Got JSON-RPC error response 00:13:24.527 response: 00:13:24.527 { 00:13:24.527 "code": -32602, 00:13:24.527 "message": "Invalid SN (.KM]RN6&{9(N5p0\\/@^F" 00:13:24.527 }' 00:13:24.527 01:14:32 -- target/invalid.sh@55 -- # [[ request: 00:13:24.527 { 00:13:24.527 "nqn": "nqn.2016-06.io.spdk:cnode10418", 00:13:24.527 "serial_number": "(.KM]RN6&{9(N5p0\\/@^F", 00:13:24.527 "method": "nvmf_create_subsystem", 00:13:24.527 "req_id": 1 00:13:24.527 } 00:13:24.527 Got JSON-RPC error response 00:13:24.527 response: 00:13:24.527 { 00:13:24.527 "code": -32602, 00:13:24.527 "message": "Invalid SN (.KM]RN6&{9(N5p0\\/@^F" 00:13:24.527 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:13:24.527 01:14:32 -- target/invalid.sh@58 -- # gen_random_s 41 00:13:24.527 01:14:32 -- target/invalid.sh@19 -- # local length=41 ll 00:13:24.527 01:14:32 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:13:24.527 01:14:32 -- target/invalid.sh@21 -- # local chars 00:13:24.527 01:14:32 -- target/invalid.sh@22 -- # local string 00:13:24.527 01:14:32 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:13:24.527 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # printf %x 45 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x2d' 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # string+=- 00:13:24.527 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.527 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # printf %x 50 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x32' 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # string+=2 00:13:24.527 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.527 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # printf %x 89 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x59' 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # string+=Y 00:13:24.527 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.527 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # printf %x 38 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x26' 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # string+='&' 00:13:24.527 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.527 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # printf %x 102 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x66' 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # string+=f 00:13:24.527 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.527 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # printf %x 62 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x3e' 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # string+='>' 00:13:24.527 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.527 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # printf %x 67 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x43' 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # string+=C 00:13:24.527 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.527 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # printf %x 70 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x46' 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # string+=F 00:13:24.527 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.527 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # printf %x 38 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x26' 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # string+='&' 00:13:24.527 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.527 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # printf %x 106 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x6a' 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # string+=j 00:13:24.527 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.527 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # printf %x 127 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x7f' 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # string+=$'\177' 00:13:24.527 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.527 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # printf %x 80 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x50' 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # string+=P 00:13:24.527 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.527 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # printf %x 68 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x44' 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # string+=D 00:13:24.527 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.527 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # printf %x 112 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x70' 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # string+=p 00:13:24.527 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.527 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # printf %x 90 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x5a' 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # string+=Z 00:13:24.527 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.527 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # printf %x 115 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x73' 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # string+=s 00:13:24.527 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.527 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # printf %x 95 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x5f' 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # string+=_ 00:13:24.527 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.527 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # printf %x 89 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x59' 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # string+=Y 00:13:24.527 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.527 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # printf %x 47 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x2f' 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # string+=/ 00:13:24.527 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.527 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # printf %x 96 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x60' 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # string+='`' 00:13:24.527 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.527 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # printf %x 55 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x37' 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # string+=7 00:13:24.527 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.527 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # printf %x 108 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x6c' 00:13:24.527 01:14:32 -- target/invalid.sh@25 -- # string+=l 00:13:24.527 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.527 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.528 01:14:32 -- target/invalid.sh@25 -- # printf %x 118 00:13:24.528 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x76' 00:13:24.528 01:14:32 -- target/invalid.sh@25 -- # string+=v 00:13:24.528 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.528 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.528 01:14:32 -- target/invalid.sh@25 -- # printf %x 56 00:13:24.528 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x38' 00:13:24.528 01:14:32 -- target/invalid.sh@25 -- # string+=8 00:13:24.528 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.528 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.528 01:14:32 -- target/invalid.sh@25 -- # printf %x 101 00:13:24.528 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x65' 00:13:24.528 01:14:32 -- target/invalid.sh@25 -- # string+=e 00:13:24.528 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.528 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.528 01:14:32 -- target/invalid.sh@25 -- # printf %x 33 00:13:24.528 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x21' 00:13:24.528 01:14:32 -- target/invalid.sh@25 -- # string+='!' 00:13:24.528 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.528 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.528 01:14:32 -- target/invalid.sh@25 -- # printf %x 117 00:13:24.528 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x75' 00:13:24.528 01:14:32 -- target/invalid.sh@25 -- # string+=u 00:13:24.528 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.528 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.528 01:14:32 -- target/invalid.sh@25 -- # printf %x 56 00:13:24.528 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x38' 00:13:24.528 01:14:32 -- target/invalid.sh@25 -- # string+=8 00:13:24.528 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.528 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.528 01:14:32 -- target/invalid.sh@25 -- # printf %x 78 00:13:24.528 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x4e' 00:13:24.528 01:14:32 -- target/invalid.sh@25 -- # string+=N 00:13:24.528 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.528 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.528 01:14:32 -- target/invalid.sh@25 -- # printf %x 37 00:13:24.528 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x25' 00:13:24.528 01:14:32 -- target/invalid.sh@25 -- # string+=% 00:13:24.528 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.528 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.528 01:14:32 -- target/invalid.sh@25 -- # printf %x 69 00:13:24.528 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x45' 00:13:24.528 01:14:32 -- target/invalid.sh@25 -- # string+=E 00:13:24.528 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.528 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.528 01:14:32 -- target/invalid.sh@25 -- # printf %x 48 00:13:24.528 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x30' 00:13:24.528 01:14:32 -- target/invalid.sh@25 -- # string+=0 00:13:24.528 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.528 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.528 01:14:32 -- target/invalid.sh@25 -- # printf %x 96 00:13:24.528 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x60' 00:13:24.528 01:14:32 -- target/invalid.sh@25 -- # string+='`' 00:13:24.528 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.528 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.528 01:14:32 -- target/invalid.sh@25 -- # printf %x 105 00:13:24.528 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x69' 00:13:24.528 01:14:32 -- target/invalid.sh@25 -- # string+=i 00:13:24.528 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.528 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.528 01:14:32 -- target/invalid.sh@25 -- # printf %x 79 00:13:24.528 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x4f' 00:13:24.528 01:14:32 -- target/invalid.sh@25 -- # string+=O 00:13:24.528 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.528 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.528 01:14:32 -- target/invalid.sh@25 -- # printf %x 41 00:13:24.528 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x29' 00:13:24.528 01:14:32 -- target/invalid.sh@25 -- # string+=')' 00:13:24.528 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.528 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.528 01:14:32 -- target/invalid.sh@25 -- # printf %x 44 00:13:24.528 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x2c' 00:13:24.528 01:14:32 -- target/invalid.sh@25 -- # string+=, 00:13:24.528 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.528 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.528 01:14:32 -- target/invalid.sh@25 -- # printf %x 94 00:13:24.528 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x5e' 00:13:24.528 01:14:32 -- target/invalid.sh@25 -- # string+='^' 00:13:24.528 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.528 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.528 01:14:32 -- target/invalid.sh@25 -- # printf %x 34 00:13:24.528 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x22' 00:13:24.528 01:14:32 -- target/invalid.sh@25 -- # string+='"' 00:13:24.528 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.528 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.528 01:14:32 -- target/invalid.sh@25 -- # printf %x 38 00:13:24.528 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x26' 00:13:24.528 01:14:32 -- target/invalid.sh@25 -- # string+='&' 00:13:24.528 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.528 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.528 01:14:32 -- target/invalid.sh@25 -- # printf %x 44 00:13:24.528 01:14:32 -- target/invalid.sh@25 -- # echo -e '\x2c' 00:13:24.528 01:14:32 -- target/invalid.sh@25 -- # string+=, 00:13:24.528 01:14:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:24.528 01:14:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:24.528 01:14:32 -- target/invalid.sh@28 -- # [[ - == \- ]] 00:13:24.528 01:14:32 -- target/invalid.sh@29 -- # string='\-2Y&f>CF&jPDpZs_Y/`7lv8e!u8N%E0`iO),^"&,' 00:13:24.528 01:14:32 -- target/invalid.sh@31 -- # echo '\-2Y&f>CF&jPDpZs_Y/`7lv8e!u8N%E0`iO),^"&,' 00:13:24.528 01:14:32 -- target/invalid.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d '\-2Y&f>CF&jPDpZs_Y/`7lv8e!u8N%E0`iO),^"&,' nqn.2016-06.io.spdk:cnode28867 00:13:24.786 [2024-11-20 01:14:32.929664] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode28867: invalid model number '\-2Y&f>CF&jPDpZs_Y/`7lv8e!u8N%E0`iO),^"&,' 00:13:24.786 01:14:32 -- target/invalid.sh@58 -- # out='request: 00:13:24.786 { 00:13:24.786 "nqn": "nqn.2016-06.io.spdk:cnode28867", 00:13:24.786 "model_number": "\\-2Y&f>CF&j\u007fPDpZs_Y/`7lv8e!u8N%E0`iO),^\"&,", 00:13:24.786 "method": "nvmf_create_subsystem", 00:13:24.786 "req_id": 1 00:13:24.786 } 00:13:24.786 Got JSON-RPC error response 00:13:24.786 response: 00:13:24.786 { 00:13:24.786 "code": -32602, 00:13:24.786 "message": "Invalid MN \\-2Y&f>CF&j\u007fPDpZs_Y/`7lv8e!u8N%E0`iO),^\"&," 00:13:24.786 }' 00:13:24.786 01:14:32 -- target/invalid.sh@59 -- # [[ request: 00:13:24.786 { 00:13:24.786 "nqn": "nqn.2016-06.io.spdk:cnode28867", 00:13:24.786 "model_number": "\\-2Y&f>CF&j\u007fPDpZs_Y/`7lv8e!u8N%E0`iO),^\"&,", 00:13:24.786 "method": "nvmf_create_subsystem", 00:13:24.786 "req_id": 1 00:13:24.786 } 00:13:24.786 Got JSON-RPC error response 00:13:24.786 response: 00:13:24.786 { 00:13:24.786 "code": -32602, 00:13:24.786 "message": "Invalid MN \\-2Y&f>CF&j\u007fPDpZs_Y/`7lv8e!u8N%E0`iO),^\"&," 00:13:24.786 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:13:24.786 01:14:32 -- target/invalid.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport --trtype tcp 00:13:25.043 [2024-11-20 01:14:33.182616] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:25.043 01:14:33 -- target/invalid.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode -s SPDK001 -a 00:13:25.301 01:14:33 -- target/invalid.sh@64 -- # [[ tcp == \T\C\P ]] 00:13:25.301 01:14:33 -- target/invalid.sh@67 -- # echo '' 00:13:25.301 01:14:33 -- target/invalid.sh@67 -- # head -n 1 00:13:25.301 01:14:33 -- target/invalid.sh@67 -- # IP= 00:13:25.301 01:14:33 -- target/invalid.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode -t tcp -a '' -s 4421 00:13:25.559 [2024-11-20 01:14:33.688435] nvmf_rpc.c: 783:nvmf_rpc_listen_paused: *ERROR*: Unable to remove listener, rc -2 00:13:25.559 01:14:33 -- target/invalid.sh@69 -- # out='request: 00:13:25.559 { 00:13:25.559 "nqn": "nqn.2016-06.io.spdk:cnode", 00:13:25.559 "listen_address": { 00:13:25.559 "trtype": "tcp", 00:13:25.559 "traddr": "", 00:13:25.559 "trsvcid": "4421" 00:13:25.559 }, 00:13:25.559 "method": "nvmf_subsystem_remove_listener", 00:13:25.559 "req_id": 1 00:13:25.559 } 00:13:25.559 Got JSON-RPC error response 00:13:25.559 response: 00:13:25.559 { 00:13:25.559 "code": -32602, 00:13:25.559 "message": "Invalid parameters" 00:13:25.559 }' 00:13:25.559 01:14:33 -- target/invalid.sh@70 -- # [[ request: 00:13:25.559 { 00:13:25.559 "nqn": "nqn.2016-06.io.spdk:cnode", 00:13:25.559 "listen_address": { 00:13:25.560 "trtype": "tcp", 00:13:25.560 "traddr": "", 00:13:25.560 "trsvcid": "4421" 00:13:25.560 }, 00:13:25.560 "method": "nvmf_subsystem_remove_listener", 00:13:25.560 "req_id": 1 00:13:25.560 } 00:13:25.560 Got JSON-RPC error response 00:13:25.560 response: 00:13:25.560 { 00:13:25.560 "code": -32602, 00:13:25.560 "message": "Invalid parameters" 00:13:25.560 } != *\U\n\a\b\l\e\ \t\o\ \s\t\o\p\ \l\i\s\t\e\n\e\r\.* ]] 00:13:25.560 01:14:33 -- target/invalid.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode31534 -i 0 00:13:25.817 [2024-11-20 01:14:33.961310] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode31534: invalid cntlid range [0-65519] 00:13:25.817 01:14:33 -- target/invalid.sh@73 -- # out='request: 00:13:25.817 { 00:13:25.817 "nqn": "nqn.2016-06.io.spdk:cnode31534", 00:13:25.817 "min_cntlid": 0, 00:13:25.817 "method": "nvmf_create_subsystem", 00:13:25.817 "req_id": 1 00:13:25.817 } 00:13:25.817 Got JSON-RPC error response 00:13:25.817 response: 00:13:25.817 { 00:13:25.817 "code": -32602, 00:13:25.817 "message": "Invalid cntlid range [0-65519]" 00:13:25.817 }' 00:13:25.817 01:14:33 -- target/invalid.sh@74 -- # [[ request: 00:13:25.817 { 00:13:25.817 "nqn": "nqn.2016-06.io.spdk:cnode31534", 00:13:25.817 "min_cntlid": 0, 00:13:25.817 "method": "nvmf_create_subsystem", 00:13:25.817 "req_id": 1 00:13:25.817 } 00:13:25.817 Got JSON-RPC error response 00:13:25.817 response: 00:13:25.817 { 00:13:25.817 "code": -32602, 00:13:25.817 "message": "Invalid cntlid range [0-65519]" 00:13:25.817 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:25.817 01:14:33 -- target/invalid.sh@75 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1895 -i 65520 00:13:26.076 [2024-11-20 01:14:34.210179] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode1895: invalid cntlid range [65520-65519] 00:13:26.076 01:14:34 -- target/invalid.sh@75 -- # out='request: 00:13:26.076 { 00:13:26.076 "nqn": "nqn.2016-06.io.spdk:cnode1895", 00:13:26.076 "min_cntlid": 65520, 00:13:26.076 "method": "nvmf_create_subsystem", 00:13:26.076 "req_id": 1 00:13:26.076 } 00:13:26.076 Got JSON-RPC error response 00:13:26.076 response: 00:13:26.076 { 00:13:26.076 "code": -32602, 00:13:26.076 "message": "Invalid cntlid range [65520-65519]" 00:13:26.076 }' 00:13:26.076 01:14:34 -- target/invalid.sh@76 -- # [[ request: 00:13:26.076 { 00:13:26.076 "nqn": "nqn.2016-06.io.spdk:cnode1895", 00:13:26.076 "min_cntlid": 65520, 00:13:26.076 "method": "nvmf_create_subsystem", 00:13:26.076 "req_id": 1 00:13:26.076 } 00:13:26.076 Got JSON-RPC error response 00:13:26.076 response: 00:13:26.076 { 00:13:26.076 "code": -32602, 00:13:26.076 "message": "Invalid cntlid range [65520-65519]" 00:13:26.076 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:26.076 01:14:34 -- target/invalid.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5958 -I 0 00:13:26.334 [2024-11-20 01:14:34.455016] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode5958: invalid cntlid range [1-0] 00:13:26.334 01:14:34 -- target/invalid.sh@77 -- # out='request: 00:13:26.334 { 00:13:26.334 "nqn": "nqn.2016-06.io.spdk:cnode5958", 00:13:26.334 "max_cntlid": 0, 00:13:26.334 "method": "nvmf_create_subsystem", 00:13:26.334 "req_id": 1 00:13:26.334 } 00:13:26.334 Got JSON-RPC error response 00:13:26.334 response: 00:13:26.334 { 00:13:26.334 "code": -32602, 00:13:26.334 "message": "Invalid cntlid range [1-0]" 00:13:26.334 }' 00:13:26.334 01:14:34 -- target/invalid.sh@78 -- # [[ request: 00:13:26.334 { 00:13:26.334 "nqn": "nqn.2016-06.io.spdk:cnode5958", 00:13:26.334 "max_cntlid": 0, 00:13:26.334 "method": "nvmf_create_subsystem", 00:13:26.334 "req_id": 1 00:13:26.334 } 00:13:26.334 Got JSON-RPC error response 00:13:26.334 response: 00:13:26.334 { 00:13:26.334 "code": -32602, 00:13:26.334 "message": "Invalid cntlid range [1-0]" 00:13:26.334 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:26.334 01:14:34 -- target/invalid.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode17809 -I 65520 00:13:26.591 [2024-11-20 01:14:34.707874] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode17809: invalid cntlid range [1-65520] 00:13:26.592 01:14:34 -- target/invalid.sh@79 -- # out='request: 00:13:26.592 { 00:13:26.592 "nqn": "nqn.2016-06.io.spdk:cnode17809", 00:13:26.592 "max_cntlid": 65520, 00:13:26.592 "method": "nvmf_create_subsystem", 00:13:26.592 "req_id": 1 00:13:26.592 } 00:13:26.592 Got JSON-RPC error response 00:13:26.592 response: 00:13:26.592 { 00:13:26.592 "code": -32602, 00:13:26.592 "message": "Invalid cntlid range [1-65520]" 00:13:26.592 }' 00:13:26.592 01:14:34 -- target/invalid.sh@80 -- # [[ request: 00:13:26.592 { 00:13:26.592 "nqn": "nqn.2016-06.io.spdk:cnode17809", 00:13:26.592 "max_cntlid": 65520, 00:13:26.592 "method": "nvmf_create_subsystem", 00:13:26.592 "req_id": 1 00:13:26.592 } 00:13:26.592 Got JSON-RPC error response 00:13:26.592 response: 00:13:26.592 { 00:13:26.592 "code": -32602, 00:13:26.592 "message": "Invalid cntlid range [1-65520]" 00:13:26.592 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:26.592 01:14:34 -- target/invalid.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8588 -i 6 -I 5 00:13:26.849 [2024-11-20 01:14:34.960743] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode8588: invalid cntlid range [6-5] 00:13:26.849 01:14:34 -- target/invalid.sh@83 -- # out='request: 00:13:26.849 { 00:13:26.849 "nqn": "nqn.2016-06.io.spdk:cnode8588", 00:13:26.849 "min_cntlid": 6, 00:13:26.849 "max_cntlid": 5, 00:13:26.849 "method": "nvmf_create_subsystem", 00:13:26.849 "req_id": 1 00:13:26.849 } 00:13:26.849 Got JSON-RPC error response 00:13:26.849 response: 00:13:26.849 { 00:13:26.849 "code": -32602, 00:13:26.849 "message": "Invalid cntlid range [6-5]" 00:13:26.849 }' 00:13:26.849 01:14:34 -- target/invalid.sh@84 -- # [[ request: 00:13:26.849 { 00:13:26.849 "nqn": "nqn.2016-06.io.spdk:cnode8588", 00:13:26.849 "min_cntlid": 6, 00:13:26.849 "max_cntlid": 5, 00:13:26.849 "method": "nvmf_create_subsystem", 00:13:26.849 "req_id": 1 00:13:26.849 } 00:13:26.849 Got JSON-RPC error response 00:13:26.849 response: 00:13:26.849 { 00:13:26.849 "code": -32602, 00:13:26.849 "message": "Invalid cntlid range [6-5]" 00:13:26.849 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:26.849 01:14:34 -- target/invalid.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target --name foobar 00:13:27.107 01:14:35 -- target/invalid.sh@87 -- # out='request: 00:13:27.107 { 00:13:27.107 "name": "foobar", 00:13:27.107 "method": "nvmf_delete_target", 00:13:27.107 "req_id": 1 00:13:27.107 } 00:13:27.107 Got JSON-RPC error response 00:13:27.107 response: 00:13:27.107 { 00:13:27.107 "code": -32602, 00:13:27.107 "message": "The specified target doesn'\''t exist, cannot delete it." 00:13:27.107 }' 00:13:27.107 01:14:35 -- target/invalid.sh@88 -- # [[ request: 00:13:27.107 { 00:13:27.107 "name": "foobar", 00:13:27.107 "method": "nvmf_delete_target", 00:13:27.107 "req_id": 1 00:13:27.107 } 00:13:27.107 Got JSON-RPC error response 00:13:27.107 response: 00:13:27.107 { 00:13:27.107 "code": -32602, 00:13:27.107 "message": "The specified target doesn't exist, cannot delete it." 00:13:27.107 } == *\T\h\e\ \s\p\e\c\i\f\i\e\d\ \t\a\r\g\e\t\ \d\o\e\s\n\'\t\ \e\x\i\s\t\,\ \c\a\n\n\o\t\ \d\e\l\e\t\e\ \i\t\.* ]] 00:13:27.107 01:14:35 -- target/invalid.sh@90 -- # trap - SIGINT SIGTERM EXIT 00:13:27.107 01:14:35 -- target/invalid.sh@91 -- # nvmftestfini 00:13:27.107 01:14:35 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:27.107 01:14:35 -- nvmf/common.sh@116 -- # sync 00:13:27.107 01:14:35 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:27.107 01:14:35 -- nvmf/common.sh@119 -- # set +e 00:13:27.107 01:14:35 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:27.107 01:14:35 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:27.107 rmmod nvme_tcp 00:13:27.107 rmmod nvme_fabrics 00:13:27.107 rmmod nvme_keyring 00:13:27.107 01:14:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:27.107 01:14:35 -- nvmf/common.sh@123 -- # set -e 00:13:27.107 01:14:35 -- nvmf/common.sh@124 -- # return 0 00:13:27.107 01:14:35 -- nvmf/common.sh@477 -- # '[' -n 1089130 ']' 00:13:27.107 01:14:35 -- nvmf/common.sh@478 -- # killprocess 1089130 00:13:27.107 01:14:35 -- common/autotest_common.sh@936 -- # '[' -z 1089130 ']' 00:13:27.107 01:14:35 -- common/autotest_common.sh@940 -- # kill -0 1089130 00:13:27.107 01:14:35 -- common/autotest_common.sh@941 -- # uname 00:13:27.107 01:14:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:27.107 01:14:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1089130 00:13:27.107 01:14:35 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:27.107 01:14:35 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:27.107 01:14:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1089130' 00:13:27.107 killing process with pid 1089130 00:13:27.107 01:14:35 -- common/autotest_common.sh@955 -- # kill 1089130 00:13:27.107 01:14:35 -- common/autotest_common.sh@960 -- # wait 1089130 00:13:27.366 01:14:35 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:27.366 01:14:35 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:27.366 01:14:35 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:27.366 01:14:35 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:27.366 01:14:35 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:27.366 01:14:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:27.366 01:14:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:27.366 01:14:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:29.270 01:14:37 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:29.270 00:13:29.270 real 0m9.508s 00:13:29.270 user 0m23.033s 00:13:29.270 sys 0m2.430s 00:13:29.270 01:14:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:29.270 01:14:37 -- common/autotest_common.sh@10 -- # set +x 00:13:29.270 ************************************ 00:13:29.270 END TEST nvmf_invalid 00:13:29.270 ************************************ 00:13:29.270 01:14:37 -- nvmf/nvmf.sh@31 -- # run_test nvmf_abort /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:13:29.270 01:14:37 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:29.270 01:14:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:29.270 01:14:37 -- common/autotest_common.sh@10 -- # set +x 00:13:29.270 ************************************ 00:13:29.270 START TEST nvmf_abort 00:13:29.270 ************************************ 00:13:29.270 01:14:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:13:29.536 * Looking for test storage... 00:13:29.536 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:29.536 01:14:37 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:29.536 01:14:37 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:29.536 01:14:37 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:29.536 01:14:37 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:29.536 01:14:37 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:29.536 01:14:37 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:29.536 01:14:37 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:29.536 01:14:37 -- scripts/common.sh@335 -- # IFS=.-: 00:13:29.536 01:14:37 -- scripts/common.sh@335 -- # read -ra ver1 00:13:29.536 01:14:37 -- scripts/common.sh@336 -- # IFS=.-: 00:13:29.536 01:14:37 -- scripts/common.sh@336 -- # read -ra ver2 00:13:29.536 01:14:37 -- scripts/common.sh@337 -- # local 'op=<' 00:13:29.536 01:14:37 -- scripts/common.sh@339 -- # ver1_l=2 00:13:29.536 01:14:37 -- scripts/common.sh@340 -- # ver2_l=1 00:13:29.536 01:14:37 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:29.536 01:14:37 -- scripts/common.sh@343 -- # case "$op" in 00:13:29.536 01:14:37 -- scripts/common.sh@344 -- # : 1 00:13:29.536 01:14:37 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:29.536 01:14:37 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:29.536 01:14:37 -- scripts/common.sh@364 -- # decimal 1 00:13:29.536 01:14:37 -- scripts/common.sh@352 -- # local d=1 00:13:29.536 01:14:37 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:29.536 01:14:37 -- scripts/common.sh@354 -- # echo 1 00:13:29.536 01:14:37 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:29.536 01:14:37 -- scripts/common.sh@365 -- # decimal 2 00:13:29.536 01:14:37 -- scripts/common.sh@352 -- # local d=2 00:13:29.536 01:14:37 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:29.536 01:14:37 -- scripts/common.sh@354 -- # echo 2 00:13:29.536 01:14:37 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:29.536 01:14:37 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:29.536 01:14:37 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:29.536 01:14:37 -- scripts/common.sh@367 -- # return 0 00:13:29.536 01:14:37 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:29.536 01:14:37 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:29.536 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:29.536 --rc genhtml_branch_coverage=1 00:13:29.536 --rc genhtml_function_coverage=1 00:13:29.536 --rc genhtml_legend=1 00:13:29.536 --rc geninfo_all_blocks=1 00:13:29.536 --rc geninfo_unexecuted_blocks=1 00:13:29.536 00:13:29.536 ' 00:13:29.536 01:14:37 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:29.536 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:29.536 --rc genhtml_branch_coverage=1 00:13:29.536 --rc genhtml_function_coverage=1 00:13:29.536 --rc genhtml_legend=1 00:13:29.536 --rc geninfo_all_blocks=1 00:13:29.536 --rc geninfo_unexecuted_blocks=1 00:13:29.536 00:13:29.536 ' 00:13:29.536 01:14:37 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:29.536 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:29.536 --rc genhtml_branch_coverage=1 00:13:29.536 --rc genhtml_function_coverage=1 00:13:29.536 --rc genhtml_legend=1 00:13:29.536 --rc geninfo_all_blocks=1 00:13:29.536 --rc geninfo_unexecuted_blocks=1 00:13:29.536 00:13:29.536 ' 00:13:29.536 01:14:37 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:29.536 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:29.536 --rc genhtml_branch_coverage=1 00:13:29.536 --rc genhtml_function_coverage=1 00:13:29.536 --rc genhtml_legend=1 00:13:29.536 --rc geninfo_all_blocks=1 00:13:29.536 --rc geninfo_unexecuted_blocks=1 00:13:29.536 00:13:29.536 ' 00:13:29.536 01:14:37 -- target/abort.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:29.536 01:14:37 -- nvmf/common.sh@7 -- # uname -s 00:13:29.536 01:14:37 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:29.536 01:14:37 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:29.536 01:14:37 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:29.536 01:14:37 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:29.536 01:14:37 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:29.536 01:14:37 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:29.536 01:14:37 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:29.536 01:14:37 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:29.536 01:14:37 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:29.536 01:14:37 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:29.536 01:14:37 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:29.536 01:14:37 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:29.536 01:14:37 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:29.536 01:14:37 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:29.536 01:14:37 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:29.536 01:14:37 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:29.536 01:14:37 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:29.536 01:14:37 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:29.536 01:14:37 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:29.536 01:14:37 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:29.537 01:14:37 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:29.537 01:14:37 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:29.537 01:14:37 -- paths/export.sh@5 -- # export PATH 00:13:29.537 01:14:37 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:29.537 01:14:37 -- nvmf/common.sh@46 -- # : 0 00:13:29.537 01:14:37 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:29.537 01:14:37 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:29.537 01:14:37 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:29.537 01:14:37 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:29.537 01:14:37 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:29.537 01:14:37 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:29.537 01:14:37 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:29.537 01:14:37 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:29.537 01:14:37 -- target/abort.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:29.537 01:14:37 -- target/abort.sh@12 -- # MALLOC_BLOCK_SIZE=4096 00:13:29.537 01:14:37 -- target/abort.sh@14 -- # nvmftestinit 00:13:29.537 01:14:37 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:29.537 01:14:37 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:29.537 01:14:37 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:29.537 01:14:37 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:29.537 01:14:37 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:29.537 01:14:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:29.537 01:14:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:29.537 01:14:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:29.537 01:14:37 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:29.537 01:14:37 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:29.537 01:14:37 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:29.537 01:14:37 -- common/autotest_common.sh@10 -- # set +x 00:13:31.509 01:14:39 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:31.509 01:14:39 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:31.509 01:14:39 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:31.509 01:14:39 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:31.509 01:14:39 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:31.509 01:14:39 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:31.509 01:14:39 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:31.509 01:14:39 -- nvmf/common.sh@294 -- # net_devs=() 00:13:31.509 01:14:39 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:31.509 01:14:39 -- nvmf/common.sh@295 -- # e810=() 00:13:31.509 01:14:39 -- nvmf/common.sh@295 -- # local -ga e810 00:13:31.509 01:14:39 -- nvmf/common.sh@296 -- # x722=() 00:13:31.509 01:14:39 -- nvmf/common.sh@296 -- # local -ga x722 00:13:31.509 01:14:39 -- nvmf/common.sh@297 -- # mlx=() 00:13:31.509 01:14:39 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:31.509 01:14:39 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:31.509 01:14:39 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:31.509 01:14:39 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:31.509 01:14:39 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:31.509 01:14:39 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:31.509 01:14:39 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:31.509 01:14:39 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:31.509 01:14:39 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:31.509 01:14:39 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:31.509 01:14:39 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:31.509 01:14:39 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:31.509 01:14:39 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:31.509 01:14:39 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:31.509 01:14:39 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:31.509 01:14:39 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:31.509 01:14:39 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:31.509 01:14:39 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:31.509 01:14:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:31.509 01:14:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:31.509 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:31.509 01:14:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:31.509 01:14:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:31.509 01:14:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:31.509 01:14:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:31.509 01:14:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:31.509 01:14:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:31.509 01:14:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:31.509 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:31.509 01:14:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:31.509 01:14:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:31.509 01:14:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:31.510 01:14:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:31.510 01:14:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:31.510 01:14:39 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:31.510 01:14:39 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:31.510 01:14:39 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:31.510 01:14:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:31.510 01:14:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:31.510 01:14:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:31.510 01:14:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:31.510 01:14:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:31.510 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:31.510 01:14:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:31.510 01:14:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:31.510 01:14:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:31.510 01:14:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:31.510 01:14:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:31.510 01:14:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:31.510 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:31.510 01:14:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:31.510 01:14:39 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:31.510 01:14:39 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:31.510 01:14:39 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:31.510 01:14:39 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:31.510 01:14:39 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:31.510 01:14:39 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:31.510 01:14:39 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:31.510 01:14:39 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:31.510 01:14:39 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:31.510 01:14:39 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:31.510 01:14:39 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:31.510 01:14:39 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:31.510 01:14:39 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:31.510 01:14:39 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:31.510 01:14:39 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:31.510 01:14:39 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:31.510 01:14:39 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:31.510 01:14:39 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:31.510 01:14:39 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:31.510 01:14:39 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:31.510 01:14:39 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:31.768 01:14:39 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:31.768 01:14:39 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:31.768 01:14:39 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:31.768 01:14:39 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:31.768 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:31.768 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.223 ms 00:13:31.768 00:13:31.768 --- 10.0.0.2 ping statistics --- 00:13:31.768 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:31.768 rtt min/avg/max/mdev = 0.223/0.223/0.223/0.000 ms 00:13:31.768 01:14:39 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:31.768 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:31.768 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.107 ms 00:13:31.768 00:13:31.768 --- 10.0.0.1 ping statistics --- 00:13:31.768 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:31.768 rtt min/avg/max/mdev = 0.107/0.107/0.107/0.000 ms 00:13:31.768 01:14:39 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:31.768 01:14:39 -- nvmf/common.sh@410 -- # return 0 00:13:31.768 01:14:39 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:31.768 01:14:39 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:31.768 01:14:39 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:31.768 01:14:39 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:31.768 01:14:39 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:31.768 01:14:39 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:31.768 01:14:39 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:31.768 01:14:39 -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:13:31.768 01:14:39 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:31.768 01:14:39 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:31.768 01:14:39 -- common/autotest_common.sh@10 -- # set +x 00:13:31.768 01:14:39 -- nvmf/common.sh@469 -- # nvmfpid=1091928 00:13:31.768 01:14:39 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:13:31.768 01:14:39 -- nvmf/common.sh@470 -- # waitforlisten 1091928 00:13:31.768 01:14:39 -- common/autotest_common.sh@829 -- # '[' -z 1091928 ']' 00:13:31.768 01:14:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:31.768 01:14:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:31.768 01:14:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:31.768 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:31.768 01:14:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:31.768 01:14:39 -- common/autotest_common.sh@10 -- # set +x 00:13:31.768 [2024-11-20 01:14:39.848674] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:13:31.768 [2024-11-20 01:14:39.848755] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:31.768 EAL: No free 2048 kB hugepages reported on node 1 00:13:31.768 [2024-11-20 01:14:39.919003] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:32.026 [2024-11-20 01:14:40.012878] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:32.026 [2024-11-20 01:14:40.013063] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:32.026 [2024-11-20 01:14:40.013094] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:32.026 [2024-11-20 01:14:40.013110] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:32.026 [2024-11-20 01:14:40.013167] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:32.026 [2024-11-20 01:14:40.013205] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:32.026 [2024-11-20 01:14:40.013208] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:32.959 01:14:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:32.959 01:14:40 -- common/autotest_common.sh@862 -- # return 0 00:13:32.959 01:14:40 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:32.959 01:14:40 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:32.959 01:14:40 -- common/autotest_common.sh@10 -- # set +x 00:13:32.959 01:14:40 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:32.959 01:14:40 -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -a 256 00:13:32.959 01:14:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:32.959 01:14:40 -- common/autotest_common.sh@10 -- # set +x 00:13:32.959 [2024-11-20 01:14:40.853890] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:32.959 01:14:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:32.959 01:14:40 -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:13:32.959 01:14:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:32.959 01:14:40 -- common/autotest_common.sh@10 -- # set +x 00:13:32.959 Malloc0 00:13:32.959 01:14:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:32.959 01:14:40 -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:32.959 01:14:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:32.959 01:14:40 -- common/autotest_common.sh@10 -- # set +x 00:13:32.959 Delay0 00:13:32.959 01:14:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:32.959 01:14:40 -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:13:32.959 01:14:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:32.959 01:14:40 -- common/autotest_common.sh@10 -- # set +x 00:13:32.959 01:14:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:32.959 01:14:40 -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:13:32.959 01:14:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:32.959 01:14:40 -- common/autotest_common.sh@10 -- # set +x 00:13:32.959 01:14:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:32.959 01:14:40 -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:13:32.959 01:14:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:32.959 01:14:40 -- common/autotest_common.sh@10 -- # set +x 00:13:32.959 [2024-11-20 01:14:40.929778] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:32.959 01:14:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:32.959 01:14:40 -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:13:32.960 01:14:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:32.960 01:14:40 -- common/autotest_common.sh@10 -- # set +x 00:13:32.960 01:14:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:32.960 01:14:40 -- target/abort.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:13:32.960 EAL: No free 2048 kB hugepages reported on node 1 00:13:32.960 [2024-11-20 01:14:41.035080] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:13:34.858 Initializing NVMe Controllers 00:13:34.858 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:13:34.858 controller IO queue size 128 less than required 00:13:34.858 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:13:34.858 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:13:34.858 Initialization complete. Launching workers. 00:13:34.858 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 123, failed: 34255 00:13:34.858 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 34316, failed to submit 62 00:13:34.858 success 34255, unsuccess 61, failed 0 00:13:34.858 01:14:43 -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:13:34.858 01:14:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.858 01:14:43 -- common/autotest_common.sh@10 -- # set +x 00:13:35.116 01:14:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.116 01:14:43 -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:13:35.116 01:14:43 -- target/abort.sh@38 -- # nvmftestfini 00:13:35.116 01:14:43 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:35.116 01:14:43 -- nvmf/common.sh@116 -- # sync 00:13:35.116 01:14:43 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:35.116 01:14:43 -- nvmf/common.sh@119 -- # set +e 00:13:35.116 01:14:43 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:35.116 01:14:43 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:35.116 rmmod nvme_tcp 00:13:35.116 rmmod nvme_fabrics 00:13:35.116 rmmod nvme_keyring 00:13:35.116 01:14:43 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:35.116 01:14:43 -- nvmf/common.sh@123 -- # set -e 00:13:35.116 01:14:43 -- nvmf/common.sh@124 -- # return 0 00:13:35.116 01:14:43 -- nvmf/common.sh@477 -- # '[' -n 1091928 ']' 00:13:35.116 01:14:43 -- nvmf/common.sh@478 -- # killprocess 1091928 00:13:35.116 01:14:43 -- common/autotest_common.sh@936 -- # '[' -z 1091928 ']' 00:13:35.116 01:14:43 -- common/autotest_common.sh@940 -- # kill -0 1091928 00:13:35.116 01:14:43 -- common/autotest_common.sh@941 -- # uname 00:13:35.116 01:14:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:35.116 01:14:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1091928 00:13:35.116 01:14:43 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:35.116 01:14:43 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:35.116 01:14:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1091928' 00:13:35.116 killing process with pid 1091928 00:13:35.116 01:14:43 -- common/autotest_common.sh@955 -- # kill 1091928 00:13:35.116 01:14:43 -- common/autotest_common.sh@960 -- # wait 1091928 00:13:35.375 01:14:43 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:35.375 01:14:43 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:35.375 01:14:43 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:35.375 01:14:43 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:35.375 01:14:43 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:35.375 01:14:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:35.375 01:14:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:35.375 01:14:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:37.312 01:14:45 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:37.312 00:13:37.312 real 0m8.013s 00:13:37.312 user 0m12.699s 00:13:37.312 sys 0m2.608s 00:13:37.312 01:14:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:37.312 01:14:45 -- common/autotest_common.sh@10 -- # set +x 00:13:37.312 ************************************ 00:13:37.312 END TEST nvmf_abort 00:13:37.312 ************************************ 00:13:37.312 01:14:45 -- nvmf/nvmf.sh@32 -- # run_test nvmf_ns_hotplug_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:13:37.312 01:14:45 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:37.312 01:14:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:37.312 01:14:45 -- common/autotest_common.sh@10 -- # set +x 00:13:37.312 ************************************ 00:13:37.312 START TEST nvmf_ns_hotplug_stress 00:13:37.312 ************************************ 00:13:37.312 01:14:45 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:13:37.572 * Looking for test storage... 00:13:37.572 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:37.572 01:14:45 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:37.572 01:14:45 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:37.572 01:14:45 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:37.572 01:14:45 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:37.572 01:14:45 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:37.572 01:14:45 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:37.572 01:14:45 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:37.572 01:14:45 -- scripts/common.sh@335 -- # IFS=.-: 00:13:37.572 01:14:45 -- scripts/common.sh@335 -- # read -ra ver1 00:13:37.572 01:14:45 -- scripts/common.sh@336 -- # IFS=.-: 00:13:37.572 01:14:45 -- scripts/common.sh@336 -- # read -ra ver2 00:13:37.572 01:14:45 -- scripts/common.sh@337 -- # local 'op=<' 00:13:37.572 01:14:45 -- scripts/common.sh@339 -- # ver1_l=2 00:13:37.572 01:14:45 -- scripts/common.sh@340 -- # ver2_l=1 00:13:37.572 01:14:45 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:37.572 01:14:45 -- scripts/common.sh@343 -- # case "$op" in 00:13:37.572 01:14:45 -- scripts/common.sh@344 -- # : 1 00:13:37.572 01:14:45 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:37.572 01:14:45 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:37.572 01:14:45 -- scripts/common.sh@364 -- # decimal 1 00:13:37.572 01:14:45 -- scripts/common.sh@352 -- # local d=1 00:13:37.572 01:14:45 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:37.572 01:14:45 -- scripts/common.sh@354 -- # echo 1 00:13:37.572 01:14:45 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:37.572 01:14:45 -- scripts/common.sh@365 -- # decimal 2 00:13:37.572 01:14:45 -- scripts/common.sh@352 -- # local d=2 00:13:37.572 01:14:45 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:37.572 01:14:45 -- scripts/common.sh@354 -- # echo 2 00:13:37.572 01:14:45 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:37.572 01:14:45 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:37.572 01:14:45 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:37.572 01:14:45 -- scripts/common.sh@367 -- # return 0 00:13:37.572 01:14:45 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:37.572 01:14:45 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:37.572 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:37.572 --rc genhtml_branch_coverage=1 00:13:37.572 --rc genhtml_function_coverage=1 00:13:37.572 --rc genhtml_legend=1 00:13:37.572 --rc geninfo_all_blocks=1 00:13:37.572 --rc geninfo_unexecuted_blocks=1 00:13:37.572 00:13:37.572 ' 00:13:37.572 01:14:45 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:37.572 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:37.572 --rc genhtml_branch_coverage=1 00:13:37.572 --rc genhtml_function_coverage=1 00:13:37.572 --rc genhtml_legend=1 00:13:37.572 --rc geninfo_all_blocks=1 00:13:37.572 --rc geninfo_unexecuted_blocks=1 00:13:37.572 00:13:37.572 ' 00:13:37.572 01:14:45 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:37.572 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:37.572 --rc genhtml_branch_coverage=1 00:13:37.572 --rc genhtml_function_coverage=1 00:13:37.572 --rc genhtml_legend=1 00:13:37.572 --rc geninfo_all_blocks=1 00:13:37.572 --rc geninfo_unexecuted_blocks=1 00:13:37.572 00:13:37.572 ' 00:13:37.572 01:14:45 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:37.572 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:37.572 --rc genhtml_branch_coverage=1 00:13:37.572 --rc genhtml_function_coverage=1 00:13:37.572 --rc genhtml_legend=1 00:13:37.572 --rc geninfo_all_blocks=1 00:13:37.572 --rc geninfo_unexecuted_blocks=1 00:13:37.572 00:13:37.572 ' 00:13:37.572 01:14:45 -- target/ns_hotplug_stress.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:37.572 01:14:45 -- nvmf/common.sh@7 -- # uname -s 00:13:37.572 01:14:45 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:37.572 01:14:45 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:37.572 01:14:45 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:37.572 01:14:45 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:37.572 01:14:45 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:37.572 01:14:45 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:37.572 01:14:45 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:37.572 01:14:45 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:37.572 01:14:45 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:37.572 01:14:45 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:37.572 01:14:45 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:37.572 01:14:45 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:37.572 01:14:45 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:37.572 01:14:45 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:37.572 01:14:45 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:37.572 01:14:45 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:37.572 01:14:45 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:37.572 01:14:45 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:37.572 01:14:45 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:37.572 01:14:45 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:37.572 01:14:45 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:37.572 01:14:45 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:37.572 01:14:45 -- paths/export.sh@5 -- # export PATH 00:13:37.572 01:14:45 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:37.572 01:14:45 -- nvmf/common.sh@46 -- # : 0 00:13:37.572 01:14:45 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:37.572 01:14:45 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:37.572 01:14:45 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:37.572 01:14:45 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:37.572 01:14:45 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:37.573 01:14:45 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:37.573 01:14:45 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:37.573 01:14:45 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:37.573 01:14:45 -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:13:37.573 01:14:45 -- target/ns_hotplug_stress.sh@22 -- # nvmftestinit 00:13:37.573 01:14:45 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:37.573 01:14:45 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:37.573 01:14:45 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:37.573 01:14:45 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:37.573 01:14:45 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:37.573 01:14:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:37.573 01:14:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:37.573 01:14:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:37.573 01:14:45 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:37.573 01:14:45 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:37.573 01:14:45 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:37.573 01:14:45 -- common/autotest_common.sh@10 -- # set +x 00:13:40.104 01:14:47 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:40.104 01:14:47 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:40.104 01:14:47 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:40.104 01:14:47 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:40.104 01:14:47 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:40.104 01:14:47 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:40.104 01:14:47 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:40.104 01:14:47 -- nvmf/common.sh@294 -- # net_devs=() 00:13:40.104 01:14:47 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:40.104 01:14:47 -- nvmf/common.sh@295 -- # e810=() 00:13:40.104 01:14:47 -- nvmf/common.sh@295 -- # local -ga e810 00:13:40.104 01:14:47 -- nvmf/common.sh@296 -- # x722=() 00:13:40.104 01:14:47 -- nvmf/common.sh@296 -- # local -ga x722 00:13:40.104 01:14:47 -- nvmf/common.sh@297 -- # mlx=() 00:13:40.104 01:14:47 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:40.104 01:14:47 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:40.104 01:14:47 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:40.104 01:14:47 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:40.104 01:14:47 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:40.104 01:14:47 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:40.104 01:14:47 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:40.104 01:14:47 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:40.105 01:14:47 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:40.105 01:14:47 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:40.105 01:14:47 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:40.105 01:14:47 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:40.105 01:14:47 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:40.105 01:14:47 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:40.105 01:14:47 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:40.105 01:14:47 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:40.105 01:14:47 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:40.105 01:14:47 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:40.105 01:14:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:40.105 01:14:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:40.105 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:40.105 01:14:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:40.105 01:14:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:40.105 01:14:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:40.105 01:14:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:40.105 01:14:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:40.105 01:14:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:40.105 01:14:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:40.105 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:40.105 01:14:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:40.105 01:14:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:40.105 01:14:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:40.105 01:14:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:40.105 01:14:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:40.105 01:14:47 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:40.105 01:14:47 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:40.105 01:14:47 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:40.105 01:14:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:40.105 01:14:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:40.105 01:14:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:40.105 01:14:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:40.105 01:14:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:40.105 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:40.105 01:14:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:40.105 01:14:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:40.105 01:14:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:40.105 01:14:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:40.105 01:14:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:40.105 01:14:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:40.105 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:40.105 01:14:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:40.105 01:14:47 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:40.105 01:14:47 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:40.105 01:14:47 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:40.105 01:14:47 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:40.105 01:14:47 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:40.105 01:14:47 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:40.105 01:14:47 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:40.105 01:14:47 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:40.105 01:14:47 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:40.105 01:14:47 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:40.105 01:14:47 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:40.105 01:14:47 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:40.105 01:14:47 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:40.105 01:14:47 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:40.105 01:14:47 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:40.105 01:14:47 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:40.105 01:14:47 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:40.105 01:14:47 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:40.105 01:14:47 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:40.105 01:14:47 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:40.105 01:14:47 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:40.105 01:14:47 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:40.105 01:14:47 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:40.105 01:14:47 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:40.105 01:14:47 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:40.105 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:40.105 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.384 ms 00:13:40.105 00:13:40.105 --- 10.0.0.2 ping statistics --- 00:13:40.105 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:40.105 rtt min/avg/max/mdev = 0.384/0.384/0.384/0.000 ms 00:13:40.105 01:14:47 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:40.105 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:40.105 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.117 ms 00:13:40.105 00:13:40.105 --- 10.0.0.1 ping statistics --- 00:13:40.105 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:40.105 rtt min/avg/max/mdev = 0.117/0.117/0.117/0.000 ms 00:13:40.105 01:14:47 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:40.105 01:14:47 -- nvmf/common.sh@410 -- # return 0 00:13:40.105 01:14:47 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:40.105 01:14:47 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:40.105 01:14:47 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:40.105 01:14:47 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:40.105 01:14:47 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:40.105 01:14:47 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:40.105 01:14:47 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:40.105 01:14:47 -- target/ns_hotplug_stress.sh@23 -- # nvmfappstart -m 0xE 00:13:40.105 01:14:47 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:40.105 01:14:47 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:40.105 01:14:47 -- common/autotest_common.sh@10 -- # set +x 00:13:40.105 01:14:47 -- nvmf/common.sh@469 -- # nvmfpid=1094311 00:13:40.105 01:14:47 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:13:40.105 01:14:47 -- nvmf/common.sh@470 -- # waitforlisten 1094311 00:13:40.105 01:14:47 -- common/autotest_common.sh@829 -- # '[' -z 1094311 ']' 00:13:40.105 01:14:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:40.105 01:14:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:40.105 01:14:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:40.105 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:40.105 01:14:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:40.105 01:14:47 -- common/autotest_common.sh@10 -- # set +x 00:13:40.105 [2024-11-20 01:14:47.949933] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:13:40.105 [2024-11-20 01:14:47.950002] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:40.105 EAL: No free 2048 kB hugepages reported on node 1 00:13:40.105 [2024-11-20 01:14:48.012652] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:40.105 [2024-11-20 01:14:48.098303] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:40.105 [2024-11-20 01:14:48.098481] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:40.105 [2024-11-20 01:14:48.098502] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:40.105 [2024-11-20 01:14:48.098516] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:40.105 [2024-11-20 01:14:48.098640] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:40.105 [2024-11-20 01:14:48.098728] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:40.105 [2024-11-20 01:14:48.098732] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:41.039 01:14:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:41.039 01:14:48 -- common/autotest_common.sh@862 -- # return 0 00:13:41.039 01:14:48 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:41.039 01:14:48 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:41.039 01:14:48 -- common/autotest_common.sh@10 -- # set +x 00:13:41.039 01:14:48 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:41.039 01:14:48 -- target/ns_hotplug_stress.sh@25 -- # null_size=1000 00:13:41.039 01:14:48 -- target/ns_hotplug_stress.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:13:41.039 [2024-11-20 01:14:49.227961] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:41.039 01:14:49 -- target/ns_hotplug_stress.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:41.296 01:14:49 -- target/ns_hotplug_stress.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:41.554 [2024-11-20 01:14:49.742731] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:41.554 01:14:49 -- target/ns_hotplug_stress.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:13:41.812 01:14:50 -- target/ns_hotplug_stress.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:13:42.070 Malloc0 00:13:42.328 01:14:50 -- target/ns_hotplug_stress.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:42.328 Delay0 00:13:42.585 01:14:50 -- target/ns_hotplug_stress.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:42.843 01:14:50 -- target/ns_hotplug_stress.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:13:43.101 NULL1 00:13:43.101 01:14:51 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:13:43.360 01:14:51 -- target/ns_hotplug_stress.sh@42 -- # PERF_PID=1094750 00:13:43.360 01:14:51 -- target/ns_hotplug_stress.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:13:43.360 01:14:51 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1094750 00:13:43.360 01:14:51 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:43.360 EAL: No free 2048 kB hugepages reported on node 1 00:13:43.617 01:14:51 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:43.875 01:14:51 -- target/ns_hotplug_stress.sh@49 -- # null_size=1001 00:13:43.875 01:14:51 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:13:44.132 true 00:13:44.132 01:14:52 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1094750 00:13:44.132 01:14:52 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:44.391 01:14:52 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:44.649 01:14:52 -- target/ns_hotplug_stress.sh@49 -- # null_size=1002 00:13:44.649 01:14:52 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:13:44.649 true 00:13:44.906 01:14:52 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1094750 00:13:44.906 01:14:52 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:45.472 Read completed with error (sct=0, sc=11) 00:13:45.472 01:14:53 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:45.472 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:45.730 01:14:53 -- target/ns_hotplug_stress.sh@49 -- # null_size=1003 00:13:45.730 01:14:53 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:13:45.988 true 00:13:45.988 01:14:54 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1094750 00:13:45.988 01:14:54 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:46.245 01:14:54 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:46.503 01:14:54 -- target/ns_hotplug_stress.sh@49 -- # null_size=1004 00:13:46.503 01:14:54 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:13:46.761 true 00:13:46.761 01:14:54 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1094750 00:13:46.761 01:14:54 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:47.694 01:14:55 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:47.694 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:47.694 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:47.952 01:14:56 -- target/ns_hotplug_stress.sh@49 -- # null_size=1005 00:13:47.952 01:14:56 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:13:48.210 true 00:13:48.210 01:14:56 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1094750 00:13:48.210 01:14:56 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:48.467 01:14:56 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:48.724 01:14:56 -- target/ns_hotplug_stress.sh@49 -- # null_size=1006 00:13:48.724 01:14:56 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:13:48.980 true 00:13:48.980 01:14:57 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1094750 00:13:48.980 01:14:57 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:49.911 01:14:57 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:49.911 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:49.911 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:49.911 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:50.169 01:14:58 -- target/ns_hotplug_stress.sh@49 -- # null_size=1007 00:13:50.169 01:14:58 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:13:50.426 true 00:13:50.426 01:14:58 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1094750 00:13:50.426 01:14:58 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:50.683 01:14:58 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:50.941 01:14:59 -- target/ns_hotplug_stress.sh@49 -- # null_size=1008 00:13:50.941 01:14:59 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:13:51.208 true 00:13:51.208 01:14:59 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1094750 00:13:51.208 01:14:59 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:52.140 01:15:00 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:52.140 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:52.140 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:52.398 01:15:00 -- target/ns_hotplug_stress.sh@49 -- # null_size=1009 00:13:52.398 01:15:00 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:13:52.656 true 00:13:52.656 01:15:00 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1094750 00:13:52.656 01:15:00 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:52.913 01:15:00 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:53.171 01:15:01 -- target/ns_hotplug_stress.sh@49 -- # null_size=1010 00:13:53.171 01:15:01 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:13:53.428 true 00:13:53.428 01:15:01 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1094750 00:13:53.428 01:15:01 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:54.361 01:15:02 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:54.361 01:15:02 -- target/ns_hotplug_stress.sh@49 -- # null_size=1011 00:13:54.361 01:15:02 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:13:54.619 true 00:13:54.619 01:15:02 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1094750 00:13:54.619 01:15:02 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:54.878 01:15:02 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:55.135 01:15:03 -- target/ns_hotplug_stress.sh@49 -- # null_size=1012 00:13:55.135 01:15:03 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:13:55.392 true 00:13:55.392 01:15:03 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1094750 00:13:55.392 01:15:03 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:56.324 01:15:04 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:56.324 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:56.324 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:56.581 01:15:04 -- target/ns_hotplug_stress.sh@49 -- # null_size=1013 00:13:56.581 01:15:04 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:13:56.839 true 00:13:56.839 01:15:04 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1094750 00:13:56.839 01:15:04 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:57.128 01:15:05 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:57.410 01:15:05 -- target/ns_hotplug_stress.sh@49 -- # null_size=1014 00:13:57.410 01:15:05 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:13:57.668 true 00:13:57.668 01:15:05 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1094750 00:13:57.668 01:15:05 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:58.604 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:58.604 01:15:06 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:58.604 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:58.604 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:58.604 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:58.862 01:15:06 -- target/ns_hotplug_stress.sh@49 -- # null_size=1015 00:13:58.862 01:15:06 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:13:58.862 true 00:13:59.121 01:15:07 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1094750 00:13:59.121 01:15:07 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:59.378 01:15:07 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:59.636 01:15:07 -- target/ns_hotplug_stress.sh@49 -- # null_size=1016 00:13:59.636 01:15:07 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:13:59.894 true 00:13:59.894 01:15:07 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1094750 00:13:59.894 01:15:07 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:00.830 01:15:08 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:00.830 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:01.088 01:15:09 -- target/ns_hotplug_stress.sh@49 -- # null_size=1017 00:14:01.088 01:15:09 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:14:01.346 true 00:14:01.346 01:15:09 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1094750 00:14:01.346 01:15:09 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:01.605 01:15:09 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:01.866 01:15:09 -- target/ns_hotplug_stress.sh@49 -- # null_size=1018 00:14:01.866 01:15:09 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:14:01.866 true 00:14:02.126 01:15:10 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1094750 00:14:02.126 01:15:10 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:03.060 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:03.060 01:15:10 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:03.060 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:03.060 01:15:11 -- target/ns_hotplug_stress.sh@49 -- # null_size=1019 00:14:03.060 01:15:11 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:14:03.342 true 00:14:03.342 01:15:11 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1094750 00:14:03.342 01:15:11 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:03.600 01:15:11 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:03.858 01:15:11 -- target/ns_hotplug_stress.sh@49 -- # null_size=1020 00:14:03.858 01:15:11 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:14:04.115 true 00:14:04.115 01:15:12 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1094750 00:14:04.115 01:15:12 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:05.052 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:05.052 01:15:13 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:05.309 01:15:13 -- target/ns_hotplug_stress.sh@49 -- # null_size=1021 00:14:05.309 01:15:13 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:14:05.567 true 00:14:05.567 01:15:13 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1094750 00:14:05.567 01:15:13 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:05.826 01:15:13 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:06.085 01:15:14 -- target/ns_hotplug_stress.sh@49 -- # null_size=1022 00:14:06.085 01:15:14 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:14:06.344 true 00:14:06.344 01:15:14 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1094750 00:14:06.344 01:15:14 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:06.913 01:15:15 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:07.171 01:15:15 -- target/ns_hotplug_stress.sh@49 -- # null_size=1023 00:14:07.171 01:15:15 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:14:07.428 true 00:14:07.428 01:15:15 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1094750 00:14:07.428 01:15:15 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:07.686 01:15:15 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:07.944 01:15:16 -- target/ns_hotplug_stress.sh@49 -- # null_size=1024 00:14:07.944 01:15:16 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:14:08.202 true 00:14:08.202 01:15:16 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1094750 00:14:08.202 01:15:16 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:09.136 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:09.136 01:15:17 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:09.136 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:09.136 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:09.393 01:15:17 -- target/ns_hotplug_stress.sh@49 -- # null_size=1025 00:14:09.393 01:15:17 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:14:09.651 true 00:14:09.651 01:15:17 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1094750 00:14:09.651 01:15:17 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:09.909 01:15:17 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:10.167 01:15:18 -- target/ns_hotplug_stress.sh@49 -- # null_size=1026 00:14:10.167 01:15:18 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:14:10.424 true 00:14:10.424 01:15:18 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1094750 00:14:10.424 01:15:18 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:11.358 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:11.358 01:15:19 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:11.358 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:11.616 01:15:19 -- target/ns_hotplug_stress.sh@49 -- # null_size=1027 00:14:11.616 01:15:19 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:14:11.874 true 00:14:11.874 01:15:19 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1094750 00:14:11.874 01:15:19 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:12.132 01:15:20 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:12.390 01:15:20 -- target/ns_hotplug_stress.sh@49 -- # null_size=1028 00:14:12.390 01:15:20 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1028 00:14:12.648 true 00:14:12.648 01:15:20 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1094750 00:14:12.648 01:15:20 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:13.586 01:15:21 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:13.586 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:13.586 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:13.586 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:13.586 Initializing NVMe Controllers 00:14:13.586 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:13.587 Controller IO queue size 128, less than required. 00:14:13.587 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:13.587 Controller IO queue size 128, less than required. 00:14:13.587 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:13.587 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:14:13.587 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:14:13.587 Initialization complete. Launching workers. 00:14:13.587 ======================================================== 00:14:13.587 Latency(us) 00:14:13.587 Device Information : IOPS MiB/s Average min max 00:14:13.587 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 936.38 0.46 72500.70 2366.60 1010715.20 00:14:13.587 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 12014.64 5.87 10623.62 1605.76 443545.18 00:14:13.587 ======================================================== 00:14:13.587 Total : 12951.02 6.32 15097.43 1605.76 1010715.20 00:14:13.587 00:14:13.587 01:15:21 -- target/ns_hotplug_stress.sh@49 -- # null_size=1029 00:14:13.587 01:15:21 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1029 00:14:13.845 true 00:14:13.845 01:15:22 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1094750 00:14:13.845 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 44: kill: (1094750) - No such process 00:14:13.845 01:15:22 -- target/ns_hotplug_stress.sh@53 -- # wait 1094750 00:14:13.845 01:15:22 -- target/ns_hotplug_stress.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:14.103 01:15:22 -- target/ns_hotplug_stress.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:14.361 01:15:22 -- target/ns_hotplug_stress.sh@58 -- # nthreads=8 00:14:14.361 01:15:22 -- target/ns_hotplug_stress.sh@58 -- # pids=() 00:14:14.361 01:15:22 -- target/ns_hotplug_stress.sh@59 -- # (( i = 0 )) 00:14:14.361 01:15:22 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:14.361 01:15:22 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null0 100 4096 00:14:14.619 null0 00:14:14.619 01:15:22 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:14.619 01:15:22 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:14.619 01:15:22 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null1 100 4096 00:14:14.877 null1 00:14:14.877 01:15:23 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:14.877 01:15:23 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:14.877 01:15:23 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null2 100 4096 00:14:15.135 null2 00:14:15.135 01:15:23 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:15.135 01:15:23 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:15.135 01:15:23 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null3 100 4096 00:14:15.393 null3 00:14:15.393 01:15:23 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:15.393 01:15:23 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:15.393 01:15:23 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null4 100 4096 00:14:15.653 null4 00:14:15.653 01:15:23 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:15.653 01:15:23 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:15.653 01:15:23 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null5 100 4096 00:14:15.911 null5 00:14:15.911 01:15:24 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:15.911 01:15:24 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:15.911 01:15:24 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null6 100 4096 00:14:16.169 null6 00:14:16.169 01:15:24 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:16.169 01:15:24 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:16.169 01:15:24 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null7 100 4096 00:14:16.427 null7 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@62 -- # (( i = 0 )) 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@63 -- # add_remove 1 null0 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@14 -- # local nsid=1 bdev=null0 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@63 -- # add_remove 2 null1 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@14 -- # local nsid=2 bdev=null1 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@63 -- # add_remove 3 null2 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@14 -- # local nsid=3 bdev=null2 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@63 -- # add_remove 4 null3 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@14 -- # local nsid=4 bdev=null3 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@63 -- # add_remove 5 null4 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@14 -- # local nsid=5 bdev=null4 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@63 -- # add_remove 6 null5 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@14 -- # local nsid=6 bdev=null5 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@63 -- # add_remove 7 null6 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@14 -- # local nsid=7 bdev=null6 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@63 -- # add_remove 8 null7 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@14 -- # local nsid=8 bdev=null7 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@66 -- # wait 1099526 1099527 1099529 1099531 1099533 1099535 1099537 1099539 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:16.427 01:15:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:16.686 01:15:24 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:16.686 01:15:24 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:16.686 01:15:24 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:16.686 01:15:24 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:16.686 01:15:24 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:16.686 01:15:24 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:16.945 01:15:24 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:16.945 01:15:24 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:16.945 01:15:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:16.945 01:15:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:16.945 01:15:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:16.945 01:15:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:16.945 01:15:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:16.945 01:15:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:17.204 01:15:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:17.204 01:15:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:17.204 01:15:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:17.204 01:15:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:17.204 01:15:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:17.204 01:15:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:17.204 01:15:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:17.204 01:15:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:17.204 01:15:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:17.204 01:15:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:17.204 01:15:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:17.204 01:15:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:17.204 01:15:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:17.204 01:15:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:17.204 01:15:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:17.204 01:15:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:17.204 01:15:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:17.204 01:15:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:17.463 01:15:25 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:17.463 01:15:25 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:17.463 01:15:25 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:17.463 01:15:25 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:17.463 01:15:25 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:17.463 01:15:25 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:17.463 01:15:25 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:17.463 01:15:25 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:17.721 01:15:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:17.721 01:15:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:17.721 01:15:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:17.721 01:15:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:17.721 01:15:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:17.721 01:15:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:17.721 01:15:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:17.721 01:15:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:17.721 01:15:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:17.721 01:15:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:17.721 01:15:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:17.721 01:15:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:17.721 01:15:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:17.721 01:15:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:17.721 01:15:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:17.721 01:15:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:17.721 01:15:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:17.721 01:15:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:17.721 01:15:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:17.721 01:15:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:17.721 01:15:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:17.721 01:15:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:17.721 01:15:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:17.721 01:15:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:17.979 01:15:26 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:17.979 01:15:26 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:17.979 01:15:26 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:17.979 01:15:26 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:17.979 01:15:26 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:17.979 01:15:26 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:17.979 01:15:26 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:17.979 01:15:26 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:18.238 01:15:26 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:18.238 01:15:26 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:18.238 01:15:26 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:18.238 01:15:26 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:18.238 01:15:26 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:18.238 01:15:26 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:18.238 01:15:26 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:18.238 01:15:26 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:18.238 01:15:26 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:18.238 01:15:26 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:18.238 01:15:26 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:18.238 01:15:26 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:18.238 01:15:26 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:18.238 01:15:26 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:18.238 01:15:26 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:18.238 01:15:26 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:18.238 01:15:26 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:18.238 01:15:26 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:18.238 01:15:26 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:18.238 01:15:26 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:18.238 01:15:26 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:18.238 01:15:26 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:18.238 01:15:26 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:18.238 01:15:26 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:18.496 01:15:26 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:18.496 01:15:26 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:18.496 01:15:26 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:18.496 01:15:26 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:18.496 01:15:26 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:18.496 01:15:26 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:18.496 01:15:26 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:18.496 01:15:26 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:18.755 01:15:26 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:18.756 01:15:26 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:18.756 01:15:26 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:18.756 01:15:26 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:18.756 01:15:26 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:18.756 01:15:26 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:18.756 01:15:26 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:18.756 01:15:26 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:18.756 01:15:26 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:18.756 01:15:26 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:18.756 01:15:26 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:18.756 01:15:26 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:18.756 01:15:26 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:18.756 01:15:26 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:18.756 01:15:26 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:18.756 01:15:26 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:18.756 01:15:26 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:18.756 01:15:26 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:18.756 01:15:26 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:18.756 01:15:26 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:18.756 01:15:26 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:18.756 01:15:26 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:18.756 01:15:26 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:18.756 01:15:26 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:19.015 01:15:27 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:19.015 01:15:27 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:19.015 01:15:27 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:19.015 01:15:27 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:19.015 01:15:27 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:19.015 01:15:27 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:19.015 01:15:27 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:19.015 01:15:27 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:19.275 01:15:27 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:19.275 01:15:27 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:19.275 01:15:27 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:19.275 01:15:27 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:19.275 01:15:27 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:19.275 01:15:27 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:19.275 01:15:27 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:19.275 01:15:27 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:19.275 01:15:27 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:19.275 01:15:27 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:19.275 01:15:27 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:19.275 01:15:27 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:19.275 01:15:27 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:19.275 01:15:27 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:19.275 01:15:27 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:19.275 01:15:27 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:19.275 01:15:27 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:19.275 01:15:27 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:19.275 01:15:27 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:19.275 01:15:27 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:19.275 01:15:27 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:19.275 01:15:27 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:19.275 01:15:27 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:19.275 01:15:27 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:19.533 01:15:27 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:19.533 01:15:27 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:19.533 01:15:27 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:19.533 01:15:27 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:19.533 01:15:27 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:19.533 01:15:27 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:19.533 01:15:27 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:19.533 01:15:27 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:19.791 01:15:27 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:19.791 01:15:27 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:19.791 01:15:27 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:19.791 01:15:27 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:19.791 01:15:27 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:19.791 01:15:27 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:19.791 01:15:27 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:19.791 01:15:27 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:19.792 01:15:27 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:19.792 01:15:27 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:19.792 01:15:27 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:19.792 01:15:27 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:19.792 01:15:27 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:19.792 01:15:27 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:19.792 01:15:27 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:19.792 01:15:27 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:19.792 01:15:27 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:19.792 01:15:27 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:19.792 01:15:27 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:19.792 01:15:27 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:19.792 01:15:27 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:19.792 01:15:27 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:19.792 01:15:27 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:19.792 01:15:27 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:20.407 01:15:28 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:20.407 01:15:28 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:20.407 01:15:28 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:20.407 01:15:28 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:20.407 01:15:28 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:20.407 01:15:28 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:20.407 01:15:28 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:20.407 01:15:28 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:20.407 01:15:28 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:20.407 01:15:28 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:20.407 01:15:28 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:20.407 01:15:28 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:20.407 01:15:28 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:20.407 01:15:28 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:20.407 01:15:28 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:20.407 01:15:28 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:20.407 01:15:28 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:20.407 01:15:28 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:20.407 01:15:28 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:20.407 01:15:28 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:20.407 01:15:28 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:20.407 01:15:28 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:20.407 01:15:28 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:20.407 01:15:28 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:20.407 01:15:28 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:20.407 01:15:28 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:20.407 01:15:28 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:20.407 01:15:28 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:20.407 01:15:28 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:20.407 01:15:28 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:20.407 01:15:28 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:20.407 01:15:28 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:20.689 01:15:28 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:20.689 01:15:28 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:20.689 01:15:28 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:20.689 01:15:28 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:20.689 01:15:28 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:20.689 01:15:28 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:20.689 01:15:28 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:20.689 01:15:28 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:20.948 01:15:29 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:20.948 01:15:29 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:20.948 01:15:29 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:20.948 01:15:29 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:20.948 01:15:29 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:20.948 01:15:29 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:20.948 01:15:29 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:20.948 01:15:29 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:20.948 01:15:29 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:20.948 01:15:29 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:20.948 01:15:29 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:20.948 01:15:29 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:20.948 01:15:29 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:20.948 01:15:29 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:20.948 01:15:29 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:20.948 01:15:29 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:20.948 01:15:29 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:20.948 01:15:29 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:20.948 01:15:29 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:20.948 01:15:29 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:20.948 01:15:29 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:20.948 01:15:29 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:20.948 01:15:29 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:20.948 01:15:29 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:21.205 01:15:29 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:21.205 01:15:29 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:21.205 01:15:29 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:21.205 01:15:29 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:21.205 01:15:29 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:21.205 01:15:29 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:21.205 01:15:29 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:21.462 01:15:29 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:21.462 01:15:29 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:21.462 01:15:29 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:21.462 01:15:29 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:21.721 01:15:29 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:21.721 01:15:29 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:21.721 01:15:29 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:21.721 01:15:29 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:21.721 01:15:29 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:21.721 01:15:29 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:21.721 01:15:29 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:21.721 01:15:29 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:21.721 01:15:29 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:21.721 01:15:29 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:21.721 01:15:29 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:21.721 01:15:29 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:21.721 01:15:29 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:21.721 01:15:29 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:21.721 01:15:29 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:21.721 01:15:29 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:21.721 01:15:29 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:21.721 01:15:29 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:21.721 01:15:29 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:21.721 01:15:29 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:21.721 01:15:29 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:21.979 01:15:29 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:21.979 01:15:29 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:21.979 01:15:29 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:21.979 01:15:29 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:21.979 01:15:29 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:21.979 01:15:29 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:21.979 01:15:29 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:21.979 01:15:29 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:22.237 01:15:30 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:22.237 01:15:30 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:22.237 01:15:30 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:22.237 01:15:30 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:22.237 01:15:30 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:22.237 01:15:30 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:22.237 01:15:30 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:22.237 01:15:30 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:22.237 01:15:30 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:22.237 01:15:30 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:22.237 01:15:30 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:22.237 01:15:30 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:22.237 01:15:30 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:22.237 01:15:30 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:22.237 01:15:30 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:22.237 01:15:30 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:22.237 01:15:30 -- target/ns_hotplug_stress.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:14:22.237 01:15:30 -- target/ns_hotplug_stress.sh@70 -- # nvmftestfini 00:14:22.237 01:15:30 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:22.237 01:15:30 -- nvmf/common.sh@116 -- # sync 00:14:22.237 01:15:30 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:22.237 01:15:30 -- nvmf/common.sh@119 -- # set +e 00:14:22.237 01:15:30 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:22.237 01:15:30 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:22.237 rmmod nvme_tcp 00:14:22.237 rmmod nvme_fabrics 00:14:22.237 rmmod nvme_keyring 00:14:22.237 01:15:30 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:22.237 01:15:30 -- nvmf/common.sh@123 -- # set -e 00:14:22.237 01:15:30 -- nvmf/common.sh@124 -- # return 0 00:14:22.237 01:15:30 -- nvmf/common.sh@477 -- # '[' -n 1094311 ']' 00:14:22.237 01:15:30 -- nvmf/common.sh@478 -- # killprocess 1094311 00:14:22.237 01:15:30 -- common/autotest_common.sh@936 -- # '[' -z 1094311 ']' 00:14:22.237 01:15:30 -- common/autotest_common.sh@940 -- # kill -0 1094311 00:14:22.237 01:15:30 -- common/autotest_common.sh@941 -- # uname 00:14:22.237 01:15:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:22.237 01:15:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1094311 00:14:22.237 01:15:30 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:22.237 01:15:30 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:22.237 01:15:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1094311' 00:14:22.237 killing process with pid 1094311 00:14:22.237 01:15:30 -- common/autotest_common.sh@955 -- # kill 1094311 00:14:22.237 01:15:30 -- common/autotest_common.sh@960 -- # wait 1094311 00:14:22.495 01:15:30 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:22.495 01:15:30 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:22.495 01:15:30 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:22.495 01:15:30 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:22.495 01:15:30 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:22.495 01:15:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:22.495 01:15:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:22.495 01:15:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:25.024 01:15:32 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:25.024 00:14:25.024 real 0m47.140s 00:14:25.024 user 3m36.001s 00:14:25.024 sys 0m15.439s 00:14:25.024 01:15:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:25.024 01:15:32 -- common/autotest_common.sh@10 -- # set +x 00:14:25.024 ************************************ 00:14:25.024 END TEST nvmf_ns_hotplug_stress 00:14:25.024 ************************************ 00:14:25.024 01:15:32 -- nvmf/nvmf.sh@33 -- # run_test nvmf_connect_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:14:25.024 01:15:32 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:25.024 01:15:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:25.024 01:15:32 -- common/autotest_common.sh@10 -- # set +x 00:14:25.024 ************************************ 00:14:25.024 START TEST nvmf_connect_stress 00:14:25.024 ************************************ 00:14:25.024 01:15:32 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:14:25.024 * Looking for test storage... 00:14:25.024 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:25.024 01:15:32 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:25.024 01:15:32 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:25.024 01:15:32 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:25.024 01:15:32 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:25.024 01:15:32 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:25.024 01:15:32 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:25.024 01:15:32 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:25.024 01:15:32 -- scripts/common.sh@335 -- # IFS=.-: 00:14:25.024 01:15:32 -- scripts/common.sh@335 -- # read -ra ver1 00:14:25.024 01:15:32 -- scripts/common.sh@336 -- # IFS=.-: 00:14:25.024 01:15:32 -- scripts/common.sh@336 -- # read -ra ver2 00:14:25.024 01:15:32 -- scripts/common.sh@337 -- # local 'op=<' 00:14:25.024 01:15:32 -- scripts/common.sh@339 -- # ver1_l=2 00:14:25.024 01:15:32 -- scripts/common.sh@340 -- # ver2_l=1 00:14:25.024 01:15:32 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:25.024 01:15:32 -- scripts/common.sh@343 -- # case "$op" in 00:14:25.024 01:15:32 -- scripts/common.sh@344 -- # : 1 00:14:25.024 01:15:32 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:25.024 01:15:32 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:25.024 01:15:32 -- scripts/common.sh@364 -- # decimal 1 00:14:25.024 01:15:32 -- scripts/common.sh@352 -- # local d=1 00:14:25.024 01:15:32 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:25.024 01:15:32 -- scripts/common.sh@354 -- # echo 1 00:14:25.024 01:15:32 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:25.025 01:15:32 -- scripts/common.sh@365 -- # decimal 2 00:14:25.025 01:15:32 -- scripts/common.sh@352 -- # local d=2 00:14:25.025 01:15:32 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:25.025 01:15:32 -- scripts/common.sh@354 -- # echo 2 00:14:25.025 01:15:32 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:25.025 01:15:32 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:25.025 01:15:32 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:25.025 01:15:32 -- scripts/common.sh@367 -- # return 0 00:14:25.025 01:15:32 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:25.025 01:15:32 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:25.025 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:25.025 --rc genhtml_branch_coverage=1 00:14:25.025 --rc genhtml_function_coverage=1 00:14:25.025 --rc genhtml_legend=1 00:14:25.025 --rc geninfo_all_blocks=1 00:14:25.025 --rc geninfo_unexecuted_blocks=1 00:14:25.025 00:14:25.025 ' 00:14:25.025 01:15:32 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:25.025 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:25.025 --rc genhtml_branch_coverage=1 00:14:25.025 --rc genhtml_function_coverage=1 00:14:25.025 --rc genhtml_legend=1 00:14:25.025 --rc geninfo_all_blocks=1 00:14:25.025 --rc geninfo_unexecuted_blocks=1 00:14:25.025 00:14:25.025 ' 00:14:25.025 01:15:32 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:25.025 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:25.025 --rc genhtml_branch_coverage=1 00:14:25.025 --rc genhtml_function_coverage=1 00:14:25.025 --rc genhtml_legend=1 00:14:25.025 --rc geninfo_all_blocks=1 00:14:25.025 --rc geninfo_unexecuted_blocks=1 00:14:25.025 00:14:25.025 ' 00:14:25.025 01:15:32 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:25.025 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:25.025 --rc genhtml_branch_coverage=1 00:14:25.025 --rc genhtml_function_coverage=1 00:14:25.025 --rc genhtml_legend=1 00:14:25.025 --rc geninfo_all_blocks=1 00:14:25.025 --rc geninfo_unexecuted_blocks=1 00:14:25.025 00:14:25.025 ' 00:14:25.025 01:15:32 -- target/connect_stress.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:25.025 01:15:32 -- nvmf/common.sh@7 -- # uname -s 00:14:25.025 01:15:32 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:25.025 01:15:32 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:25.025 01:15:32 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:25.025 01:15:32 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:25.025 01:15:32 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:25.025 01:15:32 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:25.025 01:15:32 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:25.025 01:15:32 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:25.025 01:15:32 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:25.025 01:15:32 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:25.025 01:15:32 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:25.025 01:15:32 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:25.025 01:15:32 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:25.025 01:15:32 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:25.025 01:15:32 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:25.025 01:15:32 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:25.025 01:15:32 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:25.025 01:15:32 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:25.025 01:15:32 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:25.025 01:15:32 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:25.025 01:15:32 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:25.025 01:15:32 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:25.025 01:15:32 -- paths/export.sh@5 -- # export PATH 00:14:25.025 01:15:32 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:25.025 01:15:32 -- nvmf/common.sh@46 -- # : 0 00:14:25.025 01:15:32 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:25.025 01:15:32 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:25.025 01:15:32 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:25.025 01:15:32 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:25.025 01:15:32 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:25.025 01:15:32 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:25.025 01:15:32 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:25.025 01:15:32 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:25.025 01:15:32 -- target/connect_stress.sh@12 -- # nvmftestinit 00:14:25.025 01:15:32 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:25.025 01:15:32 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:25.025 01:15:32 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:25.025 01:15:32 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:25.025 01:15:32 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:25.025 01:15:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:25.025 01:15:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:25.025 01:15:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:25.025 01:15:32 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:25.025 01:15:32 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:25.025 01:15:32 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:25.025 01:15:32 -- common/autotest_common.sh@10 -- # set +x 00:14:26.929 01:15:34 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:26.929 01:15:34 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:26.929 01:15:34 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:26.929 01:15:34 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:26.929 01:15:34 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:26.929 01:15:34 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:26.929 01:15:34 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:26.929 01:15:34 -- nvmf/common.sh@294 -- # net_devs=() 00:14:26.929 01:15:34 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:26.929 01:15:34 -- nvmf/common.sh@295 -- # e810=() 00:14:26.929 01:15:34 -- nvmf/common.sh@295 -- # local -ga e810 00:14:26.929 01:15:34 -- nvmf/common.sh@296 -- # x722=() 00:14:26.929 01:15:34 -- nvmf/common.sh@296 -- # local -ga x722 00:14:26.929 01:15:34 -- nvmf/common.sh@297 -- # mlx=() 00:14:26.929 01:15:34 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:26.929 01:15:34 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:26.929 01:15:34 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:26.929 01:15:34 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:26.929 01:15:34 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:26.929 01:15:34 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:26.929 01:15:34 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:26.929 01:15:34 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:26.929 01:15:34 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:26.929 01:15:34 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:26.929 01:15:34 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:26.929 01:15:34 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:26.929 01:15:34 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:26.929 01:15:34 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:26.929 01:15:34 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:26.929 01:15:34 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:26.929 01:15:34 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:26.929 01:15:34 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:26.929 01:15:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:26.929 01:15:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:26.929 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:26.929 01:15:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:26.929 01:15:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:26.929 01:15:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:26.929 01:15:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:26.929 01:15:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:26.929 01:15:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:26.929 01:15:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:26.929 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:26.929 01:15:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:26.929 01:15:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:26.929 01:15:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:26.929 01:15:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:26.929 01:15:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:26.929 01:15:34 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:26.929 01:15:34 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:26.929 01:15:34 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:26.929 01:15:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:26.929 01:15:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:26.929 01:15:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:26.929 01:15:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:26.929 01:15:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:26.929 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:26.929 01:15:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:26.929 01:15:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:26.929 01:15:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:26.929 01:15:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:26.929 01:15:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:26.929 01:15:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:26.929 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:26.929 01:15:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:26.929 01:15:34 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:26.929 01:15:34 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:26.929 01:15:34 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:26.929 01:15:34 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:26.929 01:15:34 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:26.929 01:15:34 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:26.929 01:15:34 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:26.929 01:15:34 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:26.929 01:15:34 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:26.929 01:15:34 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:26.929 01:15:34 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:26.929 01:15:34 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:26.929 01:15:34 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:26.929 01:15:34 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:26.929 01:15:34 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:26.929 01:15:34 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:26.929 01:15:34 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:26.929 01:15:34 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:26.929 01:15:34 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:26.929 01:15:34 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:26.929 01:15:34 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:26.929 01:15:34 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:26.929 01:15:34 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:26.929 01:15:34 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:26.929 01:15:34 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:26.929 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:26.929 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.180 ms 00:14:26.929 00:14:26.929 --- 10.0.0.2 ping statistics --- 00:14:26.929 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:26.929 rtt min/avg/max/mdev = 0.180/0.180/0.180/0.000 ms 00:14:26.929 01:15:34 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:26.929 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:26.929 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.119 ms 00:14:26.929 00:14:26.929 --- 10.0.0.1 ping statistics --- 00:14:26.929 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:26.929 rtt min/avg/max/mdev = 0.119/0.119/0.119/0.000 ms 00:14:26.929 01:15:34 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:26.929 01:15:34 -- nvmf/common.sh@410 -- # return 0 00:14:26.929 01:15:34 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:26.929 01:15:34 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:26.929 01:15:34 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:26.929 01:15:34 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:26.929 01:15:34 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:26.929 01:15:34 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:26.930 01:15:34 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:26.930 01:15:35 -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:14:26.930 01:15:35 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:26.930 01:15:35 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:26.930 01:15:35 -- common/autotest_common.sh@10 -- # set +x 00:14:26.930 01:15:35 -- nvmf/common.sh@469 -- # nvmfpid=1102335 00:14:26.930 01:15:35 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:14:26.930 01:15:35 -- nvmf/common.sh@470 -- # waitforlisten 1102335 00:14:26.930 01:15:35 -- common/autotest_common.sh@829 -- # '[' -z 1102335 ']' 00:14:26.930 01:15:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:26.930 01:15:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:26.930 01:15:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:26.930 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:26.930 01:15:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:26.930 01:15:35 -- common/autotest_common.sh@10 -- # set +x 00:14:26.930 [2024-11-20 01:15:35.069761] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:14:26.930 [2024-11-20 01:15:35.069837] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:26.930 EAL: No free 2048 kB hugepages reported on node 1 00:14:26.930 [2024-11-20 01:15:35.138693] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:14:27.188 [2024-11-20 01:15:35.226877] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:27.188 [2024-11-20 01:15:35.227060] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:27.188 [2024-11-20 01:15:35.227090] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:27.188 [2024-11-20 01:15:35.227106] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:27.188 [2024-11-20 01:15:35.227194] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:27.188 [2024-11-20 01:15:35.227309] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:27.188 [2024-11-20 01:15:35.227312] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:28.123 01:15:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:28.123 01:15:36 -- common/autotest_common.sh@862 -- # return 0 00:14:28.123 01:15:36 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:28.123 01:15:36 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:28.123 01:15:36 -- common/autotest_common.sh@10 -- # set +x 00:14:28.123 01:15:36 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:28.123 01:15:36 -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:28.123 01:15:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:28.123 01:15:36 -- common/autotest_common.sh@10 -- # set +x 00:14:28.123 [2024-11-20 01:15:36.035798] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:28.123 01:15:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:28.123 01:15:36 -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:28.123 01:15:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:28.123 01:15:36 -- common/autotest_common.sh@10 -- # set +x 00:14:28.123 01:15:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:28.123 01:15:36 -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:28.123 01:15:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:28.123 01:15:36 -- common/autotest_common.sh@10 -- # set +x 00:14:28.123 [2024-11-20 01:15:36.064225] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:28.123 01:15:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:28.123 01:15:36 -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:14:28.123 01:15:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:28.123 01:15:36 -- common/autotest_common.sh@10 -- # set +x 00:14:28.123 NULL1 00:14:28.123 01:15:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:28.123 01:15:36 -- target/connect_stress.sh@21 -- # PERF_PID=1102494 00:14:28.123 01:15:36 -- target/connect_stress.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:14:28.123 01:15:36 -- target/connect_stress.sh@23 -- # rpcs=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:14:28.123 01:15:36 -- target/connect_stress.sh@25 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:14:28.123 01:15:36 -- target/connect_stress.sh@27 -- # seq 1 20 00:14:28.123 01:15:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:28.123 01:15:36 -- target/connect_stress.sh@28 -- # cat 00:14:28.123 01:15:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:28.123 01:15:36 -- target/connect_stress.sh@28 -- # cat 00:14:28.123 01:15:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:28.123 01:15:36 -- target/connect_stress.sh@28 -- # cat 00:14:28.123 01:15:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:28.123 01:15:36 -- target/connect_stress.sh@28 -- # cat 00:14:28.123 01:15:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:28.123 01:15:36 -- target/connect_stress.sh@28 -- # cat 00:14:28.123 01:15:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:28.123 01:15:36 -- target/connect_stress.sh@28 -- # cat 00:14:28.123 01:15:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:28.123 01:15:36 -- target/connect_stress.sh@28 -- # cat 00:14:28.123 01:15:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:28.123 01:15:36 -- target/connect_stress.sh@28 -- # cat 00:14:28.123 01:15:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:28.123 01:15:36 -- target/connect_stress.sh@28 -- # cat 00:14:28.123 01:15:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:28.123 01:15:36 -- target/connect_stress.sh@28 -- # cat 00:14:28.123 EAL: No free 2048 kB hugepages reported on node 1 00:14:28.123 01:15:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:28.123 01:15:36 -- target/connect_stress.sh@28 -- # cat 00:14:28.123 01:15:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:28.123 01:15:36 -- target/connect_stress.sh@28 -- # cat 00:14:28.123 01:15:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:28.123 01:15:36 -- target/connect_stress.sh@28 -- # cat 00:14:28.123 01:15:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:28.123 01:15:36 -- target/connect_stress.sh@28 -- # cat 00:14:28.123 01:15:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:28.123 01:15:36 -- target/connect_stress.sh@28 -- # cat 00:14:28.123 01:15:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:28.123 01:15:36 -- target/connect_stress.sh@28 -- # cat 00:14:28.123 01:15:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:28.123 01:15:36 -- target/connect_stress.sh@28 -- # cat 00:14:28.123 01:15:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:28.123 01:15:36 -- target/connect_stress.sh@28 -- # cat 00:14:28.123 01:15:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:28.123 01:15:36 -- target/connect_stress.sh@28 -- # cat 00:14:28.123 01:15:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:28.123 01:15:36 -- target/connect_stress.sh@28 -- # cat 00:14:28.123 01:15:36 -- target/connect_stress.sh@34 -- # kill -0 1102494 00:14:28.123 01:15:36 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:28.123 01:15:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:28.123 01:15:36 -- common/autotest_common.sh@10 -- # set +x 00:14:28.382 01:15:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:28.382 01:15:36 -- target/connect_stress.sh@34 -- # kill -0 1102494 00:14:28.382 01:15:36 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:28.382 01:15:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:28.382 01:15:36 -- common/autotest_common.sh@10 -- # set +x 00:14:28.639 01:15:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:28.639 01:15:36 -- target/connect_stress.sh@34 -- # kill -0 1102494 00:14:28.639 01:15:36 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:28.639 01:15:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:28.639 01:15:36 -- common/autotest_common.sh@10 -- # set +x 00:14:28.898 01:15:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:28.898 01:15:37 -- target/connect_stress.sh@34 -- # kill -0 1102494 00:14:28.898 01:15:37 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:28.898 01:15:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:28.898 01:15:37 -- common/autotest_common.sh@10 -- # set +x 00:14:29.461 01:15:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:29.461 01:15:37 -- target/connect_stress.sh@34 -- # kill -0 1102494 00:14:29.461 01:15:37 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:29.461 01:15:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:29.461 01:15:37 -- common/autotest_common.sh@10 -- # set +x 00:14:29.718 01:15:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:29.718 01:15:37 -- target/connect_stress.sh@34 -- # kill -0 1102494 00:14:29.718 01:15:37 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:29.718 01:15:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:29.718 01:15:37 -- common/autotest_common.sh@10 -- # set +x 00:14:29.975 01:15:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:29.975 01:15:38 -- target/connect_stress.sh@34 -- # kill -0 1102494 00:14:29.975 01:15:38 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:29.975 01:15:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:29.975 01:15:38 -- common/autotest_common.sh@10 -- # set +x 00:14:30.233 01:15:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:30.233 01:15:38 -- target/connect_stress.sh@34 -- # kill -0 1102494 00:14:30.233 01:15:38 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:30.233 01:15:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:30.233 01:15:38 -- common/autotest_common.sh@10 -- # set +x 00:14:30.490 01:15:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:30.490 01:15:38 -- target/connect_stress.sh@34 -- # kill -0 1102494 00:14:30.490 01:15:38 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:30.490 01:15:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:30.490 01:15:38 -- common/autotest_common.sh@10 -- # set +x 00:14:31.055 01:15:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:31.055 01:15:39 -- target/connect_stress.sh@34 -- # kill -0 1102494 00:14:31.055 01:15:39 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:31.055 01:15:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:31.055 01:15:39 -- common/autotest_common.sh@10 -- # set +x 00:14:31.311 01:15:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:31.311 01:15:39 -- target/connect_stress.sh@34 -- # kill -0 1102494 00:14:31.311 01:15:39 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:31.311 01:15:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:31.311 01:15:39 -- common/autotest_common.sh@10 -- # set +x 00:14:31.568 01:15:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:31.568 01:15:39 -- target/connect_stress.sh@34 -- # kill -0 1102494 00:14:31.568 01:15:39 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:31.568 01:15:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:31.568 01:15:39 -- common/autotest_common.sh@10 -- # set +x 00:14:31.826 01:15:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:31.826 01:15:39 -- target/connect_stress.sh@34 -- # kill -0 1102494 00:14:31.826 01:15:39 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:31.826 01:15:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:31.826 01:15:39 -- common/autotest_common.sh@10 -- # set +x 00:14:32.083 01:15:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:32.083 01:15:40 -- target/connect_stress.sh@34 -- # kill -0 1102494 00:14:32.083 01:15:40 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:32.083 01:15:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:32.083 01:15:40 -- common/autotest_common.sh@10 -- # set +x 00:14:32.648 01:15:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:32.648 01:15:40 -- target/connect_stress.sh@34 -- # kill -0 1102494 00:14:32.648 01:15:40 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:32.648 01:15:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:32.648 01:15:40 -- common/autotest_common.sh@10 -- # set +x 00:14:32.906 01:15:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:32.906 01:15:40 -- target/connect_stress.sh@34 -- # kill -0 1102494 00:14:32.906 01:15:40 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:32.906 01:15:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:32.906 01:15:40 -- common/autotest_common.sh@10 -- # set +x 00:14:33.163 01:15:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:33.163 01:15:41 -- target/connect_stress.sh@34 -- # kill -0 1102494 00:14:33.163 01:15:41 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:33.163 01:15:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:33.163 01:15:41 -- common/autotest_common.sh@10 -- # set +x 00:14:33.421 01:15:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:33.421 01:15:41 -- target/connect_stress.sh@34 -- # kill -0 1102494 00:14:33.421 01:15:41 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:33.421 01:15:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:33.421 01:15:41 -- common/autotest_common.sh@10 -- # set +x 00:14:33.986 01:15:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:33.986 01:15:41 -- target/connect_stress.sh@34 -- # kill -0 1102494 00:14:33.986 01:15:41 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:33.986 01:15:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:33.986 01:15:41 -- common/autotest_common.sh@10 -- # set +x 00:14:34.243 01:15:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:34.244 01:15:42 -- target/connect_stress.sh@34 -- # kill -0 1102494 00:14:34.244 01:15:42 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:34.244 01:15:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:34.244 01:15:42 -- common/autotest_common.sh@10 -- # set +x 00:14:34.501 01:15:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:34.501 01:15:42 -- target/connect_stress.sh@34 -- # kill -0 1102494 00:14:34.501 01:15:42 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:34.501 01:15:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:34.501 01:15:42 -- common/autotest_common.sh@10 -- # set +x 00:14:34.759 01:15:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:34.759 01:15:42 -- target/connect_stress.sh@34 -- # kill -0 1102494 00:14:34.759 01:15:42 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:34.759 01:15:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:34.759 01:15:42 -- common/autotest_common.sh@10 -- # set +x 00:14:35.016 01:15:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:35.017 01:15:43 -- target/connect_stress.sh@34 -- # kill -0 1102494 00:14:35.017 01:15:43 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:35.017 01:15:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:35.017 01:15:43 -- common/autotest_common.sh@10 -- # set +x 00:14:35.582 01:15:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:35.582 01:15:43 -- target/connect_stress.sh@34 -- # kill -0 1102494 00:14:35.582 01:15:43 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:35.582 01:15:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:35.582 01:15:43 -- common/autotest_common.sh@10 -- # set +x 00:14:35.840 01:15:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:35.840 01:15:43 -- target/connect_stress.sh@34 -- # kill -0 1102494 00:14:35.840 01:15:43 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:35.840 01:15:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:35.840 01:15:43 -- common/autotest_common.sh@10 -- # set +x 00:14:36.097 01:15:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:36.097 01:15:44 -- target/connect_stress.sh@34 -- # kill -0 1102494 00:14:36.097 01:15:44 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:36.097 01:15:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:36.097 01:15:44 -- common/autotest_common.sh@10 -- # set +x 00:14:36.355 01:15:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:36.355 01:15:44 -- target/connect_stress.sh@34 -- # kill -0 1102494 00:14:36.355 01:15:44 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:36.355 01:15:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:36.355 01:15:44 -- common/autotest_common.sh@10 -- # set +x 00:14:36.612 01:15:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:36.612 01:15:44 -- target/connect_stress.sh@34 -- # kill -0 1102494 00:14:36.612 01:15:44 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:36.612 01:15:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:36.612 01:15:44 -- common/autotest_common.sh@10 -- # set +x 00:14:37.178 01:15:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:37.178 01:15:45 -- target/connect_stress.sh@34 -- # kill -0 1102494 00:14:37.178 01:15:45 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:37.178 01:15:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:37.178 01:15:45 -- common/autotest_common.sh@10 -- # set +x 00:14:37.435 01:15:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:37.435 01:15:45 -- target/connect_stress.sh@34 -- # kill -0 1102494 00:14:37.435 01:15:45 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:37.435 01:15:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:37.435 01:15:45 -- common/autotest_common.sh@10 -- # set +x 00:14:37.693 01:15:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:37.693 01:15:45 -- target/connect_stress.sh@34 -- # kill -0 1102494 00:14:37.693 01:15:45 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:37.693 01:15:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:37.693 01:15:45 -- common/autotest_common.sh@10 -- # set +x 00:14:37.951 01:15:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:37.951 01:15:46 -- target/connect_stress.sh@34 -- # kill -0 1102494 00:14:37.951 01:15:46 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:37.951 01:15:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:37.951 01:15:46 -- common/autotest_common.sh@10 -- # set +x 00:14:38.208 Testing NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:38.208 01:15:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:38.208 01:15:46 -- target/connect_stress.sh@34 -- # kill -0 1102494 00:14:38.208 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (1102494) - No such process 00:14:38.208 01:15:46 -- target/connect_stress.sh@38 -- # wait 1102494 00:14:38.208 01:15:46 -- target/connect_stress.sh@39 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:14:38.208 01:15:46 -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:14:38.208 01:15:46 -- target/connect_stress.sh@43 -- # nvmftestfini 00:14:38.208 01:15:46 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:38.208 01:15:46 -- nvmf/common.sh@116 -- # sync 00:14:38.208 01:15:46 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:38.208 01:15:46 -- nvmf/common.sh@119 -- # set +e 00:14:38.208 01:15:46 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:38.208 01:15:46 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:38.208 rmmod nvme_tcp 00:14:38.466 rmmod nvme_fabrics 00:14:38.466 rmmod nvme_keyring 00:14:38.466 01:15:46 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:38.466 01:15:46 -- nvmf/common.sh@123 -- # set -e 00:14:38.466 01:15:46 -- nvmf/common.sh@124 -- # return 0 00:14:38.466 01:15:46 -- nvmf/common.sh@477 -- # '[' -n 1102335 ']' 00:14:38.466 01:15:46 -- nvmf/common.sh@478 -- # killprocess 1102335 00:14:38.466 01:15:46 -- common/autotest_common.sh@936 -- # '[' -z 1102335 ']' 00:14:38.466 01:15:46 -- common/autotest_common.sh@940 -- # kill -0 1102335 00:14:38.466 01:15:46 -- common/autotest_common.sh@941 -- # uname 00:14:38.466 01:15:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:38.466 01:15:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1102335 00:14:38.466 01:15:46 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:38.466 01:15:46 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:38.466 01:15:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1102335' 00:14:38.466 killing process with pid 1102335 00:14:38.466 01:15:46 -- common/autotest_common.sh@955 -- # kill 1102335 00:14:38.467 01:15:46 -- common/autotest_common.sh@960 -- # wait 1102335 00:14:38.726 01:15:46 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:38.726 01:15:46 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:38.726 01:15:46 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:38.726 01:15:46 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:38.726 01:15:46 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:38.726 01:15:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:38.726 01:15:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:38.726 01:15:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:40.631 01:15:48 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:40.631 00:14:40.631 real 0m16.097s 00:14:40.631 user 0m40.956s 00:14:40.631 sys 0m5.769s 00:14:40.631 01:15:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:40.631 01:15:48 -- common/autotest_common.sh@10 -- # set +x 00:14:40.631 ************************************ 00:14:40.631 END TEST nvmf_connect_stress 00:14:40.631 ************************************ 00:14:40.631 01:15:48 -- nvmf/nvmf.sh@34 -- # run_test nvmf_fused_ordering /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:14:40.631 01:15:48 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:40.631 01:15:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:40.631 01:15:48 -- common/autotest_common.sh@10 -- # set +x 00:14:40.631 ************************************ 00:14:40.631 START TEST nvmf_fused_ordering 00:14:40.631 ************************************ 00:14:40.631 01:15:48 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:14:40.890 * Looking for test storage... 00:14:40.890 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:40.890 01:15:48 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:40.890 01:15:48 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:40.890 01:15:48 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:40.890 01:15:48 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:40.890 01:15:48 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:40.890 01:15:48 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:40.890 01:15:48 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:40.890 01:15:48 -- scripts/common.sh@335 -- # IFS=.-: 00:14:40.890 01:15:48 -- scripts/common.sh@335 -- # read -ra ver1 00:14:40.890 01:15:48 -- scripts/common.sh@336 -- # IFS=.-: 00:14:40.890 01:15:48 -- scripts/common.sh@336 -- # read -ra ver2 00:14:40.890 01:15:48 -- scripts/common.sh@337 -- # local 'op=<' 00:14:40.890 01:15:48 -- scripts/common.sh@339 -- # ver1_l=2 00:14:40.890 01:15:48 -- scripts/common.sh@340 -- # ver2_l=1 00:14:40.890 01:15:48 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:40.890 01:15:48 -- scripts/common.sh@343 -- # case "$op" in 00:14:40.890 01:15:48 -- scripts/common.sh@344 -- # : 1 00:14:40.890 01:15:48 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:40.890 01:15:48 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:40.890 01:15:48 -- scripts/common.sh@364 -- # decimal 1 00:14:40.890 01:15:48 -- scripts/common.sh@352 -- # local d=1 00:14:40.890 01:15:48 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:40.890 01:15:48 -- scripts/common.sh@354 -- # echo 1 00:14:40.891 01:15:48 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:40.891 01:15:48 -- scripts/common.sh@365 -- # decimal 2 00:14:40.891 01:15:48 -- scripts/common.sh@352 -- # local d=2 00:14:40.891 01:15:48 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:40.891 01:15:48 -- scripts/common.sh@354 -- # echo 2 00:14:40.891 01:15:48 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:40.891 01:15:48 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:40.891 01:15:48 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:40.891 01:15:48 -- scripts/common.sh@367 -- # return 0 00:14:40.891 01:15:48 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:40.891 01:15:48 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:40.891 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:40.891 --rc genhtml_branch_coverage=1 00:14:40.891 --rc genhtml_function_coverage=1 00:14:40.891 --rc genhtml_legend=1 00:14:40.891 --rc geninfo_all_blocks=1 00:14:40.891 --rc geninfo_unexecuted_blocks=1 00:14:40.891 00:14:40.891 ' 00:14:40.891 01:15:48 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:40.891 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:40.891 --rc genhtml_branch_coverage=1 00:14:40.891 --rc genhtml_function_coverage=1 00:14:40.891 --rc genhtml_legend=1 00:14:40.891 --rc geninfo_all_blocks=1 00:14:40.891 --rc geninfo_unexecuted_blocks=1 00:14:40.891 00:14:40.891 ' 00:14:40.891 01:15:48 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:40.891 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:40.891 --rc genhtml_branch_coverage=1 00:14:40.891 --rc genhtml_function_coverage=1 00:14:40.891 --rc genhtml_legend=1 00:14:40.891 --rc geninfo_all_blocks=1 00:14:40.891 --rc geninfo_unexecuted_blocks=1 00:14:40.891 00:14:40.891 ' 00:14:40.891 01:15:48 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:40.891 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:40.891 --rc genhtml_branch_coverage=1 00:14:40.891 --rc genhtml_function_coverage=1 00:14:40.891 --rc genhtml_legend=1 00:14:40.891 --rc geninfo_all_blocks=1 00:14:40.891 --rc geninfo_unexecuted_blocks=1 00:14:40.891 00:14:40.891 ' 00:14:40.891 01:15:48 -- target/fused_ordering.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:40.891 01:15:48 -- nvmf/common.sh@7 -- # uname -s 00:14:40.891 01:15:48 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:40.891 01:15:48 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:40.891 01:15:48 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:40.891 01:15:48 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:40.891 01:15:48 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:40.891 01:15:48 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:40.891 01:15:48 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:40.891 01:15:48 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:40.891 01:15:48 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:40.891 01:15:48 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:40.891 01:15:48 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:40.891 01:15:48 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:40.891 01:15:48 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:40.891 01:15:48 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:40.891 01:15:48 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:40.891 01:15:48 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:40.891 01:15:48 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:40.891 01:15:48 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:40.891 01:15:48 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:40.891 01:15:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:40.891 01:15:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:40.891 01:15:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:40.891 01:15:48 -- paths/export.sh@5 -- # export PATH 00:14:40.891 01:15:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:40.891 01:15:48 -- nvmf/common.sh@46 -- # : 0 00:14:40.891 01:15:48 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:40.891 01:15:48 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:40.891 01:15:48 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:40.891 01:15:48 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:40.891 01:15:48 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:40.891 01:15:48 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:40.891 01:15:48 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:40.891 01:15:48 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:40.891 01:15:48 -- target/fused_ordering.sh@12 -- # nvmftestinit 00:14:40.891 01:15:48 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:40.891 01:15:48 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:40.891 01:15:48 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:40.891 01:15:48 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:40.891 01:15:48 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:40.891 01:15:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:40.891 01:15:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:40.891 01:15:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:40.891 01:15:48 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:40.891 01:15:48 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:40.891 01:15:48 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:40.891 01:15:48 -- common/autotest_common.sh@10 -- # set +x 00:14:42.809 01:15:50 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:42.809 01:15:50 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:42.809 01:15:50 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:42.809 01:15:50 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:42.809 01:15:50 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:42.809 01:15:50 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:42.809 01:15:50 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:42.809 01:15:50 -- nvmf/common.sh@294 -- # net_devs=() 00:14:42.809 01:15:50 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:42.809 01:15:50 -- nvmf/common.sh@295 -- # e810=() 00:14:42.809 01:15:50 -- nvmf/common.sh@295 -- # local -ga e810 00:14:42.809 01:15:50 -- nvmf/common.sh@296 -- # x722=() 00:14:42.809 01:15:50 -- nvmf/common.sh@296 -- # local -ga x722 00:14:42.809 01:15:50 -- nvmf/common.sh@297 -- # mlx=() 00:14:42.809 01:15:50 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:42.809 01:15:50 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:42.809 01:15:50 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:42.809 01:15:50 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:42.809 01:15:50 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:42.809 01:15:50 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:42.809 01:15:50 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:42.809 01:15:50 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:42.809 01:15:50 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:42.809 01:15:50 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:42.809 01:15:50 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:42.809 01:15:50 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:42.809 01:15:50 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:42.809 01:15:50 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:42.809 01:15:50 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:42.809 01:15:50 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:42.809 01:15:50 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:42.809 01:15:50 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:42.809 01:15:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:42.809 01:15:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:42.809 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:42.809 01:15:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:42.809 01:15:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:42.809 01:15:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:42.809 01:15:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:42.809 01:15:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:42.809 01:15:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:42.809 01:15:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:42.809 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:42.809 01:15:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:42.809 01:15:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:42.809 01:15:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:42.809 01:15:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:42.809 01:15:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:42.809 01:15:50 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:42.809 01:15:50 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:42.809 01:15:50 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:42.809 01:15:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:42.809 01:15:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:42.809 01:15:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:42.809 01:15:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:42.809 01:15:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:42.809 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:42.809 01:15:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:42.809 01:15:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:42.809 01:15:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:42.809 01:15:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:42.809 01:15:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:42.809 01:15:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:42.809 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:42.809 01:15:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:42.809 01:15:50 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:42.809 01:15:50 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:42.809 01:15:50 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:42.809 01:15:50 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:42.809 01:15:50 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:42.809 01:15:50 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:42.809 01:15:50 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:42.809 01:15:50 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:42.809 01:15:50 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:42.809 01:15:50 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:42.809 01:15:50 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:42.809 01:15:50 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:42.810 01:15:50 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:42.810 01:15:50 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:42.810 01:15:50 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:42.810 01:15:50 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:42.810 01:15:50 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:42.810 01:15:50 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:42.810 01:15:50 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:42.810 01:15:50 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:42.810 01:15:51 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:42.810 01:15:51 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:43.068 01:15:51 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:43.068 01:15:51 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:43.068 01:15:51 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:43.069 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:43.069 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.246 ms 00:14:43.069 00:14:43.069 --- 10.0.0.2 ping statistics --- 00:14:43.069 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:43.069 rtt min/avg/max/mdev = 0.246/0.246/0.246/0.000 ms 00:14:43.069 01:15:51 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:43.069 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:43.069 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.114 ms 00:14:43.069 00:14:43.069 --- 10.0.0.1 ping statistics --- 00:14:43.069 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:43.069 rtt min/avg/max/mdev = 0.114/0.114/0.114/0.000 ms 00:14:43.069 01:15:51 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:43.069 01:15:51 -- nvmf/common.sh@410 -- # return 0 00:14:43.069 01:15:51 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:43.069 01:15:51 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:43.069 01:15:51 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:43.069 01:15:51 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:43.069 01:15:51 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:43.069 01:15:51 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:43.069 01:15:51 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:43.069 01:15:51 -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:14:43.069 01:15:51 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:43.069 01:15:51 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:43.069 01:15:51 -- common/autotest_common.sh@10 -- # set +x 00:14:43.069 01:15:51 -- nvmf/common.sh@469 -- # nvmfpid=1105692 00:14:43.069 01:15:51 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:14:43.069 01:15:51 -- nvmf/common.sh@470 -- # waitforlisten 1105692 00:14:43.069 01:15:51 -- common/autotest_common.sh@829 -- # '[' -z 1105692 ']' 00:14:43.069 01:15:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:43.069 01:15:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:43.069 01:15:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:43.069 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:43.069 01:15:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:43.069 01:15:51 -- common/autotest_common.sh@10 -- # set +x 00:14:43.069 [2024-11-20 01:15:51.137995] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:14:43.069 [2024-11-20 01:15:51.138097] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:43.069 EAL: No free 2048 kB hugepages reported on node 1 00:14:43.069 [2024-11-20 01:15:51.209387] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:43.328 [2024-11-20 01:15:51.300040] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:43.328 [2024-11-20 01:15:51.300229] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:43.328 [2024-11-20 01:15:51.300250] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:43.328 [2024-11-20 01:15:51.300264] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:43.328 [2024-11-20 01:15:51.300301] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:43.894 01:15:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:43.894 01:15:52 -- common/autotest_common.sh@862 -- # return 0 00:14:43.894 01:15:52 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:43.894 01:15:52 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:43.894 01:15:52 -- common/autotest_common.sh@10 -- # set +x 00:14:44.152 01:15:52 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:44.152 01:15:52 -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:44.152 01:15:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:44.152 01:15:52 -- common/autotest_common.sh@10 -- # set +x 00:14:44.152 [2024-11-20 01:15:52.118346] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:44.152 01:15:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:44.152 01:15:52 -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:44.152 01:15:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:44.152 01:15:52 -- common/autotest_common.sh@10 -- # set +x 00:14:44.152 01:15:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:44.152 01:15:52 -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:44.152 01:15:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:44.152 01:15:52 -- common/autotest_common.sh@10 -- # set +x 00:14:44.152 [2024-11-20 01:15:52.134536] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:44.152 01:15:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:44.152 01:15:52 -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:14:44.152 01:15:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:44.152 01:15:52 -- common/autotest_common.sh@10 -- # set +x 00:14:44.152 NULL1 00:14:44.152 01:15:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:44.152 01:15:52 -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:14:44.152 01:15:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:44.152 01:15:52 -- common/autotest_common.sh@10 -- # set +x 00:14:44.152 01:15:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:44.152 01:15:52 -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:14:44.152 01:15:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:44.152 01:15:52 -- common/autotest_common.sh@10 -- # set +x 00:14:44.152 01:15:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:44.152 01:15:52 -- target/fused_ordering.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:14:44.152 [2024-11-20 01:15:52.178568] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:14:44.152 [2024-11-20 01:15:52.178609] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1105848 ] 00:14:44.152 EAL: No free 2048 kB hugepages reported on node 1 00:14:44.718 Attached to nqn.2016-06.io.spdk:cnode1 00:14:44.718 Namespace ID: 1 size: 1GB 00:14:44.718 fused_ordering(0) 00:14:44.718 fused_ordering(1) 00:14:44.718 fused_ordering(2) 00:14:44.718 fused_ordering(3) 00:14:44.718 fused_ordering(4) 00:14:44.718 fused_ordering(5) 00:14:44.718 fused_ordering(6) 00:14:44.718 fused_ordering(7) 00:14:44.718 fused_ordering(8) 00:14:44.718 fused_ordering(9) 00:14:44.718 fused_ordering(10) 00:14:44.718 fused_ordering(11) 00:14:44.718 fused_ordering(12) 00:14:44.718 fused_ordering(13) 00:14:44.718 fused_ordering(14) 00:14:44.718 fused_ordering(15) 00:14:44.718 fused_ordering(16) 00:14:44.718 fused_ordering(17) 00:14:44.718 fused_ordering(18) 00:14:44.718 fused_ordering(19) 00:14:44.718 fused_ordering(20) 00:14:44.718 fused_ordering(21) 00:14:44.718 fused_ordering(22) 00:14:44.718 fused_ordering(23) 00:14:44.718 fused_ordering(24) 00:14:44.718 fused_ordering(25) 00:14:44.718 fused_ordering(26) 00:14:44.718 fused_ordering(27) 00:14:44.718 fused_ordering(28) 00:14:44.718 fused_ordering(29) 00:14:44.718 fused_ordering(30) 00:14:44.718 fused_ordering(31) 00:14:44.718 fused_ordering(32) 00:14:44.718 fused_ordering(33) 00:14:44.718 fused_ordering(34) 00:14:44.718 fused_ordering(35) 00:14:44.718 fused_ordering(36) 00:14:44.718 fused_ordering(37) 00:14:44.718 fused_ordering(38) 00:14:44.718 fused_ordering(39) 00:14:44.718 fused_ordering(40) 00:14:44.718 fused_ordering(41) 00:14:44.718 fused_ordering(42) 00:14:44.718 fused_ordering(43) 00:14:44.718 fused_ordering(44) 00:14:44.718 fused_ordering(45) 00:14:44.718 fused_ordering(46) 00:14:44.718 fused_ordering(47) 00:14:44.718 fused_ordering(48) 00:14:44.718 fused_ordering(49) 00:14:44.718 fused_ordering(50) 00:14:44.718 fused_ordering(51) 00:14:44.718 fused_ordering(52) 00:14:44.718 fused_ordering(53) 00:14:44.718 fused_ordering(54) 00:14:44.718 fused_ordering(55) 00:14:44.718 fused_ordering(56) 00:14:44.718 fused_ordering(57) 00:14:44.718 fused_ordering(58) 00:14:44.718 fused_ordering(59) 00:14:44.718 fused_ordering(60) 00:14:44.718 fused_ordering(61) 00:14:44.718 fused_ordering(62) 00:14:44.718 fused_ordering(63) 00:14:44.718 fused_ordering(64) 00:14:44.718 fused_ordering(65) 00:14:44.718 fused_ordering(66) 00:14:44.718 fused_ordering(67) 00:14:44.718 fused_ordering(68) 00:14:44.718 fused_ordering(69) 00:14:44.718 fused_ordering(70) 00:14:44.718 fused_ordering(71) 00:14:44.718 fused_ordering(72) 00:14:44.718 fused_ordering(73) 00:14:44.718 fused_ordering(74) 00:14:44.718 fused_ordering(75) 00:14:44.718 fused_ordering(76) 00:14:44.718 fused_ordering(77) 00:14:44.718 fused_ordering(78) 00:14:44.718 fused_ordering(79) 00:14:44.718 fused_ordering(80) 00:14:44.718 fused_ordering(81) 00:14:44.718 fused_ordering(82) 00:14:44.718 fused_ordering(83) 00:14:44.718 fused_ordering(84) 00:14:44.718 fused_ordering(85) 00:14:44.718 fused_ordering(86) 00:14:44.718 fused_ordering(87) 00:14:44.718 fused_ordering(88) 00:14:44.718 fused_ordering(89) 00:14:44.718 fused_ordering(90) 00:14:44.718 fused_ordering(91) 00:14:44.718 fused_ordering(92) 00:14:44.718 fused_ordering(93) 00:14:44.718 fused_ordering(94) 00:14:44.718 fused_ordering(95) 00:14:44.718 fused_ordering(96) 00:14:44.718 fused_ordering(97) 00:14:44.718 fused_ordering(98) 00:14:44.718 fused_ordering(99) 00:14:44.718 fused_ordering(100) 00:14:44.718 fused_ordering(101) 00:14:44.718 fused_ordering(102) 00:14:44.718 fused_ordering(103) 00:14:44.718 fused_ordering(104) 00:14:44.718 fused_ordering(105) 00:14:44.718 fused_ordering(106) 00:14:44.718 fused_ordering(107) 00:14:44.718 fused_ordering(108) 00:14:44.718 fused_ordering(109) 00:14:44.718 fused_ordering(110) 00:14:44.718 fused_ordering(111) 00:14:44.718 fused_ordering(112) 00:14:44.718 fused_ordering(113) 00:14:44.718 fused_ordering(114) 00:14:44.718 fused_ordering(115) 00:14:44.718 fused_ordering(116) 00:14:44.718 fused_ordering(117) 00:14:44.718 fused_ordering(118) 00:14:44.718 fused_ordering(119) 00:14:44.718 fused_ordering(120) 00:14:44.718 fused_ordering(121) 00:14:44.718 fused_ordering(122) 00:14:44.718 fused_ordering(123) 00:14:44.718 fused_ordering(124) 00:14:44.718 fused_ordering(125) 00:14:44.718 fused_ordering(126) 00:14:44.718 fused_ordering(127) 00:14:44.718 fused_ordering(128) 00:14:44.718 fused_ordering(129) 00:14:44.718 fused_ordering(130) 00:14:44.718 fused_ordering(131) 00:14:44.718 fused_ordering(132) 00:14:44.718 fused_ordering(133) 00:14:44.718 fused_ordering(134) 00:14:44.718 fused_ordering(135) 00:14:44.718 fused_ordering(136) 00:14:44.718 fused_ordering(137) 00:14:44.718 fused_ordering(138) 00:14:44.718 fused_ordering(139) 00:14:44.718 fused_ordering(140) 00:14:44.718 fused_ordering(141) 00:14:44.718 fused_ordering(142) 00:14:44.718 fused_ordering(143) 00:14:44.718 fused_ordering(144) 00:14:44.718 fused_ordering(145) 00:14:44.718 fused_ordering(146) 00:14:44.718 fused_ordering(147) 00:14:44.718 fused_ordering(148) 00:14:44.718 fused_ordering(149) 00:14:44.718 fused_ordering(150) 00:14:44.718 fused_ordering(151) 00:14:44.718 fused_ordering(152) 00:14:44.718 fused_ordering(153) 00:14:44.718 fused_ordering(154) 00:14:44.718 fused_ordering(155) 00:14:44.718 fused_ordering(156) 00:14:44.718 fused_ordering(157) 00:14:44.718 fused_ordering(158) 00:14:44.718 fused_ordering(159) 00:14:44.718 fused_ordering(160) 00:14:44.718 fused_ordering(161) 00:14:44.718 fused_ordering(162) 00:14:44.718 fused_ordering(163) 00:14:44.718 fused_ordering(164) 00:14:44.718 fused_ordering(165) 00:14:44.718 fused_ordering(166) 00:14:44.718 fused_ordering(167) 00:14:44.718 fused_ordering(168) 00:14:44.718 fused_ordering(169) 00:14:44.718 fused_ordering(170) 00:14:44.718 fused_ordering(171) 00:14:44.718 fused_ordering(172) 00:14:44.718 fused_ordering(173) 00:14:44.718 fused_ordering(174) 00:14:44.718 fused_ordering(175) 00:14:44.718 fused_ordering(176) 00:14:44.718 fused_ordering(177) 00:14:44.718 fused_ordering(178) 00:14:44.718 fused_ordering(179) 00:14:44.718 fused_ordering(180) 00:14:44.718 fused_ordering(181) 00:14:44.718 fused_ordering(182) 00:14:44.718 fused_ordering(183) 00:14:44.718 fused_ordering(184) 00:14:44.718 fused_ordering(185) 00:14:44.718 fused_ordering(186) 00:14:44.718 fused_ordering(187) 00:14:44.718 fused_ordering(188) 00:14:44.718 fused_ordering(189) 00:14:44.718 fused_ordering(190) 00:14:44.718 fused_ordering(191) 00:14:44.718 fused_ordering(192) 00:14:44.718 fused_ordering(193) 00:14:44.718 fused_ordering(194) 00:14:44.718 fused_ordering(195) 00:14:44.718 fused_ordering(196) 00:14:44.718 fused_ordering(197) 00:14:44.719 fused_ordering(198) 00:14:44.719 fused_ordering(199) 00:14:44.719 fused_ordering(200) 00:14:44.719 fused_ordering(201) 00:14:44.719 fused_ordering(202) 00:14:44.719 fused_ordering(203) 00:14:44.719 fused_ordering(204) 00:14:44.719 fused_ordering(205) 00:14:44.977 fused_ordering(206) 00:14:44.977 fused_ordering(207) 00:14:44.977 fused_ordering(208) 00:14:44.977 fused_ordering(209) 00:14:44.977 fused_ordering(210) 00:14:44.977 fused_ordering(211) 00:14:44.977 fused_ordering(212) 00:14:44.977 fused_ordering(213) 00:14:44.977 fused_ordering(214) 00:14:44.977 fused_ordering(215) 00:14:44.977 fused_ordering(216) 00:14:44.977 fused_ordering(217) 00:14:44.977 fused_ordering(218) 00:14:44.977 fused_ordering(219) 00:14:44.977 fused_ordering(220) 00:14:44.977 fused_ordering(221) 00:14:44.977 fused_ordering(222) 00:14:44.977 fused_ordering(223) 00:14:44.977 fused_ordering(224) 00:14:44.977 fused_ordering(225) 00:14:44.977 fused_ordering(226) 00:14:44.977 fused_ordering(227) 00:14:44.977 fused_ordering(228) 00:14:44.977 fused_ordering(229) 00:14:44.977 fused_ordering(230) 00:14:44.977 fused_ordering(231) 00:14:44.977 fused_ordering(232) 00:14:44.977 fused_ordering(233) 00:14:44.977 fused_ordering(234) 00:14:44.977 fused_ordering(235) 00:14:44.977 fused_ordering(236) 00:14:44.977 fused_ordering(237) 00:14:44.977 fused_ordering(238) 00:14:44.977 fused_ordering(239) 00:14:44.977 fused_ordering(240) 00:14:44.977 fused_ordering(241) 00:14:44.977 fused_ordering(242) 00:14:44.977 fused_ordering(243) 00:14:44.977 fused_ordering(244) 00:14:44.977 fused_ordering(245) 00:14:44.977 fused_ordering(246) 00:14:44.977 fused_ordering(247) 00:14:44.977 fused_ordering(248) 00:14:44.977 fused_ordering(249) 00:14:44.977 fused_ordering(250) 00:14:44.977 fused_ordering(251) 00:14:44.977 fused_ordering(252) 00:14:44.977 fused_ordering(253) 00:14:44.977 fused_ordering(254) 00:14:44.977 fused_ordering(255) 00:14:44.977 fused_ordering(256) 00:14:44.977 fused_ordering(257) 00:14:44.977 fused_ordering(258) 00:14:44.977 fused_ordering(259) 00:14:44.977 fused_ordering(260) 00:14:44.977 fused_ordering(261) 00:14:44.977 fused_ordering(262) 00:14:44.977 fused_ordering(263) 00:14:44.977 fused_ordering(264) 00:14:44.977 fused_ordering(265) 00:14:44.977 fused_ordering(266) 00:14:44.977 fused_ordering(267) 00:14:44.977 fused_ordering(268) 00:14:44.977 fused_ordering(269) 00:14:44.977 fused_ordering(270) 00:14:44.977 fused_ordering(271) 00:14:44.977 fused_ordering(272) 00:14:44.977 fused_ordering(273) 00:14:44.977 fused_ordering(274) 00:14:44.977 fused_ordering(275) 00:14:44.977 fused_ordering(276) 00:14:44.977 fused_ordering(277) 00:14:44.977 fused_ordering(278) 00:14:44.977 fused_ordering(279) 00:14:44.977 fused_ordering(280) 00:14:44.977 fused_ordering(281) 00:14:44.977 fused_ordering(282) 00:14:44.977 fused_ordering(283) 00:14:44.977 fused_ordering(284) 00:14:44.977 fused_ordering(285) 00:14:44.977 fused_ordering(286) 00:14:44.977 fused_ordering(287) 00:14:44.977 fused_ordering(288) 00:14:44.977 fused_ordering(289) 00:14:44.977 fused_ordering(290) 00:14:44.977 fused_ordering(291) 00:14:44.977 fused_ordering(292) 00:14:44.977 fused_ordering(293) 00:14:44.977 fused_ordering(294) 00:14:44.977 fused_ordering(295) 00:14:44.977 fused_ordering(296) 00:14:44.977 fused_ordering(297) 00:14:44.977 fused_ordering(298) 00:14:44.977 fused_ordering(299) 00:14:44.977 fused_ordering(300) 00:14:44.977 fused_ordering(301) 00:14:44.977 fused_ordering(302) 00:14:44.977 fused_ordering(303) 00:14:44.977 fused_ordering(304) 00:14:44.977 fused_ordering(305) 00:14:44.977 fused_ordering(306) 00:14:44.977 fused_ordering(307) 00:14:44.977 fused_ordering(308) 00:14:44.977 fused_ordering(309) 00:14:44.977 fused_ordering(310) 00:14:44.977 fused_ordering(311) 00:14:44.977 fused_ordering(312) 00:14:44.977 fused_ordering(313) 00:14:44.977 fused_ordering(314) 00:14:44.977 fused_ordering(315) 00:14:44.977 fused_ordering(316) 00:14:44.977 fused_ordering(317) 00:14:44.977 fused_ordering(318) 00:14:44.977 fused_ordering(319) 00:14:44.977 fused_ordering(320) 00:14:44.977 fused_ordering(321) 00:14:44.977 fused_ordering(322) 00:14:44.977 fused_ordering(323) 00:14:44.977 fused_ordering(324) 00:14:44.977 fused_ordering(325) 00:14:44.977 fused_ordering(326) 00:14:44.977 fused_ordering(327) 00:14:44.977 fused_ordering(328) 00:14:44.977 fused_ordering(329) 00:14:44.977 fused_ordering(330) 00:14:44.977 fused_ordering(331) 00:14:44.977 fused_ordering(332) 00:14:44.977 fused_ordering(333) 00:14:44.977 fused_ordering(334) 00:14:44.977 fused_ordering(335) 00:14:44.977 fused_ordering(336) 00:14:44.977 fused_ordering(337) 00:14:44.977 fused_ordering(338) 00:14:44.977 fused_ordering(339) 00:14:44.977 fused_ordering(340) 00:14:44.977 fused_ordering(341) 00:14:44.977 fused_ordering(342) 00:14:44.977 fused_ordering(343) 00:14:44.977 fused_ordering(344) 00:14:44.977 fused_ordering(345) 00:14:44.977 fused_ordering(346) 00:14:44.977 fused_ordering(347) 00:14:44.977 fused_ordering(348) 00:14:44.977 fused_ordering(349) 00:14:44.977 fused_ordering(350) 00:14:44.977 fused_ordering(351) 00:14:44.977 fused_ordering(352) 00:14:44.977 fused_ordering(353) 00:14:44.977 fused_ordering(354) 00:14:44.977 fused_ordering(355) 00:14:44.977 fused_ordering(356) 00:14:44.977 fused_ordering(357) 00:14:44.977 fused_ordering(358) 00:14:44.977 fused_ordering(359) 00:14:44.977 fused_ordering(360) 00:14:44.977 fused_ordering(361) 00:14:44.977 fused_ordering(362) 00:14:44.977 fused_ordering(363) 00:14:44.977 fused_ordering(364) 00:14:44.977 fused_ordering(365) 00:14:44.977 fused_ordering(366) 00:14:44.977 fused_ordering(367) 00:14:44.977 fused_ordering(368) 00:14:44.977 fused_ordering(369) 00:14:44.977 fused_ordering(370) 00:14:44.977 fused_ordering(371) 00:14:44.977 fused_ordering(372) 00:14:44.977 fused_ordering(373) 00:14:44.977 fused_ordering(374) 00:14:44.977 fused_ordering(375) 00:14:44.977 fused_ordering(376) 00:14:44.977 fused_ordering(377) 00:14:44.977 fused_ordering(378) 00:14:44.977 fused_ordering(379) 00:14:44.977 fused_ordering(380) 00:14:44.977 fused_ordering(381) 00:14:44.977 fused_ordering(382) 00:14:44.977 fused_ordering(383) 00:14:44.977 fused_ordering(384) 00:14:44.977 fused_ordering(385) 00:14:44.977 fused_ordering(386) 00:14:44.977 fused_ordering(387) 00:14:44.977 fused_ordering(388) 00:14:44.977 fused_ordering(389) 00:14:44.977 fused_ordering(390) 00:14:44.977 fused_ordering(391) 00:14:44.977 fused_ordering(392) 00:14:44.977 fused_ordering(393) 00:14:44.977 fused_ordering(394) 00:14:44.978 fused_ordering(395) 00:14:44.978 fused_ordering(396) 00:14:44.978 fused_ordering(397) 00:14:44.978 fused_ordering(398) 00:14:44.978 fused_ordering(399) 00:14:44.978 fused_ordering(400) 00:14:44.978 fused_ordering(401) 00:14:44.978 fused_ordering(402) 00:14:44.978 fused_ordering(403) 00:14:44.978 fused_ordering(404) 00:14:44.978 fused_ordering(405) 00:14:44.978 fused_ordering(406) 00:14:44.978 fused_ordering(407) 00:14:44.978 fused_ordering(408) 00:14:44.978 fused_ordering(409) 00:14:44.978 fused_ordering(410) 00:14:45.235 fused_ordering(411) 00:14:45.235 fused_ordering(412) 00:14:45.235 fused_ordering(413) 00:14:45.235 fused_ordering(414) 00:14:45.235 fused_ordering(415) 00:14:45.235 fused_ordering(416) 00:14:45.235 fused_ordering(417) 00:14:45.235 fused_ordering(418) 00:14:45.235 fused_ordering(419) 00:14:45.235 fused_ordering(420) 00:14:45.235 fused_ordering(421) 00:14:45.235 fused_ordering(422) 00:14:45.235 fused_ordering(423) 00:14:45.235 fused_ordering(424) 00:14:45.235 fused_ordering(425) 00:14:45.235 fused_ordering(426) 00:14:45.235 fused_ordering(427) 00:14:45.235 fused_ordering(428) 00:14:45.235 fused_ordering(429) 00:14:45.235 fused_ordering(430) 00:14:45.235 fused_ordering(431) 00:14:45.235 fused_ordering(432) 00:14:45.235 fused_ordering(433) 00:14:45.235 fused_ordering(434) 00:14:45.235 fused_ordering(435) 00:14:45.235 fused_ordering(436) 00:14:45.235 fused_ordering(437) 00:14:45.235 fused_ordering(438) 00:14:45.235 fused_ordering(439) 00:14:45.235 fused_ordering(440) 00:14:45.235 fused_ordering(441) 00:14:45.235 fused_ordering(442) 00:14:45.235 fused_ordering(443) 00:14:45.235 fused_ordering(444) 00:14:45.235 fused_ordering(445) 00:14:45.235 fused_ordering(446) 00:14:45.236 fused_ordering(447) 00:14:45.236 fused_ordering(448) 00:14:45.236 fused_ordering(449) 00:14:45.236 fused_ordering(450) 00:14:45.236 fused_ordering(451) 00:14:45.236 fused_ordering(452) 00:14:45.236 fused_ordering(453) 00:14:45.236 fused_ordering(454) 00:14:45.236 fused_ordering(455) 00:14:45.236 fused_ordering(456) 00:14:45.236 fused_ordering(457) 00:14:45.236 fused_ordering(458) 00:14:45.236 fused_ordering(459) 00:14:45.236 fused_ordering(460) 00:14:45.236 fused_ordering(461) 00:14:45.236 fused_ordering(462) 00:14:45.236 fused_ordering(463) 00:14:45.236 fused_ordering(464) 00:14:45.236 fused_ordering(465) 00:14:45.236 fused_ordering(466) 00:14:45.236 fused_ordering(467) 00:14:45.236 fused_ordering(468) 00:14:45.236 fused_ordering(469) 00:14:45.236 fused_ordering(470) 00:14:45.236 fused_ordering(471) 00:14:45.236 fused_ordering(472) 00:14:45.236 fused_ordering(473) 00:14:45.236 fused_ordering(474) 00:14:45.236 fused_ordering(475) 00:14:45.236 fused_ordering(476) 00:14:45.236 fused_ordering(477) 00:14:45.236 fused_ordering(478) 00:14:45.236 fused_ordering(479) 00:14:45.236 fused_ordering(480) 00:14:45.236 fused_ordering(481) 00:14:45.236 fused_ordering(482) 00:14:45.236 fused_ordering(483) 00:14:45.236 fused_ordering(484) 00:14:45.236 fused_ordering(485) 00:14:45.236 fused_ordering(486) 00:14:45.236 fused_ordering(487) 00:14:45.236 fused_ordering(488) 00:14:45.236 fused_ordering(489) 00:14:45.236 fused_ordering(490) 00:14:45.236 fused_ordering(491) 00:14:45.236 fused_ordering(492) 00:14:45.236 fused_ordering(493) 00:14:45.236 fused_ordering(494) 00:14:45.236 fused_ordering(495) 00:14:45.236 fused_ordering(496) 00:14:45.236 fused_ordering(497) 00:14:45.236 fused_ordering(498) 00:14:45.236 fused_ordering(499) 00:14:45.236 fused_ordering(500) 00:14:45.236 fused_ordering(501) 00:14:45.236 fused_ordering(502) 00:14:45.236 fused_ordering(503) 00:14:45.236 fused_ordering(504) 00:14:45.236 fused_ordering(505) 00:14:45.236 fused_ordering(506) 00:14:45.236 fused_ordering(507) 00:14:45.236 fused_ordering(508) 00:14:45.236 fused_ordering(509) 00:14:45.236 fused_ordering(510) 00:14:45.236 fused_ordering(511) 00:14:45.236 fused_ordering(512) 00:14:45.236 fused_ordering(513) 00:14:45.236 fused_ordering(514) 00:14:45.236 fused_ordering(515) 00:14:45.236 fused_ordering(516) 00:14:45.236 fused_ordering(517) 00:14:45.236 fused_ordering(518) 00:14:45.236 fused_ordering(519) 00:14:45.236 fused_ordering(520) 00:14:45.236 fused_ordering(521) 00:14:45.236 fused_ordering(522) 00:14:45.236 fused_ordering(523) 00:14:45.236 fused_ordering(524) 00:14:45.236 fused_ordering(525) 00:14:45.236 fused_ordering(526) 00:14:45.236 fused_ordering(527) 00:14:45.236 fused_ordering(528) 00:14:45.236 fused_ordering(529) 00:14:45.236 fused_ordering(530) 00:14:45.236 fused_ordering(531) 00:14:45.236 fused_ordering(532) 00:14:45.236 fused_ordering(533) 00:14:45.236 fused_ordering(534) 00:14:45.236 fused_ordering(535) 00:14:45.236 fused_ordering(536) 00:14:45.236 fused_ordering(537) 00:14:45.236 fused_ordering(538) 00:14:45.236 fused_ordering(539) 00:14:45.236 fused_ordering(540) 00:14:45.236 fused_ordering(541) 00:14:45.236 fused_ordering(542) 00:14:45.236 fused_ordering(543) 00:14:45.236 fused_ordering(544) 00:14:45.236 fused_ordering(545) 00:14:45.236 fused_ordering(546) 00:14:45.236 fused_ordering(547) 00:14:45.236 fused_ordering(548) 00:14:45.236 fused_ordering(549) 00:14:45.236 fused_ordering(550) 00:14:45.236 fused_ordering(551) 00:14:45.236 fused_ordering(552) 00:14:45.236 fused_ordering(553) 00:14:45.236 fused_ordering(554) 00:14:45.236 fused_ordering(555) 00:14:45.236 fused_ordering(556) 00:14:45.236 fused_ordering(557) 00:14:45.236 fused_ordering(558) 00:14:45.236 fused_ordering(559) 00:14:45.236 fused_ordering(560) 00:14:45.236 fused_ordering(561) 00:14:45.236 fused_ordering(562) 00:14:45.236 fused_ordering(563) 00:14:45.236 fused_ordering(564) 00:14:45.236 fused_ordering(565) 00:14:45.236 fused_ordering(566) 00:14:45.236 fused_ordering(567) 00:14:45.236 fused_ordering(568) 00:14:45.236 fused_ordering(569) 00:14:45.236 fused_ordering(570) 00:14:45.236 fused_ordering(571) 00:14:45.236 fused_ordering(572) 00:14:45.236 fused_ordering(573) 00:14:45.236 fused_ordering(574) 00:14:45.236 fused_ordering(575) 00:14:45.236 fused_ordering(576) 00:14:45.236 fused_ordering(577) 00:14:45.236 fused_ordering(578) 00:14:45.236 fused_ordering(579) 00:14:45.236 fused_ordering(580) 00:14:45.236 fused_ordering(581) 00:14:45.236 fused_ordering(582) 00:14:45.236 fused_ordering(583) 00:14:45.236 fused_ordering(584) 00:14:45.236 fused_ordering(585) 00:14:45.236 fused_ordering(586) 00:14:45.236 fused_ordering(587) 00:14:45.236 fused_ordering(588) 00:14:45.236 fused_ordering(589) 00:14:45.236 fused_ordering(590) 00:14:45.236 fused_ordering(591) 00:14:45.236 fused_ordering(592) 00:14:45.236 fused_ordering(593) 00:14:45.236 fused_ordering(594) 00:14:45.236 fused_ordering(595) 00:14:45.236 fused_ordering(596) 00:14:45.236 fused_ordering(597) 00:14:45.236 fused_ordering(598) 00:14:45.236 fused_ordering(599) 00:14:45.236 fused_ordering(600) 00:14:45.236 fused_ordering(601) 00:14:45.236 fused_ordering(602) 00:14:45.236 fused_ordering(603) 00:14:45.236 fused_ordering(604) 00:14:45.236 fused_ordering(605) 00:14:45.236 fused_ordering(606) 00:14:45.236 fused_ordering(607) 00:14:45.236 fused_ordering(608) 00:14:45.236 fused_ordering(609) 00:14:45.236 fused_ordering(610) 00:14:45.236 fused_ordering(611) 00:14:45.236 fused_ordering(612) 00:14:45.236 fused_ordering(613) 00:14:45.236 fused_ordering(614) 00:14:45.236 fused_ordering(615) 00:14:45.802 fused_ordering(616) 00:14:45.802 fused_ordering(617) 00:14:45.802 fused_ordering(618) 00:14:45.802 fused_ordering(619) 00:14:45.802 fused_ordering(620) 00:14:45.802 fused_ordering(621) 00:14:45.802 fused_ordering(622) 00:14:45.802 fused_ordering(623) 00:14:45.802 fused_ordering(624) 00:14:45.802 fused_ordering(625) 00:14:45.802 fused_ordering(626) 00:14:45.802 fused_ordering(627) 00:14:45.802 fused_ordering(628) 00:14:45.802 fused_ordering(629) 00:14:45.802 fused_ordering(630) 00:14:45.802 fused_ordering(631) 00:14:45.802 fused_ordering(632) 00:14:45.802 fused_ordering(633) 00:14:45.802 fused_ordering(634) 00:14:45.802 fused_ordering(635) 00:14:45.803 fused_ordering(636) 00:14:45.803 fused_ordering(637) 00:14:45.803 fused_ordering(638) 00:14:45.803 fused_ordering(639) 00:14:45.803 fused_ordering(640) 00:14:45.803 fused_ordering(641) 00:14:45.803 fused_ordering(642) 00:14:45.803 fused_ordering(643) 00:14:45.803 fused_ordering(644) 00:14:45.803 fused_ordering(645) 00:14:45.803 fused_ordering(646) 00:14:45.803 fused_ordering(647) 00:14:45.803 fused_ordering(648) 00:14:45.803 fused_ordering(649) 00:14:45.803 fused_ordering(650) 00:14:45.803 fused_ordering(651) 00:14:45.803 fused_ordering(652) 00:14:45.803 fused_ordering(653) 00:14:45.803 fused_ordering(654) 00:14:45.803 fused_ordering(655) 00:14:45.803 fused_ordering(656) 00:14:45.803 fused_ordering(657) 00:14:45.803 fused_ordering(658) 00:14:45.803 fused_ordering(659) 00:14:45.803 fused_ordering(660) 00:14:45.803 fused_ordering(661) 00:14:45.803 fused_ordering(662) 00:14:45.803 fused_ordering(663) 00:14:45.803 fused_ordering(664) 00:14:45.803 fused_ordering(665) 00:14:45.803 fused_ordering(666) 00:14:45.803 fused_ordering(667) 00:14:45.803 fused_ordering(668) 00:14:45.803 fused_ordering(669) 00:14:45.803 fused_ordering(670) 00:14:45.803 fused_ordering(671) 00:14:45.803 fused_ordering(672) 00:14:45.803 fused_ordering(673) 00:14:45.803 fused_ordering(674) 00:14:45.803 fused_ordering(675) 00:14:45.803 fused_ordering(676) 00:14:45.803 fused_ordering(677) 00:14:45.803 fused_ordering(678) 00:14:45.803 fused_ordering(679) 00:14:45.803 fused_ordering(680) 00:14:45.803 fused_ordering(681) 00:14:45.803 fused_ordering(682) 00:14:45.803 fused_ordering(683) 00:14:45.803 fused_ordering(684) 00:14:45.803 fused_ordering(685) 00:14:45.803 fused_ordering(686) 00:14:45.803 fused_ordering(687) 00:14:45.803 fused_ordering(688) 00:14:45.803 fused_ordering(689) 00:14:45.803 fused_ordering(690) 00:14:45.803 fused_ordering(691) 00:14:45.803 fused_ordering(692) 00:14:45.803 fused_ordering(693) 00:14:45.803 fused_ordering(694) 00:14:45.803 fused_ordering(695) 00:14:45.803 fused_ordering(696) 00:14:45.803 fused_ordering(697) 00:14:45.803 fused_ordering(698) 00:14:45.803 fused_ordering(699) 00:14:45.803 fused_ordering(700) 00:14:45.803 fused_ordering(701) 00:14:45.803 fused_ordering(702) 00:14:45.803 fused_ordering(703) 00:14:45.803 fused_ordering(704) 00:14:45.803 fused_ordering(705) 00:14:45.803 fused_ordering(706) 00:14:45.803 fused_ordering(707) 00:14:45.803 fused_ordering(708) 00:14:45.803 fused_ordering(709) 00:14:45.803 fused_ordering(710) 00:14:45.803 fused_ordering(711) 00:14:45.803 fused_ordering(712) 00:14:45.803 fused_ordering(713) 00:14:45.803 fused_ordering(714) 00:14:45.803 fused_ordering(715) 00:14:45.803 fused_ordering(716) 00:14:45.803 fused_ordering(717) 00:14:45.803 fused_ordering(718) 00:14:45.803 fused_ordering(719) 00:14:45.803 fused_ordering(720) 00:14:45.803 fused_ordering(721) 00:14:45.803 fused_ordering(722) 00:14:45.803 fused_ordering(723) 00:14:45.803 fused_ordering(724) 00:14:45.803 fused_ordering(725) 00:14:45.803 fused_ordering(726) 00:14:45.803 fused_ordering(727) 00:14:45.803 fused_ordering(728) 00:14:45.803 fused_ordering(729) 00:14:45.803 fused_ordering(730) 00:14:45.803 fused_ordering(731) 00:14:45.803 fused_ordering(732) 00:14:45.803 fused_ordering(733) 00:14:45.803 fused_ordering(734) 00:14:45.803 fused_ordering(735) 00:14:45.803 fused_ordering(736) 00:14:45.803 fused_ordering(737) 00:14:45.803 fused_ordering(738) 00:14:45.803 fused_ordering(739) 00:14:45.803 fused_ordering(740) 00:14:45.803 fused_ordering(741) 00:14:45.803 fused_ordering(742) 00:14:45.803 fused_ordering(743) 00:14:45.803 fused_ordering(744) 00:14:45.803 fused_ordering(745) 00:14:45.803 fused_ordering(746) 00:14:45.803 fused_ordering(747) 00:14:45.803 fused_ordering(748) 00:14:45.803 fused_ordering(749) 00:14:45.803 fused_ordering(750) 00:14:45.803 fused_ordering(751) 00:14:45.803 fused_ordering(752) 00:14:45.803 fused_ordering(753) 00:14:45.803 fused_ordering(754) 00:14:45.803 fused_ordering(755) 00:14:45.803 fused_ordering(756) 00:14:45.803 fused_ordering(757) 00:14:45.803 fused_ordering(758) 00:14:45.803 fused_ordering(759) 00:14:45.803 fused_ordering(760) 00:14:45.803 fused_ordering(761) 00:14:45.803 fused_ordering(762) 00:14:45.803 fused_ordering(763) 00:14:45.803 fused_ordering(764) 00:14:45.803 fused_ordering(765) 00:14:45.803 fused_ordering(766) 00:14:45.803 fused_ordering(767) 00:14:45.803 fused_ordering(768) 00:14:45.803 fused_ordering(769) 00:14:45.803 fused_ordering(770) 00:14:45.803 fused_ordering(771) 00:14:45.803 fused_ordering(772) 00:14:45.803 fused_ordering(773) 00:14:45.803 fused_ordering(774) 00:14:45.803 fused_ordering(775) 00:14:45.803 fused_ordering(776) 00:14:45.803 fused_ordering(777) 00:14:45.803 fused_ordering(778) 00:14:45.803 fused_ordering(779) 00:14:45.803 fused_ordering(780) 00:14:45.803 fused_ordering(781) 00:14:45.803 fused_ordering(782) 00:14:45.803 fused_ordering(783) 00:14:45.803 fused_ordering(784) 00:14:45.803 fused_ordering(785) 00:14:45.803 fused_ordering(786) 00:14:45.803 fused_ordering(787) 00:14:45.803 fused_ordering(788) 00:14:45.803 fused_ordering(789) 00:14:45.803 fused_ordering(790) 00:14:45.803 fused_ordering(791) 00:14:45.803 fused_ordering(792) 00:14:45.803 fused_ordering(793) 00:14:45.803 fused_ordering(794) 00:14:45.803 fused_ordering(795) 00:14:45.803 fused_ordering(796) 00:14:45.803 fused_ordering(797) 00:14:45.803 fused_ordering(798) 00:14:45.803 fused_ordering(799) 00:14:45.803 fused_ordering(800) 00:14:45.803 fused_ordering(801) 00:14:45.803 fused_ordering(802) 00:14:45.803 fused_ordering(803) 00:14:45.803 fused_ordering(804) 00:14:45.803 fused_ordering(805) 00:14:45.803 fused_ordering(806) 00:14:45.803 fused_ordering(807) 00:14:45.803 fused_ordering(808) 00:14:45.803 fused_ordering(809) 00:14:45.803 fused_ordering(810) 00:14:45.803 fused_ordering(811) 00:14:45.803 fused_ordering(812) 00:14:45.803 fused_ordering(813) 00:14:45.803 fused_ordering(814) 00:14:45.803 fused_ordering(815) 00:14:45.803 fused_ordering(816) 00:14:45.803 fused_ordering(817) 00:14:45.803 fused_ordering(818) 00:14:45.803 fused_ordering(819) 00:14:45.803 fused_ordering(820) 00:14:46.768 fused_ordering(821) 00:14:46.768 fused_ordering(822) 00:14:46.768 fused_ordering(823) 00:14:46.768 fused_ordering(824) 00:14:46.768 fused_ordering(825) 00:14:46.768 fused_ordering(826) 00:14:46.768 fused_ordering(827) 00:14:46.768 fused_ordering(828) 00:14:46.768 fused_ordering(829) 00:14:46.768 fused_ordering(830) 00:14:46.768 fused_ordering(831) 00:14:46.768 fused_ordering(832) 00:14:46.768 fused_ordering(833) 00:14:46.768 fused_ordering(834) 00:14:46.768 fused_ordering(835) 00:14:46.768 fused_ordering(836) 00:14:46.768 fused_ordering(837) 00:14:46.768 fused_ordering(838) 00:14:46.768 fused_ordering(839) 00:14:46.768 fused_ordering(840) 00:14:46.768 fused_ordering(841) 00:14:46.768 fused_ordering(842) 00:14:46.768 fused_ordering(843) 00:14:46.768 fused_ordering(844) 00:14:46.768 fused_ordering(845) 00:14:46.768 fused_ordering(846) 00:14:46.768 fused_ordering(847) 00:14:46.768 fused_ordering(848) 00:14:46.768 fused_ordering(849) 00:14:46.768 fused_ordering(850) 00:14:46.768 fused_ordering(851) 00:14:46.768 fused_ordering(852) 00:14:46.768 fused_ordering(853) 00:14:46.768 fused_ordering(854) 00:14:46.768 fused_ordering(855) 00:14:46.768 fused_ordering(856) 00:14:46.768 fused_ordering(857) 00:14:46.768 fused_ordering(858) 00:14:46.768 fused_ordering(859) 00:14:46.768 fused_ordering(860) 00:14:46.768 fused_ordering(861) 00:14:46.768 fused_ordering(862) 00:14:46.768 fused_ordering(863) 00:14:46.768 fused_ordering(864) 00:14:46.768 fused_ordering(865) 00:14:46.768 fused_ordering(866) 00:14:46.768 fused_ordering(867) 00:14:46.768 fused_ordering(868) 00:14:46.768 fused_ordering(869) 00:14:46.768 fused_ordering(870) 00:14:46.768 fused_ordering(871) 00:14:46.768 fused_ordering(872) 00:14:46.768 fused_ordering(873) 00:14:46.768 fused_ordering(874) 00:14:46.768 fused_ordering(875) 00:14:46.768 fused_ordering(876) 00:14:46.768 fused_ordering(877) 00:14:46.768 fused_ordering(878) 00:14:46.768 fused_ordering(879) 00:14:46.768 fused_ordering(880) 00:14:46.768 fused_ordering(881) 00:14:46.768 fused_ordering(882) 00:14:46.768 fused_ordering(883) 00:14:46.768 fused_ordering(884) 00:14:46.768 fused_ordering(885) 00:14:46.768 fused_ordering(886) 00:14:46.768 fused_ordering(887) 00:14:46.768 fused_ordering(888) 00:14:46.768 fused_ordering(889) 00:14:46.768 fused_ordering(890) 00:14:46.768 fused_ordering(891) 00:14:46.768 fused_ordering(892) 00:14:46.768 fused_ordering(893) 00:14:46.768 fused_ordering(894) 00:14:46.768 fused_ordering(895) 00:14:46.768 fused_ordering(896) 00:14:46.768 fused_ordering(897) 00:14:46.768 fused_ordering(898) 00:14:46.768 fused_ordering(899) 00:14:46.768 fused_ordering(900) 00:14:46.768 fused_ordering(901) 00:14:46.768 fused_ordering(902) 00:14:46.768 fused_ordering(903) 00:14:46.768 fused_ordering(904) 00:14:46.768 fused_ordering(905) 00:14:46.768 fused_ordering(906) 00:14:46.768 fused_ordering(907) 00:14:46.768 fused_ordering(908) 00:14:46.768 fused_ordering(909) 00:14:46.768 fused_ordering(910) 00:14:46.768 fused_ordering(911) 00:14:46.768 fused_ordering(912) 00:14:46.768 fused_ordering(913) 00:14:46.768 fused_ordering(914) 00:14:46.768 fused_ordering(915) 00:14:46.768 fused_ordering(916) 00:14:46.768 fused_ordering(917) 00:14:46.768 fused_ordering(918) 00:14:46.768 fused_ordering(919) 00:14:46.768 fused_ordering(920) 00:14:46.768 fused_ordering(921) 00:14:46.768 fused_ordering(922) 00:14:46.768 fused_ordering(923) 00:14:46.768 fused_ordering(924) 00:14:46.768 fused_ordering(925) 00:14:46.768 fused_ordering(926) 00:14:46.768 fused_ordering(927) 00:14:46.768 fused_ordering(928) 00:14:46.768 fused_ordering(929) 00:14:46.768 fused_ordering(930) 00:14:46.768 fused_ordering(931) 00:14:46.768 fused_ordering(932) 00:14:46.768 fused_ordering(933) 00:14:46.768 fused_ordering(934) 00:14:46.768 fused_ordering(935) 00:14:46.768 fused_ordering(936) 00:14:46.768 fused_ordering(937) 00:14:46.768 fused_ordering(938) 00:14:46.768 fused_ordering(939) 00:14:46.768 fused_ordering(940) 00:14:46.768 fused_ordering(941) 00:14:46.768 fused_ordering(942) 00:14:46.768 fused_ordering(943) 00:14:46.768 fused_ordering(944) 00:14:46.768 fused_ordering(945) 00:14:46.768 fused_ordering(946) 00:14:46.768 fused_ordering(947) 00:14:46.768 fused_ordering(948) 00:14:46.768 fused_ordering(949) 00:14:46.768 fused_ordering(950) 00:14:46.768 fused_ordering(951) 00:14:46.768 fused_ordering(952) 00:14:46.768 fused_ordering(953) 00:14:46.768 fused_ordering(954) 00:14:46.768 fused_ordering(955) 00:14:46.768 fused_ordering(956) 00:14:46.768 fused_ordering(957) 00:14:46.768 fused_ordering(958) 00:14:46.768 fused_ordering(959) 00:14:46.768 fused_ordering(960) 00:14:46.768 fused_ordering(961) 00:14:46.768 fused_ordering(962) 00:14:46.768 fused_ordering(963) 00:14:46.768 fused_ordering(964) 00:14:46.768 fused_ordering(965) 00:14:46.768 fused_ordering(966) 00:14:46.768 fused_ordering(967) 00:14:46.768 fused_ordering(968) 00:14:46.768 fused_ordering(969) 00:14:46.768 fused_ordering(970) 00:14:46.768 fused_ordering(971) 00:14:46.768 fused_ordering(972) 00:14:46.768 fused_ordering(973) 00:14:46.768 fused_ordering(974) 00:14:46.768 fused_ordering(975) 00:14:46.768 fused_ordering(976) 00:14:46.768 fused_ordering(977) 00:14:46.768 fused_ordering(978) 00:14:46.768 fused_ordering(979) 00:14:46.768 fused_ordering(980) 00:14:46.768 fused_ordering(981) 00:14:46.768 fused_ordering(982) 00:14:46.768 fused_ordering(983) 00:14:46.768 fused_ordering(984) 00:14:46.768 fused_ordering(985) 00:14:46.768 fused_ordering(986) 00:14:46.768 fused_ordering(987) 00:14:46.769 fused_ordering(988) 00:14:46.769 fused_ordering(989) 00:14:46.769 fused_ordering(990) 00:14:46.769 fused_ordering(991) 00:14:46.769 fused_ordering(992) 00:14:46.769 fused_ordering(993) 00:14:46.769 fused_ordering(994) 00:14:46.769 fused_ordering(995) 00:14:46.769 fused_ordering(996) 00:14:46.769 fused_ordering(997) 00:14:46.769 fused_ordering(998) 00:14:46.769 fused_ordering(999) 00:14:46.769 fused_ordering(1000) 00:14:46.769 fused_ordering(1001) 00:14:46.769 fused_ordering(1002) 00:14:46.769 fused_ordering(1003) 00:14:46.769 fused_ordering(1004) 00:14:46.769 fused_ordering(1005) 00:14:46.769 fused_ordering(1006) 00:14:46.769 fused_ordering(1007) 00:14:46.769 fused_ordering(1008) 00:14:46.769 fused_ordering(1009) 00:14:46.769 fused_ordering(1010) 00:14:46.769 fused_ordering(1011) 00:14:46.769 fused_ordering(1012) 00:14:46.769 fused_ordering(1013) 00:14:46.769 fused_ordering(1014) 00:14:46.769 fused_ordering(1015) 00:14:46.769 fused_ordering(1016) 00:14:46.769 fused_ordering(1017) 00:14:46.769 fused_ordering(1018) 00:14:46.769 fused_ordering(1019) 00:14:46.769 fused_ordering(1020) 00:14:46.769 fused_ordering(1021) 00:14:46.769 fused_ordering(1022) 00:14:46.769 fused_ordering(1023) 00:14:46.769 01:15:54 -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:14:46.769 01:15:54 -- target/fused_ordering.sh@25 -- # nvmftestfini 00:14:46.769 01:15:54 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:46.769 01:15:54 -- nvmf/common.sh@116 -- # sync 00:14:46.769 01:15:54 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:46.769 01:15:54 -- nvmf/common.sh@119 -- # set +e 00:14:46.769 01:15:54 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:46.769 01:15:54 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:46.769 rmmod nvme_tcp 00:14:46.769 rmmod nvme_fabrics 00:14:46.769 rmmod nvme_keyring 00:14:46.769 01:15:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:46.769 01:15:54 -- nvmf/common.sh@123 -- # set -e 00:14:46.769 01:15:54 -- nvmf/common.sh@124 -- # return 0 00:14:46.769 01:15:54 -- nvmf/common.sh@477 -- # '[' -n 1105692 ']' 00:14:46.769 01:15:54 -- nvmf/common.sh@478 -- # killprocess 1105692 00:14:46.769 01:15:54 -- common/autotest_common.sh@936 -- # '[' -z 1105692 ']' 00:14:46.769 01:15:54 -- common/autotest_common.sh@940 -- # kill -0 1105692 00:14:46.769 01:15:54 -- common/autotest_common.sh@941 -- # uname 00:14:46.769 01:15:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:46.769 01:15:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1105692 00:14:46.769 01:15:54 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:46.769 01:15:54 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:46.769 01:15:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1105692' 00:14:46.769 killing process with pid 1105692 00:14:46.769 01:15:54 -- common/autotest_common.sh@955 -- # kill 1105692 00:14:46.769 01:15:54 -- common/autotest_common.sh@960 -- # wait 1105692 00:14:47.058 01:15:54 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:47.058 01:15:54 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:47.058 01:15:54 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:47.058 01:15:54 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:47.058 01:15:54 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:47.058 01:15:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:47.058 01:15:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:47.058 01:15:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:48.962 01:15:57 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:48.962 00:14:48.962 real 0m8.219s 00:14:48.962 user 0m5.486s 00:14:48.962 sys 0m3.452s 00:14:48.962 01:15:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:48.962 01:15:57 -- common/autotest_common.sh@10 -- # set +x 00:14:48.962 ************************************ 00:14:48.962 END TEST nvmf_fused_ordering 00:14:48.962 ************************************ 00:14:48.962 01:15:57 -- nvmf/nvmf.sh@35 -- # run_test nvmf_delete_subsystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:14:48.962 01:15:57 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:48.962 01:15:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:48.962 01:15:57 -- common/autotest_common.sh@10 -- # set +x 00:14:48.962 ************************************ 00:14:48.962 START TEST nvmf_delete_subsystem 00:14:48.962 ************************************ 00:14:48.962 01:15:57 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:14:48.962 * Looking for test storage... 00:14:48.962 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:48.962 01:15:57 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:48.962 01:15:57 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:48.962 01:15:57 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:48.962 01:15:57 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:48.962 01:15:57 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:48.962 01:15:57 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:48.962 01:15:57 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:48.962 01:15:57 -- scripts/common.sh@335 -- # IFS=.-: 00:14:48.962 01:15:57 -- scripts/common.sh@335 -- # read -ra ver1 00:14:48.962 01:15:57 -- scripts/common.sh@336 -- # IFS=.-: 00:14:48.962 01:15:57 -- scripts/common.sh@336 -- # read -ra ver2 00:14:48.962 01:15:57 -- scripts/common.sh@337 -- # local 'op=<' 00:14:48.962 01:15:57 -- scripts/common.sh@339 -- # ver1_l=2 00:14:48.962 01:15:57 -- scripts/common.sh@340 -- # ver2_l=1 00:14:48.962 01:15:57 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:48.962 01:15:57 -- scripts/common.sh@343 -- # case "$op" in 00:14:48.962 01:15:57 -- scripts/common.sh@344 -- # : 1 00:14:48.962 01:15:57 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:48.962 01:15:57 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:49.221 01:15:57 -- scripts/common.sh@364 -- # decimal 1 00:14:49.221 01:15:57 -- scripts/common.sh@352 -- # local d=1 00:14:49.221 01:15:57 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:49.221 01:15:57 -- scripts/common.sh@354 -- # echo 1 00:14:49.221 01:15:57 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:49.221 01:15:57 -- scripts/common.sh@365 -- # decimal 2 00:14:49.221 01:15:57 -- scripts/common.sh@352 -- # local d=2 00:14:49.221 01:15:57 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:49.221 01:15:57 -- scripts/common.sh@354 -- # echo 2 00:14:49.221 01:15:57 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:49.221 01:15:57 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:49.221 01:15:57 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:49.221 01:15:57 -- scripts/common.sh@367 -- # return 0 00:14:49.221 01:15:57 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:49.221 01:15:57 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:49.221 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:49.221 --rc genhtml_branch_coverage=1 00:14:49.221 --rc genhtml_function_coverage=1 00:14:49.221 --rc genhtml_legend=1 00:14:49.221 --rc geninfo_all_blocks=1 00:14:49.221 --rc geninfo_unexecuted_blocks=1 00:14:49.221 00:14:49.221 ' 00:14:49.221 01:15:57 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:49.221 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:49.221 --rc genhtml_branch_coverage=1 00:14:49.221 --rc genhtml_function_coverage=1 00:14:49.221 --rc genhtml_legend=1 00:14:49.221 --rc geninfo_all_blocks=1 00:14:49.221 --rc geninfo_unexecuted_blocks=1 00:14:49.221 00:14:49.221 ' 00:14:49.221 01:15:57 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:49.221 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:49.221 --rc genhtml_branch_coverage=1 00:14:49.221 --rc genhtml_function_coverage=1 00:14:49.221 --rc genhtml_legend=1 00:14:49.221 --rc geninfo_all_blocks=1 00:14:49.221 --rc geninfo_unexecuted_blocks=1 00:14:49.221 00:14:49.221 ' 00:14:49.221 01:15:57 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:49.221 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:49.221 --rc genhtml_branch_coverage=1 00:14:49.221 --rc genhtml_function_coverage=1 00:14:49.221 --rc genhtml_legend=1 00:14:49.221 --rc geninfo_all_blocks=1 00:14:49.221 --rc geninfo_unexecuted_blocks=1 00:14:49.221 00:14:49.221 ' 00:14:49.221 01:15:57 -- target/delete_subsystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:49.221 01:15:57 -- nvmf/common.sh@7 -- # uname -s 00:14:49.221 01:15:57 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:49.221 01:15:57 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:49.221 01:15:57 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:49.221 01:15:57 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:49.221 01:15:57 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:49.221 01:15:57 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:49.221 01:15:57 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:49.221 01:15:57 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:49.221 01:15:57 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:49.221 01:15:57 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:49.221 01:15:57 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:49.221 01:15:57 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:49.221 01:15:57 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:49.221 01:15:57 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:49.221 01:15:57 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:49.221 01:15:57 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:49.221 01:15:57 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:49.221 01:15:57 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:49.221 01:15:57 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:49.221 01:15:57 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:49.221 01:15:57 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:49.221 01:15:57 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:49.221 01:15:57 -- paths/export.sh@5 -- # export PATH 00:14:49.222 01:15:57 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:49.222 01:15:57 -- nvmf/common.sh@46 -- # : 0 00:14:49.222 01:15:57 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:49.222 01:15:57 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:49.222 01:15:57 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:49.222 01:15:57 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:49.222 01:15:57 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:49.222 01:15:57 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:49.222 01:15:57 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:49.222 01:15:57 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:49.222 01:15:57 -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:14:49.222 01:15:57 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:49.222 01:15:57 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:49.222 01:15:57 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:49.222 01:15:57 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:49.222 01:15:57 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:49.222 01:15:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:49.222 01:15:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:49.222 01:15:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:49.222 01:15:57 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:49.222 01:15:57 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:49.222 01:15:57 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:49.222 01:15:57 -- common/autotest_common.sh@10 -- # set +x 00:14:51.124 01:15:59 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:51.124 01:15:59 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:51.124 01:15:59 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:51.124 01:15:59 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:51.124 01:15:59 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:51.124 01:15:59 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:51.124 01:15:59 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:51.124 01:15:59 -- nvmf/common.sh@294 -- # net_devs=() 00:14:51.124 01:15:59 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:51.124 01:15:59 -- nvmf/common.sh@295 -- # e810=() 00:14:51.124 01:15:59 -- nvmf/common.sh@295 -- # local -ga e810 00:14:51.124 01:15:59 -- nvmf/common.sh@296 -- # x722=() 00:14:51.124 01:15:59 -- nvmf/common.sh@296 -- # local -ga x722 00:14:51.124 01:15:59 -- nvmf/common.sh@297 -- # mlx=() 00:14:51.124 01:15:59 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:51.124 01:15:59 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:51.124 01:15:59 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:51.124 01:15:59 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:51.124 01:15:59 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:51.124 01:15:59 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:51.124 01:15:59 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:51.124 01:15:59 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:51.124 01:15:59 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:51.124 01:15:59 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:51.124 01:15:59 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:51.124 01:15:59 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:51.124 01:15:59 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:51.124 01:15:59 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:51.124 01:15:59 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:51.124 01:15:59 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:51.124 01:15:59 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:51.124 01:15:59 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:51.124 01:15:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:51.124 01:15:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:51.124 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:51.124 01:15:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:51.124 01:15:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:51.124 01:15:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:51.124 01:15:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:51.124 01:15:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:51.124 01:15:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:51.124 01:15:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:51.124 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:51.124 01:15:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:51.124 01:15:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:51.124 01:15:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:51.124 01:15:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:51.124 01:15:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:51.124 01:15:59 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:51.124 01:15:59 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:51.124 01:15:59 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:51.124 01:15:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:51.124 01:15:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:51.124 01:15:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:51.124 01:15:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:51.124 01:15:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:51.124 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:51.124 01:15:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:51.124 01:15:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:51.124 01:15:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:51.124 01:15:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:51.124 01:15:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:51.124 01:15:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:51.124 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:51.124 01:15:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:51.124 01:15:59 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:51.124 01:15:59 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:51.124 01:15:59 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:51.124 01:15:59 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:51.124 01:15:59 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:51.124 01:15:59 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:51.124 01:15:59 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:51.124 01:15:59 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:51.124 01:15:59 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:51.124 01:15:59 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:51.124 01:15:59 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:51.124 01:15:59 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:51.124 01:15:59 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:51.124 01:15:59 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:51.124 01:15:59 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:51.124 01:15:59 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:51.124 01:15:59 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:51.124 01:15:59 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:51.388 01:15:59 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:51.388 01:15:59 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:51.389 01:15:59 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:51.389 01:15:59 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:51.389 01:15:59 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:51.389 01:15:59 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:51.389 01:15:59 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:51.389 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:51.389 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.293 ms 00:14:51.389 00:14:51.389 --- 10.0.0.2 ping statistics --- 00:14:51.389 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:51.389 rtt min/avg/max/mdev = 0.293/0.293/0.293/0.000 ms 00:14:51.389 01:15:59 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:51.389 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:51.389 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.117 ms 00:14:51.389 00:14:51.389 --- 10.0.0.1 ping statistics --- 00:14:51.389 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:51.389 rtt min/avg/max/mdev = 0.117/0.117/0.117/0.000 ms 00:14:51.389 01:15:59 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:51.389 01:15:59 -- nvmf/common.sh@410 -- # return 0 00:14:51.389 01:15:59 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:51.389 01:15:59 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:51.389 01:15:59 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:51.389 01:15:59 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:51.389 01:15:59 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:51.389 01:15:59 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:51.389 01:15:59 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:51.389 01:15:59 -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:14:51.389 01:15:59 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:51.389 01:15:59 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:51.389 01:15:59 -- common/autotest_common.sh@10 -- # set +x 00:14:51.389 01:15:59 -- nvmf/common.sh@469 -- # nvmfpid=1108200 00:14:51.389 01:15:59 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:14:51.389 01:15:59 -- nvmf/common.sh@470 -- # waitforlisten 1108200 00:14:51.389 01:15:59 -- common/autotest_common.sh@829 -- # '[' -z 1108200 ']' 00:14:51.389 01:15:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:51.389 01:15:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:51.389 01:15:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:51.389 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:51.389 01:15:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:51.389 01:15:59 -- common/autotest_common.sh@10 -- # set +x 00:14:51.389 [2024-11-20 01:15:59.547927] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:14:51.389 [2024-11-20 01:15:59.548022] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:51.389 EAL: No free 2048 kB hugepages reported on node 1 00:14:51.648 [2024-11-20 01:15:59.617229] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:14:51.648 [2024-11-20 01:15:59.706399] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:51.648 [2024-11-20 01:15:59.706562] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:51.648 [2024-11-20 01:15:59.706582] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:51.648 [2024-11-20 01:15:59.706595] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:51.648 [2024-11-20 01:15:59.706726] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:51.648 [2024-11-20 01:15:59.706733] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:52.582 01:16:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:52.582 01:16:00 -- common/autotest_common.sh@862 -- # return 0 00:14:52.582 01:16:00 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:52.582 01:16:00 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:52.582 01:16:00 -- common/autotest_common.sh@10 -- # set +x 00:14:52.582 01:16:00 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:52.582 01:16:00 -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:52.582 01:16:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:52.582 01:16:00 -- common/autotest_common.sh@10 -- # set +x 00:14:52.582 [2024-11-20 01:16:00.535623] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:52.582 01:16:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:52.582 01:16:00 -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:52.582 01:16:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:52.582 01:16:00 -- common/autotest_common.sh@10 -- # set +x 00:14:52.582 01:16:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:52.582 01:16:00 -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:52.582 01:16:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:52.582 01:16:00 -- common/autotest_common.sh@10 -- # set +x 00:14:52.582 [2024-11-20 01:16:00.551827] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:52.582 01:16:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:52.582 01:16:00 -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:14:52.582 01:16:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:52.582 01:16:00 -- common/autotest_common.sh@10 -- # set +x 00:14:52.582 NULL1 00:14:52.582 01:16:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:52.582 01:16:00 -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:14:52.582 01:16:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:52.582 01:16:00 -- common/autotest_common.sh@10 -- # set +x 00:14:52.582 Delay0 00:14:52.582 01:16:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:52.582 01:16:00 -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:52.582 01:16:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:52.582 01:16:00 -- common/autotest_common.sh@10 -- # set +x 00:14:52.582 01:16:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:52.582 01:16:00 -- target/delete_subsystem.sh@28 -- # perf_pid=1108357 00:14:52.582 01:16:00 -- target/delete_subsystem.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:14:52.582 01:16:00 -- target/delete_subsystem.sh@30 -- # sleep 2 00:14:52.582 EAL: No free 2048 kB hugepages reported on node 1 00:14:52.582 [2024-11-20 01:16:00.626494] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:14:54.480 01:16:02 -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:54.480 01:16:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:54.480 01:16:02 -- common/autotest_common.sh@10 -- # set +x 00:14:54.739 Read completed with error (sct=0, sc=8) 00:14:54.739 Read completed with error (sct=0, sc=8) 00:14:54.739 starting I/O failed: -6 00:14:54.739 Read completed with error (sct=0, sc=8) 00:14:54.739 Read completed with error (sct=0, sc=8) 00:14:54.739 Write completed with error (sct=0, sc=8) 00:14:54.739 Read completed with error (sct=0, sc=8) 00:14:54.739 starting I/O failed: -6 00:14:54.739 Read completed with error (sct=0, sc=8) 00:14:54.739 Read completed with error (sct=0, sc=8) 00:14:54.739 Write completed with error (sct=0, sc=8) 00:14:54.739 Read completed with error (sct=0, sc=8) 00:14:54.739 starting I/O failed: -6 00:14:54.739 Read completed with error (sct=0, sc=8) 00:14:54.739 Write completed with error (sct=0, sc=8) 00:14:54.739 Read completed with error (sct=0, sc=8) 00:14:54.739 Read completed with error (sct=0, sc=8) 00:14:54.739 starting I/O failed: -6 00:14:54.739 Read completed with error (sct=0, sc=8) 00:14:54.739 Read completed with error (sct=0, sc=8) 00:14:54.739 Read completed with error (sct=0, sc=8) 00:14:54.739 Write completed with error (sct=0, sc=8) 00:14:54.739 starting I/O failed: -6 00:14:54.739 Read completed with error (sct=0, sc=8) 00:14:54.739 Write completed with error (sct=0, sc=8) 00:14:54.739 Write completed with error (sct=0, sc=8) 00:14:54.739 Read completed with error (sct=0, sc=8) 00:14:54.739 Read completed with error (sct=0, sc=8) 00:14:54.739 Read completed with error (sct=0, sc=8) 00:14:54.739 starting I/O failed: -6 00:14:54.739 Read completed with error (sct=0, sc=8) 00:14:54.739 Write completed with error (sct=0, sc=8) 00:14:54.739 starting I/O failed: -6 00:14:54.739 Read completed with error (sct=0, sc=8) 00:14:54.739 Read completed with error (sct=0, sc=8) 00:14:54.739 Read completed with error (sct=0, sc=8) 00:14:54.739 Read completed with error (sct=0, sc=8) 00:14:54.739 Write completed with error (sct=0, sc=8) 00:14:54.739 Read completed with error (sct=0, sc=8) 00:14:54.739 Read completed with error (sct=0, sc=8) 00:14:54.739 starting I/O failed: -6 00:14:54.739 starting I/O failed: -6 00:14:54.739 Write completed with error (sct=0, sc=8) 00:14:54.739 Read completed with error (sct=0, sc=8) 00:14:54.739 Read completed with error (sct=0, sc=8) 00:14:54.739 Read completed with error (sct=0, sc=8) 00:14:54.739 Read completed with error (sct=0, sc=8) 00:14:54.739 Write completed with error (sct=0, sc=8) 00:14:54.739 Read completed with error (sct=0, sc=8) 00:14:54.739 Read completed with error (sct=0, sc=8) 00:14:54.739 starting I/O failed: -6 00:14:54.739 starting I/O failed: -6 00:14:54.739 Read completed with error (sct=0, sc=8) 00:14:54.739 Read completed with error (sct=0, sc=8) 00:14:54.739 Write completed with error (sct=0, sc=8) 00:14:54.739 Write completed with error (sct=0, sc=8) 00:14:54.739 Read completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Write completed with error (sct=0, sc=8) 00:14:54.740 Write completed with error (sct=0, sc=8) 00:14:54.740 starting I/O failed: -6 00:14:54.740 starting I/O failed: -6 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Write completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Write completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Write completed with error (sct=0, sc=8) 00:14:54.740 starting I/O failed: -6 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 starting I/O failed: -6 00:14:54.740 Write completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 starting I/O failed: -6 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Write completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 starting I/O failed: -6 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 starting I/O failed: -6 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Write completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Write completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 starting I/O failed: -6 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 starting I/O failed: -6 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Write completed with error (sct=0, sc=8) 00:14:54.740 Write completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 starting I/O failed: -6 00:14:54.740 Write completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 starting I/O failed: -6 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 starting I/O failed: -6 00:14:54.740 Write completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 starting I/O failed: -6 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 starting I/O failed: -6 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 starting I/O failed: -6 00:14:54.740 Write completed with error (sct=0, sc=8) 00:14:54.740 Write completed with error (sct=0, sc=8) 00:14:54.740 Write completed with error (sct=0, sc=8) 00:14:54.740 Write completed with error (sct=0, sc=8) 00:14:54.740 starting I/O failed: -6 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Write completed with error (sct=0, sc=8) 00:14:54.740 starting I/O failed: -6 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 starting I/O failed: -6 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Write completed with error (sct=0, sc=8) 00:14:54.740 starting I/O failed: -6 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 starting I/O failed: -6 00:14:54.740 Write completed with error (sct=0, sc=8) 00:14:54.740 [2024-11-20 01:16:02.708756] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x154e9e0 is same with the state(5) to be set 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 starting I/O failed: -6 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 starting I/O failed: -6 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 starting I/O failed: -6 00:14:54.740 Write completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 starting I/O failed: -6 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 starting I/O failed: -6 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Write completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 starting I/O failed: -6 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Write completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 starting I/O failed: -6 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Write completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Write completed with error (sct=0, sc=8) 00:14:54.740 starting I/O failed: -6 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Write completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 starting I/O failed: -6 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Write completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 starting I/O failed: -6 00:14:54.740 Write completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Write completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 starting I/O failed: -6 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Write completed with error (sct=0, sc=8) 00:14:54.740 starting I/O failed: -6 00:14:54.740 Write completed with error (sct=0, sc=8) 00:14:54.740 Write completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Write completed with error (sct=0, sc=8) 00:14:54.740 Write completed with error (sct=0, sc=8) 00:14:54.740 starting I/O failed: -6 00:14:54.740 Write completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 starting I/O failed: -6 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Write completed with error (sct=0, sc=8) 00:14:54.740 starting I/O failed: -6 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Write completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Write completed with error (sct=0, sc=8) 00:14:54.740 Write completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 starting I/O failed: -6 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Write completed with error (sct=0, sc=8) 00:14:54.740 Write completed with error (sct=0, sc=8) 00:14:54.740 Write completed with error (sct=0, sc=8) 00:14:54.740 Write completed with error (sct=0, sc=8) 00:14:54.740 Write completed with error (sct=0, sc=8) 00:14:54.740 starting I/O failed: -6 00:14:54.740 Write completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 starting I/O failed: -6 00:14:54.740 Write completed with error (sct=0, sc=8) 00:14:54.740 Read completed with error (sct=0, sc=8) 00:14:54.740 starting I/O failed: -6 00:14:54.740 Write completed with error (sct=0, sc=8) 00:14:54.740 starting I/O failed: -6 00:14:54.741 starting I/O failed: -6 00:14:54.741 starting I/O failed: -6 00:14:54.741 starting I/O failed: -6 00:14:54.741 starting I/O failed: -6 00:14:54.741 starting I/O failed: -6 00:14:55.675 [2024-11-20 01:16:03.680614] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15509c0 is same with the state(5) to be set 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Write completed with error (sct=0, sc=8) 00:14:55.675 Write completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Write completed with error (sct=0, sc=8) 00:14:55.675 Write completed with error (sct=0, sc=8) 00:14:55.675 Write completed with error (sct=0, sc=8) 00:14:55.675 Write completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Write completed with error (sct=0, sc=8) 00:14:55.675 Write completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Write completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 [2024-11-20 01:16:03.707639] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x154ece0 is same with the state(5) to be set 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Write completed with error (sct=0, sc=8) 00:14:55.675 Write completed with error (sct=0, sc=8) 00:14:55.675 Write completed with error (sct=0, sc=8) 00:14:55.675 Write completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Write completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Write completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 [2024-11-20 01:16:03.707832] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x154f240 is same with the state(5) to be set 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Write completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Write completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Write completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Write completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Write completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Write completed with error (sct=0, sc=8) 00:14:55.675 Write completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Write completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Write completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Write completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Write completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Write completed with error (sct=0, sc=8) 00:14:55.675 [2024-11-20 01:16:03.709869] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7ff16800c480 is same with the state(5) to be set 00:14:55.675 Write completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Write completed with error (sct=0, sc=8) 00:14:55.675 Write completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Write completed with error (sct=0, sc=8) 00:14:55.675 Write completed with error (sct=0, sc=8) 00:14:55.675 Write completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Write completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Read completed with error (sct=0, sc=8) 00:14:55.675 Write completed with error (sct=0, sc=8) 00:14:55.675 Write completed with error (sct=0, sc=8) 00:14:55.676 Write completed with error (sct=0, sc=8) 00:14:55.676 Read completed with error (sct=0, sc=8) 00:14:55.676 Read completed with error (sct=0, sc=8) 00:14:55.676 Read completed with error (sct=0, sc=8) 00:14:55.676 Write completed with error (sct=0, sc=8) 00:14:55.676 Read completed with error (sct=0, sc=8) 00:14:55.676 Read completed with error (sct=0, sc=8) 00:14:55.676 Read completed with error (sct=0, sc=8) 00:14:55.676 Read completed with error (sct=0, sc=8) 00:14:55.676 Read completed with error (sct=0, sc=8) 00:14:55.676 Read completed with error (sct=0, sc=8) 00:14:55.676 Read completed with error (sct=0, sc=8) 00:14:55.676 Read completed with error (sct=0, sc=8) 00:14:55.676 Read completed with error (sct=0, sc=8) 00:14:55.676 Read completed with error (sct=0, sc=8) 00:14:55.676 Read completed with error (sct=0, sc=8) 00:14:55.676 Read completed with error (sct=0, sc=8) 00:14:55.676 Read completed with error (sct=0, sc=8) 00:14:55.676 Read completed with error (sct=0, sc=8) 00:14:55.676 Read completed with error (sct=0, sc=8) 00:14:55.676 [2024-11-20 01:16:03.710651] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7ff16800bf20 is same with the state(5) to be set 00:14:55.676 [2024-11-20 01:16:03.711162] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15509c0 (9): Bad file descriptor 00:14:55.676 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf: errors occurred 00:14:55.676 01:16:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:55.676 01:16:03 -- target/delete_subsystem.sh@34 -- # delay=0 00:14:55.676 01:16:03 -- target/delete_subsystem.sh@35 -- # kill -0 1108357 00:14:55.676 01:16:03 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:14:55.676 Initializing NVMe Controllers 00:14:55.676 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:55.676 Controller IO queue size 128, less than required. 00:14:55.676 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:55.676 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:14:55.676 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:14:55.676 Initialization complete. Launching workers. 00:14:55.676 ======================================================== 00:14:55.676 Latency(us) 00:14:55.676 Device Information : IOPS MiB/s Average min max 00:14:55.676 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 163.75 0.08 908662.50 618.39 1012893.70 00:14:55.676 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 186.07 0.09 906315.91 692.48 1011555.90 00:14:55.676 ======================================================== 00:14:55.676 Total : 349.82 0.17 907414.31 618.39 1012893.70 00:14:55.676 00:14:56.242 01:16:04 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:14:56.242 01:16:04 -- target/delete_subsystem.sh@35 -- # kill -0 1108357 00:14:56.242 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (1108357) - No such process 00:14:56.242 01:16:04 -- target/delete_subsystem.sh@45 -- # NOT wait 1108357 00:14:56.242 01:16:04 -- common/autotest_common.sh@650 -- # local es=0 00:14:56.242 01:16:04 -- common/autotest_common.sh@652 -- # valid_exec_arg wait 1108357 00:14:56.242 01:16:04 -- common/autotest_common.sh@638 -- # local arg=wait 00:14:56.242 01:16:04 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:56.242 01:16:04 -- common/autotest_common.sh@642 -- # type -t wait 00:14:56.242 01:16:04 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:56.242 01:16:04 -- common/autotest_common.sh@653 -- # wait 1108357 00:14:56.242 01:16:04 -- common/autotest_common.sh@653 -- # es=1 00:14:56.242 01:16:04 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:14:56.242 01:16:04 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:14:56.242 01:16:04 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:14:56.242 01:16:04 -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:56.242 01:16:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:56.242 01:16:04 -- common/autotest_common.sh@10 -- # set +x 00:14:56.242 01:16:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:56.242 01:16:04 -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:56.242 01:16:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:56.242 01:16:04 -- common/autotest_common.sh@10 -- # set +x 00:14:56.242 [2024-11-20 01:16:04.229640] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:56.242 01:16:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:56.242 01:16:04 -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:56.242 01:16:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:56.242 01:16:04 -- common/autotest_common.sh@10 -- # set +x 00:14:56.242 01:16:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:56.242 01:16:04 -- target/delete_subsystem.sh@54 -- # perf_pid=1108780 00:14:56.242 01:16:04 -- target/delete_subsystem.sh@56 -- # delay=0 00:14:56.242 01:16:04 -- target/delete_subsystem.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:14:56.242 01:16:04 -- target/delete_subsystem.sh@57 -- # kill -0 1108780 00:14:56.242 01:16:04 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:56.242 EAL: No free 2048 kB hugepages reported on node 1 00:14:56.242 [2024-11-20 01:16:04.279157] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:14:56.807 01:16:04 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:56.807 01:16:04 -- target/delete_subsystem.sh@57 -- # kill -0 1108780 00:14:56.807 01:16:04 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:57.064 01:16:05 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:57.064 01:16:05 -- target/delete_subsystem.sh@57 -- # kill -0 1108780 00:14:57.064 01:16:05 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:57.628 01:16:05 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:57.628 01:16:05 -- target/delete_subsystem.sh@57 -- # kill -0 1108780 00:14:57.628 01:16:05 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:58.191 01:16:06 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:58.191 01:16:06 -- target/delete_subsystem.sh@57 -- # kill -0 1108780 00:14:58.191 01:16:06 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:58.755 01:16:06 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:58.755 01:16:06 -- target/delete_subsystem.sh@57 -- # kill -0 1108780 00:14:58.755 01:16:06 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:59.319 01:16:07 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:59.319 01:16:07 -- target/delete_subsystem.sh@57 -- # kill -0 1108780 00:14:59.319 01:16:07 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:59.319 Initializing NVMe Controllers 00:14:59.319 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:59.319 Controller IO queue size 128, less than required. 00:14:59.319 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:59.319 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:14:59.319 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:14:59.319 Initialization complete. Launching workers. 00:14:59.319 ======================================================== 00:14:59.320 Latency(us) 00:14:59.320 Device Information : IOPS MiB/s Average min max 00:14:59.320 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1004271.85 1000170.34 1010835.87 00:14:59.320 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1004349.68 1000206.97 1013879.60 00:14:59.320 ======================================================== 00:14:59.320 Total : 256.00 0.12 1004310.76 1000170.34 1013879.60 00:14:59.320 00:14:59.577 01:16:07 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:59.577 01:16:07 -- target/delete_subsystem.sh@57 -- # kill -0 1108780 00:14:59.577 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (1108780) - No such process 00:14:59.577 01:16:07 -- target/delete_subsystem.sh@67 -- # wait 1108780 00:14:59.577 01:16:07 -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:14:59.577 01:16:07 -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:14:59.577 01:16:07 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:59.577 01:16:07 -- nvmf/common.sh@116 -- # sync 00:14:59.577 01:16:07 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:59.577 01:16:07 -- nvmf/common.sh@119 -- # set +e 00:14:59.577 01:16:07 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:59.578 01:16:07 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:59.578 rmmod nvme_tcp 00:14:59.578 rmmod nvme_fabrics 00:14:59.835 rmmod nvme_keyring 00:14:59.835 01:16:07 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:59.835 01:16:07 -- nvmf/common.sh@123 -- # set -e 00:14:59.835 01:16:07 -- nvmf/common.sh@124 -- # return 0 00:14:59.835 01:16:07 -- nvmf/common.sh@477 -- # '[' -n 1108200 ']' 00:14:59.836 01:16:07 -- nvmf/common.sh@478 -- # killprocess 1108200 00:14:59.836 01:16:07 -- common/autotest_common.sh@936 -- # '[' -z 1108200 ']' 00:14:59.836 01:16:07 -- common/autotest_common.sh@940 -- # kill -0 1108200 00:14:59.836 01:16:07 -- common/autotest_common.sh@941 -- # uname 00:14:59.836 01:16:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:59.836 01:16:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1108200 00:14:59.836 01:16:07 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:59.836 01:16:07 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:59.836 01:16:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1108200' 00:14:59.836 killing process with pid 1108200 00:14:59.836 01:16:07 -- common/autotest_common.sh@955 -- # kill 1108200 00:14:59.836 01:16:07 -- common/autotest_common.sh@960 -- # wait 1108200 00:15:00.094 01:16:08 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:00.094 01:16:08 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:00.094 01:16:08 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:00.094 01:16:08 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:00.094 01:16:08 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:00.094 01:16:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:00.094 01:16:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:00.094 01:16:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:01.998 01:16:10 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:01.998 00:15:01.998 real 0m13.100s 00:15:01.998 user 0m29.261s 00:15:01.998 sys 0m2.944s 00:15:01.998 01:16:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:01.998 01:16:10 -- common/autotest_common.sh@10 -- # set +x 00:15:01.998 ************************************ 00:15:01.998 END TEST nvmf_delete_subsystem 00:15:01.998 ************************************ 00:15:01.998 01:16:10 -- nvmf/nvmf.sh@36 -- # [[ 1 -eq 1 ]] 00:15:01.998 01:16:10 -- nvmf/nvmf.sh@37 -- # run_test nvmf_nvme_cli /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:15:01.998 01:16:10 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:01.998 01:16:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:01.998 01:16:10 -- common/autotest_common.sh@10 -- # set +x 00:15:01.998 ************************************ 00:15:01.998 START TEST nvmf_nvme_cli 00:15:01.998 ************************************ 00:15:01.998 01:16:10 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:15:02.257 * Looking for test storage... 00:15:02.257 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:02.257 01:16:10 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:02.257 01:16:10 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:02.257 01:16:10 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:02.257 01:16:10 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:02.257 01:16:10 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:02.257 01:16:10 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:02.257 01:16:10 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:02.257 01:16:10 -- scripts/common.sh@335 -- # IFS=.-: 00:15:02.257 01:16:10 -- scripts/common.sh@335 -- # read -ra ver1 00:15:02.257 01:16:10 -- scripts/common.sh@336 -- # IFS=.-: 00:15:02.257 01:16:10 -- scripts/common.sh@336 -- # read -ra ver2 00:15:02.257 01:16:10 -- scripts/common.sh@337 -- # local 'op=<' 00:15:02.257 01:16:10 -- scripts/common.sh@339 -- # ver1_l=2 00:15:02.257 01:16:10 -- scripts/common.sh@340 -- # ver2_l=1 00:15:02.257 01:16:10 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:02.257 01:16:10 -- scripts/common.sh@343 -- # case "$op" in 00:15:02.257 01:16:10 -- scripts/common.sh@344 -- # : 1 00:15:02.257 01:16:10 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:02.257 01:16:10 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:02.257 01:16:10 -- scripts/common.sh@364 -- # decimal 1 00:15:02.257 01:16:10 -- scripts/common.sh@352 -- # local d=1 00:15:02.257 01:16:10 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:02.257 01:16:10 -- scripts/common.sh@354 -- # echo 1 00:15:02.257 01:16:10 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:02.257 01:16:10 -- scripts/common.sh@365 -- # decimal 2 00:15:02.257 01:16:10 -- scripts/common.sh@352 -- # local d=2 00:15:02.257 01:16:10 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:02.257 01:16:10 -- scripts/common.sh@354 -- # echo 2 00:15:02.257 01:16:10 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:02.257 01:16:10 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:02.257 01:16:10 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:02.257 01:16:10 -- scripts/common.sh@367 -- # return 0 00:15:02.257 01:16:10 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:02.257 01:16:10 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:02.257 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:02.257 --rc genhtml_branch_coverage=1 00:15:02.257 --rc genhtml_function_coverage=1 00:15:02.257 --rc genhtml_legend=1 00:15:02.257 --rc geninfo_all_blocks=1 00:15:02.257 --rc geninfo_unexecuted_blocks=1 00:15:02.257 00:15:02.257 ' 00:15:02.257 01:16:10 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:02.257 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:02.257 --rc genhtml_branch_coverage=1 00:15:02.257 --rc genhtml_function_coverage=1 00:15:02.257 --rc genhtml_legend=1 00:15:02.257 --rc geninfo_all_blocks=1 00:15:02.257 --rc geninfo_unexecuted_blocks=1 00:15:02.257 00:15:02.257 ' 00:15:02.257 01:16:10 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:02.257 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:02.257 --rc genhtml_branch_coverage=1 00:15:02.257 --rc genhtml_function_coverage=1 00:15:02.257 --rc genhtml_legend=1 00:15:02.257 --rc geninfo_all_blocks=1 00:15:02.257 --rc geninfo_unexecuted_blocks=1 00:15:02.257 00:15:02.257 ' 00:15:02.257 01:16:10 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:02.257 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:02.257 --rc genhtml_branch_coverage=1 00:15:02.257 --rc genhtml_function_coverage=1 00:15:02.257 --rc genhtml_legend=1 00:15:02.257 --rc geninfo_all_blocks=1 00:15:02.257 --rc geninfo_unexecuted_blocks=1 00:15:02.257 00:15:02.257 ' 00:15:02.257 01:16:10 -- target/nvme_cli.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:02.257 01:16:10 -- nvmf/common.sh@7 -- # uname -s 00:15:02.257 01:16:10 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:02.257 01:16:10 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:02.257 01:16:10 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:02.257 01:16:10 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:02.257 01:16:10 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:02.257 01:16:10 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:02.257 01:16:10 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:02.257 01:16:10 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:02.257 01:16:10 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:02.257 01:16:10 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:02.258 01:16:10 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:02.258 01:16:10 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:02.258 01:16:10 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:02.258 01:16:10 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:02.258 01:16:10 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:02.258 01:16:10 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:02.258 01:16:10 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:02.258 01:16:10 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:02.258 01:16:10 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:02.258 01:16:10 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:02.258 01:16:10 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:02.258 01:16:10 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:02.258 01:16:10 -- paths/export.sh@5 -- # export PATH 00:15:02.258 01:16:10 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:02.258 01:16:10 -- nvmf/common.sh@46 -- # : 0 00:15:02.258 01:16:10 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:02.258 01:16:10 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:02.258 01:16:10 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:02.258 01:16:10 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:02.258 01:16:10 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:02.258 01:16:10 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:02.258 01:16:10 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:02.258 01:16:10 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:02.258 01:16:10 -- target/nvme_cli.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:02.258 01:16:10 -- target/nvme_cli.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:02.258 01:16:10 -- target/nvme_cli.sh@14 -- # devs=() 00:15:02.258 01:16:10 -- target/nvme_cli.sh@16 -- # nvmftestinit 00:15:02.258 01:16:10 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:02.258 01:16:10 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:02.258 01:16:10 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:02.258 01:16:10 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:02.258 01:16:10 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:02.258 01:16:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:02.258 01:16:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:02.258 01:16:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:02.258 01:16:10 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:02.258 01:16:10 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:02.258 01:16:10 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:02.258 01:16:10 -- common/autotest_common.sh@10 -- # set +x 00:15:04.793 01:16:12 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:04.793 01:16:12 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:04.793 01:16:12 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:04.793 01:16:12 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:04.793 01:16:12 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:04.793 01:16:12 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:04.793 01:16:12 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:04.793 01:16:12 -- nvmf/common.sh@294 -- # net_devs=() 00:15:04.793 01:16:12 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:04.793 01:16:12 -- nvmf/common.sh@295 -- # e810=() 00:15:04.793 01:16:12 -- nvmf/common.sh@295 -- # local -ga e810 00:15:04.793 01:16:12 -- nvmf/common.sh@296 -- # x722=() 00:15:04.793 01:16:12 -- nvmf/common.sh@296 -- # local -ga x722 00:15:04.793 01:16:12 -- nvmf/common.sh@297 -- # mlx=() 00:15:04.793 01:16:12 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:04.793 01:16:12 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:04.793 01:16:12 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:04.793 01:16:12 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:04.793 01:16:12 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:04.793 01:16:12 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:04.793 01:16:12 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:04.793 01:16:12 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:04.793 01:16:12 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:04.793 01:16:12 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:04.793 01:16:12 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:04.793 01:16:12 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:04.793 01:16:12 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:04.793 01:16:12 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:04.793 01:16:12 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:04.793 01:16:12 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:04.793 01:16:12 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:04.793 01:16:12 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:04.793 01:16:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:04.793 01:16:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:04.793 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:04.793 01:16:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:04.793 01:16:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:04.793 01:16:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:04.793 01:16:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:04.793 01:16:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:04.793 01:16:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:04.793 01:16:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:04.793 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:04.793 01:16:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:04.793 01:16:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:04.793 01:16:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:04.793 01:16:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:04.793 01:16:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:04.793 01:16:12 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:04.793 01:16:12 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:04.793 01:16:12 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:04.793 01:16:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:04.793 01:16:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:04.793 01:16:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:04.793 01:16:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:04.793 01:16:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:04.793 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:04.793 01:16:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:04.793 01:16:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:04.793 01:16:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:04.793 01:16:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:04.793 01:16:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:04.793 01:16:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:04.793 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:04.793 01:16:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:04.793 01:16:12 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:04.793 01:16:12 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:04.793 01:16:12 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:04.793 01:16:12 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:04.793 01:16:12 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:04.793 01:16:12 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:04.793 01:16:12 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:04.794 01:16:12 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:04.794 01:16:12 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:04.794 01:16:12 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:04.794 01:16:12 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:04.794 01:16:12 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:04.794 01:16:12 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:04.794 01:16:12 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:04.794 01:16:12 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:04.794 01:16:12 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:04.794 01:16:12 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:04.794 01:16:12 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:04.794 01:16:12 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:04.794 01:16:12 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:04.794 01:16:12 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:04.794 01:16:12 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:04.794 01:16:12 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:04.794 01:16:12 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:04.794 01:16:12 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:04.794 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:04.794 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.258 ms 00:15:04.794 00:15:04.794 --- 10.0.0.2 ping statistics --- 00:15:04.794 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:04.794 rtt min/avg/max/mdev = 0.258/0.258/0.258/0.000 ms 00:15:04.794 01:16:12 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:04.794 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:04.794 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.194 ms 00:15:04.794 00:15:04.794 --- 10.0.0.1 ping statistics --- 00:15:04.794 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:04.794 rtt min/avg/max/mdev = 0.194/0.194/0.194/0.000 ms 00:15:04.794 01:16:12 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:04.794 01:16:12 -- nvmf/common.sh@410 -- # return 0 00:15:04.794 01:16:12 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:04.794 01:16:12 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:04.794 01:16:12 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:04.794 01:16:12 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:04.794 01:16:12 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:04.794 01:16:12 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:04.794 01:16:12 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:04.794 01:16:12 -- target/nvme_cli.sh@17 -- # nvmfappstart -m 0xF 00:15:04.794 01:16:12 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:04.794 01:16:12 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:04.794 01:16:12 -- common/autotest_common.sh@10 -- # set +x 00:15:04.794 01:16:12 -- nvmf/common.sh@469 -- # nvmfpid=1111147 00:15:04.794 01:16:12 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:15:04.794 01:16:12 -- nvmf/common.sh@470 -- # waitforlisten 1111147 00:15:04.794 01:16:12 -- common/autotest_common.sh@829 -- # '[' -z 1111147 ']' 00:15:04.794 01:16:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:04.794 01:16:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:04.794 01:16:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:04.794 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:04.794 01:16:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:04.794 01:16:12 -- common/autotest_common.sh@10 -- # set +x 00:15:04.794 [2024-11-20 01:16:12.596383] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:15:04.794 [2024-11-20 01:16:12.596455] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:04.794 EAL: No free 2048 kB hugepages reported on node 1 00:15:04.794 [2024-11-20 01:16:12.666182] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:04.794 [2024-11-20 01:16:12.754890] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:04.794 [2024-11-20 01:16:12.755050] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:04.794 [2024-11-20 01:16:12.755082] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:04.794 [2024-11-20 01:16:12.755097] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:04.794 [2024-11-20 01:16:12.755165] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:04.794 [2024-11-20 01:16:12.755218] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:04.794 [2024-11-20 01:16:12.755189] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:04.794 [2024-11-20 01:16:12.755215] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:05.732 01:16:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:05.732 01:16:13 -- common/autotest_common.sh@862 -- # return 0 00:15:05.732 01:16:13 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:05.732 01:16:13 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:05.732 01:16:13 -- common/autotest_common.sh@10 -- # set +x 00:15:05.732 01:16:13 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:05.732 01:16:13 -- target/nvme_cli.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:05.732 01:16:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:05.732 01:16:13 -- common/autotest_common.sh@10 -- # set +x 00:15:05.732 [2024-11-20 01:16:13.682112] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:05.732 01:16:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:05.732 01:16:13 -- target/nvme_cli.sh@21 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:05.732 01:16:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:05.732 01:16:13 -- common/autotest_common.sh@10 -- # set +x 00:15:05.732 Malloc0 00:15:05.732 01:16:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:05.732 01:16:13 -- target/nvme_cli.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:15:05.732 01:16:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:05.732 01:16:13 -- common/autotest_common.sh@10 -- # set +x 00:15:05.732 Malloc1 00:15:05.732 01:16:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:05.732 01:16:13 -- target/nvme_cli.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -d SPDK_Controller1 -i 291 00:15:05.732 01:16:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:05.732 01:16:13 -- common/autotest_common.sh@10 -- # set +x 00:15:05.732 01:16:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:05.732 01:16:13 -- target/nvme_cli.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:05.732 01:16:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:05.732 01:16:13 -- common/autotest_common.sh@10 -- # set +x 00:15:05.732 01:16:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:05.732 01:16:13 -- target/nvme_cli.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:15:05.732 01:16:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:05.732 01:16:13 -- common/autotest_common.sh@10 -- # set +x 00:15:05.732 01:16:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:05.732 01:16:13 -- target/nvme_cli.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:05.732 01:16:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:05.732 01:16:13 -- common/autotest_common.sh@10 -- # set +x 00:15:05.732 [2024-11-20 01:16:13.768829] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:05.732 01:16:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:05.732 01:16:13 -- target/nvme_cli.sh@28 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:15:05.732 01:16:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:05.732 01:16:13 -- common/autotest_common.sh@10 -- # set +x 00:15:05.732 01:16:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:05.732 01:16:13 -- target/nvme_cli.sh@30 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:15:05.732 00:15:05.732 Discovery Log Number of Records 2, Generation counter 2 00:15:05.732 =====Discovery Log Entry 0====== 00:15:05.732 trtype: tcp 00:15:05.732 adrfam: ipv4 00:15:05.732 subtype: current discovery subsystem 00:15:05.732 treq: not required 00:15:05.732 portid: 0 00:15:05.732 trsvcid: 4420 00:15:05.732 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:15:05.732 traddr: 10.0.0.2 00:15:05.732 eflags: explicit discovery connections, duplicate discovery information 00:15:05.732 sectype: none 00:15:05.732 =====Discovery Log Entry 1====== 00:15:05.732 trtype: tcp 00:15:05.732 adrfam: ipv4 00:15:05.732 subtype: nvme subsystem 00:15:05.732 treq: not required 00:15:05.732 portid: 0 00:15:05.732 trsvcid: 4420 00:15:05.732 subnqn: nqn.2016-06.io.spdk:cnode1 00:15:05.732 traddr: 10.0.0.2 00:15:05.732 eflags: none 00:15:05.732 sectype: none 00:15:05.732 01:16:13 -- target/nvme_cli.sh@31 -- # devs=($(get_nvme_devs)) 00:15:05.732 01:16:13 -- target/nvme_cli.sh@31 -- # get_nvme_devs 00:15:05.732 01:16:13 -- nvmf/common.sh@510 -- # local dev _ 00:15:05.732 01:16:13 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:05.732 01:16:13 -- nvmf/common.sh@509 -- # nvme list 00:15:05.990 01:16:13 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:15:05.990 01:16:13 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:05.990 01:16:13 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:15:05.990 01:16:13 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:05.990 01:16:13 -- target/nvme_cli.sh@31 -- # nvme_num_before_connection=0 00:15:05.990 01:16:13 -- target/nvme_cli.sh@32 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:15:06.561 01:16:14 -- target/nvme_cli.sh@34 -- # waitforserial SPDKISFASTANDAWESOME 2 00:15:06.561 01:16:14 -- common/autotest_common.sh@1187 -- # local i=0 00:15:06.561 01:16:14 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:15:06.561 01:16:14 -- common/autotest_common.sh@1189 -- # [[ -n 2 ]] 00:15:06.561 01:16:14 -- common/autotest_common.sh@1190 -- # nvme_device_counter=2 00:15:06.561 01:16:14 -- common/autotest_common.sh@1194 -- # sleep 2 00:15:08.467 01:16:16 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:15:08.467 01:16:16 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:15:08.467 01:16:16 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:15:08.467 01:16:16 -- common/autotest_common.sh@1196 -- # nvme_devices=2 00:15:08.467 01:16:16 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:15:08.467 01:16:16 -- common/autotest_common.sh@1197 -- # return 0 00:15:08.467 01:16:16 -- target/nvme_cli.sh@35 -- # get_nvme_devs 00:15:08.467 01:16:16 -- nvmf/common.sh@510 -- # local dev _ 00:15:08.467 01:16:16 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:08.467 01:16:16 -- nvmf/common.sh@509 -- # nvme list 00:15:08.726 01:16:16 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:15:08.726 01:16:16 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:08.726 01:16:16 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:15:08.726 01:16:16 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:08.726 01:16:16 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:15:08.726 01:16:16 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:15:08.726 01:16:16 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:08.726 01:16:16 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:15:08.726 01:16:16 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:15:08.726 01:16:16 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:08.726 01:16:16 -- target/nvme_cli.sh@35 -- # [[ -z /dev/nvme0n1 00:15:08.726 /dev/nvme0n2 ]] 00:15:08.726 01:16:16 -- target/nvme_cli.sh@59 -- # devs=($(get_nvme_devs)) 00:15:08.726 01:16:16 -- target/nvme_cli.sh@59 -- # get_nvme_devs 00:15:08.726 01:16:16 -- nvmf/common.sh@510 -- # local dev _ 00:15:08.726 01:16:16 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:08.726 01:16:16 -- nvmf/common.sh@509 -- # nvme list 00:15:08.726 01:16:16 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:15:08.726 01:16:16 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:08.726 01:16:16 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:15:08.726 01:16:16 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:08.726 01:16:16 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:15:08.726 01:16:16 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:15:08.726 01:16:16 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:08.726 01:16:16 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:15:08.726 01:16:16 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:15:08.726 01:16:16 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:08.726 01:16:16 -- target/nvme_cli.sh@59 -- # nvme_num=2 00:15:08.726 01:16:16 -- target/nvme_cli.sh@60 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:15:09.293 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:15:09.293 01:16:17 -- target/nvme_cli.sh@61 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:15:09.293 01:16:17 -- common/autotest_common.sh@1208 -- # local i=0 00:15:09.293 01:16:17 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:15:09.293 01:16:17 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:09.293 01:16:17 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:15:09.293 01:16:17 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:09.293 01:16:17 -- common/autotest_common.sh@1220 -- # return 0 00:15:09.293 01:16:17 -- target/nvme_cli.sh@62 -- # (( nvme_num <= nvme_num_before_connection )) 00:15:09.293 01:16:17 -- target/nvme_cli.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:09.293 01:16:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:09.293 01:16:17 -- common/autotest_common.sh@10 -- # set +x 00:15:09.293 01:16:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:09.293 01:16:17 -- target/nvme_cli.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:15:09.293 01:16:17 -- target/nvme_cli.sh@70 -- # nvmftestfini 00:15:09.293 01:16:17 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:09.293 01:16:17 -- nvmf/common.sh@116 -- # sync 00:15:09.293 01:16:17 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:09.293 01:16:17 -- nvmf/common.sh@119 -- # set +e 00:15:09.293 01:16:17 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:09.293 01:16:17 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:09.293 rmmod nvme_tcp 00:15:09.293 rmmod nvme_fabrics 00:15:09.293 rmmod nvme_keyring 00:15:09.293 01:16:17 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:09.293 01:16:17 -- nvmf/common.sh@123 -- # set -e 00:15:09.293 01:16:17 -- nvmf/common.sh@124 -- # return 0 00:15:09.293 01:16:17 -- nvmf/common.sh@477 -- # '[' -n 1111147 ']' 00:15:09.293 01:16:17 -- nvmf/common.sh@478 -- # killprocess 1111147 00:15:09.293 01:16:17 -- common/autotest_common.sh@936 -- # '[' -z 1111147 ']' 00:15:09.293 01:16:17 -- common/autotest_common.sh@940 -- # kill -0 1111147 00:15:09.293 01:16:17 -- common/autotest_common.sh@941 -- # uname 00:15:09.293 01:16:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:09.293 01:16:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1111147 00:15:09.293 01:16:17 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:09.293 01:16:17 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:09.293 01:16:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1111147' 00:15:09.293 killing process with pid 1111147 00:15:09.293 01:16:17 -- common/autotest_common.sh@955 -- # kill 1111147 00:15:09.293 01:16:17 -- common/autotest_common.sh@960 -- # wait 1111147 00:15:09.552 01:16:17 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:09.552 01:16:17 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:09.552 01:16:17 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:09.552 01:16:17 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:09.552 01:16:17 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:09.552 01:16:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:09.552 01:16:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:09.552 01:16:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:11.456 01:16:19 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:11.456 00:15:11.456 real 0m9.486s 00:15:11.456 user 0m20.219s 00:15:11.456 sys 0m2.296s 00:15:11.456 01:16:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:11.456 01:16:19 -- common/autotest_common.sh@10 -- # set +x 00:15:11.456 ************************************ 00:15:11.456 END TEST nvmf_nvme_cli 00:15:11.456 ************************************ 00:15:11.714 01:16:19 -- nvmf/nvmf.sh@39 -- # [[ 1 -eq 1 ]] 00:15:11.714 01:16:19 -- nvmf/nvmf.sh@40 -- # run_test nvmf_vfio_user /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_vfio_user.sh --transport=tcp 00:15:11.715 01:16:19 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:11.715 01:16:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:11.715 01:16:19 -- common/autotest_common.sh@10 -- # set +x 00:15:11.715 ************************************ 00:15:11.715 START TEST nvmf_vfio_user 00:15:11.715 ************************************ 00:15:11.715 01:16:19 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_vfio_user.sh --transport=tcp 00:15:11.715 * Looking for test storage... 00:15:11.715 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:11.715 01:16:19 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:11.715 01:16:19 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:11.715 01:16:19 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:11.715 01:16:19 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:11.715 01:16:19 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:11.715 01:16:19 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:11.715 01:16:19 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:11.715 01:16:19 -- scripts/common.sh@335 -- # IFS=.-: 00:15:11.715 01:16:19 -- scripts/common.sh@335 -- # read -ra ver1 00:15:11.715 01:16:19 -- scripts/common.sh@336 -- # IFS=.-: 00:15:11.715 01:16:19 -- scripts/common.sh@336 -- # read -ra ver2 00:15:11.715 01:16:19 -- scripts/common.sh@337 -- # local 'op=<' 00:15:11.715 01:16:19 -- scripts/common.sh@339 -- # ver1_l=2 00:15:11.715 01:16:19 -- scripts/common.sh@340 -- # ver2_l=1 00:15:11.715 01:16:19 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:11.715 01:16:19 -- scripts/common.sh@343 -- # case "$op" in 00:15:11.715 01:16:19 -- scripts/common.sh@344 -- # : 1 00:15:11.715 01:16:19 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:11.715 01:16:19 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:11.715 01:16:19 -- scripts/common.sh@364 -- # decimal 1 00:15:11.715 01:16:19 -- scripts/common.sh@352 -- # local d=1 00:15:11.715 01:16:19 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:11.715 01:16:19 -- scripts/common.sh@354 -- # echo 1 00:15:11.715 01:16:19 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:11.715 01:16:19 -- scripts/common.sh@365 -- # decimal 2 00:15:11.715 01:16:19 -- scripts/common.sh@352 -- # local d=2 00:15:11.715 01:16:19 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:11.715 01:16:19 -- scripts/common.sh@354 -- # echo 2 00:15:11.715 01:16:19 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:11.715 01:16:19 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:11.715 01:16:19 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:11.715 01:16:19 -- scripts/common.sh@367 -- # return 0 00:15:11.715 01:16:19 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:11.715 01:16:19 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:11.715 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:11.715 --rc genhtml_branch_coverage=1 00:15:11.715 --rc genhtml_function_coverage=1 00:15:11.715 --rc genhtml_legend=1 00:15:11.715 --rc geninfo_all_blocks=1 00:15:11.715 --rc geninfo_unexecuted_blocks=1 00:15:11.715 00:15:11.715 ' 00:15:11.715 01:16:19 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:11.715 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:11.715 --rc genhtml_branch_coverage=1 00:15:11.715 --rc genhtml_function_coverage=1 00:15:11.715 --rc genhtml_legend=1 00:15:11.715 --rc geninfo_all_blocks=1 00:15:11.715 --rc geninfo_unexecuted_blocks=1 00:15:11.715 00:15:11.715 ' 00:15:11.715 01:16:19 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:11.715 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:11.715 --rc genhtml_branch_coverage=1 00:15:11.715 --rc genhtml_function_coverage=1 00:15:11.715 --rc genhtml_legend=1 00:15:11.715 --rc geninfo_all_blocks=1 00:15:11.715 --rc geninfo_unexecuted_blocks=1 00:15:11.715 00:15:11.715 ' 00:15:11.715 01:16:19 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:11.715 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:11.715 --rc genhtml_branch_coverage=1 00:15:11.715 --rc genhtml_function_coverage=1 00:15:11.715 --rc genhtml_legend=1 00:15:11.715 --rc geninfo_all_blocks=1 00:15:11.715 --rc geninfo_unexecuted_blocks=1 00:15:11.715 00:15:11.715 ' 00:15:11.715 01:16:19 -- target/nvmf_vfio_user.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:11.715 01:16:19 -- nvmf/common.sh@7 -- # uname -s 00:15:11.715 01:16:19 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:11.715 01:16:19 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:11.715 01:16:19 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:11.715 01:16:19 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:11.715 01:16:19 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:11.715 01:16:19 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:11.715 01:16:19 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:11.715 01:16:19 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:11.715 01:16:19 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:11.715 01:16:19 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:11.715 01:16:19 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:11.715 01:16:19 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:11.715 01:16:19 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:11.715 01:16:19 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:11.715 01:16:19 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:11.715 01:16:19 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:11.715 01:16:19 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:11.715 01:16:19 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:11.715 01:16:19 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:11.715 01:16:19 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:11.715 01:16:19 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:11.715 01:16:19 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:11.715 01:16:19 -- paths/export.sh@5 -- # export PATH 00:15:11.715 01:16:19 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:11.715 01:16:19 -- nvmf/common.sh@46 -- # : 0 00:15:11.715 01:16:19 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:11.715 01:16:19 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:11.715 01:16:19 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:11.715 01:16:19 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:11.715 01:16:19 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:11.715 01:16:19 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:11.715 01:16:19 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:11.715 01:16:19 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:11.715 01:16:19 -- target/nvmf_vfio_user.sh@12 -- # MALLOC_BDEV_SIZE=64 00:15:11.715 01:16:19 -- target/nvmf_vfio_user.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:15:11.715 01:16:19 -- target/nvmf_vfio_user.sh@14 -- # NUM_DEVICES=2 00:15:11.715 01:16:19 -- target/nvmf_vfio_user.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:11.715 01:16:19 -- target/nvmf_vfio_user.sh@18 -- # export TEST_TRANSPORT=VFIOUSER 00:15:11.715 01:16:19 -- target/nvmf_vfio_user.sh@18 -- # TEST_TRANSPORT=VFIOUSER 00:15:11.715 01:16:19 -- target/nvmf_vfio_user.sh@47 -- # rm -rf /var/run/vfio-user 00:15:11.715 01:16:19 -- target/nvmf_vfio_user.sh@103 -- # setup_nvmf_vfio_user '' '' 00:15:11.715 01:16:19 -- target/nvmf_vfio_user.sh@51 -- # local nvmf_app_args= 00:15:11.715 01:16:19 -- target/nvmf_vfio_user.sh@52 -- # local transport_args= 00:15:11.715 01:16:19 -- target/nvmf_vfio_user.sh@55 -- # nvmfpid=1112226 00:15:11.715 01:16:19 -- target/nvmf_vfio_user.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m '[0,1,2,3]' 00:15:11.715 01:16:19 -- target/nvmf_vfio_user.sh@57 -- # echo 'Process pid: 1112226' 00:15:11.715 Process pid: 1112226 00:15:11.715 01:16:19 -- target/nvmf_vfio_user.sh@59 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:15:11.715 01:16:19 -- target/nvmf_vfio_user.sh@60 -- # waitforlisten 1112226 00:15:11.715 01:16:19 -- common/autotest_common.sh@829 -- # '[' -z 1112226 ']' 00:15:11.715 01:16:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:11.715 01:16:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:11.715 01:16:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:11.715 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:11.715 01:16:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:11.715 01:16:19 -- common/autotest_common.sh@10 -- # set +x 00:15:11.715 [2024-11-20 01:16:19.891598] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:15:11.715 [2024-11-20 01:16:19.891696] [ DPDK EAL parameters: nvmf -l 0,1,2,3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:11.715 EAL: No free 2048 kB hugepages reported on node 1 00:15:11.975 [2024-11-20 01:16:19.956656] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:11.975 [2024-11-20 01:16:20.054020] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:11.975 [2024-11-20 01:16:20.054197] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:11.975 [2024-11-20 01:16:20.054217] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:11.975 [2024-11-20 01:16:20.054231] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:11.975 [2024-11-20 01:16:20.054289] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:11.975 [2024-11-20 01:16:20.054345] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:11.975 [2024-11-20 01:16:20.054393] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:11.975 [2024-11-20 01:16:20.054396] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:12.910 01:16:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:12.910 01:16:20 -- common/autotest_common.sh@862 -- # return 0 00:15:12.910 01:16:20 -- target/nvmf_vfio_user.sh@62 -- # sleep 1 00:15:13.848 01:16:21 -- target/nvmf_vfio_user.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t VFIOUSER 00:15:14.106 01:16:22 -- target/nvmf_vfio_user.sh@66 -- # mkdir -p /var/run/vfio-user 00:15:14.106 01:16:22 -- target/nvmf_vfio_user.sh@68 -- # seq 1 2 00:15:14.106 01:16:22 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:14.106 01:16:22 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user1/1 00:15:14.106 01:16:22 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:15:14.364 Malloc1 00:15:14.364 01:16:22 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode1 -a -s SPDK1 00:15:14.623 01:16:22 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc1 00:15:14.881 01:16:23 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode1 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user1/1 -s 0 00:15:15.140 01:16:23 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:15.140 01:16:23 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user2/2 00:15:15.140 01:16:23 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc2 00:15:15.441 Malloc2 00:15:15.441 01:16:23 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode2 -a -s SPDK2 00:15:15.719 01:16:23 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc2 00:15:15.977 01:16:24 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode2 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user2/2 -s 0 00:15:16.237 01:16:24 -- target/nvmf_vfio_user.sh@104 -- # run_nvmf_vfio_user 00:15:16.237 01:16:24 -- target/nvmf_vfio_user.sh@80 -- # seq 1 2 00:15:16.237 01:16:24 -- target/nvmf_vfio_user.sh@80 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:16.237 01:16:24 -- target/nvmf_vfio_user.sh@81 -- # test_traddr=/var/run/vfio-user/domain/vfio-user1/1 00:15:16.237 01:16:24 -- target/nvmf_vfio_user.sh@82 -- # test_subnqn=nqn.2019-07.io.spdk:cnode1 00:15:16.237 01:16:24 -- target/nvmf_vfio_user.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -g -L nvme -L nvme_vfio -L vfio_pci 00:15:16.237 [2024-11-20 01:16:24.317498] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:15:16.237 [2024-11-20 01:16:24.317538] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --single-file-segments --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1112793 ] 00:15:16.237 EAL: No free 2048 kB hugepages reported on node 1 00:15:16.237 [2024-11-20 01:16:24.349377] nvme_vfio_user.c: 259:nvme_vfio_ctrlr_scan: *DEBUG*: Scan controller : /var/run/vfio-user/domain/vfio-user1/1 00:15:16.237 [2024-11-20 01:16:24.354786] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 0, Size 0x2000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:16.237 [2024-11-20 01:16:24.354815] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0x1000, Offset 0x1000, Map addr 0x7f9a95469000 00:15:16.237 [2024-11-20 01:16:24.355777] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 1, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:16.237 [2024-11-20 01:16:24.356770] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 2, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:16.237 [2024-11-20 01:16:24.357773] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 3, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:16.237 [2024-11-20 01:16:24.358781] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 4, Size 0x2000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:16.237 [2024-11-20 01:16:24.359786] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 5, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:16.237 [2024-11-20 01:16:24.360787] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 6, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:16.237 [2024-11-20 01:16:24.361790] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 7, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:16.238 [2024-11-20 01:16:24.362795] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 8, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:16.238 [2024-11-20 01:16:24.363806] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 9, Size 0xc000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:16.238 [2024-11-20 01:16:24.363827] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0xb000, Offset 0x1000, Map addr 0x7f9a94163000 00:15:16.238 [2024-11-20 01:16:24.364960] vfio_user_pci.c: 65:vfio_add_mr: *DEBUG*: Add memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:16.238 [2024-11-20 01:16:24.380587] vfio_user_pci.c: 386:spdk_vfio_user_setup: *DEBUG*: Device vfio-user0, Path /var/run/vfio-user/domain/vfio-user1/1/cntrl Setup Successfully 00:15:16.238 [2024-11-20 01:16:24.380625] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to connect adminq (no timeout) 00:15:16.238 [2024-11-20 01:16:24.382926] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x0, value 0x201e0100ff 00:15:16.238 [2024-11-20 01:16:24.382983] nvme_pcie_common.c: 132:nvme_pcie_qpair_construct: *INFO*: max_completions_cap = 64 num_trackers = 192 00:15:16.238 [2024-11-20 01:16:24.383097] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for connect adminq (no timeout) 00:15:16.238 [2024-11-20 01:16:24.383133] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read vs (no timeout) 00:15:16.238 [2024-11-20 01:16:24.383145] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read vs wait for vs (no timeout) 00:15:16.238 [2024-11-20 01:16:24.383924] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x8, value 0x10300 00:15:16.238 [2024-11-20 01:16:24.383942] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read cap (no timeout) 00:15:16.238 [2024-11-20 01:16:24.383954] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read cap wait for cap (no timeout) 00:15:16.238 [2024-11-20 01:16:24.384932] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x0, value 0x201e0100ff 00:15:16.238 [2024-11-20 01:16:24.384951] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to check en (no timeout) 00:15:16.238 [2024-11-20 01:16:24.384964] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to check en wait for cc (timeout 15000 ms) 00:15:16.238 [2024-11-20 01:16:24.385937] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x0 00:15:16.238 [2024-11-20 01:16:24.385955] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:15:16.238 [2024-11-20 01:16:24.386943] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x0 00:15:16.238 [2024-11-20 01:16:24.386962] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CC.EN = 0 && CSTS.RDY = 0 00:15:16.238 [2024-11-20 01:16:24.386971] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to controller is disabled (timeout 15000 ms) 00:15:16.238 [2024-11-20 01:16:24.386981] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:15:16.238 [2024-11-20 01:16:24.387091] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Setting CC.EN = 1 00:15:16.238 [2024-11-20 01:16:24.387101] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:15:16.238 [2024-11-20 01:16:24.387110] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x28, value 0x2000003c0000 00:15:16.238 [2024-11-20 01:16:24.391079] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x30, value 0x2000003be000 00:15:16.238 [2024-11-20 01:16:24.391975] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x24, value 0xff00ff 00:15:16.238 [2024-11-20 01:16:24.392984] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x460001 00:15:16.238 [2024-11-20 01:16:24.394019] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:15:16.238 [2024-11-20 01:16:24.395000] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x1 00:15:16.238 [2024-11-20 01:16:24.395017] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:15:16.238 [2024-11-20 01:16:24.395025] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to reset admin queue (timeout 30000 ms) 00:15:16.238 [2024-11-20 01:16:24.395048] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify controller (no timeout) 00:15:16.238 [2024-11-20 01:16:24.395062] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify controller (timeout 30000 ms) 00:15:16.238 [2024-11-20 01:16:24.395188] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:16.238 [2024-11-20 01:16:24.395201] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:16.238 [2024-11-20 01:16:24.395220] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000001 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:16.238 [2024-11-20 01:16:24.395275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0001 p:1 m:0 dnr:0 00:15:16.238 [2024-11-20 01:16:24.395291] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] transport max_xfer_size 131072 00:15:16.238 [2024-11-20 01:16:24.395300] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] MDTS max_xfer_size 131072 00:15:16.238 [2024-11-20 01:16:24.395307] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CNTLID 0x0001 00:15:16.238 [2024-11-20 01:16:24.395314] nvme_ctrlr.c:1990:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Identify CNTLID 0x0001 != Connect CNTLID 0x0000 00:15:16.238 [2024-11-20 01:16:24.395322] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] transport max_sges 1 00:15:16.238 [2024-11-20 01:16:24.395329] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] fuses compare and write: 1 00:15:16.238 [2024-11-20 01:16:24.395337] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to configure AER (timeout 30000 ms) 00:15:16.238 [2024-11-20 01:16:24.395354] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for configure aer (timeout 30000 ms) 00:15:16.238 [2024-11-20 01:16:24.395370] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:191 cdw10:0000000b PRP1 0x0 PRP2 0x0 00:15:16.238 [2024-11-20 01:16:24.395399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0002 p:1 m:0 dnr:0 00:15:16.238 [2024-11-20 01:16:24.395420] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:190 nsid:0 cdw10:00000000 cdw11:00000000 00:15:16.238 [2024-11-20 01:16:24.395434] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:189 nsid:0 cdw10:00000000 cdw11:00000000 00:15:16.238 [2024-11-20 01:16:24.395446] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:188 nsid:0 cdw10:00000000 cdw11:00000000 00:15:16.238 [2024-11-20 01:16:24.395457] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:187 nsid:0 cdw10:00000000 cdw11:00000000 00:15:16.238 [2024-11-20 01:16:24.395470] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set keep alive timeout (timeout 30000 ms) 00:15:16.238 [2024-11-20 01:16:24.395487] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:15:16.238 [2024-11-20 01:16:24.395501] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:191 cdw10:0000000f PRP1 0x0 PRP2 0x0 00:15:16.238 [2024-11-20 01:16:24.395514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0007 p:1 m:0 dnr:0 00:15:16.238 [2024-11-20 01:16:24.395523] nvme_ctrlr.c:2878:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Controller adjusted keep alive timeout to 0 ms 00:15:16.238 [2024-11-20 01:16:24.395531] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify controller iocs specific (timeout 30000 ms) 00:15:16.238 [2024-11-20 01:16:24.395541] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set number of queues (timeout 30000 ms) 00:15:16.238 [2024-11-20 01:16:24.395554] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for set number of queues (timeout 30000 ms) 00:15:16.238 [2024-11-20 01:16:24.395568] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:16.238 [2024-11-20 01:16:24.395580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:0008 p:1 m:0 dnr:0 00:15:16.238 [2024-11-20 01:16:24.395640] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify active ns (timeout 30000 ms) 00:15:16.238 [2024-11-20 01:16:24.395654] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify active ns (timeout 30000 ms) 00:15:16.238 [2024-11-20 01:16:24.395666] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f9000 len:4096 00:15:16.238 [2024-11-20 01:16:24.395674] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f9000 00:15:16.238 [2024-11-20 01:16:24.395683] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000002 cdw11:00000000 PRP1 0x2000002f9000 PRP2 0x0 00:15:16.238 [2024-11-20 01:16:24.395697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0009 p:1 m:0 dnr:0 00:15:16.238 [2024-11-20 01:16:24.395717] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Namespace 1 was added 00:15:16.238 [2024-11-20 01:16:24.395736] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify ns (timeout 30000 ms) 00:15:16.238 [2024-11-20 01:16:24.395750] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify ns (timeout 30000 ms) 00:15:16.238 [2024-11-20 01:16:24.395761] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:16.238 [2024-11-20 01:16:24.395769] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:16.238 [2024-11-20 01:16:24.395779] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000000 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:16.238 [2024-11-20 01:16:24.395801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000a p:1 m:0 dnr:0 00:15:16.238 [2024-11-20 01:16:24.395821] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:15:16.239 [2024-11-20 01:16:24.395835] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:15:16.239 [2024-11-20 01:16:24.395851] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:16.239 [2024-11-20 01:16:24.395860] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:16.239 [2024-11-20 01:16:24.395869] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:16.239 [2024-11-20 01:16:24.395881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000b p:1 m:0 dnr:0 00:15:16.239 [2024-11-20 01:16:24.395894] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify ns iocs specific (timeout 30000 ms) 00:15:16.239 [2024-11-20 01:16:24.395905] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set supported log pages (timeout 30000 ms) 00:15:16.239 [2024-11-20 01:16:24.395919] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set supported features (timeout 30000 ms) 00:15:16.239 [2024-11-20 01:16:24.395928] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set doorbell buffer config (timeout 30000 ms) 00:15:16.239 [2024-11-20 01:16:24.395936] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set host ID (timeout 30000 ms) 00:15:16.239 [2024-11-20 01:16:24.395944] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] NVMe-oF transport - not sending Set Features - Host ID 00:15:16.239 [2024-11-20 01:16:24.395951] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to transport ready (timeout 30000 ms) 00:15:16.239 [2024-11-20 01:16:24.395959] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to ready (no timeout) 00:15:16.239 [2024-11-20 01:16:24.395986] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:191 cdw10:00000001 PRP1 0x0 PRP2 0x0 00:15:16.239 [2024-11-20 01:16:24.396004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000c p:1 m:0 dnr:0 00:15:16.239 [2024-11-20 01:16:24.396023] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:191 cdw10:00000002 PRP1 0x0 PRP2 0x0 00:15:16.239 [2024-11-20 01:16:24.396035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000d p:1 m:0 dnr:0 00:15:16.239 [2024-11-20 01:16:24.396065] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:191 cdw10:00000004 PRP1 0x0 PRP2 0x0 00:15:16.239 [2024-11-20 01:16:24.396090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000e p:1 m:0 dnr:0 00:15:16.239 [2024-11-20 01:16:24.396108] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:16.239 [2024-11-20 01:16:24.396120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:000f p:1 m:0 dnr:0 00:15:16.239 [2024-11-20 01:16:24.396138] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f6000 len:8192 00:15:16.239 [2024-11-20 01:16:24.396147] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f6000 00:15:16.239 [2024-11-20 01:16:24.396153] nvme_pcie_common.c:1235:nvme_pcie_prp_list_append: *DEBUG*: prp[0] = 0x2000002f7000 00:15:16.239 [2024-11-20 01:16:24.396159] nvme_pcie_common.c:1251:nvme_pcie_prp_list_append: *DEBUG*: prp2 = 0x2000002f7000 00:15:16.239 [2024-11-20 01:16:24.396169] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:191 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 PRP1 0x2000002f6000 PRP2 0x2000002f7000 00:15:16.239 [2024-11-20 01:16:24.396180] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fc000 len:512 00:15:16.239 [2024-11-20 01:16:24.396193] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fc000 00:15:16.239 [2024-11-20 01:16:24.396203] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:186 nsid:ffffffff cdw10:007f0002 cdw11:00000000 PRP1 0x2000002fc000 PRP2 0x0 00:15:16.239 [2024-11-20 01:16:24.396214] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:512 00:15:16.239 [2024-11-20 01:16:24.396222] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:16.239 [2024-11-20 01:16:24.396231] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:185 nsid:ffffffff cdw10:007f0003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:16.239 [2024-11-20 01:16:24.396243] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f4000 len:4096 00:15:16.239 [2024-11-20 01:16:24.396251] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f4000 00:15:16.239 [2024-11-20 01:16:24.396261] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:184 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 PRP1 0x2000002f4000 PRP2 0x0 00:15:16.239 [2024-11-20 01:16:24.396272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0010 p:1 m:0 dnr:0 00:15:16.239 [2024-11-20 01:16:24.396294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:186 cdw0:0 sqhd:0011 p:1 m:0 dnr:0 00:15:16.239 [2024-11-20 01:16:24.396310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:185 cdw0:0 sqhd:0012 p:1 m:0 dnr:0 00:15:16.239 [2024-11-20 01:16:24.396322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0013 p:1 m:0 dnr:0 00:15:16.239 ===================================================== 00:15:16.239 NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:16.239 ===================================================== 00:15:16.239 Controller Capabilities/Features 00:15:16.239 ================================ 00:15:16.239 Vendor ID: 4e58 00:15:16.239 Subsystem Vendor ID: 4e58 00:15:16.239 Serial Number: SPDK1 00:15:16.239 Model Number: SPDK bdev Controller 00:15:16.239 Firmware Version: 24.01.1 00:15:16.239 Recommended Arb Burst: 6 00:15:16.239 IEEE OUI Identifier: 8d 6b 50 00:15:16.239 Multi-path I/O 00:15:16.239 May have multiple subsystem ports: Yes 00:15:16.239 May have multiple controllers: Yes 00:15:16.239 Associated with SR-IOV VF: No 00:15:16.239 Max Data Transfer Size: 131072 00:15:16.239 Max Number of Namespaces: 32 00:15:16.239 Max Number of I/O Queues: 127 00:15:16.239 NVMe Specification Version (VS): 1.3 00:15:16.239 NVMe Specification Version (Identify): 1.3 00:15:16.239 Maximum Queue Entries: 256 00:15:16.239 Contiguous Queues Required: Yes 00:15:16.239 Arbitration Mechanisms Supported 00:15:16.239 Weighted Round Robin: Not Supported 00:15:16.239 Vendor Specific: Not Supported 00:15:16.239 Reset Timeout: 15000 ms 00:15:16.239 Doorbell Stride: 4 bytes 00:15:16.239 NVM Subsystem Reset: Not Supported 00:15:16.239 Command Sets Supported 00:15:16.239 NVM Command Set: Supported 00:15:16.239 Boot Partition: Not Supported 00:15:16.239 Memory Page Size Minimum: 4096 bytes 00:15:16.239 Memory Page Size Maximum: 4096 bytes 00:15:16.239 Persistent Memory Region: Not Supported 00:15:16.239 Optional Asynchronous Events Supported 00:15:16.239 Namespace Attribute Notices: Supported 00:15:16.239 Firmware Activation Notices: Not Supported 00:15:16.239 ANA Change Notices: Not Supported 00:15:16.239 PLE Aggregate Log Change Notices: Not Supported 00:15:16.239 LBA Status Info Alert Notices: Not Supported 00:15:16.239 EGE Aggregate Log Change Notices: Not Supported 00:15:16.239 Normal NVM Subsystem Shutdown event: Not Supported 00:15:16.239 Zone Descriptor Change Notices: Not Supported 00:15:16.239 Discovery Log Change Notices: Not Supported 00:15:16.239 Controller Attributes 00:15:16.239 128-bit Host Identifier: Supported 00:15:16.239 Non-Operational Permissive Mode: Not Supported 00:15:16.239 NVM Sets: Not Supported 00:15:16.239 Read Recovery Levels: Not Supported 00:15:16.239 Endurance Groups: Not Supported 00:15:16.239 Predictable Latency Mode: Not Supported 00:15:16.239 Traffic Based Keep ALive: Not Supported 00:15:16.239 Namespace Granularity: Not Supported 00:15:16.239 SQ Associations: Not Supported 00:15:16.239 UUID List: Not Supported 00:15:16.239 Multi-Domain Subsystem: Not Supported 00:15:16.239 Fixed Capacity Management: Not Supported 00:15:16.239 Variable Capacity Management: Not Supported 00:15:16.239 Delete Endurance Group: Not Supported 00:15:16.239 Delete NVM Set: Not Supported 00:15:16.239 Extended LBA Formats Supported: Not Supported 00:15:16.239 Flexible Data Placement Supported: Not Supported 00:15:16.239 00:15:16.239 Controller Memory Buffer Support 00:15:16.239 ================================ 00:15:16.239 Supported: No 00:15:16.239 00:15:16.239 Persistent Memory Region Support 00:15:16.239 ================================ 00:15:16.239 Supported: No 00:15:16.239 00:15:16.239 Admin Command Set Attributes 00:15:16.239 ============================ 00:15:16.239 Security Send/Receive: Not Supported 00:15:16.239 Format NVM: Not Supported 00:15:16.239 Firmware Activate/Download: Not Supported 00:15:16.239 Namespace Management: Not Supported 00:15:16.239 Device Self-Test: Not Supported 00:15:16.239 Directives: Not Supported 00:15:16.239 NVMe-MI: Not Supported 00:15:16.239 Virtualization Management: Not Supported 00:15:16.239 Doorbell Buffer Config: Not Supported 00:15:16.239 Get LBA Status Capability: Not Supported 00:15:16.239 Command & Feature Lockdown Capability: Not Supported 00:15:16.239 Abort Command Limit: 4 00:15:16.239 Async Event Request Limit: 4 00:15:16.239 Number of Firmware Slots: N/A 00:15:16.239 Firmware Slot 1 Read-Only: N/A 00:15:16.239 Firmware Activation Without Reset: N/A 00:15:16.239 Multiple Update Detection Support: N/A 00:15:16.239 Firmware Update Granularity: No Information Provided 00:15:16.239 Per-Namespace SMART Log: No 00:15:16.239 Asymmetric Namespace Access Log Page: Not Supported 00:15:16.239 Subsystem NQN: nqn.2019-07.io.spdk:cnode1 00:15:16.240 Command Effects Log Page: Supported 00:15:16.240 Get Log Page Extended Data: Supported 00:15:16.240 Telemetry Log Pages: Not Supported 00:15:16.240 Persistent Event Log Pages: Not Supported 00:15:16.240 Supported Log Pages Log Page: May Support 00:15:16.240 Commands Supported & Effects Log Page: Not Supported 00:15:16.240 Feature Identifiers & Effects Log Page:May Support 00:15:16.240 NVMe-MI Commands & Effects Log Page: May Support 00:15:16.240 Data Area 4 for Telemetry Log: Not Supported 00:15:16.240 Error Log Page Entries Supported: 128 00:15:16.240 Keep Alive: Supported 00:15:16.240 Keep Alive Granularity: 10000 ms 00:15:16.240 00:15:16.240 NVM Command Set Attributes 00:15:16.240 ========================== 00:15:16.240 Submission Queue Entry Size 00:15:16.240 Max: 64 00:15:16.240 Min: 64 00:15:16.240 Completion Queue Entry Size 00:15:16.240 Max: 16 00:15:16.240 Min: 16 00:15:16.240 Number of Namespaces: 32 00:15:16.240 Compare Command: Supported 00:15:16.240 Write Uncorrectable Command: Not Supported 00:15:16.240 Dataset Management Command: Supported 00:15:16.240 Write Zeroes Command: Supported 00:15:16.240 Set Features Save Field: Not Supported 00:15:16.240 Reservations: Not Supported 00:15:16.240 Timestamp: Not Supported 00:15:16.240 Copy: Supported 00:15:16.240 Volatile Write Cache: Present 00:15:16.240 Atomic Write Unit (Normal): 1 00:15:16.240 Atomic Write Unit (PFail): 1 00:15:16.240 Atomic Compare & Write Unit: 1 00:15:16.240 Fused Compare & Write: Supported 00:15:16.240 Scatter-Gather List 00:15:16.240 SGL Command Set: Supported (Dword aligned) 00:15:16.240 SGL Keyed: Not Supported 00:15:16.240 SGL Bit Bucket Descriptor: Not Supported 00:15:16.240 SGL Metadata Pointer: Not Supported 00:15:16.240 Oversized SGL: Not Supported 00:15:16.240 SGL Metadata Address: Not Supported 00:15:16.240 SGL Offset: Not Supported 00:15:16.240 Transport SGL Data Block: Not Supported 00:15:16.240 Replay Protected Memory Block: Not Supported 00:15:16.240 00:15:16.240 Firmware Slot Information 00:15:16.240 ========================= 00:15:16.240 Active slot: 1 00:15:16.240 Slot 1 Firmware Revision: 24.01.1 00:15:16.240 00:15:16.240 00:15:16.240 Commands Supported and Effects 00:15:16.240 ============================== 00:15:16.240 Admin Commands 00:15:16.240 -------------- 00:15:16.240 Get Log Page (02h): Supported 00:15:16.240 Identify (06h): Supported 00:15:16.240 Abort (08h): Supported 00:15:16.240 Set Features (09h): Supported 00:15:16.240 Get Features (0Ah): Supported 00:15:16.240 Asynchronous Event Request (0Ch): Supported 00:15:16.240 Keep Alive (18h): Supported 00:15:16.240 I/O Commands 00:15:16.240 ------------ 00:15:16.240 Flush (00h): Supported LBA-Change 00:15:16.240 Write (01h): Supported LBA-Change 00:15:16.240 Read (02h): Supported 00:15:16.240 Compare (05h): Supported 00:15:16.240 Write Zeroes (08h): Supported LBA-Change 00:15:16.240 Dataset Management (09h): Supported LBA-Change 00:15:16.240 Copy (19h): Supported LBA-Change 00:15:16.240 Unknown (79h): Supported LBA-Change 00:15:16.240 Unknown (7Ah): Supported 00:15:16.240 00:15:16.240 Error Log 00:15:16.240 ========= 00:15:16.240 00:15:16.240 Arbitration 00:15:16.240 =========== 00:15:16.240 Arbitration Burst: 1 00:15:16.240 00:15:16.240 Power Management 00:15:16.240 ================ 00:15:16.240 Number of Power States: 1 00:15:16.240 Current Power State: Power State #0 00:15:16.240 Power State #0: 00:15:16.240 Max Power: 0.00 W 00:15:16.240 Non-Operational State: Operational 00:15:16.240 Entry Latency: Not Reported 00:15:16.240 Exit Latency: Not Reported 00:15:16.240 Relative Read Throughput: 0 00:15:16.240 Relative Read Latency: 0 00:15:16.240 Relative Write Throughput: 0 00:15:16.240 Relative Write Latency: 0 00:15:16.240 Idle Power: Not Reported 00:15:16.240 Active Power: Not Reported 00:15:16.240 Non-Operational Permissive Mode: Not Supported 00:15:16.240 00:15:16.240 Health Information 00:15:16.240 ================== 00:15:16.240 Critical Warnings: 00:15:16.240 Available Spare Space: OK 00:15:16.240 Temperature: OK 00:15:16.240 Device Reliability: OK 00:15:16.240 Read Only: No 00:15:16.240 Volatile Memory Backup: OK 00:15:16.240 Current Temperature: 0 Kelvin[2024-11-20 01:16:24.396471] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:184 cdw10:00000005 PRP1 0x0 PRP2 0x0 00:15:16.240 [2024-11-20 01:16:24.396488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0014 p:1 m:0 dnr:0 00:15:16.240 [2024-11-20 01:16:24.396526] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Prepare to destruct SSD 00:15:16.240 [2024-11-20 01:16:24.396542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:190 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:16.240 [2024-11-20 01:16:24.396553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:189 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:16.240 [2024-11-20 01:16:24.396563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:188 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:16.240 [2024-11-20 01:16:24.396572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:187 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:16.240 [2024-11-20 01:16:24.397016] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x460001 00:15:16.240 [2024-11-20 01:16:24.397036] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x464001 00:15:16.240 [2024-11-20 01:16:24.398084] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] RTD3E = 0 us 00:15:16.240 [2024-11-20 01:16:24.398097] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] shutdown timeout = 10000 ms 00:15:16.240 [2024-11-20 01:16:24.399026] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x9 00:15:16.240 [2024-11-20 01:16:24.399047] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] shutdown complete in 0 milliseconds 00:15:16.240 [2024-11-20 01:16:24.399124] vfio_user_pci.c: 399:spdk_vfio_user_release: *DEBUG*: Release file /var/run/vfio-user/domain/vfio-user1/1/cntrl 00:15:16.240 [2024-11-20 01:16:24.401088] vfio_user_pci.c: 96:vfio_remove_mr: *DEBUG*: Remove memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:16.240 (-273 Celsius) 00:15:16.240 Temperature Threshold: 0 Kelvin (-273 Celsius) 00:15:16.240 Available Spare: 0% 00:15:16.240 Available Spare Threshold: 0% 00:15:16.240 Life Percentage Used: 0% 00:15:16.240 Data Units Read: 0 00:15:16.240 Data Units Written: 0 00:15:16.240 Host Read Commands: 0 00:15:16.240 Host Write Commands: 0 00:15:16.240 Controller Busy Time: 0 minutes 00:15:16.240 Power Cycles: 0 00:15:16.240 Power On Hours: 0 hours 00:15:16.240 Unsafe Shutdowns: 0 00:15:16.240 Unrecoverable Media Errors: 0 00:15:16.240 Lifetime Error Log Entries: 0 00:15:16.240 Warning Temperature Time: 0 minutes 00:15:16.240 Critical Temperature Time: 0 minutes 00:15:16.240 00:15:16.240 Number of Queues 00:15:16.240 ================ 00:15:16.240 Number of I/O Submission Queues: 127 00:15:16.240 Number of I/O Completion Queues: 127 00:15:16.240 00:15:16.240 Active Namespaces 00:15:16.240 ================= 00:15:16.240 Namespace ID:1 00:15:16.240 Error Recovery Timeout: Unlimited 00:15:16.240 Command Set Identifier: NVM (00h) 00:15:16.240 Deallocate: Supported 00:15:16.240 Deallocated/Unwritten Error: Not Supported 00:15:16.240 Deallocated Read Value: Unknown 00:15:16.240 Deallocate in Write Zeroes: Not Supported 00:15:16.240 Deallocated Guard Field: 0xFFFF 00:15:16.240 Flush: Supported 00:15:16.240 Reservation: Supported 00:15:16.240 Namespace Sharing Capabilities: Multiple Controllers 00:15:16.240 Size (in LBAs): 131072 (0GiB) 00:15:16.240 Capacity (in LBAs): 131072 (0GiB) 00:15:16.240 Utilization (in LBAs): 131072 (0GiB) 00:15:16.240 NGUID: 3EF4B6BFC5B74326A2DDF07DB5C46693 00:15:16.240 UUID: 3ef4b6bf-c5b7-4326-a2dd-f07db5c46693 00:15:16.240 Thin Provisioning: Not Supported 00:15:16.240 Per-NS Atomic Units: Yes 00:15:16.240 Atomic Boundary Size (Normal): 0 00:15:16.240 Atomic Boundary Size (PFail): 0 00:15:16.240 Atomic Boundary Offset: 0 00:15:16.240 Maximum Single Source Range Length: 65535 00:15:16.240 Maximum Copy Length: 65535 00:15:16.240 Maximum Source Range Count: 1 00:15:16.240 NGUID/EUI64 Never Reused: No 00:15:16.240 Namespace Write Protected: No 00:15:16.240 Number of LBA Formats: 1 00:15:16.240 Current LBA Format: LBA Format #00 00:15:16.240 LBA Format #00: Data Size: 512 Metadata Size: 0 00:15:16.240 00:15:16.240 01:16:24 -- target/nvmf_vfio_user.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -s 256 -g -q 128 -o 4096 -w read -t 5 -c 0x2 00:15:16.501 EAL: No free 2048 kB hugepages reported on node 1 00:15:21.781 Initializing NVMe Controllers 00:15:21.781 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:21.781 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 with lcore 1 00:15:21.781 Initialization complete. Launching workers. 00:15:21.781 ======================================================== 00:15:21.781 Latency(us) 00:15:21.781 Device Information : IOPS MiB/s Average min max 00:15:21.781 VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 from core 1: 38226.97 149.32 3348.22 1143.02 8445.54 00:15:21.781 ======================================================== 00:15:21.781 Total : 38226.97 149.32 3348.22 1143.02 8445.54 00:15:21.781 00:15:21.781 01:16:29 -- target/nvmf_vfio_user.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -s 256 -g -q 128 -o 4096 -w write -t 5 -c 0x2 00:15:21.781 EAL: No free 2048 kB hugepages reported on node 1 00:15:27.054 Initializing NVMe Controllers 00:15:27.054 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:27.054 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 with lcore 1 00:15:27.054 Initialization complete. Launching workers. 00:15:27.054 ======================================================== 00:15:27.054 Latency(us) 00:15:27.054 Device Information : IOPS MiB/s Average min max 00:15:27.054 VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 from core 1: 16039.28 62.65 7979.71 5995.27 11973.81 00:15:27.054 ======================================================== 00:15:27.054 Total : 16039.28 62.65 7979.71 5995.27 11973.81 00:15:27.054 00:15:27.054 01:16:34 -- target/nvmf_vfio_user.sh@86 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -g -q 32 -o 4096 -w randrw -M 50 -t 5 -c 0xE 00:15:27.054 EAL: No free 2048 kB hugepages reported on node 1 00:15:32.331 Initializing NVMe Controllers 00:15:32.331 Attaching to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:32.331 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:32.331 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 1 00:15:32.331 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 2 00:15:32.331 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 3 00:15:32.331 Initialization complete. Launching workers. 00:15:32.331 Starting thread on core 2 00:15:32.331 Starting thread on core 3 00:15:32.331 Starting thread on core 1 00:15:32.331 01:16:40 -- target/nvmf_vfio_user.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -t 3 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -d 256 -g 00:15:32.331 EAL: No free 2048 kB hugepages reported on node 1 00:15:35.625 Initializing NVMe Controllers 00:15:35.625 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:15:35.625 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:15:35.625 Associating SPDK bdev Controller (SPDK1 ) with lcore 0 00:15:35.625 Associating SPDK bdev Controller (SPDK1 ) with lcore 1 00:15:35.625 Associating SPDK bdev Controller (SPDK1 ) with lcore 2 00:15:35.625 Associating SPDK bdev Controller (SPDK1 ) with lcore 3 00:15:35.625 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration run with configuration: 00:15:35.625 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -q 64 -s 131072 -w randrw -M 50 -l 0 -t 3 -c 0xf -m 0 -a 0 -b 0 -n 100000 -i -1 00:15:35.625 Initialization complete. Launching workers. 00:15:35.625 Starting thread on core 1 with urgent priority queue 00:15:35.625 Starting thread on core 2 with urgent priority queue 00:15:35.625 Starting thread on core 3 with urgent priority queue 00:15:35.625 Starting thread on core 0 with urgent priority queue 00:15:35.625 SPDK bdev Controller (SPDK1 ) core 0: 4748.33 IO/s 21.06 secs/100000 ios 00:15:35.625 SPDK bdev Controller (SPDK1 ) core 1: 5121.33 IO/s 19.53 secs/100000 ios 00:15:35.625 SPDK bdev Controller (SPDK1 ) core 2: 5246.00 IO/s 19.06 secs/100000 ios 00:15:35.625 SPDK bdev Controller (SPDK1 ) core 3: 5248.33 IO/s 19.05 secs/100000 ios 00:15:35.625 ======================================================== 00:15:35.625 00:15:35.625 01:16:43 -- target/nvmf_vfio_user.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/hello_world -d 256 -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' 00:15:35.625 EAL: No free 2048 kB hugepages reported on node 1 00:15:35.883 Initializing NVMe Controllers 00:15:35.883 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:15:35.883 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:15:35.883 Namespace ID: 1 size: 0GB 00:15:35.883 Initialization complete. 00:15:35.883 INFO: using host memory buffer for IO 00:15:35.883 Hello world! 00:15:35.883 01:16:43 -- target/nvmf_vfio_user.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/overhead/overhead -o 4096 -t 1 -H -g -d 256 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' 00:15:35.883 EAL: No free 2048 kB hugepages reported on node 1 00:15:37.266 Initializing NVMe Controllers 00:15:37.266 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:15:37.266 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:15:37.266 Initialization complete. Launching workers. 00:15:37.266 submit (in ns) avg, min, max = 7058.2, 3456.7, 4017081.1 00:15:37.266 complete (in ns) avg, min, max = 26253.4, 2041.1, 4017322.2 00:15:37.266 00:15:37.266 Submit histogram 00:15:37.266 ================ 00:15:37.266 Range in us Cumulative Count 00:15:37.266 3.437 - 3.461: 0.0217% ( 3) 00:15:37.266 3.461 - 3.484: 0.5072% ( 67) 00:15:37.266 3.484 - 3.508: 1.6665% ( 160) 00:15:37.266 3.508 - 3.532: 4.8475% ( 439) 00:15:37.266 3.532 - 3.556: 10.9340% ( 840) 00:15:37.266 3.556 - 3.579: 19.9478% ( 1244) 00:15:37.266 3.579 - 3.603: 30.1065% ( 1402) 00:15:37.266 3.603 - 3.627: 39.2001% ( 1255) 00:15:37.266 3.627 - 3.650: 47.7574% ( 1181) 00:15:37.266 3.650 - 3.674: 53.2208% ( 754) 00:15:37.266 3.674 - 3.698: 58.0248% ( 663) 00:15:37.266 3.698 - 3.721: 62.5462% ( 624) 00:15:37.266 3.721 - 3.745: 65.8141% ( 451) 00:15:37.266 3.745 - 3.769: 69.3138% ( 483) 00:15:37.266 3.769 - 3.793: 72.4730% ( 436) 00:15:37.266 3.793 - 3.816: 76.4945% ( 555) 00:15:37.266 3.816 - 3.840: 80.7188% ( 583) 00:15:37.266 3.840 - 3.864: 84.4359% ( 513) 00:15:37.266 3.864 - 3.887: 86.7908% ( 325) 00:15:37.266 3.887 - 3.911: 88.4718% ( 232) 00:15:37.266 3.911 - 3.935: 90.1167% ( 227) 00:15:37.266 3.935 - 3.959: 91.3485% ( 170) 00:15:37.266 3.959 - 3.982: 92.4933% ( 158) 00:15:37.266 3.982 - 4.006: 93.3845% ( 123) 00:15:37.266 4.006 - 4.030: 94.1454% ( 105) 00:15:37.266 4.030 - 4.053: 94.9496% ( 111) 00:15:37.266 4.053 - 4.077: 95.5510% ( 83) 00:15:37.266 4.077 - 4.101: 96.0655% ( 71) 00:15:37.266 4.101 - 4.124: 96.3626% ( 41) 00:15:37.266 4.124 - 4.148: 96.6814% ( 44) 00:15:37.266 4.148 - 4.172: 96.8408% ( 22) 00:15:37.266 4.172 - 4.196: 97.0075% ( 23) 00:15:37.266 4.196 - 4.219: 97.1306% ( 17) 00:15:37.266 4.219 - 4.243: 97.2248% ( 13) 00:15:37.266 4.243 - 4.267: 97.2973% ( 10) 00:15:37.266 4.267 - 4.290: 97.3987% ( 14) 00:15:37.266 4.290 - 4.314: 97.4640% ( 9) 00:15:37.266 4.314 - 4.338: 97.5147% ( 7) 00:15:37.266 4.338 - 4.361: 97.5509% ( 5) 00:15:37.266 4.361 - 4.385: 97.5799% ( 4) 00:15:37.266 4.385 - 4.409: 97.6016% ( 3) 00:15:37.266 4.409 - 4.433: 97.6161% ( 2) 00:15:37.266 4.456 - 4.480: 97.6379% ( 3) 00:15:37.266 4.480 - 4.504: 97.6668% ( 4) 00:15:37.266 4.527 - 4.551: 97.6741% ( 1) 00:15:37.266 4.551 - 4.575: 97.7176% ( 6) 00:15:37.266 4.575 - 4.599: 97.7320% ( 2) 00:15:37.266 4.599 - 4.622: 97.7683% ( 5) 00:15:37.266 4.622 - 4.646: 97.7973% ( 4) 00:15:37.266 4.646 - 4.670: 97.8262% ( 4) 00:15:37.266 4.670 - 4.693: 97.8842% ( 8) 00:15:37.266 4.693 - 4.717: 97.9567% ( 10) 00:15:37.266 4.717 - 4.741: 98.0074% ( 7) 00:15:37.266 4.741 - 4.764: 98.0436% ( 5) 00:15:37.266 4.764 - 4.788: 98.0798% ( 5) 00:15:37.266 4.788 - 4.812: 98.1378% ( 8) 00:15:37.266 4.812 - 4.836: 98.1958% ( 8) 00:15:37.266 4.836 - 4.859: 98.2393% ( 6) 00:15:37.266 4.859 - 4.883: 98.2900% ( 7) 00:15:37.266 4.883 - 4.907: 98.3190% ( 4) 00:15:37.266 4.907 - 4.930: 98.3624% ( 6) 00:15:37.266 4.930 - 4.954: 98.3914% ( 4) 00:15:37.266 4.954 - 4.978: 98.4132% ( 3) 00:15:37.266 4.978 - 5.001: 98.4204% ( 1) 00:15:37.266 5.001 - 5.025: 98.4494% ( 4) 00:15:37.266 5.049 - 5.073: 98.4566% ( 1) 00:15:37.266 5.073 - 5.096: 98.4639% ( 1) 00:15:37.266 5.120 - 5.144: 98.4711% ( 1) 00:15:37.266 5.144 - 5.167: 98.4784% ( 1) 00:15:37.266 5.167 - 5.191: 98.4856% ( 1) 00:15:37.266 5.215 - 5.239: 98.4929% ( 1) 00:15:37.266 5.262 - 5.286: 98.5074% ( 2) 00:15:37.266 5.879 - 5.902: 98.5146% ( 1) 00:15:37.266 6.400 - 6.447: 98.5218% ( 1) 00:15:37.266 6.447 - 6.495: 98.5291% ( 1) 00:15:37.266 6.590 - 6.637: 98.5363% ( 1) 00:15:37.266 6.827 - 6.874: 98.5508% ( 2) 00:15:37.266 7.159 - 7.206: 98.5581% ( 1) 00:15:37.266 7.301 - 7.348: 98.5653% ( 1) 00:15:37.266 7.396 - 7.443: 98.5726% ( 1) 00:15:37.266 7.443 - 7.490: 98.5798% ( 1) 00:15:37.266 7.490 - 7.538: 98.5871% ( 1) 00:15:37.266 7.633 - 7.680: 98.5943% ( 1) 00:15:37.266 7.822 - 7.870: 98.6016% ( 1) 00:15:37.266 7.870 - 7.917: 98.6160% ( 2) 00:15:37.266 7.917 - 7.964: 98.6233% ( 1) 00:15:37.266 7.964 - 8.012: 98.6305% ( 1) 00:15:37.266 8.059 - 8.107: 98.6450% ( 2) 00:15:37.266 8.107 - 8.154: 98.6595% ( 2) 00:15:37.266 8.154 - 8.201: 98.6668% ( 1) 00:15:37.266 8.201 - 8.249: 98.6885% ( 3) 00:15:37.266 8.249 - 8.296: 98.6957% ( 1) 00:15:37.266 8.296 - 8.344: 98.7102% ( 2) 00:15:37.266 8.344 - 8.391: 98.7320% ( 3) 00:15:37.266 8.439 - 8.486: 98.7392% ( 1) 00:15:37.266 8.486 - 8.533: 98.7537% ( 2) 00:15:37.266 8.533 - 8.581: 98.7610% ( 1) 00:15:37.266 8.676 - 8.723: 98.7682% ( 1) 00:15:37.266 8.723 - 8.770: 98.7755% ( 1) 00:15:37.266 8.770 - 8.818: 98.7827% ( 1) 00:15:37.266 8.818 - 8.865: 98.7899% ( 1) 00:15:37.266 8.913 - 8.960: 98.8044% ( 2) 00:15:37.266 8.960 - 9.007: 98.8189% ( 2) 00:15:37.266 9.007 - 9.055: 98.8262% ( 1) 00:15:37.266 9.150 - 9.197: 98.8334% ( 1) 00:15:37.266 9.197 - 9.244: 98.8407% ( 1) 00:15:37.266 9.481 - 9.529: 98.8479% ( 1) 00:15:37.266 9.956 - 10.003: 98.8552% ( 1) 00:15:37.266 10.193 - 10.240: 98.8624% ( 1) 00:15:37.266 10.287 - 10.335: 98.8696% ( 1) 00:15:37.266 10.430 - 10.477: 98.8769% ( 1) 00:15:37.266 10.524 - 10.572: 98.8914% ( 2) 00:15:37.266 10.572 - 10.619: 98.8986% ( 1) 00:15:37.266 10.619 - 10.667: 98.9059% ( 1) 00:15:37.266 10.714 - 10.761: 98.9204% ( 2) 00:15:37.266 10.809 - 10.856: 98.9276% ( 1) 00:15:37.266 10.951 - 10.999: 98.9349% ( 1) 00:15:37.266 11.141 - 11.188: 98.9421% ( 1) 00:15:37.266 11.330 - 11.378: 98.9494% ( 1) 00:15:37.266 11.425 - 11.473: 98.9566% ( 1) 00:15:37.266 11.567 - 11.615: 98.9638% ( 1) 00:15:37.266 11.852 - 11.899: 98.9711% ( 1) 00:15:37.266 12.610 - 12.705: 98.9856% ( 2) 00:15:37.266 12.895 - 12.990: 98.9928% ( 1) 00:15:37.266 13.653 - 13.748: 99.0001% ( 1) 00:15:37.266 14.033 - 14.127: 99.0146% ( 2) 00:15:37.266 14.317 - 14.412: 99.0291% ( 2) 00:15:37.266 14.412 - 14.507: 99.0363% ( 1) 00:15:37.266 14.696 - 14.791: 99.0435% ( 1) 00:15:37.266 14.981 - 15.076: 99.0508% ( 1) 00:15:37.266 15.170 - 15.265: 99.0580% ( 1) 00:15:37.266 16.972 - 17.067: 99.0653% ( 1) 00:15:37.266 17.067 - 17.161: 99.0725% ( 1) 00:15:37.266 17.161 - 17.256: 99.1015% ( 4) 00:15:37.267 17.256 - 17.351: 99.1088% ( 1) 00:15:37.267 17.351 - 17.446: 99.1233% ( 2) 00:15:37.267 17.446 - 17.541: 99.1305% ( 1) 00:15:37.267 17.541 - 17.636: 99.1667% ( 5) 00:15:37.267 17.636 - 17.730: 99.1957% ( 4) 00:15:37.267 17.730 - 17.825: 99.2102% ( 2) 00:15:37.267 17.825 - 17.920: 99.2537% ( 6) 00:15:37.267 17.920 - 18.015: 99.3261% ( 10) 00:15:37.267 18.015 - 18.110: 99.4276% ( 14) 00:15:37.267 18.110 - 18.204: 99.5073% ( 11) 00:15:37.267 18.204 - 18.299: 99.5652% ( 8) 00:15:37.267 18.299 - 18.394: 99.6160% ( 7) 00:15:37.267 18.394 - 18.489: 99.6667% ( 7) 00:15:37.267 18.489 - 18.584: 99.7319% ( 9) 00:15:37.267 18.584 - 18.679: 99.7681% ( 5) 00:15:37.267 18.679 - 18.773: 99.7971% ( 4) 00:15:37.267 18.773 - 18.868: 99.8333% ( 5) 00:15:37.267 18.868 - 18.963: 99.8478% ( 2) 00:15:37.267 18.963 - 19.058: 99.8623% ( 2) 00:15:37.267 19.058 - 19.153: 99.8696% ( 1) 00:15:37.267 19.153 - 19.247: 99.8841% ( 2) 00:15:37.267 19.816 - 19.911: 99.8913% ( 1) 00:15:37.267 21.618 - 21.713: 99.8986% ( 1) 00:15:37.267 21.713 - 21.807: 99.9058% ( 1) 00:15:37.267 28.065 - 28.255: 99.9130% ( 1) 00:15:37.267 28.634 - 28.824: 99.9203% ( 1) 00:15:37.267 3980.705 - 4004.978: 99.9783% ( 8) 00:15:37.267 4004.978 - 4029.250: 100.0000% ( 3) 00:15:37.267 00:15:37.267 Complete histogram 00:15:37.267 ================== 00:15:37.267 Range in us Cumulative Count 00:15:37.267 2.039 - 2.050: 4.2098% ( 581) 00:15:37.267 2.050 - 2.062: 16.1945% ( 1654) 00:15:37.267 2.062 - 2.074: 18.1364% ( 268) 00:15:37.267 2.074 - 2.086: 39.6276% ( 2966) 00:15:37.267 2.086 - 2.098: 59.9667% ( 2807) 00:15:37.267 2.098 - 2.110: 62.2491% ( 315) 00:15:37.267 2.110 - 2.121: 65.7054% ( 477) 00:15:37.267 2.121 - 2.133: 67.5893% ( 260) 00:15:37.267 2.133 - 2.145: 69.2414% ( 228) 00:15:37.267 2.145 - 2.157: 78.9073% ( 1334) 00:15:37.267 2.157 - 2.169: 83.2114% ( 594) 00:15:37.267 2.169 - 2.181: 84.2765% ( 147) 00:15:37.267 2.181 - 2.193: 86.3488% ( 286) 00:15:37.267 2.193 - 2.204: 87.4647% ( 154) 00:15:37.267 2.204 - 2.216: 88.5443% ( 149) 00:15:37.267 2.216 - 2.228: 92.8194% ( 590) 00:15:37.267 2.228 - 2.240: 94.4424% ( 224) 00:15:37.267 2.240 - 2.252: 94.7830% ( 47) 00:15:37.267 2.252 - 2.264: 95.2467% ( 64) 00:15:37.267 2.264 - 2.276: 95.4061% ( 22) 00:15:37.267 2.276 - 2.287: 95.7467% ( 47) 00:15:37.267 2.287 - 2.299: 96.1090% ( 50) 00:15:37.267 2.299 - 2.311: 96.1959% ( 12) 00:15:37.267 2.311 - 2.323: 96.2394% ( 6) 00:15:37.267 2.323 - 2.335: 96.3843% ( 20) 00:15:37.267 2.335 - 2.347: 96.5292% ( 20) 00:15:37.267 2.347 - 2.359: 96.6597% ( 18) 00:15:37.267 2.359 - 2.370: 96.8843% ( 31) 00:15:37.267 2.370 - 2.382: 97.1451% ( 36) 00:15:37.267 2.382 - 2.394: 97.3553% ( 29) 00:15:37.267 2.394 - 2.406: 97.5437% ( 26) 00:15:37.267 2.406 - 2.418: 97.7393% ( 27) 00:15:37.267 2.418 - 2.430: 97.8842% ( 20) 00:15:37.267 2.430 - 2.441: 98.0146% ( 18) 00:15:37.267 2.441 - 2.453: 98.1596% ( 20) 00:15:37.267 2.453 - 2.465: 98.2610% ( 14) 00:15:37.267 2.465 - 2.477: 98.3190% ( 8) 00:15:37.267 2.477 - 2.489: 98.3987% ( 11) 00:15:37.267 2.489 - 2.501: 98.4349% ( 5) 00:15:37.267 2.501 - 2.513: 98.4784% ( 6) 00:15:37.267 2.513 - 2.524: 98.5436% ( 9) 00:15:37.267 2.524 - 2.536: 98.5653% ( 3) 00:15:37.267 2.536 - 2.548: 98.5871% ( 3) 00:15:37.267 2.548 - 2.560: 98.5943% ( 1) 00:15:37.267 2.584 - 2.596: 98.6088% ( 2) 00:15:37.267 2.690 - 2.702: 98.6160% ( 1) 00:15:37.267 3.129 - 3.153: 98.6233% ( 1) 00:15:37.267 3.153 - 3.176: 98.6305% ( 1) 00:15:37.267 3.200 - 3.224: 98.6378% ( 1) 00:15:37.267 3.247 - 3.271: 98.6523% ( 2) 00:15:37.267 3.295 - 3.319: 98.6595% ( 1) 00:15:37.267 3.342 - 3.366: 98.6668% ( 1) 00:15:37.267 3.366 - 3.390: 98.6813% ( 2) 00:15:37.267 3.390 - 3.413: 98.6885% ( 1) 00:15:37.267 3.413 - 3.437: 98.7030% ( 2) 00:15:37.267 3.437 - 3.461: 98.7320% ( 4) 00:15:37.267 3.461 - 3.484: 98.7392% ( 1) 00:15:37.267 3.484 - 3.508: 98.7465% ( 1) 00:15:37.267 3.532 - 3.556: 98.7537% ( 1) 00:15:37.267 3.556 - 3.579: 98.7755% ( 3) 00:15:37.267 3.603 - 3.627: 98.7827% ( 1) 00:15:37.267 3.721 - 3.745: 98.7899% ( 1) 00:15:37.267 3.745 - 3.769: 98.7972% ( 1) 00:15:37.267 3.793 - 3.816: 98.8044% ( 1) 00:15:37.267 4.030 - 4.053: 98.8117% ( 1) 00:15:37.267 5.665 - 5.689: 98.8189% ( 1) 00:15:37.267 5.689 - 5.713: 98.8334% ( 2) 00:15:37.267 6.163 - 6.210: 98.8407% ( 1) 00:15:37.267 6.353 - 6.400: 98.8479% ( 1) 00:15:37.267 6.542 - 6.590: 98.8552% ( 1) 00:15:37.267 6.637 - 6.684: 98.8624% ( 1) 00:15:37.267 6.921 - 6.969: 98.8769% ( 2) 00:15:37.267 6.969 - 7.016: 98.8841% ( 1) 00:15:37.267 7.064 - 7.111: 98.8914% ( 1) 00:15:37.267 7.301 - 7.348: 98.8986% ( 1) 00:15:37.267 7.396 - 7.443: 98.9059% ( 1) 00:15:37.267 7.585 - 7.633: 98.9131% ( 1) 00:15:37.267 8.012 - 8.059: 98.9204% ( 1) 00:15:37.267 9.861 - 9.908: 98.9276% ( 1) 00:15:37.267 11.615 - 11.662: 98.9349% ( 1) 00:15:37.267 15.455 - 15.550: 98.9421% ( 1) 00:15:37.267 15.644 - 15.739: 98.9494% ( 1) 00:15:37.267 15.739 - 15.834: 98.9566% ( 1) 00:15:37.267 15.834 - 15.929: 98.9638% ( 1) 00:15:37.267 15.929 - 16.024: 98.9856% ( 3) 00:15:37.267 16.024 - 16.119: 99.0146% ( 4) 00:15:37.267 16.119 - 16.213: 99.0291% ( 2) 00:15:37.267 16.213 - 16.308: 99.0943% ( 9) 00:15:37.267 16.308 - 16.403: 99.1088% ( 2) 00:15:37.267 16.403 - 16.498: 99.1450% ( 5) 00:15:37.267 16.498 - 16.593: 99.1812% ( 5) 00:15:37.267 16.593 - 16.687: 99.2102% ( 4) 00:15:37.267 16.687 - 16.782: 99.2319% ( 3) 00:15:37.267 16.782 - 16.877: 99.2972% ( 9) 00:15:37.267 16.877 - 16.972: 99.3189% ( 3) 00:15:37.267 16.972 - 17.067: 99.3406% ( 3) 00:15:37.267 17.067 - 17.161: 99.3551% ( 2) 00:15:37.267 17.256 - 17.351: 99.3624% ( 1) 00:15:37.267 17.446 - 17.541: 99.3696% ( 1) 00:15:37.267 17.920 - 18.015: 99.3769% ( 1) 00:15:37.267 18.110 - 18.204: 99.3841% ( 1) 00:15:37.267 18.394 - 18.489: 99.3986% ( 2) 00:15:37.267 3980.705 - 4004.978: 99.8768% ( 66) 00:15:37.267 4004.978 - 4029.250: 100.0000% ( 17) 00:15:37.267 00:15:37.267 01:16:45 -- target/nvmf_vfio_user.sh@90 -- # aer_vfio_user /var/run/vfio-user/domain/vfio-user1/1 nqn.2019-07.io.spdk:cnode1 1 00:15:37.267 01:16:45 -- target/nvmf_vfio_user.sh@22 -- # local traddr=/var/run/vfio-user/domain/vfio-user1/1 00:15:37.267 01:16:45 -- target/nvmf_vfio_user.sh@23 -- # local subnqn=nqn.2019-07.io.spdk:cnode1 00:15:37.267 01:16:45 -- target/nvmf_vfio_user.sh@24 -- # local malloc_num=Malloc3 00:15:37.267 01:16:45 -- target/nvmf_vfio_user.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:15:37.526 [2024-11-20 01:16:45.502690] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:15:37.526 [ 00:15:37.526 { 00:15:37.526 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:15:37.526 "subtype": "Discovery", 00:15:37.526 "listen_addresses": [], 00:15:37.526 "allow_any_host": true, 00:15:37.526 "hosts": [] 00:15:37.526 }, 00:15:37.526 { 00:15:37.526 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:15:37.526 "subtype": "NVMe", 00:15:37.526 "listen_addresses": [ 00:15:37.526 { 00:15:37.526 "transport": "VFIOUSER", 00:15:37.526 "trtype": "VFIOUSER", 00:15:37.526 "adrfam": "IPv4", 00:15:37.526 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:15:37.526 "trsvcid": "0" 00:15:37.526 } 00:15:37.526 ], 00:15:37.526 "allow_any_host": true, 00:15:37.526 "hosts": [], 00:15:37.526 "serial_number": "SPDK1", 00:15:37.526 "model_number": "SPDK bdev Controller", 00:15:37.526 "max_namespaces": 32, 00:15:37.526 "min_cntlid": 1, 00:15:37.526 "max_cntlid": 65519, 00:15:37.526 "namespaces": [ 00:15:37.526 { 00:15:37.526 "nsid": 1, 00:15:37.526 "bdev_name": "Malloc1", 00:15:37.526 "name": "Malloc1", 00:15:37.526 "nguid": "3EF4B6BFC5B74326A2DDF07DB5C46693", 00:15:37.526 "uuid": "3ef4b6bf-c5b7-4326-a2dd-f07db5c46693" 00:15:37.526 } 00:15:37.526 ] 00:15:37.526 }, 00:15:37.526 { 00:15:37.526 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:15:37.526 "subtype": "NVMe", 00:15:37.526 "listen_addresses": [ 00:15:37.526 { 00:15:37.526 "transport": "VFIOUSER", 00:15:37.526 "trtype": "VFIOUSER", 00:15:37.526 "adrfam": "IPv4", 00:15:37.526 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:15:37.526 "trsvcid": "0" 00:15:37.526 } 00:15:37.526 ], 00:15:37.526 "allow_any_host": true, 00:15:37.526 "hosts": [], 00:15:37.526 "serial_number": "SPDK2", 00:15:37.526 "model_number": "SPDK bdev Controller", 00:15:37.526 "max_namespaces": 32, 00:15:37.526 "min_cntlid": 1, 00:15:37.526 "max_cntlid": 65519, 00:15:37.526 "namespaces": [ 00:15:37.526 { 00:15:37.526 "nsid": 1, 00:15:37.526 "bdev_name": "Malloc2", 00:15:37.526 "name": "Malloc2", 00:15:37.526 "nguid": "4C544B9D176542FCB83B2B9865D5E397", 00:15:37.526 "uuid": "4c544b9d-1765-42fc-b83b-2b9865d5e397" 00:15:37.526 } 00:15:37.526 ] 00:15:37.526 } 00:15:37.526 ] 00:15:37.526 01:16:45 -- target/nvmf_vfio_user.sh@27 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:15:37.526 01:16:45 -- target/nvmf_vfio_user.sh@34 -- # aerpid=1115267 00:15:37.526 01:16:45 -- target/nvmf_vfio_user.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -n 2 -g -t /tmp/aer_touch_file 00:15:37.526 01:16:45 -- target/nvmf_vfio_user.sh@37 -- # waitforfile /tmp/aer_touch_file 00:15:37.526 01:16:45 -- common/autotest_common.sh@1254 -- # local i=0 00:15:37.526 01:16:45 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:15:37.526 01:16:45 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:15:37.526 01:16:45 -- common/autotest_common.sh@1265 -- # return 0 00:15:37.526 01:16:45 -- target/nvmf_vfio_user.sh@38 -- # rm -f /tmp/aer_touch_file 00:15:37.526 01:16:45 -- target/nvmf_vfio_user.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 --name Malloc3 00:15:37.526 EAL: No free 2048 kB hugepages reported on node 1 00:15:37.784 Malloc3 00:15:37.784 01:16:45 -- target/nvmf_vfio_user.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc3 -n 2 00:15:38.042 01:16:46 -- target/nvmf_vfio_user.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:15:38.042 Asynchronous Event Request test 00:15:38.042 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:15:38.042 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:15:38.042 Registering asynchronous event callbacks... 00:15:38.042 Starting namespace attribute notice tests for all controllers... 00:15:38.042 /var/run/vfio-user/domain/vfio-user1/1: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:15:38.042 aer_cb - Changed Namespace 00:15:38.042 Cleaning up... 00:15:38.305 [ 00:15:38.305 { 00:15:38.305 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:15:38.305 "subtype": "Discovery", 00:15:38.305 "listen_addresses": [], 00:15:38.305 "allow_any_host": true, 00:15:38.305 "hosts": [] 00:15:38.305 }, 00:15:38.305 { 00:15:38.305 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:15:38.305 "subtype": "NVMe", 00:15:38.305 "listen_addresses": [ 00:15:38.305 { 00:15:38.305 "transport": "VFIOUSER", 00:15:38.305 "trtype": "VFIOUSER", 00:15:38.305 "adrfam": "IPv4", 00:15:38.305 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:15:38.305 "trsvcid": "0" 00:15:38.305 } 00:15:38.305 ], 00:15:38.305 "allow_any_host": true, 00:15:38.305 "hosts": [], 00:15:38.305 "serial_number": "SPDK1", 00:15:38.305 "model_number": "SPDK bdev Controller", 00:15:38.305 "max_namespaces": 32, 00:15:38.305 "min_cntlid": 1, 00:15:38.305 "max_cntlid": 65519, 00:15:38.305 "namespaces": [ 00:15:38.305 { 00:15:38.305 "nsid": 1, 00:15:38.305 "bdev_name": "Malloc1", 00:15:38.305 "name": "Malloc1", 00:15:38.305 "nguid": "3EF4B6BFC5B74326A2DDF07DB5C46693", 00:15:38.305 "uuid": "3ef4b6bf-c5b7-4326-a2dd-f07db5c46693" 00:15:38.305 }, 00:15:38.305 { 00:15:38.305 "nsid": 2, 00:15:38.305 "bdev_name": "Malloc3", 00:15:38.305 "name": "Malloc3", 00:15:38.305 "nguid": "A91DB5CDC4684577BFE70FF075AC2037", 00:15:38.305 "uuid": "a91db5cd-c468-4577-bfe7-0ff075ac2037" 00:15:38.305 } 00:15:38.305 ] 00:15:38.305 }, 00:15:38.305 { 00:15:38.305 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:15:38.305 "subtype": "NVMe", 00:15:38.305 "listen_addresses": [ 00:15:38.305 { 00:15:38.305 "transport": "VFIOUSER", 00:15:38.305 "trtype": "VFIOUSER", 00:15:38.305 "adrfam": "IPv4", 00:15:38.305 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:15:38.305 "trsvcid": "0" 00:15:38.305 } 00:15:38.305 ], 00:15:38.305 "allow_any_host": true, 00:15:38.305 "hosts": [], 00:15:38.305 "serial_number": "SPDK2", 00:15:38.305 "model_number": "SPDK bdev Controller", 00:15:38.305 "max_namespaces": 32, 00:15:38.305 "min_cntlid": 1, 00:15:38.305 "max_cntlid": 65519, 00:15:38.305 "namespaces": [ 00:15:38.305 { 00:15:38.305 "nsid": 1, 00:15:38.305 "bdev_name": "Malloc2", 00:15:38.305 "name": "Malloc2", 00:15:38.305 "nguid": "4C544B9D176542FCB83B2B9865D5E397", 00:15:38.305 "uuid": "4c544b9d-1765-42fc-b83b-2b9865d5e397" 00:15:38.305 } 00:15:38.305 ] 00:15:38.305 } 00:15:38.305 ] 00:15:38.305 01:16:46 -- target/nvmf_vfio_user.sh@44 -- # wait 1115267 00:15:38.305 01:16:46 -- target/nvmf_vfio_user.sh@80 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:38.305 01:16:46 -- target/nvmf_vfio_user.sh@81 -- # test_traddr=/var/run/vfio-user/domain/vfio-user2/2 00:15:38.305 01:16:46 -- target/nvmf_vfio_user.sh@82 -- # test_subnqn=nqn.2019-07.io.spdk:cnode2 00:15:38.305 01:16:46 -- target/nvmf_vfio_user.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -g -L nvme -L nvme_vfio -L vfio_pci 00:15:38.305 [2024-11-20 01:16:46.329924] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:15:38.305 [2024-11-20 01:16:46.329966] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --single-file-segments --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1115402 ] 00:15:38.305 EAL: No free 2048 kB hugepages reported on node 1 00:15:38.306 [2024-11-20 01:16:46.362295] nvme_vfio_user.c: 259:nvme_vfio_ctrlr_scan: *DEBUG*: Scan controller : /var/run/vfio-user/domain/vfio-user2/2 00:15:38.306 [2024-11-20 01:16:46.371329] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 0, Size 0x2000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:38.306 [2024-11-20 01:16:46.371387] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0x1000, Offset 0x1000, Map addr 0x7f55e9bf5000 00:15:38.306 [2024-11-20 01:16:46.372329] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 1, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:38.306 [2024-11-20 01:16:46.373329] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 2, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:38.306 [2024-11-20 01:16:46.374340] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 3, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:38.306 [2024-11-20 01:16:46.375347] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 4, Size 0x2000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:38.306 [2024-11-20 01:16:46.376352] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 5, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:38.306 [2024-11-20 01:16:46.377376] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 6, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:38.306 [2024-11-20 01:16:46.378377] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 7, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:38.306 [2024-11-20 01:16:46.379389] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 8, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:38.306 [2024-11-20 01:16:46.380400] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 9, Size 0xc000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:38.306 [2024-11-20 01:16:46.380423] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0xb000, Offset 0x1000, Map addr 0x7f55e88ef000 00:15:38.306 [2024-11-20 01:16:46.381636] vfio_user_pci.c: 65:vfio_add_mr: *DEBUG*: Add memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:38.306 [2024-11-20 01:16:46.397047] vfio_user_pci.c: 386:spdk_vfio_user_setup: *DEBUG*: Device vfio-user0, Path /var/run/vfio-user/domain/vfio-user2/2/cntrl Setup Successfully 00:15:38.306 [2024-11-20 01:16:46.397097] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to connect adminq (no timeout) 00:15:38.306 [2024-11-20 01:16:46.399183] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x0, value 0x201e0100ff 00:15:38.306 [2024-11-20 01:16:46.399235] nvme_pcie_common.c: 132:nvme_pcie_qpair_construct: *INFO*: max_completions_cap = 64 num_trackers = 192 00:15:38.306 [2024-11-20 01:16:46.399325] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for connect adminq (no timeout) 00:15:38.306 [2024-11-20 01:16:46.399369] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read vs (no timeout) 00:15:38.306 [2024-11-20 01:16:46.399380] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read vs wait for vs (no timeout) 00:15:38.306 [2024-11-20 01:16:46.400195] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x8, value 0x10300 00:15:38.306 [2024-11-20 01:16:46.400217] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read cap (no timeout) 00:15:38.306 [2024-11-20 01:16:46.400231] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read cap wait for cap (no timeout) 00:15:38.306 [2024-11-20 01:16:46.401197] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x0, value 0x201e0100ff 00:15:38.306 [2024-11-20 01:16:46.401218] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to check en (no timeout) 00:15:38.306 [2024-11-20 01:16:46.401232] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to check en wait for cc (timeout 15000 ms) 00:15:38.306 [2024-11-20 01:16:46.405081] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x0 00:15:38.306 [2024-11-20 01:16:46.405102] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:15:38.306 [2024-11-20 01:16:46.405223] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x0 00:15:38.306 [2024-11-20 01:16:46.405241] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CC.EN = 0 && CSTS.RDY = 0 00:15:38.306 [2024-11-20 01:16:46.405251] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to controller is disabled (timeout 15000 ms) 00:15:38.306 [2024-11-20 01:16:46.405267] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:15:38.306 [2024-11-20 01:16:46.405378] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Setting CC.EN = 1 00:15:38.306 [2024-11-20 01:16:46.405387] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:15:38.306 [2024-11-20 01:16:46.405395] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x28, value 0x2000003c0000 00:15:38.306 [2024-11-20 01:16:46.406235] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x30, value 0x2000003be000 00:15:38.306 [2024-11-20 01:16:46.407244] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x24, value 0xff00ff 00:15:38.306 [2024-11-20 01:16:46.408250] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x460001 00:15:38.306 [2024-11-20 01:16:46.409287] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:15:38.306 [2024-11-20 01:16:46.410270] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x1 00:15:38.306 [2024-11-20 01:16:46.410290] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:15:38.306 [2024-11-20 01:16:46.410300] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to reset admin queue (timeout 30000 ms) 00:15:38.306 [2024-11-20 01:16:46.410324] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify controller (no timeout) 00:15:38.306 [2024-11-20 01:16:46.410338] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify controller (timeout 30000 ms) 00:15:38.306 [2024-11-20 01:16:46.410356] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:38.306 [2024-11-20 01:16:46.410366] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:38.306 [2024-11-20 01:16:46.410383] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000001 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:38.306 [2024-11-20 01:16:46.416085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0001 p:1 m:0 dnr:0 00:15:38.306 [2024-11-20 01:16:46.416107] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] transport max_xfer_size 131072 00:15:38.306 [2024-11-20 01:16:46.416117] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] MDTS max_xfer_size 131072 00:15:38.306 [2024-11-20 01:16:46.416125] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CNTLID 0x0001 00:15:38.306 [2024-11-20 01:16:46.416133] nvme_ctrlr.c:1990:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Identify CNTLID 0x0001 != Connect CNTLID 0x0000 00:15:38.306 [2024-11-20 01:16:46.416141] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] transport max_sges 1 00:15:38.306 [2024-11-20 01:16:46.416148] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] fuses compare and write: 1 00:15:38.306 [2024-11-20 01:16:46.416157] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to configure AER (timeout 30000 ms) 00:15:38.306 [2024-11-20 01:16:46.416174] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for configure aer (timeout 30000 ms) 00:15:38.306 [2024-11-20 01:16:46.416195] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:191 cdw10:0000000b PRP1 0x0 PRP2 0x0 00:15:38.306 [2024-11-20 01:16:46.424084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0002 p:1 m:0 dnr:0 00:15:38.306 [2024-11-20 01:16:46.424124] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:190 nsid:0 cdw10:00000000 cdw11:00000000 00:15:38.306 [2024-11-20 01:16:46.424139] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:189 nsid:0 cdw10:00000000 cdw11:00000000 00:15:38.306 [2024-11-20 01:16:46.424151] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:188 nsid:0 cdw10:00000000 cdw11:00000000 00:15:38.306 [2024-11-20 01:16:46.424164] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:187 nsid:0 cdw10:00000000 cdw11:00000000 00:15:38.306 [2024-11-20 01:16:46.424173] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set keep alive timeout (timeout 30000 ms) 00:15:38.306 [2024-11-20 01:16:46.424188] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:15:38.306 [2024-11-20 01:16:46.424203] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:191 cdw10:0000000f PRP1 0x0 PRP2 0x0 00:15:38.306 [2024-11-20 01:16:46.432081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0007 p:1 m:0 dnr:0 00:15:38.306 [2024-11-20 01:16:46.432110] nvme_ctrlr.c:2878:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Controller adjusted keep alive timeout to 0 ms 00:15:38.306 [2024-11-20 01:16:46.432120] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify controller iocs specific (timeout 30000 ms) 00:15:38.306 [2024-11-20 01:16:46.432132] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set number of queues (timeout 30000 ms) 00:15:38.306 [2024-11-20 01:16:46.432147] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for set number of queues (timeout 30000 ms) 00:15:38.306 [2024-11-20 01:16:46.432165] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:38.306 [2024-11-20 01:16:46.440079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:0008 p:1 m:0 dnr:0 00:15:38.306 [2024-11-20 01:16:46.440150] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify active ns (timeout 30000 ms) 00:15:38.306 [2024-11-20 01:16:46.440166] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify active ns (timeout 30000 ms) 00:15:38.306 [2024-11-20 01:16:46.440179] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f9000 len:4096 00:15:38.307 [2024-11-20 01:16:46.440187] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f9000 00:15:38.307 [2024-11-20 01:16:46.440197] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000002 cdw11:00000000 PRP1 0x2000002f9000 PRP2 0x0 00:15:38.307 [2024-11-20 01:16:46.448098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0009 p:1 m:0 dnr:0 00:15:38.307 [2024-11-20 01:16:46.448125] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Namespace 1 was added 00:15:38.307 [2024-11-20 01:16:46.448144] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify ns (timeout 30000 ms) 00:15:38.307 [2024-11-20 01:16:46.448158] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify ns (timeout 30000 ms) 00:15:38.307 [2024-11-20 01:16:46.448174] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:38.307 [2024-11-20 01:16:46.448183] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:38.307 [2024-11-20 01:16:46.448193] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000000 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:38.307 [2024-11-20 01:16:46.456082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000a p:1 m:0 dnr:0 00:15:38.307 [2024-11-20 01:16:46.456118] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify namespace id descriptors (timeout 30000 ms) 00:15:38.307 [2024-11-20 01:16:46.456134] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:15:38.307 [2024-11-20 01:16:46.456147] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:38.307 [2024-11-20 01:16:46.456155] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:38.307 [2024-11-20 01:16:46.456165] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:38.307 [2024-11-20 01:16:46.464095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000b p:1 m:0 dnr:0 00:15:38.307 [2024-11-20 01:16:46.464122] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify ns iocs specific (timeout 30000 ms) 00:15:38.307 [2024-11-20 01:16:46.464135] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set supported log pages (timeout 30000 ms) 00:15:38.307 [2024-11-20 01:16:46.464150] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set supported features (timeout 30000 ms) 00:15:38.307 [2024-11-20 01:16:46.464161] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set doorbell buffer config (timeout 30000 ms) 00:15:38.307 [2024-11-20 01:16:46.464169] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set host ID (timeout 30000 ms) 00:15:38.307 [2024-11-20 01:16:46.464177] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] NVMe-oF transport - not sending Set Features - Host ID 00:15:38.307 [2024-11-20 01:16:46.464185] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to transport ready (timeout 30000 ms) 00:15:38.307 [2024-11-20 01:16:46.464193] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to ready (no timeout) 00:15:38.307 [2024-11-20 01:16:46.464217] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:191 cdw10:00000001 PRP1 0x0 PRP2 0x0 00:15:38.307 [2024-11-20 01:16:46.472083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000c p:1 m:0 dnr:0 00:15:38.307 [2024-11-20 01:16:46.472110] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:191 cdw10:00000002 PRP1 0x0 PRP2 0x0 00:15:38.307 [2024-11-20 01:16:46.480079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000d p:1 m:0 dnr:0 00:15:38.307 [2024-11-20 01:16:46.480104] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:191 cdw10:00000004 PRP1 0x0 PRP2 0x0 00:15:38.307 [2024-11-20 01:16:46.488092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000e p:1 m:0 dnr:0 00:15:38.307 [2024-11-20 01:16:46.488118] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:38.307 [2024-11-20 01:16:46.496096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:000f p:1 m:0 dnr:0 00:15:38.307 [2024-11-20 01:16:46.496122] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f6000 len:8192 00:15:38.307 [2024-11-20 01:16:46.496133] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f6000 00:15:38.307 [2024-11-20 01:16:46.496139] nvme_pcie_common.c:1235:nvme_pcie_prp_list_append: *DEBUG*: prp[0] = 0x2000002f7000 00:15:38.307 [2024-11-20 01:16:46.496145] nvme_pcie_common.c:1251:nvme_pcie_prp_list_append: *DEBUG*: prp2 = 0x2000002f7000 00:15:38.307 [2024-11-20 01:16:46.496155] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:191 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 PRP1 0x2000002f6000 PRP2 0x2000002f7000 00:15:38.307 [2024-11-20 01:16:46.496167] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fc000 len:512 00:15:38.307 [2024-11-20 01:16:46.496175] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fc000 00:15:38.307 [2024-11-20 01:16:46.496184] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:186 nsid:ffffffff cdw10:007f0002 cdw11:00000000 PRP1 0x2000002fc000 PRP2 0x0 00:15:38.307 [2024-11-20 01:16:46.496195] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:512 00:15:38.307 [2024-11-20 01:16:46.496203] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:38.307 [2024-11-20 01:16:46.496212] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:185 nsid:ffffffff cdw10:007f0003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:38.307 [2024-11-20 01:16:46.496224] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f4000 len:4096 00:15:38.307 [2024-11-20 01:16:46.496232] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f4000 00:15:38.307 [2024-11-20 01:16:46.496241] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:184 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 PRP1 0x2000002f4000 PRP2 0x0 00:15:38.307 [2024-11-20 01:16:46.504084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0010 p:1 m:0 dnr:0 00:15:38.307 [2024-11-20 01:16:46.504113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:186 cdw0:0 sqhd:0011 p:1 m:0 dnr:0 00:15:38.307 [2024-11-20 01:16:46.504129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:185 cdw0:0 sqhd:0012 p:1 m:0 dnr:0 00:15:38.307 [2024-11-20 01:16:46.504140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0013 p:1 m:0 dnr:0 00:15:38.307 ===================================================== 00:15:38.307 NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:15:38.307 ===================================================== 00:15:38.307 Controller Capabilities/Features 00:15:38.307 ================================ 00:15:38.307 Vendor ID: 4e58 00:15:38.307 Subsystem Vendor ID: 4e58 00:15:38.307 Serial Number: SPDK2 00:15:38.307 Model Number: SPDK bdev Controller 00:15:38.307 Firmware Version: 24.01.1 00:15:38.307 Recommended Arb Burst: 6 00:15:38.307 IEEE OUI Identifier: 8d 6b 50 00:15:38.307 Multi-path I/O 00:15:38.307 May have multiple subsystem ports: Yes 00:15:38.307 May have multiple controllers: Yes 00:15:38.307 Associated with SR-IOV VF: No 00:15:38.307 Max Data Transfer Size: 131072 00:15:38.307 Max Number of Namespaces: 32 00:15:38.307 Max Number of I/O Queues: 127 00:15:38.307 NVMe Specification Version (VS): 1.3 00:15:38.307 NVMe Specification Version (Identify): 1.3 00:15:38.307 Maximum Queue Entries: 256 00:15:38.307 Contiguous Queues Required: Yes 00:15:38.307 Arbitration Mechanisms Supported 00:15:38.307 Weighted Round Robin: Not Supported 00:15:38.307 Vendor Specific: Not Supported 00:15:38.307 Reset Timeout: 15000 ms 00:15:38.307 Doorbell Stride: 4 bytes 00:15:38.307 NVM Subsystem Reset: Not Supported 00:15:38.307 Command Sets Supported 00:15:38.307 NVM Command Set: Supported 00:15:38.307 Boot Partition: Not Supported 00:15:38.307 Memory Page Size Minimum: 4096 bytes 00:15:38.307 Memory Page Size Maximum: 4096 bytes 00:15:38.307 Persistent Memory Region: Not Supported 00:15:38.307 Optional Asynchronous Events Supported 00:15:38.307 Namespace Attribute Notices: Supported 00:15:38.307 Firmware Activation Notices: Not Supported 00:15:38.307 ANA Change Notices: Not Supported 00:15:38.307 PLE Aggregate Log Change Notices: Not Supported 00:15:38.307 LBA Status Info Alert Notices: Not Supported 00:15:38.307 EGE Aggregate Log Change Notices: Not Supported 00:15:38.307 Normal NVM Subsystem Shutdown event: Not Supported 00:15:38.307 Zone Descriptor Change Notices: Not Supported 00:15:38.307 Discovery Log Change Notices: Not Supported 00:15:38.307 Controller Attributes 00:15:38.307 128-bit Host Identifier: Supported 00:15:38.307 Non-Operational Permissive Mode: Not Supported 00:15:38.307 NVM Sets: Not Supported 00:15:38.307 Read Recovery Levels: Not Supported 00:15:38.307 Endurance Groups: Not Supported 00:15:38.307 Predictable Latency Mode: Not Supported 00:15:38.307 Traffic Based Keep ALive: Not Supported 00:15:38.307 Namespace Granularity: Not Supported 00:15:38.307 SQ Associations: Not Supported 00:15:38.307 UUID List: Not Supported 00:15:38.307 Multi-Domain Subsystem: Not Supported 00:15:38.307 Fixed Capacity Management: Not Supported 00:15:38.307 Variable Capacity Management: Not Supported 00:15:38.307 Delete Endurance Group: Not Supported 00:15:38.307 Delete NVM Set: Not Supported 00:15:38.307 Extended LBA Formats Supported: Not Supported 00:15:38.307 Flexible Data Placement Supported: Not Supported 00:15:38.307 00:15:38.307 Controller Memory Buffer Support 00:15:38.307 ================================ 00:15:38.307 Supported: No 00:15:38.307 00:15:38.307 Persistent Memory Region Support 00:15:38.307 ================================ 00:15:38.307 Supported: No 00:15:38.307 00:15:38.307 Admin Command Set Attributes 00:15:38.307 ============================ 00:15:38.308 Security Send/Receive: Not Supported 00:15:38.308 Format NVM: Not Supported 00:15:38.308 Firmware Activate/Download: Not Supported 00:15:38.308 Namespace Management: Not Supported 00:15:38.308 Device Self-Test: Not Supported 00:15:38.308 Directives: Not Supported 00:15:38.308 NVMe-MI: Not Supported 00:15:38.308 Virtualization Management: Not Supported 00:15:38.308 Doorbell Buffer Config: Not Supported 00:15:38.308 Get LBA Status Capability: Not Supported 00:15:38.308 Command & Feature Lockdown Capability: Not Supported 00:15:38.308 Abort Command Limit: 4 00:15:38.308 Async Event Request Limit: 4 00:15:38.308 Number of Firmware Slots: N/A 00:15:38.308 Firmware Slot 1 Read-Only: N/A 00:15:38.308 Firmware Activation Without Reset: N/A 00:15:38.308 Multiple Update Detection Support: N/A 00:15:38.308 Firmware Update Granularity: No Information Provided 00:15:38.308 Per-Namespace SMART Log: No 00:15:38.308 Asymmetric Namespace Access Log Page: Not Supported 00:15:38.308 Subsystem NQN: nqn.2019-07.io.spdk:cnode2 00:15:38.308 Command Effects Log Page: Supported 00:15:38.308 Get Log Page Extended Data: Supported 00:15:38.308 Telemetry Log Pages: Not Supported 00:15:38.308 Persistent Event Log Pages: Not Supported 00:15:38.308 Supported Log Pages Log Page: May Support 00:15:38.308 Commands Supported & Effects Log Page: Not Supported 00:15:38.308 Feature Identifiers & Effects Log Page:May Support 00:15:38.308 NVMe-MI Commands & Effects Log Page: May Support 00:15:38.308 Data Area 4 for Telemetry Log: Not Supported 00:15:38.308 Error Log Page Entries Supported: 128 00:15:38.308 Keep Alive: Supported 00:15:38.308 Keep Alive Granularity: 10000 ms 00:15:38.308 00:15:38.308 NVM Command Set Attributes 00:15:38.308 ========================== 00:15:38.308 Submission Queue Entry Size 00:15:38.308 Max: 64 00:15:38.308 Min: 64 00:15:38.308 Completion Queue Entry Size 00:15:38.308 Max: 16 00:15:38.308 Min: 16 00:15:38.308 Number of Namespaces: 32 00:15:38.308 Compare Command: Supported 00:15:38.308 Write Uncorrectable Command: Not Supported 00:15:38.308 Dataset Management Command: Supported 00:15:38.308 Write Zeroes Command: Supported 00:15:38.308 Set Features Save Field: Not Supported 00:15:38.308 Reservations: Not Supported 00:15:38.308 Timestamp: Not Supported 00:15:38.308 Copy: Supported 00:15:38.308 Volatile Write Cache: Present 00:15:38.308 Atomic Write Unit (Normal): 1 00:15:38.308 Atomic Write Unit (PFail): 1 00:15:38.308 Atomic Compare & Write Unit: 1 00:15:38.308 Fused Compare & Write: Supported 00:15:38.308 Scatter-Gather List 00:15:38.308 SGL Command Set: Supported (Dword aligned) 00:15:38.308 SGL Keyed: Not Supported 00:15:38.308 SGL Bit Bucket Descriptor: Not Supported 00:15:38.308 SGL Metadata Pointer: Not Supported 00:15:38.308 Oversized SGL: Not Supported 00:15:38.308 SGL Metadata Address: Not Supported 00:15:38.308 SGL Offset: Not Supported 00:15:38.308 Transport SGL Data Block: Not Supported 00:15:38.308 Replay Protected Memory Block: Not Supported 00:15:38.308 00:15:38.308 Firmware Slot Information 00:15:38.308 ========================= 00:15:38.308 Active slot: 1 00:15:38.308 Slot 1 Firmware Revision: 24.01.1 00:15:38.308 00:15:38.308 00:15:38.308 Commands Supported and Effects 00:15:38.308 ============================== 00:15:38.308 Admin Commands 00:15:38.308 -------------- 00:15:38.308 Get Log Page (02h): Supported 00:15:38.308 Identify (06h): Supported 00:15:38.308 Abort (08h): Supported 00:15:38.308 Set Features (09h): Supported 00:15:38.308 Get Features (0Ah): Supported 00:15:38.308 Asynchronous Event Request (0Ch): Supported 00:15:38.308 Keep Alive (18h): Supported 00:15:38.308 I/O Commands 00:15:38.308 ------------ 00:15:38.308 Flush (00h): Supported LBA-Change 00:15:38.308 Write (01h): Supported LBA-Change 00:15:38.308 Read (02h): Supported 00:15:38.308 Compare (05h): Supported 00:15:38.308 Write Zeroes (08h): Supported LBA-Change 00:15:38.308 Dataset Management (09h): Supported LBA-Change 00:15:38.308 Copy (19h): Supported LBA-Change 00:15:38.308 Unknown (79h): Supported LBA-Change 00:15:38.308 Unknown (7Ah): Supported 00:15:38.308 00:15:38.308 Error Log 00:15:38.308 ========= 00:15:38.308 00:15:38.308 Arbitration 00:15:38.308 =========== 00:15:38.308 Arbitration Burst: 1 00:15:38.308 00:15:38.308 Power Management 00:15:38.308 ================ 00:15:38.308 Number of Power States: 1 00:15:38.308 Current Power State: Power State #0 00:15:38.308 Power State #0: 00:15:38.308 Max Power: 0.00 W 00:15:38.308 Non-Operational State: Operational 00:15:38.308 Entry Latency: Not Reported 00:15:38.308 Exit Latency: Not Reported 00:15:38.308 Relative Read Throughput: 0 00:15:38.308 Relative Read Latency: 0 00:15:38.308 Relative Write Throughput: 0 00:15:38.308 Relative Write Latency: 0 00:15:38.308 Idle Power: Not Reported 00:15:38.308 Active Power: Not Reported 00:15:38.308 Non-Operational Permissive Mode: Not Supported 00:15:38.308 00:15:38.308 Health Information 00:15:38.308 ================== 00:15:38.308 Critical Warnings: 00:15:38.308 Available Spare Space: OK 00:15:38.308 Temperature: OK 00:15:38.308 Device Reliability: OK 00:15:38.308 Read Only: No 00:15:38.308 Volatile Memory Backup: OK 00:15:38.308 Current Temperature: 0 Kelvin[2024-11-20 01:16:46.504268] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:184 cdw10:00000005 PRP1 0x0 PRP2 0x0 00:15:38.308 [2024-11-20 01:16:46.512080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0014 p:1 m:0 dnr:0 00:15:38.308 [2024-11-20 01:16:46.512127] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Prepare to destruct SSD 00:15:38.308 [2024-11-20 01:16:46.512144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:190 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:38.308 [2024-11-20 01:16:46.512155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:189 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:38.308 [2024-11-20 01:16:46.512165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:188 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:38.308 [2024-11-20 01:16:46.512174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:187 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:38.308 [2024-11-20 01:16:46.512255] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x460001 00:15:38.308 [2024-11-20 01:16:46.512276] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x464001 00:15:38.308 [2024-11-20 01:16:46.513298] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] RTD3E = 0 us 00:15:38.308 [2024-11-20 01:16:46.513314] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] shutdown timeout = 10000 ms 00:15:38.308 [2024-11-20 01:16:46.514263] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x9 00:15:38.308 [2024-11-20 01:16:46.514287] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] shutdown complete in 0 milliseconds 00:15:38.308 [2024-11-20 01:16:46.514338] vfio_user_pci.c: 399:spdk_vfio_user_release: *DEBUG*: Release file /var/run/vfio-user/domain/vfio-user2/2/cntrl 00:15:38.308 [2024-11-20 01:16:46.517084] vfio_user_pci.c: 96:vfio_remove_mr: *DEBUG*: Remove memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:38.568 (-273 Celsius) 00:15:38.568 Temperature Threshold: 0 Kelvin (-273 Celsius) 00:15:38.568 Available Spare: 0% 00:15:38.568 Available Spare Threshold: 0% 00:15:38.568 Life Percentage Used: 0% 00:15:38.568 Data Units Read: 0 00:15:38.568 Data Units Written: 0 00:15:38.568 Host Read Commands: 0 00:15:38.568 Host Write Commands: 0 00:15:38.568 Controller Busy Time: 0 minutes 00:15:38.568 Power Cycles: 0 00:15:38.568 Power On Hours: 0 hours 00:15:38.568 Unsafe Shutdowns: 0 00:15:38.568 Unrecoverable Media Errors: 0 00:15:38.568 Lifetime Error Log Entries: 0 00:15:38.568 Warning Temperature Time: 0 minutes 00:15:38.568 Critical Temperature Time: 0 minutes 00:15:38.568 00:15:38.568 Number of Queues 00:15:38.568 ================ 00:15:38.568 Number of I/O Submission Queues: 127 00:15:38.568 Number of I/O Completion Queues: 127 00:15:38.568 00:15:38.568 Active Namespaces 00:15:38.568 ================= 00:15:38.568 Namespace ID:1 00:15:38.568 Error Recovery Timeout: Unlimited 00:15:38.568 Command Set Identifier: NVM (00h) 00:15:38.568 Deallocate: Supported 00:15:38.568 Deallocated/Unwritten Error: Not Supported 00:15:38.568 Deallocated Read Value: Unknown 00:15:38.568 Deallocate in Write Zeroes: Not Supported 00:15:38.568 Deallocated Guard Field: 0xFFFF 00:15:38.568 Flush: Supported 00:15:38.568 Reservation: Supported 00:15:38.568 Namespace Sharing Capabilities: Multiple Controllers 00:15:38.568 Size (in LBAs): 131072 (0GiB) 00:15:38.568 Capacity (in LBAs): 131072 (0GiB) 00:15:38.568 Utilization (in LBAs): 131072 (0GiB) 00:15:38.568 NGUID: 4C544B9D176542FCB83B2B9865D5E397 00:15:38.568 UUID: 4c544b9d-1765-42fc-b83b-2b9865d5e397 00:15:38.568 Thin Provisioning: Not Supported 00:15:38.568 Per-NS Atomic Units: Yes 00:15:38.568 Atomic Boundary Size (Normal): 0 00:15:38.568 Atomic Boundary Size (PFail): 0 00:15:38.568 Atomic Boundary Offset: 0 00:15:38.568 Maximum Single Source Range Length: 65535 00:15:38.568 Maximum Copy Length: 65535 00:15:38.568 Maximum Source Range Count: 1 00:15:38.568 NGUID/EUI64 Never Reused: No 00:15:38.568 Namespace Write Protected: No 00:15:38.568 Number of LBA Formats: 1 00:15:38.568 Current LBA Format: LBA Format #00 00:15:38.568 LBA Format #00: Data Size: 512 Metadata Size: 0 00:15:38.568 00:15:38.568 01:16:46 -- target/nvmf_vfio_user.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -s 256 -g -q 128 -o 4096 -w read -t 5 -c 0x2 00:15:38.568 EAL: No free 2048 kB hugepages reported on node 1 00:15:43.847 Initializing NVMe Controllers 00:15:43.847 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:15:43.847 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 with lcore 1 00:15:43.847 Initialization complete. Launching workers. 00:15:43.847 ======================================================== 00:15:43.847 Latency(us) 00:15:43.847 Device Information : IOPS MiB/s Average min max 00:15:43.847 VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 from core 1: 37952.77 148.25 3372.07 1138.50 8441.97 00:15:43.847 ======================================================== 00:15:43.847 Total : 37952.77 148.25 3372.07 1138.50 8441.97 00:15:43.847 00:15:43.847 01:16:51 -- target/nvmf_vfio_user.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -s 256 -g -q 128 -o 4096 -w write -t 5 -c 0x2 00:15:43.847 EAL: No free 2048 kB hugepages reported on node 1 00:15:49.131 Initializing NVMe Controllers 00:15:49.131 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:15:49.131 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 with lcore 1 00:15:49.131 Initialization complete. Launching workers. 00:15:49.131 ======================================================== 00:15:49.131 Latency(us) 00:15:49.131 Device Information : IOPS MiB/s Average min max 00:15:49.131 VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 from core 1: 36170.07 141.29 3538.20 1144.60 7243.44 00:15:49.131 ======================================================== 00:15:49.131 Total : 36170.07 141.29 3538.20 1144.60 7243.44 00:15:49.131 00:15:49.131 01:16:57 -- target/nvmf_vfio_user.sh@86 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -g -q 32 -o 4096 -w randrw -M 50 -t 5 -c 0xE 00:15:49.131 EAL: No free 2048 kB hugepages reported on node 1 00:15:54.403 Initializing NVMe Controllers 00:15:54.403 Attaching to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:15:54.403 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:15:54.403 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 1 00:15:54.403 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 2 00:15:54.403 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 3 00:15:54.403 Initialization complete. Launching workers. 00:15:54.403 Starting thread on core 2 00:15:54.403 Starting thread on core 3 00:15:54.403 Starting thread on core 1 00:15:54.403 01:17:02 -- target/nvmf_vfio_user.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -t 3 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -d 256 -g 00:15:54.403 EAL: No free 2048 kB hugepages reported on node 1 00:15:57.695 Initializing NVMe Controllers 00:15:57.695 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:15:57.695 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:15:57.695 Associating SPDK bdev Controller (SPDK2 ) with lcore 0 00:15:57.695 Associating SPDK bdev Controller (SPDK2 ) with lcore 1 00:15:57.695 Associating SPDK bdev Controller (SPDK2 ) with lcore 2 00:15:57.695 Associating SPDK bdev Controller (SPDK2 ) with lcore 3 00:15:57.695 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration run with configuration: 00:15:57.695 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -q 64 -s 131072 -w randrw -M 50 -l 0 -t 3 -c 0xf -m 0 -a 0 -b 0 -n 100000 -i -1 00:15:57.695 Initialization complete. Launching workers. 00:15:57.695 Starting thread on core 1 with urgent priority queue 00:15:57.695 Starting thread on core 2 with urgent priority queue 00:15:57.695 Starting thread on core 3 with urgent priority queue 00:15:57.695 Starting thread on core 0 with urgent priority queue 00:15:57.695 SPDK bdev Controller (SPDK2 ) core 0: 5840.33 IO/s 17.12 secs/100000 ios 00:15:57.695 SPDK bdev Controller (SPDK2 ) core 1: 6055.33 IO/s 16.51 secs/100000 ios 00:15:57.695 SPDK bdev Controller (SPDK2 ) core 2: 6229.33 IO/s 16.05 secs/100000 ios 00:15:57.695 SPDK bdev Controller (SPDK2 ) core 3: 5359.67 IO/s 18.66 secs/100000 ios 00:15:57.695 ======================================================== 00:15:57.695 00:15:57.695 01:17:05 -- target/nvmf_vfio_user.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/hello_world -d 256 -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' 00:15:57.955 EAL: No free 2048 kB hugepages reported on node 1 00:15:58.215 Initializing NVMe Controllers 00:15:58.215 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:15:58.215 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:15:58.215 Namespace ID: 1 size: 0GB 00:15:58.215 Initialization complete. 00:15:58.215 INFO: using host memory buffer for IO 00:15:58.215 Hello world! 00:15:58.215 01:17:06 -- target/nvmf_vfio_user.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/overhead/overhead -o 4096 -t 1 -H -g -d 256 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' 00:15:58.215 EAL: No free 2048 kB hugepages reported on node 1 00:15:59.593 Initializing NVMe Controllers 00:15:59.593 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:15:59.593 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:15:59.593 Initialization complete. Launching workers. 00:15:59.593 submit (in ns) avg, min, max = 7026.5, 3434.4, 4016585.6 00:15:59.593 complete (in ns) avg, min, max = 25066.6, 2037.8, 7008996.7 00:15:59.593 00:15:59.593 Submit histogram 00:15:59.593 ================ 00:15:59.593 Range in us Cumulative Count 00:15:59.593 3.413 - 3.437: 0.0295% ( 4) 00:15:59.593 3.437 - 3.461: 0.5245% ( 67) 00:15:59.593 3.461 - 3.484: 1.8320% ( 177) 00:15:59.593 3.484 - 3.508: 4.5283% ( 365) 00:15:59.593 3.508 - 3.532: 9.7880% ( 712) 00:15:59.593 3.532 - 3.556: 18.3275% ( 1156) 00:15:59.593 3.556 - 3.579: 26.8967% ( 1160) 00:15:59.593 3.579 - 3.603: 36.3818% ( 1284) 00:15:59.593 3.603 - 3.627: 43.5695% ( 973) 00:15:59.593 3.627 - 3.650: 51.5550% ( 1081) 00:15:59.593 3.650 - 3.674: 55.8396% ( 580) 00:15:59.593 3.674 - 3.698: 60.0428% ( 569) 00:15:59.593 3.698 - 3.721: 63.6256% ( 485) 00:15:59.593 3.721 - 3.745: 67.3414% ( 503) 00:15:59.593 3.745 - 3.769: 70.8281% ( 472) 00:15:59.593 3.769 - 3.793: 74.6251% ( 514) 00:15:59.593 3.793 - 3.816: 78.4812% ( 522) 00:15:59.593 3.816 - 3.840: 81.9384% ( 468) 00:15:59.593 3.840 - 3.864: 85.0927% ( 427) 00:15:59.593 3.864 - 3.887: 87.3089% ( 300) 00:15:59.593 3.887 - 3.911: 88.8675% ( 211) 00:15:59.593 3.911 - 3.935: 90.4336% ( 212) 00:15:59.593 3.935 - 3.959: 91.6303% ( 162) 00:15:59.593 3.959 - 3.982: 92.5611% ( 126) 00:15:59.593 3.982 - 4.006: 93.4550% ( 121) 00:15:59.593 4.006 - 4.030: 94.1494% ( 94) 00:15:59.593 4.030 - 4.053: 94.7625% ( 83) 00:15:59.593 4.053 - 4.077: 95.3756% ( 83) 00:15:59.593 4.077 - 4.101: 95.6933% ( 43) 00:15:59.593 4.101 - 4.124: 96.0553% ( 49) 00:15:59.593 4.124 - 4.148: 96.3286% ( 37) 00:15:59.593 4.148 - 4.172: 96.4542% ( 17) 00:15:59.593 4.172 - 4.196: 96.6167% ( 22) 00:15:59.593 4.196 - 4.219: 96.6832% ( 9) 00:15:59.593 4.219 - 4.243: 96.8309% ( 20) 00:15:59.593 4.243 - 4.267: 96.8900% ( 8) 00:15:59.593 4.267 - 4.290: 96.9417% ( 7) 00:15:59.593 4.290 - 4.314: 97.0008% ( 8) 00:15:59.593 4.314 - 4.338: 97.0821% ( 11) 00:15:59.593 4.338 - 4.361: 97.1042% ( 3) 00:15:59.593 4.361 - 4.385: 97.1412% ( 5) 00:15:59.593 4.385 - 4.409: 97.1559% ( 2) 00:15:59.593 4.409 - 4.433: 97.1707% ( 2) 00:15:59.593 4.433 - 4.456: 97.1781% ( 1) 00:15:59.593 4.456 - 4.480: 97.1929% ( 2) 00:15:59.593 4.480 - 4.504: 97.2003% ( 1) 00:15:59.593 4.504 - 4.527: 97.2077% ( 1) 00:15:59.593 4.622 - 4.646: 97.2150% ( 1) 00:15:59.593 4.646 - 4.670: 97.2298% ( 2) 00:15:59.593 4.693 - 4.717: 97.2446% ( 2) 00:15:59.593 4.717 - 4.741: 97.2963% ( 7) 00:15:59.593 4.741 - 4.764: 97.3332% ( 5) 00:15:59.594 4.764 - 4.788: 97.3406% ( 1) 00:15:59.594 4.788 - 4.812: 97.4071% ( 9) 00:15:59.594 4.812 - 4.836: 97.4588% ( 7) 00:15:59.594 4.836 - 4.859: 97.5179% ( 8) 00:15:59.594 4.859 - 4.883: 97.5475% ( 4) 00:15:59.594 4.883 - 4.907: 97.5696% ( 3) 00:15:59.594 4.907 - 4.930: 97.6361% ( 9) 00:15:59.594 4.930 - 4.954: 97.6804% ( 6) 00:15:59.594 4.954 - 4.978: 97.7248% ( 6) 00:15:59.594 4.978 - 5.001: 97.7617% ( 5) 00:15:59.594 5.001 - 5.025: 97.7839% ( 3) 00:15:59.594 5.025 - 5.049: 97.8134% ( 4) 00:15:59.594 5.049 - 5.073: 97.8651% ( 7) 00:15:59.594 5.073 - 5.096: 97.9020% ( 5) 00:15:59.594 5.096 - 5.120: 97.9316% ( 4) 00:15:59.594 5.120 - 5.144: 97.9390% ( 1) 00:15:59.594 5.144 - 5.167: 97.9611% ( 3) 00:15:59.594 5.167 - 5.191: 97.9833% ( 3) 00:15:59.594 5.191 - 5.215: 98.0055% ( 3) 00:15:59.594 5.239 - 5.262: 98.0202% ( 2) 00:15:59.594 5.262 - 5.286: 98.0276% ( 1) 00:15:59.594 5.286 - 5.310: 98.0350% ( 1) 00:15:59.594 5.310 - 5.333: 98.0424% ( 1) 00:15:59.594 5.333 - 5.357: 98.0498% ( 1) 00:15:59.594 5.357 - 5.381: 98.0572% ( 1) 00:15:59.594 5.404 - 5.428: 98.0720% ( 2) 00:15:59.594 5.428 - 5.452: 98.0867% ( 2) 00:15:59.594 5.452 - 5.476: 98.0941% ( 1) 00:15:59.594 5.547 - 5.570: 98.1015% ( 1) 00:15:59.594 5.641 - 5.665: 98.1163% ( 2) 00:15:59.594 5.855 - 5.879: 98.1237% ( 1) 00:15:59.594 5.902 - 5.926: 98.1310% ( 1) 00:15:59.594 6.827 - 6.874: 98.1384% ( 1) 00:15:59.594 6.921 - 6.969: 98.1458% ( 1) 00:15:59.594 6.969 - 7.016: 98.1532% ( 1) 00:15:59.594 7.016 - 7.064: 98.1680% ( 2) 00:15:59.594 7.111 - 7.159: 98.1754% ( 1) 00:15:59.594 7.253 - 7.301: 98.1828% ( 1) 00:15:59.594 7.301 - 7.348: 98.1975% ( 2) 00:15:59.594 7.396 - 7.443: 98.2049% ( 1) 00:15:59.594 7.680 - 7.727: 98.2271% ( 3) 00:15:59.594 7.775 - 7.822: 98.2345% ( 1) 00:15:59.594 7.822 - 7.870: 98.2419% ( 1) 00:15:59.594 7.917 - 7.964: 98.2492% ( 1) 00:15:59.594 7.964 - 8.012: 98.2566% ( 1) 00:15:59.594 8.012 - 8.059: 98.2714% ( 2) 00:15:59.594 8.059 - 8.107: 98.2862% ( 2) 00:15:59.594 8.154 - 8.201: 98.2936% ( 1) 00:15:59.594 8.201 - 8.249: 98.3010% ( 1) 00:15:59.594 8.249 - 8.296: 98.3305% ( 4) 00:15:59.594 8.296 - 8.344: 98.3379% ( 1) 00:15:59.594 8.391 - 8.439: 98.3527% ( 2) 00:15:59.594 8.439 - 8.486: 98.3748% ( 3) 00:15:59.594 8.486 - 8.533: 98.3970% ( 3) 00:15:59.594 8.533 - 8.581: 98.4044% ( 1) 00:15:59.594 8.581 - 8.628: 98.4191% ( 2) 00:15:59.594 8.723 - 8.770: 98.4265% ( 1) 00:15:59.594 8.770 - 8.818: 98.4339% ( 1) 00:15:59.594 8.865 - 8.913: 98.4487% ( 2) 00:15:59.594 8.960 - 9.007: 98.4561% ( 1) 00:15:59.594 9.007 - 9.055: 98.4709% ( 2) 00:15:59.594 9.055 - 9.102: 98.4782% ( 1) 00:15:59.594 9.102 - 9.150: 98.4856% ( 1) 00:15:59.594 9.150 - 9.197: 98.4930% ( 1) 00:15:59.594 9.197 - 9.244: 98.5004% ( 1) 00:15:59.594 9.339 - 9.387: 98.5078% ( 1) 00:15:59.594 9.387 - 9.434: 98.5152% ( 1) 00:15:59.594 9.434 - 9.481: 98.5226% ( 1) 00:15:59.594 9.481 - 9.529: 98.5447% ( 3) 00:15:59.594 9.576 - 9.624: 98.5521% ( 1) 00:15:59.594 9.671 - 9.719: 98.5669% ( 2) 00:15:59.594 9.766 - 9.813: 98.5891% ( 3) 00:15:59.594 9.908 - 9.956: 98.5964% ( 1) 00:15:59.594 9.956 - 10.003: 98.6112% ( 2) 00:15:59.594 10.003 - 10.050: 98.6186% ( 1) 00:15:59.594 10.098 - 10.145: 98.6334% ( 2) 00:15:59.594 10.240 - 10.287: 98.6408% ( 1) 00:15:59.594 10.524 - 10.572: 98.6555% ( 2) 00:15:59.594 10.572 - 10.619: 98.6629% ( 1) 00:15:59.594 10.619 - 10.667: 98.6703% ( 1) 00:15:59.594 10.667 - 10.714: 98.6777% ( 1) 00:15:59.594 10.714 - 10.761: 98.6851% ( 1) 00:15:59.594 10.809 - 10.856: 98.6999% ( 2) 00:15:59.594 10.856 - 10.904: 98.7072% ( 1) 00:15:59.594 10.904 - 10.951: 98.7146% ( 1) 00:15:59.594 10.951 - 10.999: 98.7294% ( 2) 00:15:59.594 10.999 - 11.046: 98.7368% ( 1) 00:15:59.594 11.141 - 11.188: 98.7516% ( 2) 00:15:59.594 11.283 - 11.330: 98.7663% ( 2) 00:15:59.594 11.330 - 11.378: 98.7737% ( 1) 00:15:59.594 11.378 - 11.425: 98.7885% ( 2) 00:15:59.594 11.425 - 11.473: 98.7959% ( 1) 00:15:59.594 11.615 - 11.662: 98.8033% ( 1) 00:15:59.594 11.662 - 11.710: 98.8181% ( 2) 00:15:59.594 12.231 - 12.326: 98.8254% ( 1) 00:15:59.594 12.421 - 12.516: 98.8328% ( 1) 00:15:59.594 12.516 - 12.610: 98.8402% ( 1) 00:15:59.594 12.610 - 12.705: 98.8476% ( 1) 00:15:59.594 12.705 - 12.800: 98.8624% ( 2) 00:15:59.594 13.274 - 13.369: 98.8845% ( 3) 00:15:59.594 13.369 - 13.464: 98.8919% ( 1) 00:15:59.594 13.464 - 13.559: 98.8993% ( 1) 00:15:59.594 13.559 - 13.653: 98.9141% ( 2) 00:15:59.594 13.653 - 13.748: 98.9215% ( 1) 00:15:59.594 13.748 - 13.843: 98.9289% ( 1) 00:15:59.594 13.938 - 14.033: 98.9436% ( 2) 00:15:59.594 14.317 - 14.412: 98.9510% ( 1) 00:15:59.594 14.507 - 14.601: 98.9732% ( 3) 00:15:59.594 14.601 - 14.696: 98.9806% ( 1) 00:15:59.594 14.696 - 14.791: 98.9880% ( 1) 00:15:59.594 14.981 - 15.076: 99.0027% ( 2) 00:15:59.594 15.644 - 15.739: 99.0101% ( 1) 00:15:59.594 16.024 - 16.119: 99.0175% ( 1) 00:15:59.594 16.687 - 16.782: 99.0249% ( 1) 00:15:59.594 17.067 - 17.161: 99.0397% ( 2) 00:15:59.594 17.161 - 17.256: 99.0471% ( 1) 00:15:59.594 17.256 - 17.351: 99.0618% ( 2) 00:15:59.594 17.351 - 17.446: 99.0988% ( 5) 00:15:59.594 17.446 - 17.541: 99.1357% ( 5) 00:15:59.594 17.541 - 17.636: 99.1653% ( 4) 00:15:59.594 17.636 - 17.730: 99.1800% ( 2) 00:15:59.594 17.730 - 17.825: 99.2096% ( 4) 00:15:59.594 17.825 - 17.920: 99.2539% ( 6) 00:15:59.594 17.920 - 18.015: 99.3056% ( 7) 00:15:59.594 18.015 - 18.110: 99.3721% ( 9) 00:15:59.594 18.110 - 18.204: 99.4607% ( 12) 00:15:59.594 18.204 - 18.299: 99.5568% ( 13) 00:15:59.594 18.299 - 18.394: 99.5789% ( 3) 00:15:59.594 18.394 - 18.489: 99.6159% ( 5) 00:15:59.594 18.489 - 18.584: 99.6750% ( 8) 00:15:59.594 18.584 - 18.679: 99.6971% ( 3) 00:15:59.594 18.679 - 18.773: 99.7119% ( 2) 00:15:59.594 18.773 - 18.868: 99.7488% ( 5) 00:15:59.594 18.963 - 19.058: 99.7784% ( 4) 00:15:59.594 19.247 - 19.342: 99.7858% ( 1) 00:15:59.594 19.627 - 19.721: 99.7932% ( 1) 00:15:59.594 19.721 - 19.816: 99.8005% ( 1) 00:15:59.594 20.575 - 20.670: 99.8079% ( 1) 00:15:59.594 21.144 - 21.239: 99.8153% ( 1) 00:15:59.594 23.135 - 23.230: 99.8227% ( 1) 00:15:59.594 23.324 - 23.419: 99.8301% ( 1) 00:15:59.594 23.419 - 23.514: 99.8375% ( 1) 00:15:59.594 23.609 - 23.704: 99.8449% ( 1) 00:15:59.594 23.704 - 23.799: 99.8523% ( 1) 00:15:59.594 24.652 - 24.841: 99.8596% ( 1) 00:15:59.594 25.600 - 25.790: 99.8670% ( 1) 00:15:59.594 25.979 - 26.169: 99.8744% ( 1) 00:15:59.595 27.117 - 27.307: 99.8818% ( 1) 00:15:59.595 27.876 - 28.065: 99.8892% ( 1) 00:15:59.595 28.444 - 28.634: 99.8966% ( 1) 00:15:59.595 33.944 - 34.133: 99.9040% ( 1) 00:15:59.595 36.978 - 37.167: 99.9114% ( 1) 00:15:59.595 37.357 - 37.547: 99.9187% ( 1) 00:15:59.595 2354.441 - 2366.578: 99.9261% ( 1) 00:15:59.595 3980.705 - 4004.978: 99.9852% ( 8) 00:15:59.595 4004.978 - 4029.250: 100.0000% ( 2) 00:15:59.595 00:15:59.595 Complete histogram 00:15:59.595 ================== 00:15:59.595 Range in us Cumulative Count 00:15:59.595 2.027 - 2.039: 0.0295% ( 4) 00:15:59.595 2.039 - 2.050: 1.9576% ( 261) 00:15:59.595 2.050 - 2.062: 3.4572% ( 203) 00:15:59.595 2.062 - 2.074: 12.0041% ( 1157) 00:15:59.595 2.074 - 2.086: 44.2860% ( 4370) 00:15:59.595 2.086 - 2.098: 52.2716% ( 1081) 00:15:59.595 2.098 - 2.110: 57.6420% ( 727) 00:15:59.595 2.110 - 2.121: 61.0032% ( 455) 00:15:59.595 2.121 - 2.133: 62.3920% ( 188) 00:15:59.595 2.133 - 2.145: 68.1466% ( 779) 00:15:59.595 2.145 - 2.157: 77.8902% ( 1319) 00:15:59.595 2.157 - 2.169: 80.0768% ( 296) 00:15:59.595 2.169 - 2.181: 82.0049% ( 261) 00:15:59.595 2.181 - 2.193: 83.3493% ( 182) 00:15:59.595 2.193 - 2.204: 83.9034% ( 75) 00:15:59.595 2.204 - 2.216: 85.8536% ( 264) 00:15:59.595 2.216 - 2.228: 89.4437% ( 486) 00:15:59.595 2.228 - 2.240: 90.8473% ( 190) 00:15:59.595 2.240 - 2.252: 93.0856% ( 303) 00:15:59.595 2.252 - 2.264: 94.1863% ( 149) 00:15:59.595 2.264 - 2.276: 94.3710% ( 25) 00:15:59.595 2.276 - 2.287: 94.4966% ( 17) 00:15:59.595 2.287 - 2.299: 94.6000% ( 14) 00:15:59.595 2.299 - 2.311: 94.8068% ( 28) 00:15:59.595 2.311 - 2.323: 95.5086% ( 95) 00:15:59.595 2.323 - 2.335: 95.9149% ( 55) 00:15:59.595 2.335 - 2.347: 95.9814% ( 9) 00:15:59.595 2.347 - 2.359: 95.9888% ( 1) 00:15:59.595 2.359 - 2.370: 96.0183% ( 4) 00:15:59.595 2.370 - 2.382: 96.1217% ( 14) 00:15:59.595 2.382 - 2.394: 96.2916% ( 23) 00:15:59.595 2.394 - 2.406: 96.6315% ( 46) 00:15:59.595 2.406 - 2.418: 96.9196% ( 39) 00:15:59.595 2.418 - 2.430: 97.1116% ( 26) 00:15:59.595 2.430 - 2.441: 97.3037% ( 26) 00:15:59.595 2.441 - 2.453: 97.4588% ( 21) 00:15:59.595 2.453 - 2.465: 97.6878% ( 31) 00:15:59.595 2.465 - 2.477: 97.8060% ( 16) 00:15:59.595 2.477 - 2.489: 97.9464% ( 19) 00:15:59.595 2.489 - 2.501: 98.0941% ( 20) 00:15:59.595 2.501 - 2.513: 98.2492% ( 21) 00:15:59.595 2.513 - 2.524: 98.3379% ( 12) 00:15:59.595 2.524 - 2.536: 98.3822% ( 6) 00:15:59.595 2.536 - 2.548: 98.4413% ( 8) 00:15:59.595 2.548 - 2.560: 98.4782% ( 5) 00:15:59.595 2.560 - 2.572: 98.5004% ( 3) 00:15:59.595 2.584 - 2.596: 98.5078% ( 1) 00:15:59.595 2.596 - 2.607: 98.5226% ( 2) 00:15:59.595 2.607 - 2.619: 98.5300% ( 1) 00:15:59.595 2.619 - 2.631: 98.5447% ( 2) 00:15:59.595 2.643 - 2.655: 98.5521% ( 1) 00:15:59.595 2.667 - 2.679: 98.5595% ( 1) 00:15:59.595 2.690 - 2.702: 98.5669% ( 1) 00:15:59.595 2.702 - 2.714: 98.5743% ( 1) 00:15:59.595 2.714 - 2.726: 98.5817% ( 1) 00:15:59.595 3.271 - 3.295: 98.5891% ( 1) 00:15:59.595 3.319 - 3.342: 98.5964% ( 1) 00:15:59.595 3.342 - 3.366: 98.6112% ( 2) 00:15:59.595 3.366 - 3.390: 98.6186% ( 1) 00:15:59.595 3.390 - 3.413: 98.6334% ( 2) 00:15:59.595 3.413 - 3.437: 98.6555% ( 3) 00:15:59.595 3.484 - 3.508: 98.6851% ( 4) 00:15:59.595 3.532 - 3.556: 98.6925% ( 1) 00:15:59.595 3.556 - 3.579: 98.7072% ( 2) 00:15:59.595 3.579 - 3.603: 98.7294% ( 3) 00:15:59.595 3.603 - 3.627: 98.7442% ( 2) 00:15:59.595 3.721 - 3.745: 98.7590% ( 2) 00:15:59.595 3.745 - 3.769: 98.7663% ( 1) 00:15:59.595 3.769 - 3.793: 98.7737% ( 1) 00:15:59.595 3.793 - 3.816: 98.7885% ( 2) 00:15:59.595 3.935 - 3.959: 98.8033% ( 2) 00:15:59.595 3.982 - 4.006: 98.8107% ( 1) 00:15:59.595 4.006 - 4.030: 98.8181% ( 1) 00:15:59.595 5.523 - 5.547: 98.8254% ( 1) 00:15:59.595 5.665 - 5.689: 98.8328% ( 1) 00:15:59.595 5.926 - 5.950: 98.8402% ( 1) 00:15:59.595 5.950 - 5.973: 98.8476% ( 1) 00:15:59.595 5.997 - 6.021: 98.8550% ( 1) 00:15:59.595 6.400 - 6.447: 98.8624% ( 1) 00:15:59.595 6.590 - 6.637: 98.8772% ( 2) 00:15:59.595 6.827 - 6.874: 98.8845% ( 1) 00:15:59.595 7.253 - 7.301: 98.8919% ( 1) 00:15:59.595 7.917 - 7.964: 98.8993% ( 1) 00:15:59.595 8.296 - 8.344: 98.9067% ( 1) 00:15:59.595 15.076 - 15.170: 98.9141% ( 1) 00:15:59.595 15.170 - 15.265: 98.9215% ( 1) 00:15:59.595 15.360 - 15.455: 98.9289% ( 1) 00:15:59.595 15.455 - 15.550: 98.9436% ( 2) 00:15:59.595 15.739 - 15.834: 98.9584% ( 2) 00:15:59.595 15.834 - 15.929: 98.9732% ( 2) 00:15:59.595 15.929 - 16.024: 98.9953% ( 3) 00:15:59.595 16.024 - 16.119: 99.0175% ( 3) 00:15:59.595 16.119 - 16.213: 99.0397% ( 3) 00:15:59.595 16.213 - 16.308: 99.0766% ( 5) 00:15:59.595 16.308 - 16.403: 99.0840% ( 1) 00:15:59.595 16.403 - 16.498: 99.1283% ( 6) 00:15:59.595 16.498 - 16.593: 99.1800% ( 7) 00:15:59.595 16.593 - 16.687: 99.2170% ( 5) 00:15:59.595 16.687 - 16.782: 99.2539% ( 5) 00:15:59.595 16.782 - 16.877: 99.2908% ( 5) 00:15:59.595 16.877 - 16.972: 99.2982% ( 1) 00:15:59.595 16.972 - 17.067: 99.3278% ( 4) 00:15:59.595 17.067 - 17.161: 99.3352% ( 1) 00:15:59.595 17.256 - 17.351: 99.3425% ( 1) 00:15:59.595 17.446 - 17.541: 99.3499% ( 1) 00:15:59.595 17.541 - 17.636: 99.3573% ( 1) 00:15:59.595 17.636 - 17.730: 99.3647% ( 1) 00:15:59.595 17.730 - 17.825: 99.3721% ( 1) 00:15:59.595 18.015 - 18.110: 99.3795% ( 1) 00:15:59.595 18.110 - 18.204: 99.3943% ( 2) 00:15:59.595 18.679 - 18.773: 99.4090% ( 2) 00:15:59.595 20.196 - 20.290: 99.4164% ( 1) 00:15:59.595 20.385 - 20.480: 99.4238% ( 1) 00:15:59.595 160.047 - 160.806: 99.4312% ( 1) 00:15:59.595 1031.585 - 1037.653: 99.4386% ( 1) 00:15:59.595 1711.218 - 1723.354: 99.4460% ( 1) 00:15:59.595 2002.489 - 2014.625: 99.4534% ( 1) 00:15:59.595 3325.345 - 3349.618: 99.4607% ( 1) 00:15:59.595 3980.705 - 4004.978: 99.8449% ( 52) 00:15:59.595 4004.978 - 4029.250: 99.9631% ( 16) 00:15:59.596 4029.250 - 4053.523: 99.9778% ( 2) 00:15:59.596 6990.507 - 7039.052: 100.0000% ( 3) 00:15:59.596 00:15:59.596 01:17:07 -- target/nvmf_vfio_user.sh@90 -- # aer_vfio_user /var/run/vfio-user/domain/vfio-user2/2 nqn.2019-07.io.spdk:cnode2 2 00:15:59.596 01:17:07 -- target/nvmf_vfio_user.sh@22 -- # local traddr=/var/run/vfio-user/domain/vfio-user2/2 00:15:59.596 01:17:07 -- target/nvmf_vfio_user.sh@23 -- # local subnqn=nqn.2019-07.io.spdk:cnode2 00:15:59.596 01:17:07 -- target/nvmf_vfio_user.sh@24 -- # local malloc_num=Malloc4 00:15:59.596 01:17:07 -- target/nvmf_vfio_user.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:15:59.885 [ 00:15:59.885 { 00:15:59.885 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:15:59.885 "subtype": "Discovery", 00:15:59.885 "listen_addresses": [], 00:15:59.885 "allow_any_host": true, 00:15:59.885 "hosts": [] 00:15:59.885 }, 00:15:59.885 { 00:15:59.885 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:15:59.885 "subtype": "NVMe", 00:15:59.885 "listen_addresses": [ 00:15:59.885 { 00:15:59.885 "transport": "VFIOUSER", 00:15:59.885 "trtype": "VFIOUSER", 00:15:59.885 "adrfam": "IPv4", 00:15:59.885 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:15:59.885 "trsvcid": "0" 00:15:59.885 } 00:15:59.885 ], 00:15:59.885 "allow_any_host": true, 00:15:59.885 "hosts": [], 00:15:59.885 "serial_number": "SPDK1", 00:15:59.885 "model_number": "SPDK bdev Controller", 00:15:59.885 "max_namespaces": 32, 00:15:59.885 "min_cntlid": 1, 00:15:59.885 "max_cntlid": 65519, 00:15:59.885 "namespaces": [ 00:15:59.885 { 00:15:59.885 "nsid": 1, 00:15:59.885 "bdev_name": "Malloc1", 00:15:59.885 "name": "Malloc1", 00:15:59.885 "nguid": "3EF4B6BFC5B74326A2DDF07DB5C46693", 00:15:59.885 "uuid": "3ef4b6bf-c5b7-4326-a2dd-f07db5c46693" 00:15:59.885 }, 00:15:59.885 { 00:15:59.885 "nsid": 2, 00:15:59.885 "bdev_name": "Malloc3", 00:15:59.885 "name": "Malloc3", 00:15:59.885 "nguid": "A91DB5CDC4684577BFE70FF075AC2037", 00:15:59.885 "uuid": "a91db5cd-c468-4577-bfe7-0ff075ac2037" 00:15:59.885 } 00:15:59.885 ] 00:15:59.885 }, 00:15:59.885 { 00:15:59.885 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:15:59.885 "subtype": "NVMe", 00:15:59.885 "listen_addresses": [ 00:15:59.885 { 00:15:59.885 "transport": "VFIOUSER", 00:15:59.885 "trtype": "VFIOUSER", 00:15:59.885 "adrfam": "IPv4", 00:15:59.885 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:15:59.885 "trsvcid": "0" 00:15:59.885 } 00:15:59.885 ], 00:15:59.885 "allow_any_host": true, 00:15:59.885 "hosts": [], 00:15:59.885 "serial_number": "SPDK2", 00:15:59.885 "model_number": "SPDK bdev Controller", 00:15:59.885 "max_namespaces": 32, 00:15:59.885 "min_cntlid": 1, 00:15:59.885 "max_cntlid": 65519, 00:15:59.885 "namespaces": [ 00:15:59.885 { 00:15:59.885 "nsid": 1, 00:15:59.885 "bdev_name": "Malloc2", 00:15:59.885 "name": "Malloc2", 00:15:59.885 "nguid": "4C544B9D176542FCB83B2B9865D5E397", 00:15:59.885 "uuid": "4c544b9d-1765-42fc-b83b-2b9865d5e397" 00:15:59.885 } 00:15:59.885 ] 00:15:59.885 } 00:15:59.885 ] 00:15:59.885 01:17:07 -- target/nvmf_vfio_user.sh@27 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:15:59.885 01:17:07 -- target/nvmf_vfio_user.sh@34 -- # aerpid=1117997 00:15:59.885 01:17:07 -- target/nvmf_vfio_user.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -n 2 -g -t /tmp/aer_touch_file 00:15:59.885 01:17:07 -- target/nvmf_vfio_user.sh@37 -- # waitforfile /tmp/aer_touch_file 00:15:59.885 01:17:07 -- common/autotest_common.sh@1254 -- # local i=0 00:15:59.885 01:17:07 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:15:59.885 01:17:07 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:15:59.885 01:17:07 -- common/autotest_common.sh@1265 -- # return 0 00:15:59.885 01:17:07 -- target/nvmf_vfio_user.sh@38 -- # rm -f /tmp/aer_touch_file 00:15:59.885 01:17:07 -- target/nvmf_vfio_user.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 --name Malloc4 00:15:59.885 EAL: No free 2048 kB hugepages reported on node 1 00:16:00.166 Malloc4 00:16:00.166 01:17:08 -- target/nvmf_vfio_user.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc4 -n 2 00:16:00.425 01:17:08 -- target/nvmf_vfio_user.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:16:00.425 Asynchronous Event Request test 00:16:00.425 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:16:00.425 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:16:00.425 Registering asynchronous event callbacks... 00:16:00.425 Starting namespace attribute notice tests for all controllers... 00:16:00.425 /var/run/vfio-user/domain/vfio-user2/2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:16:00.425 aer_cb - Changed Namespace 00:16:00.425 Cleaning up... 00:16:00.685 [ 00:16:00.685 { 00:16:00.685 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:16:00.685 "subtype": "Discovery", 00:16:00.685 "listen_addresses": [], 00:16:00.685 "allow_any_host": true, 00:16:00.685 "hosts": [] 00:16:00.685 }, 00:16:00.685 { 00:16:00.685 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:16:00.685 "subtype": "NVMe", 00:16:00.685 "listen_addresses": [ 00:16:00.685 { 00:16:00.685 "transport": "VFIOUSER", 00:16:00.685 "trtype": "VFIOUSER", 00:16:00.685 "adrfam": "IPv4", 00:16:00.685 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:16:00.685 "trsvcid": "0" 00:16:00.685 } 00:16:00.685 ], 00:16:00.685 "allow_any_host": true, 00:16:00.685 "hosts": [], 00:16:00.685 "serial_number": "SPDK1", 00:16:00.685 "model_number": "SPDK bdev Controller", 00:16:00.685 "max_namespaces": 32, 00:16:00.685 "min_cntlid": 1, 00:16:00.685 "max_cntlid": 65519, 00:16:00.685 "namespaces": [ 00:16:00.685 { 00:16:00.685 "nsid": 1, 00:16:00.685 "bdev_name": "Malloc1", 00:16:00.685 "name": "Malloc1", 00:16:00.685 "nguid": "3EF4B6BFC5B74326A2DDF07DB5C46693", 00:16:00.685 "uuid": "3ef4b6bf-c5b7-4326-a2dd-f07db5c46693" 00:16:00.685 }, 00:16:00.685 { 00:16:00.685 "nsid": 2, 00:16:00.685 "bdev_name": "Malloc3", 00:16:00.685 "name": "Malloc3", 00:16:00.685 "nguid": "A91DB5CDC4684577BFE70FF075AC2037", 00:16:00.685 "uuid": "a91db5cd-c468-4577-bfe7-0ff075ac2037" 00:16:00.685 } 00:16:00.685 ] 00:16:00.685 }, 00:16:00.685 { 00:16:00.685 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:16:00.685 "subtype": "NVMe", 00:16:00.685 "listen_addresses": [ 00:16:00.685 { 00:16:00.685 "transport": "VFIOUSER", 00:16:00.685 "trtype": "VFIOUSER", 00:16:00.685 "adrfam": "IPv4", 00:16:00.685 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:16:00.685 "trsvcid": "0" 00:16:00.685 } 00:16:00.685 ], 00:16:00.685 "allow_any_host": true, 00:16:00.685 "hosts": [], 00:16:00.685 "serial_number": "SPDK2", 00:16:00.685 "model_number": "SPDK bdev Controller", 00:16:00.685 "max_namespaces": 32, 00:16:00.685 "min_cntlid": 1, 00:16:00.685 "max_cntlid": 65519, 00:16:00.685 "namespaces": [ 00:16:00.685 { 00:16:00.685 "nsid": 1, 00:16:00.685 "bdev_name": "Malloc2", 00:16:00.685 "name": "Malloc2", 00:16:00.685 "nguid": "4C544B9D176542FCB83B2B9865D5E397", 00:16:00.685 "uuid": "4c544b9d-1765-42fc-b83b-2b9865d5e397" 00:16:00.685 }, 00:16:00.685 { 00:16:00.685 "nsid": 2, 00:16:00.685 "bdev_name": "Malloc4", 00:16:00.685 "name": "Malloc4", 00:16:00.685 "nguid": "6BEE3F2B288C479F8AEEA34B66325008", 00:16:00.685 "uuid": "6bee3f2b-288c-479f-8aee-a34b66325008" 00:16:00.685 } 00:16:00.685 ] 00:16:00.685 } 00:16:00.685 ] 00:16:00.685 01:17:08 -- target/nvmf_vfio_user.sh@44 -- # wait 1117997 00:16:00.685 01:17:08 -- target/nvmf_vfio_user.sh@105 -- # stop_nvmf_vfio_user 00:16:00.685 01:17:08 -- target/nvmf_vfio_user.sh@95 -- # killprocess 1112226 00:16:00.685 01:17:08 -- common/autotest_common.sh@936 -- # '[' -z 1112226 ']' 00:16:00.685 01:17:08 -- common/autotest_common.sh@940 -- # kill -0 1112226 00:16:00.685 01:17:08 -- common/autotest_common.sh@941 -- # uname 00:16:00.685 01:17:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:00.685 01:17:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1112226 00:16:00.685 01:17:08 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:00.685 01:17:08 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:00.685 01:17:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1112226' 00:16:00.685 killing process with pid 1112226 00:16:00.685 01:17:08 -- common/autotest_common.sh@955 -- # kill 1112226 00:16:00.685 [2024-11-20 01:17:08.700791] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:16:00.685 01:17:08 -- common/autotest_common.sh@960 -- # wait 1112226 00:16:00.945 01:17:09 -- target/nvmf_vfio_user.sh@97 -- # rm -rf /var/run/vfio-user 00:16:00.945 01:17:09 -- target/nvmf_vfio_user.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:16:00.945 01:17:09 -- target/nvmf_vfio_user.sh@108 -- # setup_nvmf_vfio_user --interrupt-mode '-M -I' 00:16:00.945 01:17:09 -- target/nvmf_vfio_user.sh@51 -- # local nvmf_app_args=--interrupt-mode 00:16:00.945 01:17:09 -- target/nvmf_vfio_user.sh@52 -- # local 'transport_args=-M -I' 00:16:00.945 01:17:09 -- target/nvmf_vfio_user.sh@55 -- # nvmfpid=1118147 00:16:00.945 01:17:09 -- target/nvmf_vfio_user.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m '[0,1,2,3]' --interrupt-mode 00:16:00.945 01:17:09 -- target/nvmf_vfio_user.sh@57 -- # echo 'Process pid: 1118147' 00:16:00.945 Process pid: 1118147 00:16:00.945 01:17:09 -- target/nvmf_vfio_user.sh@59 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:16:00.945 01:17:09 -- target/nvmf_vfio_user.sh@60 -- # waitforlisten 1118147 00:16:00.945 01:17:09 -- common/autotest_common.sh@829 -- # '[' -z 1118147 ']' 00:16:00.945 01:17:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:00.945 01:17:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:00.945 01:17:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:00.945 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:00.945 01:17:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:00.945 01:17:09 -- common/autotest_common.sh@10 -- # set +x 00:16:00.945 [2024-11-20 01:17:09.068550] thread.c:2929:spdk_interrupt_mode_enable: *NOTICE*: Set SPDK running in interrupt mode. 00:16:00.945 [2024-11-20 01:17:09.069586] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:16:00.945 [2024-11-20 01:17:09.069646] [ DPDK EAL parameters: nvmf -l 0,1,2,3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:00.945 EAL: No free 2048 kB hugepages reported on node 1 00:16:00.945 [2024-11-20 01:17:09.133941] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:01.207 [2024-11-20 01:17:09.221128] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:01.207 [2024-11-20 01:17:09.221290] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:01.207 [2024-11-20 01:17:09.221310] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:01.207 [2024-11-20 01:17:09.221324] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:01.207 [2024-11-20 01:17:09.221416] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:01.207 [2024-11-20 01:17:09.221487] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:01.207 [2024-11-20 01:17:09.221586] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:01.207 [2024-11-20 01:17:09.221589] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:01.207 [2024-11-20 01:17:09.330301] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_0) to intr mode from intr mode. 00:16:01.207 [2024-11-20 01:17:09.330563] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_1) to intr mode from intr mode. 00:16:01.207 [2024-11-20 01:17:09.330816] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_2) to intr mode from intr mode. 00:16:01.207 [2024-11-20 01:17:09.331506] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (app_thread) to intr mode from intr mode. 00:16:01.207 [2024-11-20 01:17:09.331617] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_3) to intr mode from intr mode. 00:16:02.146 01:17:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:02.146 01:17:10 -- common/autotest_common.sh@862 -- # return 0 00:16:02.146 01:17:10 -- target/nvmf_vfio_user.sh@62 -- # sleep 1 00:16:03.085 01:17:11 -- target/nvmf_vfio_user.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t VFIOUSER -M -I 00:16:03.343 01:17:11 -- target/nvmf_vfio_user.sh@66 -- # mkdir -p /var/run/vfio-user 00:16:03.343 01:17:11 -- target/nvmf_vfio_user.sh@68 -- # seq 1 2 00:16:03.343 01:17:11 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:16:03.343 01:17:11 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user1/1 00:16:03.343 01:17:11 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:16:03.603 Malloc1 00:16:03.603 01:17:11 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode1 -a -s SPDK1 00:16:03.863 01:17:11 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc1 00:16:04.122 01:17:12 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode1 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user1/1 -s 0 00:16:04.380 01:17:12 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:16:04.380 01:17:12 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user2/2 00:16:04.380 01:17:12 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc2 00:16:04.638 Malloc2 00:16:04.638 01:17:12 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode2 -a -s SPDK2 00:16:04.896 01:17:12 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc2 00:16:05.154 01:17:13 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode2 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user2/2 -s 0 00:16:05.413 01:17:13 -- target/nvmf_vfio_user.sh@109 -- # stop_nvmf_vfio_user 00:16:05.413 01:17:13 -- target/nvmf_vfio_user.sh@95 -- # killprocess 1118147 00:16:05.413 01:17:13 -- common/autotest_common.sh@936 -- # '[' -z 1118147 ']' 00:16:05.413 01:17:13 -- common/autotest_common.sh@940 -- # kill -0 1118147 00:16:05.413 01:17:13 -- common/autotest_common.sh@941 -- # uname 00:16:05.413 01:17:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:05.413 01:17:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1118147 00:16:05.413 01:17:13 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:05.413 01:17:13 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:05.413 01:17:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1118147' 00:16:05.413 killing process with pid 1118147 00:16:05.413 01:17:13 -- common/autotest_common.sh@955 -- # kill 1118147 00:16:05.413 01:17:13 -- common/autotest_common.sh@960 -- # wait 1118147 00:16:05.673 01:17:13 -- target/nvmf_vfio_user.sh@97 -- # rm -rf /var/run/vfio-user 00:16:05.673 01:17:13 -- target/nvmf_vfio_user.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:16:05.673 00:16:05.673 real 0m54.127s 00:16:05.673 user 3m34.083s 00:16:05.673 sys 0m4.488s 00:16:05.673 01:17:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:05.673 01:17:13 -- common/autotest_common.sh@10 -- # set +x 00:16:05.673 ************************************ 00:16:05.673 END TEST nvmf_vfio_user 00:16:05.673 ************************************ 00:16:05.673 01:17:13 -- nvmf/nvmf.sh@41 -- # run_test nvmf_vfio_user_nvme_compliance /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/compliance.sh --transport=tcp 00:16:05.673 01:17:13 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:05.673 01:17:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:05.673 01:17:13 -- common/autotest_common.sh@10 -- # set +x 00:16:05.673 ************************************ 00:16:05.673 START TEST nvmf_vfio_user_nvme_compliance 00:16:05.673 ************************************ 00:16:05.673 01:17:13 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/compliance.sh --transport=tcp 00:16:05.931 * Looking for test storage... 00:16:05.931 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance 00:16:05.931 01:17:13 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:05.931 01:17:13 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:05.931 01:17:13 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:05.931 01:17:13 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:05.931 01:17:13 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:05.931 01:17:13 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:05.931 01:17:13 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:05.931 01:17:13 -- scripts/common.sh@335 -- # IFS=.-: 00:16:05.931 01:17:13 -- scripts/common.sh@335 -- # read -ra ver1 00:16:05.931 01:17:13 -- scripts/common.sh@336 -- # IFS=.-: 00:16:05.931 01:17:13 -- scripts/common.sh@336 -- # read -ra ver2 00:16:05.931 01:17:13 -- scripts/common.sh@337 -- # local 'op=<' 00:16:05.932 01:17:13 -- scripts/common.sh@339 -- # ver1_l=2 00:16:05.932 01:17:13 -- scripts/common.sh@340 -- # ver2_l=1 00:16:05.932 01:17:13 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:05.932 01:17:13 -- scripts/common.sh@343 -- # case "$op" in 00:16:05.932 01:17:13 -- scripts/common.sh@344 -- # : 1 00:16:05.932 01:17:13 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:05.932 01:17:13 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:05.932 01:17:13 -- scripts/common.sh@364 -- # decimal 1 00:16:05.932 01:17:13 -- scripts/common.sh@352 -- # local d=1 00:16:05.932 01:17:13 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:05.932 01:17:13 -- scripts/common.sh@354 -- # echo 1 00:16:05.932 01:17:13 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:05.932 01:17:13 -- scripts/common.sh@365 -- # decimal 2 00:16:05.932 01:17:13 -- scripts/common.sh@352 -- # local d=2 00:16:05.932 01:17:13 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:05.932 01:17:13 -- scripts/common.sh@354 -- # echo 2 00:16:05.932 01:17:13 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:05.932 01:17:13 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:05.932 01:17:13 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:05.932 01:17:13 -- scripts/common.sh@367 -- # return 0 00:16:05.932 01:17:13 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:05.932 01:17:13 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:05.932 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:05.932 --rc genhtml_branch_coverage=1 00:16:05.932 --rc genhtml_function_coverage=1 00:16:05.932 --rc genhtml_legend=1 00:16:05.932 --rc geninfo_all_blocks=1 00:16:05.932 --rc geninfo_unexecuted_blocks=1 00:16:05.932 00:16:05.932 ' 00:16:05.932 01:17:13 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:05.932 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:05.932 --rc genhtml_branch_coverage=1 00:16:05.932 --rc genhtml_function_coverage=1 00:16:05.932 --rc genhtml_legend=1 00:16:05.932 --rc geninfo_all_blocks=1 00:16:05.932 --rc geninfo_unexecuted_blocks=1 00:16:05.932 00:16:05.932 ' 00:16:05.932 01:17:13 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:05.932 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:05.932 --rc genhtml_branch_coverage=1 00:16:05.932 --rc genhtml_function_coverage=1 00:16:05.932 --rc genhtml_legend=1 00:16:05.932 --rc geninfo_all_blocks=1 00:16:05.932 --rc geninfo_unexecuted_blocks=1 00:16:05.932 00:16:05.932 ' 00:16:05.932 01:17:13 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:05.932 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:05.932 --rc genhtml_branch_coverage=1 00:16:05.932 --rc genhtml_function_coverage=1 00:16:05.932 --rc genhtml_legend=1 00:16:05.932 --rc geninfo_all_blocks=1 00:16:05.932 --rc geninfo_unexecuted_blocks=1 00:16:05.932 00:16:05.932 ' 00:16:05.932 01:17:13 -- compliance/compliance.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:05.932 01:17:13 -- nvmf/common.sh@7 -- # uname -s 00:16:05.932 01:17:13 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:05.932 01:17:13 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:05.932 01:17:13 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:05.932 01:17:13 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:05.932 01:17:13 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:05.932 01:17:13 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:05.932 01:17:13 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:05.932 01:17:13 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:05.932 01:17:13 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:05.932 01:17:13 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:05.932 01:17:13 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:05.932 01:17:13 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:05.932 01:17:13 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:05.932 01:17:13 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:05.932 01:17:13 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:05.932 01:17:13 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:05.932 01:17:13 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:05.932 01:17:13 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:05.932 01:17:13 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:05.932 01:17:13 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:05.932 01:17:13 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:05.932 01:17:13 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:05.932 01:17:13 -- paths/export.sh@5 -- # export PATH 00:16:05.932 01:17:13 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:05.932 01:17:13 -- nvmf/common.sh@46 -- # : 0 00:16:05.932 01:17:13 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:05.932 01:17:13 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:05.932 01:17:13 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:05.932 01:17:13 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:05.932 01:17:13 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:05.932 01:17:13 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:05.932 01:17:13 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:05.932 01:17:13 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:05.932 01:17:13 -- compliance/compliance.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:05.932 01:17:13 -- compliance/compliance.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:05.932 01:17:13 -- compliance/compliance.sh@14 -- # export TEST_TRANSPORT=VFIOUSER 00:16:05.932 01:17:13 -- compliance/compliance.sh@14 -- # TEST_TRANSPORT=VFIOUSER 00:16:05.932 01:17:13 -- compliance/compliance.sh@16 -- # rm -rf /var/run/vfio-user 00:16:05.932 01:17:14 -- compliance/compliance.sh@20 -- # nvmfpid=1118900 00:16:05.932 01:17:14 -- compliance/compliance.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:16:05.932 01:17:14 -- compliance/compliance.sh@21 -- # echo 'Process pid: 1118900' 00:16:05.932 Process pid: 1118900 00:16:05.932 01:17:14 -- compliance/compliance.sh@23 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:16:05.932 01:17:14 -- compliance/compliance.sh@24 -- # waitforlisten 1118900 00:16:05.932 01:17:14 -- common/autotest_common.sh@829 -- # '[' -z 1118900 ']' 00:16:05.932 01:17:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:05.932 01:17:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:05.932 01:17:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:05.932 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:05.932 01:17:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:05.932 01:17:14 -- common/autotest_common.sh@10 -- # set +x 00:16:05.932 [2024-11-20 01:17:14.040148] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:16:05.932 [2024-11-20 01:17:14.040249] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:05.932 EAL: No free 2048 kB hugepages reported on node 1 00:16:05.932 [2024-11-20 01:17:14.097769] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:16:06.192 [2024-11-20 01:17:14.183385] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:06.192 [2024-11-20 01:17:14.183538] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:06.192 [2024-11-20 01:17:14.183556] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:06.192 [2024-11-20 01:17:14.183569] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:06.192 [2024-11-20 01:17:14.183699] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:06.192 [2024-11-20 01:17:14.185088] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:06.192 [2024-11-20 01:17:14.185099] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:07.131 01:17:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:07.131 01:17:15 -- common/autotest_common.sh@862 -- # return 0 00:16:07.131 01:17:15 -- compliance/compliance.sh@26 -- # sleep 1 00:16:08.067 01:17:16 -- compliance/compliance.sh@28 -- # nqn=nqn.2021-09.io.spdk:cnode0 00:16:08.067 01:17:16 -- compliance/compliance.sh@29 -- # traddr=/var/run/vfio-user 00:16:08.067 01:17:16 -- compliance/compliance.sh@31 -- # rpc_cmd nvmf_create_transport -t VFIOUSER 00:16:08.067 01:17:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:08.067 01:17:16 -- common/autotest_common.sh@10 -- # set +x 00:16:08.067 01:17:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:08.067 01:17:16 -- compliance/compliance.sh@33 -- # mkdir -p /var/run/vfio-user 00:16:08.067 01:17:16 -- compliance/compliance.sh@35 -- # rpc_cmd bdev_malloc_create 64 512 -b malloc0 00:16:08.067 01:17:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:08.067 01:17:16 -- common/autotest_common.sh@10 -- # set +x 00:16:08.067 malloc0 00:16:08.067 01:17:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:08.067 01:17:16 -- compliance/compliance.sh@36 -- # rpc_cmd nvmf_create_subsystem nqn.2021-09.io.spdk:cnode0 -a -s spdk -m 32 00:16:08.067 01:17:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:08.067 01:17:16 -- common/autotest_common.sh@10 -- # set +x 00:16:08.067 01:17:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:08.067 01:17:16 -- compliance/compliance.sh@37 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2021-09.io.spdk:cnode0 malloc0 00:16:08.067 01:17:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:08.067 01:17:16 -- common/autotest_common.sh@10 -- # set +x 00:16:08.067 01:17:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:08.067 01:17:16 -- compliance/compliance.sh@38 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2021-09.io.spdk:cnode0 -t VFIOUSER -a /var/run/vfio-user -s 0 00:16:08.067 01:17:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:08.067 01:17:16 -- common/autotest_common.sh@10 -- # set +x 00:16:08.067 01:17:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:08.067 01:17:16 -- compliance/compliance.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/nvme_compliance -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user subnqn:nqn.2021-09.io.spdk:cnode0' 00:16:08.067 EAL: No free 2048 kB hugepages reported on node 1 00:16:08.067 00:16:08.067 00:16:08.067 CUnit - A unit testing framework for C - Version 2.1-3 00:16:08.067 http://cunit.sourceforge.net/ 00:16:08.067 00:16:08.067 00:16:08.067 Suite: nvme_compliance 00:16:08.067 Test: admin_identify_ctrlr_verify_dptr ...[2024-11-20 01:17:16.268962] vfio_user.c: 789:nvme_cmd_map_prps: *ERROR*: no PRP2, 3072 remaining 00:16:08.067 [2024-11-20 01:17:16.269002] vfio_user.c:5484:map_admin_cmd_req: *ERROR*: /var/run/vfio-user: map Admin Opc 6 failed 00:16:08.067 [2024-11-20 01:17:16.269030] vfio_user.c:5576:handle_cmd_req: *ERROR*: /var/run/vfio-user: process NVMe command opc 0x6 failed 00:16:08.327 passed 00:16:08.327 Test: admin_identify_ctrlr_verify_fused ...passed 00:16:08.327 Test: admin_identify_ns ...[2024-11-20 01:17:16.509091] ctrlr.c:2598:_nvmf_subsystem_get_ns_safe: *ERROR*: Identify Namespace for invalid NSID 0 00:16:08.327 [2024-11-20 01:17:16.517083] ctrlr.c:2598:_nvmf_subsystem_get_ns_safe: *ERROR*: Identify Namespace for invalid NSID 4294967295 00:16:08.587 passed 00:16:08.587 Test: admin_get_features_mandatory_features ...passed 00:16:08.587 Test: admin_get_features_optional_features ...passed 00:16:08.847 Test: admin_set_features_number_of_queues ...passed 00:16:08.847 Test: admin_get_log_page_mandatory_logs ...passed 00:16:09.106 Test: admin_get_log_page_with_lpo ...[2024-11-20 01:17:17.137089] ctrlr.c:2546:nvmf_ctrlr_get_log_page: *ERROR*: Get log page: offset (516) > len (512) 00:16:09.106 passed 00:16:09.106 Test: fabric_property_get ...passed 00:16:09.366 Test: admin_delete_io_sq_use_admin_qid ...[2024-11-20 01:17:17.324694] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:0 does not exist 00:16:09.366 passed 00:16:09.366 Test: admin_delete_io_sq_delete_sq_twice ...[2024-11-20 01:17:17.496081] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:16:09.366 [2024-11-20 01:17:17.512095] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:16:09.366 passed 00:16:09.627 Test: admin_delete_io_cq_use_admin_qid ...[2024-11-20 01:17:17.599031] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O cqid:0 does not exist 00:16:09.627 passed 00:16:09.627 Test: admin_delete_io_cq_delete_cq_first ...[2024-11-20 01:17:17.762094] vfio_user.c:2310:handle_del_io_q: *ERROR*: /var/run/vfio-user: the associated SQ must be deleted first 00:16:09.627 [2024-11-20 01:17:17.786077] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:16:09.627 passed 00:16:09.888 Test: admin_create_io_cq_verify_iv_pc ...[2024-11-20 01:17:17.876089] vfio_user.c:2150:handle_create_io_cq: *ERROR*: /var/run/vfio-user: IV is too big 00:16:09.888 [2024-11-20 01:17:17.876144] vfio_user.c:2144:handle_create_io_cq: *ERROR*: /var/run/vfio-user: non-PC CQ not supported 00:16:09.888 passed 00:16:09.888 Test: admin_create_io_sq_verify_qsize_cqid ...[2024-11-20 01:17:18.051081] vfio_user.c:2231:handle_create_io_q: *ERROR*: /var/run/vfio-user: invalid I/O queue size 1 00:16:09.888 [2024-11-20 01:17:18.059078] vfio_user.c:2231:handle_create_io_q: *ERROR*: /var/run/vfio-user: invalid I/O queue size 257 00:16:09.888 [2024-11-20 01:17:18.067080] vfio_user.c:2031:handle_create_io_sq: *ERROR*: /var/run/vfio-user: invalid cqid:0 00:16:09.888 [2024-11-20 01:17:18.075076] vfio_user.c:2031:handle_create_io_sq: *ERROR*: /var/run/vfio-user: invalid cqid:128 00:16:10.147 passed 00:16:10.147 Test: admin_create_io_sq_verify_pc ...[2024-11-20 01:17:18.204093] vfio_user.c:2044:handle_create_io_sq: *ERROR*: /var/run/vfio-user: non-PC SQ not supported 00:16:10.147 passed 00:16:11.528 Test: admin_create_io_qp_max_qps ...[2024-11-20 01:17:19.411087] nvme_ctrlr.c:5318:spdk_nvme_ctrlr_alloc_qid: *ERROR*: [/var/run/vfio-user] No free I/O queue IDs 00:16:11.787 passed 00:16:12.045 Test: admin_create_io_sq_shared_cq ...[2024-11-20 01:17:20.018085] vfio_user.c:2310:handle_del_io_q: *ERROR*: /var/run/vfio-user: the associated SQ must be deleted first 00:16:12.045 passed 00:16:12.045 00:16:12.045 Run Summary: Type Total Ran Passed Failed Inactive 00:16:12.045 suites 1 1 n/a 0 0 00:16:12.045 tests 18 18 18 0 0 00:16:12.045 asserts 360 360 360 0 n/a 00:16:12.045 00:16:12.045 Elapsed time = 1.569 seconds 00:16:12.045 01:17:20 -- compliance/compliance.sh@42 -- # killprocess 1118900 00:16:12.045 01:17:20 -- common/autotest_common.sh@936 -- # '[' -z 1118900 ']' 00:16:12.045 01:17:20 -- common/autotest_common.sh@940 -- # kill -0 1118900 00:16:12.045 01:17:20 -- common/autotest_common.sh@941 -- # uname 00:16:12.045 01:17:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:12.045 01:17:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1118900 00:16:12.045 01:17:20 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:12.045 01:17:20 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:12.045 01:17:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1118900' 00:16:12.045 killing process with pid 1118900 00:16:12.045 01:17:20 -- common/autotest_common.sh@955 -- # kill 1118900 00:16:12.045 01:17:20 -- common/autotest_common.sh@960 -- # wait 1118900 00:16:12.303 01:17:20 -- compliance/compliance.sh@44 -- # rm -rf /var/run/vfio-user 00:16:12.303 01:17:20 -- compliance/compliance.sh@46 -- # trap - SIGINT SIGTERM EXIT 00:16:12.303 00:16:12.303 real 0m6.531s 00:16:12.303 user 0m18.693s 00:16:12.303 sys 0m0.589s 00:16:12.303 01:17:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:12.303 01:17:20 -- common/autotest_common.sh@10 -- # set +x 00:16:12.303 ************************************ 00:16:12.303 END TEST nvmf_vfio_user_nvme_compliance 00:16:12.303 ************************************ 00:16:12.303 01:17:20 -- nvmf/nvmf.sh@42 -- # run_test nvmf_vfio_user_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/vfio_user_fuzz.sh --transport=tcp 00:16:12.303 01:17:20 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:12.303 01:17:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:12.303 01:17:20 -- common/autotest_common.sh@10 -- # set +x 00:16:12.303 ************************************ 00:16:12.303 START TEST nvmf_vfio_user_fuzz 00:16:12.303 ************************************ 00:16:12.303 01:17:20 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/vfio_user_fuzz.sh --transport=tcp 00:16:12.303 * Looking for test storage... 00:16:12.303 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:12.303 01:17:20 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:12.303 01:17:20 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:12.303 01:17:20 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:12.561 01:17:20 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:12.561 01:17:20 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:12.561 01:17:20 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:12.561 01:17:20 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:12.561 01:17:20 -- scripts/common.sh@335 -- # IFS=.-: 00:16:12.561 01:17:20 -- scripts/common.sh@335 -- # read -ra ver1 00:16:12.561 01:17:20 -- scripts/common.sh@336 -- # IFS=.-: 00:16:12.561 01:17:20 -- scripts/common.sh@336 -- # read -ra ver2 00:16:12.561 01:17:20 -- scripts/common.sh@337 -- # local 'op=<' 00:16:12.561 01:17:20 -- scripts/common.sh@339 -- # ver1_l=2 00:16:12.561 01:17:20 -- scripts/common.sh@340 -- # ver2_l=1 00:16:12.561 01:17:20 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:12.561 01:17:20 -- scripts/common.sh@343 -- # case "$op" in 00:16:12.561 01:17:20 -- scripts/common.sh@344 -- # : 1 00:16:12.561 01:17:20 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:12.561 01:17:20 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:12.561 01:17:20 -- scripts/common.sh@364 -- # decimal 1 00:16:12.561 01:17:20 -- scripts/common.sh@352 -- # local d=1 00:16:12.561 01:17:20 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:12.561 01:17:20 -- scripts/common.sh@354 -- # echo 1 00:16:12.561 01:17:20 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:12.561 01:17:20 -- scripts/common.sh@365 -- # decimal 2 00:16:12.561 01:17:20 -- scripts/common.sh@352 -- # local d=2 00:16:12.561 01:17:20 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:12.561 01:17:20 -- scripts/common.sh@354 -- # echo 2 00:16:12.561 01:17:20 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:12.561 01:17:20 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:12.561 01:17:20 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:12.561 01:17:20 -- scripts/common.sh@367 -- # return 0 00:16:12.561 01:17:20 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:12.561 01:17:20 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:12.561 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:12.561 --rc genhtml_branch_coverage=1 00:16:12.561 --rc genhtml_function_coverage=1 00:16:12.561 --rc genhtml_legend=1 00:16:12.561 --rc geninfo_all_blocks=1 00:16:12.561 --rc geninfo_unexecuted_blocks=1 00:16:12.561 00:16:12.561 ' 00:16:12.561 01:17:20 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:12.561 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:12.562 --rc genhtml_branch_coverage=1 00:16:12.562 --rc genhtml_function_coverage=1 00:16:12.562 --rc genhtml_legend=1 00:16:12.562 --rc geninfo_all_blocks=1 00:16:12.562 --rc geninfo_unexecuted_blocks=1 00:16:12.562 00:16:12.562 ' 00:16:12.562 01:17:20 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:12.562 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:12.562 --rc genhtml_branch_coverage=1 00:16:12.562 --rc genhtml_function_coverage=1 00:16:12.562 --rc genhtml_legend=1 00:16:12.562 --rc geninfo_all_blocks=1 00:16:12.562 --rc geninfo_unexecuted_blocks=1 00:16:12.562 00:16:12.562 ' 00:16:12.562 01:17:20 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:12.562 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:12.562 --rc genhtml_branch_coverage=1 00:16:12.562 --rc genhtml_function_coverage=1 00:16:12.562 --rc genhtml_legend=1 00:16:12.562 --rc geninfo_all_blocks=1 00:16:12.562 --rc geninfo_unexecuted_blocks=1 00:16:12.562 00:16:12.562 ' 00:16:12.562 01:17:20 -- target/vfio_user_fuzz.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:12.562 01:17:20 -- nvmf/common.sh@7 -- # uname -s 00:16:12.562 01:17:20 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:12.562 01:17:20 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:12.562 01:17:20 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:12.562 01:17:20 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:12.562 01:17:20 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:12.562 01:17:20 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:12.562 01:17:20 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:12.562 01:17:20 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:12.562 01:17:20 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:12.562 01:17:20 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:12.562 01:17:20 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:12.562 01:17:20 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:12.562 01:17:20 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:12.562 01:17:20 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:12.562 01:17:20 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:12.562 01:17:20 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:12.562 01:17:20 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:12.562 01:17:20 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:12.562 01:17:20 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:12.562 01:17:20 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:12.562 01:17:20 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:12.562 01:17:20 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:12.562 01:17:20 -- paths/export.sh@5 -- # export PATH 00:16:12.562 01:17:20 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:12.562 01:17:20 -- nvmf/common.sh@46 -- # : 0 00:16:12.562 01:17:20 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:12.562 01:17:20 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:12.562 01:17:20 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:12.562 01:17:20 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:12.562 01:17:20 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:12.562 01:17:20 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:12.562 01:17:20 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:12.562 01:17:20 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:12.562 01:17:20 -- target/vfio_user_fuzz.sh@12 -- # MALLOC_BDEV_SIZE=64 00:16:12.562 01:17:20 -- target/vfio_user_fuzz.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:16:12.562 01:17:20 -- target/vfio_user_fuzz.sh@15 -- # nqn=nqn.2021-09.io.spdk:cnode0 00:16:12.562 01:17:20 -- target/vfio_user_fuzz.sh@16 -- # traddr=/var/run/vfio-user 00:16:12.562 01:17:20 -- target/vfio_user_fuzz.sh@18 -- # export TEST_TRANSPORT=VFIOUSER 00:16:12.562 01:17:20 -- target/vfio_user_fuzz.sh@18 -- # TEST_TRANSPORT=VFIOUSER 00:16:12.562 01:17:20 -- target/vfio_user_fuzz.sh@20 -- # rm -rf /var/run/vfio-user 00:16:12.562 01:17:20 -- target/vfio_user_fuzz.sh@24 -- # nvmfpid=1119667 00:16:12.562 01:17:20 -- target/vfio_user_fuzz.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:16:12.562 01:17:20 -- target/vfio_user_fuzz.sh@25 -- # echo 'Process pid: 1119667' 00:16:12.562 Process pid: 1119667 00:16:12.562 01:17:20 -- target/vfio_user_fuzz.sh@27 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:16:12.562 01:17:20 -- target/vfio_user_fuzz.sh@28 -- # waitforlisten 1119667 00:16:12.562 01:17:20 -- common/autotest_common.sh@829 -- # '[' -z 1119667 ']' 00:16:12.562 01:17:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:12.562 01:17:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:12.562 01:17:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:12.562 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:12.562 01:17:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:12.562 01:17:20 -- common/autotest_common.sh@10 -- # set +x 00:16:13.496 01:17:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:13.496 01:17:21 -- common/autotest_common.sh@862 -- # return 0 00:16:13.496 01:17:21 -- target/vfio_user_fuzz.sh@30 -- # sleep 1 00:16:14.430 01:17:22 -- target/vfio_user_fuzz.sh@32 -- # rpc_cmd nvmf_create_transport -t VFIOUSER 00:16:14.430 01:17:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:14.430 01:17:22 -- common/autotest_common.sh@10 -- # set +x 00:16:14.430 01:17:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:14.430 01:17:22 -- target/vfio_user_fuzz.sh@34 -- # mkdir -p /var/run/vfio-user 00:16:14.430 01:17:22 -- target/vfio_user_fuzz.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b malloc0 00:16:14.430 01:17:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:14.430 01:17:22 -- common/autotest_common.sh@10 -- # set +x 00:16:14.689 malloc0 00:16:14.689 01:17:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:14.689 01:17:22 -- target/vfio_user_fuzz.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2021-09.io.spdk:cnode0 -a -s spdk 00:16:14.689 01:17:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:14.689 01:17:22 -- common/autotest_common.sh@10 -- # set +x 00:16:14.689 01:17:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:14.689 01:17:22 -- target/vfio_user_fuzz.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2021-09.io.spdk:cnode0 malloc0 00:16:14.689 01:17:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:14.689 01:17:22 -- common/autotest_common.sh@10 -- # set +x 00:16:14.689 01:17:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:14.689 01:17:22 -- target/vfio_user_fuzz.sh@39 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2021-09.io.spdk:cnode0 -t VFIOUSER -a /var/run/vfio-user -s 0 00:16:14.689 01:17:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:14.689 01:17:22 -- common/autotest_common.sh@10 -- # set +x 00:16:14.689 01:17:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:14.690 01:17:22 -- target/vfio_user_fuzz.sh@41 -- # trid='trtype:VFIOUSER subnqn:nqn.2021-09.io.spdk:cnode0 traddr:/var/run/vfio-user' 00:16:14.690 01:17:22 -- target/vfio_user_fuzz.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/vfio_user_fuzz -t 30 -S 123456 -F 'trtype:VFIOUSER subnqn:nqn.2021-09.io.spdk:cnode0 traddr:/var/run/vfio-user' -N -a 00:16:46.760 Fuzzing completed. Shutting down the fuzz application 00:16:46.760 00:16:46.760 Dumping successful admin opcodes: 00:16:46.760 8, 9, 10, 24, 00:16:46.760 Dumping successful io opcodes: 00:16:46.760 0, 00:16:46.760 NS: 0x200003a1ef00 I/O qp, Total commands completed: 565812, total successful commands: 2175, random_seed: 1420961600 00:16:46.760 NS: 0x200003a1ef00 admin qp, Total commands completed: 140640, total successful commands: 1141, random_seed: 2481137216 00:16:46.760 01:17:53 -- target/vfio_user_fuzz.sh@44 -- # rpc_cmd nvmf_delete_subsystem nqn.2021-09.io.spdk:cnode0 00:16:46.760 01:17:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:46.760 01:17:53 -- common/autotest_common.sh@10 -- # set +x 00:16:46.760 01:17:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:46.760 01:17:53 -- target/vfio_user_fuzz.sh@46 -- # killprocess 1119667 00:16:46.760 01:17:53 -- common/autotest_common.sh@936 -- # '[' -z 1119667 ']' 00:16:46.760 01:17:53 -- common/autotest_common.sh@940 -- # kill -0 1119667 00:16:46.760 01:17:53 -- common/autotest_common.sh@941 -- # uname 00:16:46.760 01:17:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:46.760 01:17:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1119667 00:16:46.760 01:17:53 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:46.760 01:17:53 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:46.760 01:17:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1119667' 00:16:46.760 killing process with pid 1119667 00:16:46.760 01:17:53 -- common/autotest_common.sh@955 -- # kill 1119667 00:16:46.760 01:17:53 -- common/autotest_common.sh@960 -- # wait 1119667 00:16:46.760 01:17:53 -- target/vfio_user_fuzz.sh@48 -- # rm -rf /var/run/vfio-user /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/vfio_user_fuzz_log.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/vfio_user_fuzz_tgt_output.txt 00:16:46.760 01:17:53 -- target/vfio_user_fuzz.sh@50 -- # trap - SIGINT SIGTERM EXIT 00:16:46.760 00:16:46.760 real 0m33.119s 00:16:46.760 user 0m34.891s 00:16:46.760 sys 0m25.435s 00:16:46.760 01:17:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:46.760 01:17:53 -- common/autotest_common.sh@10 -- # set +x 00:16:46.760 ************************************ 00:16:46.760 END TEST nvmf_vfio_user_fuzz 00:16:46.760 ************************************ 00:16:46.760 01:17:53 -- nvmf/nvmf.sh@46 -- # run_test nvmf_host_management /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:16:46.760 01:17:53 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:46.760 01:17:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:46.760 01:17:53 -- common/autotest_common.sh@10 -- # set +x 00:16:46.760 ************************************ 00:16:46.760 START TEST nvmf_host_management 00:16:46.760 ************************************ 00:16:46.760 01:17:53 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:16:46.760 * Looking for test storage... 00:16:46.760 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:46.760 01:17:53 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:46.760 01:17:53 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:46.760 01:17:53 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:46.760 01:17:53 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:46.760 01:17:53 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:46.760 01:17:53 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:46.760 01:17:53 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:46.760 01:17:53 -- scripts/common.sh@335 -- # IFS=.-: 00:16:46.760 01:17:53 -- scripts/common.sh@335 -- # read -ra ver1 00:16:46.760 01:17:53 -- scripts/common.sh@336 -- # IFS=.-: 00:16:46.760 01:17:53 -- scripts/common.sh@336 -- # read -ra ver2 00:16:46.760 01:17:53 -- scripts/common.sh@337 -- # local 'op=<' 00:16:46.760 01:17:53 -- scripts/common.sh@339 -- # ver1_l=2 00:16:46.760 01:17:53 -- scripts/common.sh@340 -- # ver2_l=1 00:16:46.760 01:17:53 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:46.760 01:17:53 -- scripts/common.sh@343 -- # case "$op" in 00:16:46.760 01:17:53 -- scripts/common.sh@344 -- # : 1 00:16:46.760 01:17:53 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:46.760 01:17:53 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:46.760 01:17:53 -- scripts/common.sh@364 -- # decimal 1 00:16:46.760 01:17:53 -- scripts/common.sh@352 -- # local d=1 00:16:46.760 01:17:53 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:46.760 01:17:53 -- scripts/common.sh@354 -- # echo 1 00:16:46.760 01:17:53 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:46.760 01:17:53 -- scripts/common.sh@365 -- # decimal 2 00:16:46.760 01:17:53 -- scripts/common.sh@352 -- # local d=2 00:16:46.761 01:17:53 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:46.761 01:17:53 -- scripts/common.sh@354 -- # echo 2 00:16:46.761 01:17:53 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:46.761 01:17:53 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:46.761 01:17:53 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:46.761 01:17:53 -- scripts/common.sh@367 -- # return 0 00:16:46.761 01:17:53 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:46.761 01:17:53 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:46.761 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:46.761 --rc genhtml_branch_coverage=1 00:16:46.761 --rc genhtml_function_coverage=1 00:16:46.761 --rc genhtml_legend=1 00:16:46.761 --rc geninfo_all_blocks=1 00:16:46.761 --rc geninfo_unexecuted_blocks=1 00:16:46.761 00:16:46.761 ' 00:16:46.761 01:17:53 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:46.761 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:46.761 --rc genhtml_branch_coverage=1 00:16:46.761 --rc genhtml_function_coverage=1 00:16:46.761 --rc genhtml_legend=1 00:16:46.761 --rc geninfo_all_blocks=1 00:16:46.761 --rc geninfo_unexecuted_blocks=1 00:16:46.761 00:16:46.761 ' 00:16:46.761 01:17:53 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:46.761 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:46.761 --rc genhtml_branch_coverage=1 00:16:46.761 --rc genhtml_function_coverage=1 00:16:46.761 --rc genhtml_legend=1 00:16:46.761 --rc geninfo_all_blocks=1 00:16:46.761 --rc geninfo_unexecuted_blocks=1 00:16:46.761 00:16:46.761 ' 00:16:46.761 01:17:53 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:46.761 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:46.761 --rc genhtml_branch_coverage=1 00:16:46.761 --rc genhtml_function_coverage=1 00:16:46.761 --rc genhtml_legend=1 00:16:46.761 --rc geninfo_all_blocks=1 00:16:46.761 --rc geninfo_unexecuted_blocks=1 00:16:46.761 00:16:46.761 ' 00:16:46.761 01:17:53 -- target/host_management.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:46.761 01:17:53 -- nvmf/common.sh@7 -- # uname -s 00:16:46.761 01:17:53 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:46.761 01:17:53 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:46.761 01:17:53 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:46.761 01:17:53 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:46.761 01:17:53 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:46.761 01:17:53 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:46.761 01:17:53 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:46.761 01:17:53 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:46.761 01:17:53 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:46.761 01:17:53 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:46.761 01:17:53 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:46.761 01:17:53 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:46.761 01:17:53 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:46.761 01:17:53 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:46.761 01:17:53 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:46.761 01:17:53 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:46.761 01:17:53 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:46.761 01:17:53 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:46.761 01:17:53 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:46.761 01:17:53 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:46.761 01:17:53 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:46.761 01:17:53 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:46.761 01:17:53 -- paths/export.sh@5 -- # export PATH 00:16:46.761 01:17:53 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:46.761 01:17:53 -- nvmf/common.sh@46 -- # : 0 00:16:46.761 01:17:53 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:46.761 01:17:53 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:46.761 01:17:53 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:46.761 01:17:53 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:46.761 01:17:53 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:46.761 01:17:53 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:46.761 01:17:53 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:46.761 01:17:53 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:46.761 01:17:53 -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:46.761 01:17:53 -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:46.761 01:17:53 -- target/host_management.sh@104 -- # nvmftestinit 00:16:46.761 01:17:53 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:46.761 01:17:53 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:46.761 01:17:53 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:46.761 01:17:53 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:46.761 01:17:53 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:46.761 01:17:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:46.761 01:17:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:46.761 01:17:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:46.761 01:17:53 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:46.761 01:17:53 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:46.761 01:17:53 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:46.761 01:17:53 -- common/autotest_common.sh@10 -- # set +x 00:16:47.696 01:17:55 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:47.696 01:17:55 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:47.696 01:17:55 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:47.696 01:17:55 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:47.697 01:17:55 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:47.697 01:17:55 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:47.697 01:17:55 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:47.697 01:17:55 -- nvmf/common.sh@294 -- # net_devs=() 00:16:47.697 01:17:55 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:47.697 01:17:55 -- nvmf/common.sh@295 -- # e810=() 00:16:47.697 01:17:55 -- nvmf/common.sh@295 -- # local -ga e810 00:16:47.697 01:17:55 -- nvmf/common.sh@296 -- # x722=() 00:16:47.697 01:17:55 -- nvmf/common.sh@296 -- # local -ga x722 00:16:47.697 01:17:55 -- nvmf/common.sh@297 -- # mlx=() 00:16:47.697 01:17:55 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:47.697 01:17:55 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:47.697 01:17:55 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:47.697 01:17:55 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:47.697 01:17:55 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:47.697 01:17:55 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:47.697 01:17:55 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:47.697 01:17:55 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:47.697 01:17:55 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:47.697 01:17:55 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:47.697 01:17:55 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:47.697 01:17:55 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:47.697 01:17:55 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:47.697 01:17:55 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:47.697 01:17:55 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:47.697 01:17:55 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:47.697 01:17:55 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:47.697 01:17:55 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:47.697 01:17:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:47.697 01:17:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:47.697 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:47.697 01:17:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:47.697 01:17:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:47.697 01:17:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:47.697 01:17:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:47.697 01:17:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:47.697 01:17:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:47.697 01:17:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:47.697 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:47.697 01:17:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:47.697 01:17:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:47.697 01:17:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:47.697 01:17:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:47.697 01:17:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:47.697 01:17:55 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:47.697 01:17:55 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:47.697 01:17:55 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:47.697 01:17:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:47.697 01:17:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:47.697 01:17:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:47.697 01:17:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:47.697 01:17:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:47.697 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:47.697 01:17:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:47.697 01:17:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:47.697 01:17:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:47.697 01:17:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:47.697 01:17:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:47.697 01:17:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:47.697 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:47.697 01:17:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:47.697 01:17:55 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:47.697 01:17:55 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:47.697 01:17:55 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:47.697 01:17:55 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:47.697 01:17:55 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:47.697 01:17:55 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:47.697 01:17:55 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:47.697 01:17:55 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:47.697 01:17:55 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:47.697 01:17:55 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:47.697 01:17:55 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:47.697 01:17:55 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:47.697 01:17:55 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:47.697 01:17:55 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:47.697 01:17:55 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:47.697 01:17:55 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:47.697 01:17:55 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:47.697 01:17:55 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:47.697 01:17:55 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:47.697 01:17:55 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:47.697 01:17:55 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:47.697 01:17:55 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:47.697 01:17:55 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:47.697 01:17:55 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:47.697 01:17:55 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:47.697 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:47.697 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.267 ms 00:16:47.697 00:16:47.697 --- 10.0.0.2 ping statistics --- 00:16:47.697 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:47.697 rtt min/avg/max/mdev = 0.267/0.267/0.267/0.000 ms 00:16:47.697 01:17:55 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:47.697 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:47.697 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.096 ms 00:16:47.697 00:16:47.697 --- 10.0.0.1 ping statistics --- 00:16:47.697 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:47.697 rtt min/avg/max/mdev = 0.096/0.096/0.096/0.000 ms 00:16:47.697 01:17:55 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:47.697 01:17:55 -- nvmf/common.sh@410 -- # return 0 00:16:47.697 01:17:55 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:47.697 01:17:55 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:47.697 01:17:55 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:47.697 01:17:55 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:47.697 01:17:55 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:47.697 01:17:55 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:47.697 01:17:55 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:47.697 01:17:55 -- target/host_management.sh@106 -- # run_test nvmf_host_management nvmf_host_management 00:16:47.697 01:17:55 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:16:47.697 01:17:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:47.697 01:17:55 -- common/autotest_common.sh@10 -- # set +x 00:16:47.697 ************************************ 00:16:47.697 START TEST nvmf_host_management 00:16:47.697 ************************************ 00:16:47.697 01:17:55 -- common/autotest_common.sh@1114 -- # nvmf_host_management 00:16:47.697 01:17:55 -- target/host_management.sh@69 -- # starttarget 00:16:47.697 01:17:55 -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:16:47.697 01:17:55 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:47.697 01:17:55 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:47.697 01:17:55 -- common/autotest_common.sh@10 -- # set +x 00:16:47.697 01:17:55 -- nvmf/common.sh@469 -- # nvmfpid=1125385 00:16:47.697 01:17:55 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:16:47.697 01:17:55 -- nvmf/common.sh@470 -- # waitforlisten 1125385 00:16:47.697 01:17:55 -- common/autotest_common.sh@829 -- # '[' -z 1125385 ']' 00:16:47.697 01:17:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:47.697 01:17:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:47.697 01:17:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:47.697 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:47.697 01:17:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:47.697 01:17:55 -- common/autotest_common.sh@10 -- # set +x 00:16:47.697 [2024-11-20 01:17:55.880216] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:16:47.697 [2024-11-20 01:17:55.880305] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:47.957 EAL: No free 2048 kB hugepages reported on node 1 00:16:47.957 [2024-11-20 01:17:55.951535] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:47.957 [2024-11-20 01:17:56.047595] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:47.957 [2024-11-20 01:17:56.047759] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:47.957 [2024-11-20 01:17:56.047777] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:47.957 [2024-11-20 01:17:56.047790] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:47.957 [2024-11-20 01:17:56.047897] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:47.957 [2024-11-20 01:17:56.047976] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:47.957 [2024-11-20 01:17:56.048041] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:16:47.957 [2024-11-20 01:17:56.048043] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:48.893 01:17:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:48.893 01:17:56 -- common/autotest_common.sh@862 -- # return 0 00:16:48.893 01:17:56 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:48.893 01:17:56 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:48.893 01:17:56 -- common/autotest_common.sh@10 -- # set +x 00:16:48.893 01:17:56 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:48.893 01:17:56 -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:16:48.893 01:17:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:48.893 01:17:56 -- common/autotest_common.sh@10 -- # set +x 00:16:48.893 [2024-11-20 01:17:56.848581] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:48.893 01:17:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:48.893 01:17:56 -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:16:48.893 01:17:56 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:48.893 01:17:56 -- common/autotest_common.sh@10 -- # set +x 00:16:48.893 01:17:56 -- target/host_management.sh@22 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:16:48.893 01:17:56 -- target/host_management.sh@23 -- # cat 00:16:48.893 01:17:56 -- target/host_management.sh@30 -- # rpc_cmd 00:16:48.893 01:17:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:48.893 01:17:56 -- common/autotest_common.sh@10 -- # set +x 00:16:48.893 Malloc0 00:16:48.893 [2024-11-20 01:17:56.907475] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:48.893 01:17:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:48.893 01:17:56 -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:16:48.893 01:17:56 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:48.893 01:17:56 -- common/autotest_common.sh@10 -- # set +x 00:16:48.893 01:17:56 -- target/host_management.sh@73 -- # perfpid=1125563 00:16:48.893 01:17:56 -- target/host_management.sh@74 -- # waitforlisten 1125563 /var/tmp/bdevperf.sock 00:16:48.893 01:17:56 -- common/autotest_common.sh@829 -- # '[' -z 1125563 ']' 00:16:48.893 01:17:56 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:16:48.893 01:17:56 -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:16:48.893 01:17:56 -- target/host_management.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:16:48.893 01:17:56 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:48.893 01:17:56 -- nvmf/common.sh@520 -- # config=() 00:16:48.893 01:17:56 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:16:48.893 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:16:48.893 01:17:56 -- nvmf/common.sh@520 -- # local subsystem config 00:16:48.893 01:17:56 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:48.893 01:17:56 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:48.893 01:17:56 -- common/autotest_common.sh@10 -- # set +x 00:16:48.893 01:17:56 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:48.893 { 00:16:48.893 "params": { 00:16:48.893 "name": "Nvme$subsystem", 00:16:48.893 "trtype": "$TEST_TRANSPORT", 00:16:48.893 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:48.893 "adrfam": "ipv4", 00:16:48.893 "trsvcid": "$NVMF_PORT", 00:16:48.893 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:48.893 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:48.893 "hdgst": ${hdgst:-false}, 00:16:48.893 "ddgst": ${ddgst:-false} 00:16:48.893 }, 00:16:48.893 "method": "bdev_nvme_attach_controller" 00:16:48.893 } 00:16:48.893 EOF 00:16:48.893 )") 00:16:48.893 01:17:56 -- nvmf/common.sh@542 -- # cat 00:16:48.893 01:17:56 -- nvmf/common.sh@544 -- # jq . 00:16:48.893 01:17:56 -- nvmf/common.sh@545 -- # IFS=, 00:16:48.893 01:17:56 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:48.893 "params": { 00:16:48.893 "name": "Nvme0", 00:16:48.893 "trtype": "tcp", 00:16:48.893 "traddr": "10.0.0.2", 00:16:48.893 "adrfam": "ipv4", 00:16:48.893 "trsvcid": "4420", 00:16:48.893 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:16:48.893 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:16:48.893 "hdgst": false, 00:16:48.893 "ddgst": false 00:16:48.893 }, 00:16:48.893 "method": "bdev_nvme_attach_controller" 00:16:48.893 }' 00:16:48.893 [2024-11-20 01:17:56.976323] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:16:48.893 [2024-11-20 01:17:56.976447] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1125563 ] 00:16:48.893 EAL: No free 2048 kB hugepages reported on node 1 00:16:48.893 [2024-11-20 01:17:57.038217] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:49.154 [2024-11-20 01:17:57.123926] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:49.154 Running I/O for 10 seconds... 00:16:49.724 01:17:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:49.985 01:17:57 -- common/autotest_common.sh@862 -- # return 0 00:16:49.985 01:17:57 -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:16:49.986 01:17:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:49.986 01:17:57 -- common/autotest_common.sh@10 -- # set +x 00:16:49.986 01:17:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:49.986 01:17:57 -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:16:49.986 01:17:57 -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:16:49.986 01:17:57 -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:16:49.986 01:17:57 -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:16:49.986 01:17:57 -- target/host_management.sh@52 -- # local ret=1 00:16:49.986 01:17:57 -- target/host_management.sh@53 -- # local i 00:16:49.986 01:17:57 -- target/host_management.sh@54 -- # (( i = 10 )) 00:16:49.986 01:17:57 -- target/host_management.sh@54 -- # (( i != 0 )) 00:16:49.986 01:17:57 -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:16:49.986 01:17:57 -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:16:49.986 01:17:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:49.986 01:17:57 -- common/autotest_common.sh@10 -- # set +x 00:16:49.986 01:17:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:49.986 01:17:58 -- target/host_management.sh@55 -- # read_io_count=2651 00:16:49.986 01:17:58 -- target/host_management.sh@58 -- # '[' 2651 -ge 100 ']' 00:16:49.986 01:17:58 -- target/host_management.sh@59 -- # ret=0 00:16:49.986 01:17:58 -- target/host_management.sh@60 -- # break 00:16:49.986 01:17:58 -- target/host_management.sh@64 -- # return 0 00:16:49.986 01:17:58 -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:16:49.986 01:17:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:49.986 01:17:58 -- common/autotest_common.sh@10 -- # set +x 00:16:49.986 [2024-11-20 01:17:58.007128] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17c6ad0 is same with the state(5) to be set 00:16:49.986 [2024-11-20 01:17:58.007250] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17c6ad0 is same with the state(5) to be set 00:16:49.986 [2024-11-20 01:17:58.007278] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17c6ad0 is same with the state(5) to be set 00:16:49.986 01:17:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:49.986 01:17:58 -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:16:49.986 01:17:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:49.986 [2024-11-20 01:17:58.011857] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:16:49.986 [2024-11-20 01:17:58.011899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.986 [2024-11-20 01:17:58.011917] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:16:49.986 [2024-11-20 01:17:58.011932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.986 01:17:58 -- common/autotest_common.sh@10 -- # set +x 00:16:49.986 [2024-11-20 01:17:58.011946] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:16:49.986 [2024-11-20 01:17:58.011962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.986 [2024-11-20 01:17:58.011977] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:16:49.986 [2024-11-20 01:17:58.012003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.986 [2024-11-20 01:17:58.012017] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14331d0 is same with the state(5) to be set 00:16:49.986 [2024-11-20 01:17:58.013246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:95360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.986 [2024-11-20 01:17:58.013273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.986 [2024-11-20 01:17:58.013301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:95488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.986 [2024-11-20 01:17:58.013319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.986 [2024-11-20 01:17:58.013337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:95872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.986 [2024-11-20 01:17:58.013359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.986 [2024-11-20 01:17:58.013375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:90368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.986 [2024-11-20 01:17:58.013391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.986 [2024-11-20 01:17:58.013408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:96256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.986 [2024-11-20 01:17:58.013442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.986 [2024-11-20 01:17:58.013460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:96384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.986 [2024-11-20 01:17:58.013475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.986 [2024-11-20 01:17:58.013492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:96512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.986 [2024-11-20 01:17:58.013508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.986 [2024-11-20 01:17:58.013525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:96640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.986 [2024-11-20 01:17:58.013540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.986 [2024-11-20 01:17:58.013557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:96768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.986 [2024-11-20 01:17:58.013572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.986 [2024-11-20 01:17:58.013589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:96896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.986 [2024-11-20 01:17:58.013604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.986 [2024-11-20 01:17:58.013621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:97024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.986 [2024-11-20 01:17:58.013637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.986 [2024-11-20 01:17:58.013654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:97152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.986 [2024-11-20 01:17:58.013675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.986 [2024-11-20 01:17:58.013692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:97280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.986 [2024-11-20 01:17:58.013708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.986 [2024-11-20 01:17:58.013726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:97408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.986 [2024-11-20 01:17:58.013742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.986 [2024-11-20 01:17:58.013759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:97536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.986 [2024-11-20 01:17:58.013774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.986 [2024-11-20 01:17:58.013791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:97664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.986 [2024-11-20 01:17:58.013807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.986 [2024-11-20 01:17:58.013823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:97792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.986 [2024-11-20 01:17:58.013839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.986 [2024-11-20 01:17:58.013857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:97920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.986 [2024-11-20 01:17:58.013872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.986 [2024-11-20 01:17:58.013889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:98048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.986 [2024-11-20 01:17:58.013905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.986 [2024-11-20 01:17:58.013922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:98176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.986 [2024-11-20 01:17:58.013938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.986 [2024-11-20 01:17:58.013954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:98304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.986 [2024-11-20 01:17:58.013970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.986 [2024-11-20 01:17:58.013987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:98432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.986 [2024-11-20 01:17:58.014002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.986 [2024-11-20 01:17:58.014019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:98560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.986 [2024-11-20 01:17:58.014035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.986 [2024-11-20 01:17:58.014067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:98688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.986 [2024-11-20 01:17:58.014098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.986 [2024-11-20 01:17:58.014129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:98816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.986 [2024-11-20 01:17:58.014146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.986 [2024-11-20 01:17:58.014164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:98944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.986 [2024-11-20 01:17:58.014179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.986 [2024-11-20 01:17:58.014196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:99072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.986 [2024-11-20 01:17:58.014212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.986 [2024-11-20 01:17:58.014229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:99200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.986 [2024-11-20 01:17:58.014245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.986 [2024-11-20 01:17:58.014262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:91264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.986 [2024-11-20 01:17:58.014278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.986 [2024-11-20 01:17:58.014295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:99328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.986 [2024-11-20 01:17:58.014311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.986 [2024-11-20 01:17:58.014328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:99456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.986 [2024-11-20 01:17:58.014344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.986 [2024-11-20 01:17:58.014386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:99584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.986 [2024-11-20 01:17:58.014401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.986 [2024-11-20 01:17:58.014418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:91520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.986 [2024-11-20 01:17:58.014445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.986 [2024-11-20 01:17:58.014461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:99712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.986 [2024-11-20 01:17:58.014477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.986 [2024-11-20 01:17:58.014494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:99840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.986 [2024-11-20 01:17:58.014510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.986 [2024-11-20 01:17:58.014526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:99968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.986 [2024-11-20 01:17:58.014542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.986 [2024-11-20 01:17:58.014558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:91776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.986 [2024-11-20 01:17:58.014577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.986 [2024-11-20 01:17:58.014594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:91904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.986 [2024-11-20 01:17:58.014610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.986 [2024-11-20 01:17:58.014628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:100096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.986 [2024-11-20 01:17:58.014643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.986 [2024-11-20 01:17:58.014661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:100224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.986 [2024-11-20 01:17:58.014676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.986 [2024-11-20 01:17:58.014694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:100352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.986 [2024-11-20 01:17:58.014710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.986 [2024-11-20 01:17:58.014726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:100480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.986 [2024-11-20 01:17:58.014743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.986 [2024-11-20 01:17:58.014761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:92032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.986 [2024-11-20 01:17:58.014777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.986 [2024-11-20 01:17:58.014796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:100608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.986 [2024-11-20 01:17:58.014811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.987 [2024-11-20 01:17:58.014829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:100736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.987 [2024-11-20 01:17:58.014845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.987 [2024-11-20 01:17:58.014862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:100864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.987 [2024-11-20 01:17:58.014877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.987 [2024-11-20 01:17:58.014895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:92928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.987 [2024-11-20 01:17:58.014911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.987 [2024-11-20 01:17:58.014928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:100992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.987 [2024-11-20 01:17:58.014944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.987 [2024-11-20 01:17:58.014962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:93056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.987 [2024-11-20 01:17:58.014978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.987 [2024-11-20 01:17:58.014998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:101120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.987 [2024-11-20 01:17:58.015015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.987 [2024-11-20 01:17:58.015032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:101248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.987 [2024-11-20 01:17:58.015062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.987 [2024-11-20 01:17:58.015091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:101376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.987 [2024-11-20 01:17:58.015116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.987 [2024-11-20 01:17:58.015133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:93184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.987 [2024-11-20 01:17:58.015147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.987 [2024-11-20 01:17:58.015165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:101504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.987 [2024-11-20 01:17:58.015182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.987 [2024-11-20 01:17:58.015199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:101632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.987 [2024-11-20 01:17:58.015215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.987 [2024-11-20 01:17:58.015232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:93312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.987 [2024-11-20 01:17:58.015247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.987 [2024-11-20 01:17:58.015264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:93696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.987 [2024-11-20 01:17:58.015280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.987 [2024-11-20 01:17:58.015297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:101760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.987 [2024-11-20 01:17:58.015313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.987 [2024-11-20 01:17:58.015329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:101888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.987 [2024-11-20 01:17:58.015345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.987 [2024-11-20 01:17:58.015361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:102016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.987 [2024-11-20 01:17:58.015376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.987 [2024-11-20 01:17:58.015409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:93824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.987 [2024-11-20 01:17:58.015424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.987 [2024-11-20 01:17:58.015441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:94336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.987 [2024-11-20 01:17:58.015460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.987 [2024-11-20 01:17:58.015478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:94592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.987 [2024-11-20 01:17:58.015495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.987 [2024-11-20 01:17:58.015512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:94848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:49.987 [2024-11-20 01:17:58.015527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:49.987 [2024-11-20 01:17:58.015621] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x142d630 was disconnected and freed. reset controller. 00:16:49.987 [2024-11-20 01:17:58.016766] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:16:49.987 task offset: 95360 on job bdev=Nvme0n1 fails 00:16:49.987 00:16:49.987 Latency(us) 00:16:49.987 [2024-11-20T00:17:58.206Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:49.987 [2024-11-20T00:17:58.206Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:16:49.987 [2024-11-20T00:17:58.206Z] Job: Nvme0n1 ended in about 0.72 seconds with error 00:16:49.987 Verification LBA range: start 0x0 length 0x400 00:16:49.987 Nvme0n1 : 0.72 3851.62 240.73 88.61 0.00 16011.08 2718.53 21845.33 00:16:49.987 [2024-11-20T00:17:58.206Z] =================================================================================================================== 00:16:49.987 [2024-11-20T00:17:58.206Z] Total : 3851.62 240.73 88.61 0.00 16011.08 2718.53 21845.33 00:16:49.987 [2024-11-20 01:17:58.018640] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:16:49.987 [2024-11-20 01:17:58.018669] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14331d0 (9): Bad file descriptor 00:16:49.987 01:17:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:49.987 01:17:58 -- target/host_management.sh@87 -- # sleep 1 00:16:49.987 [2024-11-20 01:17:58.063292] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:16:50.924 01:17:59 -- target/host_management.sh@91 -- # kill -9 1125563 00:16:50.924 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh: line 91: kill: (1125563) - No such process 00:16:50.924 01:17:59 -- target/host_management.sh@91 -- # true 00:16:50.924 01:17:59 -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:16:50.924 01:17:59 -- target/host_management.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:16:50.924 01:17:59 -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:16:50.924 01:17:59 -- nvmf/common.sh@520 -- # config=() 00:16:50.924 01:17:59 -- nvmf/common.sh@520 -- # local subsystem config 00:16:50.924 01:17:59 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:50.924 01:17:59 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:50.924 { 00:16:50.924 "params": { 00:16:50.924 "name": "Nvme$subsystem", 00:16:50.924 "trtype": "$TEST_TRANSPORT", 00:16:50.924 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:50.924 "adrfam": "ipv4", 00:16:50.924 "trsvcid": "$NVMF_PORT", 00:16:50.924 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:50.924 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:50.924 "hdgst": ${hdgst:-false}, 00:16:50.924 "ddgst": ${ddgst:-false} 00:16:50.924 }, 00:16:50.924 "method": "bdev_nvme_attach_controller" 00:16:50.924 } 00:16:50.924 EOF 00:16:50.924 )") 00:16:50.924 01:17:59 -- nvmf/common.sh@542 -- # cat 00:16:50.924 01:17:59 -- nvmf/common.sh@544 -- # jq . 00:16:50.924 01:17:59 -- nvmf/common.sh@545 -- # IFS=, 00:16:50.924 01:17:59 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:50.924 "params": { 00:16:50.924 "name": "Nvme0", 00:16:50.924 "trtype": "tcp", 00:16:50.924 "traddr": "10.0.0.2", 00:16:50.924 "adrfam": "ipv4", 00:16:50.924 "trsvcid": "4420", 00:16:50.924 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:16:50.924 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:16:50.924 "hdgst": false, 00:16:50.924 "ddgst": false 00:16:50.924 }, 00:16:50.924 "method": "bdev_nvme_attach_controller" 00:16:50.924 }' 00:16:50.924 [2024-11-20 01:17:59.066788] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:16:50.924 [2024-11-20 01:17:59.066859] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1125847 ] 00:16:50.924 EAL: No free 2048 kB hugepages reported on node 1 00:16:50.924 [2024-11-20 01:17:59.126968] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:51.199 [2024-11-20 01:17:59.213167] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:51.505 Running I/O for 1 seconds... 00:16:52.440 00:16:52.440 Latency(us) 00:16:52.440 [2024-11-20T00:18:00.659Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:52.440 [2024-11-20T00:18:00.659Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:16:52.440 Verification LBA range: start 0x0 length 0x400 00:16:52.440 Nvme0n1 : 1.02 3428.55 214.28 0.00 0.00 18345.86 2220.94 26020.22 00:16:52.440 [2024-11-20T00:18:00.659Z] =================================================================================================================== 00:16:52.440 [2024-11-20T00:18:00.659Z] Total : 3428.55 214.28 0.00 0.00 18345.86 2220.94 26020.22 00:16:52.698 01:18:00 -- target/host_management.sh@101 -- # stoptarget 00:16:52.698 01:18:00 -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:16:52.698 01:18:00 -- target/host_management.sh@37 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:16:52.698 01:18:00 -- target/host_management.sh@38 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:16:52.698 01:18:00 -- target/host_management.sh@40 -- # nvmftestfini 00:16:52.698 01:18:00 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:52.698 01:18:00 -- nvmf/common.sh@116 -- # sync 00:16:52.698 01:18:00 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:52.698 01:18:00 -- nvmf/common.sh@119 -- # set +e 00:16:52.698 01:18:00 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:52.698 01:18:00 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:52.698 rmmod nvme_tcp 00:16:52.698 rmmod nvme_fabrics 00:16:52.698 rmmod nvme_keyring 00:16:52.698 01:18:00 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:52.698 01:18:00 -- nvmf/common.sh@123 -- # set -e 00:16:52.698 01:18:00 -- nvmf/common.sh@124 -- # return 0 00:16:52.698 01:18:00 -- nvmf/common.sh@477 -- # '[' -n 1125385 ']' 00:16:52.698 01:18:00 -- nvmf/common.sh@478 -- # killprocess 1125385 00:16:52.698 01:18:00 -- common/autotest_common.sh@936 -- # '[' -z 1125385 ']' 00:16:52.698 01:18:00 -- common/autotest_common.sh@940 -- # kill -0 1125385 00:16:52.698 01:18:00 -- common/autotest_common.sh@941 -- # uname 00:16:52.698 01:18:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:52.698 01:18:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1125385 00:16:52.698 01:18:00 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:16:52.698 01:18:00 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:16:52.698 01:18:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1125385' 00:16:52.698 killing process with pid 1125385 00:16:52.698 01:18:00 -- common/autotest_common.sh@955 -- # kill 1125385 00:16:52.698 01:18:00 -- common/autotest_common.sh@960 -- # wait 1125385 00:16:52.956 [2024-11-20 01:18:00.994051] app.c: 605:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:16:52.956 01:18:01 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:52.956 01:18:01 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:52.956 01:18:01 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:52.956 01:18:01 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:52.956 01:18:01 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:52.956 01:18:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:52.956 01:18:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:52.956 01:18:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:54.860 01:18:03 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:54.860 00:16:54.860 real 0m7.231s 00:16:54.860 user 0m22.132s 00:16:54.860 sys 0m1.473s 00:16:54.860 01:18:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:54.860 01:18:03 -- common/autotest_common.sh@10 -- # set +x 00:16:54.860 ************************************ 00:16:54.860 END TEST nvmf_host_management 00:16:54.860 ************************************ 00:16:55.119 01:18:03 -- target/host_management.sh@108 -- # trap - SIGINT SIGTERM EXIT 00:16:55.119 00:16:55.119 real 0m9.537s 00:16:55.119 user 0m22.958s 00:16:55.119 sys 0m2.989s 00:16:55.119 01:18:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:55.119 01:18:03 -- common/autotest_common.sh@10 -- # set +x 00:16:55.119 ************************************ 00:16:55.119 END TEST nvmf_host_management 00:16:55.119 ************************************ 00:16:55.119 01:18:03 -- nvmf/nvmf.sh@47 -- # run_test nvmf_lvol /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:16:55.119 01:18:03 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:55.119 01:18:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:55.119 01:18:03 -- common/autotest_common.sh@10 -- # set +x 00:16:55.119 ************************************ 00:16:55.119 START TEST nvmf_lvol 00:16:55.119 ************************************ 00:16:55.119 01:18:03 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:16:55.119 * Looking for test storage... 00:16:55.119 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:55.119 01:18:03 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:55.119 01:18:03 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:55.119 01:18:03 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:55.119 01:18:03 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:55.119 01:18:03 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:55.119 01:18:03 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:55.119 01:18:03 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:55.119 01:18:03 -- scripts/common.sh@335 -- # IFS=.-: 00:16:55.119 01:18:03 -- scripts/common.sh@335 -- # read -ra ver1 00:16:55.119 01:18:03 -- scripts/common.sh@336 -- # IFS=.-: 00:16:55.119 01:18:03 -- scripts/common.sh@336 -- # read -ra ver2 00:16:55.119 01:18:03 -- scripts/common.sh@337 -- # local 'op=<' 00:16:55.119 01:18:03 -- scripts/common.sh@339 -- # ver1_l=2 00:16:55.119 01:18:03 -- scripts/common.sh@340 -- # ver2_l=1 00:16:55.119 01:18:03 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:55.119 01:18:03 -- scripts/common.sh@343 -- # case "$op" in 00:16:55.119 01:18:03 -- scripts/common.sh@344 -- # : 1 00:16:55.119 01:18:03 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:55.119 01:18:03 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:55.119 01:18:03 -- scripts/common.sh@364 -- # decimal 1 00:16:55.119 01:18:03 -- scripts/common.sh@352 -- # local d=1 00:16:55.119 01:18:03 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:55.119 01:18:03 -- scripts/common.sh@354 -- # echo 1 00:16:55.119 01:18:03 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:55.119 01:18:03 -- scripts/common.sh@365 -- # decimal 2 00:16:55.119 01:18:03 -- scripts/common.sh@352 -- # local d=2 00:16:55.119 01:18:03 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:55.119 01:18:03 -- scripts/common.sh@354 -- # echo 2 00:16:55.119 01:18:03 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:55.119 01:18:03 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:55.119 01:18:03 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:55.119 01:18:03 -- scripts/common.sh@367 -- # return 0 00:16:55.119 01:18:03 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:55.119 01:18:03 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:55.119 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:55.119 --rc genhtml_branch_coverage=1 00:16:55.119 --rc genhtml_function_coverage=1 00:16:55.119 --rc genhtml_legend=1 00:16:55.119 --rc geninfo_all_blocks=1 00:16:55.119 --rc geninfo_unexecuted_blocks=1 00:16:55.119 00:16:55.119 ' 00:16:55.119 01:18:03 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:55.119 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:55.119 --rc genhtml_branch_coverage=1 00:16:55.119 --rc genhtml_function_coverage=1 00:16:55.119 --rc genhtml_legend=1 00:16:55.119 --rc geninfo_all_blocks=1 00:16:55.119 --rc geninfo_unexecuted_blocks=1 00:16:55.119 00:16:55.119 ' 00:16:55.119 01:18:03 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:55.119 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:55.119 --rc genhtml_branch_coverage=1 00:16:55.119 --rc genhtml_function_coverage=1 00:16:55.119 --rc genhtml_legend=1 00:16:55.119 --rc geninfo_all_blocks=1 00:16:55.119 --rc geninfo_unexecuted_blocks=1 00:16:55.119 00:16:55.119 ' 00:16:55.119 01:18:03 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:55.119 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:55.119 --rc genhtml_branch_coverage=1 00:16:55.119 --rc genhtml_function_coverage=1 00:16:55.119 --rc genhtml_legend=1 00:16:55.119 --rc geninfo_all_blocks=1 00:16:55.119 --rc geninfo_unexecuted_blocks=1 00:16:55.119 00:16:55.119 ' 00:16:55.119 01:18:03 -- target/nvmf_lvol.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:55.119 01:18:03 -- nvmf/common.sh@7 -- # uname -s 00:16:55.119 01:18:03 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:55.119 01:18:03 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:55.119 01:18:03 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:55.119 01:18:03 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:55.119 01:18:03 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:55.119 01:18:03 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:55.119 01:18:03 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:55.119 01:18:03 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:55.119 01:18:03 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:55.119 01:18:03 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:55.119 01:18:03 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:55.119 01:18:03 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:55.119 01:18:03 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:55.119 01:18:03 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:55.119 01:18:03 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:55.119 01:18:03 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:55.119 01:18:03 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:55.119 01:18:03 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:55.119 01:18:03 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:55.120 01:18:03 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:55.120 01:18:03 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:55.120 01:18:03 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:55.120 01:18:03 -- paths/export.sh@5 -- # export PATH 00:16:55.120 01:18:03 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:55.120 01:18:03 -- nvmf/common.sh@46 -- # : 0 00:16:55.120 01:18:03 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:55.120 01:18:03 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:55.120 01:18:03 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:55.120 01:18:03 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:55.120 01:18:03 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:55.120 01:18:03 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:55.120 01:18:03 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:55.120 01:18:03 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:55.120 01:18:03 -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:55.120 01:18:03 -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:55.120 01:18:03 -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:16:55.120 01:18:03 -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:16:55.120 01:18:03 -- target/nvmf_lvol.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:16:55.120 01:18:03 -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:16:55.120 01:18:03 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:55.120 01:18:03 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:55.120 01:18:03 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:55.120 01:18:03 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:55.120 01:18:03 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:55.120 01:18:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:55.120 01:18:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:55.120 01:18:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:55.120 01:18:03 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:55.120 01:18:03 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:55.120 01:18:03 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:55.120 01:18:03 -- common/autotest_common.sh@10 -- # set +x 00:16:57.030 01:18:05 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:57.030 01:18:05 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:57.030 01:18:05 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:57.030 01:18:05 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:57.030 01:18:05 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:57.030 01:18:05 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:57.030 01:18:05 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:57.030 01:18:05 -- nvmf/common.sh@294 -- # net_devs=() 00:16:57.030 01:18:05 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:57.030 01:18:05 -- nvmf/common.sh@295 -- # e810=() 00:16:57.030 01:18:05 -- nvmf/common.sh@295 -- # local -ga e810 00:16:57.030 01:18:05 -- nvmf/common.sh@296 -- # x722=() 00:16:57.030 01:18:05 -- nvmf/common.sh@296 -- # local -ga x722 00:16:57.030 01:18:05 -- nvmf/common.sh@297 -- # mlx=() 00:16:57.030 01:18:05 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:57.030 01:18:05 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:57.030 01:18:05 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:57.030 01:18:05 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:57.030 01:18:05 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:57.030 01:18:05 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:57.030 01:18:05 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:57.030 01:18:05 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:57.030 01:18:05 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:57.030 01:18:05 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:57.030 01:18:05 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:57.030 01:18:05 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:57.030 01:18:05 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:57.030 01:18:05 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:57.030 01:18:05 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:57.030 01:18:05 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:57.030 01:18:05 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:57.030 01:18:05 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:57.030 01:18:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:57.030 01:18:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:57.030 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:57.030 01:18:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:57.030 01:18:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:57.030 01:18:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:57.030 01:18:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:57.030 01:18:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:57.030 01:18:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:57.030 01:18:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:57.030 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:57.030 01:18:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:57.030 01:18:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:57.030 01:18:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:57.030 01:18:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:57.030 01:18:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:57.030 01:18:05 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:57.030 01:18:05 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:57.030 01:18:05 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:57.030 01:18:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:57.030 01:18:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:57.030 01:18:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:57.031 01:18:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:57.031 01:18:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:57.031 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:57.031 01:18:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:57.031 01:18:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:57.031 01:18:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:57.031 01:18:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:57.031 01:18:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:57.031 01:18:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:57.031 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:57.031 01:18:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:57.031 01:18:05 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:57.031 01:18:05 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:57.031 01:18:05 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:57.031 01:18:05 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:57.031 01:18:05 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:57.031 01:18:05 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:57.031 01:18:05 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:57.031 01:18:05 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:57.031 01:18:05 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:57.031 01:18:05 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:57.031 01:18:05 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:57.031 01:18:05 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:57.031 01:18:05 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:57.031 01:18:05 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:57.031 01:18:05 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:57.031 01:18:05 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:57.031 01:18:05 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:57.031 01:18:05 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:57.031 01:18:05 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:57.031 01:18:05 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:57.031 01:18:05 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:57.031 01:18:05 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:57.290 01:18:05 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:57.290 01:18:05 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:57.290 01:18:05 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:57.290 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:57.290 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.221 ms 00:16:57.290 00:16:57.290 --- 10.0.0.2 ping statistics --- 00:16:57.290 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:57.290 rtt min/avg/max/mdev = 0.221/0.221/0.221/0.000 ms 00:16:57.290 01:18:05 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:57.290 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:57.290 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.078 ms 00:16:57.290 00:16:57.290 --- 10.0.0.1 ping statistics --- 00:16:57.290 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:57.290 rtt min/avg/max/mdev = 0.078/0.078/0.078/0.000 ms 00:16:57.290 01:18:05 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:57.290 01:18:05 -- nvmf/common.sh@410 -- # return 0 00:16:57.290 01:18:05 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:57.290 01:18:05 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:57.290 01:18:05 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:57.290 01:18:05 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:57.290 01:18:05 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:57.290 01:18:05 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:57.290 01:18:05 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:57.290 01:18:05 -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:16:57.290 01:18:05 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:57.290 01:18:05 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:57.290 01:18:05 -- common/autotest_common.sh@10 -- # set +x 00:16:57.290 01:18:05 -- nvmf/common.sh@469 -- # nvmfpid=1128107 00:16:57.290 01:18:05 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:16:57.290 01:18:05 -- nvmf/common.sh@470 -- # waitforlisten 1128107 00:16:57.290 01:18:05 -- common/autotest_common.sh@829 -- # '[' -z 1128107 ']' 00:16:57.290 01:18:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:57.290 01:18:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:57.291 01:18:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:57.291 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:57.291 01:18:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:57.291 01:18:05 -- common/autotest_common.sh@10 -- # set +x 00:16:57.291 [2024-11-20 01:18:05.410624] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:16:57.291 [2024-11-20 01:18:05.410725] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:57.291 EAL: No free 2048 kB hugepages reported on node 1 00:16:57.291 [2024-11-20 01:18:05.480219] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:16:57.549 [2024-11-20 01:18:05.572776] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:57.549 [2024-11-20 01:18:05.572931] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:57.549 [2024-11-20 01:18:05.572949] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:57.549 [2024-11-20 01:18:05.572962] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:57.549 [2024-11-20 01:18:05.573020] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:57.549 [2024-11-20 01:18:05.573093] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:57.549 [2024-11-20 01:18:05.573097] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:58.486 01:18:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:58.486 01:18:06 -- common/autotest_common.sh@862 -- # return 0 00:16:58.486 01:18:06 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:58.486 01:18:06 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:58.486 01:18:06 -- common/autotest_common.sh@10 -- # set +x 00:16:58.486 01:18:06 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:58.486 01:18:06 -- target/nvmf_lvol.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:16:58.487 [2024-11-20 01:18:06.661840] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:58.487 01:18:06 -- target/nvmf_lvol.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:59.053 01:18:06 -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:16:59.053 01:18:06 -- target/nvmf_lvol.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:59.053 01:18:07 -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:16:59.053 01:18:07 -- target/nvmf_lvol.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:16:59.311 01:18:07 -- target/nvmf_lvol.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:16:59.876 01:18:07 -- target/nvmf_lvol.sh@29 -- # lvs=0020b634-ff65-4517-8085-80025ded30e2 00:16:59.876 01:18:07 -- target/nvmf_lvol.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 0020b634-ff65-4517-8085-80025ded30e2 lvol 20 00:16:59.876 01:18:08 -- target/nvmf_lvol.sh@32 -- # lvol=2d466127-a832-496f-91b2-22aece8f8bfc 00:16:59.876 01:18:08 -- target/nvmf_lvol.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:17:00.134 01:18:08 -- target/nvmf_lvol.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 2d466127-a832-496f-91b2-22aece8f8bfc 00:17:00.391 01:18:08 -- target/nvmf_lvol.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:17:00.649 [2024-11-20 01:18:08.834437] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:00.650 01:18:08 -- target/nvmf_lvol.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:17:00.907 01:18:09 -- target/nvmf_lvol.sh@42 -- # perf_pid=1129150 00:17:00.907 01:18:09 -- target/nvmf_lvol.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:17:00.907 01:18:09 -- target/nvmf_lvol.sh@44 -- # sleep 1 00:17:01.165 EAL: No free 2048 kB hugepages reported on node 1 00:17:02.099 01:18:10 -- target/nvmf_lvol.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_snapshot 2d466127-a832-496f-91b2-22aece8f8bfc MY_SNAPSHOT 00:17:02.357 01:18:10 -- target/nvmf_lvol.sh@47 -- # snapshot=72bab86d-f02c-41f6-a8e5-5be86e16f211 00:17:02.357 01:18:10 -- target/nvmf_lvol.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_resize 2d466127-a832-496f-91b2-22aece8f8bfc 30 00:17:02.615 01:18:10 -- target/nvmf_lvol.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_clone 72bab86d-f02c-41f6-a8e5-5be86e16f211 MY_CLONE 00:17:02.873 01:18:11 -- target/nvmf_lvol.sh@49 -- # clone=8704168a-4f0a-4d47-8e47-997f606e87db 00:17:02.873 01:18:11 -- target/nvmf_lvol.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_inflate 8704168a-4f0a-4d47-8e47-997f606e87db 00:17:03.441 01:18:11 -- target/nvmf_lvol.sh@53 -- # wait 1129150 00:17:11.553 Initializing NVMe Controllers 00:17:11.553 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:17:11.553 Controller IO queue size 128, less than required. 00:17:11.553 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:17:11.553 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:17:11.553 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:17:11.553 Initialization complete. Launching workers. 00:17:11.553 ======================================================== 00:17:11.553 Latency(us) 00:17:11.553 Device Information : IOPS MiB/s Average min max 00:17:11.553 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 10820.00 42.27 11836.95 1761.59 85214.84 00:17:11.553 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 10759.00 42.03 11905.44 1988.87 67448.83 00:17:11.553 ======================================================== 00:17:11.553 Total : 21579.00 84.29 11871.10 1761.59 85214.84 00:17:11.553 00:17:11.553 01:18:19 -- target/nvmf_lvol.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:17:11.553 01:18:19 -- target/nvmf_lvol.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 2d466127-a832-496f-91b2-22aece8f8bfc 00:17:11.810 01:18:20 -- target/nvmf_lvol.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 0020b634-ff65-4517-8085-80025ded30e2 00:17:12.376 01:18:20 -- target/nvmf_lvol.sh@60 -- # rm -f 00:17:12.376 01:18:20 -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:17:12.376 01:18:20 -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:17:12.376 01:18:20 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:12.376 01:18:20 -- nvmf/common.sh@116 -- # sync 00:17:12.376 01:18:20 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:12.376 01:18:20 -- nvmf/common.sh@119 -- # set +e 00:17:12.376 01:18:20 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:12.376 01:18:20 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:12.376 rmmod nvme_tcp 00:17:12.376 rmmod nvme_fabrics 00:17:12.376 rmmod nvme_keyring 00:17:12.376 01:18:20 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:12.376 01:18:20 -- nvmf/common.sh@123 -- # set -e 00:17:12.376 01:18:20 -- nvmf/common.sh@124 -- # return 0 00:17:12.376 01:18:20 -- nvmf/common.sh@477 -- # '[' -n 1128107 ']' 00:17:12.376 01:18:20 -- nvmf/common.sh@478 -- # killprocess 1128107 00:17:12.376 01:18:20 -- common/autotest_common.sh@936 -- # '[' -z 1128107 ']' 00:17:12.376 01:18:20 -- common/autotest_common.sh@940 -- # kill -0 1128107 00:17:12.376 01:18:20 -- common/autotest_common.sh@941 -- # uname 00:17:12.376 01:18:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:12.376 01:18:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1128107 00:17:12.376 01:18:20 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:12.376 01:18:20 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:12.376 01:18:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1128107' 00:17:12.376 killing process with pid 1128107 00:17:12.376 01:18:20 -- common/autotest_common.sh@955 -- # kill 1128107 00:17:12.376 01:18:20 -- common/autotest_common.sh@960 -- # wait 1128107 00:17:12.634 01:18:20 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:12.634 01:18:20 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:12.634 01:18:20 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:12.634 01:18:20 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:12.634 01:18:20 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:12.634 01:18:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:12.634 01:18:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:12.634 01:18:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:14.539 01:18:22 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:14.539 00:17:14.539 real 0m19.592s 00:17:14.539 user 1m6.360s 00:17:14.539 sys 0m5.723s 00:17:14.539 01:18:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:14.539 01:18:22 -- common/autotest_common.sh@10 -- # set +x 00:17:14.539 ************************************ 00:17:14.539 END TEST nvmf_lvol 00:17:14.539 ************************************ 00:17:14.539 01:18:22 -- nvmf/nvmf.sh@48 -- # run_test nvmf_lvs_grow /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:17:14.539 01:18:22 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:14.539 01:18:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:14.539 01:18:22 -- common/autotest_common.sh@10 -- # set +x 00:17:14.539 ************************************ 00:17:14.539 START TEST nvmf_lvs_grow 00:17:14.539 ************************************ 00:17:14.539 01:18:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:17:14.799 * Looking for test storage... 00:17:14.799 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:14.799 01:18:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:14.799 01:18:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:14.799 01:18:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:14.799 01:18:22 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:14.799 01:18:22 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:14.799 01:18:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:14.799 01:18:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:14.799 01:18:22 -- scripts/common.sh@335 -- # IFS=.-: 00:17:14.799 01:18:22 -- scripts/common.sh@335 -- # read -ra ver1 00:17:14.799 01:18:22 -- scripts/common.sh@336 -- # IFS=.-: 00:17:14.799 01:18:22 -- scripts/common.sh@336 -- # read -ra ver2 00:17:14.799 01:18:22 -- scripts/common.sh@337 -- # local 'op=<' 00:17:14.799 01:18:22 -- scripts/common.sh@339 -- # ver1_l=2 00:17:14.799 01:18:22 -- scripts/common.sh@340 -- # ver2_l=1 00:17:14.799 01:18:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:14.799 01:18:22 -- scripts/common.sh@343 -- # case "$op" in 00:17:14.799 01:18:22 -- scripts/common.sh@344 -- # : 1 00:17:14.799 01:18:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:14.799 01:18:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:14.799 01:18:22 -- scripts/common.sh@364 -- # decimal 1 00:17:14.799 01:18:22 -- scripts/common.sh@352 -- # local d=1 00:17:14.799 01:18:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:14.799 01:18:22 -- scripts/common.sh@354 -- # echo 1 00:17:14.799 01:18:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:14.799 01:18:22 -- scripts/common.sh@365 -- # decimal 2 00:17:14.799 01:18:22 -- scripts/common.sh@352 -- # local d=2 00:17:14.799 01:18:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:14.799 01:18:22 -- scripts/common.sh@354 -- # echo 2 00:17:14.799 01:18:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:14.799 01:18:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:14.799 01:18:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:14.799 01:18:22 -- scripts/common.sh@367 -- # return 0 00:17:14.799 01:18:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:14.799 01:18:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:14.799 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:14.799 --rc genhtml_branch_coverage=1 00:17:14.799 --rc genhtml_function_coverage=1 00:17:14.799 --rc genhtml_legend=1 00:17:14.799 --rc geninfo_all_blocks=1 00:17:14.799 --rc geninfo_unexecuted_blocks=1 00:17:14.799 00:17:14.799 ' 00:17:14.799 01:18:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:14.799 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:14.799 --rc genhtml_branch_coverage=1 00:17:14.799 --rc genhtml_function_coverage=1 00:17:14.800 --rc genhtml_legend=1 00:17:14.800 --rc geninfo_all_blocks=1 00:17:14.800 --rc geninfo_unexecuted_blocks=1 00:17:14.800 00:17:14.800 ' 00:17:14.800 01:18:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:14.800 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:14.800 --rc genhtml_branch_coverage=1 00:17:14.800 --rc genhtml_function_coverage=1 00:17:14.800 --rc genhtml_legend=1 00:17:14.800 --rc geninfo_all_blocks=1 00:17:14.800 --rc geninfo_unexecuted_blocks=1 00:17:14.800 00:17:14.800 ' 00:17:14.800 01:18:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:14.800 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:14.800 --rc genhtml_branch_coverage=1 00:17:14.800 --rc genhtml_function_coverage=1 00:17:14.800 --rc genhtml_legend=1 00:17:14.800 --rc geninfo_all_blocks=1 00:17:14.800 --rc geninfo_unexecuted_blocks=1 00:17:14.800 00:17:14.800 ' 00:17:14.800 01:18:22 -- target/nvmf_lvs_grow.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:14.800 01:18:22 -- nvmf/common.sh@7 -- # uname -s 00:17:14.800 01:18:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:14.800 01:18:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:14.800 01:18:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:14.800 01:18:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:14.800 01:18:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:14.800 01:18:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:14.800 01:18:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:14.800 01:18:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:14.800 01:18:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:14.800 01:18:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:14.800 01:18:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:14.800 01:18:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:14.800 01:18:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:14.800 01:18:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:14.800 01:18:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:14.800 01:18:22 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:14.800 01:18:22 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:14.800 01:18:22 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:14.800 01:18:22 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:14.800 01:18:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:14.800 01:18:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:14.800 01:18:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:14.800 01:18:22 -- paths/export.sh@5 -- # export PATH 00:17:14.800 01:18:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:14.800 01:18:22 -- nvmf/common.sh@46 -- # : 0 00:17:14.800 01:18:22 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:14.800 01:18:22 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:14.800 01:18:22 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:14.800 01:18:22 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:14.800 01:18:22 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:14.800 01:18:22 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:14.800 01:18:22 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:14.800 01:18:22 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:14.800 01:18:22 -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:14.800 01:18:22 -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:14.800 01:18:22 -- target/nvmf_lvs_grow.sh@97 -- # nvmftestinit 00:17:14.800 01:18:22 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:14.800 01:18:22 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:14.800 01:18:22 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:14.800 01:18:22 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:14.800 01:18:22 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:14.800 01:18:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:14.800 01:18:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:14.800 01:18:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:14.800 01:18:22 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:14.800 01:18:22 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:14.800 01:18:22 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:14.800 01:18:22 -- common/autotest_common.sh@10 -- # set +x 00:17:17.333 01:18:24 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:17.333 01:18:24 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:17.333 01:18:24 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:17.333 01:18:24 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:17.333 01:18:24 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:17.333 01:18:24 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:17.333 01:18:24 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:17.333 01:18:24 -- nvmf/common.sh@294 -- # net_devs=() 00:17:17.333 01:18:24 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:17.333 01:18:24 -- nvmf/common.sh@295 -- # e810=() 00:17:17.333 01:18:24 -- nvmf/common.sh@295 -- # local -ga e810 00:17:17.333 01:18:24 -- nvmf/common.sh@296 -- # x722=() 00:17:17.333 01:18:24 -- nvmf/common.sh@296 -- # local -ga x722 00:17:17.333 01:18:24 -- nvmf/common.sh@297 -- # mlx=() 00:17:17.333 01:18:24 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:17.333 01:18:24 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:17.333 01:18:24 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:17.333 01:18:24 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:17.333 01:18:24 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:17.333 01:18:24 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:17.333 01:18:24 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:17.333 01:18:24 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:17.333 01:18:24 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:17.333 01:18:24 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:17.333 01:18:24 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:17.333 01:18:24 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:17.333 01:18:24 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:17.333 01:18:24 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:17.333 01:18:24 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:17.333 01:18:24 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:17.333 01:18:24 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:17.333 01:18:24 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:17.333 01:18:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:17.333 01:18:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:17.333 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:17.333 01:18:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:17.333 01:18:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:17.334 01:18:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:17.334 01:18:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:17.334 01:18:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:17.334 01:18:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:17.334 01:18:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:17.334 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:17.334 01:18:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:17.334 01:18:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:17.334 01:18:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:17.334 01:18:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:17.334 01:18:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:17.334 01:18:24 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:17.334 01:18:24 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:17.334 01:18:24 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:17.334 01:18:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:17.334 01:18:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:17.334 01:18:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:17.334 01:18:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:17.334 01:18:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:17.334 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:17.334 01:18:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:17.334 01:18:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:17.334 01:18:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:17.334 01:18:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:17.334 01:18:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:17.334 01:18:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:17.334 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:17.334 01:18:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:17.334 01:18:24 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:17.334 01:18:24 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:17.334 01:18:24 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:17.334 01:18:24 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:17.334 01:18:24 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:17.334 01:18:24 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:17.334 01:18:24 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:17.334 01:18:24 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:17.334 01:18:24 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:17.334 01:18:24 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:17.334 01:18:24 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:17.334 01:18:24 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:17.334 01:18:24 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:17.334 01:18:24 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:17.334 01:18:24 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:17.334 01:18:24 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:17.334 01:18:24 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:17.334 01:18:24 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:17.334 01:18:25 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:17.334 01:18:25 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:17.334 01:18:25 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:17.334 01:18:25 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:17.334 01:18:25 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:17.334 01:18:25 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:17.334 01:18:25 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:17.334 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:17.334 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.215 ms 00:17:17.334 00:17:17.334 --- 10.0.0.2 ping statistics --- 00:17:17.334 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:17.334 rtt min/avg/max/mdev = 0.215/0.215/0.215/0.000 ms 00:17:17.334 01:18:25 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:17.334 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:17.334 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.163 ms 00:17:17.334 00:17:17.334 --- 10.0.0.1 ping statistics --- 00:17:17.334 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:17.334 rtt min/avg/max/mdev = 0.163/0.163/0.163/0.000 ms 00:17:17.334 01:18:25 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:17.334 01:18:25 -- nvmf/common.sh@410 -- # return 0 00:17:17.334 01:18:25 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:17.334 01:18:25 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:17.334 01:18:25 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:17.334 01:18:25 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:17.334 01:18:25 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:17.334 01:18:25 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:17.334 01:18:25 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:17.334 01:18:25 -- target/nvmf_lvs_grow.sh@98 -- # nvmfappstart -m 0x1 00:17:17.334 01:18:25 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:17.334 01:18:25 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:17.334 01:18:25 -- common/autotest_common.sh@10 -- # set +x 00:17:17.334 01:18:25 -- nvmf/common.sh@469 -- # nvmfpid=1132472 00:17:17.334 01:18:25 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:17:17.334 01:18:25 -- nvmf/common.sh@470 -- # waitforlisten 1132472 00:17:17.334 01:18:25 -- common/autotest_common.sh@829 -- # '[' -z 1132472 ']' 00:17:17.334 01:18:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:17.334 01:18:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:17.334 01:18:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:17.334 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:17.334 01:18:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:17.334 01:18:25 -- common/autotest_common.sh@10 -- # set +x 00:17:17.334 [2024-11-20 01:18:25.138118] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:17:17.334 [2024-11-20 01:18:25.138206] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:17.334 EAL: No free 2048 kB hugepages reported on node 1 00:17:17.334 [2024-11-20 01:18:25.205101] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:17.334 [2024-11-20 01:18:25.293852] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:17.334 [2024-11-20 01:18:25.294033] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:17.334 [2024-11-20 01:18:25.294052] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:17.334 [2024-11-20 01:18:25.294085] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:17.334 [2024-11-20 01:18:25.294132] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:17.334 01:18:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:17.334 01:18:25 -- common/autotest_common.sh@862 -- # return 0 00:17:17.334 01:18:25 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:17.334 01:18:25 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:17.334 01:18:25 -- common/autotest_common.sh@10 -- # set +x 00:17:17.334 01:18:25 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:17.334 01:18:25 -- target/nvmf_lvs_grow.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:17:17.593 [2024-11-20 01:18:25.665659] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:17.593 01:18:25 -- target/nvmf_lvs_grow.sh@101 -- # run_test lvs_grow_clean lvs_grow 00:17:17.593 01:18:25 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:17:17.593 01:18:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:17.593 01:18:25 -- common/autotest_common.sh@10 -- # set +x 00:17:17.593 ************************************ 00:17:17.593 START TEST lvs_grow_clean 00:17:17.593 ************************************ 00:17:17.593 01:18:25 -- common/autotest_common.sh@1114 -- # lvs_grow 00:17:17.593 01:18:25 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:17:17.593 01:18:25 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:17:17.593 01:18:25 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:17:17.593 01:18:25 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:17:17.593 01:18:25 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:17:17.593 01:18:25 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:17:17.593 01:18:25 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:17.593 01:18:25 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:17.593 01:18:25 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:17.851 01:18:25 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:17:17.851 01:18:25 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:17:18.109 01:18:26 -- target/nvmf_lvs_grow.sh@28 -- # lvs=74d88a68-c1e5-42e0-9b63-d874e3e4eb5e 00:17:18.109 01:18:26 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 74d88a68-c1e5-42e0-9b63-d874e3e4eb5e 00:17:18.109 01:18:26 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:17:18.367 01:18:26 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:17:18.367 01:18:26 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:17:18.367 01:18:26 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 74d88a68-c1e5-42e0-9b63-d874e3e4eb5e lvol 150 00:17:18.625 01:18:26 -- target/nvmf_lvs_grow.sh@33 -- # lvol=b0f6701d-0fef-4977-9902-e48e13eba493 00:17:18.625 01:18:26 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:18.625 01:18:26 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:17:18.883 [2024-11-20 01:18:27.014459] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:17:18.883 [2024-11-20 01:18:27.014548] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:17:18.883 true 00:17:18.883 01:18:27 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 74d88a68-c1e5-42e0-9b63-d874e3e4eb5e 00:17:18.883 01:18:27 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:17:19.141 01:18:27 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:17:19.141 01:18:27 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:17:19.398 01:18:27 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 b0f6701d-0fef-4977-9902-e48e13eba493 00:17:19.656 01:18:27 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:17:19.914 [2024-11-20 01:18:28.105838] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:19.914 01:18:28 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:17:20.480 01:18:28 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=1132914 00:17:20.480 01:18:28 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:20.480 01:18:28 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 1132914 /var/tmp/bdevperf.sock 00:17:20.480 01:18:28 -- common/autotest_common.sh@829 -- # '[' -z 1132914 ']' 00:17:20.480 01:18:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:20.480 01:18:28 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:17:20.480 01:18:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:20.480 01:18:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:20.480 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:20.480 01:18:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:20.480 01:18:28 -- common/autotest_common.sh@10 -- # set +x 00:17:20.481 [2024-11-20 01:18:28.460961] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:17:20.481 [2024-11-20 01:18:28.461050] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1132914 ] 00:17:20.481 EAL: No free 2048 kB hugepages reported on node 1 00:17:20.481 [2024-11-20 01:18:28.524085] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:20.481 [2024-11-20 01:18:28.612115] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:21.414 01:18:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:21.414 01:18:29 -- common/autotest_common.sh@862 -- # return 0 00:17:21.414 01:18:29 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:17:21.671 Nvme0n1 00:17:21.671 01:18:29 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:17:21.929 [ 00:17:21.929 { 00:17:21.929 "name": "Nvme0n1", 00:17:21.929 "aliases": [ 00:17:21.929 "b0f6701d-0fef-4977-9902-e48e13eba493" 00:17:21.929 ], 00:17:21.929 "product_name": "NVMe disk", 00:17:21.929 "block_size": 4096, 00:17:21.929 "num_blocks": 38912, 00:17:21.930 "uuid": "b0f6701d-0fef-4977-9902-e48e13eba493", 00:17:21.930 "assigned_rate_limits": { 00:17:21.930 "rw_ios_per_sec": 0, 00:17:21.930 "rw_mbytes_per_sec": 0, 00:17:21.930 "r_mbytes_per_sec": 0, 00:17:21.930 "w_mbytes_per_sec": 0 00:17:21.930 }, 00:17:21.930 "claimed": false, 00:17:21.930 "zoned": false, 00:17:21.930 "supported_io_types": { 00:17:21.930 "read": true, 00:17:21.930 "write": true, 00:17:21.930 "unmap": true, 00:17:21.930 "write_zeroes": true, 00:17:21.930 "flush": true, 00:17:21.930 "reset": true, 00:17:21.930 "compare": true, 00:17:21.930 "compare_and_write": true, 00:17:21.930 "abort": true, 00:17:21.930 "nvme_admin": true, 00:17:21.930 "nvme_io": true 00:17:21.930 }, 00:17:21.930 "driver_specific": { 00:17:21.930 "nvme": [ 00:17:21.930 { 00:17:21.930 "trid": { 00:17:21.930 "trtype": "TCP", 00:17:21.930 "adrfam": "IPv4", 00:17:21.930 "traddr": "10.0.0.2", 00:17:21.930 "trsvcid": "4420", 00:17:21.930 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:17:21.930 }, 00:17:21.930 "ctrlr_data": { 00:17:21.930 "cntlid": 1, 00:17:21.930 "vendor_id": "0x8086", 00:17:21.930 "model_number": "SPDK bdev Controller", 00:17:21.930 "serial_number": "SPDK0", 00:17:21.930 "firmware_revision": "24.01.1", 00:17:21.930 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:21.930 "oacs": { 00:17:21.930 "security": 0, 00:17:21.930 "format": 0, 00:17:21.930 "firmware": 0, 00:17:21.930 "ns_manage": 0 00:17:21.930 }, 00:17:21.930 "multi_ctrlr": true, 00:17:21.930 "ana_reporting": false 00:17:21.930 }, 00:17:21.930 "vs": { 00:17:21.930 "nvme_version": "1.3" 00:17:21.930 }, 00:17:21.930 "ns_data": { 00:17:21.930 "id": 1, 00:17:21.930 "can_share": true 00:17:21.930 } 00:17:21.930 } 00:17:21.930 ], 00:17:21.930 "mp_policy": "active_passive" 00:17:21.930 } 00:17:21.930 } 00:17:21.930 ] 00:17:21.930 01:18:30 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=1133062 00:17:21.930 01:18:30 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:17:21.930 01:18:30 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:17:22.188 Running I/O for 10 seconds... 00:17:23.123 Latency(us) 00:17:23.123 [2024-11-20T00:18:31.342Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:23.123 [2024-11-20T00:18:31.342Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:23.123 Nvme0n1 : 1.00 14939.00 58.36 0.00 0.00 0.00 0.00 0.00 00:17:23.123 [2024-11-20T00:18:31.342Z] =================================================================================================================== 00:17:23.123 [2024-11-20T00:18:31.342Z] Total : 14939.00 58.36 0.00 0.00 0.00 0.00 0.00 00:17:23.123 00:17:24.117 01:18:32 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 74d88a68-c1e5-42e0-9b63-d874e3e4eb5e 00:17:24.117 [2024-11-20T00:18:32.336Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:24.117 Nvme0n1 : 2.00 15154.50 59.20 0.00 0.00 0.00 0.00 0.00 00:17:24.117 [2024-11-20T00:18:32.336Z] =================================================================================================================== 00:17:24.117 [2024-11-20T00:18:32.336Z] Total : 15154.50 59.20 0.00 0.00 0.00 0.00 0.00 00:17:24.117 00:17:24.375 true 00:17:24.375 01:18:32 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 74d88a68-c1e5-42e0-9b63-d874e3e4eb5e 00:17:24.375 01:18:32 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:17:24.633 01:18:32 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:17:24.633 01:18:32 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:17:24.633 01:18:32 -- target/nvmf_lvs_grow.sh@65 -- # wait 1133062 00:17:25.199 [2024-11-20T00:18:33.418Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:25.199 Nvme0n1 : 3.00 15417.33 60.22 0.00 0.00 0.00 0.00 0.00 00:17:25.199 [2024-11-20T00:18:33.418Z] =================================================================================================================== 00:17:25.199 [2024-11-20T00:18:33.418Z] Total : 15417.33 60.22 0.00 0.00 0.00 0.00 0.00 00:17:25.199 00:17:26.134 [2024-11-20T00:18:34.353Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:26.134 Nvme0n1 : 4.00 15506.50 60.57 0.00 0.00 0.00 0.00 0.00 00:17:26.134 [2024-11-20T00:18:34.353Z] =================================================================================================================== 00:17:26.134 [2024-11-20T00:18:34.353Z] Total : 15506.50 60.57 0.00 0.00 0.00 0.00 0.00 00:17:26.134 00:17:27.068 [2024-11-20T00:18:35.287Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:27.068 Nvme0n1 : 5.00 15550.00 60.74 0.00 0.00 0.00 0.00 0.00 00:17:27.068 [2024-11-20T00:18:35.287Z] =================================================================================================================== 00:17:27.068 [2024-11-20T00:18:35.287Z] Total : 15550.00 60.74 0.00 0.00 0.00 0.00 0.00 00:17:27.068 00:17:28.002 [2024-11-20T00:18:36.221Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:28.002 Nvme0n1 : 6.00 15593.83 60.91 0.00 0.00 0.00 0.00 0.00 00:17:28.002 [2024-11-20T00:18:36.221Z] =================================================================================================================== 00:17:28.002 [2024-11-20T00:18:36.221Z] Total : 15593.83 60.91 0.00 0.00 0.00 0.00 0.00 00:17:28.002 00:17:29.374 [2024-11-20T00:18:37.593Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:29.374 Nvme0n1 : 7.00 15627.71 61.05 0.00 0.00 0.00 0.00 0.00 00:17:29.374 [2024-11-20T00:18:37.593Z] =================================================================================================================== 00:17:29.374 [2024-11-20T00:18:37.593Z] Total : 15627.71 61.05 0.00 0.00 0.00 0.00 0.00 00:17:29.374 00:17:30.309 [2024-11-20T00:18:38.528Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:30.309 Nvme0n1 : 8.00 15659.38 61.17 0.00 0.00 0.00 0.00 0.00 00:17:30.309 [2024-11-20T00:18:38.528Z] =================================================================================================================== 00:17:30.309 [2024-11-20T00:18:38.528Z] Total : 15659.38 61.17 0.00 0.00 0.00 0.00 0.00 00:17:30.309 00:17:31.242 [2024-11-20T00:18:39.461Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:31.242 Nvme0n1 : 9.00 15681.22 61.25 0.00 0.00 0.00 0.00 0.00 00:17:31.242 [2024-11-20T00:18:39.461Z] =================================================================================================================== 00:17:31.242 [2024-11-20T00:18:39.461Z] Total : 15681.22 61.25 0.00 0.00 0.00 0.00 0.00 00:17:31.242 00:17:32.175 [2024-11-20T00:18:40.394Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:32.175 Nvme0n1 : 10.00 15705.10 61.35 0.00 0.00 0.00 0.00 0.00 00:17:32.175 [2024-11-20T00:18:40.394Z] =================================================================================================================== 00:17:32.175 [2024-11-20T00:18:40.394Z] Total : 15705.10 61.35 0.00 0.00 0.00 0.00 0.00 00:17:32.175 00:17:32.175 00:17:32.175 Latency(us) 00:17:32.175 [2024-11-20T00:18:40.394Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:32.175 [2024-11-20T00:18:40.394Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:32.175 Nvme0n1 : 10.01 15708.35 61.36 0.00 0.00 8143.34 3592.34 16311.18 00:17:32.175 [2024-11-20T00:18:40.394Z] =================================================================================================================== 00:17:32.175 [2024-11-20T00:18:40.394Z] Total : 15708.35 61.36 0.00 0.00 8143.34 3592.34 16311.18 00:17:32.175 0 00:17:32.175 01:18:40 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 1132914 00:17:32.175 01:18:40 -- common/autotest_common.sh@936 -- # '[' -z 1132914 ']' 00:17:32.175 01:18:40 -- common/autotest_common.sh@940 -- # kill -0 1132914 00:17:32.175 01:18:40 -- common/autotest_common.sh@941 -- # uname 00:17:32.175 01:18:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:32.175 01:18:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1132914 00:17:32.175 01:18:40 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:32.175 01:18:40 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:32.175 01:18:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1132914' 00:17:32.175 killing process with pid 1132914 00:17:32.175 01:18:40 -- common/autotest_common.sh@955 -- # kill 1132914 00:17:32.175 Received shutdown signal, test time was about 10.000000 seconds 00:17:32.175 00:17:32.175 Latency(us) 00:17:32.175 [2024-11-20T00:18:40.394Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:32.175 [2024-11-20T00:18:40.394Z] =================================================================================================================== 00:17:32.175 [2024-11-20T00:18:40.394Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:32.175 01:18:40 -- common/autotest_common.sh@960 -- # wait 1132914 00:17:32.433 01:18:40 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:17:32.689 01:18:40 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 74d88a68-c1e5-42e0-9b63-d874e3e4eb5e 00:17:32.689 01:18:40 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:17:32.947 01:18:41 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:17:32.947 01:18:41 -- target/nvmf_lvs_grow.sh@71 -- # [[ '' == \d\i\r\t\y ]] 00:17:32.947 01:18:41 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:17:33.205 [2024-11-20 01:18:41.254947] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:17:33.205 01:18:41 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 74d88a68-c1e5-42e0-9b63-d874e3e4eb5e 00:17:33.205 01:18:41 -- common/autotest_common.sh@650 -- # local es=0 00:17:33.205 01:18:41 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 74d88a68-c1e5-42e0-9b63-d874e3e4eb5e 00:17:33.205 01:18:41 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:33.205 01:18:41 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:33.205 01:18:41 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:33.205 01:18:41 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:33.205 01:18:41 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:33.205 01:18:41 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:33.205 01:18:41 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:33.205 01:18:41 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:17:33.205 01:18:41 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 74d88a68-c1e5-42e0-9b63-d874e3e4eb5e 00:17:33.463 request: 00:17:33.463 { 00:17:33.463 "uuid": "74d88a68-c1e5-42e0-9b63-d874e3e4eb5e", 00:17:33.463 "method": "bdev_lvol_get_lvstores", 00:17:33.463 "req_id": 1 00:17:33.463 } 00:17:33.463 Got JSON-RPC error response 00:17:33.463 response: 00:17:33.463 { 00:17:33.463 "code": -19, 00:17:33.463 "message": "No such device" 00:17:33.463 } 00:17:33.463 01:18:41 -- common/autotest_common.sh@653 -- # es=1 00:17:33.463 01:18:41 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:33.463 01:18:41 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:33.463 01:18:41 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:33.463 01:18:41 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:33.721 aio_bdev 00:17:33.721 01:18:41 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev b0f6701d-0fef-4977-9902-e48e13eba493 00:17:33.721 01:18:41 -- common/autotest_common.sh@897 -- # local bdev_name=b0f6701d-0fef-4977-9902-e48e13eba493 00:17:33.721 01:18:41 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:17:33.721 01:18:41 -- common/autotest_common.sh@899 -- # local i 00:17:33.721 01:18:41 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:17:33.721 01:18:41 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:17:33.721 01:18:41 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:17:33.979 01:18:42 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b b0f6701d-0fef-4977-9902-e48e13eba493 -t 2000 00:17:34.237 [ 00:17:34.237 { 00:17:34.237 "name": "b0f6701d-0fef-4977-9902-e48e13eba493", 00:17:34.237 "aliases": [ 00:17:34.237 "lvs/lvol" 00:17:34.237 ], 00:17:34.237 "product_name": "Logical Volume", 00:17:34.237 "block_size": 4096, 00:17:34.237 "num_blocks": 38912, 00:17:34.237 "uuid": "b0f6701d-0fef-4977-9902-e48e13eba493", 00:17:34.237 "assigned_rate_limits": { 00:17:34.237 "rw_ios_per_sec": 0, 00:17:34.237 "rw_mbytes_per_sec": 0, 00:17:34.237 "r_mbytes_per_sec": 0, 00:17:34.237 "w_mbytes_per_sec": 0 00:17:34.237 }, 00:17:34.237 "claimed": false, 00:17:34.237 "zoned": false, 00:17:34.237 "supported_io_types": { 00:17:34.237 "read": true, 00:17:34.237 "write": true, 00:17:34.237 "unmap": true, 00:17:34.237 "write_zeroes": true, 00:17:34.237 "flush": false, 00:17:34.237 "reset": true, 00:17:34.237 "compare": false, 00:17:34.237 "compare_and_write": false, 00:17:34.237 "abort": false, 00:17:34.237 "nvme_admin": false, 00:17:34.237 "nvme_io": false 00:17:34.237 }, 00:17:34.237 "driver_specific": { 00:17:34.237 "lvol": { 00:17:34.237 "lvol_store_uuid": "74d88a68-c1e5-42e0-9b63-d874e3e4eb5e", 00:17:34.237 "base_bdev": "aio_bdev", 00:17:34.237 "thin_provision": false, 00:17:34.237 "snapshot": false, 00:17:34.237 "clone": false, 00:17:34.237 "esnap_clone": false 00:17:34.237 } 00:17:34.237 } 00:17:34.237 } 00:17:34.237 ] 00:17:34.237 01:18:42 -- common/autotest_common.sh@905 -- # return 0 00:17:34.237 01:18:42 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 74d88a68-c1e5-42e0-9b63-d874e3e4eb5e 00:17:34.237 01:18:42 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:17:34.494 01:18:42 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:17:34.495 01:18:42 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 74d88a68-c1e5-42e0-9b63-d874e3e4eb5e 00:17:34.495 01:18:42 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:17:34.753 01:18:42 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:17:34.753 01:18:42 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete b0f6701d-0fef-4977-9902-e48e13eba493 00:17:35.011 01:18:43 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 74d88a68-c1e5-42e0-9b63-d874e3e4eb5e 00:17:35.269 01:18:43 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:17:35.527 01:18:43 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:35.527 00:17:35.527 real 0m17.996s 00:17:35.527 user 0m17.776s 00:17:35.527 sys 0m1.825s 00:17:35.527 01:18:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:35.527 01:18:43 -- common/autotest_common.sh@10 -- # set +x 00:17:35.527 ************************************ 00:17:35.527 END TEST lvs_grow_clean 00:17:35.527 ************************************ 00:17:35.527 01:18:43 -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_dirty lvs_grow dirty 00:17:35.527 01:18:43 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:35.527 01:18:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:35.527 01:18:43 -- common/autotest_common.sh@10 -- # set +x 00:17:35.527 ************************************ 00:17:35.527 START TEST lvs_grow_dirty 00:17:35.527 ************************************ 00:17:35.527 01:18:43 -- common/autotest_common.sh@1114 -- # lvs_grow dirty 00:17:35.527 01:18:43 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:17:35.527 01:18:43 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:17:35.527 01:18:43 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:17:35.527 01:18:43 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:17:35.527 01:18:43 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:17:35.527 01:18:43 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:17:35.527 01:18:43 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:35.527 01:18:43 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:35.527 01:18:43 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:35.786 01:18:43 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:17:35.786 01:18:43 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:17:36.045 01:18:44 -- target/nvmf_lvs_grow.sh@28 -- # lvs=b16ebdfe-170f-4e32-9327-9f25f1963bd8 00:17:36.045 01:18:44 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u b16ebdfe-170f-4e32-9327-9f25f1963bd8 00:17:36.045 01:18:44 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:17:36.303 01:18:44 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:17:36.303 01:18:44 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:17:36.303 01:18:44 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u b16ebdfe-170f-4e32-9327-9f25f1963bd8 lvol 150 00:17:36.561 01:18:44 -- target/nvmf_lvs_grow.sh@33 -- # lvol=40e733ac-b136-423d-a569-48b45dc012ab 00:17:36.561 01:18:44 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:36.561 01:18:44 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:17:36.820 [2024-11-20 01:18:45.031538] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:17:36.820 [2024-11-20 01:18:45.031641] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:17:36.820 true 00:17:37.078 01:18:45 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u b16ebdfe-170f-4e32-9327-9f25f1963bd8 00:17:37.078 01:18:45 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:17:37.335 01:18:45 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:17:37.335 01:18:45 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:17:37.593 01:18:45 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 40e733ac-b136-423d-a569-48b45dc012ab 00:17:37.852 01:18:45 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:17:38.110 01:18:46 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:17:38.368 01:18:46 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=1135156 00:17:38.368 01:18:46 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:17:38.368 01:18:46 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:38.368 01:18:46 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 1135156 /var/tmp/bdevperf.sock 00:17:38.368 01:18:46 -- common/autotest_common.sh@829 -- # '[' -z 1135156 ']' 00:17:38.368 01:18:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:38.368 01:18:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:38.368 01:18:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:38.368 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:38.368 01:18:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:38.368 01:18:46 -- common/autotest_common.sh@10 -- # set +x 00:17:38.368 [2024-11-20 01:18:46.383955] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:17:38.368 [2024-11-20 01:18:46.384025] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1135156 ] 00:17:38.368 EAL: No free 2048 kB hugepages reported on node 1 00:17:38.368 [2024-11-20 01:18:46.444929] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:38.368 [2024-11-20 01:18:46.533240] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:39.301 01:18:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:39.301 01:18:47 -- common/autotest_common.sh@862 -- # return 0 00:17:39.301 01:18:47 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:17:39.559 Nvme0n1 00:17:39.559 01:18:47 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:17:39.817 [ 00:17:39.817 { 00:17:39.817 "name": "Nvme0n1", 00:17:39.817 "aliases": [ 00:17:39.817 "40e733ac-b136-423d-a569-48b45dc012ab" 00:17:39.817 ], 00:17:39.817 "product_name": "NVMe disk", 00:17:39.817 "block_size": 4096, 00:17:39.817 "num_blocks": 38912, 00:17:39.817 "uuid": "40e733ac-b136-423d-a569-48b45dc012ab", 00:17:39.817 "assigned_rate_limits": { 00:17:39.817 "rw_ios_per_sec": 0, 00:17:39.817 "rw_mbytes_per_sec": 0, 00:17:39.817 "r_mbytes_per_sec": 0, 00:17:39.817 "w_mbytes_per_sec": 0 00:17:39.817 }, 00:17:39.817 "claimed": false, 00:17:39.817 "zoned": false, 00:17:39.817 "supported_io_types": { 00:17:39.817 "read": true, 00:17:39.817 "write": true, 00:17:39.817 "unmap": true, 00:17:39.817 "write_zeroes": true, 00:17:39.817 "flush": true, 00:17:39.817 "reset": true, 00:17:39.817 "compare": true, 00:17:39.817 "compare_and_write": true, 00:17:39.817 "abort": true, 00:17:39.817 "nvme_admin": true, 00:17:39.817 "nvme_io": true 00:17:39.817 }, 00:17:39.817 "driver_specific": { 00:17:39.817 "nvme": [ 00:17:39.817 { 00:17:39.817 "trid": { 00:17:39.817 "trtype": "TCP", 00:17:39.817 "adrfam": "IPv4", 00:17:39.817 "traddr": "10.0.0.2", 00:17:39.817 "trsvcid": "4420", 00:17:39.817 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:17:39.817 }, 00:17:39.817 "ctrlr_data": { 00:17:39.817 "cntlid": 1, 00:17:39.817 "vendor_id": "0x8086", 00:17:39.817 "model_number": "SPDK bdev Controller", 00:17:39.817 "serial_number": "SPDK0", 00:17:39.817 "firmware_revision": "24.01.1", 00:17:39.817 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:39.817 "oacs": { 00:17:39.817 "security": 0, 00:17:39.817 "format": 0, 00:17:39.817 "firmware": 0, 00:17:39.817 "ns_manage": 0 00:17:39.817 }, 00:17:39.817 "multi_ctrlr": true, 00:17:39.817 "ana_reporting": false 00:17:39.817 }, 00:17:39.817 "vs": { 00:17:39.817 "nvme_version": "1.3" 00:17:39.817 }, 00:17:39.817 "ns_data": { 00:17:39.817 "id": 1, 00:17:39.817 "can_share": true 00:17:39.817 } 00:17:39.817 } 00:17:39.817 ], 00:17:39.817 "mp_policy": "active_passive" 00:17:39.817 } 00:17:39.817 } 00:17:39.817 ] 00:17:39.817 01:18:48 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=1135304 00:17:39.817 01:18:48 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:17:39.817 01:18:48 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:17:40.075 Running I/O for 10 seconds... 00:17:41.010 Latency(us) 00:17:41.010 [2024-11-20T00:18:49.229Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:41.010 [2024-11-20T00:18:49.229Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:41.010 Nvme0n1 : 1.00 15170.00 59.26 0.00 0.00 0.00 0.00 0.00 00:17:41.010 [2024-11-20T00:18:49.229Z] =================================================================================================================== 00:17:41.010 [2024-11-20T00:18:49.229Z] Total : 15170.00 59.26 0.00 0.00 0.00 0.00 0.00 00:17:41.010 00:17:41.943 01:18:50 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u b16ebdfe-170f-4e32-9327-9f25f1963bd8 00:17:41.943 [2024-11-20T00:18:50.162Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:41.943 Nvme0n1 : 2.00 15302.50 59.78 0.00 0.00 0.00 0.00 0.00 00:17:41.943 [2024-11-20T00:18:50.162Z] =================================================================================================================== 00:17:41.943 [2024-11-20T00:18:50.163Z] Total : 15302.50 59.78 0.00 0.00 0.00 0.00 0.00 00:17:41.944 00:17:42.202 true 00:17:42.202 01:18:50 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u b16ebdfe-170f-4e32-9327-9f25f1963bd8 00:17:42.202 01:18:50 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:17:42.461 01:18:50 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:17:42.461 01:18:50 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:17:42.461 01:18:50 -- target/nvmf_lvs_grow.sh@65 -- # wait 1135304 00:17:43.027 [2024-11-20T00:18:51.246Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:43.027 Nvme0n1 : 3.00 15559.33 60.78 0.00 0.00 0.00 0.00 0.00 00:17:43.027 [2024-11-20T00:18:51.246Z] =================================================================================================================== 00:17:43.027 [2024-11-20T00:18:51.246Z] Total : 15559.33 60.78 0.00 0.00 0.00 0.00 0.00 00:17:43.027 00:17:43.961 [2024-11-20T00:18:52.180Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:43.961 Nvme0n1 : 4.00 15616.50 61.00 0.00 0.00 0.00 0.00 0.00 00:17:43.961 [2024-11-20T00:18:52.180Z] =================================================================================================================== 00:17:43.961 [2024-11-20T00:18:52.180Z] Total : 15616.50 61.00 0.00 0.00 0.00 0.00 0.00 00:17:43.961 00:17:44.996 [2024-11-20T00:18:53.216Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:44.997 Nvme0n1 : 5.00 15668.20 61.20 0.00 0.00 0.00 0.00 0.00 00:17:44.997 [2024-11-20T00:18:53.216Z] =================================================================================================================== 00:17:44.997 [2024-11-20T00:18:53.216Z] Total : 15668.20 61.20 0.00 0.00 0.00 0.00 0.00 00:17:44.997 00:17:45.930 [2024-11-20T00:18:54.149Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:45.930 Nvme0n1 : 6.00 15710.83 61.37 0.00 0.00 0.00 0.00 0.00 00:17:45.930 [2024-11-20T00:18:54.149Z] =================================================================================================================== 00:17:45.930 [2024-11-20T00:18:54.149Z] Total : 15710.83 61.37 0.00 0.00 0.00 0.00 0.00 00:17:45.930 00:17:47.305 [2024-11-20T00:18:55.524Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:47.305 Nvme0n1 : 7.00 15758.71 61.56 0.00 0.00 0.00 0.00 0.00 00:17:47.305 [2024-11-20T00:18:55.524Z] =================================================================================================================== 00:17:47.305 [2024-11-20T00:18:55.524Z] Total : 15758.71 61.56 0.00 0.00 0.00 0.00 0.00 00:17:47.305 00:17:48.240 [2024-11-20T00:18:56.459Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:48.240 Nvme0n1 : 8.00 15799.00 61.71 0.00 0.00 0.00 0.00 0.00 00:17:48.240 [2024-11-20T00:18:56.459Z] =================================================================================================================== 00:17:48.240 [2024-11-20T00:18:56.459Z] Total : 15799.00 61.71 0.00 0.00 0.00 0.00 0.00 00:17:48.240 00:17:49.174 [2024-11-20T00:18:57.393Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:49.174 Nvme0n1 : 9.00 15831.22 61.84 0.00 0.00 0.00 0.00 0.00 00:17:49.174 [2024-11-20T00:18:57.393Z] =================================================================================================================== 00:17:49.174 [2024-11-20T00:18:57.393Z] Total : 15831.22 61.84 0.00 0.00 0.00 0.00 0.00 00:17:49.174 00:17:50.109 [2024-11-20T00:18:58.328Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:50.109 Nvme0n1 : 10.00 15850.60 61.92 0.00 0.00 0.00 0.00 0.00 00:17:50.109 [2024-11-20T00:18:58.328Z] =================================================================================================================== 00:17:50.109 [2024-11-20T00:18:58.328Z] Total : 15850.60 61.92 0.00 0.00 0.00 0.00 0.00 00:17:50.109 00:17:50.109 00:17:50.109 Latency(us) 00:17:50.109 [2024-11-20T00:18:58.328Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:50.109 [2024-11-20T00:18:58.328Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:50.109 Nvme0n1 : 10.01 15851.15 61.92 0.00 0.00 8070.74 2184.53 16214.09 00:17:50.109 [2024-11-20T00:18:58.328Z] =================================================================================================================== 00:17:50.109 [2024-11-20T00:18:58.328Z] Total : 15851.15 61.92 0.00 0.00 8070.74 2184.53 16214.09 00:17:50.109 0 00:17:50.109 01:18:58 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 1135156 00:17:50.109 01:18:58 -- common/autotest_common.sh@936 -- # '[' -z 1135156 ']' 00:17:50.109 01:18:58 -- common/autotest_common.sh@940 -- # kill -0 1135156 00:17:50.109 01:18:58 -- common/autotest_common.sh@941 -- # uname 00:17:50.109 01:18:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:50.109 01:18:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1135156 00:17:50.109 01:18:58 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:50.109 01:18:58 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:50.109 01:18:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1135156' 00:17:50.109 killing process with pid 1135156 00:17:50.109 01:18:58 -- common/autotest_common.sh@955 -- # kill 1135156 00:17:50.109 Received shutdown signal, test time was about 10.000000 seconds 00:17:50.109 00:17:50.109 Latency(us) 00:17:50.109 [2024-11-20T00:18:58.328Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:50.109 [2024-11-20T00:18:58.328Z] =================================================================================================================== 00:17:50.109 [2024-11-20T00:18:58.328Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:50.109 01:18:58 -- common/autotest_common.sh@960 -- # wait 1135156 00:17:50.367 01:18:58 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:17:50.626 01:18:58 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u b16ebdfe-170f-4e32-9327-9f25f1963bd8 00:17:50.626 01:18:58 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:17:50.884 01:18:58 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:17:50.884 01:18:58 -- target/nvmf_lvs_grow.sh@71 -- # [[ dirty == \d\i\r\t\y ]] 00:17:50.884 01:18:58 -- target/nvmf_lvs_grow.sh@73 -- # kill -9 1132472 00:17:50.884 01:18:58 -- target/nvmf_lvs_grow.sh@74 -- # wait 1132472 00:17:50.884 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 74: 1132472 Killed "${NVMF_APP[@]}" "$@" 00:17:50.884 01:18:58 -- target/nvmf_lvs_grow.sh@74 -- # true 00:17:50.884 01:18:58 -- target/nvmf_lvs_grow.sh@75 -- # nvmfappstart -m 0x1 00:17:50.884 01:18:58 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:50.884 01:18:58 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:50.884 01:18:58 -- common/autotest_common.sh@10 -- # set +x 00:17:50.884 01:18:58 -- nvmf/common.sh@469 -- # nvmfpid=1136669 00:17:50.884 01:18:58 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:17:50.884 01:18:58 -- nvmf/common.sh@470 -- # waitforlisten 1136669 00:17:50.884 01:18:59 -- common/autotest_common.sh@829 -- # '[' -z 1136669 ']' 00:17:50.884 01:18:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:50.884 01:18:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:50.884 01:18:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:50.884 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:50.884 01:18:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:50.884 01:18:59 -- common/autotest_common.sh@10 -- # set +x 00:17:50.884 [2024-11-20 01:18:59.044612] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:17:50.884 [2024-11-20 01:18:59.044695] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:50.884 EAL: No free 2048 kB hugepages reported on node 1 00:17:51.146 [2024-11-20 01:18:59.113022] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:51.146 [2024-11-20 01:18:59.199922] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:51.146 [2024-11-20 01:18:59.200094] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:51.146 [2024-11-20 01:18:59.200113] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:51.146 [2024-11-20 01:18:59.200126] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:51.146 [2024-11-20 01:18:59.200153] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:52.082 01:19:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:52.082 01:19:00 -- common/autotest_common.sh@862 -- # return 0 00:17:52.082 01:19:00 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:52.082 01:19:00 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:52.082 01:19:00 -- common/autotest_common.sh@10 -- # set +x 00:17:52.082 01:19:00 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:52.082 01:19:00 -- target/nvmf_lvs_grow.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:52.082 [2024-11-20 01:19:00.264953] blobstore.c:4642:bs_recover: *NOTICE*: Performing recovery on blobstore 00:17:52.082 [2024-11-20 01:19:00.265112] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:17:52.082 [2024-11-20 01:19:00.265164] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:17:52.082 01:19:00 -- target/nvmf_lvs_grow.sh@76 -- # aio_bdev=aio_bdev 00:17:52.082 01:19:00 -- target/nvmf_lvs_grow.sh@77 -- # waitforbdev 40e733ac-b136-423d-a569-48b45dc012ab 00:17:52.082 01:19:00 -- common/autotest_common.sh@897 -- # local bdev_name=40e733ac-b136-423d-a569-48b45dc012ab 00:17:52.082 01:19:00 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:17:52.082 01:19:00 -- common/autotest_common.sh@899 -- # local i 00:17:52.082 01:19:00 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:17:52.082 01:19:00 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:17:52.082 01:19:00 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:17:52.340 01:19:00 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 40e733ac-b136-423d-a569-48b45dc012ab -t 2000 00:17:52.599 [ 00:17:52.599 { 00:17:52.599 "name": "40e733ac-b136-423d-a569-48b45dc012ab", 00:17:52.599 "aliases": [ 00:17:52.599 "lvs/lvol" 00:17:52.599 ], 00:17:52.599 "product_name": "Logical Volume", 00:17:52.599 "block_size": 4096, 00:17:52.599 "num_blocks": 38912, 00:17:52.599 "uuid": "40e733ac-b136-423d-a569-48b45dc012ab", 00:17:52.599 "assigned_rate_limits": { 00:17:52.599 "rw_ios_per_sec": 0, 00:17:52.599 "rw_mbytes_per_sec": 0, 00:17:52.599 "r_mbytes_per_sec": 0, 00:17:52.599 "w_mbytes_per_sec": 0 00:17:52.599 }, 00:17:52.599 "claimed": false, 00:17:52.599 "zoned": false, 00:17:52.599 "supported_io_types": { 00:17:52.599 "read": true, 00:17:52.599 "write": true, 00:17:52.599 "unmap": true, 00:17:52.599 "write_zeroes": true, 00:17:52.599 "flush": false, 00:17:52.599 "reset": true, 00:17:52.599 "compare": false, 00:17:52.599 "compare_and_write": false, 00:17:52.599 "abort": false, 00:17:52.599 "nvme_admin": false, 00:17:52.599 "nvme_io": false 00:17:52.599 }, 00:17:52.599 "driver_specific": { 00:17:52.599 "lvol": { 00:17:52.599 "lvol_store_uuid": "b16ebdfe-170f-4e32-9327-9f25f1963bd8", 00:17:52.599 "base_bdev": "aio_bdev", 00:17:52.599 "thin_provision": false, 00:17:52.599 "snapshot": false, 00:17:52.599 "clone": false, 00:17:52.599 "esnap_clone": false 00:17:52.599 } 00:17:52.599 } 00:17:52.599 } 00:17:52.599 ] 00:17:52.599 01:19:00 -- common/autotest_common.sh@905 -- # return 0 00:17:52.599 01:19:00 -- target/nvmf_lvs_grow.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u b16ebdfe-170f-4e32-9327-9f25f1963bd8 00:17:52.599 01:19:00 -- target/nvmf_lvs_grow.sh@78 -- # jq -r '.[0].free_clusters' 00:17:52.857 01:19:01 -- target/nvmf_lvs_grow.sh@78 -- # (( free_clusters == 61 )) 00:17:52.857 01:19:01 -- target/nvmf_lvs_grow.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u b16ebdfe-170f-4e32-9327-9f25f1963bd8 00:17:52.857 01:19:01 -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].total_data_clusters' 00:17:53.115 01:19:01 -- target/nvmf_lvs_grow.sh@79 -- # (( data_clusters == 99 )) 00:17:53.115 01:19:01 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:17:53.373 [2024-11-20 01:19:01.510194] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:17:53.373 01:19:01 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u b16ebdfe-170f-4e32-9327-9f25f1963bd8 00:17:53.373 01:19:01 -- common/autotest_common.sh@650 -- # local es=0 00:17:53.373 01:19:01 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u b16ebdfe-170f-4e32-9327-9f25f1963bd8 00:17:53.373 01:19:01 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:53.373 01:19:01 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:53.373 01:19:01 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:53.373 01:19:01 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:53.373 01:19:01 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:53.373 01:19:01 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:53.373 01:19:01 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:53.373 01:19:01 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:17:53.373 01:19:01 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u b16ebdfe-170f-4e32-9327-9f25f1963bd8 00:17:53.631 request: 00:17:53.631 { 00:17:53.631 "uuid": "b16ebdfe-170f-4e32-9327-9f25f1963bd8", 00:17:53.631 "method": "bdev_lvol_get_lvstores", 00:17:53.631 "req_id": 1 00:17:53.631 } 00:17:53.631 Got JSON-RPC error response 00:17:53.631 response: 00:17:53.631 { 00:17:53.631 "code": -19, 00:17:53.631 "message": "No such device" 00:17:53.631 } 00:17:53.631 01:19:01 -- common/autotest_common.sh@653 -- # es=1 00:17:53.631 01:19:01 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:53.631 01:19:01 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:53.631 01:19:01 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:53.631 01:19:01 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:53.890 aio_bdev 00:17:53.890 01:19:02 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 40e733ac-b136-423d-a569-48b45dc012ab 00:17:53.890 01:19:02 -- common/autotest_common.sh@897 -- # local bdev_name=40e733ac-b136-423d-a569-48b45dc012ab 00:17:53.890 01:19:02 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:17:53.890 01:19:02 -- common/autotest_common.sh@899 -- # local i 00:17:53.890 01:19:02 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:17:53.890 01:19:02 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:17:53.890 01:19:02 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:17:54.148 01:19:02 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 40e733ac-b136-423d-a569-48b45dc012ab -t 2000 00:17:54.407 [ 00:17:54.407 { 00:17:54.407 "name": "40e733ac-b136-423d-a569-48b45dc012ab", 00:17:54.407 "aliases": [ 00:17:54.407 "lvs/lvol" 00:17:54.407 ], 00:17:54.407 "product_name": "Logical Volume", 00:17:54.407 "block_size": 4096, 00:17:54.407 "num_blocks": 38912, 00:17:54.407 "uuid": "40e733ac-b136-423d-a569-48b45dc012ab", 00:17:54.407 "assigned_rate_limits": { 00:17:54.407 "rw_ios_per_sec": 0, 00:17:54.407 "rw_mbytes_per_sec": 0, 00:17:54.407 "r_mbytes_per_sec": 0, 00:17:54.407 "w_mbytes_per_sec": 0 00:17:54.407 }, 00:17:54.407 "claimed": false, 00:17:54.407 "zoned": false, 00:17:54.407 "supported_io_types": { 00:17:54.407 "read": true, 00:17:54.407 "write": true, 00:17:54.407 "unmap": true, 00:17:54.407 "write_zeroes": true, 00:17:54.407 "flush": false, 00:17:54.407 "reset": true, 00:17:54.407 "compare": false, 00:17:54.407 "compare_and_write": false, 00:17:54.407 "abort": false, 00:17:54.407 "nvme_admin": false, 00:17:54.407 "nvme_io": false 00:17:54.407 }, 00:17:54.407 "driver_specific": { 00:17:54.407 "lvol": { 00:17:54.407 "lvol_store_uuid": "b16ebdfe-170f-4e32-9327-9f25f1963bd8", 00:17:54.407 "base_bdev": "aio_bdev", 00:17:54.407 "thin_provision": false, 00:17:54.407 "snapshot": false, 00:17:54.407 "clone": false, 00:17:54.407 "esnap_clone": false 00:17:54.407 } 00:17:54.407 } 00:17:54.407 } 00:17:54.407 ] 00:17:54.666 01:19:02 -- common/autotest_common.sh@905 -- # return 0 00:17:54.666 01:19:02 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u b16ebdfe-170f-4e32-9327-9f25f1963bd8 00:17:54.666 01:19:02 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:17:54.924 01:19:02 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:17:54.924 01:19:02 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u b16ebdfe-170f-4e32-9327-9f25f1963bd8 00:17:54.924 01:19:02 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:17:55.182 01:19:03 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:17:55.182 01:19:03 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 40e733ac-b136-423d-a569-48b45dc012ab 00:17:55.182 01:19:03 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u b16ebdfe-170f-4e32-9327-9f25f1963bd8 00:17:55.748 01:19:03 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:17:55.748 01:19:03 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:55.748 00:17:55.748 real 0m20.230s 00:17:55.748 user 0m50.226s 00:17:55.748 sys 0m4.615s 00:17:55.748 01:19:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:55.748 01:19:03 -- common/autotest_common.sh@10 -- # set +x 00:17:55.748 ************************************ 00:17:55.748 END TEST lvs_grow_dirty 00:17:55.749 ************************************ 00:17:55.749 01:19:03 -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:17:55.749 01:19:03 -- common/autotest_common.sh@806 -- # type=--id 00:17:55.749 01:19:03 -- common/autotest_common.sh@807 -- # id=0 00:17:55.749 01:19:03 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:17:55.749 01:19:03 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:17:56.007 01:19:03 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:17:56.007 01:19:03 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:17:56.007 01:19:03 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:17:56.007 01:19:03 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:17:56.007 nvmf_trace.0 00:17:56.007 01:19:03 -- common/autotest_common.sh@821 -- # return 0 00:17:56.007 01:19:03 -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:17:56.007 01:19:03 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:56.007 01:19:03 -- nvmf/common.sh@116 -- # sync 00:17:56.007 01:19:03 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:56.007 01:19:03 -- nvmf/common.sh@119 -- # set +e 00:17:56.007 01:19:03 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:56.007 01:19:03 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:56.007 rmmod nvme_tcp 00:17:56.007 rmmod nvme_fabrics 00:17:56.007 rmmod nvme_keyring 00:17:56.007 01:19:04 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:56.007 01:19:04 -- nvmf/common.sh@123 -- # set -e 00:17:56.007 01:19:04 -- nvmf/common.sh@124 -- # return 0 00:17:56.007 01:19:04 -- nvmf/common.sh@477 -- # '[' -n 1136669 ']' 00:17:56.007 01:19:04 -- nvmf/common.sh@478 -- # killprocess 1136669 00:17:56.007 01:19:04 -- common/autotest_common.sh@936 -- # '[' -z 1136669 ']' 00:17:56.007 01:19:04 -- common/autotest_common.sh@940 -- # kill -0 1136669 00:17:56.007 01:19:04 -- common/autotest_common.sh@941 -- # uname 00:17:56.007 01:19:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:56.007 01:19:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1136669 00:17:56.007 01:19:04 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:56.007 01:19:04 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:56.007 01:19:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1136669' 00:17:56.007 killing process with pid 1136669 00:17:56.007 01:19:04 -- common/autotest_common.sh@955 -- # kill 1136669 00:17:56.007 01:19:04 -- common/autotest_common.sh@960 -- # wait 1136669 00:17:56.266 01:19:04 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:56.266 01:19:04 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:56.266 01:19:04 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:56.266 01:19:04 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:56.266 01:19:04 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:56.266 01:19:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:56.266 01:19:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:56.266 01:19:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:58.170 01:19:06 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:58.170 00:17:58.170 real 0m43.629s 00:17:58.170 user 1m14.544s 00:17:58.170 sys 0m8.302s 00:17:58.170 01:19:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:58.170 01:19:06 -- common/autotest_common.sh@10 -- # set +x 00:17:58.170 ************************************ 00:17:58.170 END TEST nvmf_lvs_grow 00:17:58.170 ************************************ 00:17:58.170 01:19:06 -- nvmf/nvmf.sh@49 -- # run_test nvmf_bdev_io_wait /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:17:58.170 01:19:06 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:58.170 01:19:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:58.170 01:19:06 -- common/autotest_common.sh@10 -- # set +x 00:17:58.430 ************************************ 00:17:58.430 START TEST nvmf_bdev_io_wait 00:17:58.430 ************************************ 00:17:58.430 01:19:06 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:17:58.430 * Looking for test storage... 00:17:58.430 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:58.430 01:19:06 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:58.430 01:19:06 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:58.430 01:19:06 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:58.430 01:19:06 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:58.430 01:19:06 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:58.430 01:19:06 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:58.430 01:19:06 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:58.430 01:19:06 -- scripts/common.sh@335 -- # IFS=.-: 00:17:58.430 01:19:06 -- scripts/common.sh@335 -- # read -ra ver1 00:17:58.430 01:19:06 -- scripts/common.sh@336 -- # IFS=.-: 00:17:58.430 01:19:06 -- scripts/common.sh@336 -- # read -ra ver2 00:17:58.430 01:19:06 -- scripts/common.sh@337 -- # local 'op=<' 00:17:58.430 01:19:06 -- scripts/common.sh@339 -- # ver1_l=2 00:17:58.430 01:19:06 -- scripts/common.sh@340 -- # ver2_l=1 00:17:58.430 01:19:06 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:58.430 01:19:06 -- scripts/common.sh@343 -- # case "$op" in 00:17:58.430 01:19:06 -- scripts/common.sh@344 -- # : 1 00:17:58.430 01:19:06 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:58.430 01:19:06 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:58.430 01:19:06 -- scripts/common.sh@364 -- # decimal 1 00:17:58.430 01:19:06 -- scripts/common.sh@352 -- # local d=1 00:17:58.430 01:19:06 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:58.430 01:19:06 -- scripts/common.sh@354 -- # echo 1 00:17:58.430 01:19:06 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:58.430 01:19:06 -- scripts/common.sh@365 -- # decimal 2 00:17:58.430 01:19:06 -- scripts/common.sh@352 -- # local d=2 00:17:58.430 01:19:06 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:58.430 01:19:06 -- scripts/common.sh@354 -- # echo 2 00:17:58.430 01:19:06 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:58.430 01:19:06 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:58.430 01:19:06 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:58.430 01:19:06 -- scripts/common.sh@367 -- # return 0 00:17:58.430 01:19:06 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:58.430 01:19:06 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:58.430 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:58.430 --rc genhtml_branch_coverage=1 00:17:58.430 --rc genhtml_function_coverage=1 00:17:58.430 --rc genhtml_legend=1 00:17:58.430 --rc geninfo_all_blocks=1 00:17:58.430 --rc geninfo_unexecuted_blocks=1 00:17:58.430 00:17:58.430 ' 00:17:58.430 01:19:06 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:58.430 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:58.430 --rc genhtml_branch_coverage=1 00:17:58.430 --rc genhtml_function_coverage=1 00:17:58.430 --rc genhtml_legend=1 00:17:58.430 --rc geninfo_all_blocks=1 00:17:58.430 --rc geninfo_unexecuted_blocks=1 00:17:58.430 00:17:58.430 ' 00:17:58.430 01:19:06 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:58.430 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:58.430 --rc genhtml_branch_coverage=1 00:17:58.430 --rc genhtml_function_coverage=1 00:17:58.430 --rc genhtml_legend=1 00:17:58.430 --rc geninfo_all_blocks=1 00:17:58.430 --rc geninfo_unexecuted_blocks=1 00:17:58.430 00:17:58.430 ' 00:17:58.430 01:19:06 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:58.430 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:58.430 --rc genhtml_branch_coverage=1 00:17:58.430 --rc genhtml_function_coverage=1 00:17:58.430 --rc genhtml_legend=1 00:17:58.430 --rc geninfo_all_blocks=1 00:17:58.430 --rc geninfo_unexecuted_blocks=1 00:17:58.430 00:17:58.430 ' 00:17:58.430 01:19:06 -- target/bdev_io_wait.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:58.430 01:19:06 -- nvmf/common.sh@7 -- # uname -s 00:17:58.430 01:19:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:58.430 01:19:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:58.430 01:19:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:58.430 01:19:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:58.430 01:19:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:58.430 01:19:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:58.430 01:19:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:58.430 01:19:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:58.430 01:19:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:58.430 01:19:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:58.430 01:19:06 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:58.430 01:19:06 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:58.430 01:19:06 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:58.430 01:19:06 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:58.430 01:19:06 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:58.430 01:19:06 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:58.430 01:19:06 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:58.430 01:19:06 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:58.430 01:19:06 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:58.430 01:19:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:58.430 01:19:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:58.430 01:19:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:58.430 01:19:06 -- paths/export.sh@5 -- # export PATH 00:17:58.430 01:19:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:58.430 01:19:06 -- nvmf/common.sh@46 -- # : 0 00:17:58.430 01:19:06 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:58.430 01:19:06 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:58.430 01:19:06 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:58.430 01:19:06 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:58.430 01:19:06 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:58.430 01:19:06 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:58.430 01:19:06 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:58.430 01:19:06 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:58.430 01:19:06 -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:58.430 01:19:06 -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:58.430 01:19:06 -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:17:58.430 01:19:06 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:58.430 01:19:06 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:58.430 01:19:06 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:58.430 01:19:06 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:58.430 01:19:06 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:58.430 01:19:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:58.430 01:19:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:58.430 01:19:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:58.430 01:19:06 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:58.431 01:19:06 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:58.431 01:19:06 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:58.431 01:19:06 -- common/autotest_common.sh@10 -- # set +x 00:18:00.965 01:19:08 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:00.965 01:19:08 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:00.965 01:19:08 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:00.965 01:19:08 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:00.965 01:19:08 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:00.965 01:19:08 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:00.965 01:19:08 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:00.965 01:19:08 -- nvmf/common.sh@294 -- # net_devs=() 00:18:00.965 01:19:08 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:00.965 01:19:08 -- nvmf/common.sh@295 -- # e810=() 00:18:00.965 01:19:08 -- nvmf/common.sh@295 -- # local -ga e810 00:18:00.965 01:19:08 -- nvmf/common.sh@296 -- # x722=() 00:18:00.965 01:19:08 -- nvmf/common.sh@296 -- # local -ga x722 00:18:00.965 01:19:08 -- nvmf/common.sh@297 -- # mlx=() 00:18:00.965 01:19:08 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:00.965 01:19:08 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:00.965 01:19:08 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:00.966 01:19:08 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:00.966 01:19:08 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:00.966 01:19:08 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:00.966 01:19:08 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:00.966 01:19:08 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:00.966 01:19:08 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:00.966 01:19:08 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:00.966 01:19:08 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:00.966 01:19:08 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:00.966 01:19:08 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:00.966 01:19:08 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:00.966 01:19:08 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:00.966 01:19:08 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:00.966 01:19:08 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:00.966 01:19:08 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:00.966 01:19:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:00.966 01:19:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:00.966 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:00.966 01:19:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:00.966 01:19:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:00.966 01:19:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:00.966 01:19:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:00.966 01:19:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:00.966 01:19:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:00.966 01:19:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:00.966 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:00.966 01:19:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:00.966 01:19:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:00.966 01:19:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:00.966 01:19:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:00.966 01:19:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:00.966 01:19:08 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:00.966 01:19:08 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:00.966 01:19:08 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:00.966 01:19:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:00.966 01:19:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:00.966 01:19:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:00.966 01:19:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:00.966 01:19:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:00.966 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:00.966 01:19:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:00.966 01:19:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:00.966 01:19:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:00.966 01:19:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:00.966 01:19:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:00.966 01:19:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:00.966 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:00.966 01:19:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:00.966 01:19:08 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:00.966 01:19:08 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:00.966 01:19:08 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:00.966 01:19:08 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:00.966 01:19:08 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:00.966 01:19:08 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:00.966 01:19:08 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:00.966 01:19:08 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:00.966 01:19:08 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:00.966 01:19:08 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:00.966 01:19:08 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:00.966 01:19:08 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:00.966 01:19:08 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:00.966 01:19:08 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:00.966 01:19:08 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:00.966 01:19:08 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:00.966 01:19:08 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:00.966 01:19:08 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:00.966 01:19:08 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:00.966 01:19:08 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:00.966 01:19:08 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:00.966 01:19:08 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:00.966 01:19:08 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:00.966 01:19:08 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:00.966 01:19:08 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:00.966 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:00.966 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.298 ms 00:18:00.966 00:18:00.966 --- 10.0.0.2 ping statistics --- 00:18:00.966 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:00.966 rtt min/avg/max/mdev = 0.298/0.298/0.298/0.000 ms 00:18:00.966 01:19:08 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:00.966 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:00.966 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.073 ms 00:18:00.966 00:18:00.966 --- 10.0.0.1 ping statistics --- 00:18:00.966 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:00.966 rtt min/avg/max/mdev = 0.073/0.073/0.073/0.000 ms 00:18:00.966 01:19:08 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:00.966 01:19:08 -- nvmf/common.sh@410 -- # return 0 00:18:00.966 01:19:08 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:00.966 01:19:08 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:00.966 01:19:08 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:00.966 01:19:08 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:00.966 01:19:08 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:00.966 01:19:08 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:00.966 01:19:08 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:00.966 01:19:08 -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:18:00.966 01:19:08 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:00.966 01:19:08 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:00.966 01:19:08 -- common/autotest_common.sh@10 -- # set +x 00:18:00.966 01:19:08 -- nvmf/common.sh@469 -- # nvmfpid=1139327 00:18:00.966 01:19:08 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:18:00.966 01:19:08 -- nvmf/common.sh@470 -- # waitforlisten 1139327 00:18:00.966 01:19:08 -- common/autotest_common.sh@829 -- # '[' -z 1139327 ']' 00:18:00.966 01:19:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:00.966 01:19:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:00.966 01:19:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:00.966 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:00.966 01:19:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:00.966 01:19:08 -- common/autotest_common.sh@10 -- # set +x 00:18:00.966 [2024-11-20 01:19:08.801257] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:00.966 [2024-11-20 01:19:08.801340] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:00.966 EAL: No free 2048 kB hugepages reported on node 1 00:18:00.966 [2024-11-20 01:19:08.867355] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:18:00.966 [2024-11-20 01:19:08.957668] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:00.966 [2024-11-20 01:19:08.957810] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:00.966 [2024-11-20 01:19:08.957827] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:00.966 [2024-11-20 01:19:08.957841] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:00.966 [2024-11-20 01:19:08.957899] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:00.966 [2024-11-20 01:19:08.958019] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:00.966 [2024-11-20 01:19:08.958094] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:18:00.966 [2024-11-20 01:19:08.958097] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:00.966 01:19:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:00.966 01:19:09 -- common/autotest_common.sh@862 -- # return 0 00:18:00.966 01:19:09 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:00.966 01:19:09 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:00.966 01:19:09 -- common/autotest_common.sh@10 -- # set +x 00:18:00.966 01:19:09 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:00.966 01:19:09 -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:18:00.966 01:19:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:00.966 01:19:09 -- common/autotest_common.sh@10 -- # set +x 00:18:00.966 01:19:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:00.966 01:19:09 -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:18:00.966 01:19:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:00.966 01:19:09 -- common/autotest_common.sh@10 -- # set +x 00:18:00.966 01:19:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:00.966 01:19:09 -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:00.966 01:19:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:00.966 01:19:09 -- common/autotest_common.sh@10 -- # set +x 00:18:00.966 [2024-11-20 01:19:09.115339] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:00.966 01:19:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:00.966 01:19:09 -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:18:00.966 01:19:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:00.966 01:19:09 -- common/autotest_common.sh@10 -- # set +x 00:18:00.966 Malloc0 00:18:00.967 01:19:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:00.967 01:19:09 -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:00.967 01:19:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:00.967 01:19:09 -- common/autotest_common.sh@10 -- # set +x 00:18:00.967 01:19:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:00.967 01:19:09 -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:00.967 01:19:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:00.967 01:19:09 -- common/autotest_common.sh@10 -- # set +x 00:18:00.967 01:19:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:00.967 01:19:09 -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:00.967 01:19:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:00.967 01:19:09 -- common/autotest_common.sh@10 -- # set +x 00:18:00.967 [2024-11-20 01:19:09.179344] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:01.224 01:19:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:01.225 01:19:09 -- target/bdev_io_wait.sh@28 -- # WRITE_PID=1139380 00:18:01.225 01:19:09 -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:18:01.225 01:19:09 -- target/bdev_io_wait.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:18:01.225 01:19:09 -- nvmf/common.sh@520 -- # config=() 00:18:01.225 01:19:09 -- target/bdev_io_wait.sh@30 -- # READ_PID=1139382 00:18:01.225 01:19:09 -- nvmf/common.sh@520 -- # local subsystem config 00:18:01.225 01:19:09 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:01.225 01:19:09 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:01.225 { 00:18:01.225 "params": { 00:18:01.225 "name": "Nvme$subsystem", 00:18:01.225 "trtype": "$TEST_TRANSPORT", 00:18:01.225 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:01.225 "adrfam": "ipv4", 00:18:01.225 "trsvcid": "$NVMF_PORT", 00:18:01.225 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:01.225 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:01.225 "hdgst": ${hdgst:-false}, 00:18:01.225 "ddgst": ${ddgst:-false} 00:18:01.225 }, 00:18:01.225 "method": "bdev_nvme_attach_controller" 00:18:01.225 } 00:18:01.225 EOF 00:18:01.225 )") 00:18:01.225 01:19:09 -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:18:01.225 01:19:09 -- target/bdev_io_wait.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:18:01.225 01:19:09 -- nvmf/common.sh@520 -- # config=() 00:18:01.225 01:19:09 -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=1139384 00:18:01.225 01:19:09 -- nvmf/common.sh@520 -- # local subsystem config 00:18:01.225 01:19:09 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:01.225 01:19:09 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:01.225 { 00:18:01.225 "params": { 00:18:01.225 "name": "Nvme$subsystem", 00:18:01.225 "trtype": "$TEST_TRANSPORT", 00:18:01.225 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:01.225 "adrfam": "ipv4", 00:18:01.225 "trsvcid": "$NVMF_PORT", 00:18:01.225 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:01.225 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:01.225 "hdgst": ${hdgst:-false}, 00:18:01.225 "ddgst": ${ddgst:-false} 00:18:01.225 }, 00:18:01.225 "method": "bdev_nvme_attach_controller" 00:18:01.225 } 00:18:01.225 EOF 00:18:01.225 )") 00:18:01.225 01:19:09 -- nvmf/common.sh@542 -- # cat 00:18:01.225 01:19:09 -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:18:01.225 01:19:09 -- target/bdev_io_wait.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:18:01.225 01:19:09 -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=1139387 00:18:01.225 01:19:09 -- nvmf/common.sh@520 -- # config=() 00:18:01.225 01:19:09 -- target/bdev_io_wait.sh@35 -- # sync 00:18:01.225 01:19:09 -- nvmf/common.sh@520 -- # local subsystem config 00:18:01.225 01:19:09 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:01.225 01:19:09 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:01.225 { 00:18:01.225 "params": { 00:18:01.225 "name": "Nvme$subsystem", 00:18:01.225 "trtype": "$TEST_TRANSPORT", 00:18:01.225 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:01.225 "adrfam": "ipv4", 00:18:01.225 "trsvcid": "$NVMF_PORT", 00:18:01.225 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:01.225 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:01.225 "hdgst": ${hdgst:-false}, 00:18:01.225 "ddgst": ${ddgst:-false} 00:18:01.225 }, 00:18:01.225 "method": "bdev_nvme_attach_controller" 00:18:01.225 } 00:18:01.225 EOF 00:18:01.225 )") 00:18:01.225 01:19:09 -- nvmf/common.sh@542 -- # cat 00:18:01.225 01:19:09 -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:18:01.225 01:19:09 -- target/bdev_io_wait.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:18:01.225 01:19:09 -- nvmf/common.sh@520 -- # config=() 00:18:01.225 01:19:09 -- nvmf/common.sh@520 -- # local subsystem config 00:18:01.225 01:19:09 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:01.225 01:19:09 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:01.225 { 00:18:01.225 "params": { 00:18:01.225 "name": "Nvme$subsystem", 00:18:01.225 "trtype": "$TEST_TRANSPORT", 00:18:01.225 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:01.225 "adrfam": "ipv4", 00:18:01.225 "trsvcid": "$NVMF_PORT", 00:18:01.225 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:01.225 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:01.225 "hdgst": ${hdgst:-false}, 00:18:01.225 "ddgst": ${ddgst:-false} 00:18:01.225 }, 00:18:01.225 "method": "bdev_nvme_attach_controller" 00:18:01.225 } 00:18:01.225 EOF 00:18:01.225 )") 00:18:01.225 01:19:09 -- nvmf/common.sh@542 -- # cat 00:18:01.225 01:19:09 -- nvmf/common.sh@544 -- # jq . 00:18:01.225 01:19:09 -- target/bdev_io_wait.sh@37 -- # wait 1139380 00:18:01.225 01:19:09 -- nvmf/common.sh@542 -- # cat 00:18:01.225 01:19:09 -- nvmf/common.sh@544 -- # jq . 00:18:01.225 01:19:09 -- nvmf/common.sh@545 -- # IFS=, 00:18:01.225 01:19:09 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:01.225 "params": { 00:18:01.225 "name": "Nvme1", 00:18:01.225 "trtype": "tcp", 00:18:01.225 "traddr": "10.0.0.2", 00:18:01.225 "adrfam": "ipv4", 00:18:01.225 "trsvcid": "4420", 00:18:01.225 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:01.225 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:01.225 "hdgst": false, 00:18:01.225 "ddgst": false 00:18:01.225 }, 00:18:01.225 "method": "bdev_nvme_attach_controller" 00:18:01.225 }' 00:18:01.225 01:19:09 -- nvmf/common.sh@544 -- # jq . 00:18:01.225 01:19:09 -- nvmf/common.sh@545 -- # IFS=, 00:18:01.225 01:19:09 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:01.225 "params": { 00:18:01.225 "name": "Nvme1", 00:18:01.225 "trtype": "tcp", 00:18:01.225 "traddr": "10.0.0.2", 00:18:01.225 "adrfam": "ipv4", 00:18:01.225 "trsvcid": "4420", 00:18:01.225 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:01.225 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:01.225 "hdgst": false, 00:18:01.225 "ddgst": false 00:18:01.225 }, 00:18:01.225 "method": "bdev_nvme_attach_controller" 00:18:01.225 }' 00:18:01.225 01:19:09 -- nvmf/common.sh@544 -- # jq . 00:18:01.225 01:19:09 -- nvmf/common.sh@545 -- # IFS=, 00:18:01.225 01:19:09 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:01.225 "params": { 00:18:01.225 "name": "Nvme1", 00:18:01.225 "trtype": "tcp", 00:18:01.225 "traddr": "10.0.0.2", 00:18:01.225 "adrfam": "ipv4", 00:18:01.225 "trsvcid": "4420", 00:18:01.225 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:01.225 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:01.225 "hdgst": false, 00:18:01.225 "ddgst": false 00:18:01.225 }, 00:18:01.225 "method": "bdev_nvme_attach_controller" 00:18:01.225 }' 00:18:01.225 01:19:09 -- nvmf/common.sh@545 -- # IFS=, 00:18:01.225 01:19:09 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:01.225 "params": { 00:18:01.225 "name": "Nvme1", 00:18:01.225 "trtype": "tcp", 00:18:01.225 "traddr": "10.0.0.2", 00:18:01.225 "adrfam": "ipv4", 00:18:01.225 "trsvcid": "4420", 00:18:01.225 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:01.225 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:01.225 "hdgst": false, 00:18:01.225 "ddgst": false 00:18:01.225 }, 00:18:01.225 "method": "bdev_nvme_attach_controller" 00:18:01.225 }' 00:18:01.225 [2024-11-20 01:19:09.223050] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:01.225 [2024-11-20 01:19:09.223051] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:01.225 [2024-11-20 01:19:09.223050] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:01.225 [2024-11-20 01:19:09.223157] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-11-20 01:19:09.223157] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-11-20 01:19:09.223158] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:18:01.225 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:18:01.225 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:18:01.225 [2024-11-20 01:19:09.224672] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:01.225 [2024-11-20 01:19:09.224754] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:18:01.225 EAL: No free 2048 kB hugepages reported on node 1 00:18:01.225 EAL: No free 2048 kB hugepages reported on node 1 00:18:01.225 [2024-11-20 01:19:09.395756] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:01.484 EAL: No free 2048 kB hugepages reported on node 1 00:18:01.484 [2024-11-20 01:19:09.469118] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:18:01.484 [2024-11-20 01:19:09.497085] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:01.484 EAL: No free 2048 kB hugepages reported on node 1 00:18:01.484 [2024-11-20 01:19:09.569867] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:18:01.484 [2024-11-20 01:19:09.596166] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:01.484 [2024-11-20 01:19:09.669100] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:18:01.484 [2024-11-20 01:19:09.669085] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:01.742 [2024-11-20 01:19:09.735371] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:18:01.742 Running I/O for 1 seconds... 00:18:01.742 Running I/O for 1 seconds... 00:18:01.742 Running I/O for 1 seconds... 00:18:02.001 Running I/O for 1 seconds... 00:18:02.936 00:18:02.936 Latency(us) 00:18:02.936 [2024-11-20T00:19:11.155Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:02.936 [2024-11-20T00:19:11.155Z] Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:18:02.936 Nvme1n1 : 1.01 9981.80 38.99 0.00 0.00 12773.12 6990.51 25243.50 00:18:02.936 [2024-11-20T00:19:11.155Z] =================================================================================================================== 00:18:02.936 [2024-11-20T00:19:11.155Z] Total : 9981.80 38.99 0.00 0.00 12773.12 6990.51 25243.50 00:18:02.936 00:18:02.936 Latency(us) 00:18:02.936 [2024-11-20T00:19:11.155Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:02.936 [2024-11-20T00:19:11.155Z] Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:18:02.936 Nvme1n1 : 1.01 9154.10 35.76 0.00 0.00 13915.14 8835.22 26214.40 00:18:02.936 [2024-11-20T00:19:11.155Z] =================================================================================================================== 00:18:02.936 [2024-11-20T00:19:11.155Z] Total : 9154.10 35.76 0.00 0.00 13915.14 8835.22 26214.40 00:18:02.936 00:18:02.936 Latency(us) 00:18:02.936 [2024-11-20T00:19:11.155Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:02.936 [2024-11-20T00:19:11.155Z] Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:18:02.936 Nvme1n1 : 1.01 8403.23 32.83 0.00 0.00 15157.93 6990.51 26020.22 00:18:02.936 [2024-11-20T00:19:11.155Z] =================================================================================================================== 00:18:02.936 [2024-11-20T00:19:11.155Z] Total : 8403.23 32.83 0.00 0.00 15157.93 6990.51 26020.22 00:18:02.936 00:18:02.936 Latency(us) 00:18:02.936 [2024-11-20T00:19:11.155Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:02.936 [2024-11-20T00:19:11.155Z] Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:18:02.936 Nvme1n1 : 1.00 200801.55 784.38 0.00 0.00 634.84 250.31 1152.95 00:18:02.936 [2024-11-20T00:19:11.155Z] =================================================================================================================== 00:18:02.936 [2024-11-20T00:19:11.155Z] Total : 200801.55 784.38 0.00 0.00 634.84 250.31 1152.95 00:18:03.194 01:19:11 -- target/bdev_io_wait.sh@38 -- # wait 1139382 00:18:03.194 01:19:11 -- target/bdev_io_wait.sh@39 -- # wait 1139384 00:18:03.194 01:19:11 -- target/bdev_io_wait.sh@40 -- # wait 1139387 00:18:03.194 01:19:11 -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:18:03.194 01:19:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:03.194 01:19:11 -- common/autotest_common.sh@10 -- # set +x 00:18:03.194 01:19:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:03.194 01:19:11 -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:18:03.194 01:19:11 -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:18:03.194 01:19:11 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:03.194 01:19:11 -- nvmf/common.sh@116 -- # sync 00:18:03.194 01:19:11 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:03.194 01:19:11 -- nvmf/common.sh@119 -- # set +e 00:18:03.194 01:19:11 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:03.194 01:19:11 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:03.194 rmmod nvme_tcp 00:18:03.194 rmmod nvme_fabrics 00:18:03.194 rmmod nvme_keyring 00:18:03.194 01:19:11 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:03.452 01:19:11 -- nvmf/common.sh@123 -- # set -e 00:18:03.452 01:19:11 -- nvmf/common.sh@124 -- # return 0 00:18:03.452 01:19:11 -- nvmf/common.sh@477 -- # '[' -n 1139327 ']' 00:18:03.452 01:19:11 -- nvmf/common.sh@478 -- # killprocess 1139327 00:18:03.452 01:19:11 -- common/autotest_common.sh@936 -- # '[' -z 1139327 ']' 00:18:03.452 01:19:11 -- common/autotest_common.sh@940 -- # kill -0 1139327 00:18:03.452 01:19:11 -- common/autotest_common.sh@941 -- # uname 00:18:03.452 01:19:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:03.452 01:19:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1139327 00:18:03.452 01:19:11 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:03.452 01:19:11 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:03.452 01:19:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1139327' 00:18:03.452 killing process with pid 1139327 00:18:03.452 01:19:11 -- common/autotest_common.sh@955 -- # kill 1139327 00:18:03.452 01:19:11 -- common/autotest_common.sh@960 -- # wait 1139327 00:18:03.711 01:19:11 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:03.712 01:19:11 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:03.712 01:19:11 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:03.712 01:19:11 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:03.712 01:19:11 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:03.712 01:19:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:03.712 01:19:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:03.712 01:19:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:05.620 01:19:13 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:05.620 00:18:05.620 real 0m7.338s 00:18:05.620 user 0m15.874s 00:18:05.620 sys 0m3.871s 00:18:05.620 01:19:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:05.620 01:19:13 -- common/autotest_common.sh@10 -- # set +x 00:18:05.620 ************************************ 00:18:05.620 END TEST nvmf_bdev_io_wait 00:18:05.620 ************************************ 00:18:05.620 01:19:13 -- nvmf/nvmf.sh@50 -- # run_test nvmf_queue_depth /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:18:05.620 01:19:13 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:05.620 01:19:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:05.620 01:19:13 -- common/autotest_common.sh@10 -- # set +x 00:18:05.620 ************************************ 00:18:05.620 START TEST nvmf_queue_depth 00:18:05.620 ************************************ 00:18:05.620 01:19:13 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:18:05.620 * Looking for test storage... 00:18:05.620 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:05.620 01:19:13 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:05.620 01:19:13 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:05.620 01:19:13 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:05.880 01:19:13 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:05.880 01:19:13 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:05.880 01:19:13 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:05.880 01:19:13 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:05.880 01:19:13 -- scripts/common.sh@335 -- # IFS=.-: 00:18:05.880 01:19:13 -- scripts/common.sh@335 -- # read -ra ver1 00:18:05.880 01:19:13 -- scripts/common.sh@336 -- # IFS=.-: 00:18:05.880 01:19:13 -- scripts/common.sh@336 -- # read -ra ver2 00:18:05.880 01:19:13 -- scripts/common.sh@337 -- # local 'op=<' 00:18:05.880 01:19:13 -- scripts/common.sh@339 -- # ver1_l=2 00:18:05.880 01:19:13 -- scripts/common.sh@340 -- # ver2_l=1 00:18:05.880 01:19:13 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:05.880 01:19:13 -- scripts/common.sh@343 -- # case "$op" in 00:18:05.880 01:19:13 -- scripts/common.sh@344 -- # : 1 00:18:05.880 01:19:13 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:05.880 01:19:13 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:05.880 01:19:13 -- scripts/common.sh@364 -- # decimal 1 00:18:05.880 01:19:13 -- scripts/common.sh@352 -- # local d=1 00:18:05.880 01:19:13 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:05.880 01:19:13 -- scripts/common.sh@354 -- # echo 1 00:18:05.880 01:19:13 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:05.880 01:19:13 -- scripts/common.sh@365 -- # decimal 2 00:18:05.880 01:19:13 -- scripts/common.sh@352 -- # local d=2 00:18:05.880 01:19:13 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:05.880 01:19:13 -- scripts/common.sh@354 -- # echo 2 00:18:05.880 01:19:13 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:05.880 01:19:13 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:05.880 01:19:13 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:05.880 01:19:13 -- scripts/common.sh@367 -- # return 0 00:18:05.880 01:19:13 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:05.880 01:19:13 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:05.880 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:05.880 --rc genhtml_branch_coverage=1 00:18:05.880 --rc genhtml_function_coverage=1 00:18:05.880 --rc genhtml_legend=1 00:18:05.880 --rc geninfo_all_blocks=1 00:18:05.880 --rc geninfo_unexecuted_blocks=1 00:18:05.880 00:18:05.880 ' 00:18:05.880 01:19:13 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:05.880 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:05.880 --rc genhtml_branch_coverage=1 00:18:05.880 --rc genhtml_function_coverage=1 00:18:05.880 --rc genhtml_legend=1 00:18:05.880 --rc geninfo_all_blocks=1 00:18:05.880 --rc geninfo_unexecuted_blocks=1 00:18:05.880 00:18:05.880 ' 00:18:05.880 01:19:13 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:05.880 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:05.880 --rc genhtml_branch_coverage=1 00:18:05.880 --rc genhtml_function_coverage=1 00:18:05.880 --rc genhtml_legend=1 00:18:05.880 --rc geninfo_all_blocks=1 00:18:05.880 --rc geninfo_unexecuted_blocks=1 00:18:05.880 00:18:05.880 ' 00:18:05.880 01:19:13 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:05.880 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:05.880 --rc genhtml_branch_coverage=1 00:18:05.880 --rc genhtml_function_coverage=1 00:18:05.880 --rc genhtml_legend=1 00:18:05.880 --rc geninfo_all_blocks=1 00:18:05.880 --rc geninfo_unexecuted_blocks=1 00:18:05.880 00:18:05.880 ' 00:18:05.880 01:19:13 -- target/queue_depth.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:05.880 01:19:13 -- nvmf/common.sh@7 -- # uname -s 00:18:05.880 01:19:13 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:05.880 01:19:13 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:05.880 01:19:13 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:05.880 01:19:13 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:05.880 01:19:13 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:05.880 01:19:13 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:05.880 01:19:13 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:05.880 01:19:13 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:05.880 01:19:13 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:05.880 01:19:13 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:05.880 01:19:13 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:05.880 01:19:13 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:05.880 01:19:13 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:05.880 01:19:13 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:05.880 01:19:13 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:05.880 01:19:13 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:05.880 01:19:13 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:05.880 01:19:13 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:05.880 01:19:13 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:05.880 01:19:13 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:05.880 01:19:13 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:05.880 01:19:13 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:05.880 01:19:13 -- paths/export.sh@5 -- # export PATH 00:18:05.880 01:19:13 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:05.880 01:19:13 -- nvmf/common.sh@46 -- # : 0 00:18:05.880 01:19:13 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:05.880 01:19:13 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:05.880 01:19:13 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:05.880 01:19:13 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:05.880 01:19:13 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:05.880 01:19:13 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:05.880 01:19:13 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:05.880 01:19:13 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:05.880 01:19:13 -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:18:05.880 01:19:13 -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:18:05.880 01:19:13 -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:05.880 01:19:13 -- target/queue_depth.sh@19 -- # nvmftestinit 00:18:05.880 01:19:13 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:05.880 01:19:13 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:05.880 01:19:13 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:05.880 01:19:13 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:05.880 01:19:13 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:05.880 01:19:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:05.881 01:19:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:05.881 01:19:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:05.881 01:19:13 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:05.881 01:19:13 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:05.881 01:19:13 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:05.881 01:19:13 -- common/autotest_common.sh@10 -- # set +x 00:18:07.784 01:19:15 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:07.784 01:19:15 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:07.784 01:19:15 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:07.784 01:19:15 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:07.784 01:19:15 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:07.784 01:19:15 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:07.784 01:19:15 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:07.784 01:19:15 -- nvmf/common.sh@294 -- # net_devs=() 00:18:07.784 01:19:15 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:07.784 01:19:15 -- nvmf/common.sh@295 -- # e810=() 00:18:07.784 01:19:15 -- nvmf/common.sh@295 -- # local -ga e810 00:18:07.784 01:19:15 -- nvmf/common.sh@296 -- # x722=() 00:18:07.784 01:19:15 -- nvmf/common.sh@296 -- # local -ga x722 00:18:07.784 01:19:15 -- nvmf/common.sh@297 -- # mlx=() 00:18:07.784 01:19:15 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:07.784 01:19:15 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:07.784 01:19:15 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:07.784 01:19:15 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:07.784 01:19:15 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:07.784 01:19:15 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:07.784 01:19:15 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:07.784 01:19:15 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:07.784 01:19:15 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:07.784 01:19:15 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:07.784 01:19:15 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:07.784 01:19:15 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:07.784 01:19:15 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:07.784 01:19:15 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:07.784 01:19:15 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:07.784 01:19:15 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:07.784 01:19:15 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:07.784 01:19:15 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:07.784 01:19:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:07.784 01:19:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:07.784 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:07.784 01:19:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:07.784 01:19:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:07.784 01:19:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:07.784 01:19:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:07.784 01:19:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:07.784 01:19:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:07.784 01:19:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:07.784 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:07.784 01:19:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:07.784 01:19:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:07.784 01:19:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:07.784 01:19:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:07.784 01:19:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:07.784 01:19:15 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:07.784 01:19:15 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:07.784 01:19:15 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:07.784 01:19:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:07.784 01:19:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:07.784 01:19:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:07.784 01:19:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:07.784 01:19:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:07.784 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:07.784 01:19:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:07.784 01:19:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:07.784 01:19:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:07.784 01:19:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:07.784 01:19:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:07.784 01:19:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:07.784 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:07.784 01:19:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:07.784 01:19:15 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:07.784 01:19:15 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:07.784 01:19:15 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:07.784 01:19:15 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:07.784 01:19:15 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:07.784 01:19:15 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:07.784 01:19:15 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:07.784 01:19:15 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:07.784 01:19:15 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:07.784 01:19:15 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:07.784 01:19:15 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:07.784 01:19:15 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:07.784 01:19:15 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:07.784 01:19:15 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:07.784 01:19:15 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:07.784 01:19:15 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:07.784 01:19:15 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:07.784 01:19:15 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:08.043 01:19:16 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:08.043 01:19:16 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:08.043 01:19:16 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:08.043 01:19:16 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:08.043 01:19:16 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:08.043 01:19:16 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:08.043 01:19:16 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:08.043 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:08.043 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.288 ms 00:18:08.043 00:18:08.043 --- 10.0.0.2 ping statistics --- 00:18:08.043 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:08.043 rtt min/avg/max/mdev = 0.288/0.288/0.288/0.000 ms 00:18:08.043 01:19:16 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:08.043 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:08.043 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.151 ms 00:18:08.043 00:18:08.043 --- 10.0.0.1 ping statistics --- 00:18:08.043 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:08.043 rtt min/avg/max/mdev = 0.151/0.151/0.151/0.000 ms 00:18:08.043 01:19:16 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:08.043 01:19:16 -- nvmf/common.sh@410 -- # return 0 00:18:08.043 01:19:16 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:08.043 01:19:16 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:08.043 01:19:16 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:08.043 01:19:16 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:08.043 01:19:16 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:08.043 01:19:16 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:08.043 01:19:16 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:08.043 01:19:16 -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:18:08.043 01:19:16 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:08.043 01:19:16 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:08.043 01:19:16 -- common/autotest_common.sh@10 -- # set +x 00:18:08.043 01:19:16 -- nvmf/common.sh@469 -- # nvmfpid=1141630 00:18:08.043 01:19:16 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:08.043 01:19:16 -- nvmf/common.sh@470 -- # waitforlisten 1141630 00:18:08.043 01:19:16 -- common/autotest_common.sh@829 -- # '[' -z 1141630 ']' 00:18:08.043 01:19:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:08.043 01:19:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:08.043 01:19:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:08.043 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:08.043 01:19:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:08.043 01:19:16 -- common/autotest_common.sh@10 -- # set +x 00:18:08.043 [2024-11-20 01:19:16.156751] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:08.043 [2024-11-20 01:19:16.156832] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:08.043 EAL: No free 2048 kB hugepages reported on node 1 00:18:08.043 [2024-11-20 01:19:16.225753] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:08.301 [2024-11-20 01:19:16.321925] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:08.301 [2024-11-20 01:19:16.322111] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:08.301 [2024-11-20 01:19:16.322148] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:08.301 [2024-11-20 01:19:16.322162] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:08.301 [2024-11-20 01:19:16.322191] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:09.235 01:19:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:09.235 01:19:17 -- common/autotest_common.sh@862 -- # return 0 00:18:09.235 01:19:17 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:09.235 01:19:17 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:09.235 01:19:17 -- common/autotest_common.sh@10 -- # set +x 00:18:09.235 01:19:17 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:09.235 01:19:17 -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:09.235 01:19:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:09.235 01:19:17 -- common/autotest_common.sh@10 -- # set +x 00:18:09.235 [2024-11-20 01:19:17.173029] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:09.235 01:19:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:09.235 01:19:17 -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:18:09.235 01:19:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:09.235 01:19:17 -- common/autotest_common.sh@10 -- # set +x 00:18:09.235 Malloc0 00:18:09.235 01:19:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:09.235 01:19:17 -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:09.235 01:19:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:09.235 01:19:17 -- common/autotest_common.sh@10 -- # set +x 00:18:09.235 01:19:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:09.236 01:19:17 -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:09.236 01:19:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:09.236 01:19:17 -- common/autotest_common.sh@10 -- # set +x 00:18:09.236 01:19:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:09.236 01:19:17 -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:09.236 01:19:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:09.236 01:19:17 -- common/autotest_common.sh@10 -- # set +x 00:18:09.236 [2024-11-20 01:19:17.229949] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:09.236 01:19:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:09.236 01:19:17 -- target/queue_depth.sh@30 -- # bdevperf_pid=1141789 00:18:09.236 01:19:17 -- target/queue_depth.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:18:09.236 01:19:17 -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:09.236 01:19:17 -- target/queue_depth.sh@33 -- # waitforlisten 1141789 /var/tmp/bdevperf.sock 00:18:09.236 01:19:17 -- common/autotest_common.sh@829 -- # '[' -z 1141789 ']' 00:18:09.236 01:19:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:09.236 01:19:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:09.236 01:19:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:09.236 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:09.236 01:19:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:09.236 01:19:17 -- common/autotest_common.sh@10 -- # set +x 00:18:09.236 [2024-11-20 01:19:17.273624] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:09.236 [2024-11-20 01:19:17.273684] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1141789 ] 00:18:09.236 EAL: No free 2048 kB hugepages reported on node 1 00:18:09.236 [2024-11-20 01:19:17.332943] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:09.236 [2024-11-20 01:19:17.421286] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:09.494 01:19:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:09.494 01:19:17 -- common/autotest_common.sh@862 -- # return 0 00:18:09.494 01:19:17 -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:18:09.494 01:19:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:09.494 01:19:17 -- common/autotest_common.sh@10 -- # set +x 00:18:09.494 NVMe0n1 00:18:09.494 01:19:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:09.494 01:19:17 -- target/queue_depth.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:18:09.752 Running I/O for 10 seconds... 00:18:19.718 00:18:19.718 Latency(us) 00:18:19.718 [2024-11-20T00:19:27.937Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:19.718 [2024-11-20T00:19:27.937Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:18:19.718 Verification LBA range: start 0x0 length 0x4000 00:18:19.718 NVMe0n1 : 10.07 12436.63 48.58 0.00 0.00 82016.31 14660.65 62137.84 00:18:19.718 [2024-11-20T00:19:27.937Z] =================================================================================================================== 00:18:19.718 [2024-11-20T00:19:27.937Z] Total : 12436.63 48.58 0.00 0.00 82016.31 14660.65 62137.84 00:18:19.718 0 00:18:19.718 01:19:27 -- target/queue_depth.sh@39 -- # killprocess 1141789 00:18:19.718 01:19:27 -- common/autotest_common.sh@936 -- # '[' -z 1141789 ']' 00:18:19.718 01:19:27 -- common/autotest_common.sh@940 -- # kill -0 1141789 00:18:19.718 01:19:27 -- common/autotest_common.sh@941 -- # uname 00:18:19.718 01:19:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:19.718 01:19:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1141789 00:18:19.718 01:19:27 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:19.718 01:19:27 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:19.718 01:19:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1141789' 00:18:19.718 killing process with pid 1141789 00:18:19.718 01:19:27 -- common/autotest_common.sh@955 -- # kill 1141789 00:18:19.718 Received shutdown signal, test time was about 10.000000 seconds 00:18:19.718 00:18:19.718 Latency(us) 00:18:19.718 [2024-11-20T00:19:27.937Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:19.718 [2024-11-20T00:19:27.937Z] =================================================================================================================== 00:18:19.718 [2024-11-20T00:19:27.937Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:19.718 01:19:27 -- common/autotest_common.sh@960 -- # wait 1141789 00:18:19.976 01:19:28 -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:18:19.976 01:19:28 -- target/queue_depth.sh@43 -- # nvmftestfini 00:18:19.976 01:19:28 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:19.976 01:19:28 -- nvmf/common.sh@116 -- # sync 00:18:19.976 01:19:28 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:19.976 01:19:28 -- nvmf/common.sh@119 -- # set +e 00:18:19.976 01:19:28 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:19.976 01:19:28 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:19.976 rmmod nvme_tcp 00:18:19.976 rmmod nvme_fabrics 00:18:19.976 rmmod nvme_keyring 00:18:19.976 01:19:28 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:19.976 01:19:28 -- nvmf/common.sh@123 -- # set -e 00:18:19.976 01:19:28 -- nvmf/common.sh@124 -- # return 0 00:18:19.976 01:19:28 -- nvmf/common.sh@477 -- # '[' -n 1141630 ']' 00:18:19.976 01:19:28 -- nvmf/common.sh@478 -- # killprocess 1141630 00:18:19.976 01:19:28 -- common/autotest_common.sh@936 -- # '[' -z 1141630 ']' 00:18:19.976 01:19:28 -- common/autotest_common.sh@940 -- # kill -0 1141630 00:18:19.976 01:19:28 -- common/autotest_common.sh@941 -- # uname 00:18:19.976 01:19:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:19.976 01:19:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1141630 00:18:20.234 01:19:28 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:20.234 01:19:28 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:20.234 01:19:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1141630' 00:18:20.234 killing process with pid 1141630 00:18:20.234 01:19:28 -- common/autotest_common.sh@955 -- # kill 1141630 00:18:20.234 01:19:28 -- common/autotest_common.sh@960 -- # wait 1141630 00:18:20.493 01:19:28 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:20.493 01:19:28 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:20.493 01:19:28 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:20.493 01:19:28 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:20.493 01:19:28 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:20.493 01:19:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:20.493 01:19:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:20.493 01:19:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:22.399 01:19:30 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:22.399 00:18:22.399 real 0m16.783s 00:18:22.399 user 0m23.281s 00:18:22.399 sys 0m3.232s 00:18:22.399 01:19:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:22.399 01:19:30 -- common/autotest_common.sh@10 -- # set +x 00:18:22.399 ************************************ 00:18:22.399 END TEST nvmf_queue_depth 00:18:22.399 ************************************ 00:18:22.399 01:19:30 -- nvmf/nvmf.sh@51 -- # run_test nvmf_multipath /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:18:22.399 01:19:30 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:22.399 01:19:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:22.399 01:19:30 -- common/autotest_common.sh@10 -- # set +x 00:18:22.399 ************************************ 00:18:22.399 START TEST nvmf_multipath 00:18:22.399 ************************************ 00:18:22.399 01:19:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:18:22.399 * Looking for test storage... 00:18:22.657 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:22.657 01:19:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:22.657 01:19:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:22.657 01:19:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:22.657 01:19:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:22.657 01:19:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:22.657 01:19:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:22.657 01:19:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:22.657 01:19:30 -- scripts/common.sh@335 -- # IFS=.-: 00:18:22.657 01:19:30 -- scripts/common.sh@335 -- # read -ra ver1 00:18:22.657 01:19:30 -- scripts/common.sh@336 -- # IFS=.-: 00:18:22.657 01:19:30 -- scripts/common.sh@336 -- # read -ra ver2 00:18:22.658 01:19:30 -- scripts/common.sh@337 -- # local 'op=<' 00:18:22.658 01:19:30 -- scripts/common.sh@339 -- # ver1_l=2 00:18:22.658 01:19:30 -- scripts/common.sh@340 -- # ver2_l=1 00:18:22.658 01:19:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:22.658 01:19:30 -- scripts/common.sh@343 -- # case "$op" in 00:18:22.658 01:19:30 -- scripts/common.sh@344 -- # : 1 00:18:22.658 01:19:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:22.658 01:19:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:22.658 01:19:30 -- scripts/common.sh@364 -- # decimal 1 00:18:22.658 01:19:30 -- scripts/common.sh@352 -- # local d=1 00:18:22.658 01:19:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:22.658 01:19:30 -- scripts/common.sh@354 -- # echo 1 00:18:22.658 01:19:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:22.658 01:19:30 -- scripts/common.sh@365 -- # decimal 2 00:18:22.658 01:19:30 -- scripts/common.sh@352 -- # local d=2 00:18:22.658 01:19:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:22.658 01:19:30 -- scripts/common.sh@354 -- # echo 2 00:18:22.658 01:19:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:22.658 01:19:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:22.658 01:19:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:22.658 01:19:30 -- scripts/common.sh@367 -- # return 0 00:18:22.658 01:19:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:22.658 01:19:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:22.658 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:22.658 --rc genhtml_branch_coverage=1 00:18:22.658 --rc genhtml_function_coverage=1 00:18:22.658 --rc genhtml_legend=1 00:18:22.658 --rc geninfo_all_blocks=1 00:18:22.658 --rc geninfo_unexecuted_blocks=1 00:18:22.658 00:18:22.658 ' 00:18:22.658 01:19:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:22.658 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:22.658 --rc genhtml_branch_coverage=1 00:18:22.658 --rc genhtml_function_coverage=1 00:18:22.658 --rc genhtml_legend=1 00:18:22.658 --rc geninfo_all_blocks=1 00:18:22.658 --rc geninfo_unexecuted_blocks=1 00:18:22.658 00:18:22.658 ' 00:18:22.658 01:19:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:22.658 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:22.658 --rc genhtml_branch_coverage=1 00:18:22.658 --rc genhtml_function_coverage=1 00:18:22.658 --rc genhtml_legend=1 00:18:22.658 --rc geninfo_all_blocks=1 00:18:22.658 --rc geninfo_unexecuted_blocks=1 00:18:22.658 00:18:22.658 ' 00:18:22.658 01:19:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:22.658 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:22.658 --rc genhtml_branch_coverage=1 00:18:22.658 --rc genhtml_function_coverage=1 00:18:22.658 --rc genhtml_legend=1 00:18:22.658 --rc geninfo_all_blocks=1 00:18:22.658 --rc geninfo_unexecuted_blocks=1 00:18:22.658 00:18:22.658 ' 00:18:22.658 01:19:30 -- target/multipath.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:22.658 01:19:30 -- nvmf/common.sh@7 -- # uname -s 00:18:22.658 01:19:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:22.658 01:19:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:22.658 01:19:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:22.658 01:19:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:22.658 01:19:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:22.658 01:19:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:22.658 01:19:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:22.658 01:19:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:22.658 01:19:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:22.658 01:19:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:22.658 01:19:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:22.658 01:19:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:22.658 01:19:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:22.658 01:19:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:22.658 01:19:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:22.658 01:19:30 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:22.658 01:19:30 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:22.658 01:19:30 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:22.658 01:19:30 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:22.658 01:19:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:22.658 01:19:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:22.658 01:19:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:22.658 01:19:30 -- paths/export.sh@5 -- # export PATH 00:18:22.658 01:19:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:22.658 01:19:30 -- nvmf/common.sh@46 -- # : 0 00:18:22.658 01:19:30 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:22.658 01:19:30 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:22.658 01:19:30 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:22.658 01:19:30 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:22.658 01:19:30 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:22.658 01:19:30 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:22.658 01:19:30 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:22.658 01:19:30 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:22.658 01:19:30 -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:22.658 01:19:30 -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:22.658 01:19:30 -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:18:22.658 01:19:30 -- target/multipath.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:22.658 01:19:30 -- target/multipath.sh@43 -- # nvmftestinit 00:18:22.658 01:19:30 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:22.658 01:19:30 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:22.658 01:19:30 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:22.658 01:19:30 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:22.658 01:19:30 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:22.658 01:19:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:22.658 01:19:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:22.658 01:19:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:22.658 01:19:30 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:22.658 01:19:30 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:22.658 01:19:30 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:22.658 01:19:30 -- common/autotest_common.sh@10 -- # set +x 00:18:24.559 01:19:32 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:24.559 01:19:32 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:24.559 01:19:32 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:24.559 01:19:32 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:24.559 01:19:32 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:24.559 01:19:32 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:24.559 01:19:32 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:24.559 01:19:32 -- nvmf/common.sh@294 -- # net_devs=() 00:18:24.559 01:19:32 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:24.559 01:19:32 -- nvmf/common.sh@295 -- # e810=() 00:18:24.559 01:19:32 -- nvmf/common.sh@295 -- # local -ga e810 00:18:24.559 01:19:32 -- nvmf/common.sh@296 -- # x722=() 00:18:24.559 01:19:32 -- nvmf/common.sh@296 -- # local -ga x722 00:18:24.559 01:19:32 -- nvmf/common.sh@297 -- # mlx=() 00:18:24.559 01:19:32 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:24.559 01:19:32 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:24.559 01:19:32 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:24.559 01:19:32 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:24.559 01:19:32 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:24.559 01:19:32 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:24.559 01:19:32 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:24.559 01:19:32 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:24.559 01:19:32 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:24.559 01:19:32 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:24.559 01:19:32 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:24.559 01:19:32 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:24.559 01:19:32 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:24.559 01:19:32 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:24.559 01:19:32 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:24.559 01:19:32 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:24.559 01:19:32 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:24.559 01:19:32 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:24.559 01:19:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:24.559 01:19:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:24.559 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:24.559 01:19:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:24.559 01:19:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:24.559 01:19:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:24.559 01:19:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:24.559 01:19:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:24.559 01:19:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:24.560 01:19:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:24.560 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:24.560 01:19:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:24.560 01:19:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:24.560 01:19:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:24.560 01:19:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:24.560 01:19:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:24.560 01:19:32 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:24.560 01:19:32 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:24.560 01:19:32 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:24.560 01:19:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:24.560 01:19:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:24.560 01:19:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:24.560 01:19:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:24.560 01:19:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:24.560 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:24.560 01:19:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:24.560 01:19:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:24.560 01:19:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:24.560 01:19:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:24.560 01:19:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:24.560 01:19:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:24.560 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:24.560 01:19:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:24.560 01:19:32 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:24.560 01:19:32 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:24.560 01:19:32 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:24.560 01:19:32 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:24.560 01:19:32 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:24.560 01:19:32 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:24.560 01:19:32 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:24.560 01:19:32 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:24.560 01:19:32 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:24.560 01:19:32 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:24.560 01:19:32 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:24.560 01:19:32 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:24.560 01:19:32 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:24.560 01:19:32 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:24.560 01:19:32 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:24.560 01:19:32 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:24.560 01:19:32 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:24.560 01:19:32 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:24.819 01:19:32 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:24.819 01:19:32 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:24.819 01:19:32 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:24.819 01:19:32 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:24.819 01:19:32 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:24.819 01:19:32 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:24.819 01:19:32 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:24.819 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:24.819 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.196 ms 00:18:24.819 00:18:24.819 --- 10.0.0.2 ping statistics --- 00:18:24.819 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:24.819 rtt min/avg/max/mdev = 0.196/0.196/0.196/0.000 ms 00:18:24.819 01:19:32 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:24.819 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:24.819 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.132 ms 00:18:24.819 00:18:24.819 --- 10.0.0.1 ping statistics --- 00:18:24.819 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:24.819 rtt min/avg/max/mdev = 0.132/0.132/0.132/0.000 ms 00:18:24.819 01:19:32 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:24.819 01:19:32 -- nvmf/common.sh@410 -- # return 0 00:18:24.819 01:19:32 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:24.819 01:19:32 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:24.819 01:19:32 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:24.819 01:19:32 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:24.819 01:19:32 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:24.819 01:19:32 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:24.819 01:19:32 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:24.819 01:19:32 -- target/multipath.sh@45 -- # '[' -z ']' 00:18:24.819 01:19:32 -- target/multipath.sh@46 -- # echo 'only one NIC for nvmf test' 00:18:24.819 only one NIC for nvmf test 00:18:24.819 01:19:32 -- target/multipath.sh@47 -- # nvmftestfini 00:18:24.819 01:19:32 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:24.819 01:19:32 -- nvmf/common.sh@116 -- # sync 00:18:24.819 01:19:32 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:24.819 01:19:32 -- nvmf/common.sh@119 -- # set +e 00:18:24.819 01:19:32 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:24.819 01:19:32 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:24.819 rmmod nvme_tcp 00:18:24.819 rmmod nvme_fabrics 00:18:24.819 rmmod nvme_keyring 00:18:24.819 01:19:32 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:24.819 01:19:32 -- nvmf/common.sh@123 -- # set -e 00:18:24.819 01:19:32 -- nvmf/common.sh@124 -- # return 0 00:18:24.819 01:19:32 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:18:24.819 01:19:32 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:24.819 01:19:32 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:24.819 01:19:32 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:24.819 01:19:32 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:24.819 01:19:32 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:24.819 01:19:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:24.819 01:19:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:24.819 01:19:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:27.355 01:19:35 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:27.355 01:19:35 -- target/multipath.sh@48 -- # exit 0 00:18:27.355 01:19:35 -- target/multipath.sh@1 -- # nvmftestfini 00:18:27.356 01:19:35 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:27.356 01:19:35 -- nvmf/common.sh@116 -- # sync 00:18:27.356 01:19:35 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:27.356 01:19:35 -- nvmf/common.sh@119 -- # set +e 00:18:27.356 01:19:35 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:27.356 01:19:35 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:27.356 01:19:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:27.356 01:19:35 -- nvmf/common.sh@123 -- # set -e 00:18:27.356 01:19:35 -- nvmf/common.sh@124 -- # return 0 00:18:27.356 01:19:35 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:18:27.356 01:19:35 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:27.356 01:19:35 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:27.356 01:19:35 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:27.356 01:19:35 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:27.356 01:19:35 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:27.356 01:19:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:27.356 01:19:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:27.356 01:19:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:27.356 01:19:35 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:27.356 00:18:27.356 real 0m4.469s 00:18:27.356 user 0m0.904s 00:18:27.356 sys 0m1.546s 00:18:27.356 01:19:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:27.356 01:19:35 -- common/autotest_common.sh@10 -- # set +x 00:18:27.356 ************************************ 00:18:27.356 END TEST nvmf_multipath 00:18:27.356 ************************************ 00:18:27.356 01:19:35 -- nvmf/nvmf.sh@52 -- # run_test nvmf_zcopy /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:18:27.356 01:19:35 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:27.356 01:19:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:27.356 01:19:35 -- common/autotest_common.sh@10 -- # set +x 00:18:27.356 ************************************ 00:18:27.356 START TEST nvmf_zcopy 00:18:27.356 ************************************ 00:18:27.356 01:19:35 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:18:27.356 * Looking for test storage... 00:18:27.356 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:27.356 01:19:35 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:27.356 01:19:35 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:27.356 01:19:35 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:27.356 01:19:35 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:27.356 01:19:35 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:27.356 01:19:35 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:27.356 01:19:35 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:27.356 01:19:35 -- scripts/common.sh@335 -- # IFS=.-: 00:18:27.356 01:19:35 -- scripts/common.sh@335 -- # read -ra ver1 00:18:27.356 01:19:35 -- scripts/common.sh@336 -- # IFS=.-: 00:18:27.356 01:19:35 -- scripts/common.sh@336 -- # read -ra ver2 00:18:27.356 01:19:35 -- scripts/common.sh@337 -- # local 'op=<' 00:18:27.356 01:19:35 -- scripts/common.sh@339 -- # ver1_l=2 00:18:27.356 01:19:35 -- scripts/common.sh@340 -- # ver2_l=1 00:18:27.356 01:19:35 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:27.356 01:19:35 -- scripts/common.sh@343 -- # case "$op" in 00:18:27.356 01:19:35 -- scripts/common.sh@344 -- # : 1 00:18:27.356 01:19:35 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:27.356 01:19:35 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:27.356 01:19:35 -- scripts/common.sh@364 -- # decimal 1 00:18:27.356 01:19:35 -- scripts/common.sh@352 -- # local d=1 00:18:27.356 01:19:35 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:27.356 01:19:35 -- scripts/common.sh@354 -- # echo 1 00:18:27.356 01:19:35 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:27.356 01:19:35 -- scripts/common.sh@365 -- # decimal 2 00:18:27.356 01:19:35 -- scripts/common.sh@352 -- # local d=2 00:18:27.356 01:19:35 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:27.356 01:19:35 -- scripts/common.sh@354 -- # echo 2 00:18:27.356 01:19:35 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:27.356 01:19:35 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:27.356 01:19:35 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:27.356 01:19:35 -- scripts/common.sh@367 -- # return 0 00:18:27.356 01:19:35 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:27.356 01:19:35 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:27.356 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:27.356 --rc genhtml_branch_coverage=1 00:18:27.356 --rc genhtml_function_coverage=1 00:18:27.356 --rc genhtml_legend=1 00:18:27.356 --rc geninfo_all_blocks=1 00:18:27.356 --rc geninfo_unexecuted_blocks=1 00:18:27.356 00:18:27.356 ' 00:18:27.356 01:19:35 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:27.356 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:27.356 --rc genhtml_branch_coverage=1 00:18:27.356 --rc genhtml_function_coverage=1 00:18:27.356 --rc genhtml_legend=1 00:18:27.356 --rc geninfo_all_blocks=1 00:18:27.356 --rc geninfo_unexecuted_blocks=1 00:18:27.356 00:18:27.356 ' 00:18:27.356 01:19:35 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:27.356 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:27.356 --rc genhtml_branch_coverage=1 00:18:27.356 --rc genhtml_function_coverage=1 00:18:27.356 --rc genhtml_legend=1 00:18:27.356 --rc geninfo_all_blocks=1 00:18:27.356 --rc geninfo_unexecuted_blocks=1 00:18:27.356 00:18:27.356 ' 00:18:27.356 01:19:35 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:27.356 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:27.356 --rc genhtml_branch_coverage=1 00:18:27.356 --rc genhtml_function_coverage=1 00:18:27.356 --rc genhtml_legend=1 00:18:27.356 --rc geninfo_all_blocks=1 00:18:27.356 --rc geninfo_unexecuted_blocks=1 00:18:27.356 00:18:27.356 ' 00:18:27.356 01:19:35 -- target/zcopy.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:27.356 01:19:35 -- nvmf/common.sh@7 -- # uname -s 00:18:27.356 01:19:35 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:27.356 01:19:35 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:27.356 01:19:35 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:27.356 01:19:35 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:27.356 01:19:35 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:27.356 01:19:35 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:27.356 01:19:35 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:27.356 01:19:35 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:27.356 01:19:35 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:27.356 01:19:35 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:27.356 01:19:35 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:27.356 01:19:35 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:27.356 01:19:35 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:27.356 01:19:35 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:27.356 01:19:35 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:27.356 01:19:35 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:27.356 01:19:35 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:27.356 01:19:35 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:27.356 01:19:35 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:27.357 01:19:35 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:27.357 01:19:35 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:27.357 01:19:35 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:27.357 01:19:35 -- paths/export.sh@5 -- # export PATH 00:18:27.357 01:19:35 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:27.357 01:19:35 -- nvmf/common.sh@46 -- # : 0 00:18:27.357 01:19:35 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:27.357 01:19:35 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:27.357 01:19:35 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:27.357 01:19:35 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:27.357 01:19:35 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:27.357 01:19:35 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:27.357 01:19:35 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:27.357 01:19:35 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:27.357 01:19:35 -- target/zcopy.sh@12 -- # nvmftestinit 00:18:27.357 01:19:35 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:27.357 01:19:35 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:27.357 01:19:35 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:27.357 01:19:35 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:27.357 01:19:35 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:27.357 01:19:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:27.357 01:19:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:27.357 01:19:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:27.357 01:19:35 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:27.357 01:19:35 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:27.357 01:19:35 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:27.357 01:19:35 -- common/autotest_common.sh@10 -- # set +x 00:18:29.262 01:19:37 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:29.262 01:19:37 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:29.262 01:19:37 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:29.262 01:19:37 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:29.262 01:19:37 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:29.262 01:19:37 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:29.262 01:19:37 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:29.262 01:19:37 -- nvmf/common.sh@294 -- # net_devs=() 00:18:29.262 01:19:37 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:29.262 01:19:37 -- nvmf/common.sh@295 -- # e810=() 00:18:29.262 01:19:37 -- nvmf/common.sh@295 -- # local -ga e810 00:18:29.262 01:19:37 -- nvmf/common.sh@296 -- # x722=() 00:18:29.262 01:19:37 -- nvmf/common.sh@296 -- # local -ga x722 00:18:29.262 01:19:37 -- nvmf/common.sh@297 -- # mlx=() 00:18:29.262 01:19:37 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:29.262 01:19:37 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:29.262 01:19:37 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:29.262 01:19:37 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:29.262 01:19:37 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:29.262 01:19:37 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:29.262 01:19:37 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:29.262 01:19:37 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:29.262 01:19:37 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:29.262 01:19:37 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:29.262 01:19:37 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:29.262 01:19:37 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:29.262 01:19:37 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:29.263 01:19:37 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:29.263 01:19:37 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:29.263 01:19:37 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:29.263 01:19:37 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:29.263 01:19:37 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:29.263 01:19:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:29.263 01:19:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:29.263 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:29.263 01:19:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:29.263 01:19:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:29.263 01:19:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:29.263 01:19:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:29.263 01:19:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:29.263 01:19:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:29.263 01:19:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:29.263 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:29.263 01:19:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:29.263 01:19:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:29.263 01:19:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:29.263 01:19:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:29.263 01:19:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:29.263 01:19:37 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:29.263 01:19:37 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:29.263 01:19:37 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:29.263 01:19:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:29.263 01:19:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:29.263 01:19:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:29.263 01:19:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:29.263 01:19:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:29.263 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:29.263 01:19:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:29.263 01:19:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:29.263 01:19:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:29.263 01:19:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:29.263 01:19:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:29.263 01:19:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:29.263 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:29.263 01:19:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:29.263 01:19:37 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:29.263 01:19:37 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:29.263 01:19:37 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:29.263 01:19:37 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:29.263 01:19:37 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:29.263 01:19:37 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:29.263 01:19:37 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:29.263 01:19:37 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:29.263 01:19:37 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:29.263 01:19:37 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:29.263 01:19:37 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:29.263 01:19:37 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:29.263 01:19:37 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:29.263 01:19:37 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:29.263 01:19:37 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:29.263 01:19:37 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:29.263 01:19:37 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:29.263 01:19:37 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:29.263 01:19:37 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:29.263 01:19:37 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:29.263 01:19:37 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:29.263 01:19:37 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:29.263 01:19:37 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:29.263 01:19:37 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:29.263 01:19:37 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:29.263 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:29.263 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.258 ms 00:18:29.263 00:18:29.263 --- 10.0.0.2 ping statistics --- 00:18:29.263 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:29.263 rtt min/avg/max/mdev = 0.258/0.258/0.258/0.000 ms 00:18:29.263 01:19:37 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:29.263 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:29.263 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.048 ms 00:18:29.263 00:18:29.263 --- 10.0.0.1 ping statistics --- 00:18:29.263 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:29.263 rtt min/avg/max/mdev = 0.048/0.048/0.048/0.000 ms 00:18:29.263 01:19:37 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:29.263 01:19:37 -- nvmf/common.sh@410 -- # return 0 00:18:29.263 01:19:37 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:29.263 01:19:37 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:29.263 01:19:37 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:29.263 01:19:37 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:29.263 01:19:37 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:29.263 01:19:37 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:29.263 01:19:37 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:29.523 01:19:37 -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:18:29.523 01:19:37 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:29.523 01:19:37 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:29.523 01:19:37 -- common/autotest_common.sh@10 -- # set +x 00:18:29.523 01:19:37 -- nvmf/common.sh@469 -- # nvmfpid=1147036 00:18:29.523 01:19:37 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:29.523 01:19:37 -- nvmf/common.sh@470 -- # waitforlisten 1147036 00:18:29.523 01:19:37 -- common/autotest_common.sh@829 -- # '[' -z 1147036 ']' 00:18:29.523 01:19:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:29.523 01:19:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:29.523 01:19:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:29.523 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:29.523 01:19:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:29.523 01:19:37 -- common/autotest_common.sh@10 -- # set +x 00:18:29.523 [2024-11-20 01:19:37.551421] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:29.523 [2024-11-20 01:19:37.551514] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:29.523 EAL: No free 2048 kB hugepages reported on node 1 00:18:29.523 [2024-11-20 01:19:37.621309] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:29.523 [2024-11-20 01:19:37.711486] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:29.523 [2024-11-20 01:19:37.711666] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:29.523 [2024-11-20 01:19:37.711688] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:29.523 [2024-11-20 01:19:37.711704] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:29.523 [2024-11-20 01:19:37.711735] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:30.461 01:19:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:30.461 01:19:38 -- common/autotest_common.sh@862 -- # return 0 00:18:30.461 01:19:38 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:30.461 01:19:38 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:30.461 01:19:38 -- common/autotest_common.sh@10 -- # set +x 00:18:30.461 01:19:38 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:30.461 01:19:38 -- target/zcopy.sh@15 -- # '[' tcp '!=' tcp ']' 00:18:30.461 01:19:38 -- target/zcopy.sh@22 -- # rpc_cmd nvmf_create_transport -t tcp -o -c 0 --zcopy 00:18:30.461 01:19:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:30.461 01:19:38 -- common/autotest_common.sh@10 -- # set +x 00:18:30.461 [2024-11-20 01:19:38.558187] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:30.461 01:19:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:30.461 01:19:38 -- target/zcopy.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:18:30.461 01:19:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:30.461 01:19:38 -- common/autotest_common.sh@10 -- # set +x 00:18:30.461 01:19:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:30.461 01:19:38 -- target/zcopy.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:30.461 01:19:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:30.461 01:19:38 -- common/autotest_common.sh@10 -- # set +x 00:18:30.461 [2024-11-20 01:19:38.574355] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:30.461 01:19:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:30.461 01:19:38 -- target/zcopy.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:18:30.461 01:19:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:30.461 01:19:38 -- common/autotest_common.sh@10 -- # set +x 00:18:30.461 01:19:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:30.461 01:19:38 -- target/zcopy.sh@29 -- # rpc_cmd bdev_malloc_create 32 4096 -b malloc0 00:18:30.461 01:19:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:30.461 01:19:38 -- common/autotest_common.sh@10 -- # set +x 00:18:30.461 malloc0 00:18:30.461 01:19:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:30.461 01:19:38 -- target/zcopy.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:18:30.461 01:19:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:30.461 01:19:38 -- common/autotest_common.sh@10 -- # set +x 00:18:30.461 01:19:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:30.461 01:19:38 -- target/zcopy.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -t 10 -q 128 -w verify -o 8192 00:18:30.461 01:19:38 -- target/zcopy.sh@33 -- # gen_nvmf_target_json 00:18:30.461 01:19:38 -- nvmf/common.sh@520 -- # config=() 00:18:30.461 01:19:38 -- nvmf/common.sh@520 -- # local subsystem config 00:18:30.461 01:19:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:30.461 01:19:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:30.461 { 00:18:30.461 "params": { 00:18:30.461 "name": "Nvme$subsystem", 00:18:30.461 "trtype": "$TEST_TRANSPORT", 00:18:30.461 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:30.461 "adrfam": "ipv4", 00:18:30.461 "trsvcid": "$NVMF_PORT", 00:18:30.461 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:30.461 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:30.461 "hdgst": ${hdgst:-false}, 00:18:30.461 "ddgst": ${ddgst:-false} 00:18:30.461 }, 00:18:30.461 "method": "bdev_nvme_attach_controller" 00:18:30.461 } 00:18:30.461 EOF 00:18:30.461 )") 00:18:30.461 01:19:38 -- nvmf/common.sh@542 -- # cat 00:18:30.461 01:19:38 -- nvmf/common.sh@544 -- # jq . 00:18:30.461 01:19:38 -- nvmf/common.sh@545 -- # IFS=, 00:18:30.461 01:19:38 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:30.461 "params": { 00:18:30.461 "name": "Nvme1", 00:18:30.461 "trtype": "tcp", 00:18:30.461 "traddr": "10.0.0.2", 00:18:30.461 "adrfam": "ipv4", 00:18:30.461 "trsvcid": "4420", 00:18:30.461 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:30.461 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:30.461 "hdgst": false, 00:18:30.461 "ddgst": false 00:18:30.461 }, 00:18:30.461 "method": "bdev_nvme_attach_controller" 00:18:30.461 }' 00:18:30.461 [2024-11-20 01:19:38.645087] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:30.461 [2024-11-20 01:19:38.645177] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1147195 ] 00:18:30.461 EAL: No free 2048 kB hugepages reported on node 1 00:18:30.721 [2024-11-20 01:19:38.708232] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:30.721 [2024-11-20 01:19:38.799475] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:30.982 Running I/O for 10 seconds... 00:18:40.972 00:18:40.972 Latency(us) 00:18:40.972 [2024-11-20T00:19:49.191Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:40.972 [2024-11-20T00:19:49.191Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 8192) 00:18:40.972 Verification LBA range: start 0x0 length 0x1000 00:18:40.972 Nvme1n1 : 10.01 7289.94 56.95 0.00 0.00 17519.40 1456.36 24369.68 00:18:40.972 [2024-11-20T00:19:49.191Z] =================================================================================================================== 00:18:40.972 [2024-11-20T00:19:49.191Z] Total : 7289.94 56.95 0.00 0.00 17519.40 1456.36 24369.68 00:18:41.231 01:19:49 -- target/zcopy.sh@39 -- # perfpid=1148427 00:18:41.231 01:19:49 -- target/zcopy.sh@41 -- # xtrace_disable 00:18:41.231 01:19:49 -- common/autotest_common.sh@10 -- # set +x 00:18:41.231 01:19:49 -- target/zcopy.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -t 5 -q 128 -w randrw -M 50 -o 8192 00:18:41.231 01:19:49 -- target/zcopy.sh@37 -- # gen_nvmf_target_json 00:18:41.231 01:19:49 -- nvmf/common.sh@520 -- # config=() 00:18:41.231 01:19:49 -- nvmf/common.sh@520 -- # local subsystem config 00:18:41.231 01:19:49 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:41.231 01:19:49 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:41.231 { 00:18:41.231 "params": { 00:18:41.231 "name": "Nvme$subsystem", 00:18:41.231 "trtype": "$TEST_TRANSPORT", 00:18:41.231 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:41.231 "adrfam": "ipv4", 00:18:41.231 "trsvcid": "$NVMF_PORT", 00:18:41.231 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:41.231 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:41.231 "hdgst": ${hdgst:-false}, 00:18:41.231 "ddgst": ${ddgst:-false} 00:18:41.231 }, 00:18:41.231 "method": "bdev_nvme_attach_controller" 00:18:41.231 } 00:18:41.231 EOF 00:18:41.231 )") 00:18:41.231 [2024-11-20 01:19:49.280544] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.231 [2024-11-20 01:19:49.280594] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.231 01:19:49 -- nvmf/common.sh@542 -- # cat 00:18:41.231 01:19:49 -- nvmf/common.sh@544 -- # jq . 00:18:41.231 01:19:49 -- nvmf/common.sh@545 -- # IFS=, 00:18:41.231 01:19:49 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:41.231 "params": { 00:18:41.231 "name": "Nvme1", 00:18:41.231 "trtype": "tcp", 00:18:41.231 "traddr": "10.0.0.2", 00:18:41.231 "adrfam": "ipv4", 00:18:41.231 "trsvcid": "4420", 00:18:41.231 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:41.231 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:41.231 "hdgst": false, 00:18:41.231 "ddgst": false 00:18:41.231 }, 00:18:41.231 "method": "bdev_nvme_attach_controller" 00:18:41.231 }' 00:18:41.231 [2024-11-20 01:19:49.288489] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.231 [2024-11-20 01:19:49.288517] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.231 [2024-11-20 01:19:49.296504] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.231 [2024-11-20 01:19:49.296528] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.231 [2024-11-20 01:19:49.304520] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.231 [2024-11-20 01:19:49.304542] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.231 [2024-11-20 01:19:49.312539] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.231 [2024-11-20 01:19:49.312561] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.231 [2024-11-20 01:19:49.318063] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:41.231 [2024-11-20 01:19:49.318151] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1148427 ] 00:18:41.231 [2024-11-20 01:19:49.320557] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.231 [2024-11-20 01:19:49.320578] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.231 [2024-11-20 01:19:49.328579] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.231 [2024-11-20 01:19:49.328599] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.231 [2024-11-20 01:19:49.336601] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.231 [2024-11-20 01:19:49.336621] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.231 [2024-11-20 01:19:49.344622] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.231 [2024-11-20 01:19:49.344642] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.231 EAL: No free 2048 kB hugepages reported on node 1 00:18:41.231 [2024-11-20 01:19:49.352660] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.231 [2024-11-20 01:19:49.352685] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.231 [2024-11-20 01:19:49.360684] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.231 [2024-11-20 01:19:49.360708] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.231 [2024-11-20 01:19:49.368705] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.231 [2024-11-20 01:19:49.368730] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.231 [2024-11-20 01:19:49.376727] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.231 [2024-11-20 01:19:49.376751] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.231 [2024-11-20 01:19:49.379912] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:41.231 [2024-11-20 01:19:49.384761] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.231 [2024-11-20 01:19:49.384789] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.231 [2024-11-20 01:19:49.392813] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.231 [2024-11-20 01:19:49.392856] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.231 [2024-11-20 01:19:49.400797] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.231 [2024-11-20 01:19:49.400822] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.231 [2024-11-20 01:19:49.408819] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.231 [2024-11-20 01:19:49.408845] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.231 [2024-11-20 01:19:49.416842] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.231 [2024-11-20 01:19:49.416868] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.231 [2024-11-20 01:19:49.424862] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.231 [2024-11-20 01:19:49.424887] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.231 [2024-11-20 01:19:49.432916] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.231 [2024-11-20 01:19:49.432955] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.231 [2024-11-20 01:19:49.440925] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.231 [2024-11-20 01:19:49.440959] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.490 [2024-11-20 01:19:49.448930] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.490 [2024-11-20 01:19:49.448970] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.490 [2024-11-20 01:19:49.456949] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.490 [2024-11-20 01:19:49.456974] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.490 [2024-11-20 01:19:49.464971] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.490 [2024-11-20 01:19:49.464997] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.490 [2024-11-20 01:19:49.469311] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:41.490 [2024-11-20 01:19:49.472992] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.490 [2024-11-20 01:19:49.473017] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.490 [2024-11-20 01:19:49.481013] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.490 [2024-11-20 01:19:49.481038] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.490 [2024-11-20 01:19:49.489079] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.490 [2024-11-20 01:19:49.489131] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.490 [2024-11-20 01:19:49.497096] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.490 [2024-11-20 01:19:49.497148] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.490 [2024-11-20 01:19:49.505139] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.490 [2024-11-20 01:19:49.505178] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.490 [2024-11-20 01:19:49.513156] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.490 [2024-11-20 01:19:49.513212] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.490 [2024-11-20 01:19:49.521178] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.491 [2024-11-20 01:19:49.521217] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.491 [2024-11-20 01:19:49.529194] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.491 [2024-11-20 01:19:49.529232] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.491 [2024-11-20 01:19:49.537173] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.491 [2024-11-20 01:19:49.537197] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.491 [2024-11-20 01:19:49.545223] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.491 [2024-11-20 01:19:49.545260] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.491 [2024-11-20 01:19:49.553244] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.491 [2024-11-20 01:19:49.553284] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.491 [2024-11-20 01:19:49.561231] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.491 [2024-11-20 01:19:49.561255] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.491 [2024-11-20 01:19:49.569251] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.491 [2024-11-20 01:19:49.569274] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.491 [2024-11-20 01:19:49.577281] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.491 [2024-11-20 01:19:49.577306] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.491 [2024-11-20 01:19:49.585306] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.491 [2024-11-20 01:19:49.585332] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.491 [2024-11-20 01:19:49.593325] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.491 [2024-11-20 01:19:49.593365] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.491 [2024-11-20 01:19:49.601363] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.491 [2024-11-20 01:19:49.601396] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.491 [2024-11-20 01:19:49.609388] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.491 [2024-11-20 01:19:49.609414] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.491 [2024-11-20 01:19:49.617409] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.491 [2024-11-20 01:19:49.617434] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.491 [2024-11-20 01:19:49.625456] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.491 [2024-11-20 01:19:49.625481] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.491 [2024-11-20 01:19:49.633462] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.491 [2024-11-20 01:19:49.633487] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.491 [2024-11-20 01:19:49.641497] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.491 [2024-11-20 01:19:49.641522] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.491 [2024-11-20 01:19:49.649510] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.491 [2024-11-20 01:19:49.649536] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.491 [2024-11-20 01:19:49.657532] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.491 [2024-11-20 01:19:49.657560] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.491 [2024-11-20 01:19:49.665556] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.491 [2024-11-20 01:19:49.665582] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.491 [2024-11-20 01:19:49.673577] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.491 [2024-11-20 01:19:49.673602] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.491 [2024-11-20 01:19:49.681602] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.491 [2024-11-20 01:19:49.681627] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.491 [2024-11-20 01:19:49.689625] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.491 [2024-11-20 01:19:49.689650] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.491 [2024-11-20 01:19:49.697655] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.491 [2024-11-20 01:19:49.697682] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.491 [2024-11-20 01:19:49.705675] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.491 [2024-11-20 01:19:49.705700] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.752 [2024-11-20 01:19:49.713696] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.752 [2024-11-20 01:19:49.713721] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.752 [2024-11-20 01:19:49.721721] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.752 [2024-11-20 01:19:49.721746] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.752 [2024-11-20 01:19:49.729740] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.752 [2024-11-20 01:19:49.729765] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.752 [2024-11-20 01:19:49.737767] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.752 [2024-11-20 01:19:49.737793] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.752 [2024-11-20 01:19:49.745788] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.752 [2024-11-20 01:19:49.745816] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.752 [2024-11-20 01:19:49.753812] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.752 [2024-11-20 01:19:49.753837] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.752 [2024-11-20 01:19:49.761836] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.752 [2024-11-20 01:19:49.761861] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.752 [2024-11-20 01:19:49.769857] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.752 [2024-11-20 01:19:49.769882] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.752 [2024-11-20 01:19:49.777879] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.752 [2024-11-20 01:19:49.777904] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.752 [2024-11-20 01:19:49.785906] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.752 [2024-11-20 01:19:49.785932] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.752 [2024-11-20 01:19:49.793929] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.752 [2024-11-20 01:19:49.793956] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.752 [2024-11-20 01:19:49.837283] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.752 [2024-11-20 01:19:49.837311] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.752 [2024-11-20 01:19:49.842087] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.752 [2024-11-20 01:19:49.842138] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.752 Running I/O for 5 seconds... 00:18:41.752 [2024-11-20 01:19:49.850122] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.752 [2024-11-20 01:19:49.850145] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.752 [2024-11-20 01:19:49.862780] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.752 [2024-11-20 01:19:49.862809] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.752 [2024-11-20 01:19:49.872525] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.752 [2024-11-20 01:19:49.872555] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.752 [2024-11-20 01:19:49.883636] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.752 [2024-11-20 01:19:49.883665] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.752 [2024-11-20 01:19:49.894353] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.752 [2024-11-20 01:19:49.894382] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.752 [2024-11-20 01:19:49.905504] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.752 [2024-11-20 01:19:49.905534] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.752 [2024-11-20 01:19:49.916206] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.752 [2024-11-20 01:19:49.916235] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.752 [2024-11-20 01:19:49.927105] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.752 [2024-11-20 01:19:49.927143] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.752 [2024-11-20 01:19:49.938228] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.752 [2024-11-20 01:19:49.938256] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.752 [2024-11-20 01:19:49.949497] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.752 [2024-11-20 01:19:49.949529] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.752 [2024-11-20 01:19:49.960439] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.752 [2024-11-20 01:19:49.960491] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.014 [2024-11-20 01:19:49.971119] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.014 [2024-11-20 01:19:49.971148] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.014 [2024-11-20 01:19:49.981900] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.014 [2024-11-20 01:19:49.981929] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.014 [2024-11-20 01:19:49.994788] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.014 [2024-11-20 01:19:49.994832] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.014 [2024-11-20 01:19:50.004706] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.014 [2024-11-20 01:19:50.004740] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.014 [2024-11-20 01:19:50.015535] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.014 [2024-11-20 01:19:50.015564] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.015 [2024-11-20 01:19:50.028278] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.015 [2024-11-20 01:19:50.028307] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.015 [2024-11-20 01:19:50.038849] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.015 [2024-11-20 01:19:50.038878] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.015 [2024-11-20 01:19:50.049800] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.015 [2024-11-20 01:19:50.049843] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.015 [2024-11-20 01:19:50.062533] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.015 [2024-11-20 01:19:50.062562] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.015 [2024-11-20 01:19:50.072950] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.015 [2024-11-20 01:19:50.072978] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.015 [2024-11-20 01:19:50.084201] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.015 [2024-11-20 01:19:50.084230] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.015 [2024-11-20 01:19:50.096898] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.015 [2024-11-20 01:19:50.096943] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.015 [2024-11-20 01:19:50.107085] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.015 [2024-11-20 01:19:50.107113] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.015 [2024-11-20 01:19:50.117919] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.015 [2024-11-20 01:19:50.117947] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.015 [2024-11-20 01:19:50.129153] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.015 [2024-11-20 01:19:50.129182] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.015 [2024-11-20 01:19:50.139555] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.015 [2024-11-20 01:19:50.139584] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.015 [2024-11-20 01:19:50.149809] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.015 [2024-11-20 01:19:50.149837] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.015 [2024-11-20 01:19:50.159998] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.015 [2024-11-20 01:19:50.160027] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.015 [2024-11-20 01:19:50.170773] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.015 [2024-11-20 01:19:50.170814] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.015 [2024-11-20 01:19:50.183544] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.015 [2024-11-20 01:19:50.183572] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.015 [2024-11-20 01:19:50.193640] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.015 [2024-11-20 01:19:50.193668] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.015 [2024-11-20 01:19:50.204415] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.015 [2024-11-20 01:19:50.204444] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.015 [2024-11-20 01:19:50.216986] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.015 [2024-11-20 01:19:50.217014] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.015 [2024-11-20 01:19:50.226818] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.015 [2024-11-20 01:19:50.226846] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.277 [2024-11-20 01:19:50.237739] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.277 [2024-11-20 01:19:50.237769] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.277 [2024-11-20 01:19:50.250096] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.277 [2024-11-20 01:19:50.250125] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.277 [2024-11-20 01:19:50.259673] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.277 [2024-11-20 01:19:50.259701] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.277 [2024-11-20 01:19:50.270640] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.277 [2024-11-20 01:19:50.270669] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.277 [2024-11-20 01:19:50.283686] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.277 [2024-11-20 01:19:50.283715] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.277 [2024-11-20 01:19:50.293927] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.277 [2024-11-20 01:19:50.293955] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.277 [2024-11-20 01:19:50.304567] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.277 [2024-11-20 01:19:50.304595] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.277 [2024-11-20 01:19:50.317390] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.277 [2024-11-20 01:19:50.317419] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.277 [2024-11-20 01:19:50.327284] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.277 [2024-11-20 01:19:50.327313] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.277 [2024-11-20 01:19:50.338541] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.277 [2024-11-20 01:19:50.338570] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.277 [2024-11-20 01:19:50.350560] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.277 [2024-11-20 01:19:50.350588] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.277 [2024-11-20 01:19:50.360032] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.277 [2024-11-20 01:19:50.360061] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.277 [2024-11-20 01:19:50.372888] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.277 [2024-11-20 01:19:50.372917] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.277 [2024-11-20 01:19:50.383164] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.277 [2024-11-20 01:19:50.383204] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.277 [2024-11-20 01:19:50.393569] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.277 [2024-11-20 01:19:50.393597] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.277 [2024-11-20 01:19:50.405855] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.278 [2024-11-20 01:19:50.405883] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.278 [2024-11-20 01:19:50.415875] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.278 [2024-11-20 01:19:50.415903] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.278 [2024-11-20 01:19:50.426184] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.278 [2024-11-20 01:19:50.426212] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.278 [2024-11-20 01:19:50.436799] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.278 [2024-11-20 01:19:50.436828] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.278 [2024-11-20 01:19:50.447217] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.278 [2024-11-20 01:19:50.447245] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.278 [2024-11-20 01:19:50.457427] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.278 [2024-11-20 01:19:50.457456] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.278 [2024-11-20 01:19:50.468120] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.278 [2024-11-20 01:19:50.468164] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.278 [2024-11-20 01:19:50.480598] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.278 [2024-11-20 01:19:50.480628] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.278 [2024-11-20 01:19:50.490214] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.278 [2024-11-20 01:19:50.490242] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.539 [2024-11-20 01:19:50.501414] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.539 [2024-11-20 01:19:50.501446] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.539 [2024-11-20 01:19:50.512108] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.539 [2024-11-20 01:19:50.512139] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.539 [2024-11-20 01:19:50.523491] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.539 [2024-11-20 01:19:50.523523] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.539 [2024-11-20 01:19:50.534453] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.539 [2024-11-20 01:19:50.534485] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.539 [2024-11-20 01:19:50.545559] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.539 [2024-11-20 01:19:50.545591] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.539 [2024-11-20 01:19:50.558561] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.539 [2024-11-20 01:19:50.558592] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.539 [2024-11-20 01:19:50.568963] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.539 [2024-11-20 01:19:50.568994] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.539 [2024-11-20 01:19:50.580039] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.539 [2024-11-20 01:19:50.580079] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.539 [2024-11-20 01:19:50.593241] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.539 [2024-11-20 01:19:50.593273] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.539 [2024-11-20 01:19:50.603867] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.539 [2024-11-20 01:19:50.603899] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.539 [2024-11-20 01:19:50.615169] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.539 [2024-11-20 01:19:50.615200] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.539 [2024-11-20 01:19:50.627893] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.539 [2024-11-20 01:19:50.627925] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.539 [2024-11-20 01:19:50.638638] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.539 [2024-11-20 01:19:50.638669] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.539 [2024-11-20 01:19:50.650000] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.539 [2024-11-20 01:19:50.650031] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.539 [2024-11-20 01:19:50.661203] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.539 [2024-11-20 01:19:50.661234] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.539 [2024-11-20 01:19:50.672777] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.539 [2024-11-20 01:19:50.672808] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.539 [2024-11-20 01:19:50.683970] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.539 [2024-11-20 01:19:50.684001] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.539 [2024-11-20 01:19:50.695115] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.539 [2024-11-20 01:19:50.695148] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.539 [2024-11-20 01:19:50.706551] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.539 [2024-11-20 01:19:50.706582] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.539 [2024-11-20 01:19:50.717890] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.539 [2024-11-20 01:19:50.717922] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.539 [2024-11-20 01:19:50.730571] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.539 [2024-11-20 01:19:50.730603] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.539 [2024-11-20 01:19:50.741174] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.539 [2024-11-20 01:19:50.741206] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.539 [2024-11-20 01:19:50.752181] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.539 [2024-11-20 01:19:50.752212] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.831 [2024-11-20 01:19:50.765293] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.831 [2024-11-20 01:19:50.765339] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.831 [2024-11-20 01:19:50.776404] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.831 [2024-11-20 01:19:50.776435] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.831 [2024-11-20 01:19:50.787749] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.831 [2024-11-20 01:19:50.787781] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.831 [2024-11-20 01:19:50.799009] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.831 [2024-11-20 01:19:50.799040] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.831 [2024-11-20 01:19:50.810306] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.831 [2024-11-20 01:19:50.810337] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.831 [2024-11-20 01:19:50.821506] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.831 [2024-11-20 01:19:50.821538] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.831 [2024-11-20 01:19:50.831692] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.831 [2024-11-20 01:19:50.831720] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.831 [2024-11-20 01:19:50.841866] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.831 [2024-11-20 01:19:50.841894] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.831 [2024-11-20 01:19:50.851996] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.831 [2024-11-20 01:19:50.852024] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.831 [2024-11-20 01:19:50.862106] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.831 [2024-11-20 01:19:50.862135] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.831 [2024-11-20 01:19:50.872590] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.831 [2024-11-20 01:19:50.872618] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.831 [2024-11-20 01:19:50.885194] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.831 [2024-11-20 01:19:50.885222] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.831 [2024-11-20 01:19:50.893892] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.831 [2024-11-20 01:19:50.893920] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.831 [2024-11-20 01:19:50.906541] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.831 [2024-11-20 01:19:50.906570] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.831 [2024-11-20 01:19:50.918106] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.831 [2024-11-20 01:19:50.918134] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.831 [2024-11-20 01:19:50.927020] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.831 [2024-11-20 01:19:50.927047] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.831 [2024-11-20 01:19:50.937960] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.831 [2024-11-20 01:19:50.937988] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.831 [2024-11-20 01:19:50.951403] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.831 [2024-11-20 01:19:50.951431] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.831 [2024-11-20 01:19:50.961240] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.831 [2024-11-20 01:19:50.961268] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.831 [2024-11-20 01:19:50.970857] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.831 [2024-11-20 01:19:50.970885] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.831 [2024-11-20 01:19:50.981205] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.831 [2024-11-20 01:19:50.981233] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.831 [2024-11-20 01:19:50.993703] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.831 [2024-11-20 01:19:50.993731] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.831 [2024-11-20 01:19:51.003420] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.831 [2024-11-20 01:19:51.003450] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.831 [2024-11-20 01:19:51.014142] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.831 [2024-11-20 01:19:51.014171] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.831 [2024-11-20 01:19:51.024111] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.831 [2024-11-20 01:19:51.024139] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.139 [2024-11-20 01:19:51.034493] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.139 [2024-11-20 01:19:51.034521] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.139 [2024-11-20 01:19:51.047053] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.139 [2024-11-20 01:19:51.047102] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.139 [2024-11-20 01:19:51.056203] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.139 [2024-11-20 01:19:51.056232] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.139 [2024-11-20 01:19:51.068654] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.139 [2024-11-20 01:19:51.068682] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.139 [2024-11-20 01:19:51.078194] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.139 [2024-11-20 01:19:51.078222] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.139 [2024-11-20 01:19:51.087964] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.139 [2024-11-20 01:19:51.087993] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.139 [2024-11-20 01:19:51.097999] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.139 [2024-11-20 01:19:51.098027] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.139 [2024-11-20 01:19:51.108548] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.139 [2024-11-20 01:19:51.108576] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.139 [2024-11-20 01:19:51.121342] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.139 [2024-11-20 01:19:51.121371] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.139 [2024-11-20 01:19:51.131644] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.139 [2024-11-20 01:19:51.131673] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.139 [2024-11-20 01:19:51.141778] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.139 [2024-11-20 01:19:51.141807] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.139 [2024-11-20 01:19:51.151998] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.139 [2024-11-20 01:19:51.152026] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.139 [2024-11-20 01:19:51.162718] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.139 [2024-11-20 01:19:51.162746] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.139 [2024-11-20 01:19:51.173329] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.139 [2024-11-20 01:19:51.173358] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.139 [2024-11-20 01:19:51.185461] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.139 [2024-11-20 01:19:51.185490] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.139 [2024-11-20 01:19:51.194234] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.139 [2024-11-20 01:19:51.194263] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.139 [2024-11-20 01:19:51.206647] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.139 [2024-11-20 01:19:51.206675] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.139 [2024-11-20 01:19:51.216836] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.139 [2024-11-20 01:19:51.216864] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.139 [2024-11-20 01:19:51.227258] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.139 [2024-11-20 01:19:51.227287] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.139 [2024-11-20 01:19:51.237515] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.139 [2024-11-20 01:19:51.237545] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.139 [2024-11-20 01:19:51.248000] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.139 [2024-11-20 01:19:51.248029] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.139 [2024-11-20 01:19:51.260560] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.139 [2024-11-20 01:19:51.260589] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.139 [2024-11-20 01:19:51.269865] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.139 [2024-11-20 01:19:51.269893] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.139 [2024-11-20 01:19:51.280268] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.139 [2024-11-20 01:19:51.280296] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.139 [2024-11-20 01:19:51.290139] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.139 [2024-11-20 01:19:51.290167] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.139 [2024-11-20 01:19:51.300443] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.139 [2024-11-20 01:19:51.300473] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.139 [2024-11-20 01:19:51.310194] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.139 [2024-11-20 01:19:51.310222] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.139 [2024-11-20 01:19:51.319940] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.139 [2024-11-20 01:19:51.319968] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.139 [2024-11-20 01:19:51.330306] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.139 [2024-11-20 01:19:51.330334] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.400 [2024-11-20 01:19:51.343151] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.400 [2024-11-20 01:19:51.343180] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.400 [2024-11-20 01:19:51.355241] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.400 [2024-11-20 01:19:51.355270] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.400 [2024-11-20 01:19:51.363777] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.400 [2024-11-20 01:19:51.363805] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.400 [2024-11-20 01:19:51.377232] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.400 [2024-11-20 01:19:51.377261] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.400 [2024-11-20 01:19:51.387302] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.400 [2024-11-20 01:19:51.387339] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.400 [2024-11-20 01:19:51.397666] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.400 [2024-11-20 01:19:51.397694] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.400 [2024-11-20 01:19:51.408834] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.400 [2024-11-20 01:19:51.408892] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.400 [2024-11-20 01:19:51.421565] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.400 [2024-11-20 01:19:51.421593] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.400 [2024-11-20 01:19:51.433553] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.401 [2024-11-20 01:19:51.433584] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.401 [2024-11-20 01:19:51.442774] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.401 [2024-11-20 01:19:51.442802] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.401 [2024-11-20 01:19:51.454293] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.401 [2024-11-20 01:19:51.454321] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.401 [2024-11-20 01:19:51.467045] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.401 [2024-11-20 01:19:51.467083] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.401 [2024-11-20 01:19:51.477218] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.401 [2024-11-20 01:19:51.477246] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.401 [2024-11-20 01:19:51.488050] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.401 [2024-11-20 01:19:51.488086] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.401 [2024-11-20 01:19:51.500521] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.401 [2024-11-20 01:19:51.500549] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.401 [2024-11-20 01:19:51.510344] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.401 [2024-11-20 01:19:51.510373] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.401 [2024-11-20 01:19:51.521014] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.401 [2024-11-20 01:19:51.521043] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.401 [2024-11-20 01:19:51.531751] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.401 [2024-11-20 01:19:51.531780] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.401 [2024-11-20 01:19:51.544425] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.401 [2024-11-20 01:19:51.544458] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.401 [2024-11-20 01:19:51.554671] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.401 [2024-11-20 01:19:51.554699] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.401 [2024-11-20 01:19:51.565158] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.401 [2024-11-20 01:19:51.565188] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.401 [2024-11-20 01:19:51.575837] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.401 [2024-11-20 01:19:51.575866] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.401 [2024-11-20 01:19:51.586501] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.401 [2024-11-20 01:19:51.586530] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.401 [2024-11-20 01:19:51.596757] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.401 [2024-11-20 01:19:51.596786] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.401 [2024-11-20 01:19:51.607015] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.401 [2024-11-20 01:19:51.607042] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.659 [2024-11-20 01:19:51.617541] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.659 [2024-11-20 01:19:51.617580] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.659 [2024-11-20 01:19:51.628013] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.659 [2024-11-20 01:19:51.628041] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.659 [2024-11-20 01:19:51.638443] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.659 [2024-11-20 01:19:51.638471] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.659 [2024-11-20 01:19:51.648503] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.659 [2024-11-20 01:19:51.648531] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.659 [2024-11-20 01:19:51.659014] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.659 [2024-11-20 01:19:51.659042] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.659 [2024-11-20 01:19:51.669854] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.659 [2024-11-20 01:19:51.669884] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.659 [2024-11-20 01:19:51.680183] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.659 [2024-11-20 01:19:51.680212] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.659 [2024-11-20 01:19:51.690357] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.659 [2024-11-20 01:19:51.690386] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.659 [2024-11-20 01:19:51.701130] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.659 [2024-11-20 01:19:51.701159] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.659 [2024-11-20 01:19:51.711415] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.659 [2024-11-20 01:19:51.711442] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.659 [2024-11-20 01:19:51.722157] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.659 [2024-11-20 01:19:51.722185] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.659 [2024-11-20 01:19:51.732604] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.659 [2024-11-20 01:19:51.732632] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.659 [2024-11-20 01:19:51.742984] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.659 [2024-11-20 01:19:51.743013] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.659 [2024-11-20 01:19:51.753460] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.659 [2024-11-20 01:19:51.753488] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.659 [2024-11-20 01:19:51.763678] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.659 [2024-11-20 01:19:51.763708] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.660 [2024-11-20 01:19:51.773919] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.660 [2024-11-20 01:19:51.773948] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.660 [2024-11-20 01:19:51.784462] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.660 [2024-11-20 01:19:51.784491] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.660 [2024-11-20 01:19:51.794822] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.660 [2024-11-20 01:19:51.794851] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.660 [2024-11-20 01:19:51.805260] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.660 [2024-11-20 01:19:51.805288] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.660 [2024-11-20 01:19:51.815887] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.660 [2024-11-20 01:19:51.815925] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.660 [2024-11-20 01:19:51.827112] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.660 [2024-11-20 01:19:51.827141] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.660 [2024-11-20 01:19:51.838238] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.660 [2024-11-20 01:19:51.838267] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.660 [2024-11-20 01:19:51.848921] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.660 [2024-11-20 01:19:51.848950] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.660 [2024-11-20 01:19:51.859573] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.660 [2024-11-20 01:19:51.859602] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.660 [2024-11-20 01:19:51.872353] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.660 [2024-11-20 01:19:51.872382] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.918 [2024-11-20 01:19:51.882652] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.918 [2024-11-20 01:19:51.882680] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.918 [2024-11-20 01:19:51.893014] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.918 [2024-11-20 01:19:51.893043] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.918 [2024-11-20 01:19:51.903806] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.918 [2024-11-20 01:19:51.903835] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.918 [2024-11-20 01:19:51.914397] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.918 [2024-11-20 01:19:51.914425] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.918 [2024-11-20 01:19:51.924638] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.918 [2024-11-20 01:19:51.924684] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.918 [2024-11-20 01:19:51.935481] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.918 [2024-11-20 01:19:51.935509] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.918 [2024-11-20 01:19:51.947728] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.918 [2024-11-20 01:19:51.947757] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.918 [2024-11-20 01:19:51.957055] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.918 [2024-11-20 01:19:51.957095] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.918 [2024-11-20 01:19:51.968107] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.918 [2024-11-20 01:19:51.968136] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.918 [2024-11-20 01:19:51.978448] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.918 [2024-11-20 01:19:51.978476] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.918 [2024-11-20 01:19:51.988835] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.918 [2024-11-20 01:19:51.988864] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.918 [2024-11-20 01:19:51.999309] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.918 [2024-11-20 01:19:51.999337] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.918 [2024-11-20 01:19:52.010081] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.918 [2024-11-20 01:19:52.010110] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.918 [2024-11-20 01:19:52.020618] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.918 [2024-11-20 01:19:52.020657] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.918 [2024-11-20 01:19:52.032911] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.918 [2024-11-20 01:19:52.032940] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.918 [2024-11-20 01:19:52.042601] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.918 [2024-11-20 01:19:52.042629] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.918 [2024-11-20 01:19:52.053537] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.918 [2024-11-20 01:19:52.053566] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.918 [2024-11-20 01:19:52.064292] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.918 [2024-11-20 01:19:52.064321] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.918 [2024-11-20 01:19:52.075499] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.918 [2024-11-20 01:19:52.075528] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.918 [2024-11-20 01:19:52.086340] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.918 [2024-11-20 01:19:52.086368] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.918 [2024-11-20 01:19:52.097092] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.918 [2024-11-20 01:19:52.097121] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.918 [2024-11-20 01:19:52.109452] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.918 [2024-11-20 01:19:52.109480] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.918 [2024-11-20 01:19:52.120913] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.918 [2024-11-20 01:19:52.120942] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.918 [2024-11-20 01:19:52.130231] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.918 [2024-11-20 01:19:52.130259] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.177 [2024-11-20 01:19:52.141255] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.177 [2024-11-20 01:19:52.141284] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.177 [2024-11-20 01:19:52.153785] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.177 [2024-11-20 01:19:52.153813] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.177 [2024-11-20 01:19:52.163323] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.177 [2024-11-20 01:19:52.163351] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.177 [2024-11-20 01:19:52.175873] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.177 [2024-11-20 01:19:52.175902] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.177 [2024-11-20 01:19:52.187723] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.177 [2024-11-20 01:19:52.187752] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.177 [2024-11-20 01:19:52.197161] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.177 [2024-11-20 01:19:52.197189] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.177 [2024-11-20 01:19:52.208347] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.177 [2024-11-20 01:19:52.208375] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.177 [2024-11-20 01:19:52.220837] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.177 [2024-11-20 01:19:52.220865] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.177 [2024-11-20 01:19:52.230269] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.177 [2024-11-20 01:19:52.230297] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.177 [2024-11-20 01:19:52.241568] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.177 [2024-11-20 01:19:52.241596] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.177 [2024-11-20 01:19:52.252030] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.177 [2024-11-20 01:19:52.252058] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.177 [2024-11-20 01:19:52.262663] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.177 [2024-11-20 01:19:52.262692] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.177 [2024-11-20 01:19:52.275634] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.177 [2024-11-20 01:19:52.275662] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.177 [2024-11-20 01:19:52.285850] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.177 [2024-11-20 01:19:52.285878] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.177 [2024-11-20 01:19:52.296666] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.177 [2024-11-20 01:19:52.296695] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.177 [2024-11-20 01:19:52.309515] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.177 [2024-11-20 01:19:52.309545] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.177 [2024-11-20 01:19:52.318814] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.177 [2024-11-20 01:19:52.318842] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.177 [2024-11-20 01:19:52.330012] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.177 [2024-11-20 01:19:52.330040] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.177 [2024-11-20 01:19:52.340221] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.177 [2024-11-20 01:19:52.340250] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.177 [2024-11-20 01:19:52.350999] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.177 [2024-11-20 01:19:52.351027] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.177 [2024-11-20 01:19:52.361968] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.177 [2024-11-20 01:19:52.361996] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.177 [2024-11-20 01:19:52.374446] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.177 [2024-11-20 01:19:52.374475] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.177 [2024-11-20 01:19:52.386457] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.177 [2024-11-20 01:19:52.386504] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.436 [2024-11-20 01:19:52.395347] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.436 [2024-11-20 01:19:52.395376] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.436 [2024-11-20 01:19:52.406619] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.436 [2024-11-20 01:19:52.406648] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.436 [2024-11-20 01:19:52.419029] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.436 [2024-11-20 01:19:52.419057] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.436 [2024-11-20 01:19:52.428001] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.436 [2024-11-20 01:19:52.428030] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.436 [2024-11-20 01:19:52.441721] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.436 [2024-11-20 01:19:52.441749] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.436 [2024-11-20 01:19:52.451745] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.436 [2024-11-20 01:19:52.451773] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.436 [2024-11-20 01:19:52.462226] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.436 [2024-11-20 01:19:52.462254] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.436 [2024-11-20 01:19:52.472886] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.436 [2024-11-20 01:19:52.472914] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.436 [2024-11-20 01:19:52.483552] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.436 [2024-11-20 01:19:52.483580] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.436 [2024-11-20 01:19:52.494022] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.436 [2024-11-20 01:19:52.494051] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.436 [2024-11-20 01:19:52.506648] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.436 [2024-11-20 01:19:52.506676] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.436 [2024-11-20 01:19:52.516355] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.436 [2024-11-20 01:19:52.516383] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.436 [2024-11-20 01:19:52.526544] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.436 [2024-11-20 01:19:52.526572] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.436 [2024-11-20 01:19:52.536829] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.436 [2024-11-20 01:19:52.536857] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.436 [2024-11-20 01:19:52.547411] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.436 [2024-11-20 01:19:52.547439] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.436 [2024-11-20 01:19:52.557878] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.436 [2024-11-20 01:19:52.557906] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.436 [2024-11-20 01:19:52.570064] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.436 [2024-11-20 01:19:52.570101] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.436 [2024-11-20 01:19:52.581624] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.436 [2024-11-20 01:19:52.581652] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.436 [2024-11-20 01:19:52.590409] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.436 [2024-11-20 01:19:52.590436] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.436 [2024-11-20 01:19:52.601268] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.436 [2024-11-20 01:19:52.601297] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.436 [2024-11-20 01:19:52.611766] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.436 [2024-11-20 01:19:52.611808] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.436 [2024-11-20 01:19:52.621960] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.436 [2024-11-20 01:19:52.621987] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.436 [2024-11-20 01:19:52.632358] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.436 [2024-11-20 01:19:52.632403] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.436 [2024-11-20 01:19:52.642904] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.436 [2024-11-20 01:19:52.642932] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.694 [2024-11-20 01:19:52.653657] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.694 [2024-11-20 01:19:52.653685] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.694 [2024-11-20 01:19:52.664469] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.694 [2024-11-20 01:19:52.664497] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.694 [2024-11-20 01:19:52.676991] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.694 [2024-11-20 01:19:52.677019] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.694 [2024-11-20 01:19:52.686523] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.694 [2024-11-20 01:19:52.686551] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.694 [2024-11-20 01:19:52.697836] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.694 [2024-11-20 01:19:52.697863] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.694 [2024-11-20 01:19:52.708554] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.694 [2024-11-20 01:19:52.708582] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.694 [2024-11-20 01:19:52.719130] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.694 [2024-11-20 01:19:52.719158] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.694 [2024-11-20 01:19:52.729809] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.694 [2024-11-20 01:19:52.729840] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.694 [2024-11-20 01:19:52.741077] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.694 [2024-11-20 01:19:52.741108] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.694 [2024-11-20 01:19:52.753948] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.694 [2024-11-20 01:19:52.753979] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.694 [2024-11-20 01:19:52.764203] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.694 [2024-11-20 01:19:52.764234] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.694 [2024-11-20 01:19:52.776089] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.694 [2024-11-20 01:19:52.776120] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.694 [2024-11-20 01:19:52.786971] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.694 [2024-11-20 01:19:52.787002] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.694 [2024-11-20 01:19:52.799744] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.695 [2024-11-20 01:19:52.799775] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.695 [2024-11-20 01:19:52.809877] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.695 [2024-11-20 01:19:52.809909] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.695 [2024-11-20 01:19:52.820909] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.695 [2024-11-20 01:19:52.820939] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.695 [2024-11-20 01:19:52.834034] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.695 [2024-11-20 01:19:52.834066] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.695 [2024-11-20 01:19:52.844007] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.695 [2024-11-20 01:19:52.844038] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.695 [2024-11-20 01:19:52.855679] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.695 [2024-11-20 01:19:52.855710] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.695 [2024-11-20 01:19:52.867108] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.695 [2024-11-20 01:19:52.867139] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.695 [2024-11-20 01:19:52.877904] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.695 [2024-11-20 01:19:52.877935] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.695 [2024-11-20 01:19:52.890890] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.695 [2024-11-20 01:19:52.890922] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.695 [2024-11-20 01:19:52.900874] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.695 [2024-11-20 01:19:52.900905] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.953 [2024-11-20 01:19:52.911890] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.953 [2024-11-20 01:19:52.911922] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.953 [2024-11-20 01:19:52.922975] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.953 [2024-11-20 01:19:52.923007] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.953 [2024-11-20 01:19:52.933833] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.953 [2024-11-20 01:19:52.933864] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.953 [2024-11-20 01:19:52.946389] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.953 [2024-11-20 01:19:52.946420] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.953 [2024-11-20 01:19:52.956958] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.953 [2024-11-20 01:19:52.956989] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.953 [2024-11-20 01:19:52.968438] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.953 [2024-11-20 01:19:52.968470] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.953 [2024-11-20 01:19:52.979774] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.953 [2024-11-20 01:19:52.979805] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.953 [2024-11-20 01:19:52.992967] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.953 [2024-11-20 01:19:52.992999] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.953 [2024-11-20 01:19:53.003495] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.953 [2024-11-20 01:19:53.003526] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.953 [2024-11-20 01:19:53.014540] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.953 [2024-11-20 01:19:53.014571] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.953 [2024-11-20 01:19:53.027430] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.953 [2024-11-20 01:19:53.027462] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.953 [2024-11-20 01:19:53.038106] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.953 [2024-11-20 01:19:53.038141] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.953 [2024-11-20 01:19:53.049216] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.953 [2024-11-20 01:19:53.049246] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.953 [2024-11-20 01:19:53.062128] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.953 [2024-11-20 01:19:53.062169] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.953 [2024-11-20 01:19:53.072379] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.953 [2024-11-20 01:19:53.072410] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.953 [2024-11-20 01:19:53.084123] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.953 [2024-11-20 01:19:53.084154] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.953 [2024-11-20 01:19:53.095231] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.953 [2024-11-20 01:19:53.095263] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.953 [2024-11-20 01:19:53.106424] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.953 [2024-11-20 01:19:53.106455] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.953 [2024-11-20 01:19:53.117562] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.953 [2024-11-20 01:19:53.117593] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.953 [2024-11-20 01:19:53.128943] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.953 [2024-11-20 01:19:53.128974] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.953 [2024-11-20 01:19:53.140142] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.953 [2024-11-20 01:19:53.140173] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.954 [2024-11-20 01:19:53.150959] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.954 [2024-11-20 01:19:53.150990] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.954 [2024-11-20 01:19:53.162055] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.954 [2024-11-20 01:19:53.162095] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.212 [2024-11-20 01:19:53.175506] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.212 [2024-11-20 01:19:53.175538] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.212 [2024-11-20 01:19:53.186091] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.212 [2024-11-20 01:19:53.186121] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.212 [2024-11-20 01:19:53.197139] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.212 [2024-11-20 01:19:53.197171] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.212 [2024-11-20 01:19:53.210119] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.212 [2024-11-20 01:19:53.210160] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.212 [2024-11-20 01:19:53.220802] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.212 [2024-11-20 01:19:53.220833] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.212 [2024-11-20 01:19:53.231896] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.212 [2024-11-20 01:19:53.231927] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.212 [2024-11-20 01:19:53.245013] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.212 [2024-11-20 01:19:53.245045] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.212 [2024-11-20 01:19:53.255765] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.212 [2024-11-20 01:19:53.255796] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.212 [2024-11-20 01:19:53.266307] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.212 [2024-11-20 01:19:53.266338] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.212 [2024-11-20 01:19:53.277827] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.212 [2024-11-20 01:19:53.277868] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.212 [2024-11-20 01:19:53.288624] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.212 [2024-11-20 01:19:53.288655] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.212 [2024-11-20 01:19:53.299297] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.212 [2024-11-20 01:19:53.299328] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.212 [2024-11-20 01:19:53.310399] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.212 [2024-11-20 01:19:53.310431] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.212 [2024-11-20 01:19:53.321748] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.212 [2024-11-20 01:19:53.321780] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.212 [2024-11-20 01:19:53.333368] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.212 [2024-11-20 01:19:53.333399] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.212 [2024-11-20 01:19:53.344704] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.212 [2024-11-20 01:19:53.344735] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.212 [2024-11-20 01:19:53.355980] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.212 [2024-11-20 01:19:53.356011] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.212 [2024-11-20 01:19:53.369241] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.212 [2024-11-20 01:19:53.369271] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.212 [2024-11-20 01:19:53.379594] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.212 [2024-11-20 01:19:53.379626] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.212 [2024-11-20 01:19:53.390348] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.212 [2024-11-20 01:19:53.390378] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.212 [2024-11-20 01:19:53.401397] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.212 [2024-11-20 01:19:53.401428] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.212 [2024-11-20 01:19:53.412593] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.212 [2024-11-20 01:19:53.412625] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.212 [2024-11-20 01:19:53.423860] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.212 [2024-11-20 01:19:53.423891] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.471 [2024-11-20 01:19:53.435251] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.471 [2024-11-20 01:19:53.435282] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.471 [2024-11-20 01:19:53.445720] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.471 [2024-11-20 01:19:53.445751] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.471 [2024-11-20 01:19:53.456885] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.471 [2024-11-20 01:19:53.456917] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.471 [2024-11-20 01:19:53.470268] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.471 [2024-11-20 01:19:53.470300] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.471 [2024-11-20 01:19:53.481202] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.471 [2024-11-20 01:19:53.481233] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.471 [2024-11-20 01:19:53.492333] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.471 [2024-11-20 01:19:53.492384] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.471 [2024-11-20 01:19:53.503373] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.471 [2024-11-20 01:19:53.503405] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.471 [2024-11-20 01:19:53.514653] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.471 [2024-11-20 01:19:53.514684] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.471 [2024-11-20 01:19:53.527966] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.471 [2024-11-20 01:19:53.527998] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.471 [2024-11-20 01:19:53.538754] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.471 [2024-11-20 01:19:53.538784] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.471 [2024-11-20 01:19:53.550454] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.471 [2024-11-20 01:19:53.550485] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.471 [2024-11-20 01:19:53.561331] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.471 [2024-11-20 01:19:53.561362] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.471 [2024-11-20 01:19:53.572140] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.471 [2024-11-20 01:19:53.572172] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.471 [2024-11-20 01:19:53.583338] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.471 [2024-11-20 01:19:53.583370] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.471 [2024-11-20 01:19:53.594690] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.471 [2024-11-20 01:19:53.594721] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.471 [2024-11-20 01:19:53.607993] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.471 [2024-11-20 01:19:53.608025] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.471 [2024-11-20 01:19:53.618338] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.471 [2024-11-20 01:19:53.618370] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.471 [2024-11-20 01:19:53.629265] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.471 [2024-11-20 01:19:53.629297] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.471 [2024-11-20 01:19:53.642066] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.471 [2024-11-20 01:19:53.642111] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.471 [2024-11-20 01:19:53.651927] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.471 [2024-11-20 01:19:53.651959] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.471 [2024-11-20 01:19:53.663511] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.471 [2024-11-20 01:19:53.663542] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.471 [2024-11-20 01:19:53.674716] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.471 [2024-11-20 01:19:53.674748] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.471 [2024-11-20 01:19:53.685507] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.471 [2024-11-20 01:19:53.685538] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.730 [2024-11-20 01:19:53.696552] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.730 [2024-11-20 01:19:53.696584] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.730 [2024-11-20 01:19:53.707710] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.730 [2024-11-20 01:19:53.707754] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.730 [2024-11-20 01:19:53.719089] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.730 [2024-11-20 01:19:53.719120] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.730 [2024-11-20 01:19:53.730161] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.730 [2024-11-20 01:19:53.730192] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.730 [2024-11-20 01:19:53.741645] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.730 [2024-11-20 01:19:53.741676] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.730 [2024-11-20 01:19:53.752482] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.730 [2024-11-20 01:19:53.752513] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.730 [2024-11-20 01:19:53.763759] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.730 [2024-11-20 01:19:53.763789] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.730 [2024-11-20 01:19:53.774675] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.730 [2024-11-20 01:19:53.774707] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.730 [2024-11-20 01:19:53.785902] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.730 [2024-11-20 01:19:53.785933] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.730 [2024-11-20 01:19:53.797034] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.730 [2024-11-20 01:19:53.797065] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.730 [2024-11-20 01:19:53.808330] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.730 [2024-11-20 01:19:53.808360] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.730 [2024-11-20 01:19:53.821643] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.730 [2024-11-20 01:19:53.821674] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.730 [2024-11-20 01:19:53.832344] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.730 [2024-11-20 01:19:53.832376] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.730 [2024-11-20 01:19:53.843572] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.730 [2024-11-20 01:19:53.843604] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.730 [2024-11-20 01:19:53.856822] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.730 [2024-11-20 01:19:53.856854] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.730 [2024-11-20 01:19:53.867646] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.730 [2024-11-20 01:19:53.867677] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.730 [2024-11-20 01:19:53.878814] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.730 [2024-11-20 01:19:53.878845] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.730 [2024-11-20 01:19:53.891695] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.730 [2024-11-20 01:19:53.891727] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.730 [2024-11-20 01:19:53.902227] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.730 [2024-11-20 01:19:53.902258] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.730 [2024-11-20 01:19:53.913355] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.730 [2024-11-20 01:19:53.913386] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.730 [2024-11-20 01:19:53.926546] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.730 [2024-11-20 01:19:53.926578] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.730 [2024-11-20 01:19:53.936684] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.730 [2024-11-20 01:19:53.936715] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.989 [2024-11-20 01:19:53.947925] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.989 [2024-11-20 01:19:53.947956] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.989 [2024-11-20 01:19:53.961697] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.989 [2024-11-20 01:19:53.961729] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.989 [2024-11-20 01:19:53.972350] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.989 [2024-11-20 01:19:53.972382] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.989 [2024-11-20 01:19:53.983698] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.989 [2024-11-20 01:19:53.983730] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.989 [2024-11-20 01:19:53.994421] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.989 [2024-11-20 01:19:53.994452] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.989 [2024-11-20 01:19:54.005724] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.989 [2024-11-20 01:19:54.005755] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.989 [2024-11-20 01:19:54.018520] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.989 [2024-11-20 01:19:54.018552] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.989 [2024-11-20 01:19:54.028789] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.989 [2024-11-20 01:19:54.028820] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.989 [2024-11-20 01:19:54.039695] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.989 [2024-11-20 01:19:54.039728] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.989 [2024-11-20 01:19:54.052782] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.989 [2024-11-20 01:19:54.052813] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.989 [2024-11-20 01:19:54.063296] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.989 [2024-11-20 01:19:54.063327] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.989 [2024-11-20 01:19:54.074496] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.989 [2024-11-20 01:19:54.074527] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.989 [2024-11-20 01:19:54.087982] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.989 [2024-11-20 01:19:54.088015] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.989 [2024-11-20 01:19:54.098749] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.989 [2024-11-20 01:19:54.098780] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.989 [2024-11-20 01:19:54.109974] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.989 [2024-11-20 01:19:54.110005] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.989 [2024-11-20 01:19:54.120991] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.989 [2024-11-20 01:19:54.121022] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.989 [2024-11-20 01:19:54.131787] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.989 [2024-11-20 01:19:54.131818] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.989 [2024-11-20 01:19:54.142764] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.989 [2024-11-20 01:19:54.142795] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.989 [2024-11-20 01:19:54.153693] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.989 [2024-11-20 01:19:54.153725] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.989 [2024-11-20 01:19:54.164391] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.989 [2024-11-20 01:19:54.164422] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.989 [2024-11-20 01:19:54.174807] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.989 [2024-11-20 01:19:54.174838] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.989 [2024-11-20 01:19:54.185858] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.989 [2024-11-20 01:19:54.185889] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.989 [2024-11-20 01:19:54.198783] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.989 [2024-11-20 01:19:54.198814] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.247 [2024-11-20 01:19:54.208703] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.247 [2024-11-20 01:19:54.208741] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.247 [2024-11-20 01:19:54.219593] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.247 [2024-11-20 01:19:54.219625] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.247 [2024-11-20 01:19:54.232814] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.248 [2024-11-20 01:19:54.232845] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.248 [2024-11-20 01:19:54.243327] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.248 [2024-11-20 01:19:54.243362] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.248 [2024-11-20 01:19:54.254755] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.248 [2024-11-20 01:19:54.254786] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.248 [2024-11-20 01:19:54.265780] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.248 [2024-11-20 01:19:54.265811] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.248 [2024-11-20 01:19:54.277244] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.248 [2024-11-20 01:19:54.277275] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.248 [2024-11-20 01:19:54.290253] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.248 [2024-11-20 01:19:54.290284] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.248 [2024-11-20 01:19:54.300707] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.248 [2024-11-20 01:19:54.300738] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.248 [2024-11-20 01:19:54.311324] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.248 [2024-11-20 01:19:54.311364] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.248 [2024-11-20 01:19:54.322465] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.248 [2024-11-20 01:19:54.322495] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.248 [2024-11-20 01:19:54.333692] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.248 [2024-11-20 01:19:54.333724] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.248 [2024-11-20 01:19:54.347054] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.248 [2024-11-20 01:19:54.347095] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.248 [2024-11-20 01:19:54.357825] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.248 [2024-11-20 01:19:54.357855] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.248 [2024-11-20 01:19:54.369163] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.248 [2024-11-20 01:19:54.369195] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.248 [2024-11-20 01:19:54.382104] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.248 [2024-11-20 01:19:54.382135] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.248 [2024-11-20 01:19:54.392323] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.248 [2024-11-20 01:19:54.392353] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.248 [2024-11-20 01:19:54.403530] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.248 [2024-11-20 01:19:54.403561] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.248 [2024-11-20 01:19:54.416571] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.248 [2024-11-20 01:19:54.416602] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.248 [2024-11-20 01:19:54.426830] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.248 [2024-11-20 01:19:54.426860] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.248 [2024-11-20 01:19:54.437864] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.248 [2024-11-20 01:19:54.437895] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.248 [2024-11-20 01:19:54.448988] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.248 [2024-11-20 01:19:54.449018] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.248 [2024-11-20 01:19:54.460064] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.248 [2024-11-20 01:19:54.460106] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.506 [2024-11-20 01:19:54.473290] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.506 [2024-11-20 01:19:54.473322] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.506 [2024-11-20 01:19:54.484286] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.506 [2024-11-20 01:19:54.484317] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.506 [2024-11-20 01:19:54.495704] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.506 [2024-11-20 01:19:54.495736] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.506 [2024-11-20 01:19:54.507001] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.506 [2024-11-20 01:19:54.507032] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.506 [2024-11-20 01:19:54.518484] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.506 [2024-11-20 01:19:54.518515] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.506 [2024-11-20 01:19:54.529910] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.506 [2024-11-20 01:19:54.529941] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.506 [2024-11-20 01:19:54.541188] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.506 [2024-11-20 01:19:54.541219] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.506 [2024-11-20 01:19:54.554250] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.506 [2024-11-20 01:19:54.554282] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.506 [2024-11-20 01:19:54.564903] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.506 [2024-11-20 01:19:54.564934] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.506 [2024-11-20 01:19:54.576221] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.506 [2024-11-20 01:19:54.576252] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.506 [2024-11-20 01:19:54.589487] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.506 [2024-11-20 01:19:54.589520] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.506 [2024-11-20 01:19:54.600117] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.506 [2024-11-20 01:19:54.600147] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.506 [2024-11-20 01:19:54.611018] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.506 [2024-11-20 01:19:54.611049] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.506 [2024-11-20 01:19:54.623717] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.507 [2024-11-20 01:19:54.623748] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.507 [2024-11-20 01:19:54.633598] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.507 [2024-11-20 01:19:54.633630] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.507 [2024-11-20 01:19:54.653935] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.507 [2024-11-20 01:19:54.653969] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.507 [2024-11-20 01:19:54.664631] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.507 [2024-11-20 01:19:54.664663] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.507 [2024-11-20 01:19:54.675437] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.507 [2024-11-20 01:19:54.675468] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.507 [2024-11-20 01:19:54.689047] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.507 [2024-11-20 01:19:54.689091] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.507 [2024-11-20 01:19:54.699711] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.507 [2024-11-20 01:19:54.699742] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.507 [2024-11-20 01:19:54.711022] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.507 [2024-11-20 01:19:54.711053] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.507 [2024-11-20 01:19:54.722270] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.507 [2024-11-20 01:19:54.722301] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.765 [2024-11-20 01:19:54.733031] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.765 [2024-11-20 01:19:54.733063] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.765 [2024-11-20 01:19:54.744036] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.765 [2024-11-20 01:19:54.744076] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.765 [2024-11-20 01:19:54.755394] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.765 [2024-11-20 01:19:54.755424] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.765 [2024-11-20 01:19:54.766615] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.765 [2024-11-20 01:19:54.766646] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.765 [2024-11-20 01:19:54.778032] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.765 [2024-11-20 01:19:54.778063] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.765 [2024-11-20 01:19:54.789579] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.765 [2024-11-20 01:19:54.789623] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.765 [2024-11-20 01:19:54.800584] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.765 [2024-11-20 01:19:54.800615] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.765 [2024-11-20 01:19:54.812160] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.765 [2024-11-20 01:19:54.812192] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.765 [2024-11-20 01:19:54.823152] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.765 [2024-11-20 01:19:54.823183] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.766 [2024-11-20 01:19:54.834531] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.766 [2024-11-20 01:19:54.834562] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.766 [2024-11-20 01:19:54.845675] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.766 [2024-11-20 01:19:54.845707] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.766 [2024-11-20 01:19:54.856767] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.766 [2024-11-20 01:19:54.856799] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.766 [2024-11-20 01:19:54.867323] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.766 [2024-11-20 01:19:54.867354] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.766 00:18:46.766 Latency(us) 00:18:46.766 [2024-11-20T00:19:54.985Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:46.766 [2024-11-20T00:19:54.985Z] Job: Nvme1n1 (Core Mask 0x1, workload: randrw, percentage: 50, depth: 128, IO size: 8192) 00:18:46.766 Nvme1n1 : 5.01 11734.77 91.68 0.00 0.00 10892.55 4466.16 21262.79 00:18:46.766 [2024-11-20T00:19:54.985Z] =================================================================================================================== 00:18:46.766 [2024-11-20T00:19:54.985Z] Total : 11734.77 91.68 0.00 0.00 10892.55 4466.16 21262.79 00:18:46.766 [2024-11-20 01:19:54.875390] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.766 [2024-11-20 01:19:54.875420] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.766 [2024-11-20 01:19:54.883378] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.766 [2024-11-20 01:19:54.883408] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.766 [2024-11-20 01:19:54.891412] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.766 [2024-11-20 01:19:54.891448] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.766 [2024-11-20 01:19:54.899472] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.766 [2024-11-20 01:19:54.899524] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.766 [2024-11-20 01:19:54.907509] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.766 [2024-11-20 01:19:54.907564] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.766 [2024-11-20 01:19:54.915514] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.766 [2024-11-20 01:19:54.915567] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.766 [2024-11-20 01:19:54.923530] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.766 [2024-11-20 01:19:54.923580] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.766 [2024-11-20 01:19:54.931554] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.766 [2024-11-20 01:19:54.931605] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.766 [2024-11-20 01:19:54.939584] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.766 [2024-11-20 01:19:54.939654] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.766 [2024-11-20 01:19:54.947604] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.766 [2024-11-20 01:19:54.947654] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.766 [2024-11-20 01:19:54.955625] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.766 [2024-11-20 01:19:54.955676] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.766 [2024-11-20 01:19:54.963650] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.766 [2024-11-20 01:19:54.963702] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.766 [2024-11-20 01:19:54.971663] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.766 [2024-11-20 01:19:54.971714] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.766 [2024-11-20 01:19:54.979695] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:46.766 [2024-11-20 01:19:54.979749] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:47.024 [2024-11-20 01:19:54.987716] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:47.024 [2024-11-20 01:19:54.987766] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:47.024 [2024-11-20 01:19:54.995736] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:47.024 [2024-11-20 01:19:54.995786] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:47.024 [2024-11-20 01:19:55.003752] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:47.024 [2024-11-20 01:19:55.003803] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:47.024 [2024-11-20 01:19:55.011777] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:47.024 [2024-11-20 01:19:55.011826] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:47.024 [2024-11-20 01:19:55.019774] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:47.024 [2024-11-20 01:19:55.019814] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:47.024 [2024-11-20 01:19:55.027772] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:47.024 [2024-11-20 01:19:55.027799] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:47.025 [2024-11-20 01:19:55.035835] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:47.025 [2024-11-20 01:19:55.035882] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:47.025 [2024-11-20 01:19:55.043860] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:47.025 [2024-11-20 01:19:55.043911] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:47.025 [2024-11-20 01:19:55.051891] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:47.025 [2024-11-20 01:19:55.051941] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:47.025 [2024-11-20 01:19:55.059869] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:47.025 [2024-11-20 01:19:55.059897] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:47.025 [2024-11-20 01:19:55.067897] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:47.025 [2024-11-20 01:19:55.067927] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:47.025 [2024-11-20 01:19:55.075962] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:47.025 [2024-11-20 01:19:55.076012] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:47.025 [2024-11-20 01:19:55.083982] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:47.025 [2024-11-20 01:19:55.084033] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:47.025 [2024-11-20 01:19:55.091963] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:47.025 [2024-11-20 01:19:55.092005] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:47.025 [2024-11-20 01:19:55.099972] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:47.025 [2024-11-20 01:19:55.099997] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:47.025 [2024-11-20 01:19:55.107994] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:47.025 [2024-11-20 01:19:55.108019] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:47.025 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh: line 42: kill: (1148427) - No such process 00:18:47.025 01:19:55 -- target/zcopy.sh@49 -- # wait 1148427 00:18:47.025 01:19:55 -- target/zcopy.sh@52 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:18:47.025 01:19:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:47.025 01:19:55 -- common/autotest_common.sh@10 -- # set +x 00:18:47.025 01:19:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:47.025 01:19:55 -- target/zcopy.sh@53 -- # rpc_cmd bdev_delay_create -b malloc0 -d delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:18:47.025 01:19:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:47.025 01:19:55 -- common/autotest_common.sh@10 -- # set +x 00:18:47.025 delay0 00:18:47.025 01:19:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:47.025 01:19:55 -- target/zcopy.sh@54 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 delay0 -n 1 00:18:47.025 01:19:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:47.025 01:19:55 -- common/autotest_common.sh@10 -- # set +x 00:18:47.025 01:19:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:47.025 01:19:55 -- target/zcopy.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -c 0x1 -t 5 -q 64 -w randrw -M 50 -l warning -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 ns:1' 00:18:47.025 EAL: No free 2048 kB hugepages reported on node 1 00:18:47.025 [2024-11-20 01:19:55.223384] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:18:53.576 Initializing NVMe Controllers 00:18:53.576 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:18:53.576 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:18:53.576 Initialization complete. Launching workers. 00:18:53.576 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 I/O completed: 320, failed: 227 00:18:53.576 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) abort submitted 514, failed to submit 33 00:18:53.576 success 319, unsuccess 195, failed 0 00:18:53.576 01:20:01 -- target/zcopy.sh@59 -- # trap - SIGINT SIGTERM EXIT 00:18:53.576 01:20:01 -- target/zcopy.sh@60 -- # nvmftestfini 00:18:53.576 01:20:01 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:53.576 01:20:01 -- nvmf/common.sh@116 -- # sync 00:18:53.576 01:20:01 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:53.576 01:20:01 -- nvmf/common.sh@119 -- # set +e 00:18:53.576 01:20:01 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:53.576 01:20:01 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:53.576 rmmod nvme_tcp 00:18:53.576 rmmod nvme_fabrics 00:18:53.576 rmmod nvme_keyring 00:18:53.576 01:20:01 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:53.576 01:20:01 -- nvmf/common.sh@123 -- # set -e 00:18:53.576 01:20:01 -- nvmf/common.sh@124 -- # return 0 00:18:53.576 01:20:01 -- nvmf/common.sh@477 -- # '[' -n 1147036 ']' 00:18:53.576 01:20:01 -- nvmf/common.sh@478 -- # killprocess 1147036 00:18:53.576 01:20:01 -- common/autotest_common.sh@936 -- # '[' -z 1147036 ']' 00:18:53.576 01:20:01 -- common/autotest_common.sh@940 -- # kill -0 1147036 00:18:53.576 01:20:01 -- common/autotest_common.sh@941 -- # uname 00:18:53.576 01:20:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:53.576 01:20:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1147036 00:18:53.576 01:20:01 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:53.576 01:20:01 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:53.576 01:20:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1147036' 00:18:53.576 killing process with pid 1147036 00:18:53.576 01:20:01 -- common/autotest_common.sh@955 -- # kill 1147036 00:18:53.576 01:20:01 -- common/autotest_common.sh@960 -- # wait 1147036 00:18:53.576 01:20:01 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:53.576 01:20:01 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:53.576 01:20:01 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:53.576 01:20:01 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:53.576 01:20:01 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:53.576 01:20:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:53.576 01:20:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:53.576 01:20:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:56.110 01:20:03 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:56.110 00:18:56.110 real 0m28.669s 00:18:56.110 user 0m40.084s 00:18:56.110 sys 0m8.935s 00:18:56.110 01:20:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:56.110 01:20:03 -- common/autotest_common.sh@10 -- # set +x 00:18:56.110 ************************************ 00:18:56.110 END TEST nvmf_zcopy 00:18:56.110 ************************************ 00:18:56.110 01:20:03 -- nvmf/nvmf.sh@53 -- # run_test nvmf_nmic /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:18:56.110 01:20:03 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:56.110 01:20:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:56.110 01:20:03 -- common/autotest_common.sh@10 -- # set +x 00:18:56.110 ************************************ 00:18:56.110 START TEST nvmf_nmic 00:18:56.110 ************************************ 00:18:56.110 01:20:03 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:18:56.110 * Looking for test storage... 00:18:56.110 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:56.110 01:20:03 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:56.110 01:20:03 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:56.110 01:20:03 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:56.110 01:20:03 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:56.110 01:20:03 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:56.110 01:20:03 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:56.110 01:20:03 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:56.110 01:20:03 -- scripts/common.sh@335 -- # IFS=.-: 00:18:56.110 01:20:03 -- scripts/common.sh@335 -- # read -ra ver1 00:18:56.110 01:20:03 -- scripts/common.sh@336 -- # IFS=.-: 00:18:56.110 01:20:03 -- scripts/common.sh@336 -- # read -ra ver2 00:18:56.110 01:20:03 -- scripts/common.sh@337 -- # local 'op=<' 00:18:56.110 01:20:03 -- scripts/common.sh@339 -- # ver1_l=2 00:18:56.110 01:20:03 -- scripts/common.sh@340 -- # ver2_l=1 00:18:56.110 01:20:03 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:56.110 01:20:03 -- scripts/common.sh@343 -- # case "$op" in 00:18:56.110 01:20:03 -- scripts/common.sh@344 -- # : 1 00:18:56.110 01:20:03 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:56.110 01:20:03 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:56.110 01:20:03 -- scripts/common.sh@364 -- # decimal 1 00:18:56.110 01:20:03 -- scripts/common.sh@352 -- # local d=1 00:18:56.110 01:20:03 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:56.110 01:20:03 -- scripts/common.sh@354 -- # echo 1 00:18:56.110 01:20:03 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:56.110 01:20:03 -- scripts/common.sh@365 -- # decimal 2 00:18:56.110 01:20:03 -- scripts/common.sh@352 -- # local d=2 00:18:56.110 01:20:03 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:56.110 01:20:03 -- scripts/common.sh@354 -- # echo 2 00:18:56.110 01:20:03 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:56.110 01:20:03 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:56.110 01:20:03 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:56.110 01:20:03 -- scripts/common.sh@367 -- # return 0 00:18:56.110 01:20:03 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:56.110 01:20:03 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:56.110 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:56.110 --rc genhtml_branch_coverage=1 00:18:56.110 --rc genhtml_function_coverage=1 00:18:56.110 --rc genhtml_legend=1 00:18:56.110 --rc geninfo_all_blocks=1 00:18:56.110 --rc geninfo_unexecuted_blocks=1 00:18:56.110 00:18:56.110 ' 00:18:56.110 01:20:03 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:56.110 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:56.110 --rc genhtml_branch_coverage=1 00:18:56.110 --rc genhtml_function_coverage=1 00:18:56.110 --rc genhtml_legend=1 00:18:56.110 --rc geninfo_all_blocks=1 00:18:56.110 --rc geninfo_unexecuted_blocks=1 00:18:56.110 00:18:56.110 ' 00:18:56.110 01:20:03 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:56.110 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:56.110 --rc genhtml_branch_coverage=1 00:18:56.110 --rc genhtml_function_coverage=1 00:18:56.110 --rc genhtml_legend=1 00:18:56.110 --rc geninfo_all_blocks=1 00:18:56.110 --rc geninfo_unexecuted_blocks=1 00:18:56.110 00:18:56.110 ' 00:18:56.110 01:20:03 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:56.110 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:56.110 --rc genhtml_branch_coverage=1 00:18:56.110 --rc genhtml_function_coverage=1 00:18:56.110 --rc genhtml_legend=1 00:18:56.110 --rc geninfo_all_blocks=1 00:18:56.110 --rc geninfo_unexecuted_blocks=1 00:18:56.110 00:18:56.110 ' 00:18:56.110 01:20:03 -- target/nmic.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:56.110 01:20:03 -- nvmf/common.sh@7 -- # uname -s 00:18:56.110 01:20:03 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:56.110 01:20:03 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:56.110 01:20:03 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:56.110 01:20:03 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:56.110 01:20:03 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:56.110 01:20:03 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:56.110 01:20:03 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:56.110 01:20:03 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:56.110 01:20:03 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:56.110 01:20:03 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:56.110 01:20:03 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:56.110 01:20:03 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:56.110 01:20:03 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:56.110 01:20:03 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:56.110 01:20:03 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:56.110 01:20:03 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:56.110 01:20:03 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:56.110 01:20:03 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:56.110 01:20:03 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:56.110 01:20:03 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:56.110 01:20:03 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:56.110 01:20:03 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:56.110 01:20:03 -- paths/export.sh@5 -- # export PATH 00:18:56.110 01:20:03 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:56.110 01:20:03 -- nvmf/common.sh@46 -- # : 0 00:18:56.110 01:20:03 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:56.110 01:20:03 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:56.110 01:20:03 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:56.110 01:20:03 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:56.110 01:20:03 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:56.110 01:20:03 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:56.110 01:20:03 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:56.111 01:20:03 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:56.111 01:20:03 -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:56.111 01:20:03 -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:56.111 01:20:03 -- target/nmic.sh@14 -- # nvmftestinit 00:18:56.111 01:20:03 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:56.111 01:20:03 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:56.111 01:20:03 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:56.111 01:20:03 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:56.111 01:20:03 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:56.111 01:20:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:56.111 01:20:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:56.111 01:20:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:56.111 01:20:03 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:56.111 01:20:03 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:56.111 01:20:03 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:56.111 01:20:03 -- common/autotest_common.sh@10 -- # set +x 00:18:58.119 01:20:05 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:58.120 01:20:05 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:58.120 01:20:05 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:58.120 01:20:05 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:58.120 01:20:05 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:58.120 01:20:05 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:58.120 01:20:05 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:58.120 01:20:05 -- nvmf/common.sh@294 -- # net_devs=() 00:18:58.120 01:20:05 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:58.120 01:20:05 -- nvmf/common.sh@295 -- # e810=() 00:18:58.120 01:20:05 -- nvmf/common.sh@295 -- # local -ga e810 00:18:58.120 01:20:05 -- nvmf/common.sh@296 -- # x722=() 00:18:58.120 01:20:05 -- nvmf/common.sh@296 -- # local -ga x722 00:18:58.120 01:20:05 -- nvmf/common.sh@297 -- # mlx=() 00:18:58.120 01:20:05 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:58.120 01:20:05 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:58.120 01:20:05 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:58.120 01:20:05 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:58.120 01:20:05 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:58.120 01:20:05 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:58.120 01:20:05 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:58.120 01:20:05 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:58.120 01:20:05 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:58.120 01:20:05 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:58.120 01:20:05 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:58.120 01:20:05 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:58.120 01:20:05 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:58.120 01:20:05 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:58.120 01:20:05 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:58.120 01:20:05 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:58.120 01:20:05 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:58.120 01:20:05 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:58.120 01:20:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:58.120 01:20:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:58.120 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:58.120 01:20:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:58.120 01:20:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:58.120 01:20:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:58.120 01:20:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:58.120 01:20:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:58.120 01:20:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:58.120 01:20:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:58.120 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:58.120 01:20:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:58.120 01:20:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:58.120 01:20:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:58.120 01:20:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:58.120 01:20:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:58.120 01:20:05 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:58.120 01:20:05 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:58.120 01:20:05 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:58.120 01:20:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:58.120 01:20:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:58.120 01:20:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:58.120 01:20:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:58.120 01:20:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:58.120 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:58.120 01:20:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:58.120 01:20:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:58.120 01:20:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:58.120 01:20:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:58.120 01:20:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:58.120 01:20:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:58.120 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:58.120 01:20:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:58.120 01:20:05 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:58.120 01:20:05 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:58.120 01:20:05 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:58.120 01:20:05 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:58.120 01:20:05 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:58.120 01:20:05 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:58.120 01:20:05 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:58.120 01:20:05 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:58.120 01:20:05 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:58.120 01:20:05 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:58.120 01:20:05 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:58.120 01:20:05 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:58.120 01:20:05 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:58.120 01:20:05 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:58.120 01:20:05 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:58.120 01:20:05 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:58.120 01:20:05 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:58.120 01:20:05 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:58.120 01:20:06 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:58.120 01:20:06 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:58.120 01:20:06 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:58.120 01:20:06 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:58.120 01:20:06 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:58.120 01:20:06 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:58.120 01:20:06 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:58.120 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:58.120 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.347 ms 00:18:58.120 00:18:58.120 --- 10.0.0.2 ping statistics --- 00:18:58.120 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:58.120 rtt min/avg/max/mdev = 0.347/0.347/0.347/0.000 ms 00:18:58.120 01:20:06 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:58.120 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:58.120 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.166 ms 00:18:58.120 00:18:58.120 --- 10.0.0.1 ping statistics --- 00:18:58.120 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:58.120 rtt min/avg/max/mdev = 0.166/0.166/0.166/0.000 ms 00:18:58.120 01:20:06 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:58.120 01:20:06 -- nvmf/common.sh@410 -- # return 0 00:18:58.120 01:20:06 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:58.120 01:20:06 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:58.120 01:20:06 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:58.120 01:20:06 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:58.120 01:20:06 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:58.120 01:20:06 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:58.120 01:20:06 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:58.120 01:20:06 -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:18:58.120 01:20:06 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:58.120 01:20:06 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:58.120 01:20:06 -- common/autotest_common.sh@10 -- # set +x 00:18:58.120 01:20:06 -- nvmf/common.sh@469 -- # nvmfpid=1151868 00:18:58.120 01:20:06 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:18:58.120 01:20:06 -- nvmf/common.sh@470 -- # waitforlisten 1151868 00:18:58.120 01:20:06 -- common/autotest_common.sh@829 -- # '[' -z 1151868 ']' 00:18:58.120 01:20:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:58.120 01:20:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:58.120 01:20:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:58.120 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:58.120 01:20:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:58.120 01:20:06 -- common/autotest_common.sh@10 -- # set +x 00:18:58.120 [2024-11-20 01:20:06.135124] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:58.120 [2024-11-20 01:20:06.135200] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:58.120 EAL: No free 2048 kB hugepages reported on node 1 00:18:58.120 [2024-11-20 01:20:06.200146] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:18:58.120 [2024-11-20 01:20:06.290650] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:58.120 [2024-11-20 01:20:06.290793] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:58.120 [2024-11-20 01:20:06.290809] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:58.120 [2024-11-20 01:20:06.290822] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:58.120 [2024-11-20 01:20:06.290890] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:58.120 [2024-11-20 01:20:06.290940] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:58.120 [2024-11-20 01:20:06.291007] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:18:58.120 [2024-11-20 01:20:06.291009] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:59.050 01:20:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:59.050 01:20:07 -- common/autotest_common.sh@862 -- # return 0 00:18:59.050 01:20:07 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:59.050 01:20:07 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:59.050 01:20:07 -- common/autotest_common.sh@10 -- # set +x 00:18:59.050 01:20:07 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:59.050 01:20:07 -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:59.050 01:20:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.050 01:20:07 -- common/autotest_common.sh@10 -- # set +x 00:18:59.050 [2024-11-20 01:20:07.129772] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:59.050 01:20:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.050 01:20:07 -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:18:59.050 01:20:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.050 01:20:07 -- common/autotest_common.sh@10 -- # set +x 00:18:59.050 Malloc0 00:18:59.050 01:20:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.050 01:20:07 -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:18:59.050 01:20:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.050 01:20:07 -- common/autotest_common.sh@10 -- # set +x 00:18:59.050 01:20:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.050 01:20:07 -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:59.050 01:20:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.050 01:20:07 -- common/autotest_common.sh@10 -- # set +x 00:18:59.050 01:20:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.050 01:20:07 -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:59.050 01:20:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.050 01:20:07 -- common/autotest_common.sh@10 -- # set +x 00:18:59.050 [2024-11-20 01:20:07.183746] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:59.050 01:20:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.050 01:20:07 -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:18:59.050 test case1: single bdev can't be used in multiple subsystems 00:18:59.050 01:20:07 -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:18:59.050 01:20:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.050 01:20:07 -- common/autotest_common.sh@10 -- # set +x 00:18:59.050 01:20:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.050 01:20:07 -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:18:59.050 01:20:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.050 01:20:07 -- common/autotest_common.sh@10 -- # set +x 00:18:59.050 01:20:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.050 01:20:07 -- target/nmic.sh@28 -- # nmic_status=0 00:18:59.050 01:20:07 -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:18:59.050 01:20:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.050 01:20:07 -- common/autotest_common.sh@10 -- # set +x 00:18:59.050 [2024-11-20 01:20:07.207587] bdev.c:7940:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:18:59.050 [2024-11-20 01:20:07.207617] subsystem.c:1819:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:18:59.050 [2024-11-20 01:20:07.207632] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.050 request: 00:18:59.050 { 00:18:59.050 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:18:59.050 "namespace": { 00:18:59.050 "bdev_name": "Malloc0" 00:18:59.050 }, 00:18:59.050 "method": "nvmf_subsystem_add_ns", 00:18:59.050 "req_id": 1 00:18:59.050 } 00:18:59.050 Got JSON-RPC error response 00:18:59.050 response: 00:18:59.050 { 00:18:59.050 "code": -32602, 00:18:59.050 "message": "Invalid parameters" 00:18:59.050 } 00:18:59.050 01:20:07 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:18:59.050 01:20:07 -- target/nmic.sh@29 -- # nmic_status=1 00:18:59.050 01:20:07 -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:18:59.050 01:20:07 -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:18:59.050 Adding namespace failed - expected result. 00:18:59.050 01:20:07 -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:18:59.050 test case2: host connect to nvmf target in multiple paths 00:18:59.050 01:20:07 -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:18:59.050 01:20:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.050 01:20:07 -- common/autotest_common.sh@10 -- # set +x 00:18:59.050 [2024-11-20 01:20:07.215698] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:18:59.050 01:20:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.050 01:20:07 -- target/nmic.sh@41 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:18:59.983 01:20:07 -- target/nmic.sh@42 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4421 00:19:00.548 01:20:08 -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:19:00.548 01:20:08 -- common/autotest_common.sh@1187 -- # local i=0 00:19:00.548 01:20:08 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:00.548 01:20:08 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:00.548 01:20:08 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:02.447 01:20:10 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:02.447 01:20:10 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:02.447 01:20:10 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:19:02.447 01:20:10 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:02.447 01:20:10 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:02.447 01:20:10 -- common/autotest_common.sh@1197 -- # return 0 00:19:02.447 01:20:10 -- target/nmic.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:19:02.447 [global] 00:19:02.447 thread=1 00:19:02.447 invalidate=1 00:19:02.447 rw=write 00:19:02.447 time_based=1 00:19:02.447 runtime=1 00:19:02.447 ioengine=libaio 00:19:02.447 direct=1 00:19:02.447 bs=4096 00:19:02.447 iodepth=1 00:19:02.447 norandommap=0 00:19:02.447 numjobs=1 00:19:02.447 00:19:02.447 verify_dump=1 00:19:02.447 verify_backlog=512 00:19:02.447 verify_state_save=0 00:19:02.447 do_verify=1 00:19:02.447 verify=crc32c-intel 00:19:02.447 [job0] 00:19:02.447 filename=/dev/nvme0n1 00:19:02.447 Could not set queue depth (nvme0n1) 00:19:02.704 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:02.704 fio-3.35 00:19:02.704 Starting 1 thread 00:19:04.078 00:19:04.078 job0: (groupid=0, jobs=1): err= 0: pid=1152532: Wed Nov 20 01:20:11 2024 00:19:04.078 read: IOPS=21, BW=86.8KiB/s (88.9kB/s)(88.0KiB/1014msec) 00:19:04.078 slat (nsec): min=11862, max=33765, avg=22062.64, stdev=9732.88 00:19:04.078 clat (usec): min=40903, max=42067, avg=41482.83, stdev=508.24 00:19:04.078 lat (usec): min=40937, max=42083, avg=41504.90, stdev=511.01 00:19:04.078 clat percentiles (usec): 00:19:04.078 | 1.00th=[41157], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:19:04.078 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41681], 00:19:04.078 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:19:04.078 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:04.078 | 99.99th=[42206] 00:19:04.078 write: IOPS=504, BW=2020KiB/s (2068kB/s)(2048KiB/1014msec); 0 zone resets 00:19:04.078 slat (nsec): min=6930, max=25567, avg=9626.08, stdev=2762.18 00:19:04.078 clat (usec): min=130, max=321, avg=184.61, stdev=47.58 00:19:04.078 lat (usec): min=140, max=347, avg=194.24, stdev=46.64 00:19:04.078 clat percentiles (usec): 00:19:04.078 | 1.00th=[ 133], 5.00th=[ 137], 10.00th=[ 139], 20.00th=[ 143], 00:19:04.078 | 30.00th=[ 147], 40.00th=[ 153], 50.00th=[ 157], 60.00th=[ 169], 00:19:04.078 | 70.00th=[ 241], 80.00th=[ 245], 90.00th=[ 247], 95.00th=[ 249], 00:19:04.078 | 99.00th=[ 255], 99.50th=[ 265], 99.90th=[ 322], 99.95th=[ 322], 00:19:04.078 | 99.99th=[ 322] 00:19:04.078 bw ( KiB/s): min= 4096, max= 4096, per=100.00%, avg=4096.00, stdev= 0.00, samples=1 00:19:04.078 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:04.078 lat (usec) : 250=92.88%, 500=3.00% 00:19:04.078 lat (msec) : 50=4.12% 00:19:04.078 cpu : usr=0.00%, sys=0.89%, ctx=535, majf=0, minf=1 00:19:04.078 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:04.078 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:04.078 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:04.078 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:04.078 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:04.079 00:19:04.079 Run status group 0 (all jobs): 00:19:04.079 READ: bw=86.8KiB/s (88.9kB/s), 86.8KiB/s-86.8KiB/s (88.9kB/s-88.9kB/s), io=88.0KiB (90.1kB), run=1014-1014msec 00:19:04.079 WRITE: bw=2020KiB/s (2068kB/s), 2020KiB/s-2020KiB/s (2068kB/s-2068kB/s), io=2048KiB (2097kB), run=1014-1014msec 00:19:04.079 00:19:04.079 Disk stats (read/write): 00:19:04.079 nvme0n1: ios=69/512, merge=0/0, ticks=817/92, in_queue=909, util=92.08% 00:19:04.079 01:20:11 -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:19:04.079 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:19:04.079 01:20:12 -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:19:04.079 01:20:12 -- common/autotest_common.sh@1208 -- # local i=0 00:19:04.079 01:20:12 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:04.079 01:20:12 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:04.079 01:20:12 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:04.079 01:20:12 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:04.079 01:20:12 -- common/autotest_common.sh@1220 -- # return 0 00:19:04.079 01:20:12 -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:19:04.079 01:20:12 -- target/nmic.sh@53 -- # nvmftestfini 00:19:04.079 01:20:12 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:04.079 01:20:12 -- nvmf/common.sh@116 -- # sync 00:19:04.079 01:20:12 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:04.079 01:20:12 -- nvmf/common.sh@119 -- # set +e 00:19:04.079 01:20:12 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:04.079 01:20:12 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:04.079 rmmod nvme_tcp 00:19:04.079 rmmod nvme_fabrics 00:19:04.079 rmmod nvme_keyring 00:19:04.079 01:20:12 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:04.079 01:20:12 -- nvmf/common.sh@123 -- # set -e 00:19:04.079 01:20:12 -- nvmf/common.sh@124 -- # return 0 00:19:04.079 01:20:12 -- nvmf/common.sh@477 -- # '[' -n 1151868 ']' 00:19:04.079 01:20:12 -- nvmf/common.sh@478 -- # killprocess 1151868 00:19:04.079 01:20:12 -- common/autotest_common.sh@936 -- # '[' -z 1151868 ']' 00:19:04.079 01:20:12 -- common/autotest_common.sh@940 -- # kill -0 1151868 00:19:04.079 01:20:12 -- common/autotest_common.sh@941 -- # uname 00:19:04.079 01:20:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:04.079 01:20:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1151868 00:19:04.079 01:20:12 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:04.079 01:20:12 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:04.079 01:20:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1151868' 00:19:04.079 killing process with pid 1151868 00:19:04.079 01:20:12 -- common/autotest_common.sh@955 -- # kill 1151868 00:19:04.079 01:20:12 -- common/autotest_common.sh@960 -- # wait 1151868 00:19:04.337 01:20:12 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:04.337 01:20:12 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:04.337 01:20:12 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:04.337 01:20:12 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:04.337 01:20:12 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:04.337 01:20:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:04.337 01:20:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:04.337 01:20:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:06.876 01:20:14 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:06.876 00:19:06.876 real 0m10.757s 00:19:06.876 user 0m25.948s 00:19:06.876 sys 0m2.347s 00:19:06.876 01:20:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:06.876 01:20:14 -- common/autotest_common.sh@10 -- # set +x 00:19:06.876 ************************************ 00:19:06.876 END TEST nvmf_nmic 00:19:06.876 ************************************ 00:19:06.876 01:20:14 -- nvmf/nvmf.sh@54 -- # run_test nvmf_fio_target /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:19:06.876 01:20:14 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:06.876 01:20:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:06.876 01:20:14 -- common/autotest_common.sh@10 -- # set +x 00:19:06.876 ************************************ 00:19:06.876 START TEST nvmf_fio_target 00:19:06.876 ************************************ 00:19:06.876 01:20:14 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:19:06.876 * Looking for test storage... 00:19:06.876 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:06.876 01:20:14 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:06.876 01:20:14 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:06.876 01:20:14 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:06.876 01:20:14 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:06.876 01:20:14 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:06.876 01:20:14 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:06.876 01:20:14 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:06.876 01:20:14 -- scripts/common.sh@335 -- # IFS=.-: 00:19:06.876 01:20:14 -- scripts/common.sh@335 -- # read -ra ver1 00:19:06.876 01:20:14 -- scripts/common.sh@336 -- # IFS=.-: 00:19:06.876 01:20:14 -- scripts/common.sh@336 -- # read -ra ver2 00:19:06.876 01:20:14 -- scripts/common.sh@337 -- # local 'op=<' 00:19:06.876 01:20:14 -- scripts/common.sh@339 -- # ver1_l=2 00:19:06.876 01:20:14 -- scripts/common.sh@340 -- # ver2_l=1 00:19:06.876 01:20:14 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:06.876 01:20:14 -- scripts/common.sh@343 -- # case "$op" in 00:19:06.876 01:20:14 -- scripts/common.sh@344 -- # : 1 00:19:06.876 01:20:14 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:06.876 01:20:14 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:06.876 01:20:14 -- scripts/common.sh@364 -- # decimal 1 00:19:06.876 01:20:14 -- scripts/common.sh@352 -- # local d=1 00:19:06.876 01:20:14 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:06.876 01:20:14 -- scripts/common.sh@354 -- # echo 1 00:19:06.876 01:20:14 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:06.876 01:20:14 -- scripts/common.sh@365 -- # decimal 2 00:19:06.876 01:20:14 -- scripts/common.sh@352 -- # local d=2 00:19:06.876 01:20:14 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:06.876 01:20:14 -- scripts/common.sh@354 -- # echo 2 00:19:06.876 01:20:14 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:06.876 01:20:14 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:06.876 01:20:14 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:06.876 01:20:14 -- scripts/common.sh@367 -- # return 0 00:19:06.876 01:20:14 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:06.876 01:20:14 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:06.876 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:06.876 --rc genhtml_branch_coverage=1 00:19:06.876 --rc genhtml_function_coverage=1 00:19:06.876 --rc genhtml_legend=1 00:19:06.877 --rc geninfo_all_blocks=1 00:19:06.877 --rc geninfo_unexecuted_blocks=1 00:19:06.877 00:19:06.877 ' 00:19:06.877 01:20:14 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:06.877 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:06.877 --rc genhtml_branch_coverage=1 00:19:06.877 --rc genhtml_function_coverage=1 00:19:06.877 --rc genhtml_legend=1 00:19:06.877 --rc geninfo_all_blocks=1 00:19:06.877 --rc geninfo_unexecuted_blocks=1 00:19:06.877 00:19:06.877 ' 00:19:06.877 01:20:14 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:06.877 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:06.877 --rc genhtml_branch_coverage=1 00:19:06.877 --rc genhtml_function_coverage=1 00:19:06.877 --rc genhtml_legend=1 00:19:06.877 --rc geninfo_all_blocks=1 00:19:06.877 --rc geninfo_unexecuted_blocks=1 00:19:06.877 00:19:06.877 ' 00:19:06.877 01:20:14 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:06.877 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:06.877 --rc genhtml_branch_coverage=1 00:19:06.877 --rc genhtml_function_coverage=1 00:19:06.877 --rc genhtml_legend=1 00:19:06.877 --rc geninfo_all_blocks=1 00:19:06.877 --rc geninfo_unexecuted_blocks=1 00:19:06.877 00:19:06.877 ' 00:19:06.877 01:20:14 -- target/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:06.877 01:20:14 -- nvmf/common.sh@7 -- # uname -s 00:19:06.877 01:20:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:06.877 01:20:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:06.877 01:20:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:06.877 01:20:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:06.877 01:20:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:06.877 01:20:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:06.877 01:20:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:06.877 01:20:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:06.877 01:20:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:06.877 01:20:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:06.877 01:20:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:06.877 01:20:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:06.877 01:20:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:06.877 01:20:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:06.877 01:20:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:06.877 01:20:14 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:06.877 01:20:14 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:06.877 01:20:14 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:06.877 01:20:14 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:06.877 01:20:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:06.877 01:20:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:06.877 01:20:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:06.877 01:20:14 -- paths/export.sh@5 -- # export PATH 00:19:06.877 01:20:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:06.877 01:20:14 -- nvmf/common.sh@46 -- # : 0 00:19:06.877 01:20:14 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:06.877 01:20:14 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:06.877 01:20:14 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:06.877 01:20:14 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:06.877 01:20:14 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:06.877 01:20:14 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:06.877 01:20:14 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:06.877 01:20:14 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:06.877 01:20:14 -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:06.877 01:20:14 -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:06.877 01:20:14 -- target/fio.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:19:06.877 01:20:14 -- target/fio.sh@16 -- # nvmftestinit 00:19:06.877 01:20:14 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:06.877 01:20:14 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:06.877 01:20:14 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:06.877 01:20:14 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:06.877 01:20:14 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:06.877 01:20:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:06.877 01:20:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:06.877 01:20:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:06.877 01:20:14 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:06.877 01:20:14 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:06.877 01:20:14 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:06.877 01:20:14 -- common/autotest_common.sh@10 -- # set +x 00:19:08.783 01:20:16 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:08.783 01:20:16 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:08.783 01:20:16 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:08.783 01:20:16 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:08.783 01:20:16 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:08.783 01:20:16 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:08.783 01:20:16 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:08.783 01:20:16 -- nvmf/common.sh@294 -- # net_devs=() 00:19:08.783 01:20:16 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:08.783 01:20:16 -- nvmf/common.sh@295 -- # e810=() 00:19:08.783 01:20:16 -- nvmf/common.sh@295 -- # local -ga e810 00:19:08.783 01:20:16 -- nvmf/common.sh@296 -- # x722=() 00:19:08.783 01:20:16 -- nvmf/common.sh@296 -- # local -ga x722 00:19:08.783 01:20:16 -- nvmf/common.sh@297 -- # mlx=() 00:19:08.783 01:20:16 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:08.783 01:20:16 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:08.783 01:20:16 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:08.783 01:20:16 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:08.783 01:20:16 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:08.783 01:20:16 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:08.783 01:20:16 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:08.783 01:20:16 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:08.783 01:20:16 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:08.783 01:20:16 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:08.783 01:20:16 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:08.783 01:20:16 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:08.783 01:20:16 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:08.783 01:20:16 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:08.783 01:20:16 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:08.783 01:20:16 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:08.783 01:20:16 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:08.783 01:20:16 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:08.783 01:20:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:08.783 01:20:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:08.783 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:08.783 01:20:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:08.783 01:20:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:08.783 01:20:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:08.783 01:20:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:08.783 01:20:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:08.783 01:20:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:08.783 01:20:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:08.783 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:08.783 01:20:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:08.783 01:20:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:08.783 01:20:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:08.783 01:20:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:08.783 01:20:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:08.783 01:20:16 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:08.783 01:20:16 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:08.783 01:20:16 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:08.783 01:20:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:08.783 01:20:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:08.783 01:20:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:08.783 01:20:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:08.783 01:20:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:08.783 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:08.783 01:20:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:08.783 01:20:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:08.783 01:20:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:08.784 01:20:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:08.784 01:20:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:08.784 01:20:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:08.784 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:08.784 01:20:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:08.784 01:20:16 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:08.784 01:20:16 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:08.784 01:20:16 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:08.784 01:20:16 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:08.784 01:20:16 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:08.784 01:20:16 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:08.784 01:20:16 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:08.784 01:20:16 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:08.784 01:20:16 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:08.784 01:20:16 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:08.784 01:20:16 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:08.784 01:20:16 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:08.784 01:20:16 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:08.784 01:20:16 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:08.784 01:20:16 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:08.784 01:20:16 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:08.784 01:20:16 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:08.784 01:20:16 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:08.784 01:20:16 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:08.784 01:20:16 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:08.784 01:20:16 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:08.784 01:20:16 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:08.784 01:20:16 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:08.784 01:20:16 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:08.784 01:20:16 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:08.784 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:08.784 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.372 ms 00:19:08.784 00:19:08.784 --- 10.0.0.2 ping statistics --- 00:19:08.784 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:08.784 rtt min/avg/max/mdev = 0.372/0.372/0.372/0.000 ms 00:19:08.784 01:20:16 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:08.784 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:08.784 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.156 ms 00:19:08.784 00:19:08.784 --- 10.0.0.1 ping statistics --- 00:19:08.784 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:08.784 rtt min/avg/max/mdev = 0.156/0.156/0.156/0.000 ms 00:19:08.784 01:20:16 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:08.784 01:20:16 -- nvmf/common.sh@410 -- # return 0 00:19:08.784 01:20:16 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:08.784 01:20:16 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:08.784 01:20:16 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:08.784 01:20:16 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:08.784 01:20:16 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:08.784 01:20:16 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:08.784 01:20:16 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:08.784 01:20:16 -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:19:08.784 01:20:16 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:08.784 01:20:16 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:08.784 01:20:16 -- common/autotest_common.sh@10 -- # set +x 00:19:08.784 01:20:16 -- nvmf/common.sh@469 -- # nvmfpid=1154750 00:19:08.784 01:20:16 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:08.784 01:20:16 -- nvmf/common.sh@470 -- # waitforlisten 1154750 00:19:08.784 01:20:16 -- common/autotest_common.sh@829 -- # '[' -z 1154750 ']' 00:19:08.784 01:20:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:08.784 01:20:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:08.784 01:20:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:08.784 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:08.784 01:20:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:08.784 01:20:16 -- common/autotest_common.sh@10 -- # set +x 00:19:09.042 [2024-11-20 01:20:17.042870] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:19:09.042 [2024-11-20 01:20:17.042969] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:09.042 EAL: No free 2048 kB hugepages reported on node 1 00:19:09.042 [2024-11-20 01:20:17.108976] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:09.042 [2024-11-20 01:20:17.197237] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:09.042 [2024-11-20 01:20:17.197388] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:09.042 [2024-11-20 01:20:17.197406] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:09.042 [2024-11-20 01:20:17.197418] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:09.042 [2024-11-20 01:20:17.197488] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:09.042 [2024-11-20 01:20:17.197549] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:09.042 [2024-11-20 01:20:17.197616] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:09.042 [2024-11-20 01:20:17.197619] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:09.977 01:20:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:09.977 01:20:18 -- common/autotest_common.sh@862 -- # return 0 00:19:09.977 01:20:18 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:09.977 01:20:18 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:09.977 01:20:18 -- common/autotest_common.sh@10 -- # set +x 00:19:09.977 01:20:18 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:09.977 01:20:18 -- target/fio.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:19:10.235 [2024-11-20 01:20:18.326713] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:10.235 01:20:18 -- target/fio.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:10.493 01:20:18 -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:19:10.493 01:20:18 -- target/fio.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:10.752 01:20:18 -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:19:10.752 01:20:18 -- target/fio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:11.317 01:20:19 -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:19:11.317 01:20:19 -- target/fio.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:11.317 01:20:19 -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:19:11.317 01:20:19 -- target/fio.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:19:11.575 01:20:19 -- target/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:11.834 01:20:20 -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:19:11.834 01:20:20 -- target/fio.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:12.092 01:20:20 -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:19:12.092 01:20:20 -- target/fio.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:12.658 01:20:20 -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:19:12.658 01:20:20 -- target/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:19:12.658 01:20:20 -- target/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:19:12.917 01:20:21 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:19:12.917 01:20:21 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:13.175 01:20:21 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:19:13.175 01:20:21 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:19:13.433 01:20:21 -- target/fio.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:13.691 [2024-11-20 01:20:21.821650] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:13.691 01:20:21 -- target/fio.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:19:13.991 01:20:22 -- target/fio.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:19:14.273 01:20:22 -- target/fio.sh@46 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:19:14.841 01:20:23 -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:19:14.841 01:20:23 -- common/autotest_common.sh@1187 -- # local i=0 00:19:14.841 01:20:23 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:14.841 01:20:23 -- common/autotest_common.sh@1189 -- # [[ -n 4 ]] 00:19:14.841 01:20:23 -- common/autotest_common.sh@1190 -- # nvme_device_counter=4 00:19:14.841 01:20:23 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:17.376 01:20:25 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:17.376 01:20:25 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:17.376 01:20:25 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:19:17.376 01:20:25 -- common/autotest_common.sh@1196 -- # nvme_devices=4 00:19:17.376 01:20:25 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:17.376 01:20:25 -- common/autotest_common.sh@1197 -- # return 0 00:19:17.376 01:20:25 -- target/fio.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:19:17.376 [global] 00:19:17.376 thread=1 00:19:17.376 invalidate=1 00:19:17.376 rw=write 00:19:17.376 time_based=1 00:19:17.377 runtime=1 00:19:17.377 ioengine=libaio 00:19:17.377 direct=1 00:19:17.377 bs=4096 00:19:17.377 iodepth=1 00:19:17.377 norandommap=0 00:19:17.377 numjobs=1 00:19:17.377 00:19:17.377 verify_dump=1 00:19:17.377 verify_backlog=512 00:19:17.377 verify_state_save=0 00:19:17.377 do_verify=1 00:19:17.377 verify=crc32c-intel 00:19:17.377 [job0] 00:19:17.377 filename=/dev/nvme0n1 00:19:17.377 [job1] 00:19:17.377 filename=/dev/nvme0n2 00:19:17.377 [job2] 00:19:17.377 filename=/dev/nvme0n3 00:19:17.377 [job3] 00:19:17.377 filename=/dev/nvme0n4 00:19:17.377 Could not set queue depth (nvme0n1) 00:19:17.377 Could not set queue depth (nvme0n2) 00:19:17.377 Could not set queue depth (nvme0n3) 00:19:17.377 Could not set queue depth (nvme0n4) 00:19:17.377 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:17.377 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:17.377 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:17.377 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:17.377 fio-3.35 00:19:17.377 Starting 4 threads 00:19:18.315 00:19:18.315 job0: (groupid=0, jobs=1): err= 0: pid=1155860: Wed Nov 20 01:20:26 2024 00:19:18.315 read: IOPS=61, BW=246KiB/s (252kB/s)(248KiB/1008msec) 00:19:18.315 slat (nsec): min=6133, max=33251, avg=15888.61, stdev=9888.79 00:19:18.315 clat (usec): min=207, max=41262, avg=14037.71, stdev=19405.68 00:19:18.315 lat (usec): min=214, max=41277, avg=14053.59, stdev=19411.40 00:19:18.315 clat percentiles (usec): 00:19:18.315 | 1.00th=[ 208], 5.00th=[ 210], 10.00th=[ 219], 20.00th=[ 223], 00:19:18.315 | 30.00th=[ 235], 40.00th=[ 269], 50.00th=[ 277], 60.00th=[ 351], 00:19:18.315 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:19:18.315 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:19:18.315 | 99.99th=[41157] 00:19:18.315 write: IOPS=507, BW=2032KiB/s (2081kB/s)(2048KiB/1008msec); 0 zone resets 00:19:18.315 slat (nsec): min=6281, max=42068, avg=13495.61, stdev=6682.37 00:19:18.315 clat (usec): min=150, max=477, avg=243.35, stdev=48.00 00:19:18.315 lat (usec): min=158, max=486, avg=256.85, stdev=47.27 00:19:18.315 clat percentiles (usec): 00:19:18.315 | 1.00th=[ 163], 5.00th=[ 172], 10.00th=[ 182], 20.00th=[ 198], 00:19:18.315 | 30.00th=[ 219], 40.00th=[ 237], 50.00th=[ 245], 60.00th=[ 249], 00:19:18.315 | 70.00th=[ 260], 80.00th=[ 273], 90.00th=[ 306], 95.00th=[ 326], 00:19:18.315 | 99.00th=[ 383], 99.50th=[ 388], 99.90th=[ 478], 99.95th=[ 478], 00:19:18.315 | 99.99th=[ 478] 00:19:18.315 bw ( KiB/s): min= 4096, max= 4096, per=20.22%, avg=4096.00, stdev= 0.00, samples=1 00:19:18.315 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:18.315 lat (usec) : 250=57.49%, 500=38.85% 00:19:18.315 lat (msec) : 50=3.66% 00:19:18.315 cpu : usr=0.30%, sys=0.70%, ctx=575, majf=0, minf=1 00:19:18.315 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:18.315 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:18.315 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:18.315 issued rwts: total=62,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:18.315 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:18.315 job1: (groupid=0, jobs=1): err= 0: pid=1155861: Wed Nov 20 01:20:26 2024 00:19:18.315 read: IOPS=1950, BW=7800KiB/s (7987kB/s)(7808KiB/1001msec) 00:19:18.315 slat (nsec): min=5882, max=60732, avg=14475.04, stdev=4959.68 00:19:18.315 clat (usec): min=199, max=587, avg=275.96, stdev=66.08 00:19:18.315 lat (usec): min=206, max=596, avg=290.43, stdev=66.91 00:19:18.315 clat percentiles (usec): 00:19:18.315 | 1.00th=[ 206], 5.00th=[ 217], 10.00th=[ 229], 20.00th=[ 239], 00:19:18.315 | 30.00th=[ 245], 40.00th=[ 249], 50.00th=[ 253], 60.00th=[ 260], 00:19:18.315 | 70.00th=[ 265], 80.00th=[ 281], 90.00th=[ 420], 95.00th=[ 437], 00:19:18.315 | 99.00th=[ 465], 99.50th=[ 486], 99.90th=[ 529], 99.95th=[ 586], 00:19:18.315 | 99.99th=[ 586] 00:19:18.315 write: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec); 0 zone resets 00:19:18.315 slat (nsec): min=7619, max=60201, avg=17289.18, stdev=6876.38 00:19:18.315 clat (usec): min=137, max=345, avg=183.81, stdev=21.12 00:19:18.315 lat (usec): min=145, max=368, avg=201.10, stdev=23.63 00:19:18.315 clat percentiles (usec): 00:19:18.315 | 1.00th=[ 147], 5.00th=[ 155], 10.00th=[ 161], 20.00th=[ 167], 00:19:18.315 | 30.00th=[ 172], 40.00th=[ 176], 50.00th=[ 180], 60.00th=[ 186], 00:19:18.315 | 70.00th=[ 190], 80.00th=[ 200], 90.00th=[ 215], 95.00th=[ 223], 00:19:18.315 | 99.00th=[ 239], 99.50th=[ 251], 99.90th=[ 322], 99.95th=[ 338], 00:19:18.315 | 99.99th=[ 347] 00:19:18.315 bw ( KiB/s): min= 8192, max= 8192, per=40.44%, avg=8192.00, stdev= 0.00, samples=1 00:19:18.315 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:19:18.315 lat (usec) : 250=71.55%, 500=28.32%, 750=0.12% 00:19:18.315 cpu : usr=3.90%, sys=9.60%, ctx=4003, majf=0, minf=1 00:19:18.315 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:18.315 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:18.315 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:18.315 issued rwts: total=1952,2048,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:18.315 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:18.315 job2: (groupid=0, jobs=1): err= 0: pid=1155862: Wed Nov 20 01:20:26 2024 00:19:18.315 read: IOPS=83, BW=332KiB/s (340kB/s)(336KiB/1011msec) 00:19:18.315 slat (nsec): min=7930, max=47851, avg=16770.21, stdev=10601.08 00:19:18.315 clat (usec): min=284, max=41218, avg=9983.38, stdev=17075.59 00:19:18.315 lat (usec): min=298, max=41257, avg=10000.16, stdev=17081.90 00:19:18.315 clat percentiles (usec): 00:19:18.315 | 1.00th=[ 285], 5.00th=[ 334], 10.00th=[ 343], 20.00th=[ 351], 00:19:18.315 | 30.00th=[ 363], 40.00th=[ 375], 50.00th=[ 408], 60.00th=[ 441], 00:19:18.315 | 70.00th=[ 553], 80.00th=[40633], 90.00th=[41157], 95.00th=[41157], 00:19:18.315 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:19:18.315 | 99.99th=[41157] 00:19:18.315 write: IOPS=506, BW=2026KiB/s (2074kB/s)(2048KiB/1011msec); 0 zone resets 00:19:18.315 slat (usec): min=7, max=19767, avg=57.04, stdev=872.84 00:19:18.315 clat (usec): min=148, max=708, avg=270.72, stdev=59.02 00:19:18.315 lat (usec): min=160, max=20157, avg=327.76, stdev=879.99 00:19:18.315 clat percentiles (usec): 00:19:18.315 | 1.00th=[ 157], 5.00th=[ 190], 10.00th=[ 208], 20.00th=[ 229], 00:19:18.315 | 30.00th=[ 241], 40.00th=[ 251], 50.00th=[ 262], 60.00th=[ 269], 00:19:18.315 | 70.00th=[ 285], 80.00th=[ 318], 90.00th=[ 355], 95.00th=[ 388], 00:19:18.315 | 99.00th=[ 412], 99.50th=[ 420], 99.90th=[ 709], 99.95th=[ 709], 00:19:18.315 | 99.99th=[ 709] 00:19:18.315 bw ( KiB/s): min= 4096, max= 4096, per=20.22%, avg=4096.00, stdev= 0.00, samples=1 00:19:18.315 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:18.315 lat (usec) : 250=33.56%, 500=61.91%, 750=0.84% 00:19:18.315 lat (msec) : 10=0.34%, 50=3.36% 00:19:18.315 cpu : usr=0.30%, sys=1.39%, ctx=600, majf=0, minf=1 00:19:18.315 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:18.315 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:18.315 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:18.315 issued rwts: total=84,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:18.315 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:18.315 job3: (groupid=0, jobs=1): err= 0: pid=1155863: Wed Nov 20 01:20:26 2024 00:19:18.315 read: IOPS=1710, BW=6841KiB/s (7005kB/s)(6848KiB/1001msec) 00:19:18.315 slat (nsec): min=4767, max=53518, avg=15090.31, stdev=6692.25 00:19:18.315 clat (usec): min=204, max=791, avg=276.83, stdev=60.92 00:19:18.315 lat (usec): min=215, max=800, avg=291.92, stdev=64.24 00:19:18.315 clat percentiles (usec): 00:19:18.315 | 1.00th=[ 217], 5.00th=[ 229], 10.00th=[ 235], 20.00th=[ 245], 00:19:18.315 | 30.00th=[ 253], 40.00th=[ 260], 50.00th=[ 265], 60.00th=[ 269], 00:19:18.315 | 70.00th=[ 273], 80.00th=[ 281], 90.00th=[ 314], 95.00th=[ 433], 00:19:18.315 | 99.00th=[ 570], 99.50th=[ 586], 99.90th=[ 660], 99.95th=[ 791], 00:19:18.315 | 99.99th=[ 791] 00:19:18.315 write: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec); 0 zone resets 00:19:18.315 slat (nsec): min=6219, max=71777, avg=18538.38, stdev=8022.75 00:19:18.315 clat (usec): min=147, max=508, avg=215.83, stdev=45.99 00:19:18.315 lat (usec): min=155, max=543, avg=234.36, stdev=47.04 00:19:18.315 clat percentiles (usec): 00:19:18.315 | 1.00th=[ 157], 5.00th=[ 167], 10.00th=[ 178], 20.00th=[ 190], 00:19:18.315 | 30.00th=[ 196], 40.00th=[ 200], 50.00th=[ 204], 60.00th=[ 208], 00:19:18.315 | 70.00th=[ 217], 80.00th=[ 231], 90.00th=[ 269], 95.00th=[ 326], 00:19:18.315 | 99.00th=[ 388], 99.50th=[ 408], 99.90th=[ 469], 99.95th=[ 474], 00:19:18.315 | 99.99th=[ 510] 00:19:18.315 bw ( KiB/s): min= 8192, max= 8192, per=40.44%, avg=8192.00, stdev= 0.00, samples=1 00:19:18.315 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:19:18.315 lat (usec) : 250=58.70%, 500=40.37%, 750=0.90%, 1000=0.03% 00:19:18.315 cpu : usr=4.70%, sys=7.60%, ctx=3762, majf=0, minf=1 00:19:18.315 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:18.315 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:18.315 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:18.315 issued rwts: total=1712,2048,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:18.315 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:18.315 00:19:18.315 Run status group 0 (all jobs): 00:19:18.315 READ: bw=14.7MiB/s (15.4MB/s), 246KiB/s-7800KiB/s (252kB/s-7987kB/s), io=14.9MiB (15.6MB), run=1001-1011msec 00:19:18.315 WRITE: bw=19.8MiB/s (20.7MB/s), 2026KiB/s-8184KiB/s (2074kB/s-8380kB/s), io=20.0MiB (21.0MB), run=1001-1011msec 00:19:18.315 00:19:18.315 Disk stats (read/write): 00:19:18.315 nvme0n1: ios=85/512, merge=0/0, ticks=1693/116, in_queue=1809, util=97.70% 00:19:18.315 nvme0n2: ios=1564/1842, merge=0/0, ticks=1405/307, in_queue=1712, util=97.97% 00:19:18.315 nvme0n3: ios=106/512, merge=0/0, ticks=1657/133, in_queue=1790, util=98.02% 00:19:18.315 nvme0n4: ios=1560/1597, merge=0/0, ticks=1364/324, in_queue=1688, util=97.90% 00:19:18.315 01:20:26 -- target/fio.sh@51 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:19:18.315 [global] 00:19:18.315 thread=1 00:19:18.315 invalidate=1 00:19:18.315 rw=randwrite 00:19:18.315 time_based=1 00:19:18.315 runtime=1 00:19:18.316 ioengine=libaio 00:19:18.316 direct=1 00:19:18.316 bs=4096 00:19:18.316 iodepth=1 00:19:18.316 norandommap=0 00:19:18.316 numjobs=1 00:19:18.316 00:19:18.316 verify_dump=1 00:19:18.316 verify_backlog=512 00:19:18.316 verify_state_save=0 00:19:18.316 do_verify=1 00:19:18.316 verify=crc32c-intel 00:19:18.316 [job0] 00:19:18.316 filename=/dev/nvme0n1 00:19:18.316 [job1] 00:19:18.316 filename=/dev/nvme0n2 00:19:18.316 [job2] 00:19:18.316 filename=/dev/nvme0n3 00:19:18.316 [job3] 00:19:18.316 filename=/dev/nvme0n4 00:19:18.575 Could not set queue depth (nvme0n1) 00:19:18.575 Could not set queue depth (nvme0n2) 00:19:18.575 Could not set queue depth (nvme0n3) 00:19:18.575 Could not set queue depth (nvme0n4) 00:19:18.575 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:18.575 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:18.575 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:18.575 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:18.575 fio-3.35 00:19:18.575 Starting 4 threads 00:19:19.963 00:19:19.963 job0: (groupid=0, jobs=1): err= 0: pid=1156104: Wed Nov 20 01:20:27 2024 00:19:19.963 read: IOPS=2027, BW=8112KiB/s (8307kB/s)(8120KiB/1001msec) 00:19:19.963 slat (nsec): min=5261, max=44057, avg=14947.53, stdev=5948.78 00:19:19.963 clat (usec): min=204, max=3726, avg=272.01, stdev=94.43 00:19:19.963 lat (usec): min=213, max=3735, avg=286.96, stdev=94.97 00:19:19.963 clat percentiles (usec): 00:19:19.963 | 1.00th=[ 217], 5.00th=[ 233], 10.00th=[ 239], 20.00th=[ 247], 00:19:19.963 | 30.00th=[ 251], 40.00th=[ 255], 50.00th=[ 258], 60.00th=[ 262], 00:19:19.963 | 70.00th=[ 265], 80.00th=[ 273], 90.00th=[ 281], 95.00th=[ 420], 00:19:19.963 | 99.00th=[ 515], 99.50th=[ 537], 99.90th=[ 570], 99.95th=[ 594], 00:19:19.963 | 99.99th=[ 3720] 00:19:19.963 write: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec); 0 zone resets 00:19:19.963 slat (nsec): min=6974, max=66719, avg=16090.88, stdev=6998.02 00:19:19.963 clat (usec): min=135, max=276, avg=177.79, stdev=15.87 00:19:19.963 lat (usec): min=143, max=322, avg=193.88, stdev=20.47 00:19:19.963 clat percentiles (usec): 00:19:19.963 | 1.00th=[ 143], 5.00th=[ 151], 10.00th=[ 155], 20.00th=[ 163], 00:19:19.963 | 30.00th=[ 172], 40.00th=[ 176], 50.00th=[ 180], 60.00th=[ 184], 00:19:19.963 | 70.00th=[ 188], 80.00th=[ 192], 90.00th=[ 198], 95.00th=[ 202], 00:19:19.963 | 99.00th=[ 212], 99.50th=[ 217], 99.90th=[ 223], 99.95th=[ 231], 00:19:19.963 | 99.99th=[ 277] 00:19:19.963 bw ( KiB/s): min= 9240, max= 9240, per=36.69%, avg=9240.00, stdev= 0.00, samples=1 00:19:19.963 iops : min= 2310, max= 2310, avg=2310.00, stdev= 0.00, samples=1 00:19:19.963 lat (usec) : 250=64.39%, 500=34.87%, 750=0.71% 00:19:19.963 lat (msec) : 4=0.02% 00:19:19.963 cpu : usr=5.10%, sys=8.60%, ctx=4078, majf=0, minf=2 00:19:19.963 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:19.963 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:19.963 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:19.963 issued rwts: total=2030,2048,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:19.963 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:19.963 job1: (groupid=0, jobs=1): err= 0: pid=1156105: Wed Nov 20 01:20:27 2024 00:19:19.963 read: IOPS=1534, BW=6138KiB/s (6285kB/s)(6144KiB/1001msec) 00:19:19.963 slat (nsec): min=5770, max=65877, avg=15897.91, stdev=6517.90 00:19:19.963 clat (usec): min=206, max=712, avg=320.59, stdev=57.09 00:19:19.963 lat (usec): min=215, max=775, avg=336.49, stdev=58.32 00:19:19.963 clat percentiles (usec): 00:19:19.963 | 1.00th=[ 241], 5.00th=[ 262], 10.00th=[ 273], 20.00th=[ 289], 00:19:19.963 | 30.00th=[ 297], 40.00th=[ 302], 50.00th=[ 310], 60.00th=[ 314], 00:19:19.963 | 70.00th=[ 326], 80.00th=[ 338], 90.00th=[ 383], 95.00th=[ 433], 00:19:19.963 | 99.00th=[ 578], 99.50th=[ 603], 99.90th=[ 676], 99.95th=[ 709], 00:19:19.963 | 99.99th=[ 709] 00:19:19.963 write: IOPS=1959, BW=7836KiB/s (8024kB/s)(7844KiB/1001msec); 0 zone resets 00:19:19.963 slat (nsec): min=6929, max=69460, avg=16823.94, stdev=6807.84 00:19:19.963 clat (usec): min=145, max=489, avg=220.67, stdev=55.99 00:19:19.963 lat (usec): min=157, max=520, avg=237.50, stdev=55.34 00:19:19.963 clat percentiles (usec): 00:19:19.963 | 1.00th=[ 159], 5.00th=[ 172], 10.00th=[ 176], 20.00th=[ 182], 00:19:19.963 | 30.00th=[ 188], 40.00th=[ 194], 50.00th=[ 200], 60.00th=[ 210], 00:19:19.963 | 70.00th=[ 227], 80.00th=[ 249], 90.00th=[ 302], 95.00th=[ 343], 00:19:19.963 | 99.00th=[ 424], 99.50th=[ 437], 99.90th=[ 474], 99.95th=[ 490], 00:19:19.963 | 99.99th=[ 490] 00:19:19.963 bw ( KiB/s): min= 8192, max= 8192, per=32.52%, avg=8192.00, stdev= 0.00, samples=1 00:19:19.963 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:19:19.963 lat (usec) : 250=45.98%, 500=52.96%, 750=1.06% 00:19:19.963 cpu : usr=5.00%, sys=7.20%, ctx=3497, majf=0, minf=1 00:19:19.963 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:19.963 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:19.963 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:19.963 issued rwts: total=1536,1961,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:19.963 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:19.963 job2: (groupid=0, jobs=1): err= 0: pid=1156106: Wed Nov 20 01:20:27 2024 00:19:19.963 read: IOPS=1534, BW=6138KiB/s (6285kB/s)(6144KiB/1001msec) 00:19:19.963 slat (nsec): min=5546, max=71241, avg=19339.90, stdev=9671.49 00:19:19.963 clat (usec): min=212, max=552, avg=316.27, stdev=59.96 00:19:19.963 lat (usec): min=230, max=585, avg=335.61, stdev=59.75 00:19:19.963 clat percentiles (usec): 00:19:19.963 | 1.00th=[ 227], 5.00th=[ 237], 10.00th=[ 247], 20.00th=[ 273], 00:19:19.963 | 30.00th=[ 285], 40.00th=[ 293], 50.00th=[ 302], 60.00th=[ 314], 00:19:19.963 | 70.00th=[ 330], 80.00th=[ 367], 90.00th=[ 400], 95.00th=[ 424], 00:19:19.963 | 99.00th=[ 502], 99.50th=[ 523], 99.90th=[ 553], 99.95th=[ 553], 00:19:19.963 | 99.99th=[ 553] 00:19:19.963 write: IOPS=1969, BW=7876KiB/s (8065kB/s)(7884KiB/1001msec); 0 zone resets 00:19:19.963 slat (nsec): min=6129, max=77592, avg=16388.24, stdev=6702.48 00:19:19.963 clat (usec): min=148, max=505, avg=220.79, stdev=54.54 00:19:19.963 lat (usec): min=156, max=550, avg=237.17, stdev=53.89 00:19:19.963 clat percentiles (usec): 00:19:19.963 | 1.00th=[ 161], 5.00th=[ 172], 10.00th=[ 176], 20.00th=[ 184], 00:19:19.963 | 30.00th=[ 190], 40.00th=[ 196], 50.00th=[ 202], 60.00th=[ 210], 00:19:19.963 | 70.00th=[ 223], 80.00th=[ 247], 90.00th=[ 302], 95.00th=[ 347], 00:19:19.963 | 99.00th=[ 412], 99.50th=[ 437], 99.90th=[ 478], 99.95th=[ 506], 00:19:19.963 | 99.99th=[ 506] 00:19:19.963 bw ( KiB/s): min= 8192, max= 8192, per=32.52%, avg=8192.00, stdev= 0.00, samples=1 00:19:19.963 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:19:19.963 lat (usec) : 250=50.47%, 500=48.90%, 750=0.63% 00:19:19.963 cpu : usr=3.10%, sys=6.60%, ctx=3509, majf=0, minf=1 00:19:19.963 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:19.963 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:19.963 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:19.963 issued rwts: total=1536,1971,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:19.963 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:19.963 job3: (groupid=0, jobs=1): err= 0: pid=1156107: Wed Nov 20 01:20:27 2024 00:19:19.963 read: IOPS=22, BW=89.2KiB/s (91.4kB/s)(92.0KiB/1031msec) 00:19:19.963 slat (nsec): min=7198, max=34321, avg=21149.17, stdev=9748.10 00:19:19.963 clat (usec): min=249, max=41049, avg=39189.92, stdev=8489.00 00:19:19.963 lat (usec): min=263, max=41065, avg=39211.07, stdev=8490.50 00:19:19.963 clat percentiles (usec): 00:19:19.963 | 1.00th=[ 249], 5.00th=[40633], 10.00th=[41157], 20.00th=[41157], 00:19:19.963 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:19:19.963 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:19:19.963 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:19:19.963 | 99.99th=[41157] 00:19:19.963 write: IOPS=496, BW=1986KiB/s (2034kB/s)(2048KiB/1031msec); 0 zone resets 00:19:19.963 slat (nsec): min=6156, max=46389, avg=11116.59, stdev=6435.32 00:19:19.963 clat (usec): min=147, max=984, avg=237.09, stdev=91.76 00:19:19.963 lat (usec): min=155, max=993, avg=248.20, stdev=93.44 00:19:19.963 clat percentiles (usec): 00:19:19.963 | 1.00th=[ 151], 5.00th=[ 157], 10.00th=[ 161], 20.00th=[ 167], 00:19:19.963 | 30.00th=[ 174], 40.00th=[ 180], 50.00th=[ 188], 60.00th=[ 225], 00:19:19.963 | 70.00th=[ 277], 80.00th=[ 322], 90.00th=[ 363], 95.00th=[ 408], 00:19:19.963 | 99.00th=[ 494], 99.50th=[ 519], 99.90th=[ 988], 99.95th=[ 988], 00:19:19.963 | 99.99th=[ 988] 00:19:19.963 bw ( KiB/s): min= 4096, max= 4096, per=16.26%, avg=4096.00, stdev= 0.00, samples=1 00:19:19.963 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:19.963 lat (usec) : 250=61.87%, 500=33.27%, 750=0.56%, 1000=0.19% 00:19:19.963 lat (msec) : 50=4.11% 00:19:19.963 cpu : usr=0.29%, sys=0.58%, ctx=535, majf=0, minf=1 00:19:19.963 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:19.963 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:19.963 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:19.963 issued rwts: total=23,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:19.964 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:19.964 00:19:19.964 Run status group 0 (all jobs): 00:19:19.964 READ: bw=19.4MiB/s (20.4MB/s), 89.2KiB/s-8112KiB/s (91.4kB/s-8307kB/s), io=20.0MiB (21.0MB), run=1001-1031msec 00:19:19.964 WRITE: bw=24.6MiB/s (25.8MB/s), 1986KiB/s-8184KiB/s (2034kB/s-8380kB/s), io=25.4MiB (26.6MB), run=1001-1031msec 00:19:19.964 00:19:19.964 Disk stats (read/write): 00:19:19.964 nvme0n1: ios=1660/2048, merge=0/0, ticks=410/355, in_queue=765, util=86.97% 00:19:19.964 nvme0n2: ios=1424/1536, merge=0/0, ticks=431/313, in_queue=744, util=86.90% 00:19:19.964 nvme0n3: ios=1436/1536, merge=0/0, ticks=1422/311, in_queue=1733, util=98.23% 00:19:19.964 nvme0n4: ios=18/512, merge=0/0, ticks=697/117, in_queue=814, util=89.72% 00:19:19.964 01:20:27 -- target/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:19:19.964 [global] 00:19:19.964 thread=1 00:19:19.964 invalidate=1 00:19:19.964 rw=write 00:19:19.964 time_based=1 00:19:19.964 runtime=1 00:19:19.964 ioengine=libaio 00:19:19.964 direct=1 00:19:19.964 bs=4096 00:19:19.964 iodepth=128 00:19:19.964 norandommap=0 00:19:19.964 numjobs=1 00:19:19.964 00:19:19.964 verify_dump=1 00:19:19.964 verify_backlog=512 00:19:19.964 verify_state_save=0 00:19:19.964 do_verify=1 00:19:19.964 verify=crc32c-intel 00:19:19.964 [job0] 00:19:19.964 filename=/dev/nvme0n1 00:19:19.964 [job1] 00:19:19.964 filename=/dev/nvme0n2 00:19:19.964 [job2] 00:19:19.964 filename=/dev/nvme0n3 00:19:19.964 [job3] 00:19:19.964 filename=/dev/nvme0n4 00:19:19.964 Could not set queue depth (nvme0n1) 00:19:19.964 Could not set queue depth (nvme0n2) 00:19:19.964 Could not set queue depth (nvme0n3) 00:19:19.964 Could not set queue depth (nvme0n4) 00:19:20.222 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:20.222 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:20.222 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:20.222 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:20.222 fio-3.35 00:19:20.222 Starting 4 threads 00:19:21.601 00:19:21.601 job0: (groupid=0, jobs=1): err= 0: pid=1156457: Wed Nov 20 01:20:29 2024 00:19:21.601 read: IOPS=4575, BW=17.9MiB/s (18.7MB/s)(17.9MiB/1003msec) 00:19:21.601 slat (usec): min=2, max=18684, avg=113.39, stdev=733.72 00:19:21.601 clat (usec): min=648, max=84032, avg=14375.00, stdev=11056.71 00:19:21.601 lat (usec): min=659, max=84041, avg=14488.40, stdev=11120.98 00:19:21.601 clat percentiles (usec): 00:19:21.601 | 1.00th=[ 3589], 5.00th=[ 8356], 10.00th=[ 8717], 20.00th=[ 9372], 00:19:21.601 | 30.00th=[10290], 40.00th=[10683], 50.00th=[10945], 60.00th=[11731], 00:19:21.601 | 70.00th=[12649], 80.00th=[14222], 90.00th=[24249], 95.00th=[31589], 00:19:21.601 | 99.00th=[70779], 99.50th=[82314], 99.90th=[82314], 99.95th=[84411], 00:19:21.601 | 99.99th=[84411] 00:19:21.601 write: IOPS=4594, BW=17.9MiB/s (18.8MB/s)(18.0MiB/1003msec); 0 zone resets 00:19:21.601 slat (usec): min=3, max=10935, avg=94.87, stdev=524.79 00:19:21.601 clat (usec): min=214, max=50229, avg=13295.24, stdev=7948.10 00:19:21.601 lat (usec): min=230, max=50234, avg=13390.11, stdev=7991.88 00:19:21.601 clat percentiles (usec): 00:19:21.601 | 1.00th=[ 1827], 5.00th=[ 5866], 10.00th=[ 8717], 20.00th=[ 9241], 00:19:21.601 | 30.00th=[10683], 40.00th=[11207], 50.00th=[11600], 60.00th=[11863], 00:19:21.601 | 70.00th=[12649], 80.00th=[14091], 90.00th=[17957], 95.00th=[33817], 00:19:21.601 | 99.00th=[48497], 99.50th=[49021], 99.90th=[50070], 99.95th=[50070], 00:19:21.601 | 99.99th=[50070] 00:19:21.601 bw ( KiB/s): min=16384, max=20480, per=27.35%, avg=18432.00, stdev=2896.31, samples=2 00:19:21.601 iops : min= 4096, max= 5120, avg=4608.00, stdev=724.08, samples=2 00:19:21.601 lat (usec) : 250=0.01%, 500=0.02%, 750=0.20%, 1000=0.07% 00:19:21.601 lat (msec) : 2=0.60%, 4=1.42%, 10=24.30%, 20=62.82%, 50=9.10% 00:19:21.601 lat (msec) : 100=1.46% 00:19:21.601 cpu : usr=3.09%, sys=6.59%, ctx=465, majf=0, minf=2 00:19:21.601 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:19:21.601 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:21.601 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:21.601 issued rwts: total=4589,4608,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:21.601 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:21.601 job1: (groupid=0, jobs=1): err= 0: pid=1156458: Wed Nov 20 01:20:29 2024 00:19:21.601 read: IOPS=3951, BW=15.4MiB/s (16.2MB/s)(15.5MiB/1003msec) 00:19:21.601 slat (usec): min=2, max=7936, avg=110.41, stdev=622.97 00:19:21.601 clat (usec): min=808, max=31920, avg=14162.94, stdev=3548.07 00:19:21.601 lat (usec): min=4099, max=31935, avg=14273.35, stdev=3600.57 00:19:21.601 clat percentiles (usec): 00:19:21.601 | 1.00th=[ 4948], 5.00th=[ 9372], 10.00th=[ 9765], 20.00th=[10552], 00:19:21.601 | 30.00th=[12387], 40.00th=[13829], 50.00th=[14484], 60.00th=[15139], 00:19:21.601 | 70.00th=[15401], 80.00th=[16581], 90.00th=[18482], 95.00th=[19268], 00:19:21.601 | 99.00th=[24511], 99.50th=[28181], 99.90th=[31851], 99.95th=[31851], 00:19:21.601 | 99.99th=[31851] 00:19:21.601 write: IOPS=4083, BW=16.0MiB/s (16.7MB/s)(16.0MiB/1003msec); 0 zone resets 00:19:21.601 slat (usec): min=3, max=26319, avg=126.95, stdev=720.17 00:19:21.601 clat (usec): min=6307, max=41325, avg=16815.55, stdev=6707.51 00:19:21.601 lat (usec): min=6326, max=41333, avg=16942.50, stdev=6755.85 00:19:21.601 clat percentiles (usec): 00:19:21.601 | 1.00th=[ 7767], 5.00th=[10290], 10.00th=[10683], 20.00th=[11207], 00:19:21.601 | 30.00th=[12387], 40.00th=[13566], 50.00th=[14091], 60.00th=[16188], 00:19:21.601 | 70.00th=[19792], 80.00th=[22414], 90.00th=[23987], 95.00th=[32375], 00:19:21.601 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:19:21.601 | 99.99th=[41157] 00:19:21.601 bw ( KiB/s): min=16384, max=16384, per=24.32%, avg=16384.00, stdev= 0.00, samples=2 00:19:21.601 iops : min= 4096, max= 4096, avg=4096.00, stdev= 0.00, samples=2 00:19:21.601 lat (usec) : 1000=0.01% 00:19:21.601 lat (msec) : 10=8.36%, 20=74.38%, 50=17.25% 00:19:21.601 cpu : usr=5.19%, sys=9.08%, ctx=401, majf=0, minf=1 00:19:21.601 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:19:21.601 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:21.601 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:21.601 issued rwts: total=3963,4096,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:21.601 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:21.601 job2: (groupid=0, jobs=1): err= 0: pid=1156459: Wed Nov 20 01:20:29 2024 00:19:21.601 read: IOPS=4637, BW=18.1MiB/s (19.0MB/s)(18.2MiB/1003msec) 00:19:21.601 slat (usec): min=2, max=13822, avg=99.50, stdev=583.79 00:19:21.601 clat (usec): min=1612, max=26398, avg=12450.97, stdev=2518.07 00:19:21.601 lat (usec): min=4070, max=28867, avg=12550.47, stdev=2556.46 00:19:21.601 clat percentiles (usec): 00:19:21.601 | 1.00th=[ 7963], 5.00th=[ 9372], 10.00th=[10290], 20.00th=[11076], 00:19:21.601 | 30.00th=[11469], 40.00th=[11863], 50.00th=[12125], 60.00th=[12387], 00:19:21.601 | 70.00th=[12649], 80.00th=[13173], 90.00th=[15139], 95.00th=[17957], 00:19:21.601 | 99.00th=[21890], 99.50th=[22938], 99.90th=[26346], 99.95th=[26346], 00:19:21.601 | 99.99th=[26346] 00:19:21.601 write: IOPS=5104, BW=19.9MiB/s (20.9MB/s)(20.0MiB/1003msec); 0 zone resets 00:19:21.601 slat (usec): min=3, max=12802, avg=93.85, stdev=595.11 00:19:21.601 clat (usec): min=410, max=40045, avg=13405.83, stdev=5050.80 00:19:21.601 lat (usec): min=423, max=40080, avg=13499.69, stdev=5094.79 00:19:21.601 clat percentiles (usec): 00:19:21.601 | 1.00th=[ 2704], 5.00th=[ 7570], 10.00th=[ 9765], 20.00th=[11076], 00:19:21.601 | 30.00th=[11600], 40.00th=[11863], 50.00th=[12125], 60.00th=[12518], 00:19:21.601 | 70.00th=[13304], 80.00th=[15401], 90.00th=[20055], 95.00th=[26346], 00:19:21.601 | 99.00th=[29230], 99.50th=[30278], 99.90th=[32375], 99.95th=[37487], 00:19:21.601 | 99.99th=[40109] 00:19:21.601 bw ( KiB/s): min=19808, max=20480, per=29.90%, avg=20144.00, stdev=475.18, samples=2 00:19:21.601 iops : min= 4952, max= 5120, avg=5036.00, stdev=118.79, samples=2 00:19:21.601 lat (usec) : 500=0.03%, 750=0.05% 00:19:21.601 lat (msec) : 2=0.16%, 4=0.62%, 10=8.82%, 20=83.55%, 50=6.75% 00:19:21.601 cpu : usr=6.09%, sys=7.88%, ctx=403, majf=0, minf=1 00:19:21.601 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:19:21.601 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:21.601 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:21.601 issued rwts: total=4651,5120,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:21.601 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:21.601 job3: (groupid=0, jobs=1): err= 0: pid=1156460: Wed Nov 20 01:20:29 2024 00:19:21.601 read: IOPS=2898, BW=11.3MiB/s (11.9MB/s)(11.4MiB/1003msec) 00:19:21.601 slat (usec): min=2, max=11016, avg=172.44, stdev=918.23 00:19:21.602 clat (usec): min=435, max=42203, avg=22058.01, stdev=9299.64 00:19:21.602 lat (usec): min=2928, max=42212, avg=22230.45, stdev=9326.15 00:19:21.602 clat percentiles (usec): 00:19:21.602 | 1.00th=[ 3326], 5.00th=[ 9896], 10.00th=[12125], 20.00th=[13042], 00:19:21.602 | 30.00th=[14746], 40.00th=[18482], 50.00th=[20841], 60.00th=[22414], 00:19:21.602 | 70.00th=[25035], 80.00th=[31065], 90.00th=[36963], 95.00th=[39584], 00:19:21.602 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:21.602 | 99.99th=[42206] 00:19:21.602 write: IOPS=3062, BW=12.0MiB/s (12.5MB/s)(12.0MiB/1003msec); 0 zone resets 00:19:21.602 slat (usec): min=2, max=12840, avg=156.16, stdev=801.27 00:19:21.602 clat (usec): min=8532, max=40731, avg=20262.17, stdev=7685.19 00:19:21.602 lat (usec): min=9090, max=40737, avg=20418.33, stdev=7713.21 00:19:21.602 clat percentiles (usec): 00:19:21.602 | 1.00th=[ 9634], 5.00th=[10290], 10.00th=[11076], 20.00th=[13042], 00:19:21.602 | 30.00th=[14746], 40.00th=[16712], 50.00th=[17957], 60.00th=[21627], 00:19:21.602 | 70.00th=[23987], 80.00th=[27919], 90.00th=[32113], 95.00th=[34866], 00:19:21.602 | 99.00th=[37487], 99.50th=[40109], 99.90th=[40633], 99.95th=[40633], 00:19:21.602 | 99.99th=[40633] 00:19:21.602 bw ( KiB/s): min=12288, max=12288, per=18.24%, avg=12288.00, stdev= 0.00, samples=2 00:19:21.602 iops : min= 3072, max= 3072, avg=3072.00, stdev= 0.00, samples=2 00:19:21.602 lat (usec) : 500=0.02% 00:19:21.602 lat (msec) : 4=0.54%, 10=3.01%, 20=46.18%, 50=50.26% 00:19:21.602 cpu : usr=2.40%, sys=4.09%, ctx=315, majf=0, minf=1 00:19:21.602 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:19:21.602 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:21.602 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:21.602 issued rwts: total=2907,3072,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:21.602 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:21.602 00:19:21.602 Run status group 0 (all jobs): 00:19:21.602 READ: bw=62.7MiB/s (65.8MB/s), 11.3MiB/s-18.1MiB/s (11.9MB/s-19.0MB/s), io=62.9MiB (66.0MB), run=1003-1003msec 00:19:21.602 WRITE: bw=65.8MiB/s (69.0MB/s), 12.0MiB/s-19.9MiB/s (12.5MB/s-20.9MB/s), io=66.0MiB (69.2MB), run=1003-1003msec 00:19:21.602 00:19:21.602 Disk stats (read/write): 00:19:21.602 nvme0n1: ios=4092/4096, merge=0/0, ticks=21848/27319, in_queue=49167, util=85.97% 00:19:21.602 nvme0n2: ios=3114/3279, merge=0/0, ticks=22666/25875, in_queue=48541, util=91.17% 00:19:21.602 nvme0n3: ios=4156/4440, merge=0/0, ticks=25175/28741, in_queue=53916, util=93.75% 00:19:21.602 nvme0n4: ios=2105/2479, merge=0/0, ticks=13975/13644, in_queue=27619, util=95.59% 00:19:21.602 01:20:29 -- target/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:19:21.602 [global] 00:19:21.602 thread=1 00:19:21.602 invalidate=1 00:19:21.602 rw=randwrite 00:19:21.602 time_based=1 00:19:21.602 runtime=1 00:19:21.602 ioengine=libaio 00:19:21.602 direct=1 00:19:21.602 bs=4096 00:19:21.602 iodepth=128 00:19:21.602 norandommap=0 00:19:21.602 numjobs=1 00:19:21.602 00:19:21.602 verify_dump=1 00:19:21.602 verify_backlog=512 00:19:21.602 verify_state_save=0 00:19:21.602 do_verify=1 00:19:21.602 verify=crc32c-intel 00:19:21.602 [job0] 00:19:21.602 filename=/dev/nvme0n1 00:19:21.602 [job1] 00:19:21.602 filename=/dev/nvme0n2 00:19:21.602 [job2] 00:19:21.602 filename=/dev/nvme0n3 00:19:21.602 [job3] 00:19:21.602 filename=/dev/nvme0n4 00:19:21.602 Could not set queue depth (nvme0n1) 00:19:21.602 Could not set queue depth (nvme0n2) 00:19:21.602 Could not set queue depth (nvme0n3) 00:19:21.602 Could not set queue depth (nvme0n4) 00:19:21.602 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:21.602 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:21.602 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:21.602 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:21.602 fio-3.35 00:19:21.602 Starting 4 threads 00:19:22.981 00:19:22.981 job0: (groupid=0, jobs=1): err= 0: pid=1156690: Wed Nov 20 01:20:30 2024 00:19:22.981 read: IOPS=4603, BW=18.0MiB/s (18.9MB/s)(18.0MiB/1001msec) 00:19:22.981 slat (usec): min=2, max=23347, avg=102.83, stdev=783.55 00:19:22.981 clat (usec): min=3503, max=59003, avg=12883.16, stdev=5068.56 00:19:22.981 lat (usec): min=3507, max=59020, avg=12985.99, stdev=5140.76 00:19:22.981 clat percentiles (usec): 00:19:22.981 | 1.00th=[ 5538], 5.00th=[ 9372], 10.00th=[ 9503], 20.00th=[10552], 00:19:22.981 | 30.00th=[11207], 40.00th=[11600], 50.00th=[11731], 60.00th=[11994], 00:19:22.981 | 70.00th=[12518], 80.00th=[13435], 90.00th=[17433], 95.00th=[20317], 00:19:22.981 | 99.00th=[35914], 99.50th=[36439], 99.90th=[58983], 99.95th=[58983], 00:19:22.981 | 99.99th=[58983] 00:19:22.981 write: IOPS=4715, BW=18.4MiB/s (19.3MB/s)(18.4MiB/1001msec); 0 zone resets 00:19:22.981 slat (usec): min=3, max=15111, avg=100.39, stdev=595.27 00:19:22.981 clat (usec): min=302, max=59082, avg=14344.16, stdev=7132.36 00:19:22.981 lat (usec): min=1177, max=59096, avg=14444.55, stdev=7177.56 00:19:22.981 clat percentiles (usec): 00:19:22.981 | 1.00th=[ 3490], 5.00th=[ 7767], 10.00th=[ 9634], 20.00th=[10290], 00:19:22.981 | 30.00th=[10683], 40.00th=[11600], 50.00th=[12125], 60.00th=[12780], 00:19:22.981 | 70.00th=[13435], 80.00th=[20055], 90.00th=[22414], 95.00th=[27919], 00:19:22.981 | 99.00th=[43779], 99.50th=[44303], 99.90th=[58983], 99.95th=[58983], 00:19:22.981 | 99.99th=[58983] 00:19:22.981 bw ( KiB/s): min=16384, max=16384, per=22.42%, avg=16384.00, stdev= 0.00, samples=1 00:19:22.981 iops : min= 4096, max= 4096, avg=4096.00, stdev= 0.00, samples=1 00:19:22.981 lat (usec) : 500=0.01% 00:19:22.981 lat (msec) : 2=0.03%, 4=1.05%, 10=13.75%, 20=72.45%, 50=12.34% 00:19:22.981 lat (msec) : 100=0.36% 00:19:22.981 cpu : usr=5.80%, sys=9.30%, ctx=440, majf=0, minf=2 00:19:22.981 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:19:22.981 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:22.981 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:22.981 issued rwts: total=4608,4720,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:22.981 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:22.981 job1: (groupid=0, jobs=1): err= 0: pid=1156691: Wed Nov 20 01:20:30 2024 00:19:22.981 read: IOPS=4587, BW=17.9MiB/s (18.8MB/s)(18.0MiB/1003msec) 00:19:22.981 slat (usec): min=3, max=13159, avg=99.24, stdev=657.17 00:19:22.981 clat (usec): min=599, max=45382, avg=13094.20, stdev=5357.97 00:19:22.981 lat (usec): min=3826, max=45392, avg=13193.43, stdev=5391.06 00:19:22.981 clat percentiles (usec): 00:19:22.981 | 1.00th=[ 4883], 5.00th=[ 9372], 10.00th=[10290], 20.00th=[10552], 00:19:22.981 | 30.00th=[10814], 40.00th=[10945], 50.00th=[11207], 60.00th=[11600], 00:19:22.981 | 70.00th=[12387], 80.00th=[14353], 90.00th=[19792], 95.00th=[22676], 00:19:22.981 | 99.00th=[34341], 99.50th=[43254], 99.90th=[45351], 99.95th=[45351], 00:19:22.981 | 99.99th=[45351] 00:19:22.981 write: IOPS=4594, BW=17.9MiB/s (18.8MB/s)(18.0MiB/1003msec); 0 zone resets 00:19:22.981 slat (usec): min=4, max=17755, avg=105.30, stdev=724.36 00:19:22.981 clat (usec): min=6201, max=50731, avg=14542.53, stdev=6977.39 00:19:22.981 lat (usec): min=6208, max=50772, avg=14647.83, stdev=7033.20 00:19:22.981 clat percentiles (usec): 00:19:22.981 | 1.00th=[ 6915], 5.00th=[ 8717], 10.00th=[ 9634], 20.00th=[10814], 00:19:22.981 | 30.00th=[11338], 40.00th=[11600], 50.00th=[11863], 60.00th=[12256], 00:19:22.981 | 70.00th=[13829], 80.00th=[19530], 90.00th=[21365], 95.00th=[27132], 00:19:22.981 | 99.00th=[44827], 99.50th=[46924], 99.90th=[50594], 99.95th=[50594], 00:19:22.981 | 99.99th=[50594] 00:19:22.981 bw ( KiB/s): min=15800, max=21064, per=25.22%, avg=18432.00, stdev=3722.21, samples=2 00:19:22.981 iops : min= 3950, max= 5266, avg=4608.00, stdev=930.55, samples=2 00:19:22.981 lat (usec) : 750=0.01% 00:19:22.981 lat (msec) : 4=0.08%, 10=10.31%, 20=75.11%, 50=14.42%, 100=0.08% 00:19:22.981 cpu : usr=5.89%, sys=10.78%, ctx=356, majf=0, minf=1 00:19:22.981 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:19:22.981 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:22.981 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:22.981 issued rwts: total=4601,4608,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:22.981 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:22.981 job2: (groupid=0, jobs=1): err= 0: pid=1156698: Wed Nov 20 01:20:30 2024 00:19:22.981 read: IOPS=4776, BW=18.7MiB/s (19.6MB/s)(18.8MiB/1005msec) 00:19:22.981 slat (usec): min=2, max=12236, avg=96.37, stdev=686.13 00:19:22.982 clat (usec): min=3423, max=25867, avg=13041.05, stdev=3283.93 00:19:22.982 lat (usec): min=3431, max=25881, avg=13137.42, stdev=3316.30 00:19:22.982 clat percentiles (usec): 00:19:22.982 | 1.00th=[ 4948], 5.00th=[ 8717], 10.00th=[ 9372], 20.00th=[10814], 00:19:22.982 | 30.00th=[11994], 40.00th=[12518], 50.00th=[12780], 60.00th=[13173], 00:19:22.982 | 70.00th=[13960], 80.00th=[15139], 90.00th=[16909], 95.00th=[19268], 00:19:22.982 | 99.00th=[23725], 99.50th=[24773], 99.90th=[25822], 99.95th=[25822], 00:19:22.982 | 99.99th=[25822] 00:19:22.982 write: IOPS=5094, BW=19.9MiB/s (20.9MB/s)(20.0MiB/1005msec); 0 zone resets 00:19:22.982 slat (usec): min=4, max=11607, avg=89.74, stdev=585.50 00:19:22.982 clat (usec): min=290, max=25822, avg=12644.08, stdev=2759.44 00:19:22.982 lat (usec): min=871, max=25855, avg=12733.82, stdev=2806.56 00:19:22.982 clat percentiles (usec): 00:19:22.982 | 1.00th=[ 4146], 5.00th=[ 6521], 10.00th=[ 9110], 20.00th=[11469], 00:19:22.982 | 30.00th=[12256], 40.00th=[12518], 50.00th=[12780], 60.00th=[13566], 00:19:22.982 | 70.00th=[14222], 80.00th=[14615], 90.00th=[15008], 95.00th=[15401], 00:19:22.982 | 99.00th=[19268], 99.50th=[20579], 99.90th=[25297], 99.95th=[25560], 00:19:22.982 | 99.99th=[25822] 00:19:22.982 bw ( KiB/s): min=19560, max=21400, per=28.02%, avg=20480.00, stdev=1301.08, samples=2 00:19:22.982 iops : min= 4890, max= 5350, avg=5120.00, stdev=325.27, samples=2 00:19:22.982 lat (usec) : 500=0.02% 00:19:22.982 lat (msec) : 2=0.19%, 4=0.39%, 10=13.41%, 20=83.68%, 50=2.31% 00:19:22.982 cpu : usr=6.47%, sys=9.56%, ctx=431, majf=0, minf=1 00:19:22.982 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:19:22.982 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:22.982 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:22.982 issued rwts: total=4800,5120,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:22.982 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:22.982 job3: (groupid=0, jobs=1): err= 0: pid=1156699: Wed Nov 20 01:20:30 2024 00:19:22.982 read: IOPS=4108, BW=16.0MiB/s (16.8MB/s)(16.7MiB/1043msec) 00:19:22.982 slat (usec): min=2, max=14609, avg=107.83, stdev=734.23 00:19:22.982 clat (usec): min=3875, max=55678, avg=14811.32, stdev=7122.93 00:19:22.982 lat (usec): min=3882, max=62359, avg=14919.16, stdev=7157.43 00:19:22.982 clat percentiles (usec): 00:19:22.982 | 1.00th=[ 7570], 5.00th=[10290], 10.00th=[11076], 20.00th=[11863], 00:19:22.982 | 30.00th=[12387], 40.00th=[12518], 50.00th=[12911], 60.00th=[13566], 00:19:22.982 | 70.00th=[14484], 80.00th=[15795], 90.00th=[17957], 95.00th=[22938], 00:19:22.982 | 99.00th=[54789], 99.50th=[55313], 99.90th=[55837], 99.95th=[55837], 00:19:22.982 | 99.99th=[55837] 00:19:22.982 write: IOPS=4418, BW=17.3MiB/s (18.1MB/s)(18.0MiB/1043msec); 0 zone resets 00:19:22.982 slat (usec): min=4, max=27909, avg=105.08, stdev=753.33 00:19:22.982 clat (usec): min=1757, max=49941, avg=14880.71, stdev=5651.97 00:19:22.982 lat (usec): min=3030, max=49958, avg=14985.79, stdev=5684.60 00:19:22.982 clat percentiles (usec): 00:19:22.982 | 1.00th=[ 3064], 5.00th=[ 6390], 10.00th=[10945], 20.00th=[12387], 00:19:22.982 | 30.00th=[12518], 40.00th=[12911], 50.00th=[13960], 60.00th=[15270], 00:19:22.982 | 70.00th=[15926], 80.00th=[16450], 90.00th=[21103], 95.00th=[22152], 00:19:22.982 | 99.00th=[40109], 99.50th=[45876], 99.90th=[49546], 99.95th=[49546], 00:19:22.982 | 99.99th=[50070] 00:19:22.982 bw ( KiB/s): min=18384, max=18480, per=25.22%, avg=18432.00, stdev=67.88, samples=2 00:19:22.982 iops : min= 4596, max= 4620, avg=4608.00, stdev=16.97, samples=2 00:19:22.982 lat (msec) : 2=0.01%, 4=1.47%, 10=5.30%, 20=83.82%, 50=8.69% 00:19:22.982 lat (msec) : 100=0.71% 00:19:22.982 cpu : usr=5.66%, sys=10.84%, ctx=465, majf=0, minf=1 00:19:22.982 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:19:22.982 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:22.982 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:22.982 issued rwts: total=4285,4608,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:22.982 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:22.982 00:19:22.982 Run status group 0 (all jobs): 00:19:22.982 READ: bw=68.5MiB/s (71.8MB/s), 16.0MiB/s-18.7MiB/s (16.8MB/s-19.6MB/s), io=71.5MiB (74.9MB), run=1001-1043msec 00:19:22.982 WRITE: bw=71.4MiB/s (74.8MB/s), 17.3MiB/s-19.9MiB/s (18.1MB/s-20.9MB/s), io=74.4MiB (78.1MB), run=1001-1043msec 00:19:22.982 00:19:22.982 Disk stats (read/write): 00:19:22.982 nvme0n1: ios=3634/4081, merge=0/0, ticks=30601/35025, in_queue=65626, util=86.77% 00:19:22.982 nvme0n2: ios=3604/3834, merge=0/0, ticks=28610/33576, in_queue=62186, util=85.08% 00:19:22.982 nvme0n3: ios=4152/4399, merge=0/0, ticks=39754/41185, in_queue=80939, util=98.12% 00:19:22.982 nvme0n4: ios=3642/4020, merge=0/0, ticks=29574/37554, in_queue=67128, util=98.21% 00:19:22.982 01:20:30 -- target/fio.sh@55 -- # sync 00:19:22.982 01:20:30 -- target/fio.sh@59 -- # fio_pid=1156835 00:19:22.982 01:20:30 -- target/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:19:22.982 01:20:30 -- target/fio.sh@61 -- # sleep 3 00:19:22.982 [global] 00:19:22.982 thread=1 00:19:22.982 invalidate=1 00:19:22.982 rw=read 00:19:22.982 time_based=1 00:19:22.982 runtime=10 00:19:22.982 ioengine=libaio 00:19:22.982 direct=1 00:19:22.982 bs=4096 00:19:22.982 iodepth=1 00:19:22.982 norandommap=1 00:19:22.982 numjobs=1 00:19:22.982 00:19:22.982 [job0] 00:19:22.982 filename=/dev/nvme0n1 00:19:22.982 [job1] 00:19:22.982 filename=/dev/nvme0n2 00:19:22.982 [job2] 00:19:22.982 filename=/dev/nvme0n3 00:19:22.982 [job3] 00:19:22.982 filename=/dev/nvme0n4 00:19:22.982 Could not set queue depth (nvme0n1) 00:19:22.982 Could not set queue depth (nvme0n2) 00:19:22.982 Could not set queue depth (nvme0n3) 00:19:22.982 Could not set queue depth (nvme0n4) 00:19:22.982 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:22.982 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:22.982 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:22.982 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:22.982 fio-3.35 00:19:22.982 Starting 4 threads 00:19:26.269 01:20:33 -- target/fio.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete concat0 00:19:26.269 01:20:34 -- target/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete raid0 00:19:26.269 fio: io_u error on file /dev/nvme0n4: Operation not supported: read offset=37445632, buflen=4096 00:19:26.269 fio: pid=1156930, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:19:26.527 01:20:34 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:26.527 01:20:34 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:19:26.527 fio: io_u error on file /dev/nvme0n3: Operation not supported: read offset=11849728, buflen=4096 00:19:26.527 fio: pid=1156929, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:19:26.786 fio: io_u error on file /dev/nvme0n1: Operation not supported: read offset=56418304, buflen=4096 00:19:26.786 fio: pid=1156923, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:19:26.786 01:20:34 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:26.786 01:20:34 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:19:27.044 fio: io_u error on file /dev/nvme0n2: Input/output error: read offset=9535488, buflen=4096 00:19:27.044 fio: pid=1156924, err=5/file:io_u.c:1889, func=io_u error, error=Input/output error 00:19:27.044 01:20:35 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:27.044 01:20:35 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:19:27.044 00:19:27.044 job0: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=1156923: Wed Nov 20 01:20:35 2024 00:19:27.044 read: IOPS=3934, BW=15.4MiB/s (16.1MB/s)(53.8MiB/3501msec) 00:19:27.044 slat (usec): min=4, max=13764, avg=13.55, stdev=191.51 00:19:27.044 clat (usec): min=172, max=2922, avg=236.69, stdev=55.22 00:19:27.044 lat (usec): min=179, max=13992, avg=250.24, stdev=200.66 00:19:27.044 clat percentiles (usec): 00:19:27.044 | 1.00th=[ 186], 5.00th=[ 192], 10.00th=[ 194], 20.00th=[ 200], 00:19:27.044 | 30.00th=[ 206], 40.00th=[ 210], 50.00th=[ 217], 60.00th=[ 225], 00:19:27.044 | 70.00th=[ 239], 80.00th=[ 277], 90.00th=[ 318], 95.00th=[ 338], 00:19:27.044 | 99.00th=[ 383], 99.50th=[ 392], 99.90th=[ 429], 99.95th=[ 461], 00:19:27.044 | 99.99th=[ 1516] 00:19:27.044 bw ( KiB/s): min=13232, max=18488, per=53.78%, avg=16022.67, stdev=2308.14, samples=6 00:19:27.044 iops : min= 3308, max= 4622, avg=4005.67, stdev=577.03, samples=6 00:19:27.044 lat (usec) : 250=75.64%, 500=24.34% 00:19:27.044 lat (msec) : 2=0.01%, 4=0.01% 00:19:27.044 cpu : usr=1.83%, sys=4.51%, ctx=13781, majf=0, minf=1 00:19:27.044 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:27.044 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:27.044 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:27.044 issued rwts: total=13775,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:27.044 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:27.044 job1: (groupid=0, jobs=1): err= 5 (file:io_u.c:1889, func=io_u error, error=Input/output error): pid=1156924: Wed Nov 20 01:20:35 2024 00:19:27.044 read: IOPS=616, BW=2465KiB/s (2524kB/s)(9312KiB/3778msec) 00:19:27.044 slat (usec): min=3, max=20806, avg=22.63, stdev=455.62 00:19:27.044 clat (usec): min=174, max=42020, avg=1597.37, stdev=7182.82 00:19:27.044 lat (usec): min=179, max=61939, avg=1616.94, stdev=7245.70 00:19:27.044 clat percentiles (usec): 00:19:27.044 | 1.00th=[ 184], 5.00th=[ 194], 10.00th=[ 206], 20.00th=[ 233], 00:19:27.044 | 30.00th=[ 243], 40.00th=[ 251], 50.00th=[ 262], 60.00th=[ 277], 00:19:27.044 | 70.00th=[ 306], 80.00th=[ 338], 90.00th=[ 404], 95.00th=[ 537], 00:19:27.044 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:19:27.044 | 99.99th=[42206] 00:19:27.044 bw ( KiB/s): min= 104, max=13712, per=8.76%, avg=2609.86, stdev=4959.67, samples=7 00:19:27.044 iops : min= 26, max= 3428, avg=652.43, stdev=1239.93, samples=7 00:19:27.044 lat (usec) : 250=38.13%, 500=55.82%, 750=2.66%, 1000=0.09% 00:19:27.044 lat (msec) : 20=0.04%, 50=3.22% 00:19:27.044 cpu : usr=0.19%, sys=1.24%, ctx=2332, majf=0, minf=2 00:19:27.044 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:27.044 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:27.044 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:27.044 issued rwts: total=2329,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:27.044 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:27.044 job2: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=1156929: Wed Nov 20 01:20:35 2024 00:19:27.044 read: IOPS=896, BW=3585KiB/s (3671kB/s)(11.3MiB/3228msec) 00:19:27.044 slat (nsec): min=4228, max=63664, avg=10391.00, stdev=7177.59 00:19:27.045 clat (usec): min=170, max=42105, avg=1095.00, stdev=5771.20 00:19:27.045 lat (usec): min=176, max=42127, avg=1105.39, stdev=5772.21 00:19:27.045 clat percentiles (usec): 00:19:27.045 | 1.00th=[ 186], 5.00th=[ 200], 10.00th=[ 208], 20.00th=[ 219], 00:19:27.045 | 30.00th=[ 227], 40.00th=[ 235], 50.00th=[ 245], 60.00th=[ 269], 00:19:27.045 | 70.00th=[ 285], 80.00th=[ 306], 90.00th=[ 388], 95.00th=[ 490], 00:19:27.045 | 99.00th=[41157], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:27.045 | 99.99th=[42206] 00:19:27.045 bw ( KiB/s): min= 88, max=13760, per=9.47%, avg=2821.33, stdev=5464.07, samples=6 00:19:27.045 iops : min= 22, max= 3440, avg=705.33, stdev=1366.02, samples=6 00:19:27.045 lat (usec) : 250=52.83%, 500=42.88%, 750=2.21%, 1000=0.03% 00:19:27.045 lat (msec) : 50=2.00% 00:19:27.045 cpu : usr=0.34%, sys=1.08%, ctx=2894, majf=0, minf=2 00:19:27.045 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:27.045 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:27.045 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:27.045 issued rwts: total=2894,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:27.045 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:27.045 job3: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=1156930: Wed Nov 20 01:20:35 2024 00:19:27.045 read: IOPS=3146, BW=12.3MiB/s (12.9MB/s)(35.7MiB/2906msec) 00:19:27.045 slat (nsec): min=4082, max=69377, avg=12627.92, stdev=7819.63 00:19:27.045 clat (usec): min=186, max=641, avg=299.65, stdev=73.69 00:19:27.045 lat (usec): min=191, max=660, avg=312.28, stdev=76.29 00:19:27.045 clat percentiles (usec): 00:19:27.045 | 1.00th=[ 196], 5.00th=[ 204], 10.00th=[ 212], 20.00th=[ 231], 00:19:27.045 | 30.00th=[ 255], 40.00th=[ 273], 50.00th=[ 293], 60.00th=[ 306], 00:19:27.045 | 70.00th=[ 326], 80.00th=[ 367], 90.00th=[ 388], 95.00th=[ 441], 00:19:27.045 | 99.00th=[ 519], 99.50th=[ 537], 99.90th=[ 594], 99.95th=[ 603], 00:19:27.045 | 99.99th=[ 644] 00:19:27.045 bw ( KiB/s): min=12160, max=14456, per=44.31%, avg=13201.60, stdev=858.06, samples=5 00:19:27.045 iops : min= 3040, max= 3614, avg=3300.40, stdev=214.52, samples=5 00:19:27.045 lat (usec) : 250=28.33%, 500=69.89%, 750=1.77% 00:19:27.045 cpu : usr=1.55%, sys=4.72%, ctx=9143, majf=0, minf=1 00:19:27.045 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:27.045 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:27.045 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:27.045 issued rwts: total=9143,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:27.045 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:27.045 00:19:27.045 Run status group 0 (all jobs): 00:19:27.045 READ: bw=29.1MiB/s (30.5MB/s), 2465KiB/s-15.4MiB/s (2524kB/s-16.1MB/s), io=110MiB (115MB), run=2906-3778msec 00:19:27.045 00:19:27.045 Disk stats (read/write): 00:19:27.045 nvme0n1: ios=13267/0, merge=0/0, ticks=4110/0, in_queue=4110, util=98.11% 00:19:27.045 nvme0n2: ios=2323/0, merge=0/0, ticks=3495/0, in_queue=3495, util=96.01% 00:19:27.045 nvme0n3: ios=2514/0, merge=0/0, ticks=3052/0, in_queue=3052, util=96.76% 00:19:27.045 nvme0n4: ios=9083/0, merge=0/0, ticks=2612/0, in_queue=2612, util=96.71% 00:19:27.303 01:20:35 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:27.303 01:20:35 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:19:27.561 01:20:35 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:27.561 01:20:35 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:19:27.820 01:20:35 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:27.820 01:20:35 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:19:28.079 01:20:36 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:28.079 01:20:36 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:19:28.337 01:20:36 -- target/fio.sh@69 -- # fio_status=0 00:19:28.337 01:20:36 -- target/fio.sh@70 -- # wait 1156835 00:19:28.337 01:20:36 -- target/fio.sh@70 -- # fio_status=4 00:19:28.337 01:20:36 -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:19:28.337 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:19:28.337 01:20:36 -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:19:28.337 01:20:36 -- common/autotest_common.sh@1208 -- # local i=0 00:19:28.337 01:20:36 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:28.337 01:20:36 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:28.337 01:20:36 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:28.337 01:20:36 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:28.337 01:20:36 -- common/autotest_common.sh@1220 -- # return 0 00:19:28.337 01:20:36 -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:19:28.337 01:20:36 -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:19:28.337 nvmf hotplug test: fio failed as expected 00:19:28.337 01:20:36 -- target/fio.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:28.595 01:20:36 -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:19:28.595 01:20:36 -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:19:28.595 01:20:36 -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:19:28.595 01:20:36 -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:19:28.595 01:20:36 -- target/fio.sh@91 -- # nvmftestfini 00:19:28.595 01:20:36 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:28.595 01:20:36 -- nvmf/common.sh@116 -- # sync 00:19:28.595 01:20:36 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:28.595 01:20:36 -- nvmf/common.sh@119 -- # set +e 00:19:28.595 01:20:36 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:28.595 01:20:36 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:28.595 rmmod nvme_tcp 00:19:28.595 rmmod nvme_fabrics 00:19:28.595 rmmod nvme_keyring 00:19:28.595 01:20:36 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:28.595 01:20:36 -- nvmf/common.sh@123 -- # set -e 00:19:28.595 01:20:36 -- nvmf/common.sh@124 -- # return 0 00:19:28.595 01:20:36 -- nvmf/common.sh@477 -- # '[' -n 1154750 ']' 00:19:28.595 01:20:36 -- nvmf/common.sh@478 -- # killprocess 1154750 00:19:28.595 01:20:36 -- common/autotest_common.sh@936 -- # '[' -z 1154750 ']' 00:19:28.595 01:20:36 -- common/autotest_common.sh@940 -- # kill -0 1154750 00:19:28.595 01:20:36 -- common/autotest_common.sh@941 -- # uname 00:19:28.595 01:20:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:28.595 01:20:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1154750 00:19:28.854 01:20:36 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:28.854 01:20:36 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:28.854 01:20:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1154750' 00:19:28.854 killing process with pid 1154750 00:19:28.854 01:20:36 -- common/autotest_common.sh@955 -- # kill 1154750 00:19:28.854 01:20:36 -- common/autotest_common.sh@960 -- # wait 1154750 00:19:29.114 01:20:37 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:29.114 01:20:37 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:29.114 01:20:37 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:29.114 01:20:37 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:29.114 01:20:37 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:29.114 01:20:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:29.114 01:20:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:29.114 01:20:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:31.020 01:20:39 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:31.020 00:19:31.020 real 0m24.562s 00:19:31.020 user 1m24.720s 00:19:31.020 sys 0m8.208s 00:19:31.020 01:20:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:31.020 01:20:39 -- common/autotest_common.sh@10 -- # set +x 00:19:31.020 ************************************ 00:19:31.020 END TEST nvmf_fio_target 00:19:31.020 ************************************ 00:19:31.020 01:20:39 -- nvmf/nvmf.sh@55 -- # run_test nvmf_bdevio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:19:31.020 01:20:39 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:31.020 01:20:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:31.020 01:20:39 -- common/autotest_common.sh@10 -- # set +x 00:19:31.020 ************************************ 00:19:31.020 START TEST nvmf_bdevio 00:19:31.020 ************************************ 00:19:31.020 01:20:39 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:19:31.020 * Looking for test storage... 00:19:31.020 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:31.020 01:20:39 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:31.020 01:20:39 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:31.020 01:20:39 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:31.281 01:20:39 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:31.281 01:20:39 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:31.281 01:20:39 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:31.281 01:20:39 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:31.281 01:20:39 -- scripts/common.sh@335 -- # IFS=.-: 00:19:31.281 01:20:39 -- scripts/common.sh@335 -- # read -ra ver1 00:19:31.281 01:20:39 -- scripts/common.sh@336 -- # IFS=.-: 00:19:31.281 01:20:39 -- scripts/common.sh@336 -- # read -ra ver2 00:19:31.281 01:20:39 -- scripts/common.sh@337 -- # local 'op=<' 00:19:31.281 01:20:39 -- scripts/common.sh@339 -- # ver1_l=2 00:19:31.281 01:20:39 -- scripts/common.sh@340 -- # ver2_l=1 00:19:31.281 01:20:39 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:31.281 01:20:39 -- scripts/common.sh@343 -- # case "$op" in 00:19:31.281 01:20:39 -- scripts/common.sh@344 -- # : 1 00:19:31.281 01:20:39 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:31.281 01:20:39 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:31.281 01:20:39 -- scripts/common.sh@364 -- # decimal 1 00:19:31.281 01:20:39 -- scripts/common.sh@352 -- # local d=1 00:19:31.281 01:20:39 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:31.281 01:20:39 -- scripts/common.sh@354 -- # echo 1 00:19:31.281 01:20:39 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:31.281 01:20:39 -- scripts/common.sh@365 -- # decimal 2 00:19:31.281 01:20:39 -- scripts/common.sh@352 -- # local d=2 00:19:31.281 01:20:39 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:31.281 01:20:39 -- scripts/common.sh@354 -- # echo 2 00:19:31.281 01:20:39 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:31.281 01:20:39 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:31.281 01:20:39 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:31.281 01:20:39 -- scripts/common.sh@367 -- # return 0 00:19:31.281 01:20:39 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:31.281 01:20:39 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:31.281 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:31.281 --rc genhtml_branch_coverage=1 00:19:31.281 --rc genhtml_function_coverage=1 00:19:31.281 --rc genhtml_legend=1 00:19:31.281 --rc geninfo_all_blocks=1 00:19:31.281 --rc geninfo_unexecuted_blocks=1 00:19:31.281 00:19:31.281 ' 00:19:31.281 01:20:39 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:31.281 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:31.281 --rc genhtml_branch_coverage=1 00:19:31.281 --rc genhtml_function_coverage=1 00:19:31.281 --rc genhtml_legend=1 00:19:31.281 --rc geninfo_all_blocks=1 00:19:31.281 --rc geninfo_unexecuted_blocks=1 00:19:31.281 00:19:31.281 ' 00:19:31.281 01:20:39 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:31.281 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:31.281 --rc genhtml_branch_coverage=1 00:19:31.281 --rc genhtml_function_coverage=1 00:19:31.281 --rc genhtml_legend=1 00:19:31.281 --rc geninfo_all_blocks=1 00:19:31.281 --rc geninfo_unexecuted_blocks=1 00:19:31.281 00:19:31.281 ' 00:19:31.281 01:20:39 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:31.281 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:31.281 --rc genhtml_branch_coverage=1 00:19:31.281 --rc genhtml_function_coverage=1 00:19:31.281 --rc genhtml_legend=1 00:19:31.281 --rc geninfo_all_blocks=1 00:19:31.281 --rc geninfo_unexecuted_blocks=1 00:19:31.281 00:19:31.281 ' 00:19:31.281 01:20:39 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:31.281 01:20:39 -- nvmf/common.sh@7 -- # uname -s 00:19:31.281 01:20:39 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:31.281 01:20:39 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:31.281 01:20:39 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:31.281 01:20:39 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:31.281 01:20:39 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:31.281 01:20:39 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:31.281 01:20:39 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:31.281 01:20:39 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:31.281 01:20:39 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:31.281 01:20:39 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:31.281 01:20:39 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:31.281 01:20:39 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:31.281 01:20:39 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:31.281 01:20:39 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:31.281 01:20:39 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:31.281 01:20:39 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:31.281 01:20:39 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:31.281 01:20:39 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:31.281 01:20:39 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:31.281 01:20:39 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:31.281 01:20:39 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:31.281 01:20:39 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:31.281 01:20:39 -- paths/export.sh@5 -- # export PATH 00:19:31.281 01:20:39 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:31.281 01:20:39 -- nvmf/common.sh@46 -- # : 0 00:19:31.281 01:20:39 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:31.281 01:20:39 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:31.281 01:20:39 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:31.282 01:20:39 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:31.282 01:20:39 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:31.282 01:20:39 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:31.282 01:20:39 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:31.282 01:20:39 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:31.282 01:20:39 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:31.282 01:20:39 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:31.282 01:20:39 -- target/bdevio.sh@14 -- # nvmftestinit 00:19:31.282 01:20:39 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:31.282 01:20:39 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:31.282 01:20:39 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:31.282 01:20:39 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:31.282 01:20:39 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:31.282 01:20:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:31.282 01:20:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:31.282 01:20:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:31.282 01:20:39 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:31.282 01:20:39 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:31.282 01:20:39 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:31.282 01:20:39 -- common/autotest_common.sh@10 -- # set +x 00:19:33.814 01:20:41 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:33.814 01:20:41 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:33.814 01:20:41 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:33.814 01:20:41 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:33.814 01:20:41 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:33.814 01:20:41 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:33.814 01:20:41 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:33.814 01:20:41 -- nvmf/common.sh@294 -- # net_devs=() 00:19:33.814 01:20:41 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:33.814 01:20:41 -- nvmf/common.sh@295 -- # e810=() 00:19:33.814 01:20:41 -- nvmf/common.sh@295 -- # local -ga e810 00:19:33.814 01:20:41 -- nvmf/common.sh@296 -- # x722=() 00:19:33.814 01:20:41 -- nvmf/common.sh@296 -- # local -ga x722 00:19:33.814 01:20:41 -- nvmf/common.sh@297 -- # mlx=() 00:19:33.814 01:20:41 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:33.814 01:20:41 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:33.814 01:20:41 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:33.814 01:20:41 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:33.814 01:20:41 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:33.814 01:20:41 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:33.814 01:20:41 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:33.814 01:20:41 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:33.814 01:20:41 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:33.814 01:20:41 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:33.814 01:20:41 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:33.814 01:20:41 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:33.814 01:20:41 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:33.814 01:20:41 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:33.814 01:20:41 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:33.814 01:20:41 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:33.814 01:20:41 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:33.814 01:20:41 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:33.814 01:20:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:33.814 01:20:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:33.814 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:33.814 01:20:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:33.814 01:20:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:33.814 01:20:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:33.814 01:20:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:33.814 01:20:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:33.814 01:20:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:33.814 01:20:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:33.814 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:33.814 01:20:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:33.814 01:20:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:33.814 01:20:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:33.814 01:20:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:33.814 01:20:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:33.814 01:20:41 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:33.814 01:20:41 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:33.814 01:20:41 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:33.814 01:20:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:33.814 01:20:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:33.814 01:20:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:33.814 01:20:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:33.814 01:20:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:33.814 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:33.814 01:20:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:33.814 01:20:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:33.814 01:20:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:33.814 01:20:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:33.814 01:20:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:33.814 01:20:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:33.814 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:33.815 01:20:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:33.815 01:20:41 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:33.815 01:20:41 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:33.815 01:20:41 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:33.815 01:20:41 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:33.815 01:20:41 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:33.815 01:20:41 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:33.815 01:20:41 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:33.815 01:20:41 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:33.815 01:20:41 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:33.815 01:20:41 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:33.815 01:20:41 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:33.815 01:20:41 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:33.815 01:20:41 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:33.815 01:20:41 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:33.815 01:20:41 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:33.815 01:20:41 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:33.815 01:20:41 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:33.815 01:20:41 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:33.815 01:20:41 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:33.815 01:20:41 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:33.815 01:20:41 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:33.815 01:20:41 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:33.815 01:20:41 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:33.815 01:20:41 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:33.815 01:20:41 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:33.815 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:33.815 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.257 ms 00:19:33.815 00:19:33.815 --- 10.0.0.2 ping statistics --- 00:19:33.815 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:33.815 rtt min/avg/max/mdev = 0.257/0.257/0.257/0.000 ms 00:19:33.815 01:20:41 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:33.815 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:33.815 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.089 ms 00:19:33.815 00:19:33.815 --- 10.0.0.1 ping statistics --- 00:19:33.815 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:33.815 rtt min/avg/max/mdev = 0.089/0.089/0.089/0.000 ms 00:19:33.815 01:20:41 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:33.815 01:20:41 -- nvmf/common.sh@410 -- # return 0 00:19:33.815 01:20:41 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:33.815 01:20:41 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:33.815 01:20:41 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:33.815 01:20:41 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:33.815 01:20:41 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:33.815 01:20:41 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:33.815 01:20:41 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:33.815 01:20:41 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:19:33.815 01:20:41 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:33.815 01:20:41 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:33.815 01:20:41 -- common/autotest_common.sh@10 -- # set +x 00:19:33.815 01:20:41 -- nvmf/common.sh@469 -- # nvmfpid=1159637 00:19:33.815 01:20:41 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:19:33.815 01:20:41 -- nvmf/common.sh@470 -- # waitforlisten 1159637 00:19:33.815 01:20:41 -- common/autotest_common.sh@829 -- # '[' -z 1159637 ']' 00:19:33.815 01:20:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:33.815 01:20:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:33.815 01:20:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:33.815 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:33.815 01:20:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:33.815 01:20:41 -- common/autotest_common.sh@10 -- # set +x 00:19:33.815 [2024-11-20 01:20:41.662713] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:19:33.815 [2024-11-20 01:20:41.662788] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:33.815 EAL: No free 2048 kB hugepages reported on node 1 00:19:33.815 [2024-11-20 01:20:41.731903] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:33.815 [2024-11-20 01:20:41.825657] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:33.815 [2024-11-20 01:20:41.825807] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:33.815 [2024-11-20 01:20:41.825827] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:33.815 [2024-11-20 01:20:41.825841] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:33.815 [2024-11-20 01:20:41.825936] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:19:33.815 [2024-11-20 01:20:41.825995] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:19:33.815 [2024-11-20 01:20:41.826047] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:19:33.815 [2024-11-20 01:20:41.826050] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:34.748 01:20:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:34.748 01:20:42 -- common/autotest_common.sh@862 -- # return 0 00:19:34.748 01:20:42 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:34.748 01:20:42 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:34.748 01:20:42 -- common/autotest_common.sh@10 -- # set +x 00:19:34.748 01:20:42 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:34.748 01:20:42 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:34.748 01:20:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:34.748 01:20:42 -- common/autotest_common.sh@10 -- # set +x 00:19:34.748 [2024-11-20 01:20:42.638566] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:34.748 01:20:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:34.748 01:20:42 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:34.748 01:20:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:34.748 01:20:42 -- common/autotest_common.sh@10 -- # set +x 00:19:34.748 Malloc0 00:19:34.748 01:20:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:34.748 01:20:42 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:19:34.748 01:20:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:34.748 01:20:42 -- common/autotest_common.sh@10 -- # set +x 00:19:34.748 01:20:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:34.748 01:20:42 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:34.748 01:20:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:34.748 01:20:42 -- common/autotest_common.sh@10 -- # set +x 00:19:34.748 01:20:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:34.748 01:20:42 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:34.748 01:20:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:34.748 01:20:42 -- common/autotest_common.sh@10 -- # set +x 00:19:34.748 [2024-11-20 01:20:42.689820] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:34.748 01:20:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:34.748 01:20:42 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:19:34.748 01:20:42 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:19:34.748 01:20:42 -- nvmf/common.sh@520 -- # config=() 00:19:34.748 01:20:42 -- nvmf/common.sh@520 -- # local subsystem config 00:19:34.748 01:20:42 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:19:34.748 01:20:42 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:19:34.748 { 00:19:34.748 "params": { 00:19:34.748 "name": "Nvme$subsystem", 00:19:34.748 "trtype": "$TEST_TRANSPORT", 00:19:34.748 "traddr": "$NVMF_FIRST_TARGET_IP", 00:19:34.748 "adrfam": "ipv4", 00:19:34.748 "trsvcid": "$NVMF_PORT", 00:19:34.748 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:19:34.748 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:19:34.748 "hdgst": ${hdgst:-false}, 00:19:34.748 "ddgst": ${ddgst:-false} 00:19:34.748 }, 00:19:34.748 "method": "bdev_nvme_attach_controller" 00:19:34.748 } 00:19:34.748 EOF 00:19:34.748 )") 00:19:34.748 01:20:42 -- nvmf/common.sh@542 -- # cat 00:19:34.748 01:20:42 -- nvmf/common.sh@544 -- # jq . 00:19:34.748 01:20:42 -- nvmf/common.sh@545 -- # IFS=, 00:19:34.748 01:20:42 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:19:34.748 "params": { 00:19:34.748 "name": "Nvme1", 00:19:34.748 "trtype": "tcp", 00:19:34.748 "traddr": "10.0.0.2", 00:19:34.748 "adrfam": "ipv4", 00:19:34.748 "trsvcid": "4420", 00:19:34.748 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:34.748 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:34.748 "hdgst": false, 00:19:34.748 "ddgst": false 00:19:34.748 }, 00:19:34.748 "method": "bdev_nvme_attach_controller" 00:19:34.748 }' 00:19:34.748 [2024-11-20 01:20:42.732031] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:19:34.748 [2024-11-20 01:20:42.732145] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1159750 ] 00:19:34.748 EAL: No free 2048 kB hugepages reported on node 1 00:19:34.748 [2024-11-20 01:20:42.796834] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:19:34.748 [2024-11-20 01:20:42.884208] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:34.748 [2024-11-20 01:20:42.884258] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:34.748 [2024-11-20 01:20:42.884262] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:35.007 [2024-11-20 01:20:43.180917] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:19:35.007 [2024-11-20 01:20:43.180975] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:19:35.007 I/O targets: 00:19:35.007 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:19:35.007 00:19:35.007 00:19:35.007 CUnit - A unit testing framework for C - Version 2.1-3 00:19:35.007 http://cunit.sourceforge.net/ 00:19:35.007 00:19:35.007 00:19:35.007 Suite: bdevio tests on: Nvme1n1 00:19:35.265 Test: blockdev write read block ...passed 00:19:35.265 Test: blockdev write zeroes read block ...passed 00:19:35.265 Test: blockdev write zeroes read no split ...passed 00:19:35.265 Test: blockdev write zeroes read split ...passed 00:19:35.265 Test: blockdev write zeroes read split partial ...passed 00:19:35.265 Test: blockdev reset ...[2024-11-20 01:20:43.377913] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:19:35.265 [2024-11-20 01:20:43.378017] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x236ee40 (9): Bad file descriptor 00:19:35.265 [2024-11-20 01:20:43.472155] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:19:35.265 passed 00:19:35.265 Test: blockdev write read 8 blocks ...passed 00:19:35.265 Test: blockdev write read size > 128k ...passed 00:19:35.265 Test: blockdev write read invalid size ...passed 00:19:35.522 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:19:35.522 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:19:35.522 Test: blockdev write read max offset ...passed 00:19:35.522 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:19:35.522 Test: blockdev writev readv 8 blocks ...passed 00:19:35.522 Test: blockdev writev readv 30 x 1block ...passed 00:19:35.522 Test: blockdev writev readv block ...passed 00:19:35.522 Test: blockdev writev readv size > 128k ...passed 00:19:35.780 Test: blockdev writev readv size > 128k in two iovs ...passed 00:19:35.780 Test: blockdev comparev and writev ...[2024-11-20 01:20:43.766121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:35.780 [2024-11-20 01:20:43.766156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:19:35.780 [2024-11-20 01:20:43.766181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:35.780 [2024-11-20 01:20:43.766199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:19:35.780 [2024-11-20 01:20:43.766508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:35.780 [2024-11-20 01:20:43.766541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:19:35.780 [2024-11-20 01:20:43.766563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:35.780 [2024-11-20 01:20:43.766580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:19:35.780 [2024-11-20 01:20:43.766873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:35.780 [2024-11-20 01:20:43.766897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:19:35.780 [2024-11-20 01:20:43.766918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:35.780 [2024-11-20 01:20:43.766934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:19:35.780 [2024-11-20 01:20:43.767233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:35.780 [2024-11-20 01:20:43.767258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:19:35.780 [2024-11-20 01:20:43.767280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:35.780 [2024-11-20 01:20:43.767296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:19:35.780 passed 00:19:35.780 Test: blockdev nvme passthru rw ...passed 00:19:35.780 Test: blockdev nvme passthru vendor specific ...[2024-11-20 01:20:43.850317] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:35.780 [2024-11-20 01:20:43.850345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:19:35.780 [2024-11-20 01:20:43.850491] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:35.780 [2024-11-20 01:20:43.850514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:19:35.780 [2024-11-20 01:20:43.850659] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:35.780 [2024-11-20 01:20:43.850681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:19:35.780 [2024-11-20 01:20:43.850824] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:35.780 [2024-11-20 01:20:43.850847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:19:35.780 passed 00:19:35.780 Test: blockdev nvme admin passthru ...passed 00:19:35.780 Test: blockdev copy ...passed 00:19:35.780 00:19:35.780 Run Summary: Type Total Ran Passed Failed Inactive 00:19:35.780 suites 1 1 n/a 0 0 00:19:35.780 tests 23 23 23 0 0 00:19:35.780 asserts 152 152 152 0 n/a 00:19:35.780 00:19:35.780 Elapsed time = 1.459 seconds 00:19:36.038 01:20:44 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:36.038 01:20:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.038 01:20:44 -- common/autotest_common.sh@10 -- # set +x 00:19:36.038 01:20:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.038 01:20:44 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:19:36.038 01:20:44 -- target/bdevio.sh@30 -- # nvmftestfini 00:19:36.038 01:20:44 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:36.038 01:20:44 -- nvmf/common.sh@116 -- # sync 00:19:36.038 01:20:44 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:36.038 01:20:44 -- nvmf/common.sh@119 -- # set +e 00:19:36.038 01:20:44 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:36.038 01:20:44 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:36.038 rmmod nvme_tcp 00:19:36.038 rmmod nvme_fabrics 00:19:36.038 rmmod nvme_keyring 00:19:36.038 01:20:44 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:36.038 01:20:44 -- nvmf/common.sh@123 -- # set -e 00:19:36.038 01:20:44 -- nvmf/common.sh@124 -- # return 0 00:19:36.038 01:20:44 -- nvmf/common.sh@477 -- # '[' -n 1159637 ']' 00:19:36.038 01:20:44 -- nvmf/common.sh@478 -- # killprocess 1159637 00:19:36.038 01:20:44 -- common/autotest_common.sh@936 -- # '[' -z 1159637 ']' 00:19:36.038 01:20:44 -- common/autotest_common.sh@940 -- # kill -0 1159637 00:19:36.038 01:20:44 -- common/autotest_common.sh@941 -- # uname 00:19:36.038 01:20:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:36.038 01:20:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1159637 00:19:36.038 01:20:44 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:19:36.038 01:20:44 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:19:36.038 01:20:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1159637' 00:19:36.038 killing process with pid 1159637 00:19:36.038 01:20:44 -- common/autotest_common.sh@955 -- # kill 1159637 00:19:36.038 01:20:44 -- common/autotest_common.sh@960 -- # wait 1159637 00:19:36.297 01:20:44 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:36.297 01:20:44 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:36.297 01:20:44 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:36.297 01:20:44 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:36.297 01:20:44 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:36.297 01:20:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:36.297 01:20:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:36.297 01:20:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:38.832 01:20:46 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:38.832 00:19:38.832 real 0m7.320s 00:19:38.832 user 0m13.997s 00:19:38.832 sys 0m2.230s 00:19:38.832 01:20:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:38.832 01:20:46 -- common/autotest_common.sh@10 -- # set +x 00:19:38.832 ************************************ 00:19:38.832 END TEST nvmf_bdevio 00:19:38.832 ************************************ 00:19:38.832 01:20:46 -- nvmf/nvmf.sh@57 -- # '[' tcp = tcp ']' 00:19:38.832 01:20:46 -- nvmf/nvmf.sh@58 -- # run_test nvmf_bdevio_no_huge /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:19:38.832 01:20:46 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:19:38.832 01:20:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:38.832 01:20:46 -- common/autotest_common.sh@10 -- # set +x 00:19:38.832 ************************************ 00:19:38.832 START TEST nvmf_bdevio_no_huge 00:19:38.832 ************************************ 00:19:38.832 01:20:46 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:19:38.832 * Looking for test storage... 00:19:38.832 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:38.832 01:20:46 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:38.832 01:20:46 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:38.832 01:20:46 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:38.832 01:20:46 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:38.832 01:20:46 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:38.832 01:20:46 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:38.832 01:20:46 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:38.832 01:20:46 -- scripts/common.sh@335 -- # IFS=.-: 00:19:38.832 01:20:46 -- scripts/common.sh@335 -- # read -ra ver1 00:19:38.832 01:20:46 -- scripts/common.sh@336 -- # IFS=.-: 00:19:38.832 01:20:46 -- scripts/common.sh@336 -- # read -ra ver2 00:19:38.832 01:20:46 -- scripts/common.sh@337 -- # local 'op=<' 00:19:38.832 01:20:46 -- scripts/common.sh@339 -- # ver1_l=2 00:19:38.832 01:20:46 -- scripts/common.sh@340 -- # ver2_l=1 00:19:38.832 01:20:46 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:38.832 01:20:46 -- scripts/common.sh@343 -- # case "$op" in 00:19:38.832 01:20:46 -- scripts/common.sh@344 -- # : 1 00:19:38.832 01:20:46 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:38.832 01:20:46 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:38.832 01:20:46 -- scripts/common.sh@364 -- # decimal 1 00:19:38.832 01:20:46 -- scripts/common.sh@352 -- # local d=1 00:19:38.832 01:20:46 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:38.832 01:20:46 -- scripts/common.sh@354 -- # echo 1 00:19:38.832 01:20:46 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:38.832 01:20:46 -- scripts/common.sh@365 -- # decimal 2 00:19:38.832 01:20:46 -- scripts/common.sh@352 -- # local d=2 00:19:38.832 01:20:46 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:38.832 01:20:46 -- scripts/common.sh@354 -- # echo 2 00:19:38.832 01:20:46 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:38.832 01:20:46 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:38.832 01:20:46 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:38.832 01:20:46 -- scripts/common.sh@367 -- # return 0 00:19:38.832 01:20:46 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:38.832 01:20:46 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:38.832 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:38.832 --rc genhtml_branch_coverage=1 00:19:38.832 --rc genhtml_function_coverage=1 00:19:38.832 --rc genhtml_legend=1 00:19:38.832 --rc geninfo_all_blocks=1 00:19:38.832 --rc geninfo_unexecuted_blocks=1 00:19:38.832 00:19:38.832 ' 00:19:38.832 01:20:46 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:38.833 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:38.833 --rc genhtml_branch_coverage=1 00:19:38.833 --rc genhtml_function_coverage=1 00:19:38.833 --rc genhtml_legend=1 00:19:38.833 --rc geninfo_all_blocks=1 00:19:38.833 --rc geninfo_unexecuted_blocks=1 00:19:38.833 00:19:38.833 ' 00:19:38.833 01:20:46 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:38.833 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:38.833 --rc genhtml_branch_coverage=1 00:19:38.833 --rc genhtml_function_coverage=1 00:19:38.833 --rc genhtml_legend=1 00:19:38.833 --rc geninfo_all_blocks=1 00:19:38.833 --rc geninfo_unexecuted_blocks=1 00:19:38.833 00:19:38.833 ' 00:19:38.833 01:20:46 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:38.833 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:38.833 --rc genhtml_branch_coverage=1 00:19:38.833 --rc genhtml_function_coverage=1 00:19:38.833 --rc genhtml_legend=1 00:19:38.833 --rc geninfo_all_blocks=1 00:19:38.833 --rc geninfo_unexecuted_blocks=1 00:19:38.833 00:19:38.833 ' 00:19:38.833 01:20:46 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:38.833 01:20:46 -- nvmf/common.sh@7 -- # uname -s 00:19:38.833 01:20:46 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:38.833 01:20:46 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:38.833 01:20:46 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:38.833 01:20:46 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:38.833 01:20:46 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:38.833 01:20:46 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:38.833 01:20:46 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:38.833 01:20:46 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:38.833 01:20:46 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:38.833 01:20:46 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:38.833 01:20:46 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:38.833 01:20:46 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:38.833 01:20:46 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:38.833 01:20:46 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:38.833 01:20:46 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:38.833 01:20:46 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:38.833 01:20:46 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:38.833 01:20:46 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:38.833 01:20:46 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:38.833 01:20:46 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:38.833 01:20:46 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:38.833 01:20:46 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:38.833 01:20:46 -- paths/export.sh@5 -- # export PATH 00:19:38.833 01:20:46 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:38.833 01:20:46 -- nvmf/common.sh@46 -- # : 0 00:19:38.833 01:20:46 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:38.833 01:20:46 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:38.833 01:20:46 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:38.833 01:20:46 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:38.833 01:20:46 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:38.833 01:20:46 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:38.833 01:20:46 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:38.833 01:20:46 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:38.833 01:20:46 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:38.833 01:20:46 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:38.833 01:20:46 -- target/bdevio.sh@14 -- # nvmftestinit 00:19:38.833 01:20:46 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:38.833 01:20:46 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:38.833 01:20:46 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:38.833 01:20:46 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:38.833 01:20:46 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:38.833 01:20:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:38.833 01:20:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:38.833 01:20:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:38.833 01:20:46 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:38.833 01:20:46 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:38.833 01:20:46 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:38.833 01:20:46 -- common/autotest_common.sh@10 -- # set +x 00:19:40.735 01:20:48 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:40.735 01:20:48 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:40.735 01:20:48 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:40.735 01:20:48 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:40.735 01:20:48 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:40.735 01:20:48 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:40.735 01:20:48 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:40.735 01:20:48 -- nvmf/common.sh@294 -- # net_devs=() 00:19:40.735 01:20:48 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:40.735 01:20:48 -- nvmf/common.sh@295 -- # e810=() 00:19:40.735 01:20:48 -- nvmf/common.sh@295 -- # local -ga e810 00:19:40.735 01:20:48 -- nvmf/common.sh@296 -- # x722=() 00:19:40.735 01:20:48 -- nvmf/common.sh@296 -- # local -ga x722 00:19:40.735 01:20:48 -- nvmf/common.sh@297 -- # mlx=() 00:19:40.735 01:20:48 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:40.735 01:20:48 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:40.735 01:20:48 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:40.735 01:20:48 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:40.735 01:20:48 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:40.735 01:20:48 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:40.735 01:20:48 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:40.735 01:20:48 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:40.735 01:20:48 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:40.735 01:20:48 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:40.735 01:20:48 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:40.735 01:20:48 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:40.735 01:20:48 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:40.735 01:20:48 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:40.735 01:20:48 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:40.735 01:20:48 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:40.735 01:20:48 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:40.735 01:20:48 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:40.735 01:20:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:40.735 01:20:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:40.735 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:40.735 01:20:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:40.735 01:20:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:40.735 01:20:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:40.735 01:20:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:40.735 01:20:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:40.735 01:20:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:40.735 01:20:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:40.735 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:40.735 01:20:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:40.735 01:20:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:40.735 01:20:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:40.735 01:20:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:40.735 01:20:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:40.735 01:20:48 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:40.735 01:20:48 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:40.735 01:20:48 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:40.735 01:20:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:40.735 01:20:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:40.735 01:20:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:40.735 01:20:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:40.735 01:20:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:40.735 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:40.735 01:20:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:40.735 01:20:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:40.735 01:20:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:40.735 01:20:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:40.735 01:20:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:40.735 01:20:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:40.735 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:40.735 01:20:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:40.735 01:20:48 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:40.735 01:20:48 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:40.735 01:20:48 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:40.735 01:20:48 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:40.735 01:20:48 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:40.735 01:20:48 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:40.735 01:20:48 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:40.735 01:20:48 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:40.735 01:20:48 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:40.735 01:20:48 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:40.735 01:20:48 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:40.735 01:20:48 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:40.735 01:20:48 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:40.735 01:20:48 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:40.735 01:20:48 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:40.735 01:20:48 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:40.735 01:20:48 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:40.735 01:20:48 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:40.735 01:20:48 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:40.735 01:20:48 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:40.735 01:20:48 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:40.735 01:20:48 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:40.735 01:20:48 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:40.735 01:20:48 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:40.735 01:20:48 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:40.735 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:40.735 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.335 ms 00:19:40.735 00:19:40.735 --- 10.0.0.2 ping statistics --- 00:19:40.735 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:40.735 rtt min/avg/max/mdev = 0.335/0.335/0.335/0.000 ms 00:19:40.736 01:20:48 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:40.736 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:40.736 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.165 ms 00:19:40.736 00:19:40.736 --- 10.0.0.1 ping statistics --- 00:19:40.736 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:40.736 rtt min/avg/max/mdev = 0.165/0.165/0.165/0.000 ms 00:19:40.736 01:20:48 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:40.736 01:20:48 -- nvmf/common.sh@410 -- # return 0 00:19:40.736 01:20:48 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:40.736 01:20:48 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:40.736 01:20:48 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:40.736 01:20:48 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:40.736 01:20:48 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:40.736 01:20:48 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:40.736 01:20:48 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:40.736 01:20:48 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:19:40.736 01:20:48 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:40.736 01:20:48 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:40.736 01:20:48 -- common/autotest_common.sh@10 -- # set +x 00:19:40.736 01:20:48 -- nvmf/common.sh@469 -- # nvmfpid=1161956 00:19:40.736 01:20:48 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --no-huge -s 1024 -m 0x78 00:19:40.736 01:20:48 -- nvmf/common.sh@470 -- # waitforlisten 1161956 00:19:40.736 01:20:48 -- common/autotest_common.sh@829 -- # '[' -z 1161956 ']' 00:19:40.736 01:20:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:40.736 01:20:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:40.736 01:20:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:40.736 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:40.736 01:20:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:40.736 01:20:48 -- common/autotest_common.sh@10 -- # set +x 00:19:40.736 [2024-11-20 01:20:48.799817] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:19:40.736 [2024-11-20 01:20:48.799905] [ DPDK EAL parameters: nvmf -c 0x78 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk0 --proc-type=auto ] 00:19:40.736 [2024-11-20 01:20:48.876471] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:40.994 [2024-11-20 01:20:48.968494] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:40.994 [2024-11-20 01:20:48.968639] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:40.994 [2024-11-20 01:20:48.968658] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:40.994 [2024-11-20 01:20:48.968672] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:40.994 [2024-11-20 01:20:48.968758] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:19:40.994 [2024-11-20 01:20:48.968814] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:19:40.994 [2024-11-20 01:20:48.968866] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:19:40.994 [2024-11-20 01:20:48.968868] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:41.559 01:20:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:41.559 01:20:49 -- common/autotest_common.sh@862 -- # return 0 00:19:41.559 01:20:49 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:41.559 01:20:49 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:41.818 01:20:49 -- common/autotest_common.sh@10 -- # set +x 00:19:41.818 01:20:49 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:41.818 01:20:49 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:41.818 01:20:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:41.818 01:20:49 -- common/autotest_common.sh@10 -- # set +x 00:19:41.818 [2024-11-20 01:20:49.805132] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:41.818 01:20:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:41.818 01:20:49 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:41.818 01:20:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:41.818 01:20:49 -- common/autotest_common.sh@10 -- # set +x 00:19:41.818 Malloc0 00:19:41.818 01:20:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:41.818 01:20:49 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:19:41.818 01:20:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:41.818 01:20:49 -- common/autotest_common.sh@10 -- # set +x 00:19:41.818 01:20:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:41.818 01:20:49 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:41.818 01:20:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:41.818 01:20:49 -- common/autotest_common.sh@10 -- # set +x 00:19:41.818 01:20:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:41.818 01:20:49 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:41.818 01:20:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:41.818 01:20:49 -- common/autotest_common.sh@10 -- # set +x 00:19:41.818 [2024-11-20 01:20:49.843541] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:41.818 01:20:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:41.818 01:20:49 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 --no-huge -s 1024 00:19:41.818 01:20:49 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:19:41.818 01:20:49 -- nvmf/common.sh@520 -- # config=() 00:19:41.818 01:20:49 -- nvmf/common.sh@520 -- # local subsystem config 00:19:41.818 01:20:49 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:19:41.818 01:20:49 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:19:41.818 { 00:19:41.818 "params": { 00:19:41.818 "name": "Nvme$subsystem", 00:19:41.818 "trtype": "$TEST_TRANSPORT", 00:19:41.818 "traddr": "$NVMF_FIRST_TARGET_IP", 00:19:41.818 "adrfam": "ipv4", 00:19:41.818 "trsvcid": "$NVMF_PORT", 00:19:41.818 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:19:41.818 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:19:41.818 "hdgst": ${hdgst:-false}, 00:19:41.818 "ddgst": ${ddgst:-false} 00:19:41.818 }, 00:19:41.818 "method": "bdev_nvme_attach_controller" 00:19:41.818 } 00:19:41.818 EOF 00:19:41.818 )") 00:19:41.818 01:20:49 -- nvmf/common.sh@542 -- # cat 00:19:41.818 01:20:49 -- nvmf/common.sh@544 -- # jq . 00:19:41.818 01:20:49 -- nvmf/common.sh@545 -- # IFS=, 00:19:41.818 01:20:49 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:19:41.818 "params": { 00:19:41.818 "name": "Nvme1", 00:19:41.818 "trtype": "tcp", 00:19:41.818 "traddr": "10.0.0.2", 00:19:41.818 "adrfam": "ipv4", 00:19:41.818 "trsvcid": "4420", 00:19:41.818 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:41.818 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:41.818 "hdgst": false, 00:19:41.818 "ddgst": false 00:19:41.818 }, 00:19:41.818 "method": "bdev_nvme_attach_controller" 00:19:41.818 }' 00:19:41.818 [2024-11-20 01:20:49.888977] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:19:41.818 [2024-11-20 01:20:49.889049] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk_pid1162114 ] 00:19:41.818 [2024-11-20 01:20:49.949947] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:19:42.077 [2024-11-20 01:20:50.039066] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:42.077 [2024-11-20 01:20:50.039115] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:42.077 [2024-11-20 01:20:50.039119] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:42.077 [2024-11-20 01:20:50.229359] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:19:42.077 [2024-11-20 01:20:50.229417] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:19:42.077 I/O targets: 00:19:42.077 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:19:42.078 00:19:42.078 00:19:42.078 CUnit - A unit testing framework for C - Version 2.1-3 00:19:42.078 http://cunit.sourceforge.net/ 00:19:42.078 00:19:42.078 00:19:42.078 Suite: bdevio tests on: Nvme1n1 00:19:42.078 Test: blockdev write read block ...passed 00:19:42.336 Test: blockdev write zeroes read block ...passed 00:19:42.336 Test: blockdev write zeroes read no split ...passed 00:19:42.336 Test: blockdev write zeroes read split ...passed 00:19:42.336 Test: blockdev write zeroes read split partial ...passed 00:19:42.336 Test: blockdev reset ...[2024-11-20 01:20:50.391513] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:19:42.336 [2024-11-20 01:20:50.391617] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x4e77c0 (9): Bad file descriptor 00:19:42.336 [2024-11-20 01:20:50.487568] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:19:42.336 passed 00:19:42.336 Test: blockdev write read 8 blocks ...passed 00:19:42.336 Test: blockdev write read size > 128k ...passed 00:19:42.336 Test: blockdev write read invalid size ...passed 00:19:42.336 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:19:42.336 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:19:42.336 Test: blockdev write read max offset ...passed 00:19:42.594 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:19:42.594 Test: blockdev writev readv 8 blocks ...passed 00:19:42.594 Test: blockdev writev readv 30 x 1block ...passed 00:19:42.594 Test: blockdev writev readv block ...passed 00:19:42.594 Test: blockdev writev readv size > 128k ...passed 00:19:42.594 Test: blockdev writev readv size > 128k in two iovs ...passed 00:19:42.594 Test: blockdev comparev and writev ...[2024-11-20 01:20:50.660312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:42.594 [2024-11-20 01:20:50.660348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:19:42.594 [2024-11-20 01:20:50.660371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:42.594 [2024-11-20 01:20:50.660388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:19:42.594 [2024-11-20 01:20:50.660701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:42.594 [2024-11-20 01:20:50.660725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:19:42.594 [2024-11-20 01:20:50.660746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:42.594 [2024-11-20 01:20:50.660761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:19:42.594 [2024-11-20 01:20:50.661079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:42.594 [2024-11-20 01:20:50.661113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:19:42.594 [2024-11-20 01:20:50.661134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:42.594 [2024-11-20 01:20:50.661150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:19:42.594 [2024-11-20 01:20:50.661446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:42.594 [2024-11-20 01:20:50.661479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:19:42.594 [2024-11-20 01:20:50.661506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:42.594 [2024-11-20 01:20:50.661522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:19:42.594 passed 00:19:42.594 Test: blockdev nvme passthru rw ...passed 00:19:42.594 Test: blockdev nvme passthru vendor specific ...[2024-11-20 01:20:50.745326] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:42.594 [2024-11-20 01:20:50.745353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:19:42.594 [2024-11-20 01:20:50.745519] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:42.594 [2024-11-20 01:20:50.745542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:19:42.594 [2024-11-20 01:20:50.745681] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:42.594 [2024-11-20 01:20:50.745703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:19:42.594 [2024-11-20 01:20:50.745853] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:42.594 [2024-11-20 01:20:50.745876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:19:42.594 passed 00:19:42.594 Test: blockdev nvme admin passthru ...passed 00:19:42.594 Test: blockdev copy ...passed 00:19:42.594 00:19:42.594 Run Summary: Type Total Ran Passed Failed Inactive 00:19:42.594 suites 1 1 n/a 0 0 00:19:42.594 tests 23 23 23 0 0 00:19:42.594 asserts 152 152 152 0 n/a 00:19:42.594 00:19:42.594 Elapsed time = 1.146 seconds 00:19:43.162 01:20:51 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:43.162 01:20:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:43.162 01:20:51 -- common/autotest_common.sh@10 -- # set +x 00:19:43.162 01:20:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:43.162 01:20:51 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:19:43.162 01:20:51 -- target/bdevio.sh@30 -- # nvmftestfini 00:19:43.162 01:20:51 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:43.162 01:20:51 -- nvmf/common.sh@116 -- # sync 00:19:43.162 01:20:51 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:43.162 01:20:51 -- nvmf/common.sh@119 -- # set +e 00:19:43.162 01:20:51 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:43.162 01:20:51 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:43.162 rmmod nvme_tcp 00:19:43.162 rmmod nvme_fabrics 00:19:43.162 rmmod nvme_keyring 00:19:43.162 01:20:51 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:43.162 01:20:51 -- nvmf/common.sh@123 -- # set -e 00:19:43.162 01:20:51 -- nvmf/common.sh@124 -- # return 0 00:19:43.162 01:20:51 -- nvmf/common.sh@477 -- # '[' -n 1161956 ']' 00:19:43.162 01:20:51 -- nvmf/common.sh@478 -- # killprocess 1161956 00:19:43.162 01:20:51 -- common/autotest_common.sh@936 -- # '[' -z 1161956 ']' 00:19:43.162 01:20:51 -- common/autotest_common.sh@940 -- # kill -0 1161956 00:19:43.162 01:20:51 -- common/autotest_common.sh@941 -- # uname 00:19:43.162 01:20:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:43.162 01:20:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1161956 00:19:43.162 01:20:51 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:19:43.162 01:20:51 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:19:43.162 01:20:51 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1161956' 00:19:43.162 killing process with pid 1161956 00:19:43.162 01:20:51 -- common/autotest_common.sh@955 -- # kill 1161956 00:19:43.162 01:20:51 -- common/autotest_common.sh@960 -- # wait 1161956 00:19:43.422 01:20:51 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:43.422 01:20:51 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:43.422 01:20:51 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:43.422 01:20:51 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:43.422 01:20:51 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:43.422 01:20:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:43.422 01:20:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:43.422 01:20:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:45.958 01:20:53 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:45.958 00:19:45.958 real 0m7.179s 00:19:45.958 user 0m13.317s 00:19:45.958 sys 0m2.544s 00:19:45.958 01:20:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:45.958 01:20:53 -- common/autotest_common.sh@10 -- # set +x 00:19:45.958 ************************************ 00:19:45.958 END TEST nvmf_bdevio_no_huge 00:19:45.958 ************************************ 00:19:45.958 01:20:53 -- nvmf/nvmf.sh@59 -- # run_test nvmf_tls /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:19:45.958 01:20:53 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:45.958 01:20:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:45.958 01:20:53 -- common/autotest_common.sh@10 -- # set +x 00:19:45.958 ************************************ 00:19:45.958 START TEST nvmf_tls 00:19:45.958 ************************************ 00:19:45.958 01:20:53 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:19:45.958 * Looking for test storage... 00:19:45.958 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:45.958 01:20:53 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:45.958 01:20:53 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:45.958 01:20:53 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:45.958 01:20:53 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:45.958 01:20:53 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:45.958 01:20:53 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:45.958 01:20:53 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:45.958 01:20:53 -- scripts/common.sh@335 -- # IFS=.-: 00:19:45.958 01:20:53 -- scripts/common.sh@335 -- # read -ra ver1 00:19:45.958 01:20:53 -- scripts/common.sh@336 -- # IFS=.-: 00:19:45.958 01:20:53 -- scripts/common.sh@336 -- # read -ra ver2 00:19:45.958 01:20:53 -- scripts/common.sh@337 -- # local 'op=<' 00:19:45.958 01:20:53 -- scripts/common.sh@339 -- # ver1_l=2 00:19:45.958 01:20:53 -- scripts/common.sh@340 -- # ver2_l=1 00:19:45.958 01:20:53 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:45.958 01:20:53 -- scripts/common.sh@343 -- # case "$op" in 00:19:45.958 01:20:53 -- scripts/common.sh@344 -- # : 1 00:19:45.958 01:20:53 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:45.958 01:20:53 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:45.958 01:20:53 -- scripts/common.sh@364 -- # decimal 1 00:19:45.958 01:20:53 -- scripts/common.sh@352 -- # local d=1 00:19:45.958 01:20:53 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:45.958 01:20:53 -- scripts/common.sh@354 -- # echo 1 00:19:45.958 01:20:53 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:45.958 01:20:53 -- scripts/common.sh@365 -- # decimal 2 00:19:45.958 01:20:53 -- scripts/common.sh@352 -- # local d=2 00:19:45.958 01:20:53 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:45.958 01:20:53 -- scripts/common.sh@354 -- # echo 2 00:19:45.958 01:20:53 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:45.958 01:20:53 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:45.958 01:20:53 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:45.958 01:20:53 -- scripts/common.sh@367 -- # return 0 00:19:45.958 01:20:53 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:45.958 01:20:53 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:45.958 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:45.958 --rc genhtml_branch_coverage=1 00:19:45.958 --rc genhtml_function_coverage=1 00:19:45.958 --rc genhtml_legend=1 00:19:45.958 --rc geninfo_all_blocks=1 00:19:45.958 --rc geninfo_unexecuted_blocks=1 00:19:45.958 00:19:45.958 ' 00:19:45.958 01:20:53 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:45.958 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:45.958 --rc genhtml_branch_coverage=1 00:19:45.958 --rc genhtml_function_coverage=1 00:19:45.958 --rc genhtml_legend=1 00:19:45.958 --rc geninfo_all_blocks=1 00:19:45.958 --rc geninfo_unexecuted_blocks=1 00:19:45.958 00:19:45.958 ' 00:19:45.958 01:20:53 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:45.958 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:45.958 --rc genhtml_branch_coverage=1 00:19:45.958 --rc genhtml_function_coverage=1 00:19:45.958 --rc genhtml_legend=1 00:19:45.958 --rc geninfo_all_blocks=1 00:19:45.958 --rc geninfo_unexecuted_blocks=1 00:19:45.958 00:19:45.958 ' 00:19:45.958 01:20:53 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:45.958 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:45.958 --rc genhtml_branch_coverage=1 00:19:45.958 --rc genhtml_function_coverage=1 00:19:45.958 --rc genhtml_legend=1 00:19:45.958 --rc geninfo_all_blocks=1 00:19:45.958 --rc geninfo_unexecuted_blocks=1 00:19:45.958 00:19:45.958 ' 00:19:45.958 01:20:53 -- target/tls.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:45.958 01:20:53 -- nvmf/common.sh@7 -- # uname -s 00:19:45.958 01:20:53 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:45.958 01:20:53 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:45.958 01:20:53 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:45.958 01:20:53 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:45.958 01:20:53 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:45.958 01:20:53 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:45.958 01:20:53 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:45.958 01:20:53 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:45.958 01:20:53 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:45.958 01:20:53 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:45.958 01:20:53 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:45.958 01:20:53 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:45.958 01:20:53 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:45.958 01:20:53 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:45.958 01:20:53 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:45.958 01:20:53 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:45.958 01:20:53 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:45.958 01:20:53 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:45.958 01:20:53 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:45.958 01:20:53 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:45.958 01:20:53 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:45.959 01:20:53 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:45.959 01:20:53 -- paths/export.sh@5 -- # export PATH 00:19:45.959 01:20:53 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:45.959 01:20:53 -- nvmf/common.sh@46 -- # : 0 00:19:45.959 01:20:53 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:45.959 01:20:53 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:45.959 01:20:53 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:45.959 01:20:53 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:45.959 01:20:53 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:45.959 01:20:53 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:45.959 01:20:53 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:45.959 01:20:53 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:45.959 01:20:53 -- target/tls.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:19:45.959 01:20:53 -- target/tls.sh@71 -- # nvmftestinit 00:19:45.959 01:20:53 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:45.959 01:20:53 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:45.959 01:20:53 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:45.959 01:20:53 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:45.959 01:20:53 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:45.959 01:20:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:45.959 01:20:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:45.959 01:20:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:45.959 01:20:53 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:45.959 01:20:53 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:45.959 01:20:53 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:45.959 01:20:53 -- common/autotest_common.sh@10 -- # set +x 00:19:47.863 01:20:55 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:47.863 01:20:55 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:47.863 01:20:55 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:47.863 01:20:55 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:47.863 01:20:55 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:47.863 01:20:55 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:47.863 01:20:55 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:47.863 01:20:55 -- nvmf/common.sh@294 -- # net_devs=() 00:19:47.863 01:20:55 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:47.863 01:20:55 -- nvmf/common.sh@295 -- # e810=() 00:19:47.863 01:20:55 -- nvmf/common.sh@295 -- # local -ga e810 00:19:47.863 01:20:55 -- nvmf/common.sh@296 -- # x722=() 00:19:47.863 01:20:55 -- nvmf/common.sh@296 -- # local -ga x722 00:19:47.863 01:20:55 -- nvmf/common.sh@297 -- # mlx=() 00:19:47.863 01:20:55 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:47.863 01:20:55 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:47.863 01:20:55 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:47.863 01:20:55 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:47.863 01:20:55 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:47.863 01:20:55 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:47.863 01:20:55 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:47.863 01:20:55 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:47.863 01:20:55 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:47.863 01:20:55 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:47.863 01:20:55 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:47.863 01:20:55 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:47.863 01:20:55 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:47.863 01:20:55 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:47.863 01:20:55 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:47.863 01:20:55 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:47.863 01:20:55 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:47.863 01:20:55 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:47.863 01:20:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:47.863 01:20:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:47.863 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:47.863 01:20:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:47.863 01:20:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:47.863 01:20:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:47.863 01:20:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:47.863 01:20:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:47.863 01:20:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:47.863 01:20:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:47.863 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:47.863 01:20:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:47.863 01:20:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:47.863 01:20:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:47.863 01:20:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:47.863 01:20:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:47.863 01:20:55 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:47.863 01:20:55 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:47.863 01:20:55 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:47.863 01:20:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:47.863 01:20:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:47.863 01:20:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:47.863 01:20:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:47.863 01:20:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:47.863 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:47.863 01:20:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:47.863 01:20:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:47.863 01:20:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:47.863 01:20:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:47.863 01:20:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:47.863 01:20:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:47.863 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:47.863 01:20:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:47.863 01:20:55 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:47.863 01:20:55 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:47.863 01:20:55 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:47.863 01:20:55 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:47.863 01:20:55 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:47.863 01:20:55 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:47.863 01:20:55 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:47.863 01:20:55 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:47.863 01:20:55 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:47.863 01:20:55 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:47.863 01:20:55 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:47.863 01:20:55 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:47.863 01:20:55 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:47.863 01:20:55 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:47.863 01:20:55 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:47.863 01:20:55 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:47.863 01:20:55 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:47.863 01:20:55 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:47.863 01:20:55 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:47.863 01:20:55 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:47.863 01:20:55 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:47.863 01:20:55 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:47.863 01:20:55 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:47.863 01:20:55 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:47.863 01:20:55 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:47.863 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:47.863 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.235 ms 00:19:47.863 00:19:47.863 --- 10.0.0.2 ping statistics --- 00:19:47.863 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:47.863 rtt min/avg/max/mdev = 0.235/0.235/0.235/0.000 ms 00:19:47.863 01:20:55 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:47.863 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:47.863 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.129 ms 00:19:47.863 00:19:47.863 --- 10.0.0.1 ping statistics --- 00:19:47.863 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:47.863 rtt min/avg/max/mdev = 0.129/0.129/0.129/0.000 ms 00:19:47.863 01:20:55 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:47.863 01:20:55 -- nvmf/common.sh@410 -- # return 0 00:19:47.863 01:20:55 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:47.863 01:20:55 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:47.863 01:20:55 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:47.863 01:20:55 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:47.863 01:20:55 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:47.863 01:20:55 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:47.863 01:20:55 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:47.864 01:20:55 -- target/tls.sh@72 -- # nvmfappstart -m 0x2 --wait-for-rpc 00:19:47.864 01:20:55 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:47.864 01:20:55 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:47.864 01:20:55 -- common/autotest_common.sh@10 -- # set +x 00:19:47.864 01:20:55 -- nvmf/common.sh@469 -- # nvmfpid=1164343 00:19:47.864 01:20:55 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 --wait-for-rpc 00:19:47.864 01:20:55 -- nvmf/common.sh@470 -- # waitforlisten 1164343 00:19:47.864 01:20:55 -- common/autotest_common.sh@829 -- # '[' -z 1164343 ']' 00:19:47.864 01:20:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:47.864 01:20:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:47.864 01:20:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:47.864 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:47.864 01:20:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:47.864 01:20:55 -- common/autotest_common.sh@10 -- # set +x 00:19:47.864 [2024-11-20 01:20:56.013016] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:19:47.864 [2024-11-20 01:20:56.013123] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:47.864 EAL: No free 2048 kB hugepages reported on node 1 00:19:48.122 [2024-11-20 01:20:56.083936] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:48.122 [2024-11-20 01:20:56.171539] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:48.122 [2024-11-20 01:20:56.171710] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:48.122 [2024-11-20 01:20:56.171736] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:48.122 [2024-11-20 01:20:56.171754] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:48.122 [2024-11-20 01:20:56.171789] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:48.122 01:20:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:48.122 01:20:56 -- common/autotest_common.sh@862 -- # return 0 00:19:48.122 01:20:56 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:48.122 01:20:56 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:48.122 01:20:56 -- common/autotest_common.sh@10 -- # set +x 00:19:48.122 01:20:56 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:48.122 01:20:56 -- target/tls.sh@74 -- # '[' tcp '!=' tcp ']' 00:19:48.122 01:20:56 -- target/tls.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_set_default_impl -i ssl 00:19:48.380 true 00:19:48.380 01:20:56 -- target/tls.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:48.380 01:20:56 -- target/tls.sh@82 -- # jq -r .tls_version 00:19:48.638 01:20:56 -- target/tls.sh@82 -- # version=0 00:19:48.638 01:20:56 -- target/tls.sh@83 -- # [[ 0 != \0 ]] 00:19:48.638 01:20:56 -- target/tls.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:19:48.895 01:20:57 -- target/tls.sh@90 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:48.895 01:20:57 -- target/tls.sh@90 -- # jq -r .tls_version 00:19:49.153 01:20:57 -- target/tls.sh@90 -- # version=13 00:19:49.153 01:20:57 -- target/tls.sh@91 -- # [[ 13 != \1\3 ]] 00:19:49.153 01:20:57 -- target/tls.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 7 00:19:49.412 01:20:57 -- target/tls.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:49.412 01:20:57 -- target/tls.sh@98 -- # jq -r .tls_version 00:19:49.669 01:20:57 -- target/tls.sh@98 -- # version=7 00:19:49.669 01:20:57 -- target/tls.sh@99 -- # [[ 7 != \7 ]] 00:19:49.669 01:20:57 -- target/tls.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:49.669 01:20:57 -- target/tls.sh@105 -- # jq -r .enable_ktls 00:19:49.928 01:20:58 -- target/tls.sh@105 -- # ktls=false 00:19:49.928 01:20:58 -- target/tls.sh@106 -- # [[ false != \f\a\l\s\e ]] 00:19:49.928 01:20:58 -- target/tls.sh@112 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --enable-ktls 00:19:50.186 01:20:58 -- target/tls.sh@113 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:50.186 01:20:58 -- target/tls.sh@113 -- # jq -r .enable_ktls 00:19:50.445 01:20:58 -- target/tls.sh@113 -- # ktls=true 00:19:50.445 01:20:58 -- target/tls.sh@114 -- # [[ true != \t\r\u\e ]] 00:19:50.445 01:20:58 -- target/tls.sh@120 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --disable-ktls 00:19:50.703 01:20:58 -- target/tls.sh@121 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:50.703 01:20:58 -- target/tls.sh@121 -- # jq -r .enable_ktls 00:19:50.961 01:20:59 -- target/tls.sh@121 -- # ktls=false 00:19:50.961 01:20:59 -- target/tls.sh@122 -- # [[ false != \f\a\l\s\e ]] 00:19:50.961 01:20:59 -- target/tls.sh@127 -- # format_interchange_psk 00112233445566778899aabbccddeeff 00:19:50.961 01:20:59 -- target/tls.sh@49 -- # local key hash crc 00:19:50.961 01:20:59 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff 00:19:50.961 01:20:59 -- target/tls.sh@51 -- # hash=01 00:19:50.961 01:20:59 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff 00:19:50.961 01:20:59 -- target/tls.sh@52 -- # gzip -1 -c 00:19:50.961 01:20:59 -- target/tls.sh@52 -- # tail -c8 00:19:50.961 01:20:59 -- target/tls.sh@52 -- # head -c 4 00:19:50.961 01:20:59 -- target/tls.sh@52 -- # crc='p$H�' 00:19:50.961 01:20:59 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:19:50.961 01:20:59 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeffp$H�' 00:19:50.961 01:20:59 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:19:50.961 01:20:59 -- target/tls.sh@127 -- # key=NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:19:50.961 01:20:59 -- target/tls.sh@128 -- # format_interchange_psk ffeeddccbbaa99887766554433221100 00:19:50.961 01:20:59 -- target/tls.sh@49 -- # local key hash crc 00:19:50.961 01:20:59 -- target/tls.sh@51 -- # key=ffeeddccbbaa99887766554433221100 00:19:50.961 01:20:59 -- target/tls.sh@51 -- # hash=01 00:19:50.961 01:20:59 -- target/tls.sh@52 -- # echo -n ffeeddccbbaa99887766554433221100 00:19:50.961 01:20:59 -- target/tls.sh@52 -- # gzip -1 -c 00:19:50.961 01:20:59 -- target/tls.sh@52 -- # head -c 4 00:19:50.961 01:20:59 -- target/tls.sh@52 -- # tail -c8 00:19:50.961 01:20:59 -- target/tls.sh@52 -- # crc=$'_\006o\330' 00:19:50.961 01:20:59 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:19:50.961 01:20:59 -- target/tls.sh@54 -- # echo -n $'ffeeddccbbaa99887766554433221100_\006o\330' 00:19:50.961 01:20:59 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:19:50.961 01:20:59 -- target/tls.sh@128 -- # key_2=NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:19:50.961 01:20:59 -- target/tls.sh@130 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:50.961 01:20:59 -- target/tls.sh@131 -- # key_2_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:19:50.961 01:20:59 -- target/tls.sh@133 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:19:50.961 01:20:59 -- target/tls.sh@134 -- # echo -n NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:19:50.961 01:20:59 -- target/tls.sh@136 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:50.961 01:20:59 -- target/tls.sh@137 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:19:50.961 01:20:59 -- target/tls.sh@139 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:19:51.218 01:20:59 -- target/tls.sh@140 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_start_init 00:19:51.784 01:20:59 -- target/tls.sh@142 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:51.784 01:20:59 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:51.784 01:20:59 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:19:52.105 [2024-11-20 01:21:00.086865] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:52.105 01:21:00 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:19:52.401 01:21:00 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:19:52.660 [2024-11-20 01:21:00.624296] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:19:52.660 [2024-11-20 01:21:00.624627] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:52.660 01:21:00 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:19:52.917 malloc0 00:19:52.917 01:21:00 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:19:53.175 01:21:01 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:53.432 01:21:01 -- target/tls.sh@146 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -S ssl -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 hostnqn:nqn.2016-06.io.spdk:host1' --psk-path /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:53.432 EAL: No free 2048 kB hugepages reported on node 1 00:20:03.397 Initializing NVMe Controllers 00:20:03.397 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:20:03.397 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:20:03.397 Initialization complete. Launching workers. 00:20:03.397 ======================================================== 00:20:03.397 Latency(us) 00:20:03.397 Device Information : IOPS MiB/s Average min max 00:20:03.397 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7909.98 30.90 8093.17 1213.91 10684.46 00:20:03.397 ======================================================== 00:20:03.397 Total : 7909.98 30.90 8093.17 1213.91 10684.46 00:20:03.397 00:20:03.397 01:21:11 -- target/tls.sh@152 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:03.397 01:21:11 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:03.397 01:21:11 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:03.397 01:21:11 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:03.397 01:21:11 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:20:03.397 01:21:11 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:03.397 01:21:11 -- target/tls.sh@28 -- # bdevperf_pid=1166928 00:20:03.397 01:21:11 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:03.397 01:21:11 -- target/tls.sh@31 -- # waitforlisten 1166928 /var/tmp/bdevperf.sock 00:20:03.397 01:21:11 -- common/autotest_common.sh@829 -- # '[' -z 1166928 ']' 00:20:03.397 01:21:11 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:03.397 01:21:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:03.397 01:21:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:03.397 01:21:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:03.397 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:03.397 01:21:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:03.397 01:21:11 -- common/autotest_common.sh@10 -- # set +x 00:20:03.397 [2024-11-20 01:21:11.563650] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:03.397 [2024-11-20 01:21:11.563726] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1166928 ] 00:20:03.397 EAL: No free 2048 kB hugepages reported on node 1 00:20:03.655 [2024-11-20 01:21:11.621544] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:03.655 [2024-11-20 01:21:11.705187] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:04.588 01:21:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:04.588 01:21:12 -- common/autotest_common.sh@862 -- # return 0 00:20:04.588 01:21:12 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:04.846 [2024-11-20 01:21:12.835592] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:04.846 TLSTESTn1 00:20:04.846 01:21:12 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:20:04.846 Running I/O for 10 seconds... 00:20:17.038 00:20:17.038 Latency(us) 00:20:17.038 [2024-11-20T00:21:25.257Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:17.038 [2024-11-20T00:21:25.257Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:20:17.038 Verification LBA range: start 0x0 length 0x2000 00:20:17.038 TLSTESTn1 : 10.02 4664.96 18.22 0.00 0.00 27397.48 6553.60 46215.02 00:20:17.038 [2024-11-20T00:21:25.257Z] =================================================================================================================== 00:20:17.038 [2024-11-20T00:21:25.257Z] Total : 4664.96 18.22 0.00 0.00 27397.48 6553.60 46215.02 00:20:17.038 0 00:20:17.038 01:21:23 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:20:17.038 01:21:23 -- target/tls.sh@45 -- # killprocess 1166928 00:20:17.038 01:21:23 -- common/autotest_common.sh@936 -- # '[' -z 1166928 ']' 00:20:17.038 01:21:23 -- common/autotest_common.sh@940 -- # kill -0 1166928 00:20:17.038 01:21:23 -- common/autotest_common.sh@941 -- # uname 00:20:17.038 01:21:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:17.038 01:21:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1166928 00:20:17.038 01:21:23 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:17.038 01:21:23 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:17.038 01:21:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1166928' 00:20:17.038 killing process with pid 1166928 00:20:17.038 01:21:23 -- common/autotest_common.sh@955 -- # kill 1166928 00:20:17.038 Received shutdown signal, test time was about 10.000000 seconds 00:20:17.038 00:20:17.038 Latency(us) 00:20:17.038 [2024-11-20T00:21:25.257Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:17.038 [2024-11-20T00:21:25.257Z] =================================================================================================================== 00:20:17.038 [2024-11-20T00:21:25.257Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:17.038 01:21:23 -- common/autotest_common.sh@960 -- # wait 1166928 00:20:17.038 01:21:23 -- target/tls.sh@155 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:17.038 01:21:23 -- common/autotest_common.sh@650 -- # local es=0 00:20:17.038 01:21:23 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:17.038 01:21:23 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:17.038 01:21:23 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:17.038 01:21:23 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:17.038 01:21:23 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:17.038 01:21:23 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:17.038 01:21:23 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:17.038 01:21:23 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:17.038 01:21:23 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:17.038 01:21:23 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt' 00:20:17.038 01:21:23 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:17.038 01:21:23 -- target/tls.sh@28 -- # bdevperf_pid=1168296 00:20:17.038 01:21:23 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:17.038 01:21:23 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:17.038 01:21:23 -- target/tls.sh@31 -- # waitforlisten 1168296 /var/tmp/bdevperf.sock 00:20:17.038 01:21:23 -- common/autotest_common.sh@829 -- # '[' -z 1168296 ']' 00:20:17.038 01:21:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:17.038 01:21:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:17.038 01:21:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:17.038 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:17.038 01:21:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:17.038 01:21:23 -- common/autotest_common.sh@10 -- # set +x 00:20:17.038 [2024-11-20 01:21:23.399964] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:17.038 [2024-11-20 01:21:23.400040] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1168296 ] 00:20:17.038 EAL: No free 2048 kB hugepages reported on node 1 00:20:17.038 [2024-11-20 01:21:23.457530] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:17.038 [2024-11-20 01:21:23.538576] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:17.038 01:21:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:17.038 01:21:24 -- common/autotest_common.sh@862 -- # return 0 00:20:17.038 01:21:24 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:17.038 [2024-11-20 01:21:24.613515] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:17.038 [2024-11-20 01:21:24.625587] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:17.038 [2024-11-20 01:21:24.626419] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x146c840 (107): Transport endpoint is not connected 00:20:17.038 [2024-11-20 01:21:24.627412] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x146c840 (9): Bad file descriptor 00:20:17.039 [2024-11-20 01:21:24.628411] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:20:17.039 [2024-11-20 01:21:24.628429] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:17.039 [2024-11-20 01:21:24.628441] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:17.039 request: 00:20:17.039 { 00:20:17.039 "name": "TLSTEST", 00:20:17.039 "trtype": "tcp", 00:20:17.039 "traddr": "10.0.0.2", 00:20:17.039 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:17.039 "adrfam": "ipv4", 00:20:17.039 "trsvcid": "4420", 00:20:17.039 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:17.039 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt", 00:20:17.039 "method": "bdev_nvme_attach_controller", 00:20:17.039 "req_id": 1 00:20:17.039 } 00:20:17.039 Got JSON-RPC error response 00:20:17.039 response: 00:20:17.039 { 00:20:17.039 "code": -32602, 00:20:17.039 "message": "Invalid parameters" 00:20:17.039 } 00:20:17.039 01:21:24 -- target/tls.sh@36 -- # killprocess 1168296 00:20:17.039 01:21:24 -- common/autotest_common.sh@936 -- # '[' -z 1168296 ']' 00:20:17.039 01:21:24 -- common/autotest_common.sh@940 -- # kill -0 1168296 00:20:17.039 01:21:24 -- common/autotest_common.sh@941 -- # uname 00:20:17.039 01:21:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:17.039 01:21:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1168296 00:20:17.039 01:21:24 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:17.039 01:21:24 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:17.039 01:21:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1168296' 00:20:17.039 killing process with pid 1168296 00:20:17.039 01:21:24 -- common/autotest_common.sh@955 -- # kill 1168296 00:20:17.039 Received shutdown signal, test time was about 10.000000 seconds 00:20:17.039 00:20:17.039 Latency(us) 00:20:17.039 [2024-11-20T00:21:25.258Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:17.039 [2024-11-20T00:21:25.258Z] =================================================================================================================== 00:20:17.039 [2024-11-20T00:21:25.258Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:17.039 01:21:24 -- common/autotest_common.sh@960 -- # wait 1168296 00:20:17.039 01:21:24 -- target/tls.sh@37 -- # return 1 00:20:17.039 01:21:24 -- common/autotest_common.sh@653 -- # es=1 00:20:17.039 01:21:24 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:17.039 01:21:24 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:17.039 01:21:24 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:17.039 01:21:24 -- target/tls.sh@158 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:17.039 01:21:24 -- common/autotest_common.sh@650 -- # local es=0 00:20:17.039 01:21:24 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:17.039 01:21:24 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:17.039 01:21:24 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:17.039 01:21:24 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:17.039 01:21:24 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:17.039 01:21:24 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:17.039 01:21:24 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:17.039 01:21:24 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:17.039 01:21:24 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host2 00:20:17.039 01:21:24 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:20:17.039 01:21:24 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:17.039 01:21:24 -- target/tls.sh@28 -- # bdevperf_pid=1168568 00:20:17.039 01:21:24 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:17.039 01:21:24 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:17.039 01:21:24 -- target/tls.sh@31 -- # waitforlisten 1168568 /var/tmp/bdevperf.sock 00:20:17.039 01:21:24 -- common/autotest_common.sh@829 -- # '[' -z 1168568 ']' 00:20:17.039 01:21:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:17.039 01:21:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:17.039 01:21:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:17.039 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:17.039 01:21:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:17.039 01:21:24 -- common/autotest_common.sh@10 -- # set +x 00:20:17.039 [2024-11-20 01:21:24.939950] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:17.039 [2024-11-20 01:21:24.940025] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1168568 ] 00:20:17.039 EAL: No free 2048 kB hugepages reported on node 1 00:20:17.039 [2024-11-20 01:21:24.995843] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:17.039 [2024-11-20 01:21:25.074446] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:17.973 01:21:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:17.973 01:21:25 -- common/autotest_common.sh@862 -- # return 0 00:20:17.973 01:21:25 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host2 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:17.973 [2024-11-20 01:21:26.125019] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:17.973 [2024-11-20 01:21:26.130143] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:20:17.973 [2024-11-20 01:21:26.130177] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:20:17.973 [2024-11-20 01:21:26.130231] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:17.973 [2024-11-20 01:21:26.130732] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x108d840 (107): Transport endpoint is not connected 00:20:17.973 [2024-11-20 01:21:26.131721] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x108d840 (9): Bad file descriptor 00:20:17.973 [2024-11-20 01:21:26.132719] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:20:17.973 [2024-11-20 01:21:26.132738] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:17.973 [2024-11-20 01:21:26.132750] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:17.973 request: 00:20:17.973 { 00:20:17.973 "name": "TLSTEST", 00:20:17.973 "trtype": "tcp", 00:20:17.973 "traddr": "10.0.0.2", 00:20:17.973 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:20:17.973 "adrfam": "ipv4", 00:20:17.973 "trsvcid": "4420", 00:20:17.973 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:17.973 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:20:17.973 "method": "bdev_nvme_attach_controller", 00:20:17.973 "req_id": 1 00:20:17.973 } 00:20:17.974 Got JSON-RPC error response 00:20:17.974 response: 00:20:17.974 { 00:20:17.974 "code": -32602, 00:20:17.974 "message": "Invalid parameters" 00:20:17.974 } 00:20:17.974 01:21:26 -- target/tls.sh@36 -- # killprocess 1168568 00:20:17.974 01:21:26 -- common/autotest_common.sh@936 -- # '[' -z 1168568 ']' 00:20:17.974 01:21:26 -- common/autotest_common.sh@940 -- # kill -0 1168568 00:20:17.974 01:21:26 -- common/autotest_common.sh@941 -- # uname 00:20:17.974 01:21:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:17.974 01:21:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1168568 00:20:18.232 01:21:26 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:18.232 01:21:26 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:18.232 01:21:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1168568' 00:20:18.232 killing process with pid 1168568 00:20:18.232 01:21:26 -- common/autotest_common.sh@955 -- # kill 1168568 00:20:18.232 Received shutdown signal, test time was about 10.000000 seconds 00:20:18.232 00:20:18.232 Latency(us) 00:20:18.232 [2024-11-20T00:21:26.451Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:18.232 [2024-11-20T00:21:26.451Z] =================================================================================================================== 00:20:18.232 [2024-11-20T00:21:26.451Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:18.232 01:21:26 -- common/autotest_common.sh@960 -- # wait 1168568 00:20:18.232 01:21:26 -- target/tls.sh@37 -- # return 1 00:20:18.232 01:21:26 -- common/autotest_common.sh@653 -- # es=1 00:20:18.232 01:21:26 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:18.232 01:21:26 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:18.232 01:21:26 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:18.232 01:21:26 -- target/tls.sh@161 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:18.232 01:21:26 -- common/autotest_common.sh@650 -- # local es=0 00:20:18.232 01:21:26 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:18.232 01:21:26 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:18.232 01:21:26 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:18.232 01:21:26 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:18.232 01:21:26 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:18.232 01:21:26 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:18.232 01:21:26 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:18.232 01:21:26 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode2 00:20:18.232 01:21:26 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:18.232 01:21:26 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:20:18.232 01:21:26 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:18.232 01:21:26 -- target/tls.sh@28 -- # bdevperf_pid=1168717 00:20:18.232 01:21:26 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:18.232 01:21:26 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:18.232 01:21:26 -- target/tls.sh@31 -- # waitforlisten 1168717 /var/tmp/bdevperf.sock 00:20:18.232 01:21:26 -- common/autotest_common.sh@829 -- # '[' -z 1168717 ']' 00:20:18.232 01:21:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:18.232 01:21:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:18.232 01:21:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:18.232 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:18.232 01:21:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:18.232 01:21:26 -- common/autotest_common.sh@10 -- # set +x 00:20:18.491 [2024-11-20 01:21:26.454587] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:18.491 [2024-11-20 01:21:26.454662] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1168717 ] 00:20:18.491 EAL: No free 2048 kB hugepages reported on node 1 00:20:18.491 [2024-11-20 01:21:26.511641] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:18.491 [2024-11-20 01:21:26.591350] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:19.427 01:21:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:19.427 01:21:27 -- common/autotest_common.sh@862 -- # return 0 00:20:19.427 01:21:27 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:19.427 [2024-11-20 01:21:27.637594] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:19.427 [2024-11-20 01:21:27.643429] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:20:19.427 [2024-11-20 01:21:27.643486] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:20:19.427 [2024-11-20 01:21:27.643555] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:19.688 [2024-11-20 01:21:27.644422] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x778840 (107): Transport endpoint is not connected 00:20:19.688 [2024-11-20 01:21:27.645414] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x778840 (9): Bad file descriptor 00:20:19.688 [2024-11-20 01:21:27.646412] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:20:19.688 [2024-11-20 01:21:27.646432] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:19.688 [2024-11-20 01:21:27.646445] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:20:19.688 request: 00:20:19.688 { 00:20:19.688 "name": "TLSTEST", 00:20:19.688 "trtype": "tcp", 00:20:19.688 "traddr": "10.0.0.2", 00:20:19.688 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:19.688 "adrfam": "ipv4", 00:20:19.688 "trsvcid": "4420", 00:20:19.688 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:20:19.688 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:20:19.688 "method": "bdev_nvme_attach_controller", 00:20:19.688 "req_id": 1 00:20:19.688 } 00:20:19.688 Got JSON-RPC error response 00:20:19.688 response: 00:20:19.688 { 00:20:19.688 "code": -32602, 00:20:19.688 "message": "Invalid parameters" 00:20:19.688 } 00:20:19.688 01:21:27 -- target/tls.sh@36 -- # killprocess 1168717 00:20:19.688 01:21:27 -- common/autotest_common.sh@936 -- # '[' -z 1168717 ']' 00:20:19.688 01:21:27 -- common/autotest_common.sh@940 -- # kill -0 1168717 00:20:19.688 01:21:27 -- common/autotest_common.sh@941 -- # uname 00:20:19.688 01:21:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:19.688 01:21:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1168717 00:20:19.688 01:21:27 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:19.688 01:21:27 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:19.688 01:21:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1168717' 00:20:19.688 killing process with pid 1168717 00:20:19.688 01:21:27 -- common/autotest_common.sh@955 -- # kill 1168717 00:20:19.688 Received shutdown signal, test time was about 10.000000 seconds 00:20:19.688 00:20:19.688 Latency(us) 00:20:19.688 [2024-11-20T00:21:27.907Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:19.688 [2024-11-20T00:21:27.907Z] =================================================================================================================== 00:20:19.688 [2024-11-20T00:21:27.907Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:19.688 01:21:27 -- common/autotest_common.sh@960 -- # wait 1168717 00:20:19.946 01:21:27 -- target/tls.sh@37 -- # return 1 00:20:19.946 01:21:27 -- common/autotest_common.sh@653 -- # es=1 00:20:19.946 01:21:27 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:19.946 01:21:27 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:19.946 01:21:27 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:19.946 01:21:27 -- target/tls.sh@164 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:20:19.946 01:21:27 -- common/autotest_common.sh@650 -- # local es=0 00:20:19.946 01:21:27 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:20:19.946 01:21:27 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:19.946 01:21:27 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:19.946 01:21:27 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:19.946 01:21:27 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:19.946 01:21:27 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:20:19.946 01:21:27 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:19.946 01:21:27 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:19.946 01:21:27 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:19.946 01:21:27 -- target/tls.sh@23 -- # psk= 00:20:19.946 01:21:27 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:19.946 01:21:27 -- target/tls.sh@28 -- # bdevperf_pid=1168872 00:20:19.946 01:21:27 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:19.946 01:21:27 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:19.946 01:21:27 -- target/tls.sh@31 -- # waitforlisten 1168872 /var/tmp/bdevperf.sock 00:20:19.946 01:21:27 -- common/autotest_common.sh@829 -- # '[' -z 1168872 ']' 00:20:19.946 01:21:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:19.946 01:21:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:19.946 01:21:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:19.946 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:19.946 01:21:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:19.946 01:21:27 -- common/autotest_common.sh@10 -- # set +x 00:20:19.946 [2024-11-20 01:21:27.962134] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:19.946 [2024-11-20 01:21:27.962212] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1168872 ] 00:20:19.946 EAL: No free 2048 kB hugepages reported on node 1 00:20:19.947 [2024-11-20 01:21:28.018822] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:19.947 [2024-11-20 01:21:28.103119] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:20.880 01:21:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:20.880 01:21:28 -- common/autotest_common.sh@862 -- # return 0 00:20:20.880 01:21:28 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:20:21.139 [2024-11-20 01:21:29.187397] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:21.139 [2024-11-20 01:21:29.189441] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0dd0 (9): Bad file descriptor 00:20:21.139 [2024-11-20 01:21:29.190423] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:20:21.139 [2024-11-20 01:21:29.190443] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:21.139 [2024-11-20 01:21:29.190455] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:21.139 request: 00:20:21.139 { 00:20:21.139 "name": "TLSTEST", 00:20:21.139 "trtype": "tcp", 00:20:21.139 "traddr": "10.0.0.2", 00:20:21.139 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:21.139 "adrfam": "ipv4", 00:20:21.139 "trsvcid": "4420", 00:20:21.139 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:21.139 "method": "bdev_nvme_attach_controller", 00:20:21.139 "req_id": 1 00:20:21.139 } 00:20:21.139 Got JSON-RPC error response 00:20:21.139 response: 00:20:21.139 { 00:20:21.139 "code": -32602, 00:20:21.139 "message": "Invalid parameters" 00:20:21.139 } 00:20:21.139 01:21:29 -- target/tls.sh@36 -- # killprocess 1168872 00:20:21.139 01:21:29 -- common/autotest_common.sh@936 -- # '[' -z 1168872 ']' 00:20:21.139 01:21:29 -- common/autotest_common.sh@940 -- # kill -0 1168872 00:20:21.139 01:21:29 -- common/autotest_common.sh@941 -- # uname 00:20:21.139 01:21:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:21.139 01:21:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1168872 00:20:21.139 01:21:29 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:21.139 01:21:29 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:21.139 01:21:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1168872' 00:20:21.139 killing process with pid 1168872 00:20:21.139 01:21:29 -- common/autotest_common.sh@955 -- # kill 1168872 00:20:21.139 Received shutdown signal, test time was about 10.000000 seconds 00:20:21.139 00:20:21.139 Latency(us) 00:20:21.139 [2024-11-20T00:21:29.358Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:21.139 [2024-11-20T00:21:29.358Z] =================================================================================================================== 00:20:21.139 [2024-11-20T00:21:29.358Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:21.139 01:21:29 -- common/autotest_common.sh@960 -- # wait 1168872 00:20:21.397 01:21:29 -- target/tls.sh@37 -- # return 1 00:20:21.397 01:21:29 -- common/autotest_common.sh@653 -- # es=1 00:20:21.397 01:21:29 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:21.397 01:21:29 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:21.397 01:21:29 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:21.397 01:21:29 -- target/tls.sh@167 -- # killprocess 1164343 00:20:21.397 01:21:29 -- common/autotest_common.sh@936 -- # '[' -z 1164343 ']' 00:20:21.397 01:21:29 -- common/autotest_common.sh@940 -- # kill -0 1164343 00:20:21.397 01:21:29 -- common/autotest_common.sh@941 -- # uname 00:20:21.397 01:21:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:21.397 01:21:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1164343 00:20:21.397 01:21:29 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:21.397 01:21:29 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:21.397 01:21:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1164343' 00:20:21.397 killing process with pid 1164343 00:20:21.397 01:21:29 -- common/autotest_common.sh@955 -- # kill 1164343 00:20:21.397 01:21:29 -- common/autotest_common.sh@960 -- # wait 1164343 00:20:21.655 01:21:29 -- target/tls.sh@168 -- # format_interchange_psk 00112233445566778899aabbccddeeff0011223344556677 02 00:20:21.655 01:21:29 -- target/tls.sh@49 -- # local key hash crc 00:20:21.655 01:21:29 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff0011223344556677 00:20:21.655 01:21:29 -- target/tls.sh@51 -- # hash=02 00:20:21.655 01:21:29 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff0011223344556677 00:20:21.655 01:21:29 -- target/tls.sh@52 -- # gzip -1 -c 00:20:21.655 01:21:29 -- target/tls.sh@52 -- # tail -c8 00:20:21.655 01:21:29 -- target/tls.sh@52 -- # head -c 4 00:20:21.655 01:21:29 -- target/tls.sh@52 -- # crc='�e�'\''' 00:20:21.655 01:21:29 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:20:21.655 01:21:29 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeff0011223344556677�e�'\''' 00:20:21.655 01:21:29 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:20:21.655 01:21:29 -- target/tls.sh@168 -- # key_long=NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:20:21.655 01:21:29 -- target/tls.sh@169 -- # key_long_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:21.655 01:21:29 -- target/tls.sh@170 -- # echo -n NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:20:21.655 01:21:29 -- target/tls.sh@171 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:21.655 01:21:29 -- target/tls.sh@172 -- # nvmfappstart -m 0x2 00:20:21.655 01:21:29 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:21.656 01:21:29 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:21.656 01:21:29 -- common/autotest_common.sh@10 -- # set +x 00:20:21.656 01:21:29 -- nvmf/common.sh@469 -- # nvmfpid=1169161 00:20:21.656 01:21:29 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:20:21.656 01:21:29 -- nvmf/common.sh@470 -- # waitforlisten 1169161 00:20:21.656 01:21:29 -- common/autotest_common.sh@829 -- # '[' -z 1169161 ']' 00:20:21.656 01:21:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:21.656 01:21:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:21.656 01:21:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:21.656 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:21.656 01:21:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:21.656 01:21:29 -- common/autotest_common.sh@10 -- # set +x 00:20:21.656 [2024-11-20 01:21:29.825811] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:21.656 [2024-11-20 01:21:29.825913] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:21.656 EAL: No free 2048 kB hugepages reported on node 1 00:20:21.914 [2024-11-20 01:21:29.902407] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:21.914 [2024-11-20 01:21:29.997535] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:21.914 [2024-11-20 01:21:29.997704] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:21.914 [2024-11-20 01:21:29.997731] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:21.914 [2024-11-20 01:21:29.997749] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:21.914 [2024-11-20 01:21:29.997796] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:22.846 01:21:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:22.846 01:21:30 -- common/autotest_common.sh@862 -- # return 0 00:20:22.846 01:21:30 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:22.846 01:21:30 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:22.846 01:21:30 -- common/autotest_common.sh@10 -- # set +x 00:20:22.846 01:21:30 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:22.846 01:21:30 -- target/tls.sh@174 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:22.846 01:21:30 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:22.846 01:21:30 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:23.103 [2024-11-20 01:21:31.074111] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:23.103 01:21:31 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:23.362 01:21:31 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:23.620 [2024-11-20 01:21:31.583474] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:23.620 [2024-11-20 01:21:31.583771] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:23.620 01:21:31 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:23.877 malloc0 00:20:23.878 01:21:31 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:24.136 01:21:32 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:24.136 01:21:32 -- target/tls.sh@176 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:24.394 01:21:32 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:24.394 01:21:32 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:24.394 01:21:32 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:24.394 01:21:32 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:20:24.394 01:21:32 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:24.394 01:21:32 -- target/tls.sh@28 -- # bdevperf_pid=1169460 00:20:24.394 01:21:32 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:24.394 01:21:32 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:24.394 01:21:32 -- target/tls.sh@31 -- # waitforlisten 1169460 /var/tmp/bdevperf.sock 00:20:24.394 01:21:32 -- common/autotest_common.sh@829 -- # '[' -z 1169460 ']' 00:20:24.394 01:21:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:24.394 01:21:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:24.394 01:21:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:24.394 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:24.394 01:21:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:24.394 01:21:32 -- common/autotest_common.sh@10 -- # set +x 00:20:24.394 [2024-11-20 01:21:32.394792] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:24.394 [2024-11-20 01:21:32.394865] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1169460 ] 00:20:24.394 EAL: No free 2048 kB hugepages reported on node 1 00:20:24.394 [2024-11-20 01:21:32.452472] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:24.394 [2024-11-20 01:21:32.539970] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:25.328 01:21:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:25.328 01:21:33 -- common/autotest_common.sh@862 -- # return 0 00:20:25.328 01:21:33 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:25.587 [2024-11-20 01:21:33.605963] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:25.587 TLSTESTn1 00:20:25.587 01:21:33 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:20:25.587 Running I/O for 10 seconds... 00:20:37.779 00:20:37.779 Latency(us) 00:20:37.779 [2024-11-20T00:21:45.998Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:37.779 [2024-11-20T00:21:45.998Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:20:37.779 Verification LBA range: start 0x0 length 0x2000 00:20:37.779 TLSTESTn1 : 10.02 3827.26 14.95 0.00 0.00 33394.76 4247.70 40583.77 00:20:37.779 [2024-11-20T00:21:45.998Z] =================================================================================================================== 00:20:37.779 [2024-11-20T00:21:45.998Z] Total : 3827.26 14.95 0.00 0.00 33394.76 4247.70 40583.77 00:20:37.779 0 00:20:37.779 01:21:43 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:20:37.779 01:21:43 -- target/tls.sh@45 -- # killprocess 1169460 00:20:37.779 01:21:43 -- common/autotest_common.sh@936 -- # '[' -z 1169460 ']' 00:20:37.779 01:21:43 -- common/autotest_common.sh@940 -- # kill -0 1169460 00:20:37.779 01:21:43 -- common/autotest_common.sh@941 -- # uname 00:20:37.779 01:21:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:37.779 01:21:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1169460 00:20:37.779 01:21:43 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:37.779 01:21:43 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:37.779 01:21:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1169460' 00:20:37.779 killing process with pid 1169460 00:20:37.779 01:21:43 -- common/autotest_common.sh@955 -- # kill 1169460 00:20:37.779 Received shutdown signal, test time was about 10.000000 seconds 00:20:37.779 00:20:37.779 Latency(us) 00:20:37.779 [2024-11-20T00:21:45.998Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:37.779 [2024-11-20T00:21:45.998Z] =================================================================================================================== 00:20:37.779 [2024-11-20T00:21:45.998Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:37.779 01:21:43 -- common/autotest_common.sh@960 -- # wait 1169460 00:20:37.779 01:21:44 -- target/tls.sh@179 -- # chmod 0666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:37.779 01:21:44 -- target/tls.sh@180 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:37.779 01:21:44 -- common/autotest_common.sh@650 -- # local es=0 00:20:37.779 01:21:44 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:37.779 01:21:44 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:37.779 01:21:44 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:37.779 01:21:44 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:37.779 01:21:44 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:37.779 01:21:44 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:37.779 01:21:44 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:37.779 01:21:44 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:37.779 01:21:44 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:37.779 01:21:44 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:20:37.779 01:21:44 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:37.779 01:21:44 -- target/tls.sh@28 -- # bdevperf_pid=1170952 00:20:37.779 01:21:44 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:37.779 01:21:44 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:37.779 01:21:44 -- target/tls.sh@31 -- # waitforlisten 1170952 /var/tmp/bdevperf.sock 00:20:37.779 01:21:44 -- common/autotest_common.sh@829 -- # '[' -z 1170952 ']' 00:20:37.779 01:21:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:37.779 01:21:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:37.779 01:21:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:37.779 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:37.779 01:21:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:37.779 01:21:44 -- common/autotest_common.sh@10 -- # set +x 00:20:37.779 [2024-11-20 01:21:44.144702] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:37.779 [2024-11-20 01:21:44.144778] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1170952 ] 00:20:37.779 EAL: No free 2048 kB hugepages reported on node 1 00:20:37.779 [2024-11-20 01:21:44.201103] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:37.779 [2024-11-20 01:21:44.279789] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:37.779 01:21:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:37.779 01:21:45 -- common/autotest_common.sh@862 -- # return 0 00:20:37.779 01:21:45 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:37.779 [2024-11-20 01:21:45.341455] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:37.779 [2024-11-20 01:21:45.341507] bdev_nvme_rpc.c: 336:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:20:37.779 request: 00:20:37.779 { 00:20:37.779 "name": "TLSTEST", 00:20:37.779 "trtype": "tcp", 00:20:37.779 "traddr": "10.0.0.2", 00:20:37.779 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:37.779 "adrfam": "ipv4", 00:20:37.779 "trsvcid": "4420", 00:20:37.779 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:37.779 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:20:37.779 "method": "bdev_nvme_attach_controller", 00:20:37.779 "req_id": 1 00:20:37.779 } 00:20:37.779 Got JSON-RPC error response 00:20:37.779 response: 00:20:37.779 { 00:20:37.779 "code": -22, 00:20:37.779 "message": "Could not retrieve PSK from file: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:20:37.779 } 00:20:37.779 01:21:45 -- target/tls.sh@36 -- # killprocess 1170952 00:20:37.779 01:21:45 -- common/autotest_common.sh@936 -- # '[' -z 1170952 ']' 00:20:37.779 01:21:45 -- common/autotest_common.sh@940 -- # kill -0 1170952 00:20:37.779 01:21:45 -- common/autotest_common.sh@941 -- # uname 00:20:37.779 01:21:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:37.779 01:21:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1170952 00:20:37.779 01:21:45 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:37.779 01:21:45 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:37.779 01:21:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1170952' 00:20:37.779 killing process with pid 1170952 00:20:37.779 01:21:45 -- common/autotest_common.sh@955 -- # kill 1170952 00:20:37.779 Received shutdown signal, test time was about 10.000000 seconds 00:20:37.779 00:20:37.779 Latency(us) 00:20:37.779 [2024-11-20T00:21:45.998Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:37.779 [2024-11-20T00:21:45.998Z] =================================================================================================================== 00:20:37.779 [2024-11-20T00:21:45.998Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:37.779 01:21:45 -- common/autotest_common.sh@960 -- # wait 1170952 00:20:37.779 01:21:45 -- target/tls.sh@37 -- # return 1 00:20:37.779 01:21:45 -- common/autotest_common.sh@653 -- # es=1 00:20:37.779 01:21:45 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:37.779 01:21:45 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:37.779 01:21:45 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:37.779 01:21:45 -- target/tls.sh@183 -- # killprocess 1169161 00:20:37.780 01:21:45 -- common/autotest_common.sh@936 -- # '[' -z 1169161 ']' 00:20:37.780 01:21:45 -- common/autotest_common.sh@940 -- # kill -0 1169161 00:20:37.780 01:21:45 -- common/autotest_common.sh@941 -- # uname 00:20:37.780 01:21:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:37.780 01:21:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1169161 00:20:37.780 01:21:45 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:37.780 01:21:45 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:37.780 01:21:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1169161' 00:20:37.780 killing process with pid 1169161 00:20:37.780 01:21:45 -- common/autotest_common.sh@955 -- # kill 1169161 00:20:37.780 01:21:45 -- common/autotest_common.sh@960 -- # wait 1169161 00:20:37.780 01:21:45 -- target/tls.sh@184 -- # nvmfappstart -m 0x2 00:20:37.780 01:21:45 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:37.780 01:21:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:37.780 01:21:45 -- common/autotest_common.sh@10 -- # set +x 00:20:37.780 01:21:45 -- nvmf/common.sh@469 -- # nvmfpid=1171209 00:20:37.780 01:21:45 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:20:37.780 01:21:45 -- nvmf/common.sh@470 -- # waitforlisten 1171209 00:20:37.780 01:21:45 -- common/autotest_common.sh@829 -- # '[' -z 1171209 ']' 00:20:37.780 01:21:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:37.780 01:21:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:37.780 01:21:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:37.780 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:37.780 01:21:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:37.780 01:21:45 -- common/autotest_common.sh@10 -- # set +x 00:20:37.780 [2024-11-20 01:21:45.959782] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:37.780 [2024-11-20 01:21:45.959864] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:37.780 EAL: No free 2048 kB hugepages reported on node 1 00:20:38.038 [2024-11-20 01:21:46.028989] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:38.038 [2024-11-20 01:21:46.124325] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:38.038 [2024-11-20 01:21:46.124515] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:38.038 [2024-11-20 01:21:46.124554] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:38.038 [2024-11-20 01:21:46.124576] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:38.038 [2024-11-20 01:21:46.124635] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:38.970 01:21:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:38.970 01:21:46 -- common/autotest_common.sh@862 -- # return 0 00:20:38.970 01:21:46 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:38.970 01:21:46 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:38.970 01:21:46 -- common/autotest_common.sh@10 -- # set +x 00:20:38.970 01:21:46 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:38.970 01:21:46 -- target/tls.sh@186 -- # NOT setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:38.970 01:21:46 -- common/autotest_common.sh@650 -- # local es=0 00:20:38.970 01:21:46 -- common/autotest_common.sh@652 -- # valid_exec_arg setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:38.970 01:21:46 -- common/autotest_common.sh@638 -- # local arg=setup_nvmf_tgt 00:20:38.970 01:21:46 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:38.970 01:21:46 -- common/autotest_common.sh@642 -- # type -t setup_nvmf_tgt 00:20:38.970 01:21:46 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:38.970 01:21:46 -- common/autotest_common.sh@653 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:38.970 01:21:46 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:38.970 01:21:46 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:38.970 [2024-11-20 01:21:47.180200] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:39.228 01:21:47 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:39.485 01:21:47 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:39.485 [2024-11-20 01:21:47.677524] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:39.485 [2024-11-20 01:21:47.677812] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:39.485 01:21:47 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:39.743 malloc0 00:20:39.743 01:21:47 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:40.309 01:21:48 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:40.309 [2024-11-20 01:21:48.491208] tcp.c:3551:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:20:40.309 [2024-11-20 01:21:48.491244] tcp.c:3620:nvmf_tcp_subsystem_add_host: *ERROR*: Could not retrieve PSK from file 00:20:40.309 [2024-11-20 01:21:48.491274] subsystem.c: 880:spdk_nvmf_subsystem_add_host: *ERROR*: Unable to add host to TCP transport 00:20:40.309 request: 00:20:40.309 { 00:20:40.309 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:40.309 "host": "nqn.2016-06.io.spdk:host1", 00:20:40.309 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:20:40.309 "method": "nvmf_subsystem_add_host", 00:20:40.309 "req_id": 1 00:20:40.309 } 00:20:40.309 Got JSON-RPC error response 00:20:40.309 response: 00:20:40.309 { 00:20:40.309 "code": -32603, 00:20:40.309 "message": "Internal error" 00:20:40.309 } 00:20:40.309 01:21:48 -- common/autotest_common.sh@653 -- # es=1 00:20:40.309 01:21:48 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:40.309 01:21:48 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:40.309 01:21:48 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:40.309 01:21:48 -- target/tls.sh@189 -- # killprocess 1171209 00:20:40.309 01:21:48 -- common/autotest_common.sh@936 -- # '[' -z 1171209 ']' 00:20:40.309 01:21:48 -- common/autotest_common.sh@940 -- # kill -0 1171209 00:20:40.309 01:21:48 -- common/autotest_common.sh@941 -- # uname 00:20:40.309 01:21:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:40.309 01:21:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1171209 00:20:40.567 01:21:48 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:40.567 01:21:48 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:40.567 01:21:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1171209' 00:20:40.567 killing process with pid 1171209 00:20:40.567 01:21:48 -- common/autotest_common.sh@955 -- # kill 1171209 00:20:40.567 01:21:48 -- common/autotest_common.sh@960 -- # wait 1171209 00:20:40.825 01:21:48 -- target/tls.sh@190 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:40.825 01:21:48 -- target/tls.sh@193 -- # nvmfappstart -m 0x2 00:20:40.825 01:21:48 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:40.825 01:21:48 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:40.825 01:21:48 -- common/autotest_common.sh@10 -- # set +x 00:20:40.825 01:21:48 -- nvmf/common.sh@469 -- # nvmfpid=1171647 00:20:40.825 01:21:48 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:20:40.825 01:21:48 -- nvmf/common.sh@470 -- # waitforlisten 1171647 00:20:40.825 01:21:48 -- common/autotest_common.sh@829 -- # '[' -z 1171647 ']' 00:20:40.825 01:21:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:40.825 01:21:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:40.825 01:21:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:40.825 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:40.825 01:21:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:40.825 01:21:48 -- common/autotest_common.sh@10 -- # set +x 00:20:40.825 [2024-11-20 01:21:48.859155] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:40.826 [2024-11-20 01:21:48.859232] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:40.826 EAL: No free 2048 kB hugepages reported on node 1 00:20:40.826 [2024-11-20 01:21:48.927207] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:40.826 [2024-11-20 01:21:49.012394] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:40.826 [2024-11-20 01:21:49.012549] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:40.826 [2024-11-20 01:21:49.012573] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:40.826 [2024-11-20 01:21:49.012593] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:40.826 [2024-11-20 01:21:49.012650] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:41.759 01:21:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:41.759 01:21:49 -- common/autotest_common.sh@862 -- # return 0 00:20:41.759 01:21:49 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:41.759 01:21:49 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:41.759 01:21:49 -- common/autotest_common.sh@10 -- # set +x 00:20:41.759 01:21:49 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:41.759 01:21:49 -- target/tls.sh@194 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:41.759 01:21:49 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:41.759 01:21:49 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:42.017 [2024-11-20 01:21:50.074065] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:42.018 01:21:50 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:42.276 01:21:50 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:42.534 [2024-11-20 01:21:50.579445] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:42.534 [2024-11-20 01:21:50.579746] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:42.534 01:21:50 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:42.792 malloc0 00:20:42.792 01:21:50 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:43.050 01:21:51 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:43.308 01:21:51 -- target/tls.sh@197 -- # bdevperf_pid=1171946 00:20:43.308 01:21:51 -- target/tls.sh@196 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:43.308 01:21:51 -- target/tls.sh@199 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:43.308 01:21:51 -- target/tls.sh@200 -- # waitforlisten 1171946 /var/tmp/bdevperf.sock 00:20:43.308 01:21:51 -- common/autotest_common.sh@829 -- # '[' -z 1171946 ']' 00:20:43.308 01:21:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:43.308 01:21:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:43.308 01:21:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:43.308 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:43.308 01:21:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:43.308 01:21:51 -- common/autotest_common.sh@10 -- # set +x 00:20:43.308 [2024-11-20 01:21:51.454977] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:43.308 [2024-11-20 01:21:51.455055] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1171946 ] 00:20:43.308 EAL: No free 2048 kB hugepages reported on node 1 00:20:43.567 [2024-11-20 01:21:51.529238] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:43.567 [2024-11-20 01:21:51.629112] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:43.824 01:21:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:43.824 01:21:51 -- common/autotest_common.sh@862 -- # return 0 00:20:43.824 01:21:51 -- target/tls.sh@201 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:44.082 [2024-11-20 01:21:52.045575] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:44.082 TLSTESTn1 00:20:44.082 01:21:52 -- target/tls.sh@205 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py save_config 00:20:44.341 01:21:52 -- target/tls.sh@205 -- # tgtconf='{ 00:20:44.341 "subsystems": [ 00:20:44.341 { 00:20:44.341 "subsystem": "iobuf", 00:20:44.341 "config": [ 00:20:44.341 { 00:20:44.341 "method": "iobuf_set_options", 00:20:44.341 "params": { 00:20:44.341 "small_pool_count": 8192, 00:20:44.341 "large_pool_count": 1024, 00:20:44.341 "small_bufsize": 8192, 00:20:44.341 "large_bufsize": 135168 00:20:44.341 } 00:20:44.341 } 00:20:44.341 ] 00:20:44.341 }, 00:20:44.341 { 00:20:44.341 "subsystem": "sock", 00:20:44.341 "config": [ 00:20:44.341 { 00:20:44.341 "method": "sock_impl_set_options", 00:20:44.341 "params": { 00:20:44.341 "impl_name": "posix", 00:20:44.341 "recv_buf_size": 2097152, 00:20:44.341 "send_buf_size": 2097152, 00:20:44.341 "enable_recv_pipe": true, 00:20:44.341 "enable_quickack": false, 00:20:44.341 "enable_placement_id": 0, 00:20:44.341 "enable_zerocopy_send_server": true, 00:20:44.341 "enable_zerocopy_send_client": false, 00:20:44.341 "zerocopy_threshold": 0, 00:20:44.341 "tls_version": 0, 00:20:44.341 "enable_ktls": false 00:20:44.341 } 00:20:44.341 }, 00:20:44.341 { 00:20:44.341 "method": "sock_impl_set_options", 00:20:44.341 "params": { 00:20:44.341 "impl_name": "ssl", 00:20:44.341 "recv_buf_size": 4096, 00:20:44.341 "send_buf_size": 4096, 00:20:44.341 "enable_recv_pipe": true, 00:20:44.341 "enable_quickack": false, 00:20:44.341 "enable_placement_id": 0, 00:20:44.341 "enable_zerocopy_send_server": true, 00:20:44.341 "enable_zerocopy_send_client": false, 00:20:44.341 "zerocopy_threshold": 0, 00:20:44.341 "tls_version": 0, 00:20:44.341 "enable_ktls": false 00:20:44.341 } 00:20:44.341 } 00:20:44.341 ] 00:20:44.341 }, 00:20:44.341 { 00:20:44.341 "subsystem": "vmd", 00:20:44.341 "config": [] 00:20:44.341 }, 00:20:44.341 { 00:20:44.341 "subsystem": "accel", 00:20:44.341 "config": [ 00:20:44.341 { 00:20:44.341 "method": "accel_set_options", 00:20:44.341 "params": { 00:20:44.341 "small_cache_size": 128, 00:20:44.341 "large_cache_size": 16, 00:20:44.341 "task_count": 2048, 00:20:44.341 "sequence_count": 2048, 00:20:44.341 "buf_count": 2048 00:20:44.341 } 00:20:44.341 } 00:20:44.341 ] 00:20:44.341 }, 00:20:44.341 { 00:20:44.341 "subsystem": "bdev", 00:20:44.341 "config": [ 00:20:44.341 { 00:20:44.341 "method": "bdev_set_options", 00:20:44.341 "params": { 00:20:44.341 "bdev_io_pool_size": 65535, 00:20:44.341 "bdev_io_cache_size": 256, 00:20:44.341 "bdev_auto_examine": true, 00:20:44.341 "iobuf_small_cache_size": 128, 00:20:44.341 "iobuf_large_cache_size": 16 00:20:44.341 } 00:20:44.341 }, 00:20:44.341 { 00:20:44.341 "method": "bdev_raid_set_options", 00:20:44.341 "params": { 00:20:44.341 "process_window_size_kb": 1024 00:20:44.341 } 00:20:44.341 }, 00:20:44.341 { 00:20:44.341 "method": "bdev_iscsi_set_options", 00:20:44.341 "params": { 00:20:44.341 "timeout_sec": 30 00:20:44.341 } 00:20:44.341 }, 00:20:44.341 { 00:20:44.341 "method": "bdev_nvme_set_options", 00:20:44.341 "params": { 00:20:44.341 "action_on_timeout": "none", 00:20:44.341 "timeout_us": 0, 00:20:44.341 "timeout_admin_us": 0, 00:20:44.341 "keep_alive_timeout_ms": 10000, 00:20:44.341 "transport_retry_count": 4, 00:20:44.341 "arbitration_burst": 0, 00:20:44.341 "low_priority_weight": 0, 00:20:44.341 "medium_priority_weight": 0, 00:20:44.341 "high_priority_weight": 0, 00:20:44.341 "nvme_adminq_poll_period_us": 10000, 00:20:44.341 "nvme_ioq_poll_period_us": 0, 00:20:44.341 "io_queue_requests": 0, 00:20:44.341 "delay_cmd_submit": true, 00:20:44.341 "bdev_retry_count": 3, 00:20:44.341 "transport_ack_timeout": 0, 00:20:44.341 "ctrlr_loss_timeout_sec": 0, 00:20:44.341 "reconnect_delay_sec": 0, 00:20:44.341 "fast_io_fail_timeout_sec": 0, 00:20:44.341 "generate_uuids": false, 00:20:44.341 "transport_tos": 0, 00:20:44.341 "io_path_stat": false, 00:20:44.341 "allow_accel_sequence": false 00:20:44.341 } 00:20:44.341 }, 00:20:44.341 { 00:20:44.341 "method": "bdev_nvme_set_hotplug", 00:20:44.341 "params": { 00:20:44.341 "period_us": 100000, 00:20:44.341 "enable": false 00:20:44.341 } 00:20:44.341 }, 00:20:44.341 { 00:20:44.341 "method": "bdev_malloc_create", 00:20:44.341 "params": { 00:20:44.341 "name": "malloc0", 00:20:44.341 "num_blocks": 8192, 00:20:44.341 "block_size": 4096, 00:20:44.341 "physical_block_size": 4096, 00:20:44.341 "uuid": "324d218e-14a7-4437-9ff8-7b5b2b140961", 00:20:44.341 "optimal_io_boundary": 0 00:20:44.341 } 00:20:44.341 }, 00:20:44.341 { 00:20:44.341 "method": "bdev_wait_for_examine" 00:20:44.341 } 00:20:44.341 ] 00:20:44.341 }, 00:20:44.341 { 00:20:44.341 "subsystem": "nbd", 00:20:44.341 "config": [] 00:20:44.341 }, 00:20:44.341 { 00:20:44.341 "subsystem": "scheduler", 00:20:44.341 "config": [ 00:20:44.341 { 00:20:44.341 "method": "framework_set_scheduler", 00:20:44.342 "params": { 00:20:44.342 "name": "static" 00:20:44.342 } 00:20:44.342 } 00:20:44.342 ] 00:20:44.342 }, 00:20:44.342 { 00:20:44.342 "subsystem": "nvmf", 00:20:44.342 "config": [ 00:20:44.342 { 00:20:44.342 "method": "nvmf_set_config", 00:20:44.342 "params": { 00:20:44.342 "discovery_filter": "match_any", 00:20:44.342 "admin_cmd_passthru": { 00:20:44.342 "identify_ctrlr": false 00:20:44.342 } 00:20:44.342 } 00:20:44.342 }, 00:20:44.342 { 00:20:44.342 "method": "nvmf_set_max_subsystems", 00:20:44.342 "params": { 00:20:44.342 "max_subsystems": 1024 00:20:44.342 } 00:20:44.342 }, 00:20:44.342 { 00:20:44.342 "method": "nvmf_set_crdt", 00:20:44.342 "params": { 00:20:44.342 "crdt1": 0, 00:20:44.342 "crdt2": 0, 00:20:44.342 "crdt3": 0 00:20:44.342 } 00:20:44.342 }, 00:20:44.342 { 00:20:44.342 "method": "nvmf_create_transport", 00:20:44.342 "params": { 00:20:44.342 "trtype": "TCP", 00:20:44.342 "max_queue_depth": 128, 00:20:44.342 "max_io_qpairs_per_ctrlr": 127, 00:20:44.342 "in_capsule_data_size": 4096, 00:20:44.342 "max_io_size": 131072, 00:20:44.342 "io_unit_size": 131072, 00:20:44.342 "max_aq_depth": 128, 00:20:44.342 "num_shared_buffers": 511, 00:20:44.342 "buf_cache_size": 4294967295, 00:20:44.342 "dif_insert_or_strip": false, 00:20:44.342 "zcopy": false, 00:20:44.342 "c2h_success": false, 00:20:44.342 "sock_priority": 0, 00:20:44.342 "abort_timeout_sec": 1 00:20:44.342 } 00:20:44.342 }, 00:20:44.342 { 00:20:44.342 "method": "nvmf_create_subsystem", 00:20:44.342 "params": { 00:20:44.342 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:44.342 "allow_any_host": false, 00:20:44.342 "serial_number": "SPDK00000000000001", 00:20:44.342 "model_number": "SPDK bdev Controller", 00:20:44.342 "max_namespaces": 10, 00:20:44.342 "min_cntlid": 1, 00:20:44.342 "max_cntlid": 65519, 00:20:44.342 "ana_reporting": false 00:20:44.342 } 00:20:44.342 }, 00:20:44.342 { 00:20:44.342 "method": "nvmf_subsystem_add_host", 00:20:44.342 "params": { 00:20:44.342 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:44.342 "host": "nqn.2016-06.io.spdk:host1", 00:20:44.342 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:20:44.342 } 00:20:44.342 }, 00:20:44.342 { 00:20:44.342 "method": "nvmf_subsystem_add_ns", 00:20:44.342 "params": { 00:20:44.342 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:44.342 "namespace": { 00:20:44.342 "nsid": 1, 00:20:44.342 "bdev_name": "malloc0", 00:20:44.342 "nguid": "324D218E14A744379FF87B5B2B140961", 00:20:44.342 "uuid": "324d218e-14a7-4437-9ff8-7b5b2b140961" 00:20:44.342 } 00:20:44.342 } 00:20:44.342 }, 00:20:44.342 { 00:20:44.342 "method": "nvmf_subsystem_add_listener", 00:20:44.342 "params": { 00:20:44.342 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:44.342 "listen_address": { 00:20:44.342 "trtype": "TCP", 00:20:44.342 "adrfam": "IPv4", 00:20:44.342 "traddr": "10.0.0.2", 00:20:44.342 "trsvcid": "4420" 00:20:44.342 }, 00:20:44.342 "secure_channel": true 00:20:44.342 } 00:20:44.342 } 00:20:44.342 ] 00:20:44.342 } 00:20:44.342 ] 00:20:44.342 }' 00:20:44.342 01:21:52 -- target/tls.sh@206 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock save_config 00:20:44.655 01:21:52 -- target/tls.sh@206 -- # bdevperfconf='{ 00:20:44.655 "subsystems": [ 00:20:44.655 { 00:20:44.655 "subsystem": "iobuf", 00:20:44.655 "config": [ 00:20:44.655 { 00:20:44.655 "method": "iobuf_set_options", 00:20:44.655 "params": { 00:20:44.655 "small_pool_count": 8192, 00:20:44.655 "large_pool_count": 1024, 00:20:44.655 "small_bufsize": 8192, 00:20:44.655 "large_bufsize": 135168 00:20:44.655 } 00:20:44.655 } 00:20:44.655 ] 00:20:44.655 }, 00:20:44.655 { 00:20:44.655 "subsystem": "sock", 00:20:44.655 "config": [ 00:20:44.655 { 00:20:44.655 "method": "sock_impl_set_options", 00:20:44.655 "params": { 00:20:44.655 "impl_name": "posix", 00:20:44.655 "recv_buf_size": 2097152, 00:20:44.655 "send_buf_size": 2097152, 00:20:44.655 "enable_recv_pipe": true, 00:20:44.655 "enable_quickack": false, 00:20:44.655 "enable_placement_id": 0, 00:20:44.655 "enable_zerocopy_send_server": true, 00:20:44.655 "enable_zerocopy_send_client": false, 00:20:44.655 "zerocopy_threshold": 0, 00:20:44.655 "tls_version": 0, 00:20:44.655 "enable_ktls": false 00:20:44.655 } 00:20:44.655 }, 00:20:44.655 { 00:20:44.655 "method": "sock_impl_set_options", 00:20:44.655 "params": { 00:20:44.655 "impl_name": "ssl", 00:20:44.655 "recv_buf_size": 4096, 00:20:44.655 "send_buf_size": 4096, 00:20:44.655 "enable_recv_pipe": true, 00:20:44.655 "enable_quickack": false, 00:20:44.655 "enable_placement_id": 0, 00:20:44.655 "enable_zerocopy_send_server": true, 00:20:44.655 "enable_zerocopy_send_client": false, 00:20:44.655 "zerocopy_threshold": 0, 00:20:44.655 "tls_version": 0, 00:20:44.655 "enable_ktls": false 00:20:44.655 } 00:20:44.655 } 00:20:44.655 ] 00:20:44.655 }, 00:20:44.655 { 00:20:44.655 "subsystem": "vmd", 00:20:44.655 "config": [] 00:20:44.655 }, 00:20:44.655 { 00:20:44.655 "subsystem": "accel", 00:20:44.655 "config": [ 00:20:44.655 { 00:20:44.655 "method": "accel_set_options", 00:20:44.655 "params": { 00:20:44.655 "small_cache_size": 128, 00:20:44.655 "large_cache_size": 16, 00:20:44.655 "task_count": 2048, 00:20:44.655 "sequence_count": 2048, 00:20:44.655 "buf_count": 2048 00:20:44.655 } 00:20:44.655 } 00:20:44.655 ] 00:20:44.655 }, 00:20:44.655 { 00:20:44.655 "subsystem": "bdev", 00:20:44.655 "config": [ 00:20:44.655 { 00:20:44.655 "method": "bdev_set_options", 00:20:44.655 "params": { 00:20:44.655 "bdev_io_pool_size": 65535, 00:20:44.655 "bdev_io_cache_size": 256, 00:20:44.655 "bdev_auto_examine": true, 00:20:44.655 "iobuf_small_cache_size": 128, 00:20:44.655 "iobuf_large_cache_size": 16 00:20:44.655 } 00:20:44.655 }, 00:20:44.655 { 00:20:44.655 "method": "bdev_raid_set_options", 00:20:44.655 "params": { 00:20:44.655 "process_window_size_kb": 1024 00:20:44.655 } 00:20:44.655 }, 00:20:44.655 { 00:20:44.655 "method": "bdev_iscsi_set_options", 00:20:44.655 "params": { 00:20:44.655 "timeout_sec": 30 00:20:44.655 } 00:20:44.655 }, 00:20:44.655 { 00:20:44.655 "method": "bdev_nvme_set_options", 00:20:44.655 "params": { 00:20:44.655 "action_on_timeout": "none", 00:20:44.655 "timeout_us": 0, 00:20:44.655 "timeout_admin_us": 0, 00:20:44.655 "keep_alive_timeout_ms": 10000, 00:20:44.655 "transport_retry_count": 4, 00:20:44.655 "arbitration_burst": 0, 00:20:44.655 "low_priority_weight": 0, 00:20:44.655 "medium_priority_weight": 0, 00:20:44.655 "high_priority_weight": 0, 00:20:44.655 "nvme_adminq_poll_period_us": 10000, 00:20:44.655 "nvme_ioq_poll_period_us": 0, 00:20:44.655 "io_queue_requests": 512, 00:20:44.655 "delay_cmd_submit": true, 00:20:44.655 "bdev_retry_count": 3, 00:20:44.655 "transport_ack_timeout": 0, 00:20:44.655 "ctrlr_loss_timeout_sec": 0, 00:20:44.655 "reconnect_delay_sec": 0, 00:20:44.655 "fast_io_fail_timeout_sec": 0, 00:20:44.655 "generate_uuids": false, 00:20:44.655 "transport_tos": 0, 00:20:44.655 "io_path_stat": false, 00:20:44.655 "allow_accel_sequence": false 00:20:44.655 } 00:20:44.655 }, 00:20:44.655 { 00:20:44.655 "method": "bdev_nvme_attach_controller", 00:20:44.655 "params": { 00:20:44.655 "name": "TLSTEST", 00:20:44.655 "trtype": "TCP", 00:20:44.655 "adrfam": "IPv4", 00:20:44.655 "traddr": "10.0.0.2", 00:20:44.655 "trsvcid": "4420", 00:20:44.655 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:44.655 "prchk_reftag": false, 00:20:44.655 "prchk_guard": false, 00:20:44.655 "ctrlr_loss_timeout_sec": 0, 00:20:44.655 "reconnect_delay_sec": 0, 00:20:44.655 "fast_io_fail_timeout_sec": 0, 00:20:44.655 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:20:44.655 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:44.655 "hdgst": false, 00:20:44.656 "ddgst": false 00:20:44.656 } 00:20:44.656 }, 00:20:44.656 { 00:20:44.656 "method": "bdev_nvme_set_hotplug", 00:20:44.656 "params": { 00:20:44.656 "period_us": 100000, 00:20:44.656 "enable": false 00:20:44.656 } 00:20:44.656 }, 00:20:44.656 { 00:20:44.656 "method": "bdev_wait_for_examine" 00:20:44.656 } 00:20:44.656 ] 00:20:44.656 }, 00:20:44.656 { 00:20:44.656 "subsystem": "nbd", 00:20:44.656 "config": [] 00:20:44.656 } 00:20:44.656 ] 00:20:44.656 }' 00:20:44.656 01:21:52 -- target/tls.sh@208 -- # killprocess 1171946 00:20:44.656 01:21:52 -- common/autotest_common.sh@936 -- # '[' -z 1171946 ']' 00:20:44.656 01:21:52 -- common/autotest_common.sh@940 -- # kill -0 1171946 00:20:44.656 01:21:52 -- common/autotest_common.sh@941 -- # uname 00:20:44.656 01:21:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:44.656 01:21:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1171946 00:20:44.953 01:21:52 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:44.953 01:21:52 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:44.953 01:21:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1171946' 00:20:44.953 killing process with pid 1171946 00:20:44.953 01:21:52 -- common/autotest_common.sh@955 -- # kill 1171946 00:20:44.953 Received shutdown signal, test time was about 10.000000 seconds 00:20:44.953 00:20:44.953 Latency(us) 00:20:44.953 [2024-11-20T00:21:53.172Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:44.953 [2024-11-20T00:21:53.172Z] =================================================================================================================== 00:20:44.953 [2024-11-20T00:21:53.172Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:44.953 01:21:52 -- common/autotest_common.sh@960 -- # wait 1171946 00:20:44.953 01:21:53 -- target/tls.sh@209 -- # killprocess 1171647 00:20:44.953 01:21:53 -- common/autotest_common.sh@936 -- # '[' -z 1171647 ']' 00:20:44.953 01:21:53 -- common/autotest_common.sh@940 -- # kill -0 1171647 00:20:44.953 01:21:53 -- common/autotest_common.sh@941 -- # uname 00:20:44.953 01:21:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:44.953 01:21:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1171647 00:20:44.953 01:21:53 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:44.953 01:21:53 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:44.953 01:21:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1171647' 00:20:44.953 killing process with pid 1171647 00:20:44.953 01:21:53 -- common/autotest_common.sh@955 -- # kill 1171647 00:20:44.953 01:21:53 -- common/autotest_common.sh@960 -- # wait 1171647 00:20:45.213 01:21:53 -- target/tls.sh@212 -- # nvmfappstart -m 0x2 -c /dev/fd/62 00:20:45.213 01:21:53 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:45.213 01:21:53 -- target/tls.sh@212 -- # echo '{ 00:20:45.213 "subsystems": [ 00:20:45.213 { 00:20:45.213 "subsystem": "iobuf", 00:20:45.213 "config": [ 00:20:45.213 { 00:20:45.213 "method": "iobuf_set_options", 00:20:45.213 "params": { 00:20:45.213 "small_pool_count": 8192, 00:20:45.213 "large_pool_count": 1024, 00:20:45.213 "small_bufsize": 8192, 00:20:45.213 "large_bufsize": 135168 00:20:45.213 } 00:20:45.213 } 00:20:45.213 ] 00:20:45.213 }, 00:20:45.213 { 00:20:45.213 "subsystem": "sock", 00:20:45.213 "config": [ 00:20:45.213 { 00:20:45.213 "method": "sock_impl_set_options", 00:20:45.213 "params": { 00:20:45.213 "impl_name": "posix", 00:20:45.213 "recv_buf_size": 2097152, 00:20:45.213 "send_buf_size": 2097152, 00:20:45.213 "enable_recv_pipe": true, 00:20:45.213 "enable_quickack": false, 00:20:45.213 "enable_placement_id": 0, 00:20:45.213 "enable_zerocopy_send_server": true, 00:20:45.213 "enable_zerocopy_send_client": false, 00:20:45.213 "zerocopy_threshold": 0, 00:20:45.213 "tls_version": 0, 00:20:45.213 "enable_ktls": false 00:20:45.213 } 00:20:45.213 }, 00:20:45.213 { 00:20:45.213 "method": "sock_impl_set_options", 00:20:45.213 "params": { 00:20:45.213 "impl_name": "ssl", 00:20:45.213 "recv_buf_size": 4096, 00:20:45.213 "send_buf_size": 4096, 00:20:45.213 "enable_recv_pipe": true, 00:20:45.213 "enable_quickack": false, 00:20:45.213 "enable_placement_id": 0, 00:20:45.213 "enable_zerocopy_send_server": true, 00:20:45.213 "enable_zerocopy_send_client": false, 00:20:45.213 "zerocopy_threshold": 0, 00:20:45.213 "tls_version": 0, 00:20:45.213 "enable_ktls": false 00:20:45.213 } 00:20:45.213 } 00:20:45.213 ] 00:20:45.213 }, 00:20:45.213 { 00:20:45.213 "subsystem": "vmd", 00:20:45.213 "config": [] 00:20:45.213 }, 00:20:45.213 { 00:20:45.213 "subsystem": "accel", 00:20:45.213 "config": [ 00:20:45.213 { 00:20:45.213 "method": "accel_set_options", 00:20:45.213 "params": { 00:20:45.213 "small_cache_size": 128, 00:20:45.213 "large_cache_size": 16, 00:20:45.213 "task_count": 2048, 00:20:45.213 "sequence_count": 2048, 00:20:45.213 "buf_count": 2048 00:20:45.213 } 00:20:45.213 } 00:20:45.213 ] 00:20:45.213 }, 00:20:45.213 { 00:20:45.213 "subsystem": "bdev", 00:20:45.213 "config": [ 00:20:45.213 { 00:20:45.213 "method": "bdev_set_options", 00:20:45.213 "params": { 00:20:45.213 "bdev_io_pool_size": 65535, 00:20:45.213 "bdev_io_cache_size": 256, 00:20:45.213 "bdev_auto_examine": true, 00:20:45.213 "iobuf_small_cache_size": 128, 00:20:45.213 "iobuf_large_cache_size": 16 00:20:45.213 } 00:20:45.213 }, 00:20:45.213 { 00:20:45.213 "method": "bdev_raid_set_options", 00:20:45.213 "params": { 00:20:45.213 "process_window_size_kb": 1024 00:20:45.213 } 00:20:45.213 }, 00:20:45.213 { 00:20:45.213 "method": "bdev_iscsi_set_options", 00:20:45.213 "params": { 00:20:45.213 "timeout_sec": 30 00:20:45.213 } 00:20:45.213 }, 00:20:45.213 { 00:20:45.213 "method": "bdev_nvme_set_options", 00:20:45.213 "params": { 00:20:45.213 "action_on_timeout": "none", 00:20:45.213 "timeout_us": 0, 00:20:45.213 "timeout_admin_us": 0, 00:20:45.213 "keep_alive_timeout_ms": 10000, 00:20:45.213 "transport_retry_count": 4, 00:20:45.213 "arbitration_burst": 0, 00:20:45.213 "low_priority_weight": 0, 00:20:45.213 "medium_priority_weight": 0, 00:20:45.213 "high_priority_weight": 0, 00:20:45.213 "nvme_adminq_poll_period_us": 10000, 00:20:45.213 "nvme_ioq_poll_period_us": 0, 00:20:45.213 "io_queue_requests": 0, 00:20:45.213 "delay_cmd_submit": true, 00:20:45.213 "bdev_retry_count": 3, 00:20:45.213 "transport_ack_timeout": 0, 00:20:45.213 "ctrlr_loss_timeout_sec": 0, 00:20:45.213 "reconnect_delay_sec": 0, 00:20:45.213 "fast_io_fail_timeout_sec": 0, 00:20:45.213 "generate_uuids": false, 00:20:45.213 "transport_tos": 0, 00:20:45.213 "io_path_stat": false, 00:20:45.213 "allow_accel_sequence": false 00:20:45.213 } 00:20:45.213 }, 00:20:45.213 { 00:20:45.213 "method": "bdev_nvme_set_hotplug", 00:20:45.213 "params": { 00:20:45.213 "period_us": 100000, 00:20:45.213 "enable": false 00:20:45.213 } 00:20:45.213 }, 00:20:45.213 { 00:20:45.214 "method": "bdev_malloc_create", 00:20:45.214 "params": { 00:20:45.214 "name": "malloc0", 00:20:45.214 "num_blocks": 8192, 00:20:45.214 "block_size": 4096, 00:20:45.214 "physical_block_size": 4096, 00:20:45.214 "uuid": "324d218e-14a7-4437-9ff8-7b5b2b140961", 00:20:45.214 "optimal_io_boundary": 0 00:20:45.214 } 00:20:45.214 }, 00:20:45.214 { 00:20:45.214 "method": "bdev_wait_for_examine" 00:20:45.214 } 00:20:45.214 ] 00:20:45.214 }, 00:20:45.214 { 00:20:45.214 "subsystem": "nbd", 00:20:45.214 "config": [] 00:20:45.214 }, 00:20:45.214 { 00:20:45.214 "subsystem": "scheduler", 00:20:45.214 "config": [ 00:20:45.214 { 00:20:45.214 "method": "framework_set_scheduler", 00:20:45.214 "params": { 00:20:45.214 "name": "static" 00:20:45.214 } 00:20:45.214 } 00:20:45.214 ] 00:20:45.214 }, 00:20:45.214 { 00:20:45.214 "subsystem": "nvmf", 00:20:45.214 "config": [ 00:20:45.214 { 00:20:45.214 "method": "nvmf_set_config", 00:20:45.214 "params": { 00:20:45.214 "discovery_filter": "match_any", 00:20:45.214 "admin_cmd_passthru": { 00:20:45.214 "identify_ctrlr": false 00:20:45.214 } 00:20:45.214 } 00:20:45.214 }, 00:20:45.214 { 00:20:45.214 "method": "nvmf_set_max_subsystems", 00:20:45.214 "params": { 00:20:45.214 "max_subsystems": 1024 00:20:45.214 } 00:20:45.214 }, 00:20:45.214 { 00:20:45.214 "method": "nvmf_set_crdt", 00:20:45.214 "params": { 00:20:45.214 "crdt1": 0, 00:20:45.214 "crdt2": 0, 00:20:45.214 "crdt3": 0 00:20:45.214 } 00:20:45.214 }, 00:20:45.214 { 00:20:45.214 "method": "nvmf_create_transport", 00:20:45.214 "params": { 00:20:45.214 "trtype": "TCP", 00:20:45.214 "max_queue_depth": 128, 00:20:45.214 "max_io_qpairs_per_ctrlr": 127, 00:20:45.214 "in_capsule_data_size": 4096, 00:20:45.214 "max_io_size": 131072, 00:20:45.214 "io_unit_size": 131072, 00:20:45.214 "max_aq_depth": 128, 00:20:45.214 "num_shared_buffers": 511, 00:20:45.214 "buf_cache_size": 4294967295, 00:20:45.214 "dif_insert_or_strip": false, 00:20:45.214 "zcopy": false, 00:20:45.214 "c2h_success": false, 00:20:45.214 "sock_priority": 0, 00:20:45.214 "abort_timeout_sec": 1 00:20:45.214 } 00:20:45.214 }, 00:20:45.214 { 00:20:45.214 "method": "nvmf_create_subsystem", 00:20:45.214 "params": { 00:20:45.214 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:45.214 "allow_any_host": false, 00:20:45.214 "serial_number": "SPDK00000000000001", 00:20:45.214 "model_number": "SPDK bdev Controller", 00:20:45.214 "max_namespaces": 10, 00:20:45.214 "min_cntlid": 1, 00:20:45.214 "max_cntlid": 65519, 00:20:45.214 "ana_reporting": false 00:20:45.214 } 00:20:45.214 }, 00:20:45.214 { 00:20:45.214 "method": "nvmf_subsystem_add_host", 00:20:45.214 "params": { 00:20:45.214 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:45.214 "host": "nqn.2016-06.io.spdk:host1", 00:20:45.214 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:20:45.214 } 00:20:45.214 }, 00:20:45.214 { 00:20:45.214 "method": "nvmf_subsystem_add_ns", 00:20:45.214 "params": { 00:20:45.214 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:45.214 "namespace": { 00:20:45.214 "nsid": 1, 00:20:45.214 "bdev_name": "malloc0", 00:20:45.214 "nguid": "324D218E14A744379FF87B5B2B140961", 00:20:45.214 "uuid": "324d218e-14a7-4437-9ff8-7b5b2b140961" 00:20:45.214 } 00:20:45.214 } 00:20:45.214 }, 00:20:45.214 { 00:20:45.214 "method": "nvmf_subsystem_add_listener", 00:20:45.214 "params": { 00:20:45.214 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:45.214 "listen_address": { 00:20:45.214 "trtype": "TCP", 00:20:45.214 "adrfam": "IPv4", 00:20:45.214 "traddr": "10.0.0.2", 00:20:45.214 "trsvcid": "4420" 00:20:45.214 }, 00:20:45.214 "secure_channel": true 00:20:45.214 } 00:20:45.214 } 00:20:45.214 ] 00:20:45.214 } 00:20:45.214 ] 00:20:45.214 }' 00:20:45.214 01:21:53 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:45.214 01:21:53 -- common/autotest_common.sh@10 -- # set +x 00:20:45.214 01:21:53 -- nvmf/common.sh@469 -- # nvmfpid=1172237 00:20:45.214 01:21:53 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 -c /dev/fd/62 00:20:45.214 01:21:53 -- nvmf/common.sh@470 -- # waitforlisten 1172237 00:20:45.214 01:21:53 -- common/autotest_common.sh@829 -- # '[' -z 1172237 ']' 00:20:45.214 01:21:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:45.214 01:21:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:45.214 01:21:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:45.214 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:45.214 01:21:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:45.214 01:21:53 -- common/autotest_common.sh@10 -- # set +x 00:20:45.214 [2024-11-20 01:21:53.391728] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:45.214 [2024-11-20 01:21:53.391817] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:45.214 EAL: No free 2048 kB hugepages reported on node 1 00:20:45.472 [2024-11-20 01:21:53.458862] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:45.473 [2024-11-20 01:21:53.545820] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:45.473 [2024-11-20 01:21:53.545988] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:45.473 [2024-11-20 01:21:53.546014] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:45.473 [2024-11-20 01:21:53.546032] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:45.473 [2024-11-20 01:21:53.546093] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:45.731 [2024-11-20 01:21:53.775042] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:45.731 [2024-11-20 01:21:53.807065] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:45.731 [2024-11-20 01:21:53.807405] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:46.296 01:21:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:46.296 01:21:54 -- common/autotest_common.sh@862 -- # return 0 00:20:46.296 01:21:54 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:46.296 01:21:54 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:46.296 01:21:54 -- common/autotest_common.sh@10 -- # set +x 00:20:46.296 01:21:54 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:46.296 01:21:54 -- target/tls.sh@216 -- # bdevperf_pid=1172392 00:20:46.296 01:21:54 -- target/tls.sh@217 -- # waitforlisten 1172392 /var/tmp/bdevperf.sock 00:20:46.296 01:21:54 -- common/autotest_common.sh@829 -- # '[' -z 1172392 ']' 00:20:46.296 01:21:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:46.296 01:21:54 -- target/tls.sh@213 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 -c /dev/fd/63 00:20:46.296 01:21:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:46.296 01:21:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:46.296 01:21:54 -- target/tls.sh@213 -- # echo '{ 00:20:46.296 "subsystems": [ 00:20:46.296 { 00:20:46.296 "subsystem": "iobuf", 00:20:46.296 "config": [ 00:20:46.296 { 00:20:46.296 "method": "iobuf_set_options", 00:20:46.296 "params": { 00:20:46.296 "small_pool_count": 8192, 00:20:46.296 "large_pool_count": 1024, 00:20:46.296 "small_bufsize": 8192, 00:20:46.296 "large_bufsize": 135168 00:20:46.296 } 00:20:46.296 } 00:20:46.296 ] 00:20:46.296 }, 00:20:46.296 { 00:20:46.296 "subsystem": "sock", 00:20:46.296 "config": [ 00:20:46.296 { 00:20:46.296 "method": "sock_impl_set_options", 00:20:46.296 "params": { 00:20:46.296 "impl_name": "posix", 00:20:46.296 "recv_buf_size": 2097152, 00:20:46.296 "send_buf_size": 2097152, 00:20:46.296 "enable_recv_pipe": true, 00:20:46.296 "enable_quickack": false, 00:20:46.296 "enable_placement_id": 0, 00:20:46.296 "enable_zerocopy_send_server": true, 00:20:46.296 "enable_zerocopy_send_client": false, 00:20:46.296 "zerocopy_threshold": 0, 00:20:46.296 "tls_version": 0, 00:20:46.296 "enable_ktls": false 00:20:46.296 } 00:20:46.296 }, 00:20:46.296 { 00:20:46.296 "method": "sock_impl_set_options", 00:20:46.296 "params": { 00:20:46.296 "impl_name": "ssl", 00:20:46.296 "recv_buf_size": 4096, 00:20:46.296 "send_buf_size": 4096, 00:20:46.296 "enable_recv_pipe": true, 00:20:46.296 "enable_quickack": false, 00:20:46.296 "enable_placement_id": 0, 00:20:46.296 "enable_zerocopy_send_server": true, 00:20:46.296 "enable_zerocopy_send_client": false, 00:20:46.296 "zerocopy_threshold": 0, 00:20:46.296 "tls_version": 0, 00:20:46.296 "enable_ktls": false 00:20:46.296 } 00:20:46.296 } 00:20:46.296 ] 00:20:46.296 }, 00:20:46.296 { 00:20:46.297 "subsystem": "vmd", 00:20:46.297 "config": [] 00:20:46.297 }, 00:20:46.297 { 00:20:46.297 "subsystem": "accel", 00:20:46.297 "config": [ 00:20:46.297 { 00:20:46.297 "method": "accel_set_options", 00:20:46.297 "params": { 00:20:46.297 "small_cache_size": 128, 00:20:46.297 "large_cache_size": 16, 00:20:46.297 "task_count": 2048, 00:20:46.297 "sequence_count": 2048, 00:20:46.297 "buf_count": 2048 00:20:46.297 } 00:20:46.297 } 00:20:46.297 ] 00:20:46.297 }, 00:20:46.297 { 00:20:46.297 "subsystem": "bdev", 00:20:46.297 "config": [ 00:20:46.297 { 00:20:46.297 "method": "bdev_set_options", 00:20:46.297 "params": { 00:20:46.297 "bdev_io_pool_size": 65535, 00:20:46.297 "bdev_io_cache_size": 256, 00:20:46.297 "bdev_auto_examine": true, 00:20:46.297 "iobuf_small_cache_size": 128, 00:20:46.297 "iobuf_large_cache_size": 16 00:20:46.297 } 00:20:46.297 }, 00:20:46.297 { 00:20:46.297 "method": "bdev_raid_set_options", 00:20:46.297 "params": { 00:20:46.297 "process_window_size_kb": 1024 00:20:46.297 } 00:20:46.297 }, 00:20:46.297 { 00:20:46.297 "method": "bdev_iscsi_set_options", 00:20:46.297 "params": { 00:20:46.297 "timeout_sec": 30 00:20:46.297 } 00:20:46.297 }, 00:20:46.297 { 00:20:46.297 "method": "bdev_nvme_set_options", 00:20:46.297 "params": { 00:20:46.297 "action_on_timeout": "none", 00:20:46.297 "timeout_us": 0, 00:20:46.297 "timeout_admin_us": 0, 00:20:46.297 "keep_alive_timeout_ms": 10000, 00:20:46.297 "transport_retry_count": 4, 00:20:46.297 "arbitration_burst": 0, 00:20:46.297 "low_priority_weight": 0, 00:20:46.297 "medium_priority_weight": 0, 00:20:46.297 "high_priority_weight": 0, 00:20:46.297 "nvme_adminq_poll_period_us": 10000, 00:20:46.297 "nvme_ioq_poll_period_us": 0, 00:20:46.297 "io_queue_requests": 512, 00:20:46.297 "delay_cmd_submit": true, 00:20:46.297 "bdev_retry_count": 3, 00:20:46.297 "transport_ack_timeout": 0, 00:20:46.297 "ctrlr_loss_timeout_sec": 0, 00:20:46.297 "reconnect_delay_sec": 0, 00:20:46.297 "fast_io_fail_timeout_sec": 0, 00:20:46.297 "generate_uuids": false, 00:20:46.297 "transport_tos": 0, 00:20:46.297 "io_path_stat": false, 00:20:46.297 "allow_accel_sequence": false 00:20:46.297 } 00:20:46.297 }, 00:20:46.297 { 00:20:46.297 "method": "bdev_nvme_attach_controller", 00:20:46.297 "params": { 00:20:46.297 "name": "TLSTEST", 00:20:46.297 "trtype": "TCP", 00:20:46.297 "adrfam": "IPv4", 00:20:46.297 "traddr": "10.0.0.2", 00:20:46.297 "trsvcid": "4420", 00:20:46.297 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:46.297 "prchk_reftag": false, 00:20:46.297 "prchk_guard": false, 00:20:46.297 "ctrlr_loss_timeout_sec": 0, 00:20:46.297 "reconnect_delay_sec": 0, 00:20:46.297 "fast_io_fail_timeout_sec": 0, 00:20:46.297 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:20:46.297 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:46.297 "hdgst":Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:46.297 false, 00:20:46.297 "ddgst": false 00:20:46.297 } 00:20:46.297 }, 00:20:46.297 { 00:20:46.297 "method": "bdev_nvme_set_hotplug", 00:20:46.297 "params": { 00:20:46.297 "period_us": 100000, 00:20:46.297 "enable": false 00:20:46.297 } 00:20:46.297 }, 00:20:46.297 { 00:20:46.297 "method": "bdev_wait_for_examine" 00:20:46.297 } 00:20:46.297 ] 00:20:46.297 }, 00:20:46.297 { 00:20:46.297 "subsystem": "nbd", 00:20:46.297 "config": [] 00:20:46.297 } 00:20:46.297 ] 00:20:46.297 }' 00:20:46.297 01:21:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:46.297 01:21:54 -- common/autotest_common.sh@10 -- # set +x 00:20:46.297 [2024-11-20 01:21:54.422310] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:46.297 [2024-11-20 01:21:54.422409] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1172392 ] 00:20:46.297 EAL: No free 2048 kB hugepages reported on node 1 00:20:46.297 [2024-11-20 01:21:54.479675] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:46.555 [2024-11-20 01:21:54.564213] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:46.555 [2024-11-20 01:21:54.723626] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:47.488 01:21:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:47.488 01:21:55 -- common/autotest_common.sh@862 -- # return 0 00:20:47.488 01:21:55 -- target/tls.sh@220 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:20:47.488 Running I/O for 10 seconds... 00:20:57.451 00:20:57.451 Latency(us) 00:20:57.451 [2024-11-20T00:22:05.670Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:57.451 [2024-11-20T00:22:05.670Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:20:57.451 Verification LBA range: start 0x0 length 0x2000 00:20:57.451 TLSTESTn1 : 10.02 4510.76 17.62 0.00 0.00 28340.58 5582.70 48739.37 00:20:57.451 [2024-11-20T00:22:05.670Z] =================================================================================================================== 00:20:57.451 [2024-11-20T00:22:05.670Z] Total : 4510.76 17.62 0.00 0.00 28340.58 5582.70 48739.37 00:20:57.451 0 00:20:57.451 01:22:05 -- target/tls.sh@222 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:20:57.451 01:22:05 -- target/tls.sh@223 -- # killprocess 1172392 00:20:57.451 01:22:05 -- common/autotest_common.sh@936 -- # '[' -z 1172392 ']' 00:20:57.451 01:22:05 -- common/autotest_common.sh@940 -- # kill -0 1172392 00:20:57.451 01:22:05 -- common/autotest_common.sh@941 -- # uname 00:20:57.451 01:22:05 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:57.451 01:22:05 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1172392 00:20:57.451 01:22:05 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:57.451 01:22:05 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:57.451 01:22:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1172392' 00:20:57.451 killing process with pid 1172392 00:20:57.451 01:22:05 -- common/autotest_common.sh@955 -- # kill 1172392 00:20:57.451 Received shutdown signal, test time was about 10.000000 seconds 00:20:57.451 00:20:57.451 Latency(us) 00:20:57.451 [2024-11-20T00:22:05.670Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:57.451 [2024-11-20T00:22:05.670Z] =================================================================================================================== 00:20:57.451 [2024-11-20T00:22:05.670Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:57.451 01:22:05 -- common/autotest_common.sh@960 -- # wait 1172392 00:20:57.708 01:22:05 -- target/tls.sh@224 -- # killprocess 1172237 00:20:57.708 01:22:05 -- common/autotest_common.sh@936 -- # '[' -z 1172237 ']' 00:20:57.708 01:22:05 -- common/autotest_common.sh@940 -- # kill -0 1172237 00:20:57.708 01:22:05 -- common/autotest_common.sh@941 -- # uname 00:20:57.708 01:22:05 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:57.708 01:22:05 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1172237 00:20:57.708 01:22:05 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:57.708 01:22:05 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:57.708 01:22:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1172237' 00:20:57.708 killing process with pid 1172237 00:20:57.708 01:22:05 -- common/autotest_common.sh@955 -- # kill 1172237 00:20:57.708 01:22:05 -- common/autotest_common.sh@960 -- # wait 1172237 00:20:57.967 01:22:06 -- target/tls.sh@226 -- # trap - SIGINT SIGTERM EXIT 00:20:57.967 01:22:06 -- target/tls.sh@227 -- # cleanup 00:20:57.967 01:22:06 -- target/tls.sh@15 -- # process_shm --id 0 00:20:57.967 01:22:06 -- common/autotest_common.sh@806 -- # type=--id 00:20:57.967 01:22:06 -- common/autotest_common.sh@807 -- # id=0 00:20:57.967 01:22:06 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:20:57.967 01:22:06 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:20:57.967 01:22:06 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:20:57.967 01:22:06 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:20:57.967 01:22:06 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:20:57.967 01:22:06 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:20:57.967 nvmf_trace.0 00:20:57.967 01:22:06 -- common/autotest_common.sh@821 -- # return 0 00:20:57.967 01:22:06 -- target/tls.sh@16 -- # killprocess 1172392 00:20:57.967 01:22:06 -- common/autotest_common.sh@936 -- # '[' -z 1172392 ']' 00:20:57.967 01:22:06 -- common/autotest_common.sh@940 -- # kill -0 1172392 00:20:57.967 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1172392) - No such process 00:20:57.967 01:22:06 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1172392 is not found' 00:20:57.967 Process with pid 1172392 is not found 00:20:57.967 01:22:06 -- target/tls.sh@17 -- # nvmftestfini 00:20:57.967 01:22:06 -- nvmf/common.sh@476 -- # nvmfcleanup 00:20:57.967 01:22:06 -- nvmf/common.sh@116 -- # sync 00:20:58.226 01:22:06 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:20:58.226 01:22:06 -- nvmf/common.sh@119 -- # set +e 00:20:58.226 01:22:06 -- nvmf/common.sh@120 -- # for i in {1..20} 00:20:58.226 01:22:06 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:20:58.226 rmmod nvme_tcp 00:20:58.226 rmmod nvme_fabrics 00:20:58.226 rmmod nvme_keyring 00:20:58.226 01:22:06 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:20:58.226 01:22:06 -- nvmf/common.sh@123 -- # set -e 00:20:58.226 01:22:06 -- nvmf/common.sh@124 -- # return 0 00:20:58.226 01:22:06 -- nvmf/common.sh@477 -- # '[' -n 1172237 ']' 00:20:58.226 01:22:06 -- nvmf/common.sh@478 -- # killprocess 1172237 00:20:58.226 01:22:06 -- common/autotest_common.sh@936 -- # '[' -z 1172237 ']' 00:20:58.226 01:22:06 -- common/autotest_common.sh@940 -- # kill -0 1172237 00:20:58.226 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1172237) - No such process 00:20:58.226 01:22:06 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1172237 is not found' 00:20:58.226 Process with pid 1172237 is not found 00:20:58.226 01:22:06 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:20:58.226 01:22:06 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:20:58.226 01:22:06 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:20:58.226 01:22:06 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:20:58.226 01:22:06 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:20:58.226 01:22:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:58.226 01:22:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:58.226 01:22:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:00.130 01:22:08 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:00.131 01:22:08 -- target/tls.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:00.131 00:21:00.131 real 1m14.580s 00:21:00.131 user 1m57.427s 00:21:00.131 sys 0m23.775s 00:21:00.131 01:22:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:21:00.131 01:22:08 -- common/autotest_common.sh@10 -- # set +x 00:21:00.131 ************************************ 00:21:00.131 END TEST nvmf_tls 00:21:00.131 ************************************ 00:21:00.131 01:22:08 -- nvmf/nvmf.sh@60 -- # run_test nvmf_fips /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:21:00.131 01:22:08 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:00.131 01:22:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:00.131 01:22:08 -- common/autotest_common.sh@10 -- # set +x 00:21:00.131 ************************************ 00:21:00.131 START TEST nvmf_fips 00:21:00.131 ************************************ 00:21:00.131 01:22:08 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:21:00.389 * Looking for test storage... 00:21:00.389 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips 00:21:00.389 01:22:08 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:21:00.389 01:22:08 -- common/autotest_common.sh@1690 -- # lcov --version 00:21:00.389 01:22:08 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:21:00.389 01:22:08 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:21:00.389 01:22:08 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:21:00.389 01:22:08 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:00.389 01:22:08 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:00.389 01:22:08 -- scripts/common.sh@335 -- # IFS=.-: 00:21:00.389 01:22:08 -- scripts/common.sh@335 -- # read -ra ver1 00:21:00.389 01:22:08 -- scripts/common.sh@336 -- # IFS=.-: 00:21:00.389 01:22:08 -- scripts/common.sh@336 -- # read -ra ver2 00:21:00.389 01:22:08 -- scripts/common.sh@337 -- # local 'op=<' 00:21:00.389 01:22:08 -- scripts/common.sh@339 -- # ver1_l=2 00:21:00.389 01:22:08 -- scripts/common.sh@340 -- # ver2_l=1 00:21:00.389 01:22:08 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:00.389 01:22:08 -- scripts/common.sh@343 -- # case "$op" in 00:21:00.389 01:22:08 -- scripts/common.sh@344 -- # : 1 00:21:00.389 01:22:08 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:00.389 01:22:08 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:00.389 01:22:08 -- scripts/common.sh@364 -- # decimal 1 00:21:00.389 01:22:08 -- scripts/common.sh@352 -- # local d=1 00:21:00.389 01:22:08 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:00.389 01:22:08 -- scripts/common.sh@354 -- # echo 1 00:21:00.389 01:22:08 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:00.389 01:22:08 -- scripts/common.sh@365 -- # decimal 2 00:21:00.389 01:22:08 -- scripts/common.sh@352 -- # local d=2 00:21:00.389 01:22:08 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:00.389 01:22:08 -- scripts/common.sh@354 -- # echo 2 00:21:00.389 01:22:08 -- scripts/common.sh@365 -- # ver2[v]=2 00:21:00.389 01:22:08 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:00.389 01:22:08 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:00.389 01:22:08 -- scripts/common.sh@367 -- # return 0 00:21:00.389 01:22:08 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:00.389 01:22:08 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:21:00.389 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:00.389 --rc genhtml_branch_coverage=1 00:21:00.389 --rc genhtml_function_coverage=1 00:21:00.389 --rc genhtml_legend=1 00:21:00.389 --rc geninfo_all_blocks=1 00:21:00.389 --rc geninfo_unexecuted_blocks=1 00:21:00.389 00:21:00.389 ' 00:21:00.389 01:22:08 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:21:00.389 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:00.389 --rc genhtml_branch_coverage=1 00:21:00.389 --rc genhtml_function_coverage=1 00:21:00.389 --rc genhtml_legend=1 00:21:00.389 --rc geninfo_all_blocks=1 00:21:00.389 --rc geninfo_unexecuted_blocks=1 00:21:00.389 00:21:00.389 ' 00:21:00.389 01:22:08 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:21:00.389 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:00.389 --rc genhtml_branch_coverage=1 00:21:00.389 --rc genhtml_function_coverage=1 00:21:00.389 --rc genhtml_legend=1 00:21:00.389 --rc geninfo_all_blocks=1 00:21:00.389 --rc geninfo_unexecuted_blocks=1 00:21:00.389 00:21:00.390 ' 00:21:00.390 01:22:08 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:21:00.390 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:00.390 --rc genhtml_branch_coverage=1 00:21:00.390 --rc genhtml_function_coverage=1 00:21:00.390 --rc genhtml_legend=1 00:21:00.390 --rc geninfo_all_blocks=1 00:21:00.390 --rc geninfo_unexecuted_blocks=1 00:21:00.390 00:21:00.390 ' 00:21:00.390 01:22:08 -- fips/fips.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:00.390 01:22:08 -- nvmf/common.sh@7 -- # uname -s 00:21:00.390 01:22:08 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:00.390 01:22:08 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:00.390 01:22:08 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:00.390 01:22:08 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:00.390 01:22:08 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:00.390 01:22:08 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:00.390 01:22:08 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:00.390 01:22:08 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:00.390 01:22:08 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:00.390 01:22:08 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:00.390 01:22:08 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:00.390 01:22:08 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:00.390 01:22:08 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:00.390 01:22:08 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:00.390 01:22:08 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:00.390 01:22:08 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:00.390 01:22:08 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:00.390 01:22:08 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:00.390 01:22:08 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:00.390 01:22:08 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:00.390 01:22:08 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:00.390 01:22:08 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:00.390 01:22:08 -- paths/export.sh@5 -- # export PATH 00:21:00.390 01:22:08 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:00.390 01:22:08 -- nvmf/common.sh@46 -- # : 0 00:21:00.390 01:22:08 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:00.390 01:22:08 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:00.390 01:22:08 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:00.390 01:22:08 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:00.390 01:22:08 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:00.390 01:22:08 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:00.390 01:22:08 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:00.390 01:22:08 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:00.390 01:22:08 -- fips/fips.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:21:00.390 01:22:08 -- fips/fips.sh@89 -- # check_openssl_version 00:21:00.390 01:22:08 -- fips/fips.sh@83 -- # local target=3.0.0 00:21:00.390 01:22:08 -- fips/fips.sh@85 -- # openssl version 00:21:00.390 01:22:08 -- fips/fips.sh@85 -- # awk '{print $2}' 00:21:00.390 01:22:08 -- fips/fips.sh@85 -- # ge 3.1.1 3.0.0 00:21:00.390 01:22:08 -- scripts/common.sh@375 -- # cmp_versions 3.1.1 '>=' 3.0.0 00:21:00.390 01:22:08 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:00.390 01:22:08 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:00.390 01:22:08 -- scripts/common.sh@335 -- # IFS=.-: 00:21:00.390 01:22:08 -- scripts/common.sh@335 -- # read -ra ver1 00:21:00.390 01:22:08 -- scripts/common.sh@336 -- # IFS=.-: 00:21:00.390 01:22:08 -- scripts/common.sh@336 -- # read -ra ver2 00:21:00.390 01:22:08 -- scripts/common.sh@337 -- # local 'op=>=' 00:21:00.390 01:22:08 -- scripts/common.sh@339 -- # ver1_l=3 00:21:00.390 01:22:08 -- scripts/common.sh@340 -- # ver2_l=3 00:21:00.390 01:22:08 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:00.390 01:22:08 -- scripts/common.sh@343 -- # case "$op" in 00:21:00.390 01:22:08 -- scripts/common.sh@347 -- # : 1 00:21:00.390 01:22:08 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:00.390 01:22:08 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:00.390 01:22:08 -- scripts/common.sh@364 -- # decimal 3 00:21:00.390 01:22:08 -- scripts/common.sh@352 -- # local d=3 00:21:00.390 01:22:08 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:21:00.390 01:22:08 -- scripts/common.sh@354 -- # echo 3 00:21:00.390 01:22:08 -- scripts/common.sh@364 -- # ver1[v]=3 00:21:00.390 01:22:08 -- scripts/common.sh@365 -- # decimal 3 00:21:00.390 01:22:08 -- scripts/common.sh@352 -- # local d=3 00:21:00.390 01:22:08 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:21:00.390 01:22:08 -- scripts/common.sh@354 -- # echo 3 00:21:00.390 01:22:08 -- scripts/common.sh@365 -- # ver2[v]=3 00:21:00.390 01:22:08 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:00.390 01:22:08 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:00.390 01:22:08 -- scripts/common.sh@363 -- # (( v++ )) 00:21:00.390 01:22:08 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:00.390 01:22:08 -- scripts/common.sh@364 -- # decimal 1 00:21:00.390 01:22:08 -- scripts/common.sh@352 -- # local d=1 00:21:00.390 01:22:08 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:00.390 01:22:08 -- scripts/common.sh@354 -- # echo 1 00:21:00.390 01:22:08 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:00.390 01:22:08 -- scripts/common.sh@365 -- # decimal 0 00:21:00.390 01:22:08 -- scripts/common.sh@352 -- # local d=0 00:21:00.390 01:22:08 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:21:00.390 01:22:08 -- scripts/common.sh@354 -- # echo 0 00:21:00.390 01:22:08 -- scripts/common.sh@365 -- # ver2[v]=0 00:21:00.390 01:22:08 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:00.390 01:22:08 -- scripts/common.sh@366 -- # return 0 00:21:00.390 01:22:08 -- fips/fips.sh@95 -- # openssl info -modulesdir 00:21:00.390 01:22:08 -- fips/fips.sh@95 -- # [[ ! -f /usr/lib64/ossl-modules/fips.so ]] 00:21:00.390 01:22:08 -- fips/fips.sh@100 -- # openssl fipsinstall -help 00:21:00.390 01:22:08 -- fips/fips.sh@100 -- # warn='This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode' 00:21:00.390 01:22:08 -- fips/fips.sh@101 -- # [[ This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode == \T\h\i\s\ \c\o\m\m\a\n\d\ \i\s\ \n\o\t\ \e\n\a\b\l\e\d* ]] 00:21:00.390 01:22:08 -- fips/fips.sh@104 -- # export callback=build_openssl_config 00:21:00.390 01:22:08 -- fips/fips.sh@104 -- # callback=build_openssl_config 00:21:00.390 01:22:08 -- fips/fips.sh@113 -- # build_openssl_config 00:21:00.390 01:22:08 -- fips/fips.sh@37 -- # cat 00:21:00.390 01:22:08 -- fips/fips.sh@57 -- # [[ ! -t 0 ]] 00:21:00.390 01:22:08 -- fips/fips.sh@58 -- # cat - 00:21:00.391 01:22:08 -- fips/fips.sh@114 -- # export OPENSSL_CONF=spdk_fips.conf 00:21:00.391 01:22:08 -- fips/fips.sh@114 -- # OPENSSL_CONF=spdk_fips.conf 00:21:00.391 01:22:08 -- fips/fips.sh@116 -- # mapfile -t providers 00:21:00.391 01:22:08 -- fips/fips.sh@116 -- # openssl list -providers 00:21:00.391 01:22:08 -- fips/fips.sh@116 -- # grep name 00:21:00.391 01:22:08 -- fips/fips.sh@120 -- # (( 2 != 2 )) 00:21:00.391 01:22:08 -- fips/fips.sh@120 -- # [[ name: openssl base provider != *base* ]] 00:21:00.391 01:22:08 -- fips/fips.sh@120 -- # [[ name: red hat enterprise linux 9 - openssl fips provider != *fips* ]] 00:21:00.391 01:22:08 -- fips/fips.sh@127 -- # NOT openssl md5 /dev/fd/62 00:21:00.391 01:22:08 -- fips/fips.sh@127 -- # : 00:21:00.391 01:22:08 -- common/autotest_common.sh@650 -- # local es=0 00:21:00.391 01:22:08 -- common/autotest_common.sh@652 -- # valid_exec_arg openssl md5 /dev/fd/62 00:21:00.391 01:22:08 -- common/autotest_common.sh@638 -- # local arg=openssl 00:21:00.391 01:22:08 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:00.391 01:22:08 -- common/autotest_common.sh@642 -- # type -t openssl 00:21:00.391 01:22:08 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:00.391 01:22:08 -- common/autotest_common.sh@644 -- # type -P openssl 00:21:00.391 01:22:08 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:00.391 01:22:08 -- common/autotest_common.sh@644 -- # arg=/usr/bin/openssl 00:21:00.391 01:22:08 -- common/autotest_common.sh@644 -- # [[ -x /usr/bin/openssl ]] 00:21:00.391 01:22:08 -- common/autotest_common.sh@653 -- # openssl md5 /dev/fd/62 00:21:00.649 Error setting digest 00:21:00.649 4072436A447F0000:error:0308010C:digital envelope routines:inner_evp_generic_fetch:unsupported:crypto/evp/evp_fetch.c:341:Global default library context, Algorithm (MD5 : 95), Properties () 00:21:00.649 4072436A447F0000:error:03000086:digital envelope routines:evp_md_init_internal:initialization error:crypto/evp/digest.c:272: 00:21:00.649 01:22:08 -- common/autotest_common.sh@653 -- # es=1 00:21:00.649 01:22:08 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:21:00.649 01:22:08 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:21:00.649 01:22:08 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:21:00.649 01:22:08 -- fips/fips.sh@130 -- # nvmftestinit 00:21:00.649 01:22:08 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:00.649 01:22:08 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:00.649 01:22:08 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:00.649 01:22:08 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:00.649 01:22:08 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:00.649 01:22:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:00.649 01:22:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:00.649 01:22:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:00.649 01:22:08 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:00.649 01:22:08 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:00.649 01:22:08 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:00.649 01:22:08 -- common/autotest_common.sh@10 -- # set +x 00:21:02.549 01:22:10 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:02.549 01:22:10 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:02.549 01:22:10 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:02.549 01:22:10 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:02.549 01:22:10 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:02.549 01:22:10 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:02.549 01:22:10 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:02.549 01:22:10 -- nvmf/common.sh@294 -- # net_devs=() 00:21:02.549 01:22:10 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:02.549 01:22:10 -- nvmf/common.sh@295 -- # e810=() 00:21:02.549 01:22:10 -- nvmf/common.sh@295 -- # local -ga e810 00:21:02.549 01:22:10 -- nvmf/common.sh@296 -- # x722=() 00:21:02.549 01:22:10 -- nvmf/common.sh@296 -- # local -ga x722 00:21:02.549 01:22:10 -- nvmf/common.sh@297 -- # mlx=() 00:21:02.549 01:22:10 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:02.549 01:22:10 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:02.549 01:22:10 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:02.549 01:22:10 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:02.549 01:22:10 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:02.549 01:22:10 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:02.549 01:22:10 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:02.549 01:22:10 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:02.549 01:22:10 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:02.549 01:22:10 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:02.549 01:22:10 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:02.549 01:22:10 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:02.549 01:22:10 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:02.549 01:22:10 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:02.549 01:22:10 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:02.549 01:22:10 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:02.549 01:22:10 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:02.549 01:22:10 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:02.549 01:22:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:02.549 01:22:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:02.549 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:02.549 01:22:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:02.549 01:22:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:02.549 01:22:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:02.549 01:22:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:02.549 01:22:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:02.549 01:22:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:02.549 01:22:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:02.549 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:02.549 01:22:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:02.549 01:22:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:02.549 01:22:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:02.549 01:22:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:02.549 01:22:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:02.549 01:22:10 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:02.549 01:22:10 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:02.549 01:22:10 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:02.549 01:22:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:02.549 01:22:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:02.549 01:22:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:02.549 01:22:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:02.549 01:22:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:02.549 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:02.549 01:22:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:02.549 01:22:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:02.549 01:22:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:02.549 01:22:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:02.549 01:22:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:02.549 01:22:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:02.549 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:02.549 01:22:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:02.549 01:22:10 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:02.549 01:22:10 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:02.549 01:22:10 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:02.549 01:22:10 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:02.549 01:22:10 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:02.549 01:22:10 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:02.549 01:22:10 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:02.549 01:22:10 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:02.549 01:22:10 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:02.549 01:22:10 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:02.549 01:22:10 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:02.549 01:22:10 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:02.549 01:22:10 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:02.549 01:22:10 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:02.549 01:22:10 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:02.549 01:22:10 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:02.549 01:22:10 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:02.549 01:22:10 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:02.549 01:22:10 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:02.549 01:22:10 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:02.549 01:22:10 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:02.550 01:22:10 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:02.550 01:22:10 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:02.550 01:22:10 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:02.550 01:22:10 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:02.550 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:02.550 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.281 ms 00:21:02.550 00:21:02.550 --- 10.0.0.2 ping statistics --- 00:21:02.550 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:02.550 rtt min/avg/max/mdev = 0.281/0.281/0.281/0.000 ms 00:21:02.550 01:22:10 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:02.550 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:02.550 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.128 ms 00:21:02.550 00:21:02.550 --- 10.0.0.1 ping statistics --- 00:21:02.550 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:02.550 rtt min/avg/max/mdev = 0.128/0.128/0.128/0.000 ms 00:21:02.550 01:22:10 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:02.550 01:22:10 -- nvmf/common.sh@410 -- # return 0 00:21:02.550 01:22:10 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:02.550 01:22:10 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:02.550 01:22:10 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:02.550 01:22:10 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:02.550 01:22:10 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:02.550 01:22:10 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:02.550 01:22:10 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:02.550 01:22:10 -- fips/fips.sh@131 -- # nvmfappstart -m 0x2 00:21:02.550 01:22:10 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:02.550 01:22:10 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:02.550 01:22:10 -- common/autotest_common.sh@10 -- # set +x 00:21:02.550 01:22:10 -- nvmf/common.sh@469 -- # nvmfpid=1175725 00:21:02.550 01:22:10 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:21:02.550 01:22:10 -- nvmf/common.sh@470 -- # waitforlisten 1175725 00:21:02.550 01:22:10 -- common/autotest_common.sh@829 -- # '[' -z 1175725 ']' 00:21:02.550 01:22:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:02.550 01:22:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:02.550 01:22:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:02.550 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:02.550 01:22:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:02.550 01:22:10 -- common/autotest_common.sh@10 -- # set +x 00:21:02.808 [2024-11-20 01:22:10.817953] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:21:02.808 [2024-11-20 01:22:10.818040] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:02.808 EAL: No free 2048 kB hugepages reported on node 1 00:21:02.808 [2024-11-20 01:22:10.881003] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:02.808 [2024-11-20 01:22:10.965540] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:02.808 [2024-11-20 01:22:10.965694] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:02.808 [2024-11-20 01:22:10.965722] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:02.808 [2024-11-20 01:22:10.965750] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:02.808 [2024-11-20 01:22:10.965787] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:03.739 01:22:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:03.739 01:22:11 -- common/autotest_common.sh@862 -- # return 0 00:21:03.739 01:22:11 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:03.739 01:22:11 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:03.739 01:22:11 -- common/autotest_common.sh@10 -- # set +x 00:21:03.739 01:22:11 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:03.739 01:22:11 -- fips/fips.sh@133 -- # trap cleanup EXIT 00:21:03.739 01:22:11 -- fips/fips.sh@136 -- # key=NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:21:03.739 01:22:11 -- fips/fips.sh@137 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:03.739 01:22:11 -- fips/fips.sh@138 -- # echo -n NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:21:03.739 01:22:11 -- fips/fips.sh@139 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:03.739 01:22:11 -- fips/fips.sh@141 -- # setup_nvmf_tgt_conf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:03.739 01:22:11 -- fips/fips.sh@22 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:03.739 01:22:11 -- fips/fips.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:21:03.995 [2024-11-20 01:22:12.096275] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:03.995 [2024-11-20 01:22:12.112275] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:21:03.995 [2024-11-20 01:22:12.112584] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:03.995 malloc0 00:21:03.995 01:22:12 -- fips/fips.sh@144 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:21:03.995 01:22:12 -- fips/fips.sh@147 -- # bdevperf_pid=1175963 00:21:03.995 01:22:12 -- fips/fips.sh@145 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:21:03.995 01:22:12 -- fips/fips.sh@148 -- # waitforlisten 1175963 /var/tmp/bdevperf.sock 00:21:03.995 01:22:12 -- common/autotest_common.sh@829 -- # '[' -z 1175963 ']' 00:21:03.995 01:22:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:03.995 01:22:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:03.995 01:22:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:03.995 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:03.995 01:22:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:03.995 01:22:12 -- common/autotest_common.sh@10 -- # set +x 00:21:04.251 [2024-11-20 01:22:12.231618] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:21:04.251 [2024-11-20 01:22:12.231691] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1175963 ] 00:21:04.251 EAL: No free 2048 kB hugepages reported on node 1 00:21:04.251 [2024-11-20 01:22:12.289152] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:04.251 [2024-11-20 01:22:12.377208] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:05.247 01:22:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:05.247 01:22:13 -- common/autotest_common.sh@862 -- # return 0 00:21:05.247 01:22:13 -- fips/fips.sh@150 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:05.504 [2024-11-20 01:22:13.510245] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:05.504 TLSTESTn1 00:21:05.504 01:22:13 -- fips/fips.sh@154 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:21:05.504 Running I/O for 10 seconds... 00:21:17.699 00:21:17.699 Latency(us) 00:21:17.699 [2024-11-20T00:22:25.918Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:17.699 [2024-11-20T00:22:25.918Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:21:17.699 Verification LBA range: start 0x0 length 0x2000 00:21:17.699 TLSTESTn1 : 10.02 4559.23 17.81 0.00 0.00 28031.07 7136.14 47185.92 00:21:17.699 [2024-11-20T00:22:25.918Z] =================================================================================================================== 00:21:17.699 [2024-11-20T00:22:25.918Z] Total : 4559.23 17.81 0.00 0.00 28031.07 7136.14 47185.92 00:21:17.699 0 00:21:17.699 01:22:23 -- fips/fips.sh@1 -- # cleanup 00:21:17.699 01:22:23 -- fips/fips.sh@15 -- # process_shm --id 0 00:21:17.699 01:22:23 -- common/autotest_common.sh@806 -- # type=--id 00:21:17.699 01:22:23 -- common/autotest_common.sh@807 -- # id=0 00:21:17.699 01:22:23 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:21:17.699 01:22:23 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:21:17.699 01:22:23 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:21:17.699 01:22:23 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:21:17.699 01:22:23 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:21:17.699 01:22:23 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:21:17.699 nvmf_trace.0 00:21:17.699 01:22:23 -- common/autotest_common.sh@821 -- # return 0 00:21:17.699 01:22:23 -- fips/fips.sh@16 -- # killprocess 1175963 00:21:17.699 01:22:23 -- common/autotest_common.sh@936 -- # '[' -z 1175963 ']' 00:21:17.699 01:22:23 -- common/autotest_common.sh@940 -- # kill -0 1175963 00:21:17.699 01:22:23 -- common/autotest_common.sh@941 -- # uname 00:21:17.699 01:22:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:17.699 01:22:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1175963 00:21:17.699 01:22:23 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:21:17.699 01:22:23 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:21:17.699 01:22:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1175963' 00:21:17.699 killing process with pid 1175963 00:21:17.699 01:22:23 -- common/autotest_common.sh@955 -- # kill 1175963 00:21:17.699 Received shutdown signal, test time was about 10.000000 seconds 00:21:17.699 00:21:17.699 Latency(us) 00:21:17.699 [2024-11-20T00:22:25.918Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:17.699 [2024-11-20T00:22:25.918Z] =================================================================================================================== 00:21:17.699 [2024-11-20T00:22:25.918Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:21:17.699 01:22:23 -- common/autotest_common.sh@960 -- # wait 1175963 00:21:17.699 01:22:24 -- fips/fips.sh@17 -- # nvmftestfini 00:21:17.699 01:22:24 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:17.699 01:22:24 -- nvmf/common.sh@116 -- # sync 00:21:17.699 01:22:24 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:17.699 01:22:24 -- nvmf/common.sh@119 -- # set +e 00:21:17.699 01:22:24 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:17.699 01:22:24 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:17.699 rmmod nvme_tcp 00:21:17.699 rmmod nvme_fabrics 00:21:17.699 rmmod nvme_keyring 00:21:17.699 01:22:24 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:17.699 01:22:24 -- nvmf/common.sh@123 -- # set -e 00:21:17.699 01:22:24 -- nvmf/common.sh@124 -- # return 0 00:21:17.699 01:22:24 -- nvmf/common.sh@477 -- # '[' -n 1175725 ']' 00:21:17.699 01:22:24 -- nvmf/common.sh@478 -- # killprocess 1175725 00:21:17.699 01:22:24 -- common/autotest_common.sh@936 -- # '[' -z 1175725 ']' 00:21:17.699 01:22:24 -- common/autotest_common.sh@940 -- # kill -0 1175725 00:21:17.699 01:22:24 -- common/autotest_common.sh@941 -- # uname 00:21:17.699 01:22:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:17.699 01:22:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1175725 00:21:17.699 01:22:24 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:21:17.699 01:22:24 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:21:17.699 01:22:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1175725' 00:21:17.699 killing process with pid 1175725 00:21:17.699 01:22:24 -- common/autotest_common.sh@955 -- # kill 1175725 00:21:17.699 01:22:24 -- common/autotest_common.sh@960 -- # wait 1175725 00:21:17.699 01:22:24 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:17.699 01:22:24 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:17.699 01:22:24 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:17.699 01:22:24 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:17.699 01:22:24 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:17.699 01:22:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:17.699 01:22:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:17.699 01:22:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:18.268 01:22:26 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:18.268 01:22:26 -- fips/fips.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:18.268 00:21:18.268 real 0m18.120s 00:21:18.268 user 0m23.988s 00:21:18.268 sys 0m5.685s 00:21:18.268 01:22:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:21:18.268 01:22:26 -- common/autotest_common.sh@10 -- # set +x 00:21:18.268 ************************************ 00:21:18.268 END TEST nvmf_fips 00:21:18.268 ************************************ 00:21:18.268 01:22:26 -- nvmf/nvmf.sh@63 -- # '[' 1 -eq 1 ']' 00:21:18.268 01:22:26 -- nvmf/nvmf.sh@64 -- # run_test nvmf_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:21:18.268 01:22:26 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:18.268 01:22:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:18.268 01:22:26 -- common/autotest_common.sh@10 -- # set +x 00:21:18.268 ************************************ 00:21:18.268 START TEST nvmf_fuzz 00:21:18.268 ************************************ 00:21:18.268 01:22:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:21:18.526 * Looking for test storage... 00:21:18.526 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:18.526 01:22:26 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:21:18.526 01:22:26 -- common/autotest_common.sh@1690 -- # lcov --version 00:21:18.527 01:22:26 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:21:18.527 01:22:26 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:21:18.527 01:22:26 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:21:18.527 01:22:26 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:18.527 01:22:26 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:18.527 01:22:26 -- scripts/common.sh@335 -- # IFS=.-: 00:21:18.527 01:22:26 -- scripts/common.sh@335 -- # read -ra ver1 00:21:18.527 01:22:26 -- scripts/common.sh@336 -- # IFS=.-: 00:21:18.527 01:22:26 -- scripts/common.sh@336 -- # read -ra ver2 00:21:18.527 01:22:26 -- scripts/common.sh@337 -- # local 'op=<' 00:21:18.527 01:22:26 -- scripts/common.sh@339 -- # ver1_l=2 00:21:18.527 01:22:26 -- scripts/common.sh@340 -- # ver2_l=1 00:21:18.527 01:22:26 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:18.527 01:22:26 -- scripts/common.sh@343 -- # case "$op" in 00:21:18.527 01:22:26 -- scripts/common.sh@344 -- # : 1 00:21:18.527 01:22:26 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:18.527 01:22:26 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:18.527 01:22:26 -- scripts/common.sh@364 -- # decimal 1 00:21:18.527 01:22:26 -- scripts/common.sh@352 -- # local d=1 00:21:18.527 01:22:26 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:18.527 01:22:26 -- scripts/common.sh@354 -- # echo 1 00:21:18.527 01:22:26 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:18.527 01:22:26 -- scripts/common.sh@365 -- # decimal 2 00:21:18.527 01:22:26 -- scripts/common.sh@352 -- # local d=2 00:21:18.527 01:22:26 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:18.527 01:22:26 -- scripts/common.sh@354 -- # echo 2 00:21:18.527 01:22:26 -- scripts/common.sh@365 -- # ver2[v]=2 00:21:18.527 01:22:26 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:18.527 01:22:26 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:18.527 01:22:26 -- scripts/common.sh@367 -- # return 0 00:21:18.527 01:22:26 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:18.527 01:22:26 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:21:18.527 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:18.527 --rc genhtml_branch_coverage=1 00:21:18.527 --rc genhtml_function_coverage=1 00:21:18.527 --rc genhtml_legend=1 00:21:18.527 --rc geninfo_all_blocks=1 00:21:18.527 --rc geninfo_unexecuted_blocks=1 00:21:18.527 00:21:18.527 ' 00:21:18.527 01:22:26 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:21:18.527 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:18.527 --rc genhtml_branch_coverage=1 00:21:18.527 --rc genhtml_function_coverage=1 00:21:18.527 --rc genhtml_legend=1 00:21:18.527 --rc geninfo_all_blocks=1 00:21:18.527 --rc geninfo_unexecuted_blocks=1 00:21:18.527 00:21:18.527 ' 00:21:18.527 01:22:26 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:21:18.527 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:18.527 --rc genhtml_branch_coverage=1 00:21:18.527 --rc genhtml_function_coverage=1 00:21:18.527 --rc genhtml_legend=1 00:21:18.527 --rc geninfo_all_blocks=1 00:21:18.527 --rc geninfo_unexecuted_blocks=1 00:21:18.527 00:21:18.527 ' 00:21:18.527 01:22:26 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:21:18.527 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:18.527 --rc genhtml_branch_coverage=1 00:21:18.527 --rc genhtml_function_coverage=1 00:21:18.527 --rc genhtml_legend=1 00:21:18.527 --rc geninfo_all_blocks=1 00:21:18.527 --rc geninfo_unexecuted_blocks=1 00:21:18.527 00:21:18.527 ' 00:21:18.527 01:22:26 -- target/fabrics_fuzz.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:18.527 01:22:26 -- nvmf/common.sh@7 -- # uname -s 00:21:18.527 01:22:26 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:18.527 01:22:26 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:18.527 01:22:26 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:18.527 01:22:26 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:18.527 01:22:26 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:18.527 01:22:26 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:18.527 01:22:26 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:18.527 01:22:26 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:18.527 01:22:26 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:18.527 01:22:26 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:18.527 01:22:26 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:18.527 01:22:26 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:18.527 01:22:26 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:18.527 01:22:26 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:18.527 01:22:26 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:18.527 01:22:26 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:18.527 01:22:26 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:18.527 01:22:26 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:18.527 01:22:26 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:18.527 01:22:26 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:18.527 01:22:26 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:18.527 01:22:26 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:18.527 01:22:26 -- paths/export.sh@5 -- # export PATH 00:21:18.527 01:22:26 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:18.527 01:22:26 -- nvmf/common.sh@46 -- # : 0 00:21:18.527 01:22:26 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:18.527 01:22:26 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:18.527 01:22:26 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:18.527 01:22:26 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:18.527 01:22:26 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:18.527 01:22:26 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:18.527 01:22:26 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:18.527 01:22:26 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:18.527 01:22:26 -- target/fabrics_fuzz.sh@11 -- # nvmftestinit 00:21:18.527 01:22:26 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:18.527 01:22:26 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:18.527 01:22:26 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:18.527 01:22:26 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:18.527 01:22:26 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:18.527 01:22:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:18.527 01:22:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:18.527 01:22:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:18.527 01:22:26 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:18.527 01:22:26 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:18.527 01:22:26 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:18.527 01:22:26 -- common/autotest_common.sh@10 -- # set +x 00:21:20.430 01:22:28 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:20.430 01:22:28 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:20.430 01:22:28 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:20.430 01:22:28 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:20.430 01:22:28 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:20.430 01:22:28 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:20.430 01:22:28 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:20.430 01:22:28 -- nvmf/common.sh@294 -- # net_devs=() 00:21:20.430 01:22:28 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:20.430 01:22:28 -- nvmf/common.sh@295 -- # e810=() 00:21:20.430 01:22:28 -- nvmf/common.sh@295 -- # local -ga e810 00:21:20.430 01:22:28 -- nvmf/common.sh@296 -- # x722=() 00:21:20.430 01:22:28 -- nvmf/common.sh@296 -- # local -ga x722 00:21:20.430 01:22:28 -- nvmf/common.sh@297 -- # mlx=() 00:21:20.430 01:22:28 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:20.430 01:22:28 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:20.430 01:22:28 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:20.430 01:22:28 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:20.430 01:22:28 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:20.430 01:22:28 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:20.430 01:22:28 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:20.430 01:22:28 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:20.430 01:22:28 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:20.430 01:22:28 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:20.430 01:22:28 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:20.430 01:22:28 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:20.430 01:22:28 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:20.430 01:22:28 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:20.430 01:22:28 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:20.430 01:22:28 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:20.430 01:22:28 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:20.430 01:22:28 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:20.430 01:22:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:20.430 01:22:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:20.430 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:20.430 01:22:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:20.430 01:22:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:20.430 01:22:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:20.430 01:22:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:20.430 01:22:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:20.430 01:22:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:20.430 01:22:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:20.430 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:20.430 01:22:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:20.430 01:22:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:20.430 01:22:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:20.430 01:22:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:20.430 01:22:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:20.430 01:22:28 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:20.430 01:22:28 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:20.430 01:22:28 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:20.430 01:22:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:20.430 01:22:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:20.430 01:22:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:20.430 01:22:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:20.430 01:22:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:20.430 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:20.430 01:22:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:20.430 01:22:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:20.430 01:22:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:20.430 01:22:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:20.430 01:22:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:20.430 01:22:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:20.430 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:20.430 01:22:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:20.430 01:22:28 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:20.430 01:22:28 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:20.430 01:22:28 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:20.430 01:22:28 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:20.430 01:22:28 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:20.430 01:22:28 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:20.430 01:22:28 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:20.430 01:22:28 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:20.430 01:22:28 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:20.430 01:22:28 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:20.430 01:22:28 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:20.430 01:22:28 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:20.430 01:22:28 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:20.430 01:22:28 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:20.430 01:22:28 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:20.430 01:22:28 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:20.430 01:22:28 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:20.430 01:22:28 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:20.689 01:22:28 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:20.689 01:22:28 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:20.689 01:22:28 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:20.689 01:22:28 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:20.689 01:22:28 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:20.689 01:22:28 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:20.689 01:22:28 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:20.689 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:20.689 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.237 ms 00:21:20.689 00:21:20.689 --- 10.0.0.2 ping statistics --- 00:21:20.689 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:20.689 rtt min/avg/max/mdev = 0.237/0.237/0.237/0.000 ms 00:21:20.689 01:22:28 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:20.689 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:20.689 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.127 ms 00:21:20.689 00:21:20.689 --- 10.0.0.1 ping statistics --- 00:21:20.689 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:20.689 rtt min/avg/max/mdev = 0.127/0.127/0.127/0.000 ms 00:21:20.689 01:22:28 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:20.689 01:22:28 -- nvmf/common.sh@410 -- # return 0 00:21:20.689 01:22:28 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:20.689 01:22:28 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:20.689 01:22:28 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:20.689 01:22:28 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:20.689 01:22:28 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:20.689 01:22:28 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:20.689 01:22:28 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:20.689 01:22:28 -- target/fabrics_fuzz.sh@14 -- # nvmfpid=1179578 00:21:20.689 01:22:28 -- target/fabrics_fuzz.sh@13 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:21:20.689 01:22:28 -- target/fabrics_fuzz.sh@16 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:21:20.689 01:22:28 -- target/fabrics_fuzz.sh@18 -- # waitforlisten 1179578 00:21:20.689 01:22:28 -- common/autotest_common.sh@829 -- # '[' -z 1179578 ']' 00:21:20.689 01:22:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:20.689 01:22:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:20.689 01:22:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:20.689 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:20.689 01:22:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:20.689 01:22:28 -- common/autotest_common.sh@10 -- # set +x 00:21:21.622 01:22:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:21.622 01:22:29 -- common/autotest_common.sh@862 -- # return 0 00:21:21.622 01:22:29 -- target/fabrics_fuzz.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:21:21.622 01:22:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:21.622 01:22:29 -- common/autotest_common.sh@10 -- # set +x 00:21:21.622 01:22:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:21.622 01:22:29 -- target/fabrics_fuzz.sh@21 -- # rpc_cmd bdev_malloc_create -b Malloc0 64 512 00:21:21.622 01:22:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:21.622 01:22:29 -- common/autotest_common.sh@10 -- # set +x 00:21:21.622 Malloc0 00:21:21.622 01:22:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:21.622 01:22:29 -- target/fabrics_fuzz.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:21.622 01:22:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:21.622 01:22:29 -- common/autotest_common.sh@10 -- # set +x 00:21:21.622 01:22:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:21.622 01:22:29 -- target/fabrics_fuzz.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:21:21.622 01:22:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:21.622 01:22:29 -- common/autotest_common.sh@10 -- # set +x 00:21:21.880 01:22:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:21.880 01:22:29 -- target/fabrics_fuzz.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:21.880 01:22:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:21.880 01:22:29 -- common/autotest_common.sh@10 -- # set +x 00:21:21.880 01:22:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:21.880 01:22:29 -- target/fabrics_fuzz.sh@27 -- # trid='trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' 00:21:21.880 01:22:29 -- target/fabrics_fuzz.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -t 30 -S 123456 -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -N -a 00:21:53.942 Fuzzing completed. Shutting down the fuzz application 00:21:53.942 00:21:53.942 Dumping successful admin opcodes: 00:21:53.942 8, 9, 10, 24, 00:21:53.942 Dumping successful io opcodes: 00:21:53.942 0, 9, 00:21:53.942 NS: 0x200003aeff00 I/O qp, Total commands completed: 467970, total successful commands: 2700, random_seed: 767536832 00:21:53.942 NS: 0x200003aeff00 admin qp, Total commands completed: 57984, total successful commands: 462, random_seed: 1898419008 00:21:53.942 01:23:00 -- target/fabrics_fuzz.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -j /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/example.json -a 00:21:53.942 Fuzzing completed. Shutting down the fuzz application 00:21:53.942 00:21:53.942 Dumping successful admin opcodes: 00:21:53.942 24, 00:21:53.942 Dumping successful io opcodes: 00:21:53.942 00:21:53.942 NS: 0x200003aeff00 I/O qp, Total commands completed: 0, total successful commands: 0, random_seed: 242148803 00:21:53.942 NS: 0x200003aeff00 admin qp, Total commands completed: 16, total successful commands: 4, random_seed: 242285687 00:21:53.942 01:23:01 -- target/fabrics_fuzz.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:21:53.942 01:23:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:53.942 01:23:01 -- common/autotest_common.sh@10 -- # set +x 00:21:53.942 01:23:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:53.942 01:23:01 -- target/fabrics_fuzz.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:21:53.942 01:23:01 -- target/fabrics_fuzz.sh@38 -- # nvmftestfini 00:21:53.942 01:23:01 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:53.942 01:23:01 -- nvmf/common.sh@116 -- # sync 00:21:53.942 01:23:01 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:53.942 01:23:01 -- nvmf/common.sh@119 -- # set +e 00:21:53.942 01:23:01 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:53.942 01:23:01 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:53.942 rmmod nvme_tcp 00:21:53.942 rmmod nvme_fabrics 00:21:53.942 rmmod nvme_keyring 00:21:53.942 01:23:01 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:53.942 01:23:01 -- nvmf/common.sh@123 -- # set -e 00:21:53.942 01:23:01 -- nvmf/common.sh@124 -- # return 0 00:21:53.942 01:23:01 -- nvmf/common.sh@477 -- # '[' -n 1179578 ']' 00:21:53.942 01:23:01 -- nvmf/common.sh@478 -- # killprocess 1179578 00:21:53.942 01:23:01 -- common/autotest_common.sh@936 -- # '[' -z 1179578 ']' 00:21:53.942 01:23:01 -- common/autotest_common.sh@940 -- # kill -0 1179578 00:21:53.942 01:23:01 -- common/autotest_common.sh@941 -- # uname 00:21:53.942 01:23:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:53.942 01:23:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1179578 00:21:53.942 01:23:01 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:21:53.942 01:23:01 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:21:53.942 01:23:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1179578' 00:21:53.942 killing process with pid 1179578 00:21:53.942 01:23:01 -- common/autotest_common.sh@955 -- # kill 1179578 00:21:53.942 01:23:01 -- common/autotest_common.sh@960 -- # wait 1179578 00:21:53.942 01:23:01 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:53.942 01:23:01 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:53.942 01:23:01 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:53.942 01:23:01 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:53.942 01:23:01 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:53.942 01:23:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:53.942 01:23:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:53.942 01:23:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:55.846 01:23:04 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:55.846 01:23:04 -- target/fabrics_fuzz.sh@39 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs2.txt 00:21:55.846 00:21:55.846 real 0m37.590s 00:21:55.846 user 0m51.233s 00:21:55.846 sys 0m15.493s 00:21:55.846 01:23:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:21:55.846 01:23:04 -- common/autotest_common.sh@10 -- # set +x 00:21:55.846 ************************************ 00:21:55.846 END TEST nvmf_fuzz 00:21:55.846 ************************************ 00:21:55.846 01:23:04 -- nvmf/nvmf.sh@65 -- # run_test nvmf_multiconnection /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:21:55.846 01:23:04 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:55.846 01:23:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:55.846 01:23:04 -- common/autotest_common.sh@10 -- # set +x 00:21:56.105 ************************************ 00:21:56.105 START TEST nvmf_multiconnection 00:21:56.105 ************************************ 00:21:56.105 01:23:04 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:21:56.105 * Looking for test storage... 00:21:56.105 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:56.105 01:23:04 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:21:56.105 01:23:04 -- common/autotest_common.sh@1690 -- # lcov --version 00:21:56.105 01:23:04 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:21:56.105 01:23:04 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:21:56.105 01:23:04 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:21:56.105 01:23:04 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:56.105 01:23:04 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:56.105 01:23:04 -- scripts/common.sh@335 -- # IFS=.-: 00:21:56.105 01:23:04 -- scripts/common.sh@335 -- # read -ra ver1 00:21:56.105 01:23:04 -- scripts/common.sh@336 -- # IFS=.-: 00:21:56.105 01:23:04 -- scripts/common.sh@336 -- # read -ra ver2 00:21:56.105 01:23:04 -- scripts/common.sh@337 -- # local 'op=<' 00:21:56.105 01:23:04 -- scripts/common.sh@339 -- # ver1_l=2 00:21:56.105 01:23:04 -- scripts/common.sh@340 -- # ver2_l=1 00:21:56.105 01:23:04 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:56.105 01:23:04 -- scripts/common.sh@343 -- # case "$op" in 00:21:56.105 01:23:04 -- scripts/common.sh@344 -- # : 1 00:21:56.105 01:23:04 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:56.105 01:23:04 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:56.105 01:23:04 -- scripts/common.sh@364 -- # decimal 1 00:21:56.105 01:23:04 -- scripts/common.sh@352 -- # local d=1 00:21:56.105 01:23:04 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:56.105 01:23:04 -- scripts/common.sh@354 -- # echo 1 00:21:56.105 01:23:04 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:56.105 01:23:04 -- scripts/common.sh@365 -- # decimal 2 00:21:56.105 01:23:04 -- scripts/common.sh@352 -- # local d=2 00:21:56.105 01:23:04 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:56.105 01:23:04 -- scripts/common.sh@354 -- # echo 2 00:21:56.105 01:23:04 -- scripts/common.sh@365 -- # ver2[v]=2 00:21:56.105 01:23:04 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:56.105 01:23:04 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:56.105 01:23:04 -- scripts/common.sh@367 -- # return 0 00:21:56.105 01:23:04 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:56.105 01:23:04 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:21:56.105 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:56.105 --rc genhtml_branch_coverage=1 00:21:56.105 --rc genhtml_function_coverage=1 00:21:56.105 --rc genhtml_legend=1 00:21:56.105 --rc geninfo_all_blocks=1 00:21:56.105 --rc geninfo_unexecuted_blocks=1 00:21:56.105 00:21:56.105 ' 00:21:56.105 01:23:04 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:21:56.105 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:56.105 --rc genhtml_branch_coverage=1 00:21:56.105 --rc genhtml_function_coverage=1 00:21:56.105 --rc genhtml_legend=1 00:21:56.105 --rc geninfo_all_blocks=1 00:21:56.105 --rc geninfo_unexecuted_blocks=1 00:21:56.105 00:21:56.105 ' 00:21:56.105 01:23:04 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:21:56.105 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:56.105 --rc genhtml_branch_coverage=1 00:21:56.105 --rc genhtml_function_coverage=1 00:21:56.105 --rc genhtml_legend=1 00:21:56.105 --rc geninfo_all_blocks=1 00:21:56.105 --rc geninfo_unexecuted_blocks=1 00:21:56.105 00:21:56.105 ' 00:21:56.105 01:23:04 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:21:56.105 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:56.105 --rc genhtml_branch_coverage=1 00:21:56.105 --rc genhtml_function_coverage=1 00:21:56.105 --rc genhtml_legend=1 00:21:56.105 --rc geninfo_all_blocks=1 00:21:56.105 --rc geninfo_unexecuted_blocks=1 00:21:56.105 00:21:56.105 ' 00:21:56.105 01:23:04 -- target/multiconnection.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:56.105 01:23:04 -- nvmf/common.sh@7 -- # uname -s 00:21:56.105 01:23:04 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:56.105 01:23:04 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:56.105 01:23:04 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:56.105 01:23:04 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:56.105 01:23:04 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:56.105 01:23:04 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:56.105 01:23:04 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:56.105 01:23:04 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:56.105 01:23:04 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:56.105 01:23:04 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:56.106 01:23:04 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:56.106 01:23:04 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:56.106 01:23:04 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:56.106 01:23:04 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:56.106 01:23:04 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:56.106 01:23:04 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:56.106 01:23:04 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:56.106 01:23:04 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:56.106 01:23:04 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:56.106 01:23:04 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:56.106 01:23:04 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:56.106 01:23:04 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:56.106 01:23:04 -- paths/export.sh@5 -- # export PATH 00:21:56.106 01:23:04 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:56.106 01:23:04 -- nvmf/common.sh@46 -- # : 0 00:21:56.106 01:23:04 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:56.106 01:23:04 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:56.106 01:23:04 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:56.106 01:23:04 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:56.106 01:23:04 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:56.106 01:23:04 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:56.106 01:23:04 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:56.106 01:23:04 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:56.106 01:23:04 -- target/multiconnection.sh@11 -- # MALLOC_BDEV_SIZE=64 00:21:56.106 01:23:04 -- target/multiconnection.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:21:56.106 01:23:04 -- target/multiconnection.sh@14 -- # NVMF_SUBSYS=11 00:21:56.106 01:23:04 -- target/multiconnection.sh@16 -- # nvmftestinit 00:21:56.106 01:23:04 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:56.106 01:23:04 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:56.106 01:23:04 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:56.106 01:23:04 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:56.106 01:23:04 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:56.106 01:23:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:56.106 01:23:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:56.106 01:23:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:56.106 01:23:04 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:56.106 01:23:04 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:56.106 01:23:04 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:56.106 01:23:04 -- common/autotest_common.sh@10 -- # set +x 00:21:58.636 01:23:06 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:58.636 01:23:06 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:58.636 01:23:06 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:58.636 01:23:06 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:58.636 01:23:06 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:58.636 01:23:06 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:58.636 01:23:06 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:58.636 01:23:06 -- nvmf/common.sh@294 -- # net_devs=() 00:21:58.636 01:23:06 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:58.636 01:23:06 -- nvmf/common.sh@295 -- # e810=() 00:21:58.636 01:23:06 -- nvmf/common.sh@295 -- # local -ga e810 00:21:58.636 01:23:06 -- nvmf/common.sh@296 -- # x722=() 00:21:58.636 01:23:06 -- nvmf/common.sh@296 -- # local -ga x722 00:21:58.636 01:23:06 -- nvmf/common.sh@297 -- # mlx=() 00:21:58.636 01:23:06 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:58.636 01:23:06 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:58.636 01:23:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:58.636 01:23:06 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:58.636 01:23:06 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:58.636 01:23:06 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:58.636 01:23:06 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:58.636 01:23:06 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:58.636 01:23:06 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:58.636 01:23:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:58.636 01:23:06 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:58.636 01:23:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:58.636 01:23:06 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:58.636 01:23:06 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:58.636 01:23:06 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:58.636 01:23:06 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:58.636 01:23:06 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:58.636 01:23:06 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:58.636 01:23:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:58.636 01:23:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:58.636 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:58.636 01:23:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:58.636 01:23:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:58.636 01:23:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:58.636 01:23:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:58.636 01:23:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:58.636 01:23:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:58.636 01:23:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:58.636 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:58.636 01:23:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:58.636 01:23:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:58.636 01:23:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:58.636 01:23:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:58.636 01:23:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:58.636 01:23:06 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:58.636 01:23:06 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:58.636 01:23:06 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:58.636 01:23:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:58.636 01:23:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:58.636 01:23:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:58.636 01:23:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:58.636 01:23:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:58.636 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:58.636 01:23:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:58.636 01:23:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:58.636 01:23:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:58.636 01:23:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:58.636 01:23:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:58.636 01:23:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:58.636 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:58.636 01:23:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:58.636 01:23:06 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:58.636 01:23:06 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:58.636 01:23:06 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:58.636 01:23:06 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:58.636 01:23:06 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:58.636 01:23:06 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:58.636 01:23:06 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:58.636 01:23:06 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:58.636 01:23:06 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:58.636 01:23:06 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:58.636 01:23:06 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:58.636 01:23:06 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:58.636 01:23:06 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:58.636 01:23:06 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:58.636 01:23:06 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:58.636 01:23:06 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:58.636 01:23:06 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:58.636 01:23:06 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:58.636 01:23:06 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:58.636 01:23:06 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:58.636 01:23:06 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:58.636 01:23:06 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:58.636 01:23:06 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:58.636 01:23:06 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:58.636 01:23:06 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:58.636 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:58.636 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.231 ms 00:21:58.636 00:21:58.636 --- 10.0.0.2 ping statistics --- 00:21:58.636 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:58.636 rtt min/avg/max/mdev = 0.231/0.231/0.231/0.000 ms 00:21:58.636 01:23:06 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:58.636 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:58.636 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.107 ms 00:21:58.636 00:21:58.636 --- 10.0.0.1 ping statistics --- 00:21:58.636 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:58.636 rtt min/avg/max/mdev = 0.107/0.107/0.107/0.000 ms 00:21:58.636 01:23:06 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:58.636 01:23:06 -- nvmf/common.sh@410 -- # return 0 00:21:58.636 01:23:06 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:58.636 01:23:06 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:58.636 01:23:06 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:58.636 01:23:06 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:58.636 01:23:06 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:58.636 01:23:06 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:58.636 01:23:06 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:58.636 01:23:06 -- target/multiconnection.sh@17 -- # nvmfappstart -m 0xF 00:21:58.636 01:23:06 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:58.636 01:23:06 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:58.637 01:23:06 -- common/autotest_common.sh@10 -- # set +x 00:21:58.637 01:23:06 -- nvmf/common.sh@469 -- # nvmfpid=1185458 00:21:58.637 01:23:06 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:21:58.637 01:23:06 -- nvmf/common.sh@470 -- # waitforlisten 1185458 00:21:58.637 01:23:06 -- common/autotest_common.sh@829 -- # '[' -z 1185458 ']' 00:21:58.637 01:23:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:58.637 01:23:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:58.637 01:23:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:58.637 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:58.637 01:23:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:58.637 01:23:06 -- common/autotest_common.sh@10 -- # set +x 00:21:58.637 [2024-11-20 01:23:06.561842] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:21:58.637 [2024-11-20 01:23:06.561914] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:58.637 EAL: No free 2048 kB hugepages reported on node 1 00:21:58.637 [2024-11-20 01:23:06.633624] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:58.637 [2024-11-20 01:23:06.730982] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:58.637 [2024-11-20 01:23:06.731157] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:58.637 [2024-11-20 01:23:06.731179] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:58.637 [2024-11-20 01:23:06.731194] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:58.637 [2024-11-20 01:23:06.731260] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:58.637 [2024-11-20 01:23:06.731317] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:58.637 [2024-11-20 01:23:06.731343] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:58.637 [2024-11-20 01:23:06.731347] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:59.609 01:23:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:59.609 01:23:07 -- common/autotest_common.sh@862 -- # return 0 00:21:59.609 01:23:07 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:59.609 01:23:07 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:59.609 01:23:07 -- common/autotest_common.sh@10 -- # set +x 00:21:59.609 01:23:07 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:59.609 01:23:07 -- target/multiconnection.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:21:59.609 01:23:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:59.609 01:23:07 -- common/autotest_common.sh@10 -- # set +x 00:21:59.609 [2024-11-20 01:23:07.599854] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:59.609 01:23:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:59.609 01:23:07 -- target/multiconnection.sh@21 -- # seq 1 11 00:21:59.609 01:23:07 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:59.609 01:23:07 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:21:59.609 01:23:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:59.609 01:23:07 -- common/autotest_common.sh@10 -- # set +x 00:21:59.609 Malloc1 00:21:59.609 01:23:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:59.609 01:23:07 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK1 00:21:59.609 01:23:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:59.609 01:23:07 -- common/autotest_common.sh@10 -- # set +x 00:21:59.609 01:23:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:59.609 01:23:07 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:21:59.609 01:23:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:59.609 01:23:07 -- common/autotest_common.sh@10 -- # set +x 00:21:59.609 01:23:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:59.609 01:23:07 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:59.609 01:23:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:59.609 01:23:07 -- common/autotest_common.sh@10 -- # set +x 00:21:59.609 [2024-11-20 01:23:07.657010] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:59.609 01:23:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:59.609 01:23:07 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:59.609 01:23:07 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:21:59.609 01:23:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:59.609 01:23:07 -- common/autotest_common.sh@10 -- # set +x 00:21:59.609 Malloc2 00:21:59.609 01:23:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:59.609 01:23:07 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:21:59.609 01:23:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:59.609 01:23:07 -- common/autotest_common.sh@10 -- # set +x 00:21:59.609 01:23:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:59.609 01:23:07 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:21:59.609 01:23:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:59.609 01:23:07 -- common/autotest_common.sh@10 -- # set +x 00:21:59.609 01:23:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:59.609 01:23:07 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:21:59.609 01:23:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:59.609 01:23:07 -- common/autotest_common.sh@10 -- # set +x 00:21:59.609 01:23:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:59.609 01:23:07 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:59.609 01:23:07 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:21:59.609 01:23:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:59.609 01:23:07 -- common/autotest_common.sh@10 -- # set +x 00:21:59.609 Malloc3 00:21:59.609 01:23:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:59.609 01:23:07 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK3 00:21:59.609 01:23:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:59.609 01:23:07 -- common/autotest_common.sh@10 -- # set +x 00:21:59.609 01:23:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:59.609 01:23:07 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:21:59.609 01:23:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:59.609 01:23:07 -- common/autotest_common.sh@10 -- # set +x 00:21:59.609 01:23:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:59.609 01:23:07 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:21:59.609 01:23:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:59.609 01:23:07 -- common/autotest_common.sh@10 -- # set +x 00:21:59.609 01:23:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:59.609 01:23:07 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:59.609 01:23:07 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:21:59.609 01:23:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:59.609 01:23:07 -- common/autotest_common.sh@10 -- # set +x 00:21:59.609 Malloc4 00:21:59.609 01:23:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:59.609 01:23:07 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK4 00:21:59.609 01:23:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:59.609 01:23:07 -- common/autotest_common.sh@10 -- # set +x 00:21:59.609 01:23:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:59.609 01:23:07 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:21:59.609 01:23:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:59.609 01:23:07 -- common/autotest_common.sh@10 -- # set +x 00:21:59.609 01:23:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:59.609 01:23:07 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:21:59.609 01:23:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:59.609 01:23:07 -- common/autotest_common.sh@10 -- # set +x 00:21:59.895 01:23:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:59.895 01:23:07 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:59.895 01:23:07 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:21:59.895 01:23:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:59.895 01:23:07 -- common/autotest_common.sh@10 -- # set +x 00:21:59.895 Malloc5 00:21:59.895 01:23:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:59.895 01:23:07 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK5 00:21:59.895 01:23:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:59.895 01:23:07 -- common/autotest_common.sh@10 -- # set +x 00:21:59.896 01:23:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:59.896 01:23:07 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:21:59.896 01:23:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:59.896 01:23:07 -- common/autotest_common.sh@10 -- # set +x 00:21:59.896 01:23:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:59.896 01:23:07 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t tcp -a 10.0.0.2 -s 4420 00:21:59.896 01:23:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:59.896 01:23:07 -- common/autotest_common.sh@10 -- # set +x 00:21:59.896 01:23:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:59.896 01:23:07 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:59.896 01:23:07 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc6 00:21:59.896 01:23:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:59.896 01:23:07 -- common/autotest_common.sh@10 -- # set +x 00:21:59.896 Malloc6 00:21:59.896 01:23:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:59.896 01:23:07 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode6 -a -s SPDK6 00:21:59.896 01:23:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:59.896 01:23:07 -- common/autotest_common.sh@10 -- # set +x 00:21:59.896 01:23:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:59.896 01:23:07 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode6 Malloc6 00:21:59.896 01:23:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:59.896 01:23:07 -- common/autotest_common.sh@10 -- # set +x 00:21:59.896 01:23:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:59.896 01:23:07 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode6 -t tcp -a 10.0.0.2 -s 4420 00:21:59.896 01:23:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:59.896 01:23:07 -- common/autotest_common.sh@10 -- # set +x 00:21:59.896 01:23:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:59.896 01:23:07 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:59.896 01:23:07 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc7 00:21:59.896 01:23:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:59.896 01:23:07 -- common/autotest_common.sh@10 -- # set +x 00:21:59.896 Malloc7 00:21:59.896 01:23:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:59.896 01:23:07 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode7 -a -s SPDK7 00:21:59.896 01:23:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:59.896 01:23:07 -- common/autotest_common.sh@10 -- # set +x 00:21:59.896 01:23:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:59.896 01:23:07 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode7 Malloc7 00:21:59.896 01:23:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:59.896 01:23:07 -- common/autotest_common.sh@10 -- # set +x 00:21:59.896 01:23:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:59.896 01:23:07 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode7 -t tcp -a 10.0.0.2 -s 4420 00:21:59.896 01:23:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:59.896 01:23:07 -- common/autotest_common.sh@10 -- # set +x 00:21:59.896 01:23:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:59.896 01:23:07 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:59.896 01:23:07 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc8 00:21:59.896 01:23:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:59.896 01:23:07 -- common/autotest_common.sh@10 -- # set +x 00:21:59.896 Malloc8 00:21:59.896 01:23:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:59.896 01:23:07 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8 -a -s SPDK8 00:21:59.896 01:23:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:59.896 01:23:07 -- common/autotest_common.sh@10 -- # set +x 00:21:59.896 01:23:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:59.896 01:23:07 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode8 Malloc8 00:21:59.896 01:23:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:59.896 01:23:07 -- common/autotest_common.sh@10 -- # set +x 00:21:59.896 01:23:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:59.896 01:23:08 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode8 -t tcp -a 10.0.0.2 -s 4420 00:21:59.896 01:23:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:59.896 01:23:08 -- common/autotest_common.sh@10 -- # set +x 00:21:59.896 01:23:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:59.896 01:23:08 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:59.896 01:23:08 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc9 00:21:59.896 01:23:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:59.896 01:23:08 -- common/autotest_common.sh@10 -- # set +x 00:21:59.896 Malloc9 00:21:59.896 01:23:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:59.896 01:23:08 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9 -a -s SPDK9 00:21:59.896 01:23:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:59.896 01:23:08 -- common/autotest_common.sh@10 -- # set +x 00:21:59.896 01:23:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:59.896 01:23:08 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode9 Malloc9 00:21:59.896 01:23:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:59.896 01:23:08 -- common/autotest_common.sh@10 -- # set +x 00:21:59.896 01:23:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:59.896 01:23:08 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode9 -t tcp -a 10.0.0.2 -s 4420 00:21:59.896 01:23:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:59.896 01:23:08 -- common/autotest_common.sh@10 -- # set +x 00:21:59.896 01:23:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:59.896 01:23:08 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:59.896 01:23:08 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc10 00:21:59.896 01:23:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:59.896 01:23:08 -- common/autotest_common.sh@10 -- # set +x 00:21:59.896 Malloc10 00:21:59.896 01:23:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:59.896 01:23:08 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode10 -a -s SPDK10 00:21:59.896 01:23:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:59.896 01:23:08 -- common/autotest_common.sh@10 -- # set +x 00:21:59.896 01:23:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:59.896 01:23:08 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode10 Malloc10 00:21:59.896 01:23:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:59.896 01:23:08 -- common/autotest_common.sh@10 -- # set +x 00:21:59.896 01:23:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:59.896 01:23:08 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode10 -t tcp -a 10.0.0.2 -s 4420 00:21:59.896 01:23:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:59.896 01:23:08 -- common/autotest_common.sh@10 -- # set +x 00:21:59.896 01:23:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:59.896 01:23:08 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:59.896 01:23:08 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc11 00:21:59.896 01:23:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:59.896 01:23:08 -- common/autotest_common.sh@10 -- # set +x 00:22:00.155 Malloc11 00:22:00.155 01:23:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:00.155 01:23:08 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode11 -a -s SPDK11 00:22:00.155 01:23:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:00.155 01:23:08 -- common/autotest_common.sh@10 -- # set +x 00:22:00.155 01:23:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:00.155 01:23:08 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode11 Malloc11 00:22:00.155 01:23:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:00.155 01:23:08 -- common/autotest_common.sh@10 -- # set +x 00:22:00.155 01:23:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:00.155 01:23:08 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode11 -t tcp -a 10.0.0.2 -s 4420 00:22:00.155 01:23:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:00.155 01:23:08 -- common/autotest_common.sh@10 -- # set +x 00:22:00.155 01:23:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:00.155 01:23:08 -- target/multiconnection.sh@28 -- # seq 1 11 00:22:00.155 01:23:08 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:00.155 01:23:08 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:22:00.721 01:23:08 -- target/multiconnection.sh@30 -- # waitforserial SPDK1 00:22:00.721 01:23:08 -- common/autotest_common.sh@1187 -- # local i=0 00:22:00.721 01:23:08 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:00.721 01:23:08 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:00.721 01:23:08 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:03.248 01:23:10 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:03.248 01:23:10 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:03.248 01:23:10 -- common/autotest_common.sh@1196 -- # grep -c SPDK1 00:22:03.248 01:23:10 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:03.248 01:23:10 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:03.248 01:23:10 -- common/autotest_common.sh@1197 -- # return 0 00:22:03.248 01:23:10 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:03.248 01:23:10 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode2 -a 10.0.0.2 -s 4420 00:22:03.506 01:23:11 -- target/multiconnection.sh@30 -- # waitforserial SPDK2 00:22:03.506 01:23:11 -- common/autotest_common.sh@1187 -- # local i=0 00:22:03.506 01:23:11 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:03.506 01:23:11 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:03.506 01:23:11 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:05.406 01:23:13 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:05.406 01:23:13 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:05.406 01:23:13 -- common/autotest_common.sh@1196 -- # grep -c SPDK2 00:22:05.406 01:23:13 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:05.406 01:23:13 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:05.406 01:23:13 -- common/autotest_common.sh@1197 -- # return 0 00:22:05.406 01:23:13 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:05.406 01:23:13 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode3 -a 10.0.0.2 -s 4420 00:22:05.973 01:23:14 -- target/multiconnection.sh@30 -- # waitforserial SPDK3 00:22:05.973 01:23:14 -- common/autotest_common.sh@1187 -- # local i=0 00:22:05.973 01:23:14 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:05.973 01:23:14 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:05.973 01:23:14 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:08.499 01:23:16 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:08.499 01:23:16 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:08.499 01:23:16 -- common/autotest_common.sh@1196 -- # grep -c SPDK3 00:22:08.499 01:23:16 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:08.499 01:23:16 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:08.499 01:23:16 -- common/autotest_common.sh@1197 -- # return 0 00:22:08.499 01:23:16 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:08.499 01:23:16 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode4 -a 10.0.0.2 -s 4420 00:22:08.757 01:23:16 -- target/multiconnection.sh@30 -- # waitforserial SPDK4 00:22:08.757 01:23:16 -- common/autotest_common.sh@1187 -- # local i=0 00:22:08.757 01:23:16 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:08.757 01:23:16 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:08.757 01:23:16 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:11.283 01:23:18 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:11.283 01:23:18 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:11.283 01:23:18 -- common/autotest_common.sh@1196 -- # grep -c SPDK4 00:22:11.283 01:23:18 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:11.283 01:23:18 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:11.283 01:23:18 -- common/autotest_common.sh@1197 -- # return 0 00:22:11.283 01:23:18 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:11.283 01:23:18 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode5 -a 10.0.0.2 -s 4420 00:22:11.542 01:23:19 -- target/multiconnection.sh@30 -- # waitforserial SPDK5 00:22:11.542 01:23:19 -- common/autotest_common.sh@1187 -- # local i=0 00:22:11.542 01:23:19 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:11.542 01:23:19 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:11.542 01:23:19 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:14.068 01:23:21 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:14.068 01:23:21 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:14.068 01:23:21 -- common/autotest_common.sh@1196 -- # grep -c SPDK5 00:22:14.068 01:23:21 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:14.068 01:23:21 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:14.068 01:23:21 -- common/autotest_common.sh@1197 -- # return 0 00:22:14.069 01:23:21 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:14.069 01:23:21 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode6 -a 10.0.0.2 -s 4420 00:22:14.326 01:23:22 -- target/multiconnection.sh@30 -- # waitforserial SPDK6 00:22:14.326 01:23:22 -- common/autotest_common.sh@1187 -- # local i=0 00:22:14.326 01:23:22 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:14.326 01:23:22 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:14.326 01:23:22 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:16.854 01:23:24 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:16.854 01:23:24 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:16.854 01:23:24 -- common/autotest_common.sh@1196 -- # grep -c SPDK6 00:22:16.854 01:23:24 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:16.854 01:23:24 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:16.854 01:23:24 -- common/autotest_common.sh@1197 -- # return 0 00:22:16.854 01:23:24 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:16.854 01:23:24 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode7 -a 10.0.0.2 -s 4420 00:22:17.110 01:23:25 -- target/multiconnection.sh@30 -- # waitforserial SPDK7 00:22:17.110 01:23:25 -- common/autotest_common.sh@1187 -- # local i=0 00:22:17.110 01:23:25 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:17.110 01:23:25 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:17.110 01:23:25 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:19.007 01:23:27 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:19.007 01:23:27 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:19.007 01:23:27 -- common/autotest_common.sh@1196 -- # grep -c SPDK7 00:22:19.007 01:23:27 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:19.007 01:23:27 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:19.007 01:23:27 -- common/autotest_common.sh@1197 -- # return 0 00:22:19.007 01:23:27 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:19.007 01:23:27 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode8 -a 10.0.0.2 -s 4420 00:22:19.942 01:23:28 -- target/multiconnection.sh@30 -- # waitforserial SPDK8 00:22:19.942 01:23:28 -- common/autotest_common.sh@1187 -- # local i=0 00:22:19.942 01:23:28 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:19.942 01:23:28 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:19.942 01:23:28 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:22.466 01:23:30 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:22.466 01:23:30 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:22.466 01:23:30 -- common/autotest_common.sh@1196 -- # grep -c SPDK8 00:22:22.466 01:23:30 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:22.466 01:23:30 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:22.466 01:23:30 -- common/autotest_common.sh@1197 -- # return 0 00:22:22.466 01:23:30 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:22.466 01:23:30 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode9 -a 10.0.0.2 -s 4420 00:22:23.033 01:23:31 -- target/multiconnection.sh@30 -- # waitforserial SPDK9 00:22:23.033 01:23:31 -- common/autotest_common.sh@1187 -- # local i=0 00:22:23.033 01:23:31 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:23.033 01:23:31 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:23.033 01:23:31 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:24.930 01:23:33 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:24.930 01:23:33 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:24.930 01:23:33 -- common/autotest_common.sh@1196 -- # grep -c SPDK9 00:22:24.930 01:23:33 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:24.930 01:23:33 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:24.930 01:23:33 -- common/autotest_common.sh@1197 -- # return 0 00:22:24.930 01:23:33 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:24.930 01:23:33 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode10 -a 10.0.0.2 -s 4420 00:22:26.302 01:23:34 -- target/multiconnection.sh@30 -- # waitforserial SPDK10 00:22:26.302 01:23:34 -- common/autotest_common.sh@1187 -- # local i=0 00:22:26.302 01:23:34 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:26.302 01:23:34 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:26.302 01:23:34 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:28.200 01:23:36 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:28.200 01:23:36 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:28.200 01:23:36 -- common/autotest_common.sh@1196 -- # grep -c SPDK10 00:22:28.200 01:23:36 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:28.200 01:23:36 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:28.200 01:23:36 -- common/autotest_common.sh@1197 -- # return 0 00:22:28.200 01:23:36 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:28.200 01:23:36 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode11 -a 10.0.0.2 -s 4420 00:22:28.765 01:23:36 -- target/multiconnection.sh@30 -- # waitforserial SPDK11 00:22:28.765 01:23:36 -- common/autotest_common.sh@1187 -- # local i=0 00:22:28.765 01:23:36 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:28.765 01:23:36 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:28.765 01:23:36 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:31.291 01:23:38 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:31.291 01:23:38 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:31.291 01:23:38 -- common/autotest_common.sh@1196 -- # grep -c SPDK11 00:22:31.291 01:23:38 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:31.291 01:23:38 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:31.291 01:23:38 -- common/autotest_common.sh@1197 -- # return 0 00:22:31.291 01:23:38 -- target/multiconnection.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t read -r 10 00:22:31.291 [global] 00:22:31.291 thread=1 00:22:31.291 invalidate=1 00:22:31.291 rw=read 00:22:31.291 time_based=1 00:22:31.291 runtime=10 00:22:31.291 ioengine=libaio 00:22:31.291 direct=1 00:22:31.291 bs=262144 00:22:31.291 iodepth=64 00:22:31.291 norandommap=1 00:22:31.291 numjobs=1 00:22:31.291 00:22:31.291 [job0] 00:22:31.291 filename=/dev/nvme0n1 00:22:31.291 [job1] 00:22:31.291 filename=/dev/nvme10n1 00:22:31.291 [job2] 00:22:31.291 filename=/dev/nvme1n1 00:22:31.291 [job3] 00:22:31.291 filename=/dev/nvme2n1 00:22:31.291 [job4] 00:22:31.291 filename=/dev/nvme3n1 00:22:31.291 [job5] 00:22:31.291 filename=/dev/nvme4n1 00:22:31.291 [job6] 00:22:31.291 filename=/dev/nvme5n1 00:22:31.292 [job7] 00:22:31.292 filename=/dev/nvme6n1 00:22:31.292 [job8] 00:22:31.292 filename=/dev/nvme7n1 00:22:31.292 [job9] 00:22:31.292 filename=/dev/nvme8n1 00:22:31.292 [job10] 00:22:31.292 filename=/dev/nvme9n1 00:22:31.292 Could not set queue depth (nvme0n1) 00:22:31.292 Could not set queue depth (nvme10n1) 00:22:31.292 Could not set queue depth (nvme1n1) 00:22:31.292 Could not set queue depth (nvme2n1) 00:22:31.292 Could not set queue depth (nvme3n1) 00:22:31.292 Could not set queue depth (nvme4n1) 00:22:31.292 Could not set queue depth (nvme5n1) 00:22:31.292 Could not set queue depth (nvme6n1) 00:22:31.292 Could not set queue depth (nvme7n1) 00:22:31.292 Could not set queue depth (nvme8n1) 00:22:31.292 Could not set queue depth (nvme9n1) 00:22:31.292 job0: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:31.292 job1: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:31.292 job2: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:31.292 job3: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:31.292 job4: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:31.292 job5: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:31.292 job6: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:31.292 job7: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:31.292 job8: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:31.292 job9: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:31.292 job10: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:31.292 fio-3.35 00:22:31.292 Starting 11 threads 00:22:43.491 00:22:43.491 job0: (groupid=0, jobs=1): err= 0: pid=1189963: Wed Nov 20 01:23:49 2024 00:22:43.491 read: IOPS=567, BW=142MiB/s (149MB/s)(1433MiB/10098msec) 00:22:43.491 slat (usec): min=13, max=209232, avg=1576.05, stdev=5899.31 00:22:43.491 clat (usec): min=1229, max=464533, avg=111087.39, stdev=45201.56 00:22:43.491 lat (usec): min=1250, max=464662, avg=112663.44, stdev=46055.39 00:22:43.491 clat percentiles (msec): 00:22:43.491 | 1.00th=[ 4], 5.00th=[ 28], 10.00th=[ 39], 20.00th=[ 84], 00:22:43.491 | 30.00th=[ 97], 40.00th=[ 111], 50.00th=[ 120], 60.00th=[ 126], 00:22:43.491 | 70.00th=[ 131], 80.00th=[ 138], 90.00th=[ 155], 95.00th=[ 174], 00:22:43.491 | 99.00th=[ 247], 99.50th=[ 251], 99.90th=[ 268], 99.95th=[ 268], 00:22:43.491 | 99.99th=[ 464] 00:22:43.491 bw ( KiB/s): min=57856, max=302592, per=6.89%, avg=145100.05, stdev=55197.58, samples=20 00:22:43.491 iops : min= 226, max= 1182, avg=566.75, stdev=215.62, samples=20 00:22:43.491 lat (msec) : 2=0.51%, 4=0.75%, 10=1.64%, 20=1.06%, 50=8.55% 00:22:43.491 lat (msec) : 100=19.42%, 250=67.50%, 500=0.58% 00:22:43.491 cpu : usr=0.41%, sys=1.97%, ctx=1191, majf=0, minf=4097 00:22:43.491 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:22:43.491 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:43.491 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:43.491 issued rwts: total=5732,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:43.491 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:43.491 job1: (groupid=0, jobs=1): err= 0: pid=1189964: Wed Nov 20 01:23:49 2024 00:22:43.491 read: IOPS=628, BW=157MiB/s (165MB/s)(1583MiB/10070msec) 00:22:43.491 slat (usec): min=10, max=97845, avg=1378.65, stdev=4363.88 00:22:43.491 clat (usec): min=1939, max=224500, avg=100300.86, stdev=46697.89 00:22:43.491 lat (usec): min=1988, max=224528, avg=101679.51, stdev=47405.42 00:22:43.491 clat percentiles (msec): 00:22:43.491 | 1.00th=[ 10], 5.00th=[ 28], 10.00th=[ 31], 20.00th=[ 45], 00:22:43.491 | 30.00th=[ 74], 40.00th=[ 97], 50.00th=[ 114], 60.00th=[ 125], 00:22:43.491 | 70.00th=[ 131], 80.00th=[ 138], 90.00th=[ 155], 95.00th=[ 167], 00:22:43.491 | 99.00th=[ 184], 99.50th=[ 192], 99.90th=[ 205], 99.95th=[ 205], 00:22:43.491 | 99.99th=[ 226] 00:22:43.491 bw ( KiB/s): min=95744, max=500713, per=7.62%, avg=160524.10, stdev=89783.86, samples=20 00:22:43.491 iops : min= 374, max= 1955, avg=627.00, stdev=350.54, samples=20 00:22:43.491 lat (msec) : 2=0.05%, 4=0.02%, 10=1.17%, 20=2.10%, 50=17.99% 00:22:43.491 lat (msec) : 100=20.01%, 250=58.68% 00:22:43.491 cpu : usr=0.41%, sys=2.16%, ctx=1381, majf=0, minf=4098 00:22:43.491 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:22:43.491 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:43.491 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:43.491 issued rwts: total=6333,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:43.491 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:43.491 job2: (groupid=0, jobs=1): err= 0: pid=1189965: Wed Nov 20 01:23:49 2024 00:22:43.491 read: IOPS=754, BW=189MiB/s (198MB/s)(1907MiB/10101msec) 00:22:43.491 slat (usec): min=9, max=246822, avg=960.87, stdev=4524.94 00:22:43.491 clat (usec): min=1204, max=407278, avg=83746.03, stdev=43241.32 00:22:43.491 lat (usec): min=1226, max=415096, avg=84706.91, stdev=43895.87 00:22:43.491 clat percentiles (msec): 00:22:43.491 | 1.00th=[ 6], 5.00th=[ 30], 10.00th=[ 36], 20.00th=[ 49], 00:22:43.491 | 30.00th=[ 59], 40.00th=[ 74], 50.00th=[ 82], 60.00th=[ 88], 00:22:43.491 | 70.00th=[ 99], 80.00th=[ 113], 90.00th=[ 134], 95.00th=[ 153], 00:22:43.491 | 99.00th=[ 239], 99.50th=[ 321], 99.90th=[ 334], 99.95th=[ 334], 00:22:43.491 | 99.99th=[ 409] 00:22:43.491 bw ( KiB/s): min=63488, max=335360, per=9.19%, avg=193592.10, stdev=68321.41, samples=20 00:22:43.491 iops : min= 248, max= 1310, avg=756.20, stdev=266.88, samples=20 00:22:43.491 lat (msec) : 2=0.01%, 4=0.26%, 10=1.11%, 20=1.46%, 50=18.53% 00:22:43.491 lat (msec) : 100=50.00%, 250=27.80%, 500=0.83% 00:22:43.491 cpu : usr=0.37%, sys=2.20%, ctx=1593, majf=0, minf=4097 00:22:43.491 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:22:43.491 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:43.491 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:43.491 issued rwts: total=7626,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:43.491 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:43.491 job3: (groupid=0, jobs=1): err= 0: pid=1189966: Wed Nov 20 01:23:49 2024 00:22:43.491 read: IOPS=804, BW=201MiB/s (211MB/s)(2015MiB/10023msec) 00:22:43.491 slat (usec): min=9, max=136342, avg=982.61, stdev=4013.45 00:22:43.491 clat (msec): min=3, max=322, avg=78.57, stdev=42.96 00:22:43.491 lat (msec): min=3, max=322, avg=79.55, stdev=43.44 00:22:43.491 clat percentiles (msec): 00:22:43.491 | 1.00th=[ 8], 5.00th=[ 22], 10.00th=[ 33], 20.00th=[ 50], 00:22:43.491 | 30.00th=[ 58], 40.00th=[ 65], 50.00th=[ 71], 60.00th=[ 79], 00:22:43.491 | 70.00th=[ 87], 80.00th=[ 108], 90.00th=[ 132], 95.00th=[ 159], 00:22:43.491 | 99.00th=[ 222], 99.50th=[ 296], 99.90th=[ 317], 99.95th=[ 321], 00:22:43.491 | 99.99th=[ 321] 00:22:43.491 bw ( KiB/s): min=101376, max=353792, per=9.72%, avg=204684.40, stdev=65416.38, samples=20 00:22:43.491 iops : min= 396, max= 1382, avg=799.50, stdev=255.59, samples=20 00:22:43.491 lat (msec) : 4=0.04%, 10=1.56%, 20=2.84%, 50=16.37%, 100=55.71% 00:22:43.491 lat (msec) : 250=22.86%, 500=0.62% 00:22:43.491 cpu : usr=0.53%, sys=2.53%, ctx=1607, majf=0, minf=4097 00:22:43.491 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:22:43.491 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:43.491 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:43.491 issued rwts: total=8059,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:43.491 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:43.491 job4: (groupid=0, jobs=1): err= 0: pid=1189967: Wed Nov 20 01:23:49 2024 00:22:43.491 read: IOPS=535, BW=134MiB/s (140MB/s)(1349MiB/10071msec) 00:22:43.491 slat (usec): min=13, max=259263, avg=1739.07, stdev=5811.72 00:22:43.491 clat (msec): min=14, max=319, avg=117.64, stdev=35.78 00:22:43.491 lat (msec): min=19, max=420, avg=119.38, stdev=36.57 00:22:43.491 clat percentiles (msec): 00:22:43.491 | 1.00th=[ 31], 5.00th=[ 63], 10.00th=[ 78], 20.00th=[ 96], 00:22:43.491 | 30.00th=[ 106], 40.00th=[ 112], 50.00th=[ 120], 60.00th=[ 125], 00:22:43.491 | 70.00th=[ 130], 80.00th=[ 136], 90.00th=[ 153], 95.00th=[ 167], 00:22:43.491 | 99.00th=[ 305], 99.50th=[ 309], 99.90th=[ 317], 99.95th=[ 321], 00:22:43.491 | 99.99th=[ 321] 00:22:43.491 bw ( KiB/s): min=87727, max=207872, per=6.48%, avg=136495.65, stdev=32512.98, samples=20 00:22:43.491 iops : min= 342, max= 812, avg=533.15, stdev=127.06, samples=20 00:22:43.491 lat (msec) : 20=0.07%, 50=3.15%, 100=20.20%, 250=75.40%, 500=1.17% 00:22:43.491 cpu : usr=0.29%, sys=2.02%, ctx=1153, majf=0, minf=4097 00:22:43.491 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:22:43.491 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:43.491 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:43.491 issued rwts: total=5395,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:43.491 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:43.491 job5: (groupid=0, jobs=1): err= 0: pid=1189968: Wed Nov 20 01:23:49 2024 00:22:43.491 read: IOPS=1268, BW=317MiB/s (332MB/s)(3174MiB/10011msec) 00:22:43.491 slat (usec): min=13, max=39575, avg=767.26, stdev=2338.81 00:22:43.491 clat (msec): min=4, max=196, avg=49.66, stdev=27.11 00:22:43.491 lat (msec): min=4, max=196, avg=50.43, stdev=27.51 00:22:43.491 clat percentiles (msec): 00:22:43.491 | 1.00th=[ 22], 5.00th=[ 27], 10.00th=[ 28], 20.00th=[ 30], 00:22:43.491 | 30.00th=[ 31], 40.00th=[ 32], 50.00th=[ 39], 60.00th=[ 49], 00:22:43.491 | 70.00th=[ 58], 80.00th=[ 68], 90.00th=[ 89], 95.00th=[ 107], 00:22:43.491 | 99.00th=[ 138], 99.50th=[ 165], 99.90th=[ 184], 99.95th=[ 188], 00:22:43.491 | 99.99th=[ 190] 00:22:43.491 bw ( KiB/s): min=138752, max=559520, per=15.36%, avg=323348.80, stdev=135733.83, samples=20 00:22:43.491 iops : min= 542, max= 2185, avg=1263.05, stdev=530.15, samples=20 00:22:43.491 lat (msec) : 10=0.41%, 20=0.46%, 50=60.81%, 100=31.29%, 250=7.03% 00:22:43.491 cpu : usr=0.74%, sys=3.82%, ctx=2229, majf=0, minf=4097 00:22:43.491 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.5% 00:22:43.491 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:43.492 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:43.492 issued rwts: total=12696,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:43.492 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:43.492 job6: (groupid=0, jobs=1): err= 0: pid=1189969: Wed Nov 20 01:23:49 2024 00:22:43.492 read: IOPS=693, BW=173MiB/s (182MB/s)(1745MiB/10068msec) 00:22:43.492 slat (usec): min=11, max=51406, avg=1265.62, stdev=3854.09 00:22:43.492 clat (msec): min=2, max=211, avg=90.98, stdev=39.49 00:22:43.492 lat (msec): min=2, max=211, avg=92.24, stdev=40.15 00:22:43.492 clat percentiles (msec): 00:22:43.492 | 1.00th=[ 11], 5.00th=[ 22], 10.00th=[ 41], 20.00th=[ 55], 00:22:43.492 | 30.00th=[ 69], 40.00th=[ 82], 50.00th=[ 92], 60.00th=[ 104], 00:22:43.492 | 70.00th=[ 114], 80.00th=[ 126], 90.00th=[ 140], 95.00th=[ 157], 00:22:43.492 | 99.00th=[ 180], 99.50th=[ 184], 99.90th=[ 201], 99.95th=[ 205], 00:22:43.492 | 99.99th=[ 211] 00:22:43.492 bw ( KiB/s): min=100352, max=311296, per=8.41%, avg=177081.70, stdev=62077.76, samples=20 00:22:43.492 iops : min= 392, max= 1216, avg=691.70, stdev=242.45, samples=20 00:22:43.492 lat (msec) : 4=0.07%, 10=0.83%, 20=3.71%, 50=11.10%, 100=41.45% 00:22:43.492 lat (msec) : 250=42.84% 00:22:43.492 cpu : usr=0.42%, sys=2.41%, ctx=1495, majf=0, minf=4097 00:22:43.492 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:22:43.492 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:43.492 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:43.492 issued rwts: total=6980,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:43.492 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:43.492 job7: (groupid=0, jobs=1): err= 0: pid=1189970: Wed Nov 20 01:23:49 2024 00:22:43.492 read: IOPS=821, BW=205MiB/s (215MB/s)(2073MiB/10098msec) 00:22:43.492 slat (usec): min=9, max=200945, avg=1047.49, stdev=4357.75 00:22:43.492 clat (usec): min=758, max=355077, avg=76840.85, stdev=45417.08 00:22:43.492 lat (usec): min=777, max=427974, avg=77888.33, stdev=46088.57 00:22:43.492 clat percentiles (msec): 00:22:43.492 | 1.00th=[ 6], 5.00th=[ 20], 10.00th=[ 29], 20.00th=[ 34], 00:22:43.492 | 30.00th=[ 45], 40.00th=[ 64], 50.00th=[ 78], 60.00th=[ 86], 00:22:43.492 | 70.00th=[ 97], 80.00th=[ 110], 90.00th=[ 126], 95.00th=[ 148], 00:22:43.492 | 99.00th=[ 224], 99.50th=[ 300], 99.90th=[ 317], 99.95th=[ 321], 00:22:43.492 | 99.99th=[ 355] 00:22:43.492 bw ( KiB/s): min=40448, max=440832, per=10.00%, avg=210617.05, stdev=97658.69, samples=20 00:22:43.492 iops : min= 158, max= 1722, avg=822.70, stdev=381.48, samples=20 00:22:43.492 lat (usec) : 1000=0.17% 00:22:43.492 lat (msec) : 2=0.19%, 4=0.24%, 10=1.74%, 20=2.96%, 50=27.46% 00:22:43.492 lat (msec) : 100=40.06%, 250=26.37%, 500=0.82% 00:22:43.492 cpu : usr=0.37%, sys=2.49%, ctx=1598, majf=0, minf=3721 00:22:43.492 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:22:43.492 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:43.492 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:43.492 issued rwts: total=8291,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:43.492 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:43.492 job8: (groupid=0, jobs=1): err= 0: pid=1189977: Wed Nov 20 01:23:49 2024 00:22:43.492 read: IOPS=760, BW=190MiB/s (199MB/s)(1921MiB/10098msec) 00:22:43.492 slat (usec): min=13, max=95145, avg=1138.25, stdev=3742.29 00:22:43.492 clat (usec): min=1838, max=252596, avg=82911.61, stdev=38796.49 00:22:43.492 lat (usec): min=1901, max=252613, avg=84049.86, stdev=39321.12 00:22:43.492 clat percentiles (msec): 00:22:43.492 | 1.00th=[ 11], 5.00th=[ 28], 10.00th=[ 31], 20.00th=[ 50], 00:22:43.492 | 30.00th=[ 60], 40.00th=[ 69], 50.00th=[ 79], 60.00th=[ 91], 00:22:43.492 | 70.00th=[ 106], 80.00th=[ 122], 90.00th=[ 132], 95.00th=[ 144], 00:22:43.492 | 99.00th=[ 176], 99.50th=[ 186], 99.90th=[ 243], 99.95th=[ 249], 00:22:43.492 | 99.99th=[ 253] 00:22:43.492 bw ( KiB/s): min=123904, max=376320, per=9.27%, avg=195076.05, stdev=70134.53, samples=20 00:22:43.492 iops : min= 484, max= 1470, avg=762.00, stdev=273.97, samples=20 00:22:43.492 lat (msec) : 2=0.01%, 4=0.25%, 10=0.65%, 20=1.08%, 50=18.85% 00:22:43.492 lat (msec) : 100=45.18%, 250=33.97%, 500=0.01% 00:22:43.492 cpu : usr=0.42%, sys=2.54%, ctx=1588, majf=0, minf=4097 00:22:43.492 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:22:43.492 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:43.492 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:43.492 issued rwts: total=7683,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:43.492 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:43.492 job9: (groupid=0, jobs=1): err= 0: pid=1189994: Wed Nov 20 01:23:49 2024 00:22:43.492 read: IOPS=548, BW=137MiB/s (144MB/s)(1381MiB/10069msec) 00:22:43.492 slat (usec): min=10, max=44022, avg=1541.33, stdev=4260.05 00:22:43.492 clat (msec): min=10, max=211, avg=115.00, stdev=32.49 00:22:43.492 lat (msec): min=10, max=211, avg=116.54, stdev=33.00 00:22:43.492 clat percentiles (msec): 00:22:43.492 | 1.00th=[ 33], 5.00th=[ 55], 10.00th=[ 64], 20.00th=[ 91], 00:22:43.492 | 30.00th=[ 106], 40.00th=[ 115], 50.00th=[ 123], 60.00th=[ 128], 00:22:43.492 | 70.00th=[ 133], 80.00th=[ 138], 90.00th=[ 150], 95.00th=[ 163], 00:22:43.492 | 99.00th=[ 180], 99.50th=[ 184], 99.90th=[ 203], 99.95th=[ 209], 00:22:43.492 | 99.99th=[ 211] 00:22:43.492 bw ( KiB/s): min=94720, max=254976, per=6.64%, avg=139801.30, stdev=39008.00, samples=20 00:22:43.492 iops : min= 370, max= 996, avg=546.05, stdev=152.38, samples=20 00:22:43.492 lat (msec) : 20=0.25%, 50=3.33%, 100=21.48%, 250=74.93% 00:22:43.492 cpu : usr=0.34%, sys=1.98%, ctx=1264, majf=0, minf=4097 00:22:43.492 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:22:43.492 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:43.492 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:43.492 issued rwts: total=5525,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:43.492 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:43.492 job10: (groupid=0, jobs=1): err= 0: pid=1190003: Wed Nov 20 01:23:49 2024 00:22:43.492 read: IOPS=866, BW=217MiB/s (227MB/s)(2189MiB/10101msec) 00:22:43.492 slat (usec): min=9, max=157422, avg=924.21, stdev=4163.68 00:22:43.492 clat (msec): min=5, max=267, avg=72.83, stdev=41.42 00:22:43.492 lat (msec): min=5, max=267, avg=73.75, stdev=41.95 00:22:43.492 clat percentiles (msec): 00:22:43.492 | 1.00th=[ 14], 5.00th=[ 28], 10.00th=[ 31], 20.00th=[ 34], 00:22:43.492 | 30.00th=[ 45], 40.00th=[ 58], 50.00th=[ 66], 60.00th=[ 75], 00:22:43.492 | 70.00th=[ 86], 80.00th=[ 101], 90.00th=[ 132], 95.00th=[ 161], 00:22:43.492 | 99.00th=[ 201], 99.50th=[ 218], 99.90th=[ 243], 99.95th=[ 255], 00:22:43.492 | 99.99th=[ 268] 00:22:43.492 bw ( KiB/s): min=93696, max=413184, per=10.57%, avg=222502.15, stdev=87105.51, samples=20 00:22:43.492 iops : min= 366, max= 1614, avg=869.10, stdev=340.23, samples=20 00:22:43.492 lat (msec) : 10=0.29%, 20=1.67%, 50=30.83%, 100=47.48%, 250=19.64% 00:22:43.492 lat (msec) : 500=0.09% 00:22:43.492 cpu : usr=0.46%, sys=2.50%, ctx=1708, majf=0, minf=4097 00:22:43.492 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:22:43.492 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:43.492 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:43.492 issued rwts: total=8757,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:43.492 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:43.492 00:22:43.492 Run status group 0 (all jobs): 00:22:43.492 READ: bw=2056MiB/s (2156MB/s), 134MiB/s-317MiB/s (140MB/s-332MB/s), io=20.3GiB (21.8GB), run=10011-10101msec 00:22:43.492 00:22:43.492 Disk stats (read/write): 00:22:43.492 nvme0n1: ios=11303/0, merge=0/0, ticks=1228965/0, in_queue=1228965, util=97.35% 00:22:43.492 nvme10n1: ios=12462/0, merge=0/0, ticks=1234880/0, in_queue=1234880, util=97.56% 00:22:43.492 nvme1n1: ios=15095/0, merge=0/0, ticks=1237574/0, in_queue=1237574, util=97.82% 00:22:43.492 nvme2n1: ios=15924/0, merge=0/0, ticks=1241833/0, in_queue=1241833, util=97.93% 00:22:43.492 nvme3n1: ios=10607/0, merge=0/0, ticks=1234485/0, in_queue=1234485, util=98.00% 00:22:43.492 nvme4n1: ios=25070/0, merge=0/0, ticks=1240769/0, in_queue=1240769, util=98.30% 00:22:43.492 nvme5n1: ios=13761/0, merge=0/0, ticks=1235547/0, in_queue=1235547, util=98.45% 00:22:43.492 nvme6n1: ios=16454/0, merge=0/0, ticks=1235849/0, in_queue=1235849, util=98.56% 00:22:43.492 nvme7n1: ios=15194/0, merge=0/0, ticks=1231026/0, in_queue=1231026, util=98.93% 00:22:43.492 nvme8n1: ios=10750/0, merge=0/0, ticks=1233118/0, in_queue=1233118, util=99.10% 00:22:43.492 nvme9n1: ios=17356/0, merge=0/0, ticks=1237765/0, in_queue=1237765, util=99.23% 00:22:43.492 01:23:49 -- target/multiconnection.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t randwrite -r 10 00:22:43.492 [global] 00:22:43.492 thread=1 00:22:43.492 invalidate=1 00:22:43.492 rw=randwrite 00:22:43.492 time_based=1 00:22:43.492 runtime=10 00:22:43.492 ioengine=libaio 00:22:43.492 direct=1 00:22:43.492 bs=262144 00:22:43.492 iodepth=64 00:22:43.492 norandommap=1 00:22:43.492 numjobs=1 00:22:43.492 00:22:43.492 [job0] 00:22:43.492 filename=/dev/nvme0n1 00:22:43.492 [job1] 00:22:43.492 filename=/dev/nvme10n1 00:22:43.492 [job2] 00:22:43.492 filename=/dev/nvme1n1 00:22:43.492 [job3] 00:22:43.492 filename=/dev/nvme2n1 00:22:43.492 [job4] 00:22:43.492 filename=/dev/nvme3n1 00:22:43.492 [job5] 00:22:43.492 filename=/dev/nvme4n1 00:22:43.492 [job6] 00:22:43.492 filename=/dev/nvme5n1 00:22:43.492 [job7] 00:22:43.492 filename=/dev/nvme6n1 00:22:43.492 [job8] 00:22:43.492 filename=/dev/nvme7n1 00:22:43.492 [job9] 00:22:43.492 filename=/dev/nvme8n1 00:22:43.492 [job10] 00:22:43.492 filename=/dev/nvme9n1 00:22:43.492 Could not set queue depth (nvme0n1) 00:22:43.492 Could not set queue depth (nvme10n1) 00:22:43.492 Could not set queue depth (nvme1n1) 00:22:43.492 Could not set queue depth (nvme2n1) 00:22:43.492 Could not set queue depth (nvme3n1) 00:22:43.492 Could not set queue depth (nvme4n1) 00:22:43.492 Could not set queue depth (nvme5n1) 00:22:43.492 Could not set queue depth (nvme6n1) 00:22:43.493 Could not set queue depth (nvme7n1) 00:22:43.493 Could not set queue depth (nvme8n1) 00:22:43.493 Could not set queue depth (nvme9n1) 00:22:43.493 job0: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:43.493 job1: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:43.493 job2: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:43.493 job3: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:43.493 job4: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:43.493 job5: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:43.493 job6: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:43.493 job7: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:43.493 job8: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:43.493 job9: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:43.493 job10: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:43.493 fio-3.35 00:22:43.493 Starting 11 threads 00:22:53.535 00:22:53.535 job0: (groupid=0, jobs=1): err= 0: pid=1191164: Wed Nov 20 01:24:00 2024 00:22:53.535 write: IOPS=543, BW=136MiB/s (143MB/s)(1377MiB/10124msec); 0 zone resets 00:22:53.535 slat (usec): min=19, max=81996, avg=1502.53, stdev=3616.31 00:22:53.535 clat (usec): min=747, max=401870, avg=116092.04, stdev=59309.82 00:22:53.535 lat (usec): min=786, max=401929, avg=117594.56, stdev=60090.82 00:22:53.535 clat percentiles (msec): 00:22:53.535 | 1.00th=[ 4], 5.00th=[ 13], 10.00th=[ 30], 20.00th=[ 65], 00:22:53.535 | 30.00th=[ 85], 40.00th=[ 104], 50.00th=[ 115], 60.00th=[ 136], 00:22:53.535 | 70.00th=[ 153], 80.00th=[ 167], 90.00th=[ 188], 95.00th=[ 201], 00:22:53.536 | 99.00th=[ 249], 99.50th=[ 279], 99.90th=[ 393], 99.95th=[ 401], 00:22:53.536 | 99.99th=[ 401] 00:22:53.536 bw ( KiB/s): min=78336, max=313344, per=9.72%, avg=139345.15, stdev=58485.93, samples=20 00:22:53.536 iops : min= 306, max= 1224, avg=544.30, stdev=228.44, samples=20 00:22:53.536 lat (usec) : 750=0.02%, 1000=0.05% 00:22:53.536 lat (msec) : 2=0.16%, 4=0.91%, 10=2.56%, 20=3.81%, 50=9.93% 00:22:53.536 lat (msec) : 100=20.17%, 250=61.59%, 500=0.78% 00:22:53.536 cpu : usr=1.83%, sys=2.11%, ctx=2524, majf=0, minf=1 00:22:53.536 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:22:53.536 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:53.536 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:53.536 issued rwts: total=0,5507,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:53.536 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:53.536 job1: (groupid=0, jobs=1): err= 0: pid=1191176: Wed Nov 20 01:24:00 2024 00:22:53.536 write: IOPS=526, BW=132MiB/s (138MB/s)(1343MiB/10198msec); 0 zone resets 00:22:53.536 slat (usec): min=16, max=116258, avg=1367.08, stdev=3796.48 00:22:53.536 clat (usec): min=1303, max=502748, avg=120054.45, stdev=62915.30 00:22:53.536 lat (usec): min=1367, max=517280, avg=121421.53, stdev=63716.31 00:22:53.536 clat percentiles (msec): 00:22:53.536 | 1.00th=[ 14], 5.00th=[ 27], 10.00th=[ 41], 20.00th=[ 67], 00:22:53.536 | 30.00th=[ 84], 40.00th=[ 109], 50.00th=[ 115], 60.00th=[ 131], 00:22:53.536 | 70.00th=[ 148], 80.00th=[ 161], 90.00th=[ 201], 95.00th=[ 224], 00:22:53.536 | 99.00th=[ 305], 99.50th=[ 388], 99.90th=[ 485], 99.95th=[ 502], 00:22:53.536 | 99.99th=[ 502] 00:22:53.536 bw ( KiB/s): min=78848, max=303616, per=9.48%, avg=135910.40, stdev=55512.02, samples=20 00:22:53.536 iops : min= 308, max= 1186, avg=530.90, stdev=216.84, samples=20 00:22:53.536 lat (msec) : 2=0.07%, 10=0.63%, 20=1.38%, 50=12.60%, 100=21.11% 00:22:53.536 lat (msec) : 250=62.51%, 500=1.62%, 750=0.07% 00:22:53.536 cpu : usr=1.53%, sys=1.79%, ctx=2761, majf=0, minf=1 00:22:53.536 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:22:53.536 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:53.536 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:53.536 issued rwts: total=0,5372,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:53.536 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:53.536 job2: (groupid=0, jobs=1): err= 0: pid=1191177: Wed Nov 20 01:24:00 2024 00:22:53.536 write: IOPS=515, BW=129MiB/s (135MB/s)(1310MiB/10167msec); 0 zone resets 00:22:53.536 slat (usec): min=22, max=58221, avg=1506.17, stdev=3579.21 00:22:53.536 clat (usec): min=828, max=416217, avg=122632.04, stdev=65693.06 00:22:53.536 lat (usec): min=871, max=416254, avg=124138.20, stdev=66396.58 00:22:53.536 clat percentiles (msec): 00:22:53.536 | 1.00th=[ 7], 5.00th=[ 23], 10.00th=[ 37], 20.00th=[ 70], 00:22:53.536 | 30.00th=[ 90], 40.00th=[ 106], 50.00th=[ 117], 60.00th=[ 130], 00:22:53.536 | 70.00th=[ 146], 80.00th=[ 167], 90.00th=[ 222], 95.00th=[ 249], 00:22:53.536 | 99.00th=[ 300], 99.50th=[ 317], 99.90th=[ 405], 99.95th=[ 409], 00:22:53.536 | 99.99th=[ 418] 00:22:53.536 bw ( KiB/s): min=65536, max=214528, per=9.24%, avg=132497.65, stdev=44593.34, samples=20 00:22:53.536 iops : min= 256, max= 838, avg=517.55, stdev=174.22, samples=20 00:22:53.536 lat (usec) : 1000=0.02% 00:22:53.536 lat (msec) : 2=0.04%, 4=0.67%, 10=1.05%, 20=2.42%, 50=9.41% 00:22:53.536 lat (msec) : 100=22.79%, 250=59.61%, 500=3.99% 00:22:53.536 cpu : usr=1.65%, sys=1.92%, ctx=2467, majf=0, minf=1 00:22:53.536 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:22:53.536 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:53.536 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:53.536 issued rwts: total=0,5239,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:53.536 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:53.536 job3: (groupid=0, jobs=1): err= 0: pid=1191178: Wed Nov 20 01:24:00 2024 00:22:53.536 write: IOPS=491, BW=123MiB/s (129MB/s)(1239MiB/10091msec); 0 zone resets 00:22:53.536 slat (usec): min=18, max=66284, avg=1643.26, stdev=3929.05 00:22:53.536 clat (usec): min=1181, max=348595, avg=128591.73, stdev=54167.02 00:22:53.536 lat (usec): min=1267, max=348630, avg=130234.99, stdev=54899.37 00:22:53.536 clat percentiles (msec): 00:22:53.536 | 1.00th=[ 9], 5.00th=[ 31], 10.00th=[ 72], 20.00th=[ 92], 00:22:53.536 | 30.00th=[ 104], 40.00th=[ 111], 50.00th=[ 120], 60.00th=[ 140], 00:22:53.536 | 70.00th=[ 157], 80.00th=[ 169], 90.00th=[ 188], 95.00th=[ 224], 00:22:53.536 | 99.00th=[ 288], 99.50th=[ 300], 99.90th=[ 330], 99.95th=[ 347], 00:22:53.536 | 99.99th=[ 351] 00:22:53.536 bw ( KiB/s): min=60295, max=209314, per=8.74%, avg=125301.25, stdev=36162.96, samples=20 00:22:53.536 iops : min= 235, max= 817, avg=489.40, stdev=141.23, samples=20 00:22:53.536 lat (msec) : 2=0.08%, 4=0.18%, 10=1.01%, 20=2.04%, 50=3.65% 00:22:53.536 lat (msec) : 100=18.74%, 250=70.93%, 500=3.37% 00:22:53.536 cpu : usr=1.64%, sys=1.64%, ctx=2140, majf=0, minf=1 00:22:53.536 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.7% 00:22:53.536 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:53.536 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:53.536 issued rwts: total=0,4957,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:53.536 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:53.536 job4: (groupid=0, jobs=1): err= 0: pid=1191181: Wed Nov 20 01:24:00 2024 00:22:53.536 write: IOPS=394, BW=98.5MiB/s (103MB/s)(1007MiB/10222msec); 0 zone resets 00:22:53.536 slat (usec): min=25, max=51779, avg=1751.80, stdev=4518.25 00:22:53.536 clat (usec): min=1347, max=533904, avg=160506.68, stdev=73978.45 00:22:53.536 lat (usec): min=1933, max=533938, avg=162258.48, stdev=75031.47 00:22:53.536 clat percentiles (msec): 00:22:53.536 | 1.00th=[ 5], 5.00th=[ 39], 10.00th=[ 57], 20.00th=[ 104], 00:22:53.536 | 30.00th=[ 132], 40.00th=[ 146], 50.00th=[ 163], 60.00th=[ 178], 00:22:53.536 | 70.00th=[ 192], 80.00th=[ 211], 90.00th=[ 251], 95.00th=[ 279], 00:22:53.536 | 99.00th=[ 347], 99.50th=[ 443], 99.90th=[ 518], 99.95th=[ 518], 00:22:53.536 | 99.99th=[ 535] 00:22:53.536 bw ( KiB/s): min=53248, max=151552, per=7.08%, avg=101529.60, stdev=30657.10, samples=20 00:22:53.536 iops : min= 208, max= 592, avg=396.60, stdev=119.75, samples=20 00:22:53.536 lat (msec) : 2=0.07%, 4=0.62%, 10=0.94%, 20=0.74%, 50=5.53% 00:22:53.536 lat (msec) : 100=11.37%, 250=71.08%, 500=9.48%, 750=0.15% 00:22:53.536 cpu : usr=1.34%, sys=1.37%, ctx=2193, majf=0, minf=1 00:22:53.536 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.4% 00:22:53.536 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:53.536 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:53.536 issued rwts: total=0,4029,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:53.536 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:53.536 job5: (groupid=0, jobs=1): err= 0: pid=1191182: Wed Nov 20 01:24:00 2024 00:22:53.536 write: IOPS=606, BW=152MiB/s (159MB/s)(1553MiB/10242msec); 0 zone resets 00:22:53.536 slat (usec): min=20, max=61559, avg=1333.97, stdev=3369.58 00:22:53.536 clat (msec): min=3, max=416, avg=103.91, stdev=71.34 00:22:53.536 lat (msec): min=3, max=416, avg=105.24, stdev=72.12 00:22:53.536 clat percentiles (msec): 00:22:53.536 | 1.00th=[ 5], 5.00th=[ 23], 10.00th=[ 40], 20.00th=[ 42], 00:22:53.536 | 30.00th=[ 53], 40.00th=[ 74], 50.00th=[ 92], 60.00th=[ 109], 00:22:53.536 | 70.00th=[ 125], 80.00th=[ 148], 90.00th=[ 194], 95.00th=[ 264], 00:22:53.536 | 99.00th=[ 338], 99.50th=[ 359], 99.90th=[ 405], 99.95th=[ 409], 00:22:53.536 | 99.99th=[ 418] 00:22:53.536 bw ( KiB/s): min=53141, max=348160, per=10.98%, avg=157434.65, stdev=80030.25, samples=20 00:22:53.536 iops : min= 207, max= 1360, avg=614.95, stdev=312.66, samples=20 00:22:53.536 lat (msec) : 4=0.53%, 10=1.21%, 20=2.62%, 50=22.21%, 100=27.15% 00:22:53.536 lat (msec) : 250=40.38%, 500=5.89% 00:22:53.536 cpu : usr=2.09%, sys=2.08%, ctx=2514, majf=0, minf=1 00:22:53.536 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:22:53.537 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:53.537 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:53.537 issued rwts: total=0,6213,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:53.537 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:53.537 job6: (groupid=0, jobs=1): err= 0: pid=1191183: Wed Nov 20 01:24:00 2024 00:22:53.537 write: IOPS=420, BW=105MiB/s (110MB/s)(1074MiB/10207msec); 0 zone resets 00:22:53.537 slat (usec): min=16, max=85866, avg=1913.96, stdev=4900.85 00:22:53.537 clat (usec): min=1010, max=384666, avg=150016.66, stdev=75531.38 00:22:53.537 lat (usec): min=1034, max=384739, avg=151930.62, stdev=76465.42 00:22:53.537 clat percentiles (msec): 00:22:53.537 | 1.00th=[ 8], 5.00th=[ 19], 10.00th=[ 39], 20.00th=[ 86], 00:22:53.537 | 30.00th=[ 116], 40.00th=[ 140], 50.00th=[ 159], 60.00th=[ 171], 00:22:53.537 | 70.00th=[ 184], 80.00th=[ 205], 90.00th=[ 247], 95.00th=[ 268], 00:22:53.537 | 99.00th=[ 347], 99.50th=[ 368], 99.90th=[ 384], 99.95th=[ 384], 00:22:53.537 | 99.99th=[ 384] 00:22:53.537 bw ( KiB/s): min=54674, max=204184, per=7.56%, avg=108405.30, stdev=40930.48, samples=20 00:22:53.537 iops : min= 213, max= 797, avg=423.40, stdev=159.85, samples=20 00:22:53.537 lat (msec) : 2=0.07%, 4=0.28%, 10=1.47%, 20=3.47%, 50=8.22% 00:22:53.537 lat (msec) : 100=10.08%, 250=68.42%, 500=8.01% 00:22:53.537 cpu : usr=1.38%, sys=1.39%, ctx=1911, majf=0, minf=1 00:22:53.537 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.5% 00:22:53.537 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:53.537 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:53.537 issued rwts: total=0,4297,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:53.537 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:53.537 job7: (groupid=0, jobs=1): err= 0: pid=1191186: Wed Nov 20 01:24:00 2024 00:22:53.537 write: IOPS=494, BW=124MiB/s (130MB/s)(1245MiB/10067msec); 0 zone resets 00:22:53.537 slat (usec): min=26, max=86270, avg=1339.44, stdev=3949.13 00:22:53.537 clat (usec): min=1336, max=359226, avg=127915.28, stdev=71302.70 00:22:53.537 lat (usec): min=1932, max=363160, avg=129254.72, stdev=72262.79 00:22:53.537 clat percentiles (msec): 00:22:53.537 | 1.00th=[ 7], 5.00th=[ 19], 10.00th=[ 29], 20.00th=[ 68], 00:22:53.537 | 30.00th=[ 88], 40.00th=[ 109], 50.00th=[ 121], 60.00th=[ 138], 00:22:53.537 | 70.00th=[ 165], 80.00th=[ 192], 90.00th=[ 228], 95.00th=[ 251], 00:22:53.537 | 99.00th=[ 309], 99.50th=[ 317], 99.90th=[ 351], 99.95th=[ 355], 00:22:53.537 | 99.99th=[ 359] 00:22:53.537 bw ( KiB/s): min=59273, max=271360, per=8.78%, avg=125902.60, stdev=50622.42, samples=20 00:22:53.537 iops : min= 231, max= 1060, avg=491.75, stdev=197.81, samples=20 00:22:53.537 lat (msec) : 2=0.04%, 4=0.34%, 10=1.55%, 20=4.24%, 50=9.90% 00:22:53.537 lat (msec) : 100=18.51%, 250=60.25%, 500=5.18% 00:22:53.537 cpu : usr=1.51%, sys=2.17%, ctx=2907, majf=0, minf=1 00:22:53.537 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.7% 00:22:53.537 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:53.537 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:53.537 issued rwts: total=0,4981,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:53.537 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:53.537 job8: (groupid=0, jobs=1): err= 0: pid=1191189: Wed Nov 20 01:24:00 2024 00:22:53.537 write: IOPS=631, BW=158MiB/s (165MB/s)(1615MiB/10230msec); 0 zone resets 00:22:53.537 slat (usec): min=18, max=82964, avg=1160.53, stdev=2952.48 00:22:53.537 clat (usec): min=1139, max=444999, avg=100168.65, stdev=56840.83 00:22:53.537 lat (usec): min=1184, max=445038, avg=101329.18, stdev=57317.76 00:22:53.537 clat percentiles (msec): 00:22:53.537 | 1.00th=[ 8], 5.00th=[ 24], 10.00th=[ 42], 20.00th=[ 50], 00:22:53.537 | 30.00th=[ 73], 40.00th=[ 81], 50.00th=[ 94], 60.00th=[ 111], 00:22:53.537 | 70.00th=[ 118], 80.00th=[ 134], 90.00th=[ 169], 95.00th=[ 199], 00:22:53.537 | 99.00th=[ 309], 99.50th=[ 368], 99.90th=[ 418], 99.95th=[ 439], 00:22:53.537 | 99.99th=[ 447] 00:22:53.537 bw ( KiB/s): min=76800, max=352768, per=11.41%, avg=163686.40, stdev=61317.74, samples=20 00:22:53.537 iops : min= 300, max= 1378, avg=639.40, stdev=239.52, samples=20 00:22:53.537 lat (msec) : 2=0.09%, 4=0.20%, 10=1.32%, 20=2.65%, 50=16.57% 00:22:53.537 lat (msec) : 100=31.14%, 250=46.22%, 500=1.81% 00:22:53.537 cpu : usr=2.05%, sys=2.22%, ctx=2987, majf=0, minf=1 00:22:53.537 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:22:53.537 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:53.537 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:53.537 issued rwts: total=0,6458,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:53.537 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:53.537 job9: (groupid=0, jobs=1): err= 0: pid=1191191: Wed Nov 20 01:24:00 2024 00:22:53.537 write: IOPS=508, BW=127MiB/s (133MB/s)(1300MiB/10216msec); 0 zone resets 00:22:53.537 slat (usec): min=16, max=73222, avg=1359.24, stdev=3742.94 00:22:53.537 clat (usec): min=902, max=324088, avg=124324.37, stdev=71368.82 00:22:53.537 lat (usec): min=942, max=327726, avg=125683.61, stdev=72308.62 00:22:53.537 clat percentiles (msec): 00:22:53.537 | 1.00th=[ 4], 5.00th=[ 13], 10.00th=[ 26], 20.00th=[ 60], 00:22:53.537 | 30.00th=[ 79], 40.00th=[ 96], 50.00th=[ 120], 60.00th=[ 148], 00:22:53.537 | 70.00th=[ 167], 80.00th=[ 188], 90.00th=[ 224], 95.00th=[ 247], 00:22:53.537 | 99.00th=[ 288], 99.50th=[ 305], 99.90th=[ 317], 99.95th=[ 321], 00:22:53.537 | 99.99th=[ 326] 00:22:53.537 bw ( KiB/s): min=65536, max=214016, per=9.17%, avg=131481.60, stdev=43359.64, samples=20 00:22:53.537 iops : min= 256, max= 836, avg=513.60, stdev=169.37, samples=20 00:22:53.537 lat (usec) : 1000=0.06% 00:22:53.537 lat (msec) : 2=0.21%, 4=0.98%, 10=2.94%, 20=4.17%, 50=8.77% 00:22:53.537 lat (msec) : 100=24.24%, 250=55.30%, 500=3.33% 00:22:53.537 cpu : usr=1.54%, sys=1.75%, ctx=2953, majf=0, minf=1 00:22:53.537 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:22:53.537 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:53.537 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:53.537 issued rwts: total=0,5199,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:53.537 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:53.537 job10: (groupid=0, jobs=1): err= 0: pid=1191192: Wed Nov 20 01:24:00 2024 00:22:53.537 write: IOPS=502, BW=126MiB/s (132MB/s)(1282MiB/10195msec); 0 zone resets 00:22:53.537 slat (usec): min=17, max=30670, avg=1312.41, stdev=3459.24 00:22:53.537 clat (usec): min=955, max=393795, avg=125856.70, stdev=63519.84 00:22:53.537 lat (usec): min=990, max=393833, avg=127169.11, stdev=64272.07 00:22:53.537 clat percentiles (msec): 00:22:53.537 | 1.00th=[ 4], 5.00th=[ 20], 10.00th=[ 41], 20.00th=[ 62], 00:22:53.537 | 30.00th=[ 99], 40.00th=[ 113], 50.00th=[ 129], 60.00th=[ 144], 00:22:53.537 | 70.00th=[ 161], 80.00th=[ 180], 90.00th=[ 207], 95.00th=[ 224], 00:22:53.537 | 99.00th=[ 262], 99.50th=[ 338], 99.90th=[ 384], 99.95th=[ 388], 00:22:53.537 | 99.99th=[ 393] 00:22:53.537 bw ( KiB/s): min=75776, max=228407, per=9.04%, avg=129641.15, stdev=35556.83, samples=20 00:22:53.537 iops : min= 296, max= 892, avg=506.40, stdev=138.86, samples=20 00:22:53.537 lat (usec) : 1000=0.02% 00:22:53.537 lat (msec) : 2=0.25%, 4=0.90%, 10=1.58%, 20=2.38%, 50=10.22% 00:22:53.537 lat (msec) : 100=15.21%, 250=67.80%, 500=1.64% 00:22:53.537 cpu : usr=1.37%, sys=1.85%, ctx=2869, majf=0, minf=1 00:22:53.537 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:22:53.537 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:53.537 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:53.537 issued rwts: total=0,5128,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:53.537 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:53.537 00:22:53.537 Run status group 0 (all jobs): 00:22:53.537 WRITE: bw=1401MiB/s (1469MB/s), 98.5MiB/s-158MiB/s (103MB/s-165MB/s), io=14.0GiB (15.0GB), run=10067-10242msec 00:22:53.537 00:22:53.537 Disk stats (read/write): 00:22:53.537 nvme0n1: ios=49/10606, merge=0/0, ticks=29/1204486, in_queue=1204515, util=97.20% 00:22:53.537 nvme10n1: ios=48/10726, merge=0/0, ticks=2214/1235205, in_queue=1237419, util=99.96% 00:22:53.537 nvme1n1: ios=0/10270, merge=0/0, ticks=0/1209775, in_queue=1209775, util=97.53% 00:22:53.537 nvme2n1: ios=44/9743, merge=0/0, ticks=2216/1208818, in_queue=1211034, util=100.00% 00:22:53.537 nvme3n1: ios=45/8016, merge=0/0, ticks=599/1241804, in_queue=1242403, util=99.99% 00:22:53.537 nvme4n1: ios=50/12353, merge=0/0, ticks=1258/1227299, in_queue=1228557, util=100.00% 00:22:53.537 nvme5n1: ios=42/8573, merge=0/0, ticks=1434/1226243, in_queue=1227677, util=100.00% 00:22:53.537 nvme6n1: ios=25/9786, merge=0/0, ticks=230/1221219, in_queue=1221449, util=100.00% 00:22:53.537 nvme7n1: ios=0/12859, merge=0/0, ticks=0/1237204, in_queue=1237204, util=98.79% 00:22:53.537 nvme8n1: ios=0/10363, merge=0/0, ticks=0/1242434, in_queue=1242434, util=98.97% 00:22:53.538 nvme9n1: ios=0/10243, merge=0/0, ticks=0/1244841, in_queue=1244841, util=99.14% 00:22:53.538 01:24:00 -- target/multiconnection.sh@36 -- # sync 00:22:53.538 01:24:00 -- target/multiconnection.sh@37 -- # seq 1 11 00:22:53.538 01:24:00 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:53.538 01:24:00 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:22:53.538 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:22:53.538 01:24:01 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK1 00:22:53.538 01:24:01 -- common/autotest_common.sh@1208 -- # local i=0 00:22:53.538 01:24:01 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:22:53.538 01:24:01 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK1 00:22:53.538 01:24:01 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:22:53.538 01:24:01 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK1 00:22:53.538 01:24:01 -- common/autotest_common.sh@1220 -- # return 0 00:22:53.538 01:24:01 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:53.538 01:24:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:53.538 01:24:01 -- common/autotest_common.sh@10 -- # set +x 00:22:53.538 01:24:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:53.538 01:24:01 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:53.538 01:24:01 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:22:53.538 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:22:53.538 01:24:01 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK2 00:22:53.538 01:24:01 -- common/autotest_common.sh@1208 -- # local i=0 00:22:53.538 01:24:01 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:22:53.538 01:24:01 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK2 00:22:53.538 01:24:01 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:22:53.538 01:24:01 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK2 00:22:53.538 01:24:01 -- common/autotest_common.sh@1220 -- # return 0 00:22:53.538 01:24:01 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:22:53.538 01:24:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:53.538 01:24:01 -- common/autotest_common.sh@10 -- # set +x 00:22:53.538 01:24:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:53.538 01:24:01 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:53.538 01:24:01 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:22:53.538 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:22:53.538 01:24:01 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK3 00:22:53.538 01:24:01 -- common/autotest_common.sh@1208 -- # local i=0 00:22:53.538 01:24:01 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:22:53.538 01:24:01 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK3 00:22:53.538 01:24:01 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:22:53.538 01:24:01 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK3 00:22:53.538 01:24:01 -- common/autotest_common.sh@1220 -- # return 0 00:22:53.538 01:24:01 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:22:53.538 01:24:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:53.538 01:24:01 -- common/autotest_common.sh@10 -- # set +x 00:22:53.538 01:24:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:53.538 01:24:01 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:53.538 01:24:01 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:22:53.797 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:22:53.797 01:24:01 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK4 00:22:53.797 01:24:01 -- common/autotest_common.sh@1208 -- # local i=0 00:22:53.797 01:24:01 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:22:53.797 01:24:01 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK4 00:22:53.797 01:24:02 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:22:53.797 01:24:02 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK4 00:22:54.056 01:24:02 -- common/autotest_common.sh@1220 -- # return 0 00:22:54.056 01:24:02 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:22:54.056 01:24:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:54.056 01:24:02 -- common/autotest_common.sh@10 -- # set +x 00:22:54.056 01:24:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:54.056 01:24:02 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:54.056 01:24:02 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:22:54.314 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:22:54.314 01:24:02 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK5 00:22:54.314 01:24:02 -- common/autotest_common.sh@1208 -- # local i=0 00:22:54.314 01:24:02 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:22:54.314 01:24:02 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK5 00:22:54.314 01:24:02 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:22:54.314 01:24:02 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK5 00:22:54.314 01:24:02 -- common/autotest_common.sh@1220 -- # return 0 00:22:54.314 01:24:02 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:22:54.314 01:24:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:54.314 01:24:02 -- common/autotest_common.sh@10 -- # set +x 00:22:54.314 01:24:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:54.314 01:24:02 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:54.314 01:24:02 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode6 00:22:54.314 NQN:nqn.2016-06.io.spdk:cnode6 disconnected 1 controller(s) 00:22:54.314 01:24:02 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK6 00:22:54.315 01:24:02 -- common/autotest_common.sh@1208 -- # local i=0 00:22:54.315 01:24:02 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:22:54.315 01:24:02 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK6 00:22:54.315 01:24:02 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:22:54.315 01:24:02 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK6 00:22:54.315 01:24:02 -- common/autotest_common.sh@1220 -- # return 0 00:22:54.315 01:24:02 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode6 00:22:54.315 01:24:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:54.315 01:24:02 -- common/autotest_common.sh@10 -- # set +x 00:22:54.315 01:24:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:54.315 01:24:02 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:54.315 01:24:02 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode7 00:22:54.573 NQN:nqn.2016-06.io.spdk:cnode7 disconnected 1 controller(s) 00:22:54.573 01:24:02 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK7 00:22:54.573 01:24:02 -- common/autotest_common.sh@1208 -- # local i=0 00:22:54.573 01:24:02 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:22:54.573 01:24:02 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK7 00:22:54.573 01:24:02 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:22:54.573 01:24:02 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK7 00:22:54.573 01:24:02 -- common/autotest_common.sh@1220 -- # return 0 00:22:54.573 01:24:02 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode7 00:22:54.573 01:24:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:54.573 01:24:02 -- common/autotest_common.sh@10 -- # set +x 00:22:54.573 01:24:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:54.573 01:24:02 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:54.573 01:24:02 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode8 00:22:54.573 NQN:nqn.2016-06.io.spdk:cnode8 disconnected 1 controller(s) 00:22:54.573 01:24:02 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK8 00:22:54.573 01:24:02 -- common/autotest_common.sh@1208 -- # local i=0 00:22:54.573 01:24:02 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:22:54.573 01:24:02 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK8 00:22:54.573 01:24:02 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:22:54.573 01:24:02 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK8 00:22:54.573 01:24:02 -- common/autotest_common.sh@1220 -- # return 0 00:22:54.573 01:24:02 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode8 00:22:54.573 01:24:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:54.573 01:24:02 -- common/autotest_common.sh@10 -- # set +x 00:22:54.573 01:24:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:54.573 01:24:02 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:54.573 01:24:02 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode9 00:22:54.832 NQN:nqn.2016-06.io.spdk:cnode9 disconnected 1 controller(s) 00:22:54.832 01:24:02 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK9 00:22:54.832 01:24:02 -- common/autotest_common.sh@1208 -- # local i=0 00:22:54.832 01:24:02 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:22:54.832 01:24:02 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK9 00:22:54.832 01:24:02 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:22:54.832 01:24:02 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK9 00:22:54.832 01:24:02 -- common/autotest_common.sh@1220 -- # return 0 00:22:54.832 01:24:02 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode9 00:22:54.833 01:24:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:54.833 01:24:02 -- common/autotest_common.sh@10 -- # set +x 00:22:54.833 01:24:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:54.833 01:24:02 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:54.833 01:24:02 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode10 00:22:55.092 NQN:nqn.2016-06.io.spdk:cnode10 disconnected 1 controller(s) 00:22:55.092 01:24:03 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK10 00:22:55.092 01:24:03 -- common/autotest_common.sh@1208 -- # local i=0 00:22:55.092 01:24:03 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:22:55.092 01:24:03 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK10 00:22:55.092 01:24:03 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:22:55.092 01:24:03 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK10 00:22:55.092 01:24:03 -- common/autotest_common.sh@1220 -- # return 0 00:22:55.092 01:24:03 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode10 00:22:55.092 01:24:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:55.092 01:24:03 -- common/autotest_common.sh@10 -- # set +x 00:22:55.092 01:24:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:55.092 01:24:03 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:55.092 01:24:03 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode11 00:22:55.092 NQN:nqn.2016-06.io.spdk:cnode11 disconnected 1 controller(s) 00:22:55.092 01:24:03 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK11 00:22:55.092 01:24:03 -- common/autotest_common.sh@1208 -- # local i=0 00:22:55.092 01:24:03 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:22:55.092 01:24:03 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK11 00:22:55.092 01:24:03 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:22:55.092 01:24:03 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK11 00:22:55.092 01:24:03 -- common/autotest_common.sh@1220 -- # return 0 00:22:55.092 01:24:03 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode11 00:22:55.092 01:24:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:55.092 01:24:03 -- common/autotest_common.sh@10 -- # set +x 00:22:55.092 01:24:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:55.092 01:24:03 -- target/multiconnection.sh@43 -- # rm -f ./local-job0-0-verify.state 00:22:55.092 01:24:03 -- target/multiconnection.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:22:55.092 01:24:03 -- target/multiconnection.sh@47 -- # nvmftestfini 00:22:55.092 01:24:03 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:55.092 01:24:03 -- nvmf/common.sh@116 -- # sync 00:22:55.092 01:24:03 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:55.092 01:24:03 -- nvmf/common.sh@119 -- # set +e 00:22:55.092 01:24:03 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:55.092 01:24:03 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:55.092 rmmod nvme_tcp 00:22:55.092 rmmod nvme_fabrics 00:22:55.092 rmmod nvme_keyring 00:22:55.092 01:24:03 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:55.092 01:24:03 -- nvmf/common.sh@123 -- # set -e 00:22:55.092 01:24:03 -- nvmf/common.sh@124 -- # return 0 00:22:55.092 01:24:03 -- nvmf/common.sh@477 -- # '[' -n 1185458 ']' 00:22:55.092 01:24:03 -- nvmf/common.sh@478 -- # killprocess 1185458 00:22:55.092 01:24:03 -- common/autotest_common.sh@936 -- # '[' -z 1185458 ']' 00:22:55.092 01:24:03 -- common/autotest_common.sh@940 -- # kill -0 1185458 00:22:55.092 01:24:03 -- common/autotest_common.sh@941 -- # uname 00:22:55.092 01:24:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:55.092 01:24:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1185458 00:22:55.092 01:24:03 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:55.092 01:24:03 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:55.092 01:24:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1185458' 00:22:55.092 killing process with pid 1185458 00:22:55.092 01:24:03 -- common/autotest_common.sh@955 -- # kill 1185458 00:22:55.092 01:24:03 -- common/autotest_common.sh@960 -- # wait 1185458 00:22:55.661 01:24:03 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:55.661 01:24:03 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:55.661 01:24:03 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:55.661 01:24:03 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:55.661 01:24:03 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:55.661 01:24:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:55.661 01:24:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:55.661 01:24:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:58.205 01:24:05 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:58.205 00:22:58.205 real 1m1.790s 00:22:58.205 user 3m25.795s 00:22:58.205 sys 0m26.754s 00:22:58.205 01:24:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:58.205 01:24:05 -- common/autotest_common.sh@10 -- # set +x 00:22:58.205 ************************************ 00:22:58.205 END TEST nvmf_multiconnection 00:22:58.205 ************************************ 00:22:58.205 01:24:05 -- nvmf/nvmf.sh@66 -- # run_test nvmf_initiator_timeout /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:22:58.205 01:24:05 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:58.205 01:24:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:58.205 01:24:05 -- common/autotest_common.sh@10 -- # set +x 00:22:58.205 ************************************ 00:22:58.205 START TEST nvmf_initiator_timeout 00:22:58.205 ************************************ 00:22:58.205 01:24:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:22:58.205 * Looking for test storage... 00:22:58.205 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:22:58.205 01:24:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:58.205 01:24:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:58.205 01:24:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:58.205 01:24:06 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:58.205 01:24:06 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:58.205 01:24:06 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:58.205 01:24:06 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:58.205 01:24:06 -- scripts/common.sh@335 -- # IFS=.-: 00:22:58.205 01:24:06 -- scripts/common.sh@335 -- # read -ra ver1 00:22:58.205 01:24:06 -- scripts/common.sh@336 -- # IFS=.-: 00:22:58.205 01:24:06 -- scripts/common.sh@336 -- # read -ra ver2 00:22:58.205 01:24:06 -- scripts/common.sh@337 -- # local 'op=<' 00:22:58.205 01:24:06 -- scripts/common.sh@339 -- # ver1_l=2 00:22:58.205 01:24:06 -- scripts/common.sh@340 -- # ver2_l=1 00:22:58.205 01:24:06 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:58.205 01:24:06 -- scripts/common.sh@343 -- # case "$op" in 00:22:58.205 01:24:06 -- scripts/common.sh@344 -- # : 1 00:22:58.205 01:24:06 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:58.205 01:24:06 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:58.205 01:24:06 -- scripts/common.sh@364 -- # decimal 1 00:22:58.205 01:24:06 -- scripts/common.sh@352 -- # local d=1 00:22:58.205 01:24:06 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:58.205 01:24:06 -- scripts/common.sh@354 -- # echo 1 00:22:58.205 01:24:06 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:58.205 01:24:06 -- scripts/common.sh@365 -- # decimal 2 00:22:58.205 01:24:06 -- scripts/common.sh@352 -- # local d=2 00:22:58.205 01:24:06 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:58.205 01:24:06 -- scripts/common.sh@354 -- # echo 2 00:22:58.205 01:24:06 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:58.205 01:24:06 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:58.205 01:24:06 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:58.205 01:24:06 -- scripts/common.sh@367 -- # return 0 00:22:58.205 01:24:06 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:58.205 01:24:06 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:58.205 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:58.205 --rc genhtml_branch_coverage=1 00:22:58.205 --rc genhtml_function_coverage=1 00:22:58.205 --rc genhtml_legend=1 00:22:58.205 --rc geninfo_all_blocks=1 00:22:58.205 --rc geninfo_unexecuted_blocks=1 00:22:58.205 00:22:58.205 ' 00:22:58.205 01:24:06 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:58.205 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:58.205 --rc genhtml_branch_coverage=1 00:22:58.205 --rc genhtml_function_coverage=1 00:22:58.205 --rc genhtml_legend=1 00:22:58.205 --rc geninfo_all_blocks=1 00:22:58.205 --rc geninfo_unexecuted_blocks=1 00:22:58.205 00:22:58.205 ' 00:22:58.205 01:24:06 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:58.205 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:58.205 --rc genhtml_branch_coverage=1 00:22:58.205 --rc genhtml_function_coverage=1 00:22:58.205 --rc genhtml_legend=1 00:22:58.205 --rc geninfo_all_blocks=1 00:22:58.205 --rc geninfo_unexecuted_blocks=1 00:22:58.205 00:22:58.205 ' 00:22:58.205 01:24:06 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:58.205 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:58.205 --rc genhtml_branch_coverage=1 00:22:58.205 --rc genhtml_function_coverage=1 00:22:58.205 --rc genhtml_legend=1 00:22:58.205 --rc geninfo_all_blocks=1 00:22:58.205 --rc geninfo_unexecuted_blocks=1 00:22:58.205 00:22:58.205 ' 00:22:58.205 01:24:06 -- target/initiator_timeout.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:58.205 01:24:06 -- nvmf/common.sh@7 -- # uname -s 00:22:58.205 01:24:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:58.205 01:24:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:58.205 01:24:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:58.205 01:24:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:58.205 01:24:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:58.205 01:24:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:58.205 01:24:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:58.205 01:24:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:58.205 01:24:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:58.205 01:24:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:58.205 01:24:06 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:58.205 01:24:06 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:58.205 01:24:06 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:58.205 01:24:06 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:58.205 01:24:06 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:58.205 01:24:06 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:58.205 01:24:06 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:58.205 01:24:06 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:58.205 01:24:06 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:58.205 01:24:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:58.205 01:24:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:58.206 01:24:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:58.206 01:24:06 -- paths/export.sh@5 -- # export PATH 00:22:58.206 01:24:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:58.206 01:24:06 -- nvmf/common.sh@46 -- # : 0 00:22:58.206 01:24:06 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:58.206 01:24:06 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:58.206 01:24:06 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:58.206 01:24:06 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:58.206 01:24:06 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:58.206 01:24:06 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:58.206 01:24:06 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:58.206 01:24:06 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:58.206 01:24:06 -- target/initiator_timeout.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:58.206 01:24:06 -- target/initiator_timeout.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:58.206 01:24:06 -- target/initiator_timeout.sh@14 -- # nvmftestinit 00:22:58.206 01:24:06 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:58.206 01:24:06 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:58.206 01:24:06 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:58.206 01:24:06 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:58.206 01:24:06 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:58.206 01:24:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:58.206 01:24:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:58.206 01:24:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:58.206 01:24:06 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:58.206 01:24:06 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:58.206 01:24:06 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:58.206 01:24:06 -- common/autotest_common.sh@10 -- # set +x 00:23:00.114 01:24:08 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:00.114 01:24:08 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:00.114 01:24:08 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:00.114 01:24:08 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:00.114 01:24:08 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:00.114 01:24:08 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:00.114 01:24:08 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:00.114 01:24:08 -- nvmf/common.sh@294 -- # net_devs=() 00:23:00.114 01:24:08 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:00.114 01:24:08 -- nvmf/common.sh@295 -- # e810=() 00:23:00.114 01:24:08 -- nvmf/common.sh@295 -- # local -ga e810 00:23:00.114 01:24:08 -- nvmf/common.sh@296 -- # x722=() 00:23:00.114 01:24:08 -- nvmf/common.sh@296 -- # local -ga x722 00:23:00.114 01:24:08 -- nvmf/common.sh@297 -- # mlx=() 00:23:00.114 01:24:08 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:00.114 01:24:08 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:00.114 01:24:08 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:00.114 01:24:08 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:00.114 01:24:08 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:00.114 01:24:08 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:00.114 01:24:08 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:00.114 01:24:08 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:00.114 01:24:08 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:00.114 01:24:08 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:00.114 01:24:08 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:00.114 01:24:08 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:00.114 01:24:08 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:00.114 01:24:08 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:00.114 01:24:08 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:00.114 01:24:08 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:00.114 01:24:08 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:00.114 01:24:08 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:00.114 01:24:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:00.114 01:24:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:00.114 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:00.114 01:24:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:00.114 01:24:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:00.114 01:24:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:00.114 01:24:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:00.114 01:24:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:00.114 01:24:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:00.114 01:24:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:00.114 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:00.114 01:24:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:00.114 01:24:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:00.114 01:24:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:00.114 01:24:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:00.114 01:24:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:00.114 01:24:08 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:00.114 01:24:08 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:00.114 01:24:08 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:00.114 01:24:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:00.114 01:24:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:00.114 01:24:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:00.114 01:24:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:00.114 01:24:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:00.114 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:00.114 01:24:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:00.114 01:24:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:00.114 01:24:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:00.114 01:24:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:00.114 01:24:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:00.114 01:24:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:00.114 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:00.114 01:24:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:00.114 01:24:08 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:00.114 01:24:08 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:00.114 01:24:08 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:00.114 01:24:08 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:00.114 01:24:08 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:00.114 01:24:08 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:00.114 01:24:08 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:00.114 01:24:08 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:00.114 01:24:08 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:00.114 01:24:08 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:00.114 01:24:08 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:00.114 01:24:08 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:00.114 01:24:08 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:00.114 01:24:08 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:00.114 01:24:08 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:00.114 01:24:08 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:00.114 01:24:08 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:00.114 01:24:08 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:00.114 01:24:08 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:00.114 01:24:08 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:00.114 01:24:08 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:00.114 01:24:08 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:00.114 01:24:08 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:00.114 01:24:08 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:00.114 01:24:08 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:00.114 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:00.115 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.256 ms 00:23:00.115 00:23:00.115 --- 10.0.0.2 ping statistics --- 00:23:00.115 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:00.115 rtt min/avg/max/mdev = 0.256/0.256/0.256/0.000 ms 00:23:00.115 01:24:08 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:00.115 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:00.115 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.101 ms 00:23:00.115 00:23:00.115 --- 10.0.0.1 ping statistics --- 00:23:00.115 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:00.115 rtt min/avg/max/mdev = 0.101/0.101/0.101/0.000 ms 00:23:00.115 01:24:08 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:00.115 01:24:08 -- nvmf/common.sh@410 -- # return 0 00:23:00.115 01:24:08 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:00.115 01:24:08 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:00.115 01:24:08 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:00.115 01:24:08 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:00.115 01:24:08 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:00.115 01:24:08 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:00.115 01:24:08 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:00.115 01:24:08 -- target/initiator_timeout.sh@15 -- # nvmfappstart -m 0xF 00:23:00.115 01:24:08 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:00.115 01:24:08 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:00.115 01:24:08 -- common/autotest_common.sh@10 -- # set +x 00:23:00.115 01:24:08 -- nvmf/common.sh@469 -- # nvmfpid=1195232 00:23:00.115 01:24:08 -- nvmf/common.sh@470 -- # waitforlisten 1195232 00:23:00.115 01:24:08 -- common/autotest_common.sh@829 -- # '[' -z 1195232 ']' 00:23:00.115 01:24:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:00.115 01:24:08 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:00.115 01:24:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:00.115 01:24:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:00.115 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:00.115 01:24:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:00.115 01:24:08 -- common/autotest_common.sh@10 -- # set +x 00:23:00.115 [2024-11-20 01:24:08.233591] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:23:00.115 [2024-11-20 01:24:08.233667] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:00.115 EAL: No free 2048 kB hugepages reported on node 1 00:23:00.115 [2024-11-20 01:24:08.300957] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:00.374 [2024-11-20 01:24:08.396938] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:00.374 [2024-11-20 01:24:08.397093] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:00.374 [2024-11-20 01:24:08.397112] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:00.374 [2024-11-20 01:24:08.397124] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:00.374 [2024-11-20 01:24:08.397185] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:00.374 [2024-11-20 01:24:08.398091] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:00.374 [2024-11-20 01:24:08.398139] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:00.374 [2024-11-20 01:24:08.398144] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:01.310 01:24:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:01.310 01:24:09 -- common/autotest_common.sh@862 -- # return 0 00:23:01.310 01:24:09 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:01.310 01:24:09 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:01.310 01:24:09 -- common/autotest_common.sh@10 -- # set +x 00:23:01.310 01:24:09 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:01.310 01:24:09 -- target/initiator_timeout.sh@17 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:23:01.310 01:24:09 -- target/initiator_timeout.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:23:01.310 01:24:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:01.310 01:24:09 -- common/autotest_common.sh@10 -- # set +x 00:23:01.310 Malloc0 00:23:01.310 01:24:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:01.310 01:24:09 -- target/initiator_timeout.sh@22 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 30 -t 30 -w 30 -n 30 00:23:01.310 01:24:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:01.310 01:24:09 -- common/autotest_common.sh@10 -- # set +x 00:23:01.310 Delay0 00:23:01.310 01:24:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:01.310 01:24:09 -- target/initiator_timeout.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:23:01.310 01:24:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:01.310 01:24:09 -- common/autotest_common.sh@10 -- # set +x 00:23:01.310 [2024-11-20 01:24:09.296908] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:01.310 01:24:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:01.310 01:24:09 -- target/initiator_timeout.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:23:01.310 01:24:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:01.310 01:24:09 -- common/autotest_common.sh@10 -- # set +x 00:23:01.310 01:24:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:01.310 01:24:09 -- target/initiator_timeout.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:23:01.310 01:24:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:01.310 01:24:09 -- common/autotest_common.sh@10 -- # set +x 00:23:01.310 01:24:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:01.310 01:24:09 -- target/initiator_timeout.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:01.310 01:24:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:01.310 01:24:09 -- common/autotest_common.sh@10 -- # set +x 00:23:01.310 [2024-11-20 01:24:09.325201] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:01.310 01:24:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:01.310 01:24:09 -- target/initiator_timeout.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:23:01.877 01:24:09 -- target/initiator_timeout.sh@31 -- # waitforserial SPDKISFASTANDAWESOME 00:23:01.877 01:24:09 -- common/autotest_common.sh@1187 -- # local i=0 00:23:01.877 01:24:09 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:23:01.877 01:24:09 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:23:01.877 01:24:09 -- common/autotest_common.sh@1194 -- # sleep 2 00:23:03.786 01:24:11 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:23:03.786 01:24:11 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:23:03.786 01:24:11 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:23:03.786 01:24:11 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:23:03.786 01:24:11 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:23:03.786 01:24:11 -- common/autotest_common.sh@1197 -- # return 0 00:23:03.786 01:24:11 -- target/initiator_timeout.sh@35 -- # fio_pid=1195947 00:23:03.786 01:24:11 -- target/initiator_timeout.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 60 -v 00:23:03.786 01:24:11 -- target/initiator_timeout.sh@37 -- # sleep 3 00:23:03.786 [global] 00:23:03.786 thread=1 00:23:03.786 invalidate=1 00:23:03.786 rw=write 00:23:03.786 time_based=1 00:23:03.786 runtime=60 00:23:03.786 ioengine=libaio 00:23:03.786 direct=1 00:23:03.786 bs=4096 00:23:03.786 iodepth=1 00:23:03.786 norandommap=0 00:23:03.786 numjobs=1 00:23:03.786 00:23:03.786 verify_dump=1 00:23:03.786 verify_backlog=512 00:23:03.786 verify_state_save=0 00:23:03.786 do_verify=1 00:23:03.786 verify=crc32c-intel 00:23:03.786 [job0] 00:23:03.786 filename=/dev/nvme0n1 00:23:03.786 Could not set queue depth (nvme0n1) 00:23:04.046 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:23:04.046 fio-3.35 00:23:04.046 Starting 1 thread 00:23:07.340 01:24:14 -- target/initiator_timeout.sh@40 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 31000000 00:23:07.340 01:24:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:07.340 01:24:14 -- common/autotest_common.sh@10 -- # set +x 00:23:07.340 true 00:23:07.340 01:24:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:07.340 01:24:14 -- target/initiator_timeout.sh@41 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 31000000 00:23:07.340 01:24:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:07.340 01:24:14 -- common/autotest_common.sh@10 -- # set +x 00:23:07.340 true 00:23:07.340 01:24:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:07.340 01:24:14 -- target/initiator_timeout.sh@42 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 31000000 00:23:07.340 01:24:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:07.340 01:24:14 -- common/autotest_common.sh@10 -- # set +x 00:23:07.340 true 00:23:07.340 01:24:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:07.340 01:24:14 -- target/initiator_timeout.sh@43 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 310000000 00:23:07.340 01:24:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:07.340 01:24:14 -- common/autotest_common.sh@10 -- # set +x 00:23:07.340 true 00:23:07.340 01:24:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:07.340 01:24:14 -- target/initiator_timeout.sh@45 -- # sleep 3 00:23:09.876 01:24:17 -- target/initiator_timeout.sh@48 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 30 00:23:09.876 01:24:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:09.876 01:24:17 -- common/autotest_common.sh@10 -- # set +x 00:23:09.876 true 00:23:09.876 01:24:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:09.876 01:24:17 -- target/initiator_timeout.sh@49 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 30 00:23:09.876 01:24:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:09.876 01:24:17 -- common/autotest_common.sh@10 -- # set +x 00:23:09.876 true 00:23:09.876 01:24:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:09.876 01:24:18 -- target/initiator_timeout.sh@50 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 30 00:23:09.876 01:24:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:09.876 01:24:18 -- common/autotest_common.sh@10 -- # set +x 00:23:09.876 true 00:23:09.876 01:24:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:09.876 01:24:18 -- target/initiator_timeout.sh@51 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 30 00:23:09.876 01:24:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:09.876 01:24:18 -- common/autotest_common.sh@10 -- # set +x 00:23:09.876 true 00:23:09.876 01:24:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:09.876 01:24:18 -- target/initiator_timeout.sh@53 -- # fio_status=0 00:23:09.876 01:24:18 -- target/initiator_timeout.sh@54 -- # wait 1195947 00:24:06.126 00:24:06.126 job0: (groupid=0, jobs=1): err= 0: pid=1196016: Wed Nov 20 01:25:12 2024 00:24:06.126 read: IOPS=24, BW=97.7KiB/s (100kB/s)(5860KiB/60002msec) 00:24:06.126 slat (nsec): min=5017, max=67936, avg=20748.45, stdev=10369.63 00:24:06.126 clat (usec): min=233, max=41314k, avg=40674.43, stdev=1079227.82 00:24:06.126 lat (usec): min=238, max=41314k, avg=40695.18, stdev=1079227.63 00:24:06.126 clat percentiles (usec): 00:24:06.126 | 1.00th=[ 245], 5.00th=[ 255], 10.00th=[ 265], 00:24:06.126 | 20.00th=[ 273], 30.00th=[ 289], 40.00th=[ 310], 00:24:06.126 | 50.00th=[ 334], 60.00th=[ 359], 70.00th=[ 545], 00:24:06.126 | 80.00th=[ 41157], 90.00th=[ 41157], 95.00th=[ 41157], 00:24:06.126 | 99.00th=[ 42206], 99.50th=[ 42206], 99.90th=[ 42730], 00:24:06.126 | 99.95th=[17112761], 99.99th=[17112761] 00:24:06.126 write: IOPS=25, BW=102KiB/s (105kB/s)(6144KiB/60002msec); 0 zone resets 00:24:06.126 slat (usec): min=7, max=29569, avg=34.42, stdev=754.13 00:24:06.126 clat (usec): min=173, max=379, avg=204.64, stdev=23.31 00:24:06.126 lat (usec): min=181, max=29930, avg=239.07, stdev=758.60 00:24:06.126 clat percentiles (usec): 00:24:06.126 | 1.00th=[ 176], 5.00th=[ 182], 10.00th=[ 184], 20.00th=[ 190], 00:24:06.126 | 30.00th=[ 192], 40.00th=[ 196], 50.00th=[ 198], 60.00th=[ 202], 00:24:06.126 | 70.00th=[ 208], 80.00th=[ 217], 90.00th=[ 231], 95.00th=[ 255], 00:24:06.126 | 99.00th=[ 289], 99.50th=[ 302], 99.90th=[ 363], 99.95th=[ 379], 00:24:06.126 | 99.99th=[ 379] 00:24:06.126 bw ( KiB/s): min= 4096, max= 8192, per=100.00%, avg=6144.00, stdev=2896.31, samples=2 00:24:06.126 iops : min= 1024, max= 2048, avg=1536.00, stdev=724.08, samples=2 00:24:06.126 lat (usec) : 250=49.48%, 500=35.59%, 750=0.33% 00:24:06.126 lat (msec) : 50=14.56%, >=2000=0.03% 00:24:06.126 cpu : usr=0.05%, sys=0.11%, ctx=3005, majf=0, minf=1 00:24:06.126 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:24:06.126 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:06.126 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:06.126 issued rwts: total=1465,1536,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:06.126 latency : target=0, window=0, percentile=100.00%, depth=1 00:24:06.126 00:24:06.126 Run status group 0 (all jobs): 00:24:06.126 READ: bw=97.7KiB/s (100kB/s), 97.7KiB/s-97.7KiB/s (100kB/s-100kB/s), io=5860KiB (6001kB), run=60002-60002msec 00:24:06.126 WRITE: bw=102KiB/s (105kB/s), 102KiB/s-102KiB/s (105kB/s-105kB/s), io=6144KiB (6291kB), run=60002-60002msec 00:24:06.126 00:24:06.126 Disk stats (read/write): 00:24:06.126 nvme0n1: ios=1514/1536, merge=0/0, ticks=19537/313, in_queue=19850, util=99.84% 00:24:06.126 01:25:12 -- target/initiator_timeout.sh@56 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:24:06.126 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:24:06.126 01:25:12 -- target/initiator_timeout.sh@57 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:24:06.126 01:25:12 -- common/autotest_common.sh@1208 -- # local i=0 00:24:06.126 01:25:12 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:24:06.126 01:25:12 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:24:06.126 01:25:12 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:24:06.126 01:25:12 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:24:06.126 01:25:12 -- common/autotest_common.sh@1220 -- # return 0 00:24:06.126 01:25:12 -- target/initiator_timeout.sh@59 -- # '[' 0 -eq 0 ']' 00:24:06.126 01:25:12 -- target/initiator_timeout.sh@60 -- # echo 'nvmf hotplug test: fio successful as expected' 00:24:06.126 nvmf hotplug test: fio successful as expected 00:24:06.126 01:25:12 -- target/initiator_timeout.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:24:06.126 01:25:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:06.126 01:25:12 -- common/autotest_common.sh@10 -- # set +x 00:24:06.126 01:25:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:06.126 01:25:12 -- target/initiator_timeout.sh@69 -- # rm -f ./local-job0-0-verify.state 00:24:06.126 01:25:12 -- target/initiator_timeout.sh@71 -- # trap - SIGINT SIGTERM EXIT 00:24:06.127 01:25:12 -- target/initiator_timeout.sh@73 -- # nvmftestfini 00:24:06.127 01:25:12 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:06.127 01:25:12 -- nvmf/common.sh@116 -- # sync 00:24:06.127 01:25:12 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:06.127 01:25:12 -- nvmf/common.sh@119 -- # set +e 00:24:06.127 01:25:12 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:06.127 01:25:12 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:06.127 rmmod nvme_tcp 00:24:06.127 rmmod nvme_fabrics 00:24:06.127 rmmod nvme_keyring 00:24:06.127 01:25:12 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:06.127 01:25:12 -- nvmf/common.sh@123 -- # set -e 00:24:06.127 01:25:12 -- nvmf/common.sh@124 -- # return 0 00:24:06.127 01:25:12 -- nvmf/common.sh@477 -- # '[' -n 1195232 ']' 00:24:06.127 01:25:12 -- nvmf/common.sh@478 -- # killprocess 1195232 00:24:06.127 01:25:12 -- common/autotest_common.sh@936 -- # '[' -z 1195232 ']' 00:24:06.127 01:25:12 -- common/autotest_common.sh@940 -- # kill -0 1195232 00:24:06.127 01:25:12 -- common/autotest_common.sh@941 -- # uname 00:24:06.127 01:25:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:06.127 01:25:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1195232 00:24:06.127 01:25:12 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:06.127 01:25:12 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:06.127 01:25:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1195232' 00:24:06.127 killing process with pid 1195232 00:24:06.127 01:25:12 -- common/autotest_common.sh@955 -- # kill 1195232 00:24:06.127 01:25:12 -- common/autotest_common.sh@960 -- # wait 1195232 00:24:06.127 01:25:12 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:06.127 01:25:12 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:06.127 01:25:12 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:06.127 01:25:12 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:06.127 01:25:12 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:06.127 01:25:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:06.127 01:25:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:06.127 01:25:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:06.694 01:25:14 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:06.694 00:24:06.694 real 1m8.946s 00:24:06.694 user 4m14.081s 00:24:06.694 sys 0m6.320s 00:24:06.694 01:25:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:24:06.694 01:25:14 -- common/autotest_common.sh@10 -- # set +x 00:24:06.694 ************************************ 00:24:06.694 END TEST nvmf_initiator_timeout 00:24:06.694 ************************************ 00:24:06.694 01:25:14 -- nvmf/nvmf.sh@69 -- # [[ phy == phy ]] 00:24:06.694 01:25:14 -- nvmf/nvmf.sh@70 -- # '[' tcp = tcp ']' 00:24:06.694 01:25:14 -- nvmf/nvmf.sh@71 -- # gather_supported_nvmf_pci_devs 00:24:06.695 01:25:14 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:06.695 01:25:14 -- common/autotest_common.sh@10 -- # set +x 00:24:09.235 01:25:16 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:09.235 01:25:16 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:09.235 01:25:16 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:09.235 01:25:16 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:09.235 01:25:16 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:09.235 01:25:16 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:09.235 01:25:16 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:09.235 01:25:16 -- nvmf/common.sh@294 -- # net_devs=() 00:24:09.235 01:25:16 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:09.235 01:25:16 -- nvmf/common.sh@295 -- # e810=() 00:24:09.235 01:25:16 -- nvmf/common.sh@295 -- # local -ga e810 00:24:09.235 01:25:16 -- nvmf/common.sh@296 -- # x722=() 00:24:09.235 01:25:16 -- nvmf/common.sh@296 -- # local -ga x722 00:24:09.235 01:25:16 -- nvmf/common.sh@297 -- # mlx=() 00:24:09.235 01:25:16 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:09.235 01:25:16 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:09.235 01:25:16 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:09.235 01:25:16 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:09.235 01:25:16 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:09.235 01:25:16 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:09.235 01:25:16 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:09.235 01:25:16 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:09.235 01:25:16 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:09.235 01:25:16 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:09.235 01:25:16 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:09.235 01:25:16 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:09.235 01:25:16 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:09.235 01:25:16 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:09.235 01:25:16 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:09.235 01:25:16 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:09.235 01:25:16 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:09.235 01:25:16 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:09.235 01:25:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:09.235 01:25:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:09.235 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:09.235 01:25:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:09.235 01:25:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:09.235 01:25:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:09.235 01:25:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:09.235 01:25:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:09.235 01:25:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:09.235 01:25:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:09.235 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:09.235 01:25:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:09.235 01:25:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:09.235 01:25:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:09.235 01:25:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:09.235 01:25:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:09.235 01:25:16 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:09.235 01:25:16 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:09.235 01:25:16 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:09.235 01:25:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:09.235 01:25:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:09.235 01:25:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:09.235 01:25:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:09.235 01:25:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:09.235 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:09.235 01:25:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:09.235 01:25:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:09.235 01:25:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:09.235 01:25:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:09.235 01:25:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:09.235 01:25:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:09.235 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:09.235 01:25:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:09.235 01:25:16 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:09.235 01:25:16 -- nvmf/nvmf.sh@72 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:09.235 01:25:16 -- nvmf/nvmf.sh@73 -- # (( 2 > 0 )) 00:24:09.235 01:25:16 -- nvmf/nvmf.sh@74 -- # run_test nvmf_perf_adq /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:24:09.235 01:25:16 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:24:09.235 01:25:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:09.235 01:25:16 -- common/autotest_common.sh@10 -- # set +x 00:24:09.235 ************************************ 00:24:09.235 START TEST nvmf_perf_adq 00:24:09.235 ************************************ 00:24:09.235 01:25:16 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:24:09.235 * Looking for test storage... 00:24:09.235 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:24:09.235 01:25:16 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:24:09.235 01:25:16 -- common/autotest_common.sh@1690 -- # lcov --version 00:24:09.235 01:25:16 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:24:09.235 01:25:17 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:24:09.235 01:25:17 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:24:09.235 01:25:17 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:24:09.235 01:25:17 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:24:09.235 01:25:17 -- scripts/common.sh@335 -- # IFS=.-: 00:24:09.235 01:25:17 -- scripts/common.sh@335 -- # read -ra ver1 00:24:09.235 01:25:17 -- scripts/common.sh@336 -- # IFS=.-: 00:24:09.236 01:25:17 -- scripts/common.sh@336 -- # read -ra ver2 00:24:09.236 01:25:17 -- scripts/common.sh@337 -- # local 'op=<' 00:24:09.236 01:25:17 -- scripts/common.sh@339 -- # ver1_l=2 00:24:09.236 01:25:17 -- scripts/common.sh@340 -- # ver2_l=1 00:24:09.236 01:25:17 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:24:09.236 01:25:17 -- scripts/common.sh@343 -- # case "$op" in 00:24:09.236 01:25:17 -- scripts/common.sh@344 -- # : 1 00:24:09.236 01:25:17 -- scripts/common.sh@363 -- # (( v = 0 )) 00:24:09.236 01:25:17 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:24:09.236 01:25:17 -- scripts/common.sh@364 -- # decimal 1 00:24:09.236 01:25:17 -- scripts/common.sh@352 -- # local d=1 00:24:09.236 01:25:17 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:24:09.236 01:25:17 -- scripts/common.sh@354 -- # echo 1 00:24:09.236 01:25:17 -- scripts/common.sh@364 -- # ver1[v]=1 00:24:09.236 01:25:17 -- scripts/common.sh@365 -- # decimal 2 00:24:09.236 01:25:17 -- scripts/common.sh@352 -- # local d=2 00:24:09.236 01:25:17 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:24:09.236 01:25:17 -- scripts/common.sh@354 -- # echo 2 00:24:09.236 01:25:17 -- scripts/common.sh@365 -- # ver2[v]=2 00:24:09.236 01:25:17 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:24:09.236 01:25:17 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:24:09.236 01:25:17 -- scripts/common.sh@367 -- # return 0 00:24:09.236 01:25:17 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:24:09.236 01:25:17 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:24:09.236 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:09.236 --rc genhtml_branch_coverage=1 00:24:09.236 --rc genhtml_function_coverage=1 00:24:09.236 --rc genhtml_legend=1 00:24:09.236 --rc geninfo_all_blocks=1 00:24:09.236 --rc geninfo_unexecuted_blocks=1 00:24:09.236 00:24:09.236 ' 00:24:09.236 01:25:17 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:24:09.236 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:09.236 --rc genhtml_branch_coverage=1 00:24:09.236 --rc genhtml_function_coverage=1 00:24:09.236 --rc genhtml_legend=1 00:24:09.236 --rc geninfo_all_blocks=1 00:24:09.236 --rc geninfo_unexecuted_blocks=1 00:24:09.236 00:24:09.236 ' 00:24:09.236 01:25:17 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:24:09.236 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:09.236 --rc genhtml_branch_coverage=1 00:24:09.236 --rc genhtml_function_coverage=1 00:24:09.236 --rc genhtml_legend=1 00:24:09.236 --rc geninfo_all_blocks=1 00:24:09.236 --rc geninfo_unexecuted_blocks=1 00:24:09.236 00:24:09.236 ' 00:24:09.236 01:25:17 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:24:09.236 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:09.236 --rc genhtml_branch_coverage=1 00:24:09.236 --rc genhtml_function_coverage=1 00:24:09.236 --rc genhtml_legend=1 00:24:09.236 --rc geninfo_all_blocks=1 00:24:09.236 --rc geninfo_unexecuted_blocks=1 00:24:09.236 00:24:09.236 ' 00:24:09.236 01:25:17 -- target/perf_adq.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:09.236 01:25:17 -- nvmf/common.sh@7 -- # uname -s 00:24:09.236 01:25:17 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:09.236 01:25:17 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:09.236 01:25:17 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:09.236 01:25:17 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:09.236 01:25:17 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:09.236 01:25:17 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:09.236 01:25:17 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:09.236 01:25:17 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:09.236 01:25:17 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:09.236 01:25:17 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:09.236 01:25:17 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:24:09.236 01:25:17 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:24:09.236 01:25:17 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:09.236 01:25:17 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:09.236 01:25:17 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:09.236 01:25:17 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:09.236 01:25:17 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:09.236 01:25:17 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:09.236 01:25:17 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:09.236 01:25:17 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:09.236 01:25:17 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:09.236 01:25:17 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:09.236 01:25:17 -- paths/export.sh@5 -- # export PATH 00:24:09.236 01:25:17 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:09.236 01:25:17 -- nvmf/common.sh@46 -- # : 0 00:24:09.236 01:25:17 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:24:09.236 01:25:17 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:24:09.236 01:25:17 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:24:09.236 01:25:17 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:09.236 01:25:17 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:09.236 01:25:17 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:24:09.236 01:25:17 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:24:09.236 01:25:17 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:24:09.236 01:25:17 -- target/perf_adq.sh@11 -- # gather_supported_nvmf_pci_devs 00:24:09.236 01:25:17 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:09.236 01:25:17 -- common/autotest_common.sh@10 -- # set +x 00:24:11.140 01:25:19 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:11.140 01:25:19 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:11.140 01:25:19 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:11.140 01:25:19 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:11.140 01:25:19 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:11.140 01:25:19 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:11.140 01:25:19 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:11.140 01:25:19 -- nvmf/common.sh@294 -- # net_devs=() 00:24:11.140 01:25:19 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:11.140 01:25:19 -- nvmf/common.sh@295 -- # e810=() 00:24:11.140 01:25:19 -- nvmf/common.sh@295 -- # local -ga e810 00:24:11.140 01:25:19 -- nvmf/common.sh@296 -- # x722=() 00:24:11.140 01:25:19 -- nvmf/common.sh@296 -- # local -ga x722 00:24:11.140 01:25:19 -- nvmf/common.sh@297 -- # mlx=() 00:24:11.140 01:25:19 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:11.140 01:25:19 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:11.140 01:25:19 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:11.140 01:25:19 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:11.140 01:25:19 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:11.140 01:25:19 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:11.140 01:25:19 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:11.140 01:25:19 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:11.140 01:25:19 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:11.140 01:25:19 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:11.140 01:25:19 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:11.140 01:25:19 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:11.140 01:25:19 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:11.140 01:25:19 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:11.140 01:25:19 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:11.140 01:25:19 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:11.140 01:25:19 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:11.140 01:25:19 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:11.140 01:25:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:11.140 01:25:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:11.140 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:11.140 01:25:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:11.140 01:25:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:11.140 01:25:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:11.140 01:25:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:11.140 01:25:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:11.140 01:25:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:11.140 01:25:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:11.140 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:11.140 01:25:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:11.140 01:25:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:11.140 01:25:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:11.140 01:25:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:11.140 01:25:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:11.140 01:25:19 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:11.140 01:25:19 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:11.140 01:25:19 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:11.140 01:25:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:11.140 01:25:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:11.140 01:25:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:11.140 01:25:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:11.140 01:25:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:11.140 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:11.140 01:25:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:11.140 01:25:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:11.140 01:25:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:11.140 01:25:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:11.140 01:25:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:11.140 01:25:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:11.140 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:11.140 01:25:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:11.140 01:25:19 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:11.140 01:25:19 -- target/perf_adq.sh@12 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:11.140 01:25:19 -- target/perf_adq.sh@13 -- # (( 2 == 0 )) 00:24:11.140 01:25:19 -- target/perf_adq.sh@18 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:24:11.140 01:25:19 -- target/perf_adq.sh@59 -- # adq_reload_driver 00:24:11.140 01:25:19 -- target/perf_adq.sh@52 -- # rmmod ice 00:24:11.712 01:25:19 -- target/perf_adq.sh@53 -- # modprobe ice 00:24:14.249 01:25:22 -- target/perf_adq.sh@54 -- # sleep 5 00:24:19.537 01:25:27 -- target/perf_adq.sh@67 -- # nvmftestinit 00:24:19.537 01:25:27 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:19.537 01:25:27 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:19.537 01:25:27 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:19.537 01:25:27 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:19.537 01:25:27 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:19.538 01:25:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:19.538 01:25:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:19.538 01:25:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:19.538 01:25:27 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:19.538 01:25:27 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:19.538 01:25:27 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:19.538 01:25:27 -- common/autotest_common.sh@10 -- # set +x 00:24:19.538 01:25:27 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:19.538 01:25:27 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:19.538 01:25:27 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:19.538 01:25:27 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:19.538 01:25:27 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:19.538 01:25:27 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:19.538 01:25:27 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:19.538 01:25:27 -- nvmf/common.sh@294 -- # net_devs=() 00:24:19.538 01:25:27 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:19.538 01:25:27 -- nvmf/common.sh@295 -- # e810=() 00:24:19.538 01:25:27 -- nvmf/common.sh@295 -- # local -ga e810 00:24:19.538 01:25:27 -- nvmf/common.sh@296 -- # x722=() 00:24:19.538 01:25:27 -- nvmf/common.sh@296 -- # local -ga x722 00:24:19.538 01:25:27 -- nvmf/common.sh@297 -- # mlx=() 00:24:19.538 01:25:27 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:19.538 01:25:27 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:19.538 01:25:27 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:19.538 01:25:27 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:19.538 01:25:27 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:19.538 01:25:27 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:19.538 01:25:27 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:19.538 01:25:27 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:19.538 01:25:27 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:19.538 01:25:27 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:19.538 01:25:27 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:19.538 01:25:27 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:19.538 01:25:27 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:19.538 01:25:27 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:19.538 01:25:27 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:19.538 01:25:27 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:19.538 01:25:27 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:19.538 01:25:27 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:19.538 01:25:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:19.538 01:25:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:19.538 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:19.538 01:25:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:19.538 01:25:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:19.538 01:25:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:19.538 01:25:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:19.538 01:25:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:19.538 01:25:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:19.538 01:25:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:19.538 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:19.538 01:25:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:19.538 01:25:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:19.538 01:25:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:19.538 01:25:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:19.538 01:25:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:19.538 01:25:27 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:19.538 01:25:27 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:19.538 01:25:27 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:19.538 01:25:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:19.538 01:25:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:19.538 01:25:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:19.538 01:25:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:19.538 01:25:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:19.538 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:19.538 01:25:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:19.538 01:25:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:19.538 01:25:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:19.538 01:25:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:19.538 01:25:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:19.538 01:25:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:19.538 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:19.538 01:25:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:19.538 01:25:27 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:19.538 01:25:27 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:19.538 01:25:27 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:19.538 01:25:27 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:19.538 01:25:27 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:19.538 01:25:27 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:19.538 01:25:27 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:19.538 01:25:27 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:19.538 01:25:27 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:19.538 01:25:27 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:19.538 01:25:27 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:19.538 01:25:27 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:19.538 01:25:27 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:19.538 01:25:27 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:19.538 01:25:27 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:19.538 01:25:27 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:19.538 01:25:27 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:19.538 01:25:27 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:19.538 01:25:27 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:19.538 01:25:27 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:19.538 01:25:27 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:19.538 01:25:27 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:19.538 01:25:27 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:19.538 01:25:27 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:19.538 01:25:27 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:19.538 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:19.538 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.270 ms 00:24:19.538 00:24:19.538 --- 10.0.0.2 ping statistics --- 00:24:19.538 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:19.538 rtt min/avg/max/mdev = 0.270/0.270/0.270/0.000 ms 00:24:19.538 01:25:27 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:19.538 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:19.538 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.139 ms 00:24:19.538 00:24:19.538 --- 10.0.0.1 ping statistics --- 00:24:19.538 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:19.538 rtt min/avg/max/mdev = 0.139/0.139/0.139/0.000 ms 00:24:19.538 01:25:27 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:19.538 01:25:27 -- nvmf/common.sh@410 -- # return 0 00:24:19.538 01:25:27 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:19.538 01:25:27 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:19.538 01:25:27 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:19.538 01:25:27 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:19.538 01:25:27 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:19.538 01:25:27 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:19.538 01:25:27 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:19.538 01:25:27 -- target/perf_adq.sh@68 -- # nvmfappstart -m 0xF --wait-for-rpc 00:24:19.538 01:25:27 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:24:19.538 01:25:27 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:19.538 01:25:27 -- common/autotest_common.sh@10 -- # set +x 00:24:19.538 01:25:27 -- nvmf/common.sh@469 -- # nvmfpid=1207942 00:24:19.538 01:25:27 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:24:19.538 01:25:27 -- nvmf/common.sh@470 -- # waitforlisten 1207942 00:24:19.538 01:25:27 -- common/autotest_common.sh@829 -- # '[' -z 1207942 ']' 00:24:19.538 01:25:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:19.538 01:25:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:19.538 01:25:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:19.538 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:19.538 01:25:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:19.538 01:25:27 -- common/autotest_common.sh@10 -- # set +x 00:24:19.538 [2024-11-20 01:25:27.284478] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:24:19.538 [2024-11-20 01:25:27.284546] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:19.538 EAL: No free 2048 kB hugepages reported on node 1 00:24:19.538 [2024-11-20 01:25:27.347207] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:19.538 [2024-11-20 01:25:27.430675] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:19.538 [2024-11-20 01:25:27.430823] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:19.538 [2024-11-20 01:25:27.430839] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:19.538 [2024-11-20 01:25:27.430859] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:19.538 [2024-11-20 01:25:27.430979] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:19.538 [2024-11-20 01:25:27.431045] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:19.538 [2024-11-20 01:25:27.431134] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:19.538 [2024-11-20 01:25:27.431138] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:19.539 01:25:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:19.539 01:25:27 -- common/autotest_common.sh@862 -- # return 0 00:24:19.539 01:25:27 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:24:19.539 01:25:27 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:19.539 01:25:27 -- common/autotest_common.sh@10 -- # set +x 00:24:19.539 01:25:27 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:19.539 01:25:27 -- target/perf_adq.sh@69 -- # adq_configure_nvmf_target 0 00:24:19.539 01:25:27 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 0 --enable-zerocopy-send-server -i posix 00:24:19.539 01:25:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:19.539 01:25:27 -- common/autotest_common.sh@10 -- # set +x 00:24:19.539 01:25:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:19.539 01:25:27 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:24:19.539 01:25:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:19.539 01:25:27 -- common/autotest_common.sh@10 -- # set +x 00:24:19.539 01:25:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:19.539 01:25:27 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 0 00:24:19.539 01:25:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:19.539 01:25:27 -- common/autotest_common.sh@10 -- # set +x 00:24:19.539 [2024-11-20 01:25:27.651008] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:19.539 01:25:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:19.539 01:25:27 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:24:19.539 01:25:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:19.539 01:25:27 -- common/autotest_common.sh@10 -- # set +x 00:24:19.539 Malloc1 00:24:19.539 01:25:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:19.539 01:25:27 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:24:19.539 01:25:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:19.539 01:25:27 -- common/autotest_common.sh@10 -- # set +x 00:24:19.539 01:25:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:19.539 01:25:27 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:24:19.539 01:25:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:19.539 01:25:27 -- common/autotest_common.sh@10 -- # set +x 00:24:19.539 01:25:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:19.539 01:25:27 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:19.539 01:25:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:19.539 01:25:27 -- common/autotest_common.sh@10 -- # set +x 00:24:19.539 [2024-11-20 01:25:27.704459] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:19.539 01:25:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:19.539 01:25:27 -- target/perf_adq.sh@73 -- # perfpid=1207970 00:24:19.539 01:25:27 -- target/perf_adq.sh@74 -- # sleep 2 00:24:19.539 01:25:27 -- target/perf_adq.sh@70 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:24:19.539 EAL: No free 2048 kB hugepages reported on node 1 00:24:22.080 01:25:29 -- target/perf_adq.sh@76 -- # rpc_cmd nvmf_get_stats 00:24:22.080 01:25:29 -- target/perf_adq.sh@76 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 1) | length' 00:24:22.080 01:25:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:22.080 01:25:29 -- target/perf_adq.sh@76 -- # wc -l 00:24:22.080 01:25:29 -- common/autotest_common.sh@10 -- # set +x 00:24:22.080 01:25:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:22.080 01:25:29 -- target/perf_adq.sh@76 -- # count=4 00:24:22.080 01:25:29 -- target/perf_adq.sh@77 -- # [[ 4 -ne 4 ]] 00:24:22.080 01:25:29 -- target/perf_adq.sh@81 -- # wait 1207970 00:24:30.260 Initializing NVMe Controllers 00:24:30.260 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:30.260 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:24:30.260 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:24:30.260 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:24:30.260 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:24:30.260 Initialization complete. Launching workers. 00:24:30.260 ======================================================== 00:24:30.260 Latency(us) 00:24:30.260 Device Information : IOPS MiB/s Average min max 00:24:30.260 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 11249.77 43.94 5689.59 1572.05 9636.01 00:24:30.260 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 11177.67 43.66 5727.29 1714.15 9666.33 00:24:30.260 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 11161.17 43.60 5735.58 1123.71 8975.02 00:24:30.260 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 11086.27 43.31 5773.29 1390.55 9499.06 00:24:30.260 ======================================================== 00:24:30.260 Total : 44674.89 174.51 5731.28 1123.71 9666.33 00:24:30.260 00:24:30.260 01:25:37 -- target/perf_adq.sh@82 -- # nvmftestfini 00:24:30.260 01:25:37 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:30.260 01:25:37 -- nvmf/common.sh@116 -- # sync 00:24:30.260 01:25:37 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:30.260 01:25:37 -- nvmf/common.sh@119 -- # set +e 00:24:30.260 01:25:37 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:30.260 01:25:37 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:30.260 rmmod nvme_tcp 00:24:30.260 rmmod nvme_fabrics 00:24:30.260 rmmod nvme_keyring 00:24:30.260 01:25:37 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:30.260 01:25:37 -- nvmf/common.sh@123 -- # set -e 00:24:30.260 01:25:37 -- nvmf/common.sh@124 -- # return 0 00:24:30.260 01:25:37 -- nvmf/common.sh@477 -- # '[' -n 1207942 ']' 00:24:30.260 01:25:37 -- nvmf/common.sh@478 -- # killprocess 1207942 00:24:30.260 01:25:37 -- common/autotest_common.sh@936 -- # '[' -z 1207942 ']' 00:24:30.260 01:25:37 -- common/autotest_common.sh@940 -- # kill -0 1207942 00:24:30.260 01:25:37 -- common/autotest_common.sh@941 -- # uname 00:24:30.260 01:25:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:30.261 01:25:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1207942 00:24:30.261 01:25:37 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:30.261 01:25:37 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:30.261 01:25:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1207942' 00:24:30.261 killing process with pid 1207942 00:24:30.261 01:25:37 -- common/autotest_common.sh@955 -- # kill 1207942 00:24:30.261 01:25:37 -- common/autotest_common.sh@960 -- # wait 1207942 00:24:30.261 01:25:38 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:30.261 01:25:38 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:30.261 01:25:38 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:30.261 01:25:38 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:30.261 01:25:38 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:30.261 01:25:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:30.261 01:25:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:30.261 01:25:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:32.177 01:25:40 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:32.177 01:25:40 -- target/perf_adq.sh@84 -- # adq_reload_driver 00:24:32.177 01:25:40 -- target/perf_adq.sh@52 -- # rmmod ice 00:24:32.746 01:25:40 -- target/perf_adq.sh@53 -- # modprobe ice 00:24:35.286 01:25:43 -- target/perf_adq.sh@54 -- # sleep 5 00:24:40.571 01:25:48 -- target/perf_adq.sh@87 -- # nvmftestinit 00:24:40.571 01:25:48 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:40.572 01:25:48 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:40.572 01:25:48 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:40.572 01:25:48 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:40.572 01:25:48 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:40.572 01:25:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:40.572 01:25:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:40.572 01:25:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:40.572 01:25:48 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:40.572 01:25:48 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:40.572 01:25:48 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:40.572 01:25:48 -- common/autotest_common.sh@10 -- # set +x 00:24:40.572 01:25:48 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:40.572 01:25:48 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:40.572 01:25:48 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:40.572 01:25:48 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:40.572 01:25:48 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:40.572 01:25:48 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:40.572 01:25:48 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:40.572 01:25:48 -- nvmf/common.sh@294 -- # net_devs=() 00:24:40.572 01:25:48 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:40.572 01:25:48 -- nvmf/common.sh@295 -- # e810=() 00:24:40.572 01:25:48 -- nvmf/common.sh@295 -- # local -ga e810 00:24:40.572 01:25:48 -- nvmf/common.sh@296 -- # x722=() 00:24:40.572 01:25:48 -- nvmf/common.sh@296 -- # local -ga x722 00:24:40.572 01:25:48 -- nvmf/common.sh@297 -- # mlx=() 00:24:40.572 01:25:48 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:40.572 01:25:48 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:40.572 01:25:48 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:40.572 01:25:48 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:40.572 01:25:48 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:40.572 01:25:48 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:40.572 01:25:48 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:40.572 01:25:48 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:40.572 01:25:48 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:40.572 01:25:48 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:40.572 01:25:48 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:40.572 01:25:48 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:40.572 01:25:48 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:40.572 01:25:48 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:40.572 01:25:48 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:40.572 01:25:48 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:40.572 01:25:48 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:40.572 01:25:48 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:40.572 01:25:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:40.572 01:25:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:40.572 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:40.572 01:25:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:40.572 01:25:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:40.572 01:25:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:40.572 01:25:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:40.572 01:25:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:40.572 01:25:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:40.572 01:25:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:40.572 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:40.572 01:25:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:40.572 01:25:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:40.572 01:25:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:40.572 01:25:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:40.572 01:25:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:40.572 01:25:48 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:40.572 01:25:48 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:40.572 01:25:48 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:40.572 01:25:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:40.572 01:25:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:40.572 01:25:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:40.572 01:25:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:40.572 01:25:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:40.572 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:40.572 01:25:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:40.572 01:25:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:40.572 01:25:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:40.572 01:25:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:40.572 01:25:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:40.572 01:25:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:40.572 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:40.572 01:25:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:40.572 01:25:48 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:40.572 01:25:48 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:40.572 01:25:48 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:40.572 01:25:48 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:40.572 01:25:48 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:40.572 01:25:48 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:40.572 01:25:48 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:40.572 01:25:48 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:40.572 01:25:48 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:40.572 01:25:48 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:40.572 01:25:48 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:40.572 01:25:48 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:40.572 01:25:48 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:40.572 01:25:48 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:40.572 01:25:48 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:40.572 01:25:48 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:40.572 01:25:48 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:40.572 01:25:48 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:40.572 01:25:48 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:40.572 01:25:48 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:40.572 01:25:48 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:40.572 01:25:48 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:40.572 01:25:48 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:40.572 01:25:48 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:40.572 01:25:48 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:40.572 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:40.572 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.333 ms 00:24:40.572 00:24:40.572 --- 10.0.0.2 ping statistics --- 00:24:40.572 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:40.572 rtt min/avg/max/mdev = 0.333/0.333/0.333/0.000 ms 00:24:40.572 01:25:48 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:40.572 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:40.572 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.072 ms 00:24:40.572 00:24:40.572 --- 10.0.0.1 ping statistics --- 00:24:40.572 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:40.572 rtt min/avg/max/mdev = 0.072/0.072/0.072/0.000 ms 00:24:40.572 01:25:48 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:40.572 01:25:48 -- nvmf/common.sh@410 -- # return 0 00:24:40.572 01:25:48 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:40.572 01:25:48 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:40.572 01:25:48 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:40.572 01:25:48 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:40.572 01:25:48 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:40.572 01:25:48 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:40.572 01:25:48 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:40.572 01:25:48 -- target/perf_adq.sh@88 -- # adq_configure_driver 00:24:40.572 01:25:48 -- target/perf_adq.sh@22 -- # ip netns exec cvl_0_0_ns_spdk ethtool --offload cvl_0_0 hw-tc-offload on 00:24:40.572 01:25:48 -- target/perf_adq.sh@24 -- # ip netns exec cvl_0_0_ns_spdk ethtool --set-priv-flags cvl_0_0 channel-pkt-inspect-optimize off 00:24:40.572 01:25:48 -- target/perf_adq.sh@26 -- # sysctl -w net.core.busy_poll=1 00:24:40.572 net.core.busy_poll = 1 00:24:40.572 01:25:48 -- target/perf_adq.sh@27 -- # sysctl -w net.core.busy_read=1 00:24:40.572 net.core.busy_read = 1 00:24:40.572 01:25:48 -- target/perf_adq.sh@29 -- # tc=/usr/sbin/tc 00:24:40.572 01:25:48 -- target/perf_adq.sh@31 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 root mqprio num_tc 2 map 0 1 queues 2@0 2@2 hw 1 mode channel 00:24:40.572 01:25:48 -- target/perf_adq.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 ingress 00:24:40.572 01:25:48 -- target/perf_adq.sh@35 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc filter add dev cvl_0_0 protocol ip parent ffff: prio 1 flower dst_ip 10.0.0.2/32 ip_proto tcp dst_port 4420 skip_sw hw_tc 1 00:24:40.572 01:25:48 -- target/perf_adq.sh@38 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/nvmf/set_xps_rxqs cvl_0_0 00:24:40.572 01:25:48 -- target/perf_adq.sh@89 -- # nvmfappstart -m 0xF --wait-for-rpc 00:24:40.572 01:25:48 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:24:40.572 01:25:48 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:40.572 01:25:48 -- common/autotest_common.sh@10 -- # set +x 00:24:40.572 01:25:48 -- nvmf/common.sh@469 -- # nvmfpid=1210779 00:24:40.572 01:25:48 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:24:40.572 01:25:48 -- nvmf/common.sh@470 -- # waitforlisten 1210779 00:24:40.572 01:25:48 -- common/autotest_common.sh@829 -- # '[' -z 1210779 ']' 00:24:40.572 01:25:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:40.572 01:25:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:40.573 01:25:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:40.573 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:40.573 01:25:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:40.573 01:25:48 -- common/autotest_common.sh@10 -- # set +x 00:24:40.573 [2024-11-20 01:25:48.680678] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:24:40.573 [2024-11-20 01:25:48.680760] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:40.573 EAL: No free 2048 kB hugepages reported on node 1 00:24:40.573 [2024-11-20 01:25:48.750035] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:40.832 [2024-11-20 01:25:48.839469] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:40.832 [2024-11-20 01:25:48.839634] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:40.832 [2024-11-20 01:25:48.839655] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:40.832 [2024-11-20 01:25:48.839669] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:40.832 [2024-11-20 01:25:48.839759] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:40.832 [2024-11-20 01:25:48.839816] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:40.832 [2024-11-20 01:25:48.839930] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:40.832 [2024-11-20 01:25:48.839932] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:40.832 01:25:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:40.832 01:25:48 -- common/autotest_common.sh@862 -- # return 0 00:24:40.832 01:25:48 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:24:40.832 01:25:48 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:40.832 01:25:48 -- common/autotest_common.sh@10 -- # set +x 00:24:40.832 01:25:48 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:40.832 01:25:48 -- target/perf_adq.sh@90 -- # adq_configure_nvmf_target 1 00:24:40.832 01:25:48 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 1 --enable-zerocopy-send-server -i posix 00:24:40.832 01:25:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:40.832 01:25:48 -- common/autotest_common.sh@10 -- # set +x 00:24:40.832 01:25:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:40.833 01:25:48 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:24:40.833 01:25:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:40.833 01:25:48 -- common/autotest_common.sh@10 -- # set +x 00:24:40.833 01:25:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:40.833 01:25:49 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 1 00:24:40.833 01:25:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:40.833 01:25:49 -- common/autotest_common.sh@10 -- # set +x 00:24:40.833 [2024-11-20 01:25:49.041950] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:41.093 01:25:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:41.093 01:25:49 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:24:41.093 01:25:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:41.093 01:25:49 -- common/autotest_common.sh@10 -- # set +x 00:24:41.093 Malloc1 00:24:41.093 01:25:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:41.093 01:25:49 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:24:41.093 01:25:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:41.093 01:25:49 -- common/autotest_common.sh@10 -- # set +x 00:24:41.093 01:25:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:41.093 01:25:49 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:24:41.093 01:25:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:41.093 01:25:49 -- common/autotest_common.sh@10 -- # set +x 00:24:41.093 01:25:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:41.093 01:25:49 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:41.093 01:25:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:41.093 01:25:49 -- common/autotest_common.sh@10 -- # set +x 00:24:41.093 [2024-11-20 01:25:49.095287] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:41.093 01:25:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:41.093 01:25:49 -- target/perf_adq.sh@94 -- # perfpid=1210813 00:24:41.093 01:25:49 -- target/perf_adq.sh@95 -- # sleep 2 00:24:41.093 01:25:49 -- target/perf_adq.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:24:41.093 EAL: No free 2048 kB hugepages reported on node 1 00:24:42.999 01:25:51 -- target/perf_adq.sh@97 -- # rpc_cmd nvmf_get_stats 00:24:42.999 01:25:51 -- target/perf_adq.sh@97 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 0) | length' 00:24:42.999 01:25:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:42.999 01:25:51 -- target/perf_adq.sh@97 -- # wc -l 00:24:42.999 01:25:51 -- common/autotest_common.sh@10 -- # set +x 00:24:42.999 01:25:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:42.999 01:25:51 -- target/perf_adq.sh@97 -- # count=2 00:24:42.999 01:25:51 -- target/perf_adq.sh@98 -- # [[ 2 -lt 2 ]] 00:24:42.999 01:25:51 -- target/perf_adq.sh@103 -- # wait 1210813 00:24:51.123 Initializing NVMe Controllers 00:24:51.123 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:51.123 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:24:51.123 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:24:51.123 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:24:51.123 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:24:51.123 Initialization complete. Launching workers. 00:24:51.123 ======================================================== 00:24:51.123 Latency(us) 00:24:51.123 Device Information : IOPS MiB/s Average min max 00:24:51.123 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 7258.58 28.35 8817.91 1251.72 53766.10 00:24:51.123 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 6226.80 24.32 10279.27 1575.86 53148.51 00:24:51.123 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 7878.47 30.78 8124.21 1188.24 53348.54 00:24:51.123 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 7012.28 27.39 9126.62 1168.07 52622.43 00:24:51.123 ======================================================== 00:24:51.123 Total : 28376.13 110.84 9022.27 1168.07 53766.10 00:24:51.123 00:24:51.123 01:25:59 -- target/perf_adq.sh@104 -- # nvmftestfini 00:24:51.123 01:25:59 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:51.123 01:25:59 -- nvmf/common.sh@116 -- # sync 00:24:51.123 01:25:59 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:51.123 01:25:59 -- nvmf/common.sh@119 -- # set +e 00:24:51.123 01:25:59 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:51.123 01:25:59 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:51.123 rmmod nvme_tcp 00:24:51.123 rmmod nvme_fabrics 00:24:51.123 rmmod nvme_keyring 00:24:51.123 01:25:59 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:51.123 01:25:59 -- nvmf/common.sh@123 -- # set -e 00:24:51.123 01:25:59 -- nvmf/common.sh@124 -- # return 0 00:24:51.123 01:25:59 -- nvmf/common.sh@477 -- # '[' -n 1210779 ']' 00:24:51.123 01:25:59 -- nvmf/common.sh@478 -- # killprocess 1210779 00:24:51.123 01:25:59 -- common/autotest_common.sh@936 -- # '[' -z 1210779 ']' 00:24:51.123 01:25:59 -- common/autotest_common.sh@940 -- # kill -0 1210779 00:24:51.123 01:25:59 -- common/autotest_common.sh@941 -- # uname 00:24:51.123 01:25:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:51.123 01:25:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1210779 00:24:51.123 01:25:59 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:51.123 01:25:59 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:51.123 01:25:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1210779' 00:24:51.123 killing process with pid 1210779 00:24:51.123 01:25:59 -- common/autotest_common.sh@955 -- # kill 1210779 00:24:51.123 01:25:59 -- common/autotest_common.sh@960 -- # wait 1210779 00:24:51.381 01:25:59 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:51.381 01:25:59 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:51.381 01:25:59 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:51.381 01:25:59 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:51.381 01:25:59 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:51.381 01:25:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:51.381 01:25:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:51.381 01:25:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:53.923 01:26:01 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:53.923 01:26:01 -- target/perf_adq.sh@106 -- # trap - SIGINT SIGTERM EXIT 00:24:53.923 00:24:53.923 real 0m44.701s 00:24:53.923 user 2m37.978s 00:24:53.923 sys 0m9.966s 00:24:53.923 01:26:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:24:53.923 01:26:01 -- common/autotest_common.sh@10 -- # set +x 00:24:53.923 ************************************ 00:24:53.923 END TEST nvmf_perf_adq 00:24:53.923 ************************************ 00:24:53.923 01:26:01 -- nvmf/nvmf.sh@81 -- # run_test nvmf_shutdown /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:24:53.923 01:26:01 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:24:53.923 01:26:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:53.923 01:26:01 -- common/autotest_common.sh@10 -- # set +x 00:24:53.923 ************************************ 00:24:53.923 START TEST nvmf_shutdown 00:24:53.923 ************************************ 00:24:53.923 01:26:01 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:24:53.923 * Looking for test storage... 00:24:53.923 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:24:53.923 01:26:01 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:24:53.923 01:26:01 -- common/autotest_common.sh@1690 -- # lcov --version 00:24:53.923 01:26:01 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:24:53.923 01:26:01 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:24:53.923 01:26:01 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:24:53.923 01:26:01 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:24:53.923 01:26:01 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:24:53.923 01:26:01 -- scripts/common.sh@335 -- # IFS=.-: 00:24:53.923 01:26:01 -- scripts/common.sh@335 -- # read -ra ver1 00:24:53.923 01:26:01 -- scripts/common.sh@336 -- # IFS=.-: 00:24:53.923 01:26:01 -- scripts/common.sh@336 -- # read -ra ver2 00:24:53.923 01:26:01 -- scripts/common.sh@337 -- # local 'op=<' 00:24:53.923 01:26:01 -- scripts/common.sh@339 -- # ver1_l=2 00:24:53.923 01:26:01 -- scripts/common.sh@340 -- # ver2_l=1 00:24:53.923 01:26:01 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:24:53.923 01:26:01 -- scripts/common.sh@343 -- # case "$op" in 00:24:53.923 01:26:01 -- scripts/common.sh@344 -- # : 1 00:24:53.923 01:26:01 -- scripts/common.sh@363 -- # (( v = 0 )) 00:24:53.923 01:26:01 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:24:53.923 01:26:01 -- scripts/common.sh@364 -- # decimal 1 00:24:53.923 01:26:01 -- scripts/common.sh@352 -- # local d=1 00:24:53.923 01:26:01 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:24:53.923 01:26:01 -- scripts/common.sh@354 -- # echo 1 00:24:53.923 01:26:01 -- scripts/common.sh@364 -- # ver1[v]=1 00:24:53.923 01:26:01 -- scripts/common.sh@365 -- # decimal 2 00:24:53.923 01:26:01 -- scripts/common.sh@352 -- # local d=2 00:24:53.923 01:26:01 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:24:53.923 01:26:01 -- scripts/common.sh@354 -- # echo 2 00:24:53.923 01:26:01 -- scripts/common.sh@365 -- # ver2[v]=2 00:24:53.923 01:26:01 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:24:53.923 01:26:01 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:24:53.923 01:26:01 -- scripts/common.sh@367 -- # return 0 00:24:53.923 01:26:01 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:24:53.923 01:26:01 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:24:53.923 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:53.923 --rc genhtml_branch_coverage=1 00:24:53.923 --rc genhtml_function_coverage=1 00:24:53.923 --rc genhtml_legend=1 00:24:53.923 --rc geninfo_all_blocks=1 00:24:53.923 --rc geninfo_unexecuted_blocks=1 00:24:53.923 00:24:53.923 ' 00:24:53.923 01:26:01 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:24:53.923 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:53.923 --rc genhtml_branch_coverage=1 00:24:53.923 --rc genhtml_function_coverage=1 00:24:53.923 --rc genhtml_legend=1 00:24:53.923 --rc geninfo_all_blocks=1 00:24:53.923 --rc geninfo_unexecuted_blocks=1 00:24:53.923 00:24:53.923 ' 00:24:53.923 01:26:01 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:24:53.923 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:53.923 --rc genhtml_branch_coverage=1 00:24:53.923 --rc genhtml_function_coverage=1 00:24:53.923 --rc genhtml_legend=1 00:24:53.923 --rc geninfo_all_blocks=1 00:24:53.923 --rc geninfo_unexecuted_blocks=1 00:24:53.923 00:24:53.923 ' 00:24:53.923 01:26:01 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:24:53.923 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:53.923 --rc genhtml_branch_coverage=1 00:24:53.923 --rc genhtml_function_coverage=1 00:24:53.923 --rc genhtml_legend=1 00:24:53.923 --rc geninfo_all_blocks=1 00:24:53.923 --rc geninfo_unexecuted_blocks=1 00:24:53.923 00:24:53.923 ' 00:24:53.923 01:26:01 -- target/shutdown.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:53.923 01:26:01 -- nvmf/common.sh@7 -- # uname -s 00:24:53.923 01:26:01 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:53.923 01:26:01 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:53.923 01:26:01 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:53.923 01:26:01 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:53.923 01:26:01 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:53.923 01:26:01 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:53.923 01:26:01 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:53.923 01:26:01 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:53.923 01:26:01 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:53.923 01:26:01 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:53.923 01:26:01 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:24:53.923 01:26:01 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:24:53.923 01:26:01 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:53.923 01:26:01 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:53.923 01:26:01 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:53.923 01:26:01 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:53.923 01:26:01 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:53.923 01:26:01 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:53.923 01:26:01 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:53.923 01:26:01 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:53.923 01:26:01 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:53.923 01:26:01 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:53.923 01:26:01 -- paths/export.sh@5 -- # export PATH 00:24:53.924 01:26:01 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:53.924 01:26:01 -- nvmf/common.sh@46 -- # : 0 00:24:53.924 01:26:01 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:24:53.924 01:26:01 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:24:53.924 01:26:01 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:24:53.924 01:26:01 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:53.924 01:26:01 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:53.924 01:26:01 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:24:53.924 01:26:01 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:24:53.924 01:26:01 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:24:53.924 01:26:01 -- target/shutdown.sh@11 -- # MALLOC_BDEV_SIZE=64 00:24:53.924 01:26:01 -- target/shutdown.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:24:53.924 01:26:01 -- target/shutdown.sh@146 -- # run_test nvmf_shutdown_tc1 nvmf_shutdown_tc1 00:24:53.924 01:26:01 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:24:53.924 01:26:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:53.924 01:26:01 -- common/autotest_common.sh@10 -- # set +x 00:24:53.924 ************************************ 00:24:53.924 START TEST nvmf_shutdown_tc1 00:24:53.924 ************************************ 00:24:53.924 01:26:01 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc1 00:24:53.924 01:26:01 -- target/shutdown.sh@74 -- # starttarget 00:24:53.924 01:26:01 -- target/shutdown.sh@15 -- # nvmftestinit 00:24:53.924 01:26:01 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:53.924 01:26:01 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:53.924 01:26:01 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:53.924 01:26:01 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:53.924 01:26:01 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:53.924 01:26:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:53.924 01:26:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:53.924 01:26:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:53.924 01:26:01 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:53.924 01:26:01 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:53.924 01:26:01 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:53.924 01:26:01 -- common/autotest_common.sh@10 -- # set +x 00:24:55.832 01:26:03 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:55.832 01:26:03 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:55.832 01:26:03 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:55.832 01:26:03 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:55.832 01:26:03 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:55.832 01:26:03 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:55.832 01:26:03 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:55.832 01:26:03 -- nvmf/common.sh@294 -- # net_devs=() 00:24:55.832 01:26:03 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:55.832 01:26:03 -- nvmf/common.sh@295 -- # e810=() 00:24:55.832 01:26:03 -- nvmf/common.sh@295 -- # local -ga e810 00:24:55.832 01:26:03 -- nvmf/common.sh@296 -- # x722=() 00:24:55.832 01:26:03 -- nvmf/common.sh@296 -- # local -ga x722 00:24:55.832 01:26:03 -- nvmf/common.sh@297 -- # mlx=() 00:24:55.832 01:26:03 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:55.832 01:26:03 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:55.832 01:26:03 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:55.832 01:26:03 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:55.832 01:26:03 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:55.832 01:26:03 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:55.832 01:26:03 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:55.832 01:26:03 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:55.832 01:26:03 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:55.832 01:26:03 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:55.832 01:26:03 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:55.832 01:26:03 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:55.832 01:26:03 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:55.832 01:26:03 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:55.832 01:26:03 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:55.832 01:26:03 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:55.832 01:26:03 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:55.832 01:26:03 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:55.832 01:26:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:55.832 01:26:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:55.832 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:55.832 01:26:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:55.832 01:26:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:55.832 01:26:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:55.832 01:26:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:55.832 01:26:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:55.832 01:26:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:55.832 01:26:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:55.832 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:55.832 01:26:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:55.832 01:26:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:55.832 01:26:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:55.832 01:26:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:55.832 01:26:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:55.832 01:26:03 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:55.832 01:26:03 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:55.832 01:26:03 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:55.832 01:26:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:55.832 01:26:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:55.832 01:26:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:55.832 01:26:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:55.832 01:26:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:55.832 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:55.832 01:26:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:55.832 01:26:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:55.832 01:26:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:55.832 01:26:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:55.832 01:26:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:55.832 01:26:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:55.832 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:55.832 01:26:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:55.832 01:26:03 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:55.832 01:26:03 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:55.832 01:26:03 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:55.832 01:26:03 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:55.832 01:26:03 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:55.832 01:26:03 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:55.832 01:26:03 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:55.832 01:26:03 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:55.832 01:26:03 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:55.832 01:26:03 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:55.832 01:26:03 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:55.832 01:26:03 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:55.832 01:26:03 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:55.832 01:26:03 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:55.832 01:26:03 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:55.832 01:26:03 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:55.832 01:26:03 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:55.832 01:26:03 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:55.832 01:26:03 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:55.832 01:26:03 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:55.832 01:26:03 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:55.832 01:26:03 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:55.832 01:26:03 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:55.832 01:26:03 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:55.832 01:26:03 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:55.832 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:55.832 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.371 ms 00:24:55.832 00:24:55.832 --- 10.0.0.2 ping statistics --- 00:24:55.832 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:55.832 rtt min/avg/max/mdev = 0.371/0.371/0.371/0.000 ms 00:24:55.832 01:26:03 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:55.832 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:55.832 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.186 ms 00:24:55.832 00:24:55.832 --- 10.0.0.1 ping statistics --- 00:24:55.832 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:55.832 rtt min/avg/max/mdev = 0.186/0.186/0.186/0.000 ms 00:24:55.832 01:26:03 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:55.832 01:26:03 -- nvmf/common.sh@410 -- # return 0 00:24:55.832 01:26:03 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:55.832 01:26:03 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:55.832 01:26:03 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:55.832 01:26:03 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:55.832 01:26:03 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:55.832 01:26:03 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:55.832 01:26:03 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:55.832 01:26:03 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:24:55.832 01:26:03 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:24:55.832 01:26:03 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:55.832 01:26:03 -- common/autotest_common.sh@10 -- # set +x 00:24:55.832 01:26:03 -- nvmf/common.sh@469 -- # nvmfpid=1214019 00:24:55.832 01:26:03 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:24:55.832 01:26:03 -- nvmf/common.sh@470 -- # waitforlisten 1214019 00:24:55.832 01:26:03 -- common/autotest_common.sh@829 -- # '[' -z 1214019 ']' 00:24:55.832 01:26:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:55.832 01:26:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:55.832 01:26:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:55.832 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:55.832 01:26:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:55.832 01:26:03 -- common/autotest_common.sh@10 -- # set +x 00:24:55.832 [2024-11-20 01:26:03.923905] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:24:55.832 [2024-11-20 01:26:03.923972] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:55.832 EAL: No free 2048 kB hugepages reported on node 1 00:24:55.832 [2024-11-20 01:26:03.986505] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:56.092 [2024-11-20 01:26:04.070599] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:56.092 [2024-11-20 01:26:04.070744] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:56.092 [2024-11-20 01:26:04.070761] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:56.092 [2024-11-20 01:26:04.070772] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:56.092 [2024-11-20 01:26:04.070896] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:56.092 [2024-11-20 01:26:04.071060] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:56.093 [2024-11-20 01:26:04.070990] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:56.093 [2024-11-20 01:26:04.071057] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:24:56.661 01:26:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:56.661 01:26:04 -- common/autotest_common.sh@862 -- # return 0 00:24:56.661 01:26:04 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:24:56.661 01:26:04 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:56.661 01:26:04 -- common/autotest_common.sh@10 -- # set +x 00:24:56.920 01:26:04 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:56.920 01:26:04 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:24:56.920 01:26:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:56.920 01:26:04 -- common/autotest_common.sh@10 -- # set +x 00:24:56.920 [2024-11-20 01:26:04.898680] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:56.920 01:26:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:56.920 01:26:04 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:24:56.920 01:26:04 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:24:56.920 01:26:04 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:56.920 01:26:04 -- common/autotest_common.sh@10 -- # set +x 00:24:56.920 01:26:04 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:24:56.920 01:26:04 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:56.920 01:26:04 -- target/shutdown.sh@28 -- # cat 00:24:56.920 01:26:04 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:56.920 01:26:04 -- target/shutdown.sh@28 -- # cat 00:24:56.920 01:26:04 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:56.920 01:26:04 -- target/shutdown.sh@28 -- # cat 00:24:56.920 01:26:04 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:56.920 01:26:04 -- target/shutdown.sh@28 -- # cat 00:24:56.920 01:26:04 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:56.920 01:26:04 -- target/shutdown.sh@28 -- # cat 00:24:56.920 01:26:04 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:56.920 01:26:04 -- target/shutdown.sh@28 -- # cat 00:24:56.920 01:26:04 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:56.920 01:26:04 -- target/shutdown.sh@28 -- # cat 00:24:56.920 01:26:04 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:56.920 01:26:04 -- target/shutdown.sh@28 -- # cat 00:24:56.920 01:26:04 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:56.920 01:26:04 -- target/shutdown.sh@28 -- # cat 00:24:56.920 01:26:04 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:56.920 01:26:04 -- target/shutdown.sh@28 -- # cat 00:24:56.920 01:26:04 -- target/shutdown.sh@35 -- # rpc_cmd 00:24:56.920 01:26:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:56.920 01:26:04 -- common/autotest_common.sh@10 -- # set +x 00:24:56.920 Malloc1 00:24:56.920 [2024-11-20 01:26:04.988337] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:56.920 Malloc2 00:24:56.920 Malloc3 00:24:56.920 Malloc4 00:24:57.179 Malloc5 00:24:57.179 Malloc6 00:24:57.179 Malloc7 00:24:57.179 Malloc8 00:24:57.179 Malloc9 00:24:57.438 Malloc10 00:24:57.438 01:26:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:57.438 01:26:05 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:24:57.438 01:26:05 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:57.438 01:26:05 -- common/autotest_common.sh@10 -- # set +x 00:24:57.438 01:26:05 -- target/shutdown.sh@78 -- # perfpid=1214214 00:24:57.438 01:26:05 -- target/shutdown.sh@79 -- # waitforlisten 1214214 /var/tmp/bdevperf.sock 00:24:57.438 01:26:05 -- target/shutdown.sh@77 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:24:57.438 01:26:05 -- target/shutdown.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json /dev/fd/63 00:24:57.438 01:26:05 -- common/autotest_common.sh@829 -- # '[' -z 1214214 ']' 00:24:57.438 01:26:05 -- nvmf/common.sh@520 -- # config=() 00:24:57.438 01:26:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:24:57.438 01:26:05 -- nvmf/common.sh@520 -- # local subsystem config 00:24:57.438 01:26:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:57.439 01:26:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:57.439 01:26:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:57.439 { 00:24:57.439 "params": { 00:24:57.439 "name": "Nvme$subsystem", 00:24:57.439 "trtype": "$TEST_TRANSPORT", 00:24:57.439 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:57.439 "adrfam": "ipv4", 00:24:57.439 "trsvcid": "$NVMF_PORT", 00:24:57.439 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:57.439 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:57.439 "hdgst": ${hdgst:-false}, 00:24:57.439 "ddgst": ${ddgst:-false} 00:24:57.439 }, 00:24:57.439 "method": "bdev_nvme_attach_controller" 00:24:57.439 } 00:24:57.439 EOF 00:24:57.439 )") 00:24:57.439 01:26:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:24:57.439 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:24:57.439 01:26:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:57.439 01:26:05 -- common/autotest_common.sh@10 -- # set +x 00:24:57.439 01:26:05 -- nvmf/common.sh@542 -- # cat 00:24:57.439 01:26:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:57.439 01:26:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:57.439 { 00:24:57.439 "params": { 00:24:57.439 "name": "Nvme$subsystem", 00:24:57.439 "trtype": "$TEST_TRANSPORT", 00:24:57.439 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:57.439 "adrfam": "ipv4", 00:24:57.439 "trsvcid": "$NVMF_PORT", 00:24:57.439 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:57.439 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:57.439 "hdgst": ${hdgst:-false}, 00:24:57.439 "ddgst": ${ddgst:-false} 00:24:57.439 }, 00:24:57.439 "method": "bdev_nvme_attach_controller" 00:24:57.439 } 00:24:57.439 EOF 00:24:57.439 )") 00:24:57.439 01:26:05 -- nvmf/common.sh@542 -- # cat 00:24:57.439 01:26:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:57.439 01:26:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:57.439 { 00:24:57.439 "params": { 00:24:57.439 "name": "Nvme$subsystem", 00:24:57.439 "trtype": "$TEST_TRANSPORT", 00:24:57.439 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:57.439 "adrfam": "ipv4", 00:24:57.439 "trsvcid": "$NVMF_PORT", 00:24:57.439 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:57.439 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:57.439 "hdgst": ${hdgst:-false}, 00:24:57.439 "ddgst": ${ddgst:-false} 00:24:57.439 }, 00:24:57.439 "method": "bdev_nvme_attach_controller" 00:24:57.439 } 00:24:57.439 EOF 00:24:57.439 )") 00:24:57.439 01:26:05 -- nvmf/common.sh@542 -- # cat 00:24:57.439 01:26:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:57.439 01:26:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:57.439 { 00:24:57.439 "params": { 00:24:57.439 "name": "Nvme$subsystem", 00:24:57.439 "trtype": "$TEST_TRANSPORT", 00:24:57.439 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:57.439 "adrfam": "ipv4", 00:24:57.439 "trsvcid": "$NVMF_PORT", 00:24:57.439 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:57.439 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:57.439 "hdgst": ${hdgst:-false}, 00:24:57.439 "ddgst": ${ddgst:-false} 00:24:57.439 }, 00:24:57.439 "method": "bdev_nvme_attach_controller" 00:24:57.439 } 00:24:57.439 EOF 00:24:57.439 )") 00:24:57.439 01:26:05 -- nvmf/common.sh@542 -- # cat 00:24:57.439 01:26:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:57.439 01:26:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:57.439 { 00:24:57.439 "params": { 00:24:57.439 "name": "Nvme$subsystem", 00:24:57.439 "trtype": "$TEST_TRANSPORT", 00:24:57.439 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:57.439 "adrfam": "ipv4", 00:24:57.439 "trsvcid": "$NVMF_PORT", 00:24:57.439 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:57.439 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:57.439 "hdgst": ${hdgst:-false}, 00:24:57.439 "ddgst": ${ddgst:-false} 00:24:57.439 }, 00:24:57.439 "method": "bdev_nvme_attach_controller" 00:24:57.439 } 00:24:57.439 EOF 00:24:57.439 )") 00:24:57.439 01:26:05 -- nvmf/common.sh@542 -- # cat 00:24:57.439 01:26:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:57.439 01:26:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:57.439 { 00:24:57.439 "params": { 00:24:57.439 "name": "Nvme$subsystem", 00:24:57.439 "trtype": "$TEST_TRANSPORT", 00:24:57.439 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:57.439 "adrfam": "ipv4", 00:24:57.439 "trsvcid": "$NVMF_PORT", 00:24:57.439 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:57.439 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:57.439 "hdgst": ${hdgst:-false}, 00:24:57.439 "ddgst": ${ddgst:-false} 00:24:57.439 }, 00:24:57.439 "method": "bdev_nvme_attach_controller" 00:24:57.439 } 00:24:57.439 EOF 00:24:57.439 )") 00:24:57.439 01:26:05 -- nvmf/common.sh@542 -- # cat 00:24:57.439 01:26:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:57.439 01:26:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:57.439 { 00:24:57.439 "params": { 00:24:57.439 "name": "Nvme$subsystem", 00:24:57.439 "trtype": "$TEST_TRANSPORT", 00:24:57.439 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:57.439 "adrfam": "ipv4", 00:24:57.439 "trsvcid": "$NVMF_PORT", 00:24:57.439 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:57.439 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:57.439 "hdgst": ${hdgst:-false}, 00:24:57.439 "ddgst": ${ddgst:-false} 00:24:57.439 }, 00:24:57.439 "method": "bdev_nvme_attach_controller" 00:24:57.439 } 00:24:57.439 EOF 00:24:57.439 )") 00:24:57.439 01:26:05 -- nvmf/common.sh@542 -- # cat 00:24:57.439 01:26:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:57.439 01:26:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:57.439 { 00:24:57.439 "params": { 00:24:57.439 "name": "Nvme$subsystem", 00:24:57.439 "trtype": "$TEST_TRANSPORT", 00:24:57.439 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:57.439 "adrfam": "ipv4", 00:24:57.439 "trsvcid": "$NVMF_PORT", 00:24:57.439 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:57.439 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:57.439 "hdgst": ${hdgst:-false}, 00:24:57.439 "ddgst": ${ddgst:-false} 00:24:57.439 }, 00:24:57.439 "method": "bdev_nvme_attach_controller" 00:24:57.439 } 00:24:57.439 EOF 00:24:57.439 )") 00:24:57.439 01:26:05 -- nvmf/common.sh@542 -- # cat 00:24:57.439 01:26:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:57.439 01:26:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:57.439 { 00:24:57.439 "params": { 00:24:57.439 "name": "Nvme$subsystem", 00:24:57.439 "trtype": "$TEST_TRANSPORT", 00:24:57.439 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:57.439 "adrfam": "ipv4", 00:24:57.439 "trsvcid": "$NVMF_PORT", 00:24:57.439 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:57.439 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:57.439 "hdgst": ${hdgst:-false}, 00:24:57.439 "ddgst": ${ddgst:-false} 00:24:57.439 }, 00:24:57.439 "method": "bdev_nvme_attach_controller" 00:24:57.439 } 00:24:57.439 EOF 00:24:57.439 )") 00:24:57.439 01:26:05 -- nvmf/common.sh@542 -- # cat 00:24:57.439 01:26:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:57.439 01:26:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:57.439 { 00:24:57.439 "params": { 00:24:57.439 "name": "Nvme$subsystem", 00:24:57.439 "trtype": "$TEST_TRANSPORT", 00:24:57.439 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:57.439 "adrfam": "ipv4", 00:24:57.439 "trsvcid": "$NVMF_PORT", 00:24:57.439 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:57.439 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:57.439 "hdgst": ${hdgst:-false}, 00:24:57.439 "ddgst": ${ddgst:-false} 00:24:57.439 }, 00:24:57.439 "method": "bdev_nvme_attach_controller" 00:24:57.439 } 00:24:57.439 EOF 00:24:57.439 )") 00:24:57.439 01:26:05 -- nvmf/common.sh@542 -- # cat 00:24:57.439 01:26:05 -- nvmf/common.sh@544 -- # jq . 00:24:57.439 01:26:05 -- nvmf/common.sh@545 -- # IFS=, 00:24:57.439 01:26:05 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:24:57.439 "params": { 00:24:57.439 "name": "Nvme1", 00:24:57.439 "trtype": "tcp", 00:24:57.439 "traddr": "10.0.0.2", 00:24:57.439 "adrfam": "ipv4", 00:24:57.439 "trsvcid": "4420", 00:24:57.439 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:24:57.439 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:24:57.439 "hdgst": false, 00:24:57.439 "ddgst": false 00:24:57.439 }, 00:24:57.439 "method": "bdev_nvme_attach_controller" 00:24:57.439 },{ 00:24:57.439 "params": { 00:24:57.439 "name": "Nvme2", 00:24:57.439 "trtype": "tcp", 00:24:57.439 "traddr": "10.0.0.2", 00:24:57.439 "adrfam": "ipv4", 00:24:57.439 "trsvcid": "4420", 00:24:57.439 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:24:57.439 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:24:57.439 "hdgst": false, 00:24:57.439 "ddgst": false 00:24:57.439 }, 00:24:57.439 "method": "bdev_nvme_attach_controller" 00:24:57.439 },{ 00:24:57.439 "params": { 00:24:57.439 "name": "Nvme3", 00:24:57.439 "trtype": "tcp", 00:24:57.440 "traddr": "10.0.0.2", 00:24:57.440 "adrfam": "ipv4", 00:24:57.440 "trsvcid": "4420", 00:24:57.440 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:24:57.440 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:24:57.440 "hdgst": false, 00:24:57.440 "ddgst": false 00:24:57.440 }, 00:24:57.440 "method": "bdev_nvme_attach_controller" 00:24:57.440 },{ 00:24:57.440 "params": { 00:24:57.440 "name": "Nvme4", 00:24:57.440 "trtype": "tcp", 00:24:57.440 "traddr": "10.0.0.2", 00:24:57.440 "adrfam": "ipv4", 00:24:57.440 "trsvcid": "4420", 00:24:57.440 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:24:57.440 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:24:57.440 "hdgst": false, 00:24:57.440 "ddgst": false 00:24:57.440 }, 00:24:57.440 "method": "bdev_nvme_attach_controller" 00:24:57.440 },{ 00:24:57.440 "params": { 00:24:57.440 "name": "Nvme5", 00:24:57.440 "trtype": "tcp", 00:24:57.440 "traddr": "10.0.0.2", 00:24:57.440 "adrfam": "ipv4", 00:24:57.440 "trsvcid": "4420", 00:24:57.440 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:24:57.440 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:24:57.440 "hdgst": false, 00:24:57.440 "ddgst": false 00:24:57.440 }, 00:24:57.440 "method": "bdev_nvme_attach_controller" 00:24:57.440 },{ 00:24:57.440 "params": { 00:24:57.440 "name": "Nvme6", 00:24:57.440 "trtype": "tcp", 00:24:57.440 "traddr": "10.0.0.2", 00:24:57.440 "adrfam": "ipv4", 00:24:57.440 "trsvcid": "4420", 00:24:57.440 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:24:57.440 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:24:57.440 "hdgst": false, 00:24:57.440 "ddgst": false 00:24:57.440 }, 00:24:57.440 "method": "bdev_nvme_attach_controller" 00:24:57.440 },{ 00:24:57.440 "params": { 00:24:57.440 "name": "Nvme7", 00:24:57.440 "trtype": "tcp", 00:24:57.440 "traddr": "10.0.0.2", 00:24:57.440 "adrfam": "ipv4", 00:24:57.440 "trsvcid": "4420", 00:24:57.440 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:24:57.440 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:24:57.440 "hdgst": false, 00:24:57.440 "ddgst": false 00:24:57.440 }, 00:24:57.440 "method": "bdev_nvme_attach_controller" 00:24:57.440 },{ 00:24:57.440 "params": { 00:24:57.440 "name": "Nvme8", 00:24:57.440 "trtype": "tcp", 00:24:57.440 "traddr": "10.0.0.2", 00:24:57.440 "adrfam": "ipv4", 00:24:57.440 "trsvcid": "4420", 00:24:57.440 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:24:57.440 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:24:57.440 "hdgst": false, 00:24:57.440 "ddgst": false 00:24:57.440 }, 00:24:57.440 "method": "bdev_nvme_attach_controller" 00:24:57.440 },{ 00:24:57.440 "params": { 00:24:57.440 "name": "Nvme9", 00:24:57.440 "trtype": "tcp", 00:24:57.440 "traddr": "10.0.0.2", 00:24:57.440 "adrfam": "ipv4", 00:24:57.440 "trsvcid": "4420", 00:24:57.440 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:24:57.440 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:24:57.440 "hdgst": false, 00:24:57.440 "ddgst": false 00:24:57.440 }, 00:24:57.440 "method": "bdev_nvme_attach_controller" 00:24:57.440 },{ 00:24:57.440 "params": { 00:24:57.440 "name": "Nvme10", 00:24:57.440 "trtype": "tcp", 00:24:57.440 "traddr": "10.0.0.2", 00:24:57.440 "adrfam": "ipv4", 00:24:57.440 "trsvcid": "4420", 00:24:57.440 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:24:57.440 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:24:57.440 "hdgst": false, 00:24:57.440 "ddgst": false 00:24:57.440 }, 00:24:57.440 "method": "bdev_nvme_attach_controller" 00:24:57.440 }' 00:24:57.440 [2024-11-20 01:26:05.489522] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:24:57.440 [2024-11-20 01:26:05.489613] [ DPDK EAL parameters: bdev_svc -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:24:57.440 EAL: No free 2048 kB hugepages reported on node 1 00:24:57.440 [2024-11-20 01:26:05.554461] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:24:57.440 [2024-11-20 01:26:05.640982] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:59.361 01:26:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:59.361 01:26:07 -- common/autotest_common.sh@862 -- # return 0 00:24:59.362 01:26:07 -- target/shutdown.sh@80 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:24:59.362 01:26:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:59.362 01:26:07 -- common/autotest_common.sh@10 -- # set +x 00:24:59.362 01:26:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:59.362 01:26:07 -- target/shutdown.sh@83 -- # kill -9 1214214 00:24:59.362 01:26:07 -- target/shutdown.sh@84 -- # rm -f /var/run/spdk_bdev1 00:24:59.362 01:26:07 -- target/shutdown.sh@87 -- # sleep 1 00:25:00.299 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 73: 1214214 Killed $rootdir/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") 00:25:00.299 01:26:08 -- target/shutdown.sh@88 -- # kill -0 1214019 00:25:00.299 01:26:08 -- target/shutdown.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:25:00.299 01:26:08 -- target/shutdown.sh@91 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:00.299 01:26:08 -- nvmf/common.sh@520 -- # config=() 00:25:00.299 01:26:08 -- nvmf/common.sh@520 -- # local subsystem config 00:25:00.299 01:26:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:00.299 01:26:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:00.299 { 00:25:00.299 "params": { 00:25:00.299 "name": "Nvme$subsystem", 00:25:00.299 "trtype": "$TEST_TRANSPORT", 00:25:00.299 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:00.299 "adrfam": "ipv4", 00:25:00.299 "trsvcid": "$NVMF_PORT", 00:25:00.300 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:00.300 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:00.300 "hdgst": ${hdgst:-false}, 00:25:00.300 "ddgst": ${ddgst:-false} 00:25:00.300 }, 00:25:00.300 "method": "bdev_nvme_attach_controller" 00:25:00.300 } 00:25:00.300 EOF 00:25:00.300 )") 00:25:00.300 01:26:08 -- nvmf/common.sh@542 -- # cat 00:25:00.300 01:26:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:00.300 01:26:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:00.300 { 00:25:00.300 "params": { 00:25:00.300 "name": "Nvme$subsystem", 00:25:00.300 "trtype": "$TEST_TRANSPORT", 00:25:00.300 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:00.300 "adrfam": "ipv4", 00:25:00.300 "trsvcid": "$NVMF_PORT", 00:25:00.300 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:00.300 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:00.300 "hdgst": ${hdgst:-false}, 00:25:00.300 "ddgst": ${ddgst:-false} 00:25:00.300 }, 00:25:00.300 "method": "bdev_nvme_attach_controller" 00:25:00.300 } 00:25:00.300 EOF 00:25:00.300 )") 00:25:00.300 01:26:08 -- nvmf/common.sh@542 -- # cat 00:25:00.300 01:26:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:00.300 01:26:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:00.300 { 00:25:00.300 "params": { 00:25:00.300 "name": "Nvme$subsystem", 00:25:00.300 "trtype": "$TEST_TRANSPORT", 00:25:00.300 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:00.300 "adrfam": "ipv4", 00:25:00.300 "trsvcid": "$NVMF_PORT", 00:25:00.300 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:00.300 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:00.300 "hdgst": ${hdgst:-false}, 00:25:00.300 "ddgst": ${ddgst:-false} 00:25:00.300 }, 00:25:00.300 "method": "bdev_nvme_attach_controller" 00:25:00.300 } 00:25:00.300 EOF 00:25:00.300 )") 00:25:00.300 01:26:08 -- nvmf/common.sh@542 -- # cat 00:25:00.300 01:26:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:00.300 01:26:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:00.300 { 00:25:00.300 "params": { 00:25:00.300 "name": "Nvme$subsystem", 00:25:00.300 "trtype": "$TEST_TRANSPORT", 00:25:00.300 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:00.300 "adrfam": "ipv4", 00:25:00.300 "trsvcid": "$NVMF_PORT", 00:25:00.300 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:00.300 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:00.300 "hdgst": ${hdgst:-false}, 00:25:00.300 "ddgst": ${ddgst:-false} 00:25:00.300 }, 00:25:00.300 "method": "bdev_nvme_attach_controller" 00:25:00.300 } 00:25:00.300 EOF 00:25:00.300 )") 00:25:00.300 01:26:08 -- nvmf/common.sh@542 -- # cat 00:25:00.300 01:26:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:00.300 01:26:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:00.300 { 00:25:00.300 "params": { 00:25:00.300 "name": "Nvme$subsystem", 00:25:00.300 "trtype": "$TEST_TRANSPORT", 00:25:00.300 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:00.300 "adrfam": "ipv4", 00:25:00.300 "trsvcid": "$NVMF_PORT", 00:25:00.300 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:00.300 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:00.300 "hdgst": ${hdgst:-false}, 00:25:00.300 "ddgst": ${ddgst:-false} 00:25:00.300 }, 00:25:00.300 "method": "bdev_nvme_attach_controller" 00:25:00.300 } 00:25:00.300 EOF 00:25:00.300 )") 00:25:00.300 01:26:08 -- nvmf/common.sh@542 -- # cat 00:25:00.300 01:26:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:00.300 01:26:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:00.300 { 00:25:00.300 "params": { 00:25:00.300 "name": "Nvme$subsystem", 00:25:00.300 "trtype": "$TEST_TRANSPORT", 00:25:00.300 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:00.300 "adrfam": "ipv4", 00:25:00.300 "trsvcid": "$NVMF_PORT", 00:25:00.300 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:00.300 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:00.300 "hdgst": ${hdgst:-false}, 00:25:00.300 "ddgst": ${ddgst:-false} 00:25:00.300 }, 00:25:00.300 "method": "bdev_nvme_attach_controller" 00:25:00.300 } 00:25:00.300 EOF 00:25:00.300 )") 00:25:00.300 01:26:08 -- nvmf/common.sh@542 -- # cat 00:25:00.300 01:26:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:00.300 01:26:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:00.300 { 00:25:00.300 "params": { 00:25:00.300 "name": "Nvme$subsystem", 00:25:00.300 "trtype": "$TEST_TRANSPORT", 00:25:00.300 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:00.300 "adrfam": "ipv4", 00:25:00.300 "trsvcid": "$NVMF_PORT", 00:25:00.300 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:00.300 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:00.300 "hdgst": ${hdgst:-false}, 00:25:00.300 "ddgst": ${ddgst:-false} 00:25:00.300 }, 00:25:00.300 "method": "bdev_nvme_attach_controller" 00:25:00.300 } 00:25:00.300 EOF 00:25:00.300 )") 00:25:00.300 01:26:08 -- nvmf/common.sh@542 -- # cat 00:25:00.300 01:26:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:00.300 01:26:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:00.300 { 00:25:00.300 "params": { 00:25:00.300 "name": "Nvme$subsystem", 00:25:00.300 "trtype": "$TEST_TRANSPORT", 00:25:00.300 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:00.300 "adrfam": "ipv4", 00:25:00.300 "trsvcid": "$NVMF_PORT", 00:25:00.300 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:00.300 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:00.300 "hdgst": ${hdgst:-false}, 00:25:00.300 "ddgst": ${ddgst:-false} 00:25:00.300 }, 00:25:00.300 "method": "bdev_nvme_attach_controller" 00:25:00.300 } 00:25:00.300 EOF 00:25:00.300 )") 00:25:00.300 01:26:08 -- nvmf/common.sh@542 -- # cat 00:25:00.300 01:26:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:00.300 01:26:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:00.300 { 00:25:00.300 "params": { 00:25:00.300 "name": "Nvme$subsystem", 00:25:00.300 "trtype": "$TEST_TRANSPORT", 00:25:00.300 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:00.300 "adrfam": "ipv4", 00:25:00.300 "trsvcid": "$NVMF_PORT", 00:25:00.300 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:00.300 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:00.300 "hdgst": ${hdgst:-false}, 00:25:00.300 "ddgst": ${ddgst:-false} 00:25:00.300 }, 00:25:00.300 "method": "bdev_nvme_attach_controller" 00:25:00.300 } 00:25:00.300 EOF 00:25:00.300 )") 00:25:00.300 01:26:08 -- nvmf/common.sh@542 -- # cat 00:25:00.300 01:26:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:00.300 01:26:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:00.300 { 00:25:00.300 "params": { 00:25:00.300 "name": "Nvme$subsystem", 00:25:00.300 "trtype": "$TEST_TRANSPORT", 00:25:00.300 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:00.300 "adrfam": "ipv4", 00:25:00.300 "trsvcid": "$NVMF_PORT", 00:25:00.300 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:00.300 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:00.300 "hdgst": ${hdgst:-false}, 00:25:00.300 "ddgst": ${ddgst:-false} 00:25:00.300 }, 00:25:00.300 "method": "bdev_nvme_attach_controller" 00:25:00.300 } 00:25:00.300 EOF 00:25:00.300 )") 00:25:00.300 01:26:08 -- nvmf/common.sh@542 -- # cat 00:25:00.300 01:26:08 -- nvmf/common.sh@544 -- # jq . 00:25:00.300 01:26:08 -- nvmf/common.sh@545 -- # IFS=, 00:25:00.300 01:26:08 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:00.300 "params": { 00:25:00.300 "name": "Nvme1", 00:25:00.300 "trtype": "tcp", 00:25:00.300 "traddr": "10.0.0.2", 00:25:00.300 "adrfam": "ipv4", 00:25:00.300 "trsvcid": "4420", 00:25:00.300 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:00.300 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:00.300 "hdgst": false, 00:25:00.300 "ddgst": false 00:25:00.300 }, 00:25:00.300 "method": "bdev_nvme_attach_controller" 00:25:00.300 },{ 00:25:00.300 "params": { 00:25:00.300 "name": "Nvme2", 00:25:00.300 "trtype": "tcp", 00:25:00.300 "traddr": "10.0.0.2", 00:25:00.300 "adrfam": "ipv4", 00:25:00.300 "trsvcid": "4420", 00:25:00.300 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:00.300 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:00.300 "hdgst": false, 00:25:00.300 "ddgst": false 00:25:00.300 }, 00:25:00.300 "method": "bdev_nvme_attach_controller" 00:25:00.300 },{ 00:25:00.300 "params": { 00:25:00.300 "name": "Nvme3", 00:25:00.300 "trtype": "tcp", 00:25:00.300 "traddr": "10.0.0.2", 00:25:00.300 "adrfam": "ipv4", 00:25:00.300 "trsvcid": "4420", 00:25:00.300 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:00.300 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:00.300 "hdgst": false, 00:25:00.300 "ddgst": false 00:25:00.300 }, 00:25:00.300 "method": "bdev_nvme_attach_controller" 00:25:00.300 },{ 00:25:00.300 "params": { 00:25:00.300 "name": "Nvme4", 00:25:00.300 "trtype": "tcp", 00:25:00.300 "traddr": "10.0.0.2", 00:25:00.300 "adrfam": "ipv4", 00:25:00.300 "trsvcid": "4420", 00:25:00.300 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:00.300 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:00.300 "hdgst": false, 00:25:00.300 "ddgst": false 00:25:00.301 }, 00:25:00.301 "method": "bdev_nvme_attach_controller" 00:25:00.301 },{ 00:25:00.301 "params": { 00:25:00.301 "name": "Nvme5", 00:25:00.301 "trtype": "tcp", 00:25:00.301 "traddr": "10.0.0.2", 00:25:00.301 "adrfam": "ipv4", 00:25:00.301 "trsvcid": "4420", 00:25:00.301 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:00.301 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:00.301 "hdgst": false, 00:25:00.301 "ddgst": false 00:25:00.301 }, 00:25:00.301 "method": "bdev_nvme_attach_controller" 00:25:00.301 },{ 00:25:00.301 "params": { 00:25:00.301 "name": "Nvme6", 00:25:00.301 "trtype": "tcp", 00:25:00.301 "traddr": "10.0.0.2", 00:25:00.301 "adrfam": "ipv4", 00:25:00.301 "trsvcid": "4420", 00:25:00.301 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:00.301 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:00.301 "hdgst": false, 00:25:00.301 "ddgst": false 00:25:00.301 }, 00:25:00.301 "method": "bdev_nvme_attach_controller" 00:25:00.301 },{ 00:25:00.301 "params": { 00:25:00.301 "name": "Nvme7", 00:25:00.301 "trtype": "tcp", 00:25:00.301 "traddr": "10.0.0.2", 00:25:00.301 "adrfam": "ipv4", 00:25:00.301 "trsvcid": "4420", 00:25:00.301 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:00.301 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:00.301 "hdgst": false, 00:25:00.301 "ddgst": false 00:25:00.301 }, 00:25:00.301 "method": "bdev_nvme_attach_controller" 00:25:00.301 },{ 00:25:00.301 "params": { 00:25:00.301 "name": "Nvme8", 00:25:00.301 "trtype": "tcp", 00:25:00.301 "traddr": "10.0.0.2", 00:25:00.301 "adrfam": "ipv4", 00:25:00.301 "trsvcid": "4420", 00:25:00.301 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:00.301 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:00.301 "hdgst": false, 00:25:00.301 "ddgst": false 00:25:00.301 }, 00:25:00.301 "method": "bdev_nvme_attach_controller" 00:25:00.301 },{ 00:25:00.301 "params": { 00:25:00.301 "name": "Nvme9", 00:25:00.301 "trtype": "tcp", 00:25:00.301 "traddr": "10.0.0.2", 00:25:00.301 "adrfam": "ipv4", 00:25:00.301 "trsvcid": "4420", 00:25:00.301 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:00.301 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:00.301 "hdgst": false, 00:25:00.301 "ddgst": false 00:25:00.301 }, 00:25:00.301 "method": "bdev_nvme_attach_controller" 00:25:00.301 },{ 00:25:00.301 "params": { 00:25:00.301 "name": "Nvme10", 00:25:00.301 "trtype": "tcp", 00:25:00.301 "traddr": "10.0.0.2", 00:25:00.301 "adrfam": "ipv4", 00:25:00.301 "trsvcid": "4420", 00:25:00.301 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:00.301 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:00.301 "hdgst": false, 00:25:00.301 "ddgst": false 00:25:00.301 }, 00:25:00.301 "method": "bdev_nvme_attach_controller" 00:25:00.301 }' 00:25:00.301 [2024-11-20 01:26:08.261191] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:00.301 [2024-11-20 01:26:08.261265] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1214644 ] 00:25:00.301 EAL: No free 2048 kB hugepages reported on node 1 00:25:00.301 [2024-11-20 01:26:08.324396] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:00.301 [2024-11-20 01:26:08.412819] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:02.206 Running I/O for 1 seconds... 00:25:03.141 00:25:03.141 Latency(us) 00:25:03.141 [2024-11-20T00:26:11.360Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:03.141 [2024-11-20T00:26:11.360Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:03.141 Verification LBA range: start 0x0 length 0x400 00:25:03.141 Nvme1n1 : 1.05 378.60 23.66 0.00 0.00 164074.43 44079.03 133596.35 00:25:03.141 [2024-11-20T00:26:11.360Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:03.141 Verification LBA range: start 0x0 length 0x400 00:25:03.141 Nvme2n1 : 1.06 376.52 23.53 0.00 0.00 163560.19 46603.38 136703.24 00:25:03.141 [2024-11-20T00:26:11.360Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:03.141 Verification LBA range: start 0x0 length 0x400 00:25:03.141 Nvme3n1 : 1.07 404.79 25.30 0.00 0.00 153610.05 13204.29 115731.72 00:25:03.141 [2024-11-20T00:26:11.360Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:03.141 Verification LBA range: start 0x0 length 0x400 00:25:03.141 Nvme4n1 : 1.07 403.91 25.24 0.00 0.00 152844.07 12815.93 116508.44 00:25:03.141 [2024-11-20T00:26:11.360Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:03.142 Verification LBA range: start 0x0 length 0x400 00:25:03.142 Nvme5n1 : 1.08 402.80 25.17 0.00 0.00 152063.32 13301.38 118838.61 00:25:03.142 [2024-11-20T00:26:11.361Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:03.142 Verification LBA range: start 0x0 length 0x400 00:25:03.142 Nvme6n1 : 1.08 401.25 25.08 0.00 0.00 151511.20 14078.10 124275.67 00:25:03.142 [2024-11-20T00:26:11.361Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:03.142 Verification LBA range: start 0x0 length 0x400 00:25:03.142 Nvme7n1 : 1.09 398.06 24.88 0.00 0.00 152000.06 11262.48 121168.78 00:25:03.142 [2024-11-20T00:26:11.361Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:03.142 Verification LBA range: start 0x0 length 0x400 00:25:03.142 Nvme8n1 : 1.09 397.19 24.82 0.00 0.00 151473.11 9611.95 123498.95 00:25:03.142 [2024-11-20T00:26:11.361Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:03.142 Verification LBA range: start 0x0 length 0x400 00:25:03.142 Nvme9n1 : 1.10 396.24 24.77 0.00 0.00 150908.02 8204.14 128159.29 00:25:03.142 [2024-11-20T00:26:11.361Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:03.142 Verification LBA range: start 0x0 length 0x400 00:25:03.142 Nvme10n1 : 1.10 395.42 24.71 0.00 0.00 150155.68 8446.86 142140.30 00:25:03.142 [2024-11-20T00:26:11.361Z] =================================================================================================================== 00:25:03.142 [2024-11-20T00:26:11.361Z] Total : 3954.78 247.17 0.00 0.00 154058.11 8204.14 142140.30 00:25:03.402 01:26:11 -- target/shutdown.sh@93 -- # stoptarget 00:25:03.402 01:26:11 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:25:03.402 01:26:11 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:25:03.402 01:26:11 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:03.402 01:26:11 -- target/shutdown.sh@45 -- # nvmftestfini 00:25:03.403 01:26:11 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:03.403 01:26:11 -- nvmf/common.sh@116 -- # sync 00:25:03.403 01:26:11 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:03.403 01:26:11 -- nvmf/common.sh@119 -- # set +e 00:25:03.403 01:26:11 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:03.403 01:26:11 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:03.403 rmmod nvme_tcp 00:25:03.403 rmmod nvme_fabrics 00:25:03.403 rmmod nvme_keyring 00:25:03.403 01:26:11 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:03.403 01:26:11 -- nvmf/common.sh@123 -- # set -e 00:25:03.403 01:26:11 -- nvmf/common.sh@124 -- # return 0 00:25:03.403 01:26:11 -- nvmf/common.sh@477 -- # '[' -n 1214019 ']' 00:25:03.403 01:26:11 -- nvmf/common.sh@478 -- # killprocess 1214019 00:25:03.403 01:26:11 -- common/autotest_common.sh@936 -- # '[' -z 1214019 ']' 00:25:03.403 01:26:11 -- common/autotest_common.sh@940 -- # kill -0 1214019 00:25:03.403 01:26:11 -- common/autotest_common.sh@941 -- # uname 00:25:03.403 01:26:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:03.403 01:26:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1214019 00:25:03.403 01:26:11 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:03.403 01:26:11 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:03.403 01:26:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1214019' 00:25:03.403 killing process with pid 1214019 00:25:03.403 01:26:11 -- common/autotest_common.sh@955 -- # kill 1214019 00:25:03.403 01:26:11 -- common/autotest_common.sh@960 -- # wait 1214019 00:25:03.973 01:26:12 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:03.973 01:26:12 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:03.973 01:26:12 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:03.973 01:26:12 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:03.973 01:26:12 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:03.973 01:26:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:03.973 01:26:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:03.973 01:26:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:05.881 01:26:14 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:05.881 00:25:05.881 real 0m12.298s 00:25:05.881 user 0m36.735s 00:25:05.881 sys 0m3.246s 00:25:05.881 01:26:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:05.881 01:26:14 -- common/autotest_common.sh@10 -- # set +x 00:25:05.881 ************************************ 00:25:05.881 END TEST nvmf_shutdown_tc1 00:25:05.881 ************************************ 00:25:06.140 01:26:14 -- target/shutdown.sh@147 -- # run_test nvmf_shutdown_tc2 nvmf_shutdown_tc2 00:25:06.140 01:26:14 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:25:06.140 01:26:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:06.140 01:26:14 -- common/autotest_common.sh@10 -- # set +x 00:25:06.140 ************************************ 00:25:06.140 START TEST nvmf_shutdown_tc2 00:25:06.140 ************************************ 00:25:06.140 01:26:14 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc2 00:25:06.140 01:26:14 -- target/shutdown.sh@98 -- # starttarget 00:25:06.140 01:26:14 -- target/shutdown.sh@15 -- # nvmftestinit 00:25:06.140 01:26:14 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:06.140 01:26:14 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:06.140 01:26:14 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:06.140 01:26:14 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:06.140 01:26:14 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:06.140 01:26:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:06.140 01:26:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:06.140 01:26:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:06.140 01:26:14 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:06.140 01:26:14 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:06.140 01:26:14 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:06.140 01:26:14 -- common/autotest_common.sh@10 -- # set +x 00:25:06.140 01:26:14 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:06.140 01:26:14 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:06.140 01:26:14 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:06.140 01:26:14 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:06.140 01:26:14 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:06.140 01:26:14 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:06.140 01:26:14 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:06.140 01:26:14 -- nvmf/common.sh@294 -- # net_devs=() 00:25:06.140 01:26:14 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:06.140 01:26:14 -- nvmf/common.sh@295 -- # e810=() 00:25:06.140 01:26:14 -- nvmf/common.sh@295 -- # local -ga e810 00:25:06.140 01:26:14 -- nvmf/common.sh@296 -- # x722=() 00:25:06.140 01:26:14 -- nvmf/common.sh@296 -- # local -ga x722 00:25:06.140 01:26:14 -- nvmf/common.sh@297 -- # mlx=() 00:25:06.140 01:26:14 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:06.141 01:26:14 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:06.141 01:26:14 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:06.141 01:26:14 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:06.141 01:26:14 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:06.141 01:26:14 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:06.141 01:26:14 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:06.141 01:26:14 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:06.141 01:26:14 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:06.141 01:26:14 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:06.141 01:26:14 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:06.141 01:26:14 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:06.141 01:26:14 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:06.141 01:26:14 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:06.141 01:26:14 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:06.141 01:26:14 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:06.141 01:26:14 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:06.141 01:26:14 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:06.141 01:26:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:06.141 01:26:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:06.141 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:06.141 01:26:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:06.141 01:26:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:06.141 01:26:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:06.141 01:26:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:06.141 01:26:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:06.141 01:26:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:06.141 01:26:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:06.141 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:06.141 01:26:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:06.141 01:26:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:06.141 01:26:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:06.141 01:26:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:06.141 01:26:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:06.141 01:26:14 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:06.141 01:26:14 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:06.141 01:26:14 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:06.141 01:26:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:06.141 01:26:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:06.141 01:26:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:06.141 01:26:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:06.141 01:26:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:06.141 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:06.141 01:26:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:06.141 01:26:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:06.141 01:26:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:06.141 01:26:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:06.141 01:26:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:06.141 01:26:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:06.141 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:06.141 01:26:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:06.141 01:26:14 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:06.141 01:26:14 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:06.141 01:26:14 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:06.141 01:26:14 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:06.141 01:26:14 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:06.141 01:26:14 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:06.141 01:26:14 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:06.141 01:26:14 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:06.141 01:26:14 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:06.141 01:26:14 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:06.141 01:26:14 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:06.141 01:26:14 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:06.141 01:26:14 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:06.141 01:26:14 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:06.141 01:26:14 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:06.141 01:26:14 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:06.141 01:26:14 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:06.141 01:26:14 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:06.141 01:26:14 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:06.141 01:26:14 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:06.141 01:26:14 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:06.141 01:26:14 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:06.141 01:26:14 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:06.141 01:26:14 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:06.141 01:26:14 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:06.141 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:06.141 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.317 ms 00:25:06.141 00:25:06.141 --- 10.0.0.2 ping statistics --- 00:25:06.141 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:06.141 rtt min/avg/max/mdev = 0.317/0.317/0.317/0.000 ms 00:25:06.141 01:26:14 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:06.141 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:06.141 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.129 ms 00:25:06.141 00:25:06.141 --- 10.0.0.1 ping statistics --- 00:25:06.141 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:06.141 rtt min/avg/max/mdev = 0.129/0.129/0.129/0.000 ms 00:25:06.141 01:26:14 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:06.141 01:26:14 -- nvmf/common.sh@410 -- # return 0 00:25:06.141 01:26:14 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:06.141 01:26:14 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:06.141 01:26:14 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:06.141 01:26:14 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:06.141 01:26:14 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:06.141 01:26:14 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:06.141 01:26:14 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:06.141 01:26:14 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:25:06.141 01:26:14 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:06.141 01:26:14 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:06.141 01:26:14 -- common/autotest_common.sh@10 -- # set +x 00:25:06.141 01:26:14 -- nvmf/common.sh@469 -- # nvmfpid=1215429 00:25:06.141 01:26:14 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:25:06.141 01:26:14 -- nvmf/common.sh@470 -- # waitforlisten 1215429 00:25:06.141 01:26:14 -- common/autotest_common.sh@829 -- # '[' -z 1215429 ']' 00:25:06.141 01:26:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:06.141 01:26:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:06.141 01:26:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:06.141 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:06.141 01:26:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:06.141 01:26:14 -- common/autotest_common.sh@10 -- # set +x 00:25:06.141 [2024-11-20 01:26:14.333138] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:06.141 [2024-11-20 01:26:14.333211] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:06.400 EAL: No free 2048 kB hugepages reported on node 1 00:25:06.400 [2024-11-20 01:26:14.400133] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:06.400 [2024-11-20 01:26:14.492744] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:06.400 [2024-11-20 01:26:14.492901] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:06.400 [2024-11-20 01:26:14.492918] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:06.400 [2024-11-20 01:26:14.492931] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:06.400 [2024-11-20 01:26:14.492991] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:06.400 [2024-11-20 01:26:14.493054] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:06.400 [2024-11-20 01:26:14.493120] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:25:06.400 [2024-11-20 01:26:14.493123] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:07.337 01:26:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:07.337 01:26:15 -- common/autotest_common.sh@862 -- # return 0 00:25:07.337 01:26:15 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:07.337 01:26:15 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:07.337 01:26:15 -- common/autotest_common.sh@10 -- # set +x 00:25:07.337 01:26:15 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:07.337 01:26:15 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:07.337 01:26:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:07.337 01:26:15 -- common/autotest_common.sh@10 -- # set +x 00:25:07.337 [2024-11-20 01:26:15.413952] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:07.337 01:26:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:07.337 01:26:15 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:25:07.337 01:26:15 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:25:07.337 01:26:15 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:07.337 01:26:15 -- common/autotest_common.sh@10 -- # set +x 00:25:07.337 01:26:15 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:07.337 01:26:15 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:07.337 01:26:15 -- target/shutdown.sh@28 -- # cat 00:25:07.337 01:26:15 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:07.337 01:26:15 -- target/shutdown.sh@28 -- # cat 00:25:07.337 01:26:15 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:07.337 01:26:15 -- target/shutdown.sh@28 -- # cat 00:25:07.337 01:26:15 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:07.337 01:26:15 -- target/shutdown.sh@28 -- # cat 00:25:07.337 01:26:15 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:07.337 01:26:15 -- target/shutdown.sh@28 -- # cat 00:25:07.337 01:26:15 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:07.337 01:26:15 -- target/shutdown.sh@28 -- # cat 00:25:07.337 01:26:15 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:07.337 01:26:15 -- target/shutdown.sh@28 -- # cat 00:25:07.337 01:26:15 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:07.337 01:26:15 -- target/shutdown.sh@28 -- # cat 00:25:07.337 01:26:15 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:07.337 01:26:15 -- target/shutdown.sh@28 -- # cat 00:25:07.337 01:26:15 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:07.337 01:26:15 -- target/shutdown.sh@28 -- # cat 00:25:07.337 01:26:15 -- target/shutdown.sh@35 -- # rpc_cmd 00:25:07.337 01:26:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:07.337 01:26:15 -- common/autotest_common.sh@10 -- # set +x 00:25:07.337 Malloc1 00:25:07.337 [2024-11-20 01:26:15.503532] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:07.337 Malloc2 00:25:07.595 Malloc3 00:25:07.595 Malloc4 00:25:07.595 Malloc5 00:25:07.595 Malloc6 00:25:07.595 Malloc7 00:25:07.854 Malloc8 00:25:07.854 Malloc9 00:25:07.854 Malloc10 00:25:07.854 01:26:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:07.854 01:26:15 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:25:07.854 01:26:15 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:07.854 01:26:15 -- common/autotest_common.sh@10 -- # set +x 00:25:07.854 01:26:15 -- target/shutdown.sh@102 -- # perfpid=1215739 00:25:07.854 01:26:15 -- target/shutdown.sh@103 -- # waitforlisten 1215739 /var/tmp/bdevperf.sock 00:25:07.854 01:26:15 -- common/autotest_common.sh@829 -- # '[' -z 1215739 ']' 00:25:07.854 01:26:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:07.854 01:26:15 -- target/shutdown.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:25:07.854 01:26:15 -- target/shutdown.sh@101 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:07.854 01:26:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:07.854 01:26:15 -- nvmf/common.sh@520 -- # config=() 00:25:07.854 01:26:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:07.854 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:07.854 01:26:15 -- nvmf/common.sh@520 -- # local subsystem config 00:25:07.854 01:26:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:07.854 01:26:15 -- common/autotest_common.sh@10 -- # set +x 00:25:07.854 01:26:15 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:07.854 01:26:15 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:07.854 { 00:25:07.854 "params": { 00:25:07.854 "name": "Nvme$subsystem", 00:25:07.854 "trtype": "$TEST_TRANSPORT", 00:25:07.854 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:07.854 "adrfam": "ipv4", 00:25:07.855 "trsvcid": "$NVMF_PORT", 00:25:07.855 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:07.855 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:07.855 "hdgst": ${hdgst:-false}, 00:25:07.855 "ddgst": ${ddgst:-false} 00:25:07.855 }, 00:25:07.855 "method": "bdev_nvme_attach_controller" 00:25:07.855 } 00:25:07.855 EOF 00:25:07.855 )") 00:25:07.855 01:26:15 -- nvmf/common.sh@542 -- # cat 00:25:07.855 01:26:15 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:07.855 01:26:15 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:07.855 { 00:25:07.855 "params": { 00:25:07.855 "name": "Nvme$subsystem", 00:25:07.855 "trtype": "$TEST_TRANSPORT", 00:25:07.855 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:07.855 "adrfam": "ipv4", 00:25:07.855 "trsvcid": "$NVMF_PORT", 00:25:07.855 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:07.855 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:07.855 "hdgst": ${hdgst:-false}, 00:25:07.855 "ddgst": ${ddgst:-false} 00:25:07.855 }, 00:25:07.855 "method": "bdev_nvme_attach_controller" 00:25:07.855 } 00:25:07.855 EOF 00:25:07.855 )") 00:25:07.855 01:26:15 -- nvmf/common.sh@542 -- # cat 00:25:07.855 01:26:15 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:07.855 01:26:15 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:07.855 { 00:25:07.855 "params": { 00:25:07.855 "name": "Nvme$subsystem", 00:25:07.855 "trtype": "$TEST_TRANSPORT", 00:25:07.855 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:07.855 "adrfam": "ipv4", 00:25:07.855 "trsvcid": "$NVMF_PORT", 00:25:07.855 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:07.855 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:07.855 "hdgst": ${hdgst:-false}, 00:25:07.855 "ddgst": ${ddgst:-false} 00:25:07.855 }, 00:25:07.855 "method": "bdev_nvme_attach_controller" 00:25:07.855 } 00:25:07.855 EOF 00:25:07.855 )") 00:25:07.855 01:26:15 -- nvmf/common.sh@542 -- # cat 00:25:07.855 01:26:15 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:07.855 01:26:15 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:07.855 { 00:25:07.855 "params": { 00:25:07.855 "name": "Nvme$subsystem", 00:25:07.855 "trtype": "$TEST_TRANSPORT", 00:25:07.855 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:07.855 "adrfam": "ipv4", 00:25:07.855 "trsvcid": "$NVMF_PORT", 00:25:07.855 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:07.855 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:07.855 "hdgst": ${hdgst:-false}, 00:25:07.855 "ddgst": ${ddgst:-false} 00:25:07.855 }, 00:25:07.855 "method": "bdev_nvme_attach_controller" 00:25:07.855 } 00:25:07.855 EOF 00:25:07.855 )") 00:25:07.855 01:26:15 -- nvmf/common.sh@542 -- # cat 00:25:07.855 01:26:15 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:07.855 01:26:15 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:07.855 { 00:25:07.855 "params": { 00:25:07.855 "name": "Nvme$subsystem", 00:25:07.855 "trtype": "$TEST_TRANSPORT", 00:25:07.855 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:07.855 "adrfam": "ipv4", 00:25:07.855 "trsvcid": "$NVMF_PORT", 00:25:07.855 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:07.855 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:07.855 "hdgst": ${hdgst:-false}, 00:25:07.855 "ddgst": ${ddgst:-false} 00:25:07.855 }, 00:25:07.855 "method": "bdev_nvme_attach_controller" 00:25:07.855 } 00:25:07.855 EOF 00:25:07.855 )") 00:25:07.855 01:26:15 -- nvmf/common.sh@542 -- # cat 00:25:07.855 01:26:15 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:07.855 01:26:15 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:07.855 { 00:25:07.855 "params": { 00:25:07.855 "name": "Nvme$subsystem", 00:25:07.855 "trtype": "$TEST_TRANSPORT", 00:25:07.855 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:07.855 "adrfam": "ipv4", 00:25:07.855 "trsvcid": "$NVMF_PORT", 00:25:07.855 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:07.855 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:07.855 "hdgst": ${hdgst:-false}, 00:25:07.855 "ddgst": ${ddgst:-false} 00:25:07.855 }, 00:25:07.855 "method": "bdev_nvme_attach_controller" 00:25:07.855 } 00:25:07.855 EOF 00:25:07.855 )") 00:25:07.855 01:26:15 -- nvmf/common.sh@542 -- # cat 00:25:07.855 01:26:15 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:07.855 01:26:15 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:07.855 { 00:25:07.855 "params": { 00:25:07.855 "name": "Nvme$subsystem", 00:25:07.855 "trtype": "$TEST_TRANSPORT", 00:25:07.855 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:07.855 "adrfam": "ipv4", 00:25:07.855 "trsvcid": "$NVMF_PORT", 00:25:07.855 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:07.855 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:07.855 "hdgst": ${hdgst:-false}, 00:25:07.855 "ddgst": ${ddgst:-false} 00:25:07.855 }, 00:25:07.855 "method": "bdev_nvme_attach_controller" 00:25:07.855 } 00:25:07.855 EOF 00:25:07.855 )") 00:25:07.855 01:26:15 -- nvmf/common.sh@542 -- # cat 00:25:07.855 01:26:15 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:07.855 01:26:15 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:07.855 { 00:25:07.855 "params": { 00:25:07.855 "name": "Nvme$subsystem", 00:25:07.855 "trtype": "$TEST_TRANSPORT", 00:25:07.855 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:07.855 "adrfam": "ipv4", 00:25:07.855 "trsvcid": "$NVMF_PORT", 00:25:07.855 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:07.855 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:07.855 "hdgst": ${hdgst:-false}, 00:25:07.855 "ddgst": ${ddgst:-false} 00:25:07.855 }, 00:25:07.855 "method": "bdev_nvme_attach_controller" 00:25:07.855 } 00:25:07.855 EOF 00:25:07.855 )") 00:25:07.855 01:26:15 -- nvmf/common.sh@542 -- # cat 00:25:07.855 01:26:15 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:07.855 01:26:15 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:07.855 { 00:25:07.855 "params": { 00:25:07.855 "name": "Nvme$subsystem", 00:25:07.855 "trtype": "$TEST_TRANSPORT", 00:25:07.855 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:07.855 "adrfam": "ipv4", 00:25:07.855 "trsvcid": "$NVMF_PORT", 00:25:07.855 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:07.855 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:07.855 "hdgst": ${hdgst:-false}, 00:25:07.855 "ddgst": ${ddgst:-false} 00:25:07.855 }, 00:25:07.855 "method": "bdev_nvme_attach_controller" 00:25:07.855 } 00:25:07.855 EOF 00:25:07.855 )") 00:25:07.855 01:26:15 -- nvmf/common.sh@542 -- # cat 00:25:07.855 01:26:15 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:07.855 01:26:15 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:07.855 { 00:25:07.855 "params": { 00:25:07.855 "name": "Nvme$subsystem", 00:25:07.855 "trtype": "$TEST_TRANSPORT", 00:25:07.855 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:07.855 "adrfam": "ipv4", 00:25:07.855 "trsvcid": "$NVMF_PORT", 00:25:07.855 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:07.855 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:07.855 "hdgst": ${hdgst:-false}, 00:25:07.855 "ddgst": ${ddgst:-false} 00:25:07.855 }, 00:25:07.855 "method": "bdev_nvme_attach_controller" 00:25:07.855 } 00:25:07.855 EOF 00:25:07.855 )") 00:25:07.855 01:26:15 -- nvmf/common.sh@542 -- # cat 00:25:07.855 01:26:15 -- nvmf/common.sh@544 -- # jq . 00:25:07.855 01:26:15 -- nvmf/common.sh@545 -- # IFS=, 00:25:07.855 01:26:15 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:07.855 "params": { 00:25:07.855 "name": "Nvme1", 00:25:07.855 "trtype": "tcp", 00:25:07.855 "traddr": "10.0.0.2", 00:25:07.855 "adrfam": "ipv4", 00:25:07.855 "trsvcid": "4420", 00:25:07.855 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:07.855 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:07.855 "hdgst": false, 00:25:07.855 "ddgst": false 00:25:07.855 }, 00:25:07.855 "method": "bdev_nvme_attach_controller" 00:25:07.855 },{ 00:25:07.855 "params": { 00:25:07.855 "name": "Nvme2", 00:25:07.855 "trtype": "tcp", 00:25:07.855 "traddr": "10.0.0.2", 00:25:07.855 "adrfam": "ipv4", 00:25:07.855 "trsvcid": "4420", 00:25:07.855 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:07.855 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:07.855 "hdgst": false, 00:25:07.855 "ddgst": false 00:25:07.855 }, 00:25:07.855 "method": "bdev_nvme_attach_controller" 00:25:07.855 },{ 00:25:07.855 "params": { 00:25:07.855 "name": "Nvme3", 00:25:07.855 "trtype": "tcp", 00:25:07.855 "traddr": "10.0.0.2", 00:25:07.855 "adrfam": "ipv4", 00:25:07.855 "trsvcid": "4420", 00:25:07.855 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:07.855 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:07.855 "hdgst": false, 00:25:07.855 "ddgst": false 00:25:07.855 }, 00:25:07.855 "method": "bdev_nvme_attach_controller" 00:25:07.855 },{ 00:25:07.855 "params": { 00:25:07.855 "name": "Nvme4", 00:25:07.855 "trtype": "tcp", 00:25:07.855 "traddr": "10.0.0.2", 00:25:07.855 "adrfam": "ipv4", 00:25:07.855 "trsvcid": "4420", 00:25:07.855 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:07.855 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:07.855 "hdgst": false, 00:25:07.855 "ddgst": false 00:25:07.855 }, 00:25:07.855 "method": "bdev_nvme_attach_controller" 00:25:07.856 },{ 00:25:07.856 "params": { 00:25:07.856 "name": "Nvme5", 00:25:07.856 "trtype": "tcp", 00:25:07.856 "traddr": "10.0.0.2", 00:25:07.856 "adrfam": "ipv4", 00:25:07.856 "trsvcid": "4420", 00:25:07.856 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:07.856 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:07.856 "hdgst": false, 00:25:07.856 "ddgst": false 00:25:07.856 }, 00:25:07.856 "method": "bdev_nvme_attach_controller" 00:25:07.856 },{ 00:25:07.856 "params": { 00:25:07.856 "name": "Nvme6", 00:25:07.856 "trtype": "tcp", 00:25:07.856 "traddr": "10.0.0.2", 00:25:07.856 "adrfam": "ipv4", 00:25:07.856 "trsvcid": "4420", 00:25:07.856 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:07.856 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:07.856 "hdgst": false, 00:25:07.856 "ddgst": false 00:25:07.856 }, 00:25:07.856 "method": "bdev_nvme_attach_controller" 00:25:07.856 },{ 00:25:07.856 "params": { 00:25:07.856 "name": "Nvme7", 00:25:07.856 "trtype": "tcp", 00:25:07.856 "traddr": "10.0.0.2", 00:25:07.856 "adrfam": "ipv4", 00:25:07.856 "trsvcid": "4420", 00:25:07.856 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:07.856 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:07.856 "hdgst": false, 00:25:07.856 "ddgst": false 00:25:07.856 }, 00:25:07.856 "method": "bdev_nvme_attach_controller" 00:25:07.856 },{ 00:25:07.856 "params": { 00:25:07.856 "name": "Nvme8", 00:25:07.856 "trtype": "tcp", 00:25:07.856 "traddr": "10.0.0.2", 00:25:07.856 "adrfam": "ipv4", 00:25:07.856 "trsvcid": "4420", 00:25:07.856 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:07.856 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:07.856 "hdgst": false, 00:25:07.856 "ddgst": false 00:25:07.856 }, 00:25:07.856 "method": "bdev_nvme_attach_controller" 00:25:07.856 },{ 00:25:07.856 "params": { 00:25:07.856 "name": "Nvme9", 00:25:07.856 "trtype": "tcp", 00:25:07.856 "traddr": "10.0.0.2", 00:25:07.856 "adrfam": "ipv4", 00:25:07.856 "trsvcid": "4420", 00:25:07.856 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:07.856 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:07.856 "hdgst": false, 00:25:07.856 "ddgst": false 00:25:07.856 }, 00:25:07.856 "method": "bdev_nvme_attach_controller" 00:25:07.856 },{ 00:25:07.856 "params": { 00:25:07.856 "name": "Nvme10", 00:25:07.856 "trtype": "tcp", 00:25:07.856 "traddr": "10.0.0.2", 00:25:07.856 "adrfam": "ipv4", 00:25:07.856 "trsvcid": "4420", 00:25:07.856 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:07.856 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:07.856 "hdgst": false, 00:25:07.856 "ddgst": false 00:25:07.856 }, 00:25:07.856 "method": "bdev_nvme_attach_controller" 00:25:07.856 }' 00:25:07.856 [2024-11-20 01:26:16.006819] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:07.856 [2024-11-20 01:26:16.006895] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1215739 ] 00:25:07.856 EAL: No free 2048 kB hugepages reported on node 1 00:25:08.116 [2024-11-20 01:26:16.070936] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:08.116 [2024-11-20 01:26:16.156485] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:09.494 Running I/O for 10 seconds... 00:25:09.753 01:26:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:09.753 01:26:17 -- common/autotest_common.sh@862 -- # return 0 00:25:09.753 01:26:17 -- target/shutdown.sh@104 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:25:09.753 01:26:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:09.753 01:26:17 -- common/autotest_common.sh@10 -- # set +x 00:25:09.753 01:26:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:09.753 01:26:17 -- target/shutdown.sh@106 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:25:09.753 01:26:17 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:25:09.753 01:26:17 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:25:09.753 01:26:17 -- target/shutdown.sh@57 -- # local ret=1 00:25:09.753 01:26:17 -- target/shutdown.sh@58 -- # local i 00:25:09.753 01:26:17 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:25:09.753 01:26:17 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:25:09.753 01:26:17 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:25:09.753 01:26:17 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:25:09.753 01:26:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:09.753 01:26:17 -- common/autotest_common.sh@10 -- # set +x 00:25:09.753 01:26:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:09.753 01:26:17 -- target/shutdown.sh@60 -- # read_io_count=87 00:25:09.753 01:26:17 -- target/shutdown.sh@63 -- # '[' 87 -ge 100 ']' 00:25:09.753 01:26:17 -- target/shutdown.sh@67 -- # sleep 0.25 00:25:10.013 01:26:18 -- target/shutdown.sh@59 -- # (( i-- )) 00:25:10.013 01:26:18 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:25:10.013 01:26:18 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:25:10.013 01:26:18 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:25:10.013 01:26:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:10.013 01:26:18 -- common/autotest_common.sh@10 -- # set +x 00:25:10.013 01:26:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:10.013 01:26:18 -- target/shutdown.sh@60 -- # read_io_count=213 00:25:10.013 01:26:18 -- target/shutdown.sh@63 -- # '[' 213 -ge 100 ']' 00:25:10.013 01:26:18 -- target/shutdown.sh@64 -- # ret=0 00:25:10.013 01:26:18 -- target/shutdown.sh@65 -- # break 00:25:10.013 01:26:18 -- target/shutdown.sh@69 -- # return 0 00:25:10.013 01:26:18 -- target/shutdown.sh@109 -- # killprocess 1215739 00:25:10.013 01:26:18 -- common/autotest_common.sh@936 -- # '[' -z 1215739 ']' 00:25:10.013 01:26:18 -- common/autotest_common.sh@940 -- # kill -0 1215739 00:25:10.013 01:26:18 -- common/autotest_common.sh@941 -- # uname 00:25:10.013 01:26:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:10.013 01:26:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1215739 00:25:10.013 01:26:18 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:10.013 01:26:18 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:10.013 01:26:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1215739' 00:25:10.013 killing process with pid 1215739 00:25:10.013 01:26:18 -- common/autotest_common.sh@955 -- # kill 1215739 00:25:10.013 01:26:18 -- common/autotest_common.sh@960 -- # wait 1215739 00:25:10.274 Received shutdown signal, test time was about 0.682438 seconds 00:25:10.274 00:25:10.274 Latency(us) 00:25:10.274 [2024-11-20T00:26:18.493Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:10.274 [2024-11-20T00:26:18.493Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:10.274 Verification LBA range: start 0x0 length 0x400 00:25:10.274 Nvme1n1 : 0.66 417.26 26.08 0.00 0.00 148657.85 7621.59 131266.18 00:25:10.274 [2024-11-20T00:26:18.493Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:10.274 Verification LBA range: start 0x0 length 0x400 00:25:10.274 Nvme2n1 : 0.67 406.43 25.40 0.00 0.00 150661.77 25049.32 141363.58 00:25:10.274 [2024-11-20T00:26:18.493Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:10.274 Verification LBA range: start 0x0 length 0x400 00:25:10.274 Nvme3n1 : 0.65 415.34 25.96 0.00 0.00 145794.58 23301.69 114955.00 00:25:10.274 [2024-11-20T00:26:18.493Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:10.274 Verification LBA range: start 0x0 length 0x400 00:25:10.274 Nvme4n1 : 0.66 410.54 25.66 0.00 0.00 145423.17 25826.04 113401.55 00:25:10.274 [2024-11-20T00:26:18.493Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:10.274 Verification LBA range: start 0x0 length 0x400 00:25:10.274 Nvme5n1 : 0.67 407.64 25.48 0.00 0.00 144567.92 26991.12 113401.55 00:25:10.274 [2024-11-20T00:26:18.493Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:10.274 Verification LBA range: start 0x0 length 0x400 00:25:10.274 Nvme6n1 : 0.67 403.59 25.22 0.00 0.00 144224.53 28156.21 121168.78 00:25:10.274 [2024-11-20T00:26:18.493Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:10.274 Verification LBA range: start 0x0 length 0x400 00:25:10.274 Nvme7n1 : 0.67 404.49 25.28 0.00 0.00 142673.94 24855.13 120392.06 00:25:10.274 [2024-11-20T00:26:18.493Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:10.274 Verification LBA range: start 0x0 length 0x400 00:25:10.274 Nvme8n1 : 0.68 401.93 25.12 0.00 0.00 141852.24 25437.68 118061.89 00:25:10.274 [2024-11-20T00:26:18.493Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:10.274 Verification LBA range: start 0x0 length 0x400 00:25:10.274 Nvme9n1 : 0.68 400.40 25.03 0.00 0.00 141834.93 18932.62 122722.23 00:25:10.274 [2024-11-20T00:26:18.493Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:10.274 Verification LBA range: start 0x0 length 0x400 00:25:10.274 Nvme10n1 : 0.68 399.05 24.94 0.00 0.00 141198.85 15922.82 121945.51 00:25:10.274 [2024-11-20T00:26:18.493Z] =================================================================================================================== 00:25:10.274 [2024-11-20T00:26:18.493Z] Total : 4066.68 254.17 0.00 0.00 144691.89 7621.59 141363.58 00:25:10.534 01:26:18 -- target/shutdown.sh@112 -- # sleep 1 00:25:11.524 01:26:19 -- target/shutdown.sh@113 -- # kill -0 1215429 00:25:11.525 01:26:19 -- target/shutdown.sh@115 -- # stoptarget 00:25:11.525 01:26:19 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:25:11.525 01:26:19 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:25:11.525 01:26:19 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:11.525 01:26:19 -- target/shutdown.sh@45 -- # nvmftestfini 00:25:11.525 01:26:19 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:11.525 01:26:19 -- nvmf/common.sh@116 -- # sync 00:25:11.525 01:26:19 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:11.525 01:26:19 -- nvmf/common.sh@119 -- # set +e 00:25:11.525 01:26:19 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:11.525 01:26:19 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:11.525 rmmod nvme_tcp 00:25:11.525 rmmod nvme_fabrics 00:25:11.525 rmmod nvme_keyring 00:25:11.525 01:26:19 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:11.525 01:26:19 -- nvmf/common.sh@123 -- # set -e 00:25:11.525 01:26:19 -- nvmf/common.sh@124 -- # return 0 00:25:11.525 01:26:19 -- nvmf/common.sh@477 -- # '[' -n 1215429 ']' 00:25:11.525 01:26:19 -- nvmf/common.sh@478 -- # killprocess 1215429 00:25:11.525 01:26:19 -- common/autotest_common.sh@936 -- # '[' -z 1215429 ']' 00:25:11.525 01:26:19 -- common/autotest_common.sh@940 -- # kill -0 1215429 00:25:11.525 01:26:19 -- common/autotest_common.sh@941 -- # uname 00:25:11.525 01:26:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:11.525 01:26:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1215429 00:25:11.525 01:26:19 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:11.525 01:26:19 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:11.525 01:26:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1215429' 00:25:11.525 killing process with pid 1215429 00:25:11.525 01:26:19 -- common/autotest_common.sh@955 -- # kill 1215429 00:25:11.525 01:26:19 -- common/autotest_common.sh@960 -- # wait 1215429 00:25:12.094 01:26:20 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:12.094 01:26:20 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:12.094 01:26:20 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:12.094 01:26:20 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:12.094 01:26:20 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:12.094 01:26:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:12.094 01:26:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:12.094 01:26:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:14.002 01:26:22 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:14.002 00:25:14.002 real 0m8.030s 00:25:14.002 user 0m24.989s 00:25:14.002 sys 0m1.406s 00:25:14.002 01:26:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:14.002 01:26:22 -- common/autotest_common.sh@10 -- # set +x 00:25:14.002 ************************************ 00:25:14.002 END TEST nvmf_shutdown_tc2 00:25:14.002 ************************************ 00:25:14.002 01:26:22 -- target/shutdown.sh@148 -- # run_test nvmf_shutdown_tc3 nvmf_shutdown_tc3 00:25:14.002 01:26:22 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:25:14.002 01:26:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:14.002 01:26:22 -- common/autotest_common.sh@10 -- # set +x 00:25:14.002 ************************************ 00:25:14.002 START TEST nvmf_shutdown_tc3 00:25:14.002 ************************************ 00:25:14.002 01:26:22 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc3 00:25:14.002 01:26:22 -- target/shutdown.sh@120 -- # starttarget 00:25:14.002 01:26:22 -- target/shutdown.sh@15 -- # nvmftestinit 00:25:14.002 01:26:22 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:14.002 01:26:22 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:14.002 01:26:22 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:14.002 01:26:22 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:14.002 01:26:22 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:14.002 01:26:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:14.002 01:26:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:14.002 01:26:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:14.002 01:26:22 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:14.002 01:26:22 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:14.002 01:26:22 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:14.002 01:26:22 -- common/autotest_common.sh@10 -- # set +x 00:25:14.002 01:26:22 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:14.002 01:26:22 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:14.002 01:26:22 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:14.002 01:26:22 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:14.002 01:26:22 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:14.002 01:26:22 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:14.002 01:26:22 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:14.002 01:26:22 -- nvmf/common.sh@294 -- # net_devs=() 00:25:14.002 01:26:22 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:14.002 01:26:22 -- nvmf/common.sh@295 -- # e810=() 00:25:14.002 01:26:22 -- nvmf/common.sh@295 -- # local -ga e810 00:25:14.002 01:26:22 -- nvmf/common.sh@296 -- # x722=() 00:25:14.002 01:26:22 -- nvmf/common.sh@296 -- # local -ga x722 00:25:14.002 01:26:22 -- nvmf/common.sh@297 -- # mlx=() 00:25:14.002 01:26:22 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:14.002 01:26:22 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:14.002 01:26:22 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:14.002 01:26:22 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:14.002 01:26:22 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:14.002 01:26:22 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:14.002 01:26:22 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:14.002 01:26:22 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:14.002 01:26:22 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:14.002 01:26:22 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:14.002 01:26:22 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:14.002 01:26:22 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:14.002 01:26:22 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:14.002 01:26:22 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:14.002 01:26:22 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:14.002 01:26:22 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:14.002 01:26:22 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:14.002 01:26:22 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:14.002 01:26:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:14.002 01:26:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:14.002 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:14.002 01:26:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:14.002 01:26:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:14.002 01:26:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:14.002 01:26:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:14.002 01:26:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:14.002 01:26:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:14.002 01:26:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:14.002 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:14.002 01:26:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:14.002 01:26:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:14.002 01:26:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:14.002 01:26:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:14.002 01:26:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:14.002 01:26:22 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:14.002 01:26:22 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:14.002 01:26:22 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:14.002 01:26:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:14.002 01:26:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:14.002 01:26:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:14.002 01:26:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:14.002 01:26:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:14.002 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:14.002 01:26:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:14.002 01:26:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:14.002 01:26:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:14.003 01:26:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:14.003 01:26:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:14.003 01:26:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:14.003 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:14.003 01:26:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:14.003 01:26:22 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:14.003 01:26:22 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:14.003 01:26:22 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:14.003 01:26:22 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:14.003 01:26:22 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:14.003 01:26:22 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:14.003 01:26:22 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:14.003 01:26:22 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:14.003 01:26:22 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:14.003 01:26:22 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:14.003 01:26:22 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:14.003 01:26:22 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:14.003 01:26:22 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:14.003 01:26:22 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:14.003 01:26:22 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:14.003 01:26:22 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:14.003 01:26:22 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:14.261 01:26:22 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:14.261 01:26:22 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:14.261 01:26:22 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:14.261 01:26:22 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:14.261 01:26:22 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:14.261 01:26:22 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:14.261 01:26:22 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:14.261 01:26:22 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:14.261 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:14.261 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.251 ms 00:25:14.261 00:25:14.261 --- 10.0.0.2 ping statistics --- 00:25:14.261 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:14.261 rtt min/avg/max/mdev = 0.251/0.251/0.251/0.000 ms 00:25:14.261 01:26:22 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:14.261 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:14.261 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.127 ms 00:25:14.261 00:25:14.261 --- 10.0.0.1 ping statistics --- 00:25:14.261 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:14.261 rtt min/avg/max/mdev = 0.127/0.127/0.127/0.000 ms 00:25:14.261 01:26:22 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:14.261 01:26:22 -- nvmf/common.sh@410 -- # return 0 00:25:14.261 01:26:22 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:14.261 01:26:22 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:14.261 01:26:22 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:14.261 01:26:22 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:14.261 01:26:22 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:14.261 01:26:22 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:14.261 01:26:22 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:14.261 01:26:22 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:25:14.261 01:26:22 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:14.261 01:26:22 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:14.261 01:26:22 -- common/autotest_common.sh@10 -- # set +x 00:25:14.261 01:26:22 -- nvmf/common.sh@469 -- # nvmfpid=1216554 00:25:14.261 01:26:22 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:25:14.261 01:26:22 -- nvmf/common.sh@470 -- # waitforlisten 1216554 00:25:14.261 01:26:22 -- common/autotest_common.sh@829 -- # '[' -z 1216554 ']' 00:25:14.261 01:26:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:14.261 01:26:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:14.261 01:26:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:14.261 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:14.261 01:26:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:14.262 01:26:22 -- common/autotest_common.sh@10 -- # set +x 00:25:14.522 [2024-11-20 01:26:22.480555] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:14.522 [2024-11-20 01:26:22.480636] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:14.522 EAL: No free 2048 kB hugepages reported on node 1 00:25:14.522 [2024-11-20 01:26:22.548901] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:14.522 [2024-11-20 01:26:22.643659] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:14.522 [2024-11-20 01:26:22.643813] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:14.522 [2024-11-20 01:26:22.643833] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:14.522 [2024-11-20 01:26:22.643846] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:14.522 [2024-11-20 01:26:22.644011] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:14.522 [2024-11-20 01:26:22.644097] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:14.522 [2024-11-20 01:26:22.644127] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:25:14.522 [2024-11-20 01:26:22.644130] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:15.459 01:26:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:15.459 01:26:23 -- common/autotest_common.sh@862 -- # return 0 00:25:15.459 01:26:23 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:15.459 01:26:23 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:15.459 01:26:23 -- common/autotest_common.sh@10 -- # set +x 00:25:15.459 01:26:23 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:15.459 01:26:23 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:15.459 01:26:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:15.459 01:26:23 -- common/autotest_common.sh@10 -- # set +x 00:25:15.459 [2024-11-20 01:26:23.533925] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:15.459 01:26:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:15.459 01:26:23 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:25:15.459 01:26:23 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:25:15.459 01:26:23 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:15.459 01:26:23 -- common/autotest_common.sh@10 -- # set +x 00:25:15.459 01:26:23 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:15.459 01:26:23 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:15.459 01:26:23 -- target/shutdown.sh@28 -- # cat 00:25:15.459 01:26:23 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:15.459 01:26:23 -- target/shutdown.sh@28 -- # cat 00:25:15.459 01:26:23 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:15.459 01:26:23 -- target/shutdown.sh@28 -- # cat 00:25:15.459 01:26:23 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:15.459 01:26:23 -- target/shutdown.sh@28 -- # cat 00:25:15.459 01:26:23 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:15.459 01:26:23 -- target/shutdown.sh@28 -- # cat 00:25:15.459 01:26:23 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:15.459 01:26:23 -- target/shutdown.sh@28 -- # cat 00:25:15.459 01:26:23 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:15.459 01:26:23 -- target/shutdown.sh@28 -- # cat 00:25:15.459 01:26:23 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:15.459 01:26:23 -- target/shutdown.sh@28 -- # cat 00:25:15.459 01:26:23 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:15.459 01:26:23 -- target/shutdown.sh@28 -- # cat 00:25:15.459 01:26:23 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:15.459 01:26:23 -- target/shutdown.sh@28 -- # cat 00:25:15.459 01:26:23 -- target/shutdown.sh@35 -- # rpc_cmd 00:25:15.459 01:26:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:15.459 01:26:23 -- common/autotest_common.sh@10 -- # set +x 00:25:15.459 Malloc1 00:25:15.459 [2024-11-20 01:26:23.619648] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:15.459 Malloc2 00:25:15.719 Malloc3 00:25:15.719 Malloc4 00:25:15.719 Malloc5 00:25:15.719 Malloc6 00:25:15.719 Malloc7 00:25:15.978 Malloc8 00:25:15.978 Malloc9 00:25:15.978 Malloc10 00:25:15.978 01:26:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:15.978 01:26:24 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:25:15.978 01:26:24 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:15.978 01:26:24 -- common/autotest_common.sh@10 -- # set +x 00:25:15.978 01:26:24 -- target/shutdown.sh@124 -- # perfpid=1216867 00:25:15.978 01:26:24 -- target/shutdown.sh@125 -- # waitforlisten 1216867 /var/tmp/bdevperf.sock 00:25:15.978 01:26:24 -- common/autotest_common.sh@829 -- # '[' -z 1216867 ']' 00:25:15.978 01:26:24 -- target/shutdown.sh@123 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:25:15.978 01:26:24 -- target/shutdown.sh@123 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:15.978 01:26:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:15.978 01:26:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:15.978 01:26:24 -- nvmf/common.sh@520 -- # config=() 00:25:15.978 01:26:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:15.978 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:15.978 01:26:24 -- nvmf/common.sh@520 -- # local subsystem config 00:25:15.978 01:26:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:15.978 01:26:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:15.978 01:26:24 -- common/autotest_common.sh@10 -- # set +x 00:25:15.978 01:26:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:15.978 { 00:25:15.978 "params": { 00:25:15.978 "name": "Nvme$subsystem", 00:25:15.978 "trtype": "$TEST_TRANSPORT", 00:25:15.978 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:15.978 "adrfam": "ipv4", 00:25:15.978 "trsvcid": "$NVMF_PORT", 00:25:15.978 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:15.978 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:15.978 "hdgst": ${hdgst:-false}, 00:25:15.978 "ddgst": ${ddgst:-false} 00:25:15.978 }, 00:25:15.978 "method": "bdev_nvme_attach_controller" 00:25:15.978 } 00:25:15.978 EOF 00:25:15.978 )") 00:25:15.978 01:26:24 -- nvmf/common.sh@542 -- # cat 00:25:15.978 01:26:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:15.978 01:26:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:15.978 { 00:25:15.978 "params": { 00:25:15.978 "name": "Nvme$subsystem", 00:25:15.978 "trtype": "$TEST_TRANSPORT", 00:25:15.978 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:15.978 "adrfam": "ipv4", 00:25:15.978 "trsvcid": "$NVMF_PORT", 00:25:15.978 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:15.978 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:15.978 "hdgst": ${hdgst:-false}, 00:25:15.978 "ddgst": ${ddgst:-false} 00:25:15.978 }, 00:25:15.978 "method": "bdev_nvme_attach_controller" 00:25:15.978 } 00:25:15.978 EOF 00:25:15.978 )") 00:25:15.978 01:26:24 -- nvmf/common.sh@542 -- # cat 00:25:15.978 01:26:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:15.978 01:26:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:15.978 { 00:25:15.978 "params": { 00:25:15.978 "name": "Nvme$subsystem", 00:25:15.978 "trtype": "$TEST_TRANSPORT", 00:25:15.978 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:15.978 "adrfam": "ipv4", 00:25:15.978 "trsvcid": "$NVMF_PORT", 00:25:15.978 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:15.978 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:15.978 "hdgst": ${hdgst:-false}, 00:25:15.978 "ddgst": ${ddgst:-false} 00:25:15.978 }, 00:25:15.978 "method": "bdev_nvme_attach_controller" 00:25:15.978 } 00:25:15.978 EOF 00:25:15.978 )") 00:25:15.978 01:26:24 -- nvmf/common.sh@542 -- # cat 00:25:15.978 01:26:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:15.978 01:26:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:15.978 { 00:25:15.978 "params": { 00:25:15.978 "name": "Nvme$subsystem", 00:25:15.978 "trtype": "$TEST_TRANSPORT", 00:25:15.978 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:15.978 "adrfam": "ipv4", 00:25:15.978 "trsvcid": "$NVMF_PORT", 00:25:15.978 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:15.978 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:15.978 "hdgst": ${hdgst:-false}, 00:25:15.978 "ddgst": ${ddgst:-false} 00:25:15.978 }, 00:25:15.978 "method": "bdev_nvme_attach_controller" 00:25:15.978 } 00:25:15.978 EOF 00:25:15.978 )") 00:25:15.978 01:26:24 -- nvmf/common.sh@542 -- # cat 00:25:15.978 01:26:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:15.978 01:26:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:15.978 { 00:25:15.978 "params": { 00:25:15.978 "name": "Nvme$subsystem", 00:25:15.978 "trtype": "$TEST_TRANSPORT", 00:25:15.978 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:15.978 "adrfam": "ipv4", 00:25:15.978 "trsvcid": "$NVMF_PORT", 00:25:15.979 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:15.979 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:15.979 "hdgst": ${hdgst:-false}, 00:25:15.979 "ddgst": ${ddgst:-false} 00:25:15.979 }, 00:25:15.979 "method": "bdev_nvme_attach_controller" 00:25:15.979 } 00:25:15.979 EOF 00:25:15.979 )") 00:25:15.979 01:26:24 -- nvmf/common.sh@542 -- # cat 00:25:15.979 01:26:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:15.979 01:26:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:15.979 { 00:25:15.979 "params": { 00:25:15.979 "name": "Nvme$subsystem", 00:25:15.979 "trtype": "$TEST_TRANSPORT", 00:25:15.979 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:15.979 "adrfam": "ipv4", 00:25:15.979 "trsvcid": "$NVMF_PORT", 00:25:15.979 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:15.979 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:15.979 "hdgst": ${hdgst:-false}, 00:25:15.979 "ddgst": ${ddgst:-false} 00:25:15.979 }, 00:25:15.979 "method": "bdev_nvme_attach_controller" 00:25:15.979 } 00:25:15.979 EOF 00:25:15.979 )") 00:25:15.979 01:26:24 -- nvmf/common.sh@542 -- # cat 00:25:15.979 01:26:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:15.979 01:26:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:15.979 { 00:25:15.979 "params": { 00:25:15.979 "name": "Nvme$subsystem", 00:25:15.979 "trtype": "$TEST_TRANSPORT", 00:25:15.979 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:15.979 "adrfam": "ipv4", 00:25:15.979 "trsvcid": "$NVMF_PORT", 00:25:15.979 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:15.979 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:15.979 "hdgst": ${hdgst:-false}, 00:25:15.979 "ddgst": ${ddgst:-false} 00:25:15.979 }, 00:25:15.979 "method": "bdev_nvme_attach_controller" 00:25:15.979 } 00:25:15.979 EOF 00:25:15.979 )") 00:25:15.979 01:26:24 -- nvmf/common.sh@542 -- # cat 00:25:15.979 01:26:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:15.979 01:26:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:15.979 { 00:25:15.979 "params": { 00:25:15.979 "name": "Nvme$subsystem", 00:25:15.979 "trtype": "$TEST_TRANSPORT", 00:25:15.979 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:15.979 "adrfam": "ipv4", 00:25:15.979 "trsvcid": "$NVMF_PORT", 00:25:15.979 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:15.979 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:15.979 "hdgst": ${hdgst:-false}, 00:25:15.979 "ddgst": ${ddgst:-false} 00:25:15.979 }, 00:25:15.979 "method": "bdev_nvme_attach_controller" 00:25:15.979 } 00:25:15.979 EOF 00:25:15.979 )") 00:25:15.979 01:26:24 -- nvmf/common.sh@542 -- # cat 00:25:15.979 01:26:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:15.979 01:26:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:15.979 { 00:25:15.979 "params": { 00:25:15.979 "name": "Nvme$subsystem", 00:25:15.979 "trtype": "$TEST_TRANSPORT", 00:25:15.979 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:15.979 "adrfam": "ipv4", 00:25:15.979 "trsvcid": "$NVMF_PORT", 00:25:15.979 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:15.979 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:15.979 "hdgst": ${hdgst:-false}, 00:25:15.979 "ddgst": ${ddgst:-false} 00:25:15.979 }, 00:25:15.979 "method": "bdev_nvme_attach_controller" 00:25:15.979 } 00:25:15.979 EOF 00:25:15.979 )") 00:25:15.979 01:26:24 -- nvmf/common.sh@542 -- # cat 00:25:15.979 01:26:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:15.979 01:26:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:15.979 { 00:25:15.979 "params": { 00:25:15.979 "name": "Nvme$subsystem", 00:25:15.979 "trtype": "$TEST_TRANSPORT", 00:25:15.979 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:15.979 "adrfam": "ipv4", 00:25:15.979 "trsvcid": "$NVMF_PORT", 00:25:15.979 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:15.979 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:15.979 "hdgst": ${hdgst:-false}, 00:25:15.979 "ddgst": ${ddgst:-false} 00:25:15.979 }, 00:25:15.979 "method": "bdev_nvme_attach_controller" 00:25:15.979 } 00:25:15.979 EOF 00:25:15.979 )") 00:25:15.979 01:26:24 -- nvmf/common.sh@542 -- # cat 00:25:15.979 01:26:24 -- nvmf/common.sh@544 -- # jq . 00:25:15.979 01:26:24 -- nvmf/common.sh@545 -- # IFS=, 00:25:15.979 01:26:24 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:15.979 "params": { 00:25:15.979 "name": "Nvme1", 00:25:15.979 "trtype": "tcp", 00:25:15.979 "traddr": "10.0.0.2", 00:25:15.979 "adrfam": "ipv4", 00:25:15.979 "trsvcid": "4420", 00:25:15.979 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:15.979 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:15.979 "hdgst": false, 00:25:15.979 "ddgst": false 00:25:15.979 }, 00:25:15.979 "method": "bdev_nvme_attach_controller" 00:25:15.979 },{ 00:25:15.979 "params": { 00:25:15.979 "name": "Nvme2", 00:25:15.979 "trtype": "tcp", 00:25:15.979 "traddr": "10.0.0.2", 00:25:15.979 "adrfam": "ipv4", 00:25:15.979 "trsvcid": "4420", 00:25:15.979 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:15.979 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:15.979 "hdgst": false, 00:25:15.979 "ddgst": false 00:25:15.979 }, 00:25:15.979 "method": "bdev_nvme_attach_controller" 00:25:15.979 },{ 00:25:15.979 "params": { 00:25:15.979 "name": "Nvme3", 00:25:15.979 "trtype": "tcp", 00:25:15.979 "traddr": "10.0.0.2", 00:25:15.979 "adrfam": "ipv4", 00:25:15.979 "trsvcid": "4420", 00:25:15.979 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:15.979 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:15.979 "hdgst": false, 00:25:15.979 "ddgst": false 00:25:15.979 }, 00:25:15.979 "method": "bdev_nvme_attach_controller" 00:25:15.979 },{ 00:25:15.979 "params": { 00:25:15.979 "name": "Nvme4", 00:25:15.979 "trtype": "tcp", 00:25:15.979 "traddr": "10.0.0.2", 00:25:15.979 "adrfam": "ipv4", 00:25:15.979 "trsvcid": "4420", 00:25:15.979 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:15.979 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:15.979 "hdgst": false, 00:25:15.979 "ddgst": false 00:25:15.979 }, 00:25:15.979 "method": "bdev_nvme_attach_controller" 00:25:15.979 },{ 00:25:15.979 "params": { 00:25:15.979 "name": "Nvme5", 00:25:15.979 "trtype": "tcp", 00:25:15.979 "traddr": "10.0.0.2", 00:25:15.979 "adrfam": "ipv4", 00:25:15.979 "trsvcid": "4420", 00:25:15.979 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:15.979 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:15.979 "hdgst": false, 00:25:15.979 "ddgst": false 00:25:15.979 }, 00:25:15.979 "method": "bdev_nvme_attach_controller" 00:25:15.979 },{ 00:25:15.979 "params": { 00:25:15.979 "name": "Nvme6", 00:25:15.979 "trtype": "tcp", 00:25:15.979 "traddr": "10.0.0.2", 00:25:15.979 "adrfam": "ipv4", 00:25:15.979 "trsvcid": "4420", 00:25:15.979 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:15.979 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:15.979 "hdgst": false, 00:25:15.979 "ddgst": false 00:25:15.979 }, 00:25:15.979 "method": "bdev_nvme_attach_controller" 00:25:15.979 },{ 00:25:15.979 "params": { 00:25:15.979 "name": "Nvme7", 00:25:15.979 "trtype": "tcp", 00:25:15.979 "traddr": "10.0.0.2", 00:25:15.979 "adrfam": "ipv4", 00:25:15.979 "trsvcid": "4420", 00:25:15.979 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:15.979 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:15.979 "hdgst": false, 00:25:15.979 "ddgst": false 00:25:15.979 }, 00:25:15.979 "method": "bdev_nvme_attach_controller" 00:25:15.979 },{ 00:25:15.979 "params": { 00:25:15.979 "name": "Nvme8", 00:25:15.979 "trtype": "tcp", 00:25:15.979 "traddr": "10.0.0.2", 00:25:15.979 "adrfam": "ipv4", 00:25:15.979 "trsvcid": "4420", 00:25:15.979 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:15.979 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:15.979 "hdgst": false, 00:25:15.979 "ddgst": false 00:25:15.979 }, 00:25:15.979 "method": "bdev_nvme_attach_controller" 00:25:15.979 },{ 00:25:15.979 "params": { 00:25:15.979 "name": "Nvme9", 00:25:15.979 "trtype": "tcp", 00:25:15.979 "traddr": "10.0.0.2", 00:25:15.979 "adrfam": "ipv4", 00:25:15.979 "trsvcid": "4420", 00:25:15.979 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:15.979 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:15.979 "hdgst": false, 00:25:15.979 "ddgst": false 00:25:15.979 }, 00:25:15.979 "method": "bdev_nvme_attach_controller" 00:25:15.979 },{ 00:25:15.979 "params": { 00:25:15.979 "name": "Nvme10", 00:25:15.979 "trtype": "tcp", 00:25:15.979 "traddr": "10.0.0.2", 00:25:15.979 "adrfam": "ipv4", 00:25:15.979 "trsvcid": "4420", 00:25:15.979 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:15.979 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:15.979 "hdgst": false, 00:25:15.979 "ddgst": false 00:25:15.979 }, 00:25:15.979 "method": "bdev_nvme_attach_controller" 00:25:15.979 }' 00:25:15.979 [2024-11-20 01:26:24.131694] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:15.980 [2024-11-20 01:26:24.131765] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1216867 ] 00:25:15.980 EAL: No free 2048 kB hugepages reported on node 1 00:25:15.980 [2024-11-20 01:26:24.194327] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:16.237 [2024-11-20 01:26:24.278949] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:17.618 Running I/O for 10 seconds... 00:25:17.877 01:26:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:17.877 01:26:25 -- common/autotest_common.sh@862 -- # return 0 00:25:17.877 01:26:25 -- target/shutdown.sh@126 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:25:17.877 01:26:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:17.877 01:26:25 -- common/autotest_common.sh@10 -- # set +x 00:25:17.877 01:26:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:17.877 01:26:25 -- target/shutdown.sh@129 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:17.877 01:26:25 -- target/shutdown.sh@131 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:25:17.877 01:26:25 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:25:17.877 01:26:25 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:25:17.877 01:26:25 -- target/shutdown.sh@57 -- # local ret=1 00:25:17.877 01:26:25 -- target/shutdown.sh@58 -- # local i 00:25:17.877 01:26:25 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:25:17.877 01:26:25 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:25:17.877 01:26:25 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:25:17.877 01:26:25 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:25:17.877 01:26:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:17.877 01:26:25 -- common/autotest_common.sh@10 -- # set +x 00:25:17.877 01:26:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:17.877 01:26:26 -- target/shutdown.sh@60 -- # read_io_count=42 00:25:17.877 01:26:26 -- target/shutdown.sh@63 -- # '[' 42 -ge 100 ']' 00:25:17.877 01:26:26 -- target/shutdown.sh@67 -- # sleep 0.25 00:25:18.136 01:26:26 -- target/shutdown.sh@59 -- # (( i-- )) 00:25:18.136 01:26:26 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:25:18.136 01:26:26 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:25:18.136 01:26:26 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:25:18.136 01:26:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:18.136 01:26:26 -- common/autotest_common.sh@10 -- # set +x 00:25:18.136 01:26:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:18.136 01:26:26 -- target/shutdown.sh@60 -- # read_io_count=164 00:25:18.136 01:26:26 -- target/shutdown.sh@63 -- # '[' 164 -ge 100 ']' 00:25:18.136 01:26:26 -- target/shutdown.sh@64 -- # ret=0 00:25:18.136 01:26:26 -- target/shutdown.sh@65 -- # break 00:25:18.136 01:26:26 -- target/shutdown.sh@69 -- # return 0 00:25:18.136 01:26:26 -- target/shutdown.sh@134 -- # killprocess 1216554 00:25:18.136 01:26:26 -- common/autotest_common.sh@936 -- # '[' -z 1216554 ']' 00:25:18.136 01:26:26 -- common/autotest_common.sh@940 -- # kill -0 1216554 00:25:18.136 01:26:26 -- common/autotest_common.sh@941 -- # uname 00:25:18.136 01:26:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:18.136 01:26:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1216554 00:25:18.407 01:26:26 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:18.407 01:26:26 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:18.407 01:26:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1216554' 00:25:18.407 killing process with pid 1216554 00:25:18.407 01:26:26 -- common/autotest_common.sh@955 -- # kill 1216554 00:25:18.407 01:26:26 -- common/autotest_common.sh@960 -- # wait 1216554 00:25:18.407 [2024-11-20 01:26:26.367421] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2146e70 is same with the state(5) to be set 00:25:18.407 [2024-11-20 01:26:26.367502] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2146e70 is same with the state(5) to be set 00:25:18.407 [2024-11-20 01:26:26.368259] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.407 [2024-11-20 01:26:26.368293] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.407 [2024-11-20 01:26:26.368308] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.407 [2024-11-20 01:26:26.368320] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.407 [2024-11-20 01:26:26.368332] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.407 [2024-11-20 01:26:26.368344] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.407 [2024-11-20 01:26:26.368357] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.407 [2024-11-20 01:26:26.368376] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.407 [2024-11-20 01:26:26.368388] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.407 [2024-11-20 01:26:26.368399] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.407 [2024-11-20 01:26:26.368411] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.407 [2024-11-20 01:26:26.368422] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.407 [2024-11-20 01:26:26.368434] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.407 [2024-11-20 01:26:26.368446] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.407 [2024-11-20 01:26:26.368459] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.407 [2024-11-20 01:26:26.368471] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.407 [2024-11-20 01:26:26.368483] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.407 [2024-11-20 01:26:26.368495] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.407 [2024-11-20 01:26:26.368507] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.407 [2024-11-20 01:26:26.368518] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.407 [2024-11-20 01:26:26.368530] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.407 [2024-11-20 01:26:26.368542] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.407 [2024-11-20 01:26:26.368554] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.407 [2024-11-20 01:26:26.368566] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.407 [2024-11-20 01:26:26.368578] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.407 [2024-11-20 01:26:26.368606] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.407 [2024-11-20 01:26:26.368620] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.407 [2024-11-20 01:26:26.368632] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.407 [2024-11-20 01:26:26.368643] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.407 [2024-11-20 01:26:26.368655] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.407 [2024-11-20 01:26:26.368667] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.368679] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.368690] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.368702] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.368714] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.368726] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.368737] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.368749] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.368761] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.368772] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.368784] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.368796] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.368807] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.368819] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.368831] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.368842] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.368853] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.368865] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.368876] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.368888] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.368899] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.368911] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.368926] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.368938] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.368950] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.368962] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.368974] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.368986] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.368997] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.369009] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.369021] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.369033] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.369044] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149840 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.369503] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:18.408 [2024-11-20 01:26:26.369542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.408 [2024-11-20 01:26:26.369560] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:18.408 [2024-11-20 01:26:26.369574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.408 [2024-11-20 01:26:26.369588] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:18.408 [2024-11-20 01:26:26.369601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.408 [2024-11-20 01:26:26.369614] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:18.408 [2024-11-20 01:26:26.369628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.408 [2024-11-20 01:26:26.369641] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c92fe0 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.375202] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.375239] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.375254] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.375267] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.375280] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.375292] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.375304] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.375331] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.375345] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.375359] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.375381] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.375393] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.375405] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.375416] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.375429] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.375441] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.375453] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.375465] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.375477] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.375490] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.375503] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.375514] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.375526] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.375537] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.375549] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.375562] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.375575] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.375587] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.375599] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.375611] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.375623] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.375634] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.375646] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.375658] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.375673] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.375686] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.375698] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.375709] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.375721] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.375733] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.375744] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.408 [2024-11-20 01:26:26.375756] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.375768] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.375779] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.375790] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.375802] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.375814] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.375825] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.375837] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.375848] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.375860] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.375872] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.375884] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.375895] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.375907] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.375919] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.375932] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.375943] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.375956] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.375967] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.375979] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.375995] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.376007] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21477b0 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.376981] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377014] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377029] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377041] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377062] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377083] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377097] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377109] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377121] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377133] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377144] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377156] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377168] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377180] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377192] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377204] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377216] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377227] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377239] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377251] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377262] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377274] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377286] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377297] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377309] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377326] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377339] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377356] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377370] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377393] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377431] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377445] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377457] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377469] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377484] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377496] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377508] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377521] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377533] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377545] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377557] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377569] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377580] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377592] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377604] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377621] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377645] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377657] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377669] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377680] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377692] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377704] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377721] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377733] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377766] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377784] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377797] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377809] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377821] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377834] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377846] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377858] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.409 [2024-11-20 01:26:26.377870] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2147c40 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.378622] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.378651] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.378666] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.378678] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.378690] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.378702] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.378715] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.378727] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.378739] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.378751] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.378763] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.378776] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.378788] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.378800] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.378813] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.378826] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.378838] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.378867] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.378889] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.378903] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.378915] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.378928] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.378940] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.378952] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.378965] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.378977] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.378989] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.379001] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.379013] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.379026] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.379039] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.379051] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.379083] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.379108] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.379121] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.379133] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.379147] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.379159] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.379171] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.379184] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.379197] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.379209] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.379221] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.379233] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.379251] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.379265] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.379277] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.379289] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.379301] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.379314] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.379326] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.379339] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.379351] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.379363] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.379386] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.379398] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.379410] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.379423] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.379435] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.379447] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.379459] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.379471] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.379483] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21480f0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.380376] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21485a0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.380404] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21485a0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.381641] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.381667] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.381681] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.381694] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.381708] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.381720] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.381743] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.381756] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.381771] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.381783] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.381795] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.381807] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.381819] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.381832] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.381844] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.381855] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.381868] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.381881] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.410 [2024-11-20 01:26:26.381894] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.381905] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.381917] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.381929] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.381941] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.381953] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.381965] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.381977] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.381988] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.382000] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.382012] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.382023] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.382035] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.382047] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.382065] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.382092] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.382106] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.382118] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.382129] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.382141] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.382152] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.382164] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.382176] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.382188] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.382201] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.382212] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.382224] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.382236] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.382247] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.382259] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.382271] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.382283] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.382295] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.382307] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.382319] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.382331] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.382344] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.382356] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.382377] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.382389] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.382401] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.382412] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.382428] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.382441] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.382453] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2148ee0 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.383190] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.383215] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.383228] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.383240] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.383253] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.383265] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.383277] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.383289] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.383301] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.383312] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.383324] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.383336] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.383348] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.383361] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.383384] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.383396] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.383408] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.383421] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.383433] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.383445] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.383457] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.383469] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.383482] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.383494] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.383512] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.383524] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.383536] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.383548] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.383561] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.383573] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.383586] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.383598] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.383609] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.383622] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.383634] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.383646] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.411 [2024-11-20 01:26:26.383658] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.412 [2024-11-20 01:26:26.383671] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.412 [2024-11-20 01:26:26.383684] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.412 [2024-11-20 01:26:26.383707] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.412 [2024-11-20 01:26:26.383719] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.412 [2024-11-20 01:26:26.383731] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.412 [2024-11-20 01:26:26.383743] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.412 [2024-11-20 01:26:26.383756] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.412 [2024-11-20 01:26:26.383769] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.412 [2024-11-20 01:26:26.383782] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.412 [2024-11-20 01:26:26.383794] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.412 [2024-11-20 01:26:26.383807] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.412 [2024-11-20 01:26:26.383819] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.412 [2024-11-20 01:26:26.383831] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.412 [2024-11-20 01:26:26.383845] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.412 [2024-11-20 01:26:26.383861] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.412 [2024-11-20 01:26:26.383873] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.412 [2024-11-20 01:26:26.383886] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.412 [2024-11-20 01:26:26.383898] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.412 [2024-11-20 01:26:26.383910] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.412 [2024-11-20 01:26:26.383923] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.412 [2024-11-20 01:26:26.383935] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.412 [2024-11-20 01:26:26.383948] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.412 [2024-11-20 01:26:26.383961] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.412 [2024-11-20 01:26:26.383974] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.412 [2024-11-20 01:26:26.383987] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.412 [2024-11-20 01:26:26.383999] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2149390 is same with the state(5) to be set 00:25:18.412 [2024-11-20 01:26:26.385728] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:18.412 [2024-11-20 01:26:26.385763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.412 [2024-11-20 01:26:26.385782] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:18.412 [2024-11-20 01:26:26.385796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.412 [2024-11-20 01:26:26.385810] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:18.412 [2024-11-20 01:26:26.385823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.412 [2024-11-20 01:26:26.385837] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:18.412 [2024-11-20 01:26:26.385851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.412 [2024-11-20 01:26:26.385864] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cbe5f0 is same with the state(5) to be set 00:25:18.412 [2024-11-20 01:26:26.385918] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:18.412 [2024-11-20 01:26:26.385949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.412 [2024-11-20 01:26:26.385964] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:18.412 [2024-11-20 01:26:26.385978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.412 [2024-11-20 01:26:26.385993] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:18.412 [2024-11-20 01:26:26.386013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.412 [2024-11-20 01:26:26.386028] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:18.412 [2024-11-20 01:26:26.386042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.412 [2024-11-20 01:26:26.386055] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cbf200 is same with the state(5) to be set 00:25:18.412 [2024-11-20 01:26:26.386103] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c92fe0 (9): Bad file descriptor 00:25:18.412 [2024-11-20 01:26:26.386156] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:18.412 [2024-11-20 01:26:26.386177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.412 [2024-11-20 01:26:26.386192] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:18.412 [2024-11-20 01:26:26.386206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.412 [2024-11-20 01:26:26.386220] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:18.412 [2024-11-20 01:26:26.386233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.412 [2024-11-20 01:26:26.386247] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:18.412 [2024-11-20 01:26:26.386259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.412 [2024-11-20 01:26:26.386272] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ce4c00 is same with the state(5) to be set 00:25:18.412 [2024-11-20 01:26:26.386318] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:18.412 [2024-11-20 01:26:26.386339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.412 [2024-11-20 01:26:26.386354] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:18.412 [2024-11-20 01:26:26.386368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.412 [2024-11-20 01:26:26.386386] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:18.412 [2024-11-20 01:26:26.386399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.412 [2024-11-20 01:26:26.386414] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:18.412 [2024-11-20 01:26:26.386426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.412 [2024-11-20 01:26:26.386450] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cc6a30 is same with the state(5) to be set 00:25:18.412 [2024-11-20 01:26:26.386498] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:18.412 [2024-11-20 01:26:26.386519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.412 [2024-11-20 01:26:26.386534] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:18.412 [2024-11-20 01:26:26.386553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.412 [2024-11-20 01:26:26.386568] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:18.412 [2024-11-20 01:26:26.386581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.412 [2024-11-20 01:26:26.386595] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:18.412 [2024-11-20 01:26:26.386608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.413 [2024-11-20 01:26:26.386626] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e5a240 is same with the state(5) to be set 00:25:18.413 [2024-11-20 01:26:26.386672] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:18.413 [2024-11-20 01:26:26.386692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.413 [2024-11-20 01:26:26.386707] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:18.413 [2024-11-20 01:26:26.386725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.413 [2024-11-20 01:26:26.386750] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:18.413 [2024-11-20 01:26:26.386767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.413 [2024-11-20 01:26:26.386781] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:18.413 [2024-11-20 01:26:26.386794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.413 [2024-11-20 01:26:26.386807] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e60e80 is same with the state(5) to be set 00:25:18.413 [2024-11-20 01:26:26.386865] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:18.413 [2024-11-20 01:26:26.386885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.413 [2024-11-20 01:26:26.386900] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:18.413 [2024-11-20 01:26:26.386913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.413 [2024-11-20 01:26:26.386927] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:18.413 [2024-11-20 01:26:26.386940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.413 [2024-11-20 01:26:26.386953] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:18.413 [2024-11-20 01:26:26.386970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.413 [2024-11-20 01:26:26.386983] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cbd710 is same with the state(5) to be set 00:25:18.413 [2024-11-20 01:26:26.387037] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:18.413 [2024-11-20 01:26:26.387057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.413 [2024-11-20 01:26:26.387100] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:18.413 [2024-11-20 01:26:26.387115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.413 [2024-11-20 01:26:26.387129] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:18.413 [2024-11-20 01:26:26.387142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.413 [2024-11-20 01:26:26.387156] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:18.413 [2024-11-20 01:26:26.387169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.413 [2024-11-20 01:26:26.387182] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e3c980 is same with the state(5) to be set 00:25:18.413 [2024-11-20 01:26:26.387226] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:18.413 [2024-11-20 01:26:26.387246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.413 [2024-11-20 01:26:26.387262] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:18.413 [2024-11-20 01:26:26.387275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.413 [2024-11-20 01:26:26.387289] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:18.413 [2024-11-20 01:26:26.387302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.413 [2024-11-20 01:26:26.387315] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:18.413 [2024-11-20 01:26:26.387328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.413 [2024-11-20 01:26:26.387341] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cde190 is same with the state(5) to be set 00:25:18.413 [2024-11-20 01:26:26.387454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.413 [2024-11-20 01:26:26.387484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.413 [2024-11-20 01:26:26.387509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.413 [2024-11-20 01:26:26.387526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.413 [2024-11-20 01:26:26.387544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.413 [2024-11-20 01:26:26.387559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.413 [2024-11-20 01:26:26.387575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.413 [2024-11-20 01:26:26.387589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.413 [2024-11-20 01:26:26.387604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.413 [2024-11-20 01:26:26.387623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.413 [2024-11-20 01:26:26.387640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.413 [2024-11-20 01:26:26.387654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.413 [2024-11-20 01:26:26.387670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.413 [2024-11-20 01:26:26.387684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.413 [2024-11-20 01:26:26.387699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.413 [2024-11-20 01:26:26.387713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.413 [2024-11-20 01:26:26.387729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.413 [2024-11-20 01:26:26.387743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.413 [2024-11-20 01:26:26.387758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.413 [2024-11-20 01:26:26.387773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.413 [2024-11-20 01:26:26.387789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.413 [2024-11-20 01:26:26.387803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.413 [2024-11-20 01:26:26.387818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.413 [2024-11-20 01:26:26.387833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.413 [2024-11-20 01:26:26.387849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.413 [2024-11-20 01:26:26.387863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.413 [2024-11-20 01:26:26.387879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.413 [2024-11-20 01:26:26.387893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.413 [2024-11-20 01:26:26.387909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.413 [2024-11-20 01:26:26.387923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.413 [2024-11-20 01:26:26.387938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.413 [2024-11-20 01:26:26.387952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.413 [2024-11-20 01:26:26.387968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.413 [2024-11-20 01:26:26.387983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.413 [2024-11-20 01:26:26.388002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.413 [2024-11-20 01:26:26.388017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.413 [2024-11-20 01:26:26.388032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.413 [2024-11-20 01:26:26.388046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.413 [2024-11-20 01:26:26.388079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.413 [2024-11-20 01:26:26.388095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.413 [2024-11-20 01:26:26.388111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.413 [2024-11-20 01:26:26.388126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.414 [2024-11-20 01:26:26.388141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.414 [2024-11-20 01:26:26.388155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.414 [2024-11-20 01:26:26.388170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.414 [2024-11-20 01:26:26.388185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.414 [2024-11-20 01:26:26.388201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.414 [2024-11-20 01:26:26.388215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.414 [2024-11-20 01:26:26.388230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.414 [2024-11-20 01:26:26.388244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.414 [2024-11-20 01:26:26.388260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.414 [2024-11-20 01:26:26.388274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.414 [2024-11-20 01:26:26.388290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.414 [2024-11-20 01:26:26.388304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.414 [2024-11-20 01:26:26.388319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.414 [2024-11-20 01:26:26.388333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.414 [2024-11-20 01:26:26.388348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.414 [2024-11-20 01:26:26.388368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.414 [2024-11-20 01:26:26.388384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.414 [2024-11-20 01:26:26.388401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.414 [2024-11-20 01:26:26.388417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.414 [2024-11-20 01:26:26.388443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.414 [2024-11-20 01:26:26.388458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.414 [2024-11-20 01:26:26.388472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.414 [2024-11-20 01:26:26.388487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.414 [2024-11-20 01:26:26.388501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.414 [2024-11-20 01:26:26.388516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.414 [2024-11-20 01:26:26.388530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.414 [2024-11-20 01:26:26.388546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.414 [2024-11-20 01:26:26.388560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.414 [2024-11-20 01:26:26.388575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.414 [2024-11-20 01:26:26.388589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.414 [2024-11-20 01:26:26.388604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.414 [2024-11-20 01:26:26.388618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.414 [2024-11-20 01:26:26.388634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.414 [2024-11-20 01:26:26.388647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.414 [2024-11-20 01:26:26.388663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.414 [2024-11-20 01:26:26.388677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.414 [2024-11-20 01:26:26.388693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.414 [2024-11-20 01:26:26.388707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.414 [2024-11-20 01:26:26.388722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.414 [2024-11-20 01:26:26.388736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.414 [2024-11-20 01:26:26.388751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.414 [2024-11-20 01:26:26.388765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.414 [2024-11-20 01:26:26.388784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.414 [2024-11-20 01:26:26.388798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.414 [2024-11-20 01:26:26.388814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.414 [2024-11-20 01:26:26.388828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.414 [2024-11-20 01:26:26.388844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.414 [2024-11-20 01:26:26.388858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.414 [2024-11-20 01:26:26.388873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.414 [2024-11-20 01:26:26.388887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.414 [2024-11-20 01:26:26.388902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.414 [2024-11-20 01:26:26.388916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.414 [2024-11-20 01:26:26.388931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.414 [2024-11-20 01:26:26.388945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.414 [2024-11-20 01:26:26.388960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.414 [2024-11-20 01:26:26.388975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.414 [2024-11-20 01:26:26.388990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.414 [2024-11-20 01:26:26.389004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.414 [2024-11-20 01:26:26.389019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.414 [2024-11-20 01:26:26.389033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.414 [2024-11-20 01:26:26.389048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.414 [2024-11-20 01:26:26.389065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.414 [2024-11-20 01:26:26.389088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.414 [2024-11-20 01:26:26.389103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.414 [2024-11-20 01:26:26.389118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.414 [2024-11-20 01:26:26.389132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.414 [2024-11-20 01:26:26.389147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.414 [2024-11-20 01:26:26.389168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.414 [2024-11-20 01:26:26.389185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.414 [2024-11-20 01:26:26.389200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.414 [2024-11-20 01:26:26.389214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.414 [2024-11-20 01:26:26.389228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.414 [2024-11-20 01:26:26.389243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.414 [2024-11-20 01:26:26.389257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.414 [2024-11-20 01:26:26.389273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.414 [2024-11-20 01:26:26.389287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.414 [2024-11-20 01:26:26.389302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.414 [2024-11-20 01:26:26.389316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.414 [2024-11-20 01:26:26.389332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.414 [2024-11-20 01:26:26.389345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.415 [2024-11-20 01:26:26.389360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.415 [2024-11-20 01:26:26.389378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.415 [2024-11-20 01:26:26.389393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.415 [2024-11-20 01:26:26.389407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.415 [2024-11-20 01:26:26.389422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.415 [2024-11-20 01:26:26.389435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.415 [2024-11-20 01:26:26.389522] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1c6aac0 was disconnected and freed. reset controller. 00:25:18.415 [2024-11-20 01:26:26.390437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.415 [2024-11-20 01:26:26.390461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.415 [2024-11-20 01:26:26.390484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.415 [2024-11-20 01:26:26.390500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.415 [2024-11-20 01:26:26.390517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.415 [2024-11-20 01:26:26.390538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.415 [2024-11-20 01:26:26.390555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.415 [2024-11-20 01:26:26.390571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.415 [2024-11-20 01:26:26.390587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.415 [2024-11-20 01:26:26.390601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.415 [2024-11-20 01:26:26.390618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.415 [2024-11-20 01:26:26.390632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.415 [2024-11-20 01:26:26.390649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.415 [2024-11-20 01:26:26.390663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.415 [2024-11-20 01:26:26.390679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.415 [2024-11-20 01:26:26.390693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.415 [2024-11-20 01:26:26.390709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.415 [2024-11-20 01:26:26.390723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.415 [2024-11-20 01:26:26.390739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.415 [2024-11-20 01:26:26.390753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.415 [2024-11-20 01:26:26.390768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.415 [2024-11-20 01:26:26.390783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.415 [2024-11-20 01:26:26.390798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.415 [2024-11-20 01:26:26.390813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.415 [2024-11-20 01:26:26.390829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.415 [2024-11-20 01:26:26.390843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.415 [2024-11-20 01:26:26.390859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.415 [2024-11-20 01:26:26.390873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.415 [2024-11-20 01:26:26.390889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.415 [2024-11-20 01:26:26.390903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.415 [2024-11-20 01:26:26.390923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.415 [2024-11-20 01:26:26.390938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.415 [2024-11-20 01:26:26.390954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.415 [2024-11-20 01:26:26.390968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.415 [2024-11-20 01:26:26.390984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.415 [2024-11-20 01:26:26.390999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.415 [2024-11-20 01:26:26.391015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.415 [2024-11-20 01:26:26.391028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.415 [2024-11-20 01:26:26.391044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.415 [2024-11-20 01:26:26.391067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.415 [2024-11-20 01:26:26.391092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.415 [2024-11-20 01:26:26.391107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.415 [2024-11-20 01:26:26.391123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.415 [2024-11-20 01:26:26.391138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.415 [2024-11-20 01:26:26.391154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.415 [2024-11-20 01:26:26.391169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.415 [2024-11-20 01:26:26.391184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.415 [2024-11-20 01:26:26.391199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.415 [2024-11-20 01:26:26.391214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.415 [2024-11-20 01:26:26.391228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.415 [2024-11-20 01:26:26.391244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.415 [2024-11-20 01:26:26.391259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.415 [2024-11-20 01:26:26.391275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.415 [2024-11-20 01:26:26.391289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.415 [2024-11-20 01:26:26.391305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.415 [2024-11-20 01:26:26.391323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.415 [2024-11-20 01:26:26.391340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.415 [2024-11-20 01:26:26.391355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.415 [2024-11-20 01:26:26.391371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.415 [2024-11-20 01:26:26.391393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.415 [2024-11-20 01:26:26.391409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.415 [2024-11-20 01:26:26.391423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.415 [2024-11-20 01:26:26.391439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.415 [2024-11-20 01:26:26.391454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.415 [2024-11-20 01:26:26.391469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.415 [2024-11-20 01:26:26.391483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.415 [2024-11-20 01:26:26.391499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.415 [2024-11-20 01:26:26.391514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.415 [2024-11-20 01:26:26.391530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.415 [2024-11-20 01:26:26.391544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.415 [2024-11-20 01:26:26.391559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.415 [2024-11-20 01:26:26.391574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.416 [2024-11-20 01:26:26.391590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.416 [2024-11-20 01:26:26.391604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.416 [2024-11-20 01:26:26.391619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.416 [2024-11-20 01:26:26.391634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.416 [2024-11-20 01:26:26.391650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.416 [2024-11-20 01:26:26.391664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.416 [2024-11-20 01:26:26.391680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.416 [2024-11-20 01:26:26.391695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.416 [2024-11-20 01:26:26.391714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.416 [2024-11-20 01:26:26.391729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.416 [2024-11-20 01:26:26.391745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.416 [2024-11-20 01:26:26.391759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.416 [2024-11-20 01:26:26.391775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.416 [2024-11-20 01:26:26.391789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.416 [2024-11-20 01:26:26.391804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.416 [2024-11-20 01:26:26.391818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.416 [2024-11-20 01:26:26.391834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.416 [2024-11-20 01:26:26.391848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.416 [2024-11-20 01:26:26.391863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.416 [2024-11-20 01:26:26.391877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.416 [2024-11-20 01:26:26.391893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.416 [2024-11-20 01:26:26.391907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.416 [2024-11-20 01:26:26.391923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.416 [2024-11-20 01:26:26.391937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.416 [2024-11-20 01:26:26.391953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.416 [2024-11-20 01:26:26.391967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.416 [2024-11-20 01:26:26.391983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.416 [2024-11-20 01:26:26.391997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.416 [2024-11-20 01:26:26.392013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.416 [2024-11-20 01:26:26.392027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.416 [2024-11-20 01:26:26.392043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.416 [2024-11-20 01:26:26.392067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.416 [2024-11-20 01:26:26.392090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.416 [2024-11-20 01:26:26.392109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.416 [2024-11-20 01:26:26.392125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.416 [2024-11-20 01:26:26.392140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.416 [2024-11-20 01:26:26.392156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.416 [2024-11-20 01:26:26.392170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.416 [2024-11-20 01:26:26.392185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.416 [2024-11-20 01:26:26.392199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.416 [2024-11-20 01:26:26.392215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.416 [2024-11-20 01:26:26.392229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.416 [2024-11-20 01:26:26.392245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.416 [2024-11-20 01:26:26.392258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.416 [2024-11-20 01:26:26.392275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.416 [2024-11-20 01:26:26.392289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.416 [2024-11-20 01:26:26.392305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.416 [2024-11-20 01:26:26.392320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.416 [2024-11-20 01:26:26.392336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.416 [2024-11-20 01:26:26.392350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.416 [2024-11-20 01:26:26.392366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.416 [2024-11-20 01:26:26.392380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.416 [2024-11-20 01:26:26.392396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.416 [2024-11-20 01:26:26.392410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.416 [2024-11-20 01:26:26.392426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.416 [2024-11-20 01:26:26.392440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.416 [2024-11-20 01:26:26.392455] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c85ec0 is same with the state(5) to be set 00:25:18.416 [2024-11-20 01:26:26.392526] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1c85ec0 was disconnected and freed. reset controller. 00:25:18.416 [2024-11-20 01:26:26.394844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.416 [2024-11-20 01:26:26.394879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.416 [2024-11-20 01:26:26.394902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.416 [2024-11-20 01:26:26.394919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.416 [2024-11-20 01:26:26.394935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.416 [2024-11-20 01:26:26.394950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.416 [2024-11-20 01:26:26.394966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.416 [2024-11-20 01:26:26.394981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.416 [2024-11-20 01:26:26.394997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.416 [2024-11-20 01:26:26.395011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.417 [2024-11-20 01:26:26.395027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.417 [2024-11-20 01:26:26.395041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.417 [2024-11-20 01:26:26.395065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.417 [2024-11-20 01:26:26.395090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.417 [2024-11-20 01:26:26.395107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.417 [2024-11-20 01:26:26.395121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.417 [2024-11-20 01:26:26.395137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.417 [2024-11-20 01:26:26.395151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.417 [2024-11-20 01:26:26.395167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.417 [2024-11-20 01:26:26.395182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.417 [2024-11-20 01:26:26.395198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.417 [2024-11-20 01:26:26.395212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.417 [2024-11-20 01:26:26.395228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.417 [2024-11-20 01:26:26.395242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.417 [2024-11-20 01:26:26.395258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.417 [2024-11-20 01:26:26.395272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.417 [2024-11-20 01:26:26.395292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.417 [2024-11-20 01:26:26.395307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.417 [2024-11-20 01:26:26.395322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.417 [2024-11-20 01:26:26.395337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.417 [2024-11-20 01:26:26.395353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.417 [2024-11-20 01:26:26.395376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.417 [2024-11-20 01:26:26.395392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.417 [2024-11-20 01:26:26.395406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.417 [2024-11-20 01:26:26.395421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.417 [2024-11-20 01:26:26.395436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.417 [2024-11-20 01:26:26.395451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.417 [2024-11-20 01:26:26.395465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.417 [2024-11-20 01:26:26.395480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.417 [2024-11-20 01:26:26.395495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.417 [2024-11-20 01:26:26.395510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.417 [2024-11-20 01:26:26.395525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.417 [2024-11-20 01:26:26.395542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.417 [2024-11-20 01:26:26.395556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.417 [2024-11-20 01:26:26.395572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.417 [2024-11-20 01:26:26.395587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.417 [2024-11-20 01:26:26.395603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.417 [2024-11-20 01:26:26.395616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.417 [2024-11-20 01:26:26.395632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.417 [2024-11-20 01:26:26.395646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.417 [2024-11-20 01:26:26.395662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.417 [2024-11-20 01:26:26.395682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.417 [2024-11-20 01:26:26.395699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.417 [2024-11-20 01:26:26.395713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.417 [2024-11-20 01:26:26.395729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.417 [2024-11-20 01:26:26.395743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.417 [2024-11-20 01:26:26.395759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.417 [2024-11-20 01:26:26.395773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.417 [2024-11-20 01:26:26.395788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.417 [2024-11-20 01:26:26.395802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.417 [2024-11-20 01:26:26.395819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.417 [2024-11-20 01:26:26.395833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.417 [2024-11-20 01:26:26.395848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.417 [2024-11-20 01:26:26.395862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.417 [2024-11-20 01:26:26.395878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.417 [2024-11-20 01:26:26.395892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.417 [2024-11-20 01:26:26.395908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.417 [2024-11-20 01:26:26.395922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.417 [2024-11-20 01:26:26.395937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.417 [2024-11-20 01:26:26.395951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.417 [2024-11-20 01:26:26.395967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.417 [2024-11-20 01:26:26.395982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.417 [2024-11-20 01:26:26.395997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.417 [2024-11-20 01:26:26.396011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.417 [2024-11-20 01:26:26.396027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.417 [2024-11-20 01:26:26.396041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.417 [2024-11-20 01:26:26.396077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.417 [2024-11-20 01:26:26.396094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.417 [2024-11-20 01:26:26.396110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.417 [2024-11-20 01:26:26.396123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.417 [2024-11-20 01:26:26.396139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.417 [2024-11-20 01:26:26.396153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.417 [2024-11-20 01:26:26.396169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.417 [2024-11-20 01:26:26.396183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.417 [2024-11-20 01:26:26.396199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.417 [2024-11-20 01:26:26.396212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.417 [2024-11-20 01:26:26.396228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.417 [2024-11-20 01:26:26.396243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.417 [2024-11-20 01:26:26.396258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.418 [2024-11-20 01:26:26.396272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.418 [2024-11-20 01:26:26.396288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.418 [2024-11-20 01:26:26.396303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.418 [2024-11-20 01:26:26.396318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.418 [2024-11-20 01:26:26.396333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.418 [2024-11-20 01:26:26.396348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.418 [2024-11-20 01:26:26.396362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.418 [2024-11-20 01:26:26.396387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.418 [2024-11-20 01:26:26.396401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.418 [2024-11-20 01:26:26.396416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.418 [2024-11-20 01:26:26.396430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.418 [2024-11-20 01:26:26.396446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.418 [2024-11-20 01:26:26.396464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.418 [2024-11-20 01:26:26.396481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.418 [2024-11-20 01:26:26.396495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.418 [2024-11-20 01:26:26.396510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.418 [2024-11-20 01:26:26.396524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.418 [2024-11-20 01:26:26.396540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.418 [2024-11-20 01:26:26.396554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.418 [2024-11-20 01:26:26.396570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.418 [2024-11-20 01:26:26.396583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.418 [2024-11-20 01:26:26.396599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.418 [2024-11-20 01:26:26.396612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.418 [2024-11-20 01:26:26.396628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.418 [2024-11-20 01:26:26.396642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.418 [2024-11-20 01:26:26.396657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.418 [2024-11-20 01:26:26.396671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.418 [2024-11-20 01:26:26.396687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.418 [2024-11-20 01:26:26.396701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.418 [2024-11-20 01:26:26.396717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.418 [2024-11-20 01:26:26.396731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.418 [2024-11-20 01:26:26.396747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.418 [2024-11-20 01:26:26.396760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.418 [2024-11-20 01:26:26.396776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.418 [2024-11-20 01:26:26.396790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.418 [2024-11-20 01:26:26.396805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.418 [2024-11-20 01:26:26.396819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.418 [2024-11-20 01:26:26.396839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.418 [2024-11-20 01:26:26.396854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.418 [2024-11-20 01:26:26.396963] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1e171e0 was disconnected and freed. reset controller. 00:25:18.418 [2024-11-20 01:26:26.397021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.418 [2024-11-20 01:26:26.397040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.418 [2024-11-20 01:26:26.397077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.418 [2024-11-20 01:26:26.397095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.418 [2024-11-20 01:26:26.397111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.418 [2024-11-20 01:26:26.397126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.418 [2024-11-20 01:26:26.397142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.418 [2024-11-20 01:26:26.397156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.418 [2024-11-20 01:26:26.397172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.418 [2024-11-20 01:26:26.397187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.418 [2024-11-20 01:26:26.397203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.418 [2024-11-20 01:26:26.397217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.418 [2024-11-20 01:26:26.397233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.418 [2024-11-20 01:26:26.397247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.418 [2024-11-20 01:26:26.397262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.418 [2024-11-20 01:26:26.397276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.418 [2024-11-20 01:26:26.397292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.418 [2024-11-20 01:26:26.397306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.418 [2024-11-20 01:26:26.397323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.418 [2024-11-20 01:26:26.397337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.418 [2024-11-20 01:26:26.397353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.418 [2024-11-20 01:26:26.397377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.418 [2024-11-20 01:26:26.397398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.418 [2024-11-20 01:26:26.397413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.418 [2024-11-20 01:26:26.397429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.418 [2024-11-20 01:26:26.397443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.418 [2024-11-20 01:26:26.397459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.418 [2024-11-20 01:26:26.397473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.418 [2024-11-20 01:26:26.397489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.418 [2024-11-20 01:26:26.397503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.418 [2024-11-20 01:26:26.397519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.418 [2024-11-20 01:26:26.397533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.418 [2024-11-20 01:26:26.397548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.418 [2024-11-20 01:26:26.397563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.418 [2024-11-20 01:26:26.397579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.418 [2024-11-20 01:26:26.397593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.418 [2024-11-20 01:26:26.397609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.418 [2024-11-20 01:26:26.397623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.418 [2024-11-20 01:26:26.397639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.419 [2024-11-20 01:26:26.397654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.419 [2024-11-20 01:26:26.397670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.419 [2024-11-20 01:26:26.397684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.419 [2024-11-20 01:26:26.397700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.419 [2024-11-20 01:26:26.397714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.419 [2024-11-20 01:26:26.397731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.419 [2024-11-20 01:26:26.397745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.419 [2024-11-20 01:26:26.397761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.419 [2024-11-20 01:26:26.397783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.419 [2024-11-20 01:26:26.397800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.419 [2024-11-20 01:26:26.397814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.419 [2024-11-20 01:26:26.397830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.419 [2024-11-20 01:26:26.397844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.419 [2024-11-20 01:26:26.397860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.419 [2024-11-20 01:26:26.397875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.419 [2024-11-20 01:26:26.397891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.419 [2024-11-20 01:26:26.397905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.419 [2024-11-20 01:26:26.397921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.419 [2024-11-20 01:26:26.397936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.419 [2024-11-20 01:26:26.397951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.419 [2024-11-20 01:26:26.397966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.419 [2024-11-20 01:26:26.397982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.419 [2024-11-20 01:26:26.397996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.419 [2024-11-20 01:26:26.398012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.419 [2024-11-20 01:26:26.398026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.419 [2024-11-20 01:26:26.398042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.419 [2024-11-20 01:26:26.398063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.419 [2024-11-20 01:26:26.398085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.419 [2024-11-20 01:26:26.398100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.419 [2024-11-20 01:26:26.398116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.419 [2024-11-20 01:26:26.398130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.419 [2024-11-20 01:26:26.398146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.419 [2024-11-20 01:26:26.398160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.419 [2024-11-20 01:26:26.398179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.419 [2024-11-20 01:26:26.398195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.419 [2024-11-20 01:26:26.398210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.419 [2024-11-20 01:26:26.398224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.419 [2024-11-20 01:26:26.398240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.419 [2024-11-20 01:26:26.398254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.419 [2024-11-20 01:26:26.398270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.419 [2024-11-20 01:26:26.398284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.419 [2024-11-20 01:26:26.398299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.419 [2024-11-20 01:26:26.398313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.419 [2024-11-20 01:26:26.398329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.419 [2024-11-20 01:26:26.398343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.419 [2024-11-20 01:26:26.398359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.419 [2024-11-20 01:26:26.398375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.419 [2024-11-20 01:26:26.398390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.419 [2024-11-20 01:26:26.398404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.419 [2024-11-20 01:26:26.398419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.419 [2024-11-20 01:26:26.398433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.419 [2024-11-20 01:26:26.398449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.419 [2024-11-20 01:26:26.398462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.419 [2024-11-20 01:26:26.398478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.419 [2024-11-20 01:26:26.398492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.419 [2024-11-20 01:26:26.398507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.419 [2024-11-20 01:26:26.398521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.419 [2024-11-20 01:26:26.398536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.419 [2024-11-20 01:26:26.398554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.419 [2024-11-20 01:26:26.398570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.419 [2024-11-20 01:26:26.398585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.419 [2024-11-20 01:26:26.398601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.419 [2024-11-20 01:26:26.398615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.419 [2024-11-20 01:26:26.398631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.419 [2024-11-20 01:26:26.398644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.419 [2024-11-20 01:26:26.398660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.419 [2024-11-20 01:26:26.398674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.419 [2024-11-20 01:26:26.398690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.419 [2024-11-20 01:26:26.398704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.419 [2024-11-20 01:26:26.398720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.419 [2024-11-20 01:26:26.398734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.419 [2024-11-20 01:26:26.398750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.419 [2024-11-20 01:26:26.398763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.419 [2024-11-20 01:26:26.398779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.419 [2024-11-20 01:26:26.398793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.419 [2024-11-20 01:26:26.398808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.419 [2024-11-20 01:26:26.398823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.419 [2024-11-20 01:26:26.398838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.419 [2024-11-20 01:26:26.398852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.420 [2024-11-20 01:26:26.398867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.420 [2024-11-20 01:26:26.398881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.420 [2024-11-20 01:26:26.398897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.420 [2024-11-20 01:26:26.398911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.420 [2024-11-20 01:26:26.398930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.420 [2024-11-20 01:26:26.398945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.420 [2024-11-20 01:26:26.398961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.420 [2024-11-20 01:26:26.398975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.420 [2024-11-20 01:26:26.398991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.420 [2024-11-20 01:26:26.399005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.420 [2024-11-20 01:26:26.399127] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1c81d20 was disconnected and freed. reset controller. 00:25:18.420 [2024-11-20 01:26:26.399173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.420 [2024-11-20 01:26:26.399192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.420 [2024-11-20 01:26:26.399214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.420 [2024-11-20 01:26:26.399230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.420 [2024-11-20 01:26:26.399246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.420 [2024-11-20 01:26:26.399260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.420 [2024-11-20 01:26:26.399275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.420 [2024-11-20 01:26:26.399289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.420 [2024-11-20 01:26:26.399305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.420 [2024-11-20 01:26:26.399319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.420 [2024-11-20 01:26:26.399334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.420 [2024-11-20 01:26:26.399348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.420 [2024-11-20 01:26:26.399370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.420 [2024-11-20 01:26:26.399384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.420 [2024-11-20 01:26:26.399399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.420 [2024-11-20 01:26:26.399413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.420 [2024-11-20 01:26:26.399434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.420 [2024-11-20 01:26:26.399447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.420 [2024-11-20 01:26:26.399468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.420 [2024-11-20 01:26:26.399483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.420 [2024-11-20 01:26:26.399499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.420 [2024-11-20 01:26:26.399512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.420 [2024-11-20 01:26:26.399528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.420 [2024-11-20 01:26:26.399542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.420 [2024-11-20 01:26:26.399557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.420 [2024-11-20 01:26:26.399571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.420 [2024-11-20 01:26:26.399586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.420 [2024-11-20 01:26:26.399600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.420 [2024-11-20 01:26:26.399616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.420 [2024-11-20 01:26:26.399630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.420 [2024-11-20 01:26:26.399645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.420 [2024-11-20 01:26:26.399659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.420 [2024-11-20 01:26:26.399674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.420 [2024-11-20 01:26:26.399688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.420 [2024-11-20 01:26:26.399704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.420 [2024-11-20 01:26:26.399718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.420 [2024-11-20 01:26:26.399734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.420 [2024-11-20 01:26:26.399748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.420 [2024-11-20 01:26:26.399763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.420 [2024-11-20 01:26:26.399777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.420 [2024-11-20 01:26:26.399793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.420 [2024-11-20 01:26:26.399807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.420 [2024-11-20 01:26:26.399822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.420 [2024-11-20 01:26:26.399840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.420 [2024-11-20 01:26:26.399856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.420 [2024-11-20 01:26:26.399870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.420 [2024-11-20 01:26:26.399886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.420 [2024-11-20 01:26:26.399900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.420 [2024-11-20 01:26:26.399916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.420 [2024-11-20 01:26:26.399930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.420 [2024-11-20 01:26:26.399946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.420 [2024-11-20 01:26:26.399960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.420 [2024-11-20 01:26:26.399976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.420 [2024-11-20 01:26:26.399990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.420 [2024-11-20 01:26:26.400005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.420 [2024-11-20 01:26:26.400020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.420 [2024-11-20 01:26:26.400036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.420 [2024-11-20 01:26:26.400050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.420 [2024-11-20 01:26:26.400075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.420 [2024-11-20 01:26:26.400091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.420 [2024-11-20 01:26:26.400108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.420 [2024-11-20 01:26:26.400123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.420 [2024-11-20 01:26:26.400138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.420 [2024-11-20 01:26:26.400152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.420 [2024-11-20 01:26:26.400168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.420 [2024-11-20 01:26:26.400182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.421 [2024-11-20 01:26:26.400198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.421 [2024-11-20 01:26:26.400212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.421 [2024-11-20 01:26:26.400232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.421 [2024-11-20 01:26:26.400246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.421 [2024-11-20 01:26:26.400261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.421 [2024-11-20 01:26:26.400275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.421 [2024-11-20 01:26:26.400291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.421 [2024-11-20 01:26:26.400305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.421 [2024-11-20 01:26:26.400320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.421 [2024-11-20 01:26:26.400333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.421 [2024-11-20 01:26:26.400349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.421 [2024-11-20 01:26:26.400363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.421 [2024-11-20 01:26:26.400382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.421 [2024-11-20 01:26:26.400396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.421 [2024-11-20 01:26:26.400411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.421 [2024-11-20 01:26:26.400425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.421 [2024-11-20 01:26:26.400441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.421 [2024-11-20 01:26:26.400455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.421 [2024-11-20 01:26:26.400470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.421 [2024-11-20 01:26:26.400483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.421 [2024-11-20 01:26:26.400499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.421 [2024-11-20 01:26:26.400513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.421 [2024-11-20 01:26:26.400528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.421 [2024-11-20 01:26:26.400542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.421 [2024-11-20 01:26:26.400557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.421 [2024-11-20 01:26:26.400570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.421 [2024-11-20 01:26:26.400586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.421 [2024-11-20 01:26:26.400603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.421 [2024-11-20 01:26:26.400618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.421 [2024-11-20 01:26:26.400633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.421 [2024-11-20 01:26:26.400647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.421 [2024-11-20 01:26:26.400661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.421 [2024-11-20 01:26:26.400676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.421 [2024-11-20 01:26:26.400691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.421 [2024-11-20 01:26:26.400706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.421 [2024-11-20 01:26:26.400720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.421 [2024-11-20 01:26:26.400736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.421 [2024-11-20 01:26:26.400750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.421 [2024-11-20 01:26:26.400765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.421 [2024-11-20 01:26:26.400779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.421 [2024-11-20 01:26:26.400794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.421 [2024-11-20 01:26:26.400808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.421 [2024-11-20 01:26:26.400824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.421 [2024-11-20 01:26:26.400838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.421 [2024-11-20 01:26:26.400853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.421 [2024-11-20 01:26:26.400866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.421 [2024-11-20 01:26:26.400882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.421 [2024-11-20 01:26:26.400896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.421 [2024-11-20 01:26:26.400911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.421 [2024-11-20 01:26:26.400926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.421 [2024-11-20 01:26:26.400941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.421 [2024-11-20 01:26:26.400955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.421 [2024-11-20 01:26:26.400974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.421 [2024-11-20 01:26:26.400990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.421 [2024-11-20 01:26:26.401005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.421 [2024-11-20 01:26:26.401019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.421 [2024-11-20 01:26:26.401033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.421 [2024-11-20 01:26:26.401047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.421 [2024-11-20 01:26:26.401065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.421 [2024-11-20 01:26:26.401086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.421 [2024-11-20 01:26:26.401102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.421 [2024-11-20 01:26:26.401116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.421 [2024-11-20 01:26:26.401211] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1c83300 was disconnected and freed. reset controller. 00:25:18.421 [2024-11-20 01:26:26.403546] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:18.421 [2024-11-20 01:26:26.403621] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1cbe5f0 (9): Bad file descriptor 00:25:18.421 [2024-11-20 01:26:26.403659] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1cbf200 (9): Bad file descriptor 00:25:18.421 [2024-11-20 01:26:26.403690] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ce4c00 (9): Bad file descriptor 00:25:18.421 [2024-11-20 01:26:26.403726] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1cc6a30 (9): Bad file descriptor 00:25:18.421 [2024-11-20 01:26:26.403758] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e5a240 (9): Bad file descriptor 00:25:18.421 [2024-11-20 01:26:26.403790] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e60e80 (9): Bad file descriptor 00:25:18.421 [2024-11-20 01:26:26.403816] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1cbd710 (9): Bad file descriptor 00:25:18.421 [2024-11-20 01:26:26.403841] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e3c980 (9): Bad file descriptor 00:25:18.421 [2024-11-20 01:26:26.403866] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1cde190 (9): Bad file descriptor 00:25:18.422 [2024-11-20 01:26:26.404030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.422 [2024-11-20 01:26:26.404054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.422 [2024-11-20 01:26:26.404093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.422 [2024-11-20 01:26:26.404110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.422 [2024-11-20 01:26:26.404126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.422 [2024-11-20 01:26:26.404141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.422 [2024-11-20 01:26:26.404163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.422 [2024-11-20 01:26:26.404178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.422 [2024-11-20 01:26:26.404194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.422 [2024-11-20 01:26:26.404209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.422 [2024-11-20 01:26:26.404224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.422 [2024-11-20 01:26:26.404238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.422 [2024-11-20 01:26:26.404254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.422 [2024-11-20 01:26:26.404268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.422 [2024-11-20 01:26:26.404284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.422 [2024-11-20 01:26:26.404298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.422 [2024-11-20 01:26:26.404315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.422 [2024-11-20 01:26:26.404329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.422 [2024-11-20 01:26:26.404344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.422 [2024-11-20 01:26:26.404364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.422 [2024-11-20 01:26:26.404380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.422 [2024-11-20 01:26:26.404394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.422 [2024-11-20 01:26:26.404411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.422 [2024-11-20 01:26:26.404429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.422 [2024-11-20 01:26:26.404445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.422 [2024-11-20 01:26:26.404460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.422 [2024-11-20 01:26:26.404475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.422 [2024-11-20 01:26:26.404490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.422 [2024-11-20 01:26:26.404505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.422 [2024-11-20 01:26:26.404520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.422 [2024-11-20 01:26:26.404536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.422 [2024-11-20 01:26:26.404553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.422 [2024-11-20 01:26:26.404569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.422 [2024-11-20 01:26:26.404583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.422 [2024-11-20 01:26:26.404599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.422 [2024-11-20 01:26:26.404613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.422 [2024-11-20 01:26:26.404629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.422 [2024-11-20 01:26:26.404643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.422 [2024-11-20 01:26:26.404658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.422 [2024-11-20 01:26:26.404672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.422 [2024-11-20 01:26:26.404687] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e0ae90 is same with the state(5) to be set 00:25:18.422 [2024-11-20 01:26:26.404760] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1e0ae90 was disconnected and freed. reset controller. 00:25:18.422 [2024-11-20 01:26:26.408291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.422 [2024-11-20 01:26:26.408322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.422 [2024-11-20 01:26:26.408347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.422 [2024-11-20 01:26:26.408363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.422 [2024-11-20 01:26:26.408386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.422 [2024-11-20 01:26:26.408400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.422 [2024-11-20 01:26:26.408416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.422 [2024-11-20 01:26:26.408430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.422 [2024-11-20 01:26:26.408446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.422 [2024-11-20 01:26:26.408460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.422 [2024-11-20 01:26:26.408475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.422 [2024-11-20 01:26:26.408489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.422 [2024-11-20 01:26:26.408505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.422 [2024-11-20 01:26:26.408518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.422 [2024-11-20 01:26:26.408540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.422 [2024-11-20 01:26:26.408555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.422 [2024-11-20 01:26:26.408570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.422 [2024-11-20 01:26:26.408584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.422 [2024-11-20 01:26:26.408599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.422 [2024-11-20 01:26:26.408614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.422 [2024-11-20 01:26:26.408629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.422 [2024-11-20 01:26:26.408643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.422 [2024-11-20 01:26:26.408658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.422 [2024-11-20 01:26:26.408672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.422 [2024-11-20 01:26:26.408688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.422 [2024-11-20 01:26:26.408702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.422 [2024-11-20 01:26:26.408717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.422 [2024-11-20 01:26:26.408731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.422 [2024-11-20 01:26:26.408746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.422 [2024-11-20 01:26:26.408760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.422 [2024-11-20 01:26:26.408776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.422 [2024-11-20 01:26:26.408789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.422 [2024-11-20 01:26:26.408804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.422 [2024-11-20 01:26:26.408818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.422 [2024-11-20 01:26:26.408833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.422 [2024-11-20 01:26:26.408848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.422 [2024-11-20 01:26:26.408864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.423 [2024-11-20 01:26:26.408879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.423 [2024-11-20 01:26:26.408895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.423 [2024-11-20 01:26:26.408912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.423 [2024-11-20 01:26:26.408927] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c848e0 is same with the state(5) to be set 00:25:18.423 [2024-11-20 01:26:26.409000] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1c848e0 was disconnected and freed. reset controller. 00:25:18.423 [2024-11-20 01:26:26.410096] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:25:18.423 [2024-11-20 01:26:26.410130] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:25:18.423 [2024-11-20 01:26:26.410300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:18.423 [2024-11-20 01:26:26.410404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:18.423 [2024-11-20 01:26:26.410431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c92fe0 with addr=10.0.0.2, port=4420 00:25:18.423 [2024-11-20 01:26:26.410448] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c92fe0 is same with the state(5) to be set 00:25:18.423 [2024-11-20 01:26:26.412982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.423 [2024-11-20 01:26:26.413010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.423 [2024-11-20 01:26:26.413033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.423 [2024-11-20 01:26:26.413061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.423 [2024-11-20 01:26:26.413092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.423 [2024-11-20 01:26:26.413108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.423 [2024-11-20 01:26:26.413124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.423 [2024-11-20 01:26:26.413138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.423 [2024-11-20 01:26:26.413154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.423 [2024-11-20 01:26:26.413167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.423 [2024-11-20 01:26:26.413182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.423 [2024-11-20 01:26:26.413197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.423 [2024-11-20 01:26:26.413212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.423 [2024-11-20 01:26:26.413226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.423 [2024-11-20 01:26:26.413241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.423 [2024-11-20 01:26:26.413255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.423 [2024-11-20 01:26:26.413270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.423 [2024-11-20 01:26:26.413291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.423 [2024-11-20 01:26:26.413308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.423 [2024-11-20 01:26:26.413322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.423 [2024-11-20 01:26:26.413337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.423 [2024-11-20 01:26:26.413350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.423 [2024-11-20 01:26:26.413366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.423 [2024-11-20 01:26:26.413380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.423 [2024-11-20 01:26:26.413395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.423 [2024-11-20 01:26:26.413408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.423 [2024-11-20 01:26:26.413424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.423 [2024-11-20 01:26:26.413437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.423 [2024-11-20 01:26:26.413452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.423 [2024-11-20 01:26:26.413465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.423 [2024-11-20 01:26:26.413481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.423 [2024-11-20 01:26:26.413494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.423 [2024-11-20 01:26:26.413509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.423 [2024-11-20 01:26:26.413523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.423 [2024-11-20 01:26:26.413537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.423 [2024-11-20 01:26:26.413551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.423 [2024-11-20 01:26:26.413565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.423 [2024-11-20 01:26:26.413579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.423 [2024-11-20 01:26:26.413594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.423 [2024-11-20 01:26:26.413608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.423 [2024-11-20 01:26:26.413623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.423 [2024-11-20 01:26:26.413636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.423 [2024-11-20 01:26:26.413660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.423 [2024-11-20 01:26:26.413675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.423 [2024-11-20 01:26:26.413690] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c874a0 is same with the state(5) to be set 00:25:18.423 [2024-11-20 01:26:26.413760] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1c874a0 was disconnected and freed. reset controller. 00:25:18.423 [2024-11-20 01:26:26.413834] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:18.423 [2024-11-20 01:26:26.413910] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:18.423 [2024-11-20 01:26:26.413948] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:25:18.423 [2024-11-20 01:26:26.413973] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:25:18.423 [2024-11-20 01:26:26.414095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:18.423 [2024-11-20 01:26:26.414205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:18.423 [2024-11-20 01:26:26.414231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1cbd710 with addr=10.0.0.2, port=4420 00:25:18.423 [2024-11-20 01:26:26.414247] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cbd710 is same with the state(5) to be set 00:25:18.423 [2024-11-20 01:26:26.414338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:18.423 [2024-11-20 01:26:26.414431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:18.423 [2024-11-20 01:26:26.414456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1e3c980 with addr=10.0.0.2, port=4420 00:25:18.423 [2024-11-20 01:26:26.414471] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e3c980 is same with the state(5) to be set 00:25:18.423 [2024-11-20 01:26:26.414493] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c92fe0 (9): Bad file descriptor 00:25:18.423 [2024-11-20 01:26:26.414515] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:18.423 [2024-11-20 01:26:26.414547] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:18.423 [2024-11-20 01:26:26.414583] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:18.423 [2024-11-20 01:26:26.414604] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:18.423 [2024-11-20 01:26:26.416414] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:25:18.423 [2024-11-20 01:26:26.416464] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:25:18.423 [2024-11-20 01:26:26.416571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:18.423 [2024-11-20 01:26:26.416673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:18.423 [2024-11-20 01:26:26.416700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1e60e80 with addr=10.0.0.2, port=4420 00:25:18.423 [2024-11-20 01:26:26.416716] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e60e80 is same with the state(5) to be set 00:25:18.423 [2024-11-20 01:26:26.416798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:18.423 [2024-11-20 01:26:26.416893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:18.423 [2024-11-20 01:26:26.416919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1cbf200 with addr=10.0.0.2, port=4420 00:25:18.423 [2024-11-20 01:26:26.416934] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cbf200 is same with the state(5) to be set 00:25:18.423 [2024-11-20 01:26:26.416959] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1cbd710 (9): Bad file descriptor 00:25:18.424 [2024-11-20 01:26:26.416978] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e3c980 (9): Bad file descriptor 00:25:18.424 [2024-11-20 01:26:26.416994] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:25:18.424 [2024-11-20 01:26:26.417007] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:25:18.424 [2024-11-20 01:26:26.417022] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:18.424 [2024-11-20 01:26:26.417690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.424 [2024-11-20 01:26:26.417716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.424 [2024-11-20 01:26:26.417739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.424 [2024-11-20 01:26:26.417754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.424 [2024-11-20 01:26:26.417770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.424 [2024-11-20 01:26:26.417784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.424 [2024-11-20 01:26:26.417799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.424 [2024-11-20 01:26:26.417813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.424 [2024-11-20 01:26:26.417829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.424 [2024-11-20 01:26:26.417842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.424 [2024-11-20 01:26:26.417858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.424 [2024-11-20 01:26:26.417871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.424 [2024-11-20 01:26:26.417887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.424 [2024-11-20 01:26:26.417900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.424 [2024-11-20 01:26:26.417916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.424 [2024-11-20 01:26:26.417933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.424 [2024-11-20 01:26:26.417949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.424 [2024-11-20 01:26:26.417963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.424 [2024-11-20 01:26:26.417978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.424 [2024-11-20 01:26:26.417992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.424 [2024-11-20 01:26:26.418007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.424 [2024-11-20 01:26:26.418027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.424 [2024-11-20 01:26:26.418043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.424 [2024-11-20 01:26:26.418061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.424 [2024-11-20 01:26:26.418086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.424 [2024-11-20 01:26:26.418102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.424 [2024-11-20 01:26:26.418117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.424 [2024-11-20 01:26:26.418131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.424 [2024-11-20 01:26:26.418147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.424 [2024-11-20 01:26:26.418160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.424 [2024-11-20 01:26:26.418175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.424 [2024-11-20 01:26:26.418189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.424 [2024-11-20 01:26:26.418204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.424 [2024-11-20 01:26:26.418218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.424 [2024-11-20 01:26:26.418233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.424 [2024-11-20 01:26:26.418247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.424 [2024-11-20 01:26:26.418262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.424 [2024-11-20 01:26:26.418276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.424 [2024-11-20 01:26:26.418291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.424 [2024-11-20 01:26:26.418305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.424 [2024-11-20 01:26:26.418320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.424 [2024-11-20 01:26:26.418334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.424 [2024-11-20 01:26:26.418358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.424 [2024-11-20 01:26:26.418372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.424 [2024-11-20 01:26:26.418388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.424 [2024-11-20 01:26:26.418402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.424 [2024-11-20 01:26:26.418432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.424 [2024-11-20 01:26:26.418447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.424 [2024-11-20 01:26:26.418462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.424 [2024-11-20 01:26:26.418476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.424 [2024-11-20 01:26:26.418491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.424 [2024-11-20 01:26:26.418505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.424 [2024-11-20 01:26:26.418521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.424 [2024-11-20 01:26:26.418535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.424 [2024-11-20 01:26:26.418550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.424 [2024-11-20 01:26:26.418566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.424 [2024-11-20 01:26:26.418581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.424 [2024-11-20 01:26:26.418595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.424 [2024-11-20 01:26:26.418610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.424 [2024-11-20 01:26:26.418624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.424 [2024-11-20 01:26:26.418640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.424 [2024-11-20 01:26:26.418653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.424 [2024-11-20 01:26:26.418669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.424 [2024-11-20 01:26:26.418682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.424 [2024-11-20 01:26:26.418698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.424 [2024-11-20 01:26:26.418712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.424 [2024-11-20 01:26:26.418727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.424 [2024-11-20 01:26:26.418741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.424 [2024-11-20 01:26:26.418757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.424 [2024-11-20 01:26:26.418772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.424 [2024-11-20 01:26:26.418787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.424 [2024-11-20 01:26:26.418804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.424 [2024-11-20 01:26:26.418820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.424 [2024-11-20 01:26:26.418835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.424 [2024-11-20 01:26:26.418850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.424 [2024-11-20 01:26:26.418864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.425 [2024-11-20 01:26:26.418880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.425 [2024-11-20 01:26:26.418894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.425 [2024-11-20 01:26:26.418910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.425 [2024-11-20 01:26:26.418923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.425 [2024-11-20 01:26:26.418939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.425 [2024-11-20 01:26:26.418953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.425 [2024-11-20 01:26:26.418968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.425 [2024-11-20 01:26:26.418982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.425 [2024-11-20 01:26:26.418998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.425 [2024-11-20 01:26:26.419012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.425 [2024-11-20 01:26:26.419027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.425 [2024-11-20 01:26:26.419041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.425 [2024-11-20 01:26:26.419066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.425 [2024-11-20 01:26:26.419086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.425 [2024-11-20 01:26:26.419102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.425 [2024-11-20 01:26:26.419117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.425 [2024-11-20 01:26:26.419132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.425 [2024-11-20 01:26:26.419146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.425 [2024-11-20 01:26:26.419162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.425 [2024-11-20 01:26:26.419177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.425 [2024-11-20 01:26:26.419196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.425 [2024-11-20 01:26:26.419211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.425 [2024-11-20 01:26:26.419226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.425 [2024-11-20 01:26:26.419240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.425 [2024-11-20 01:26:26.419256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.425 [2024-11-20 01:26:26.419270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.425 [2024-11-20 01:26:26.419285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.425 [2024-11-20 01:26:26.419299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.425 [2024-11-20 01:26:26.419315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.425 [2024-11-20 01:26:26.419328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.425 [2024-11-20 01:26:26.419344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.425 [2024-11-20 01:26:26.419357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.425 [2024-11-20 01:26:26.419376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.425 [2024-11-20 01:26:26.419390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.425 [2024-11-20 01:26:26.419405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.425 [2024-11-20 01:26:26.419419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.425 [2024-11-20 01:26:26.419435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.425 [2024-11-20 01:26:26.419448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.425 [2024-11-20 01:26:26.419464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.425 [2024-11-20 01:26:26.419479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.425 [2024-11-20 01:26:26.419494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.425 [2024-11-20 01:26:26.419508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.425 [2024-11-20 01:26:26.419524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.425 [2024-11-20 01:26:26.419537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.425 [2024-11-20 01:26:26.419553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.425 [2024-11-20 01:26:26.419571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.425 [2024-11-20 01:26:26.419587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.425 [2024-11-20 01:26:26.419601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.425 [2024-11-20 01:26:26.419617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.425 [2024-11-20 01:26:26.419630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.425 [2024-11-20 01:26:26.419646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.425 [2024-11-20 01:26:26.419660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.425 [2024-11-20 01:26:26.419674] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c88a80 is same with the state(5) to be set 00:25:18.425 [2024-11-20 01:26:26.421374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.425 [2024-11-20 01:26:26.421399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.425 [2024-11-20 01:26:26.421430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.425 [2024-11-20 01:26:26.421445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.425 [2024-11-20 01:26:26.421461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.425 [2024-11-20 01:26:26.421474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.425 [2024-11-20 01:26:26.421491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.425 [2024-11-20 01:26:26.421514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.425 [2024-11-20 01:26:26.421530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.425 [2024-11-20 01:26:26.421544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.425 [2024-11-20 01:26:26.421559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.425 [2024-11-20 01:26:26.421574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.425 [2024-11-20 01:26:26.421589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.425 [2024-11-20 01:26:26.421603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.425 [2024-11-20 01:26:26.421618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.425 [2024-11-20 01:26:26.421632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.426 [2024-11-20 01:26:26.421648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.426 [2024-11-20 01:26:26.421667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.426 [2024-11-20 01:26:26.421683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.426 [2024-11-20 01:26:26.421698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.426 [2024-11-20 01:26:26.421713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.426 [2024-11-20 01:26:26.421726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.426 [2024-11-20 01:26:26.421742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.426 [2024-11-20 01:26:26.421755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.426 [2024-11-20 01:26:26.421771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.426 [2024-11-20 01:26:26.421794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.426 [2024-11-20 01:26:26.421809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.426 [2024-11-20 01:26:26.421824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.426 [2024-11-20 01:26:26.421839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.426 [2024-11-20 01:26:26.421853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.426 [2024-11-20 01:26:26.421868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.426 [2024-11-20 01:26:26.421882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.426 [2024-11-20 01:26:26.421898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.426 [2024-11-20 01:26:26.421912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.426 [2024-11-20 01:26:26.421927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.426 [2024-11-20 01:26:26.421940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.426 [2024-11-20 01:26:26.421955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.426 [2024-11-20 01:26:26.421969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.426 [2024-11-20 01:26:26.421984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.426 [2024-11-20 01:26:26.421998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.426 [2024-11-20 01:26:26.422013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.426 [2024-11-20 01:26:26.422027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.426 [2024-11-20 01:26:26.422046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.426 [2024-11-20 01:26:26.422064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.426 [2024-11-20 01:26:26.422088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.426 [2024-11-20 01:26:26.422102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.426 [2024-11-20 01:26:26.422118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.426 [2024-11-20 01:26:26.422131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.426 [2024-11-20 01:26:26.422147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.426 [2024-11-20 01:26:26.422160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.426 [2024-11-20 01:26:26.422176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.426 [2024-11-20 01:26:26.422190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.426 [2024-11-20 01:26:26.422205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.426 [2024-11-20 01:26:26.422219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.426 [2024-11-20 01:26:26.422234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.426 [2024-11-20 01:26:26.422248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.426 [2024-11-20 01:26:26.422264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.426 [2024-11-20 01:26:26.422279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.426 [2024-11-20 01:26:26.422296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.426 [2024-11-20 01:26:26.422310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.426 [2024-11-20 01:26:26.422326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.426 [2024-11-20 01:26:26.422339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.426 [2024-11-20 01:26:26.422355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.426 [2024-11-20 01:26:26.422370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.426 [2024-11-20 01:26:26.422385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.426 [2024-11-20 01:26:26.422398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.426 [2024-11-20 01:26:26.422413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.426 [2024-11-20 01:26:26.422431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.426 [2024-11-20 01:26:26.422448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.426 [2024-11-20 01:26:26.422462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.426 [2024-11-20 01:26:26.422486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.426 [2024-11-20 01:26:26.422500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.426 [2024-11-20 01:26:26.422515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.426 [2024-11-20 01:26:26.422529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.426 [2024-11-20 01:26:26.422544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.426 [2024-11-20 01:26:26.422558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.426 [2024-11-20 01:26:26.422574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.426 [2024-11-20 01:26:26.422588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.426 [2024-11-20 01:26:26.422604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.426 [2024-11-20 01:26:26.422618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.426 [2024-11-20 01:26:26.422634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.426 [2024-11-20 01:26:26.422648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.426 [2024-11-20 01:26:26.422663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.426 [2024-11-20 01:26:26.422677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.426 [2024-11-20 01:26:26.422692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.426 [2024-11-20 01:26:26.422706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.426 [2024-11-20 01:26:26.422722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.426 [2024-11-20 01:26:26.422735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.426 [2024-11-20 01:26:26.422751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.426 [2024-11-20 01:26:26.422765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.426 [2024-11-20 01:26:26.422781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.426 [2024-11-20 01:26:26.422795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.426 [2024-11-20 01:26:26.422813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.426 [2024-11-20 01:26:26.422828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.426 [2024-11-20 01:26:26.422843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.427 [2024-11-20 01:26:26.422857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.427 [2024-11-20 01:26:26.422872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.427 [2024-11-20 01:26:26.422886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.427 [2024-11-20 01:26:26.422901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.427 [2024-11-20 01:26:26.422914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.427 [2024-11-20 01:26:26.422929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.427 [2024-11-20 01:26:26.422943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.427 [2024-11-20 01:26:26.422958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.427 [2024-11-20 01:26:26.422972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.427 [2024-11-20 01:26:26.422987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.427 [2024-11-20 01:26:26.423001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.427 [2024-11-20 01:26:26.423016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.427 [2024-11-20 01:26:26.423029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.427 [2024-11-20 01:26:26.423044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.427 [2024-11-20 01:26:26.423065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.427 [2024-11-20 01:26:26.423088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.427 [2024-11-20 01:26:26.423103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.427 [2024-11-20 01:26:26.423118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.427 [2024-11-20 01:26:26.423132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.427 [2024-11-20 01:26:26.423147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.427 [2024-11-20 01:26:26.423161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.427 [2024-11-20 01:26:26.423177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.427 [2024-11-20 01:26:26.423194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.427 [2024-11-20 01:26:26.423210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.427 [2024-11-20 01:26:26.423224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.427 [2024-11-20 01:26:26.423239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.427 [2024-11-20 01:26:26.423253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.427 [2024-11-20 01:26:26.423269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.427 [2024-11-20 01:26:26.423283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.427 [2024-11-20 01:26:26.423298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.427 [2024-11-20 01:26:26.423312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.427 [2024-11-20 01:26:26.423328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:18.427 [2024-11-20 01:26:26.423342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:18.427 [2024-11-20 01:26:26.423356] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c8a060 is same with the state(5) to be set 00:25:18.427 [2024-11-20 01:26:26.424935] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:18.427 [2024-11-20 01:26:26.424963] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:25:18.427 [2024-11-20 01:26:26.424985] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:25:18.427 task offset: 28800 on job bdev=Nvme1n1 fails 00:25:18.427 00:25:18.427 Latency(us) 00:25:18.427 [2024-11-20T00:26:26.646Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:18.427 [2024-11-20T00:26:26.646Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:18.427 [2024-11-20T00:26:26.646Z] Job: Nvme1n1 ended in about 0.58 seconds with error 00:25:18.427 Verification LBA range: start 0x0 length 0x400 00:25:18.427 Nvme1n1 : 0.58 357.94 22.37 110.13 0.00 135595.98 15825.73 161558.38 00:25:18.427 [2024-11-20T00:26:26.646Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:18.427 [2024-11-20T00:26:26.646Z] Job: Nvme2n1 ended in about 0.60 seconds with error 00:25:18.427 Verification LBA range: start 0x0 length 0x400 00:25:18.427 Nvme2n1 : 0.60 347.35 21.71 33.40 0.00 161560.08 16311.18 143693.75 00:25:18.427 [2024-11-20T00:26:26.646Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:18.427 [2024-11-20T00:26:26.646Z] Job: Nvme3n1 ended in about 0.59 seconds with error 00:25:18.427 Verification LBA range: start 0x0 length 0x400 00:25:18.427 Nvme3n1 : 0.59 350.67 21.92 107.90 0.00 134884.94 51263.72 115731.72 00:25:18.427 [2024-11-20T00:26:26.646Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:18.427 [2024-11-20T00:26:26.646Z] Job: Nvme4n1 ended in about 0.59 seconds with error 00:25:18.427 Verification LBA range: start 0x0 length 0x400 00:25:18.427 Nvme4n1 : 0.59 350.02 21.88 107.70 0.00 133422.87 44661.57 115731.72 00:25:18.427 [2024-11-20T00:26:26.646Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:18.427 [2024-11-20T00:26:26.646Z] Job: Nvme5n1 ended in about 0.60 seconds with error 00:25:18.427 Verification LBA range: start 0x0 length 0x400 00:25:18.427 Nvme5n1 : 0.60 349.38 21.84 107.50 0.00 131843.01 38253.61 115731.72 00:25:18.427 [2024-11-20T00:26:26.646Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:18.427 [2024-11-20T00:26:26.646Z] Job: Nvme6n1 ended in about 0.60 seconds with error 00:25:18.427 Verification LBA range: start 0x0 length 0x400 00:25:18.427 Nvme6n1 : 0.60 346.80 21.68 33.35 0.00 154656.44 9951.76 122722.23 00:25:18.427 [2024-11-20T00:26:26.646Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:18.427 [2024-11-20T00:26:26.646Z] Job: Nvme7n1 ended in about 0.59 seconds with error 00:25:18.427 Verification LBA range: start 0x0 length 0x400 00:25:18.427 Nvme7n1 : 0.59 352.29 22.02 108.40 0.00 127292.97 16990.81 118838.61 00:25:18.427 [2024-11-20T00:26:26.646Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:18.427 [2024-11-20T00:26:26.646Z] Job: Nvme8n1 ended in about 0.60 seconds with error 00:25:18.427 Verification LBA range: start 0x0 length 0x400 00:25:18.427 Nvme8n1 : 0.60 341.34 21.33 36.45 0.00 152443.17 5898.24 119615.34 00:25:18.427 [2024-11-20T00:26:26.646Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:18.427 [2024-11-20T00:26:26.646Z] Job: Nvme9n1 ended in about 0.61 seconds with error 00:25:18.427 Verification LBA range: start 0x0 length 0x400 00:25:18.427 Nvme9n1 : 0.61 269.78 16.86 105.28 0.00 152674.61 99032.18 121168.78 00:25:18.427 [2024-11-20T00:26:26.646Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:18.427 [2024-11-20T00:26:26.646Z] Job: Nvme10n1 ended in about 0.61 seconds with error 00:25:18.427 Verification LBA range: start 0x0 length 0x400 00:25:18.427 Nvme10n1 : 0.61 268.16 16.76 104.65 0.00 151638.13 98255.45 122722.23 00:25:18.427 [2024-11-20T00:26:26.646Z] =================================================================================================================== 00:25:18.427 [2024-11-20T00:26:26.646Z] Total : 3333.74 208.36 854.76 0.00 142633.81 5898.24 161558.38 00:25:18.427 [2024-11-20 01:26:26.452282] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:25:18.427 [2024-11-20 01:26:26.452378] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:25:18.427 [2024-11-20 01:26:26.452669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:18.427 [2024-11-20 01:26:26.452780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:18.427 [2024-11-20 01:26:26.452807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1cde190 with addr=10.0.0.2, port=4420 00:25:18.427 [2024-11-20 01:26:26.452827] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cde190 is same with the state(5) to be set 00:25:18.427 [2024-11-20 01:26:26.452948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:18.427 [2024-11-20 01:26:26.453057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:18.427 [2024-11-20 01:26:26.453090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1cbe5f0 with addr=10.0.0.2, port=4420 00:25:18.427 [2024-11-20 01:26:26.453107] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cbe5f0 is same with the state(5) to be set 00:25:18.427 [2024-11-20 01:26:26.453132] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e60e80 (9): Bad file descriptor 00:25:18.427 [2024-11-20 01:26:26.453155] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1cbf200 (9): Bad file descriptor 00:25:18.427 [2024-11-20 01:26:26.453172] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:25:18.427 [2024-11-20 01:26:26.453186] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:25:18.427 [2024-11-20 01:26:26.453202] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:25:18.427 [2024-11-20 01:26:26.453229] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:25:18.428 [2024-11-20 01:26:26.453244] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:25:18.428 [2024-11-20 01:26:26.453257] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:25:18.428 [2024-11-20 01:26:26.453284] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:18.428 [2024-11-20 01:26:26.453323] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:18.428 [2024-11-20 01:26:26.453393] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:18.428 [2024-11-20 01:26:26.453417] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:18.428 [2024-11-20 01:26:26.453838] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:18.428 [2024-11-20 01:26:26.453863] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:18.428 [2024-11-20 01:26:26.453987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:18.428 [2024-11-20 01:26:26.454112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:18.428 [2024-11-20 01:26:26.454139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1cc6a30 with addr=10.0.0.2, port=4420 00:25:18.428 [2024-11-20 01:26:26.454156] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cc6a30 is same with the state(5) to be set 00:25:18.428 [2024-11-20 01:26:26.454241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:18.428 [2024-11-20 01:26:26.454321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:18.428 [2024-11-20 01:26:26.454347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ce4c00 with addr=10.0.0.2, port=4420 00:25:18.428 [2024-11-20 01:26:26.454366] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ce4c00 is same with the state(5) to be set 00:25:18.428 [2024-11-20 01:26:26.454464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:18.428 [2024-11-20 01:26:26.454555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:18.428 [2024-11-20 01:26:26.454580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1e5a240 with addr=10.0.0.2, port=4420 00:25:18.428 [2024-11-20 01:26:26.454595] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e5a240 is same with the state(5) to be set 00:25:18.428 [2024-11-20 01:26:26.454614] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1cde190 (9): Bad file descriptor 00:25:18.428 [2024-11-20 01:26:26.454632] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1cbe5f0 (9): Bad file descriptor 00:25:18.428 [2024-11-20 01:26:26.454648] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:25:18.428 [2024-11-20 01:26:26.454661] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:25:18.428 [2024-11-20 01:26:26.454674] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:25:18.428 [2024-11-20 01:26:26.454692] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:25:18.428 [2024-11-20 01:26:26.454705] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:25:18.428 [2024-11-20 01:26:26.454718] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:25:18.428 [2024-11-20 01:26:26.454741] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:18.428 [2024-11-20 01:26:26.454764] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:18.428 [2024-11-20 01:26:26.454806] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:18.428 [2024-11-20 01:26:26.454828] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:18.428 [2024-11-20 01:26:26.454846] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:18.428 [2024-11-20 01:26:26.455427] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:18.428 [2024-11-20 01:26:26.455481] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:18.428 [2024-11-20 01:26:26.455502] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:18.428 [2024-11-20 01:26:26.455535] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1cc6a30 (9): Bad file descriptor 00:25:18.428 [2024-11-20 01:26:26.455557] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ce4c00 (9): Bad file descriptor 00:25:18.428 [2024-11-20 01:26:26.455575] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e5a240 (9): Bad file descriptor 00:25:18.428 [2024-11-20 01:26:26.455591] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:25:18.428 [2024-11-20 01:26:26.455603] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:25:18.428 [2024-11-20 01:26:26.455616] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:25:18.428 [2024-11-20 01:26:26.455632] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:25:18.428 [2024-11-20 01:26:26.455645] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:25:18.428 [2024-11-20 01:26:26.455657] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:25:18.428 [2024-11-20 01:26:26.455729] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:25:18.428 [2024-11-20 01:26:26.455752] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:25:18.428 [2024-11-20 01:26:26.455769] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:18.428 [2024-11-20 01:26:26.455781] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:18.428 [2024-11-20 01:26:26.455877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:18.428 [2024-11-20 01:26:26.455959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:18.428 [2024-11-20 01:26:26.455985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c92fe0 with addr=10.0.0.2, port=4420 00:25:18.428 [2024-11-20 01:26:26.456000] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c92fe0 is same with the state(5) to be set 00:25:18.428 [2024-11-20 01:26:26.456015] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:25:18.428 [2024-11-20 01:26:26.456027] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:25:18.428 [2024-11-20 01:26:26.456039] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:25:18.428 [2024-11-20 01:26:26.456056] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode9] Ctrlr is in error state 00:25:18.428 [2024-11-20 01:26:26.456076] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode9] controller reinitialization failed 00:25:18.428 [2024-11-20 01:26:26.456090] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:25:18.428 [2024-11-20 01:26:26.456107] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:25:18.428 [2024-11-20 01:26:26.456120] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:25:18.428 [2024-11-20 01:26:26.456132] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:25:18.428 [2024-11-20 01:26:26.456187] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:18.428 [2024-11-20 01:26:26.456206] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:18.428 [2024-11-20 01:26:26.456218] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:18.428 [2024-11-20 01:26:26.456304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:18.428 [2024-11-20 01:26:26.456398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:18.428 [2024-11-20 01:26:26.456422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1e3c980 with addr=10.0.0.2, port=4420 00:25:18.428 [2024-11-20 01:26:26.456438] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e3c980 is same with the state(5) to be set 00:25:18.428 [2024-11-20 01:26:26.456516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:18.428 [2024-11-20 01:26:26.456593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:18.428 [2024-11-20 01:26:26.456618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1cbd710 with addr=10.0.0.2, port=4420 00:25:18.428 [2024-11-20 01:26:26.456634] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cbd710 is same with the state(5) to be set 00:25:18.428 [2024-11-20 01:26:26.456652] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c92fe0 (9): Bad file descriptor 00:25:18.428 [2024-11-20 01:26:26.456698] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e3c980 (9): Bad file descriptor 00:25:18.428 [2024-11-20 01:26:26.456721] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1cbd710 (9): Bad file descriptor 00:25:18.428 [2024-11-20 01:26:26.456737] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:25:18.428 [2024-11-20 01:26:26.456750] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:25:18.428 [2024-11-20 01:26:26.456763] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:18.428 [2024-11-20 01:26:26.456798] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:18.428 [2024-11-20 01:26:26.456816] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:25:18.428 [2024-11-20 01:26:26.456828] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:25:18.428 [2024-11-20 01:26:26.456841] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:25:18.428 [2024-11-20 01:26:26.456857] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:25:18.428 [2024-11-20 01:26:26.456870] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:25:18.428 [2024-11-20 01:26:26.456882] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:25:18.428 [2024-11-20 01:26:26.456920] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:18.428 [2024-11-20 01:26:26.456937] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:18.688 01:26:26 -- target/shutdown.sh@135 -- # nvmfpid= 00:25:18.688 01:26:26 -- target/shutdown.sh@138 -- # sleep 1 00:25:20.061 01:26:27 -- target/shutdown.sh@141 -- # kill -9 1216867 00:25:20.061 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 141: kill: (1216867) - No such process 00:25:20.061 01:26:27 -- target/shutdown.sh@141 -- # true 00:25:20.061 01:26:27 -- target/shutdown.sh@143 -- # stoptarget 00:25:20.061 01:26:27 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:25:20.061 01:26:27 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:25:20.061 01:26:27 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:20.061 01:26:27 -- target/shutdown.sh@45 -- # nvmftestfini 00:25:20.061 01:26:27 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:20.061 01:26:27 -- nvmf/common.sh@116 -- # sync 00:25:20.061 01:26:27 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:20.061 01:26:27 -- nvmf/common.sh@119 -- # set +e 00:25:20.061 01:26:27 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:20.061 01:26:27 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:20.061 rmmod nvme_tcp 00:25:20.061 rmmod nvme_fabrics 00:25:20.061 rmmod nvme_keyring 00:25:20.061 01:26:27 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:20.061 01:26:27 -- nvmf/common.sh@123 -- # set -e 00:25:20.061 01:26:27 -- nvmf/common.sh@124 -- # return 0 00:25:20.061 01:26:27 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:25:20.061 01:26:27 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:20.061 01:26:27 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:20.061 01:26:27 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:20.061 01:26:27 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:20.061 01:26:27 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:20.061 01:26:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:20.061 01:26:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:20.061 01:26:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:21.967 01:26:29 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:21.967 00:25:21.967 real 0m7.790s 00:25:21.967 user 0m19.422s 00:25:21.967 sys 0m1.423s 00:25:21.967 01:26:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:21.967 01:26:29 -- common/autotest_common.sh@10 -- # set +x 00:25:21.967 ************************************ 00:25:21.967 END TEST nvmf_shutdown_tc3 00:25:21.967 ************************************ 00:25:21.967 01:26:29 -- target/shutdown.sh@150 -- # trap - SIGINT SIGTERM EXIT 00:25:21.967 00:25:21.967 real 0m28.357s 00:25:21.967 user 1m21.288s 00:25:21.967 sys 0m6.194s 00:25:21.967 01:26:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:21.967 01:26:29 -- common/autotest_common.sh@10 -- # set +x 00:25:21.967 ************************************ 00:25:21.967 END TEST nvmf_shutdown 00:25:21.967 ************************************ 00:25:21.967 01:26:30 -- nvmf/nvmf.sh@86 -- # timing_exit target 00:25:21.967 01:26:30 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:21.967 01:26:30 -- common/autotest_common.sh@10 -- # set +x 00:25:21.968 01:26:30 -- nvmf/nvmf.sh@88 -- # timing_enter host 00:25:21.968 01:26:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:21.968 01:26:30 -- common/autotest_common.sh@10 -- # set +x 00:25:21.968 01:26:30 -- nvmf/nvmf.sh@90 -- # [[ 0 -eq 0 ]] 00:25:21.968 01:26:30 -- nvmf/nvmf.sh@91 -- # run_test nvmf_multicontroller /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:25:21.968 01:26:30 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:21.968 01:26:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:21.968 01:26:30 -- common/autotest_common.sh@10 -- # set +x 00:25:21.968 ************************************ 00:25:21.968 START TEST nvmf_multicontroller 00:25:21.968 ************************************ 00:25:21.968 01:26:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:25:21.968 * Looking for test storage... 00:25:21.968 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:21.968 01:26:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:21.968 01:26:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:21.968 01:26:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:21.968 01:26:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:21.968 01:26:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:21.968 01:26:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:21.968 01:26:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:21.968 01:26:30 -- scripts/common.sh@335 -- # IFS=.-: 00:25:21.968 01:26:30 -- scripts/common.sh@335 -- # read -ra ver1 00:25:21.968 01:26:30 -- scripts/common.sh@336 -- # IFS=.-: 00:25:21.968 01:26:30 -- scripts/common.sh@336 -- # read -ra ver2 00:25:21.968 01:26:30 -- scripts/common.sh@337 -- # local 'op=<' 00:25:21.968 01:26:30 -- scripts/common.sh@339 -- # ver1_l=2 00:25:21.968 01:26:30 -- scripts/common.sh@340 -- # ver2_l=1 00:25:21.968 01:26:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:21.968 01:26:30 -- scripts/common.sh@343 -- # case "$op" in 00:25:21.968 01:26:30 -- scripts/common.sh@344 -- # : 1 00:25:21.968 01:26:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:21.968 01:26:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:21.968 01:26:30 -- scripts/common.sh@364 -- # decimal 1 00:25:21.968 01:26:30 -- scripts/common.sh@352 -- # local d=1 00:25:21.968 01:26:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:21.968 01:26:30 -- scripts/common.sh@354 -- # echo 1 00:25:21.968 01:26:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:21.968 01:26:30 -- scripts/common.sh@365 -- # decimal 2 00:25:21.968 01:26:30 -- scripts/common.sh@352 -- # local d=2 00:25:21.968 01:26:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:21.968 01:26:30 -- scripts/common.sh@354 -- # echo 2 00:25:21.968 01:26:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:21.968 01:26:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:21.968 01:26:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:21.968 01:26:30 -- scripts/common.sh@367 -- # return 0 00:25:22.227 01:26:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:22.227 01:26:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:22.227 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:22.227 --rc genhtml_branch_coverage=1 00:25:22.227 --rc genhtml_function_coverage=1 00:25:22.227 --rc genhtml_legend=1 00:25:22.227 --rc geninfo_all_blocks=1 00:25:22.227 --rc geninfo_unexecuted_blocks=1 00:25:22.227 00:25:22.227 ' 00:25:22.227 01:26:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:22.227 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:22.227 --rc genhtml_branch_coverage=1 00:25:22.227 --rc genhtml_function_coverage=1 00:25:22.227 --rc genhtml_legend=1 00:25:22.227 --rc geninfo_all_blocks=1 00:25:22.227 --rc geninfo_unexecuted_blocks=1 00:25:22.227 00:25:22.227 ' 00:25:22.227 01:26:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:22.227 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:22.227 --rc genhtml_branch_coverage=1 00:25:22.227 --rc genhtml_function_coverage=1 00:25:22.227 --rc genhtml_legend=1 00:25:22.227 --rc geninfo_all_blocks=1 00:25:22.227 --rc geninfo_unexecuted_blocks=1 00:25:22.227 00:25:22.227 ' 00:25:22.227 01:26:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:22.227 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:22.227 --rc genhtml_branch_coverage=1 00:25:22.227 --rc genhtml_function_coverage=1 00:25:22.227 --rc genhtml_legend=1 00:25:22.227 --rc geninfo_all_blocks=1 00:25:22.227 --rc geninfo_unexecuted_blocks=1 00:25:22.227 00:25:22.227 ' 00:25:22.227 01:26:30 -- host/multicontroller.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:22.227 01:26:30 -- nvmf/common.sh@7 -- # uname -s 00:25:22.227 01:26:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:22.227 01:26:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:22.227 01:26:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:22.227 01:26:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:22.227 01:26:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:22.227 01:26:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:22.227 01:26:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:22.227 01:26:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:22.227 01:26:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:22.227 01:26:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:22.227 01:26:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:22.227 01:26:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:22.227 01:26:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:22.227 01:26:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:22.227 01:26:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:22.227 01:26:30 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:22.227 01:26:30 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:22.227 01:26:30 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:22.227 01:26:30 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:22.228 01:26:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:22.228 01:26:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:22.228 01:26:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:22.228 01:26:30 -- paths/export.sh@5 -- # export PATH 00:25:22.228 01:26:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:22.228 01:26:30 -- nvmf/common.sh@46 -- # : 0 00:25:22.228 01:26:30 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:22.228 01:26:30 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:22.228 01:26:30 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:22.228 01:26:30 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:22.228 01:26:30 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:22.228 01:26:30 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:22.228 01:26:30 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:22.228 01:26:30 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:22.228 01:26:30 -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:22.228 01:26:30 -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:22.228 01:26:30 -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:25:22.228 01:26:30 -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:25:22.228 01:26:30 -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:25:22.228 01:26:30 -- host/multicontroller.sh@18 -- # '[' tcp == rdma ']' 00:25:22.228 01:26:30 -- host/multicontroller.sh@23 -- # nvmftestinit 00:25:22.228 01:26:30 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:22.228 01:26:30 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:22.228 01:26:30 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:22.228 01:26:30 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:22.228 01:26:30 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:22.228 01:26:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:22.228 01:26:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:22.228 01:26:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:22.228 01:26:30 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:22.228 01:26:30 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:22.228 01:26:30 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:22.228 01:26:30 -- common/autotest_common.sh@10 -- # set +x 00:25:24.132 01:26:32 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:24.132 01:26:32 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:24.132 01:26:32 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:24.132 01:26:32 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:24.132 01:26:32 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:24.132 01:26:32 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:24.132 01:26:32 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:24.132 01:26:32 -- nvmf/common.sh@294 -- # net_devs=() 00:25:24.132 01:26:32 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:24.132 01:26:32 -- nvmf/common.sh@295 -- # e810=() 00:25:24.133 01:26:32 -- nvmf/common.sh@295 -- # local -ga e810 00:25:24.133 01:26:32 -- nvmf/common.sh@296 -- # x722=() 00:25:24.133 01:26:32 -- nvmf/common.sh@296 -- # local -ga x722 00:25:24.133 01:26:32 -- nvmf/common.sh@297 -- # mlx=() 00:25:24.133 01:26:32 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:24.133 01:26:32 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:24.133 01:26:32 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:24.133 01:26:32 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:24.133 01:26:32 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:24.133 01:26:32 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:24.133 01:26:32 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:24.133 01:26:32 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:24.133 01:26:32 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:24.133 01:26:32 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:24.133 01:26:32 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:24.133 01:26:32 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:24.133 01:26:32 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:24.133 01:26:32 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:24.133 01:26:32 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:24.133 01:26:32 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:24.133 01:26:32 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:24.133 01:26:32 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:24.133 01:26:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:24.133 01:26:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:24.133 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:24.133 01:26:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:24.133 01:26:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:24.133 01:26:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:24.133 01:26:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:24.133 01:26:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:24.133 01:26:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:24.133 01:26:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:24.133 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:24.133 01:26:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:24.133 01:26:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:24.133 01:26:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:24.133 01:26:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:24.133 01:26:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:24.133 01:26:32 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:24.133 01:26:32 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:24.133 01:26:32 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:24.133 01:26:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:24.133 01:26:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:24.133 01:26:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:24.133 01:26:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:24.133 01:26:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:24.133 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:24.133 01:26:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:24.133 01:26:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:24.133 01:26:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:24.133 01:26:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:24.133 01:26:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:24.133 01:26:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:24.133 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:24.133 01:26:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:24.133 01:26:32 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:24.133 01:26:32 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:24.133 01:26:32 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:24.133 01:26:32 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:24.133 01:26:32 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:24.133 01:26:32 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:24.133 01:26:32 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:24.133 01:26:32 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:24.133 01:26:32 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:24.133 01:26:32 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:24.133 01:26:32 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:24.133 01:26:32 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:24.133 01:26:32 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:24.133 01:26:32 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:24.133 01:26:32 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:24.133 01:26:32 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:24.133 01:26:32 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:24.133 01:26:32 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:24.391 01:26:32 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:24.391 01:26:32 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:24.391 01:26:32 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:24.391 01:26:32 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:24.391 01:26:32 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:24.391 01:26:32 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:24.391 01:26:32 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:24.391 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:24.392 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.284 ms 00:25:24.392 00:25:24.392 --- 10.0.0.2 ping statistics --- 00:25:24.392 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:24.392 rtt min/avg/max/mdev = 0.284/0.284/0.284/0.000 ms 00:25:24.392 01:26:32 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:24.392 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:24.392 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.052 ms 00:25:24.392 00:25:24.392 --- 10.0.0.1 ping statistics --- 00:25:24.392 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:24.392 rtt min/avg/max/mdev = 0.052/0.052/0.052/0.000 ms 00:25:24.392 01:26:32 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:24.392 01:26:32 -- nvmf/common.sh@410 -- # return 0 00:25:24.392 01:26:32 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:24.392 01:26:32 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:24.392 01:26:32 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:24.392 01:26:32 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:24.392 01:26:32 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:24.392 01:26:32 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:24.392 01:26:32 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:24.392 01:26:32 -- host/multicontroller.sh@25 -- # nvmfappstart -m 0xE 00:25:24.392 01:26:32 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:24.392 01:26:32 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:24.392 01:26:32 -- common/autotest_common.sh@10 -- # set +x 00:25:24.392 01:26:32 -- nvmf/common.sh@469 -- # nvmfpid=1219303 00:25:24.392 01:26:32 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:25:24.392 01:26:32 -- nvmf/common.sh@470 -- # waitforlisten 1219303 00:25:24.392 01:26:32 -- common/autotest_common.sh@829 -- # '[' -z 1219303 ']' 00:25:24.392 01:26:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:24.392 01:26:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:24.392 01:26:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:24.392 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:24.392 01:26:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:24.392 01:26:32 -- common/autotest_common.sh@10 -- # set +x 00:25:24.392 [2024-11-20 01:26:32.546878] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:24.392 [2024-11-20 01:26:32.546958] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:24.392 EAL: No free 2048 kB hugepages reported on node 1 00:25:24.651 [2024-11-20 01:26:32.613970] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:25:24.651 [2024-11-20 01:26:32.701807] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:24.651 [2024-11-20 01:26:32.701973] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:24.651 [2024-11-20 01:26:32.701993] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:24.651 [2024-11-20 01:26:32.702008] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:24.651 [2024-11-20 01:26:32.702105] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:24.651 [2024-11-20 01:26:32.702172] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:24.651 [2024-11-20 01:26:32.702175] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:25.585 01:26:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:25.585 01:26:33 -- common/autotest_common.sh@862 -- # return 0 00:25:25.585 01:26:33 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:25.585 01:26:33 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:25.585 01:26:33 -- common/autotest_common.sh@10 -- # set +x 00:25:25.585 01:26:33 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:25.585 01:26:33 -- host/multicontroller.sh@27 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:25.585 01:26:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:25.585 01:26:33 -- common/autotest_common.sh@10 -- # set +x 00:25:25.585 [2024-11-20 01:26:33.522749] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:25.585 01:26:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:25.585 01:26:33 -- host/multicontroller.sh@29 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:25:25.585 01:26:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:25.585 01:26:33 -- common/autotest_common.sh@10 -- # set +x 00:25:25.585 Malloc0 00:25:25.585 01:26:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:25.585 01:26:33 -- host/multicontroller.sh@30 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:25.585 01:26:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:25.585 01:26:33 -- common/autotest_common.sh@10 -- # set +x 00:25:25.585 01:26:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:25.585 01:26:33 -- host/multicontroller.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:25.585 01:26:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:25.585 01:26:33 -- common/autotest_common.sh@10 -- # set +x 00:25:25.585 01:26:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:25.586 01:26:33 -- host/multicontroller.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:25.586 01:26:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:25.586 01:26:33 -- common/autotest_common.sh@10 -- # set +x 00:25:25.586 [2024-11-20 01:26:33.586543] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:25.586 01:26:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:25.586 01:26:33 -- host/multicontroller.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:25.586 01:26:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:25.586 01:26:33 -- common/autotest_common.sh@10 -- # set +x 00:25:25.586 [2024-11-20 01:26:33.594448] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:25.586 01:26:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:25.586 01:26:33 -- host/multicontroller.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:25:25.586 01:26:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:25.586 01:26:33 -- common/autotest_common.sh@10 -- # set +x 00:25:25.586 Malloc1 00:25:25.586 01:26:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:25.586 01:26:33 -- host/multicontroller.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:25:25.586 01:26:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:25.586 01:26:33 -- common/autotest_common.sh@10 -- # set +x 00:25:25.586 01:26:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:25.586 01:26:33 -- host/multicontroller.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc1 00:25:25.586 01:26:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:25.586 01:26:33 -- common/autotest_common.sh@10 -- # set +x 00:25:25.586 01:26:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:25.586 01:26:33 -- host/multicontroller.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:25:25.586 01:26:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:25.586 01:26:33 -- common/autotest_common.sh@10 -- # set +x 00:25:25.586 01:26:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:25.586 01:26:33 -- host/multicontroller.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4421 00:25:25.586 01:26:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:25.586 01:26:33 -- common/autotest_common.sh@10 -- # set +x 00:25:25.586 01:26:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:25.586 01:26:33 -- host/multicontroller.sh@44 -- # bdevperf_pid=1219461 00:25:25.586 01:26:33 -- host/multicontroller.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w write -t 1 -f 00:25:25.586 01:26:33 -- host/multicontroller.sh@46 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; pap "$testdir/try.txt"; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:25.586 01:26:33 -- host/multicontroller.sh@47 -- # waitforlisten 1219461 /var/tmp/bdevperf.sock 00:25:25.586 01:26:33 -- common/autotest_common.sh@829 -- # '[' -z 1219461 ']' 00:25:25.586 01:26:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:25.586 01:26:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:25.586 01:26:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:25.586 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:25.586 01:26:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:25.586 01:26:33 -- common/autotest_common.sh@10 -- # set +x 00:25:26.524 01:26:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:26.524 01:26:34 -- common/autotest_common.sh@862 -- # return 0 00:25:26.524 01:26:34 -- host/multicontroller.sh@50 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:25:26.524 01:26:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:26.524 01:26:34 -- common/autotest_common.sh@10 -- # set +x 00:25:26.524 NVMe0n1 00:25:26.524 01:26:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:26.524 01:26:34 -- host/multicontroller.sh@54 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:26.524 01:26:34 -- host/multicontroller.sh@54 -- # grep -c NVMe 00:25:26.524 01:26:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:26.524 01:26:34 -- common/autotest_common.sh@10 -- # set +x 00:25:26.524 01:26:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:26.524 1 00:25:26.524 01:26:34 -- host/multicontroller.sh@60 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:25:26.524 01:26:34 -- common/autotest_common.sh@650 -- # local es=0 00:25:26.783 01:26:34 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:25:26.783 01:26:34 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:26.783 01:26:34 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:26.783 01:26:34 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:26.783 01:26:34 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:26.783 01:26:34 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:25:26.783 01:26:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:26.783 01:26:34 -- common/autotest_common.sh@10 -- # set +x 00:25:26.783 request: 00:25:26.783 { 00:25:26.783 "name": "NVMe0", 00:25:26.783 "trtype": "tcp", 00:25:26.783 "traddr": "10.0.0.2", 00:25:26.783 "hostnqn": "nqn.2021-09-7.io.spdk:00001", 00:25:26.783 "hostaddr": "10.0.0.2", 00:25:26.783 "hostsvcid": "60000", 00:25:26.783 "adrfam": "ipv4", 00:25:26.783 "trsvcid": "4420", 00:25:26.783 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:26.783 "method": "bdev_nvme_attach_controller", 00:25:26.783 "req_id": 1 00:25:26.783 } 00:25:26.783 Got JSON-RPC error response 00:25:26.783 response: 00:25:26.783 { 00:25:26.783 "code": -114, 00:25:26.783 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:25:26.783 } 00:25:26.783 01:26:34 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:26.784 01:26:34 -- common/autotest_common.sh@653 -- # es=1 00:25:26.784 01:26:34 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:26.784 01:26:34 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:26.784 01:26:34 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:26.784 01:26:34 -- host/multicontroller.sh@65 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:25:26.784 01:26:34 -- common/autotest_common.sh@650 -- # local es=0 00:25:26.784 01:26:34 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:25:26.784 01:26:34 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:26.784 01:26:34 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:26.784 01:26:34 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:26.784 01:26:34 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:26.784 01:26:34 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:25:26.784 01:26:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:26.784 01:26:34 -- common/autotest_common.sh@10 -- # set +x 00:25:26.784 request: 00:25:26.784 { 00:25:26.784 "name": "NVMe0", 00:25:26.784 "trtype": "tcp", 00:25:26.784 "traddr": "10.0.0.2", 00:25:26.784 "hostaddr": "10.0.0.2", 00:25:26.784 "hostsvcid": "60000", 00:25:26.784 "adrfam": "ipv4", 00:25:26.784 "trsvcid": "4420", 00:25:26.784 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:26.784 "method": "bdev_nvme_attach_controller", 00:25:26.784 "req_id": 1 00:25:26.784 } 00:25:26.784 Got JSON-RPC error response 00:25:26.784 response: 00:25:26.784 { 00:25:26.784 "code": -114, 00:25:26.784 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:25:26.784 } 00:25:26.784 01:26:34 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:26.784 01:26:34 -- common/autotest_common.sh@653 -- # es=1 00:25:26.784 01:26:34 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:26.784 01:26:34 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:26.784 01:26:34 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:26.784 01:26:34 -- host/multicontroller.sh@69 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:25:26.784 01:26:34 -- common/autotest_common.sh@650 -- # local es=0 00:25:26.784 01:26:34 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:25:26.784 01:26:34 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:26.784 01:26:34 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:26.784 01:26:34 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:26.784 01:26:34 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:26.784 01:26:34 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:25:26.784 01:26:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:26.784 01:26:34 -- common/autotest_common.sh@10 -- # set +x 00:25:26.784 request: 00:25:26.784 { 00:25:26.784 "name": "NVMe0", 00:25:26.784 "trtype": "tcp", 00:25:26.784 "traddr": "10.0.0.2", 00:25:26.784 "hostaddr": "10.0.0.2", 00:25:26.784 "hostsvcid": "60000", 00:25:26.784 "adrfam": "ipv4", 00:25:26.784 "trsvcid": "4420", 00:25:26.784 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:26.784 "multipath": "disable", 00:25:26.784 "method": "bdev_nvme_attach_controller", 00:25:26.784 "req_id": 1 00:25:26.784 } 00:25:26.784 Got JSON-RPC error response 00:25:26.784 response: 00:25:26.784 { 00:25:26.784 "code": -114, 00:25:26.784 "message": "A controller named NVMe0 already exists and multipath is disabled\n" 00:25:26.784 } 00:25:26.784 01:26:34 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:26.784 01:26:34 -- common/autotest_common.sh@653 -- # es=1 00:25:26.784 01:26:34 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:26.784 01:26:34 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:26.784 01:26:34 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:26.784 01:26:34 -- host/multicontroller.sh@74 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:25:26.784 01:26:34 -- common/autotest_common.sh@650 -- # local es=0 00:25:26.784 01:26:34 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:25:26.784 01:26:34 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:26.784 01:26:34 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:26.784 01:26:34 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:26.784 01:26:34 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:26.784 01:26:34 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:25:26.784 01:26:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:26.784 01:26:34 -- common/autotest_common.sh@10 -- # set +x 00:25:26.784 request: 00:25:26.784 { 00:25:26.784 "name": "NVMe0", 00:25:26.784 "trtype": "tcp", 00:25:26.784 "traddr": "10.0.0.2", 00:25:26.784 "hostaddr": "10.0.0.2", 00:25:26.784 "hostsvcid": "60000", 00:25:26.784 "adrfam": "ipv4", 00:25:26.784 "trsvcid": "4420", 00:25:26.784 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:26.784 "multipath": "failover", 00:25:26.784 "method": "bdev_nvme_attach_controller", 00:25:26.784 "req_id": 1 00:25:26.784 } 00:25:26.784 Got JSON-RPC error response 00:25:26.784 response: 00:25:26.784 { 00:25:26.784 "code": -114, 00:25:26.784 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:25:26.784 } 00:25:26.784 01:26:34 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:26.784 01:26:34 -- common/autotest_common.sh@653 -- # es=1 00:25:26.784 01:26:34 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:26.784 01:26:34 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:26.784 01:26:34 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:26.784 01:26:34 -- host/multicontroller.sh@79 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:26.784 01:26:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:26.784 01:26:34 -- common/autotest_common.sh@10 -- # set +x 00:25:26.784 00:25:26.784 01:26:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:26.784 01:26:34 -- host/multicontroller.sh@83 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:26.784 01:26:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:26.784 01:26:34 -- common/autotest_common.sh@10 -- # set +x 00:25:26.784 01:26:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:26.784 01:26:34 -- host/multicontroller.sh@87 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe1 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:25:26.784 01:26:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:26.784 01:26:34 -- common/autotest_common.sh@10 -- # set +x 00:25:27.042 00:25:27.042 01:26:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:27.042 01:26:35 -- host/multicontroller.sh@90 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:27.042 01:26:35 -- host/multicontroller.sh@90 -- # grep -c NVMe 00:25:27.042 01:26:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:27.042 01:26:35 -- common/autotest_common.sh@10 -- # set +x 00:25:27.042 01:26:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:27.042 01:26:35 -- host/multicontroller.sh@90 -- # '[' 2 '!=' 2 ']' 00:25:27.042 01:26:35 -- host/multicontroller.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:25:28.418 0 00:25:28.418 01:26:36 -- host/multicontroller.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe1 00:25:28.418 01:26:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:28.418 01:26:36 -- common/autotest_common.sh@10 -- # set +x 00:25:28.418 01:26:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:28.418 01:26:36 -- host/multicontroller.sh@100 -- # killprocess 1219461 00:25:28.418 01:26:36 -- common/autotest_common.sh@936 -- # '[' -z 1219461 ']' 00:25:28.418 01:26:36 -- common/autotest_common.sh@940 -- # kill -0 1219461 00:25:28.418 01:26:36 -- common/autotest_common.sh@941 -- # uname 00:25:28.418 01:26:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:28.418 01:26:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1219461 00:25:28.418 01:26:36 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:28.418 01:26:36 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:28.418 01:26:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1219461' 00:25:28.418 killing process with pid 1219461 00:25:28.418 01:26:36 -- common/autotest_common.sh@955 -- # kill 1219461 00:25:28.418 01:26:36 -- common/autotest_common.sh@960 -- # wait 1219461 00:25:28.418 01:26:36 -- host/multicontroller.sh@102 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:28.418 01:26:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:28.418 01:26:36 -- common/autotest_common.sh@10 -- # set +x 00:25:28.418 01:26:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:28.418 01:26:36 -- host/multicontroller.sh@103 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:25:28.418 01:26:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:28.418 01:26:36 -- common/autotest_common.sh@10 -- # set +x 00:25:28.418 01:26:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:28.418 01:26:36 -- host/multicontroller.sh@105 -- # trap - SIGINT SIGTERM EXIT 00:25:28.418 01:26:36 -- host/multicontroller.sh@107 -- # pap /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:28.418 01:26:36 -- common/autotest_common.sh@1607 -- # read -r file 00:25:28.418 01:26:36 -- common/autotest_common.sh@1606 -- # find /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt -type f 00:25:28.418 01:26:36 -- common/autotest_common.sh@1606 -- # sort -u 00:25:28.418 01:26:36 -- common/autotest_common.sh@1608 -- # cat 00:25:28.418 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:25:28.418 [2024-11-20 01:26:33.688917] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:28.418 [2024-11-20 01:26:33.689004] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1219461 ] 00:25:28.418 EAL: No free 2048 kB hugepages reported on node 1 00:25:28.418 [2024-11-20 01:26:33.748178] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:28.418 [2024-11-20 01:26:33.832164] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:28.418 [2024-11-20 01:26:35.134787] bdev.c:4553:bdev_name_add: *ERROR*: Bdev name 9ae234f6-a84e-4d30-b834-975281ec53cc already exists 00:25:28.418 [2024-11-20 01:26:35.134825] bdev.c:7603:bdev_register: *ERROR*: Unable to add uuid:9ae234f6-a84e-4d30-b834-975281ec53cc alias for bdev NVMe1n1 00:25:28.418 [2024-11-20 01:26:35.134858] bdev_nvme.c:4236:nvme_bdev_create: *ERROR*: spdk_bdev_register() failed 00:25:28.418 Running I/O for 1 seconds... 00:25:28.418 00:25:28.418 Latency(us) 00:25:28.418 [2024-11-20T00:26:36.637Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:28.418 [2024-11-20T00:26:36.637Z] Job: NVMe0n1 (Core Mask 0x1, workload: write, depth: 128, IO size: 4096) 00:25:28.418 NVMe0n1 : 1.00 19911.84 77.78 0.00 0.00 6411.52 3665.16 11553.75 00:25:28.418 [2024-11-20T00:26:36.637Z] =================================================================================================================== 00:25:28.418 [2024-11-20T00:26:36.637Z] Total : 19911.84 77.78 0.00 0.00 6411.52 3665.16 11553.75 00:25:28.418 Received shutdown signal, test time was about 1.000000 seconds 00:25:28.418 00:25:28.418 Latency(us) 00:25:28.418 [2024-11-20T00:26:36.637Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:28.418 [2024-11-20T00:26:36.637Z] =================================================================================================================== 00:25:28.418 [2024-11-20T00:26:36.637Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:25:28.418 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:25:28.418 01:26:36 -- common/autotest_common.sh@1613 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:28.418 01:26:36 -- common/autotest_common.sh@1607 -- # read -r file 00:25:28.418 01:26:36 -- host/multicontroller.sh@108 -- # nvmftestfini 00:25:28.418 01:26:36 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:28.418 01:26:36 -- nvmf/common.sh@116 -- # sync 00:25:28.418 01:26:36 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:28.418 01:26:36 -- nvmf/common.sh@119 -- # set +e 00:25:28.418 01:26:36 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:28.418 01:26:36 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:28.418 rmmod nvme_tcp 00:25:28.418 rmmod nvme_fabrics 00:25:28.418 rmmod nvme_keyring 00:25:28.418 01:26:36 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:28.418 01:26:36 -- nvmf/common.sh@123 -- # set -e 00:25:28.418 01:26:36 -- nvmf/common.sh@124 -- # return 0 00:25:28.418 01:26:36 -- nvmf/common.sh@477 -- # '[' -n 1219303 ']' 00:25:28.418 01:26:36 -- nvmf/common.sh@478 -- # killprocess 1219303 00:25:28.418 01:26:36 -- common/autotest_common.sh@936 -- # '[' -z 1219303 ']' 00:25:28.418 01:26:36 -- common/autotest_common.sh@940 -- # kill -0 1219303 00:25:28.418 01:26:36 -- common/autotest_common.sh@941 -- # uname 00:25:28.418 01:26:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:28.418 01:26:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1219303 00:25:28.676 01:26:36 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:28.676 01:26:36 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:28.676 01:26:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1219303' 00:25:28.676 killing process with pid 1219303 00:25:28.676 01:26:36 -- common/autotest_common.sh@955 -- # kill 1219303 00:25:28.676 01:26:36 -- common/autotest_common.sh@960 -- # wait 1219303 00:25:28.935 01:26:36 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:28.935 01:26:36 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:28.935 01:26:36 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:28.935 01:26:36 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:28.935 01:26:36 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:28.935 01:26:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:28.935 01:26:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:28.935 01:26:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:30.841 01:26:38 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:30.841 00:25:30.841 real 0m8.909s 00:25:30.841 user 0m16.723s 00:25:30.841 sys 0m2.312s 00:25:30.841 01:26:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:30.841 01:26:38 -- common/autotest_common.sh@10 -- # set +x 00:25:30.841 ************************************ 00:25:30.841 END TEST nvmf_multicontroller 00:25:30.841 ************************************ 00:25:30.841 01:26:38 -- nvmf/nvmf.sh@92 -- # run_test nvmf_aer /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:25:30.841 01:26:38 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:30.841 01:26:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:30.841 01:26:38 -- common/autotest_common.sh@10 -- # set +x 00:25:30.842 ************************************ 00:25:30.842 START TEST nvmf_aer 00:25:30.842 ************************************ 00:25:30.842 01:26:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:25:30.842 * Looking for test storage... 00:25:30.842 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:30.842 01:26:39 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:30.842 01:26:39 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:30.842 01:26:39 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:31.100 01:26:39 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:31.100 01:26:39 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:31.100 01:26:39 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:31.100 01:26:39 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:31.100 01:26:39 -- scripts/common.sh@335 -- # IFS=.-: 00:25:31.100 01:26:39 -- scripts/common.sh@335 -- # read -ra ver1 00:25:31.100 01:26:39 -- scripts/common.sh@336 -- # IFS=.-: 00:25:31.100 01:26:39 -- scripts/common.sh@336 -- # read -ra ver2 00:25:31.100 01:26:39 -- scripts/common.sh@337 -- # local 'op=<' 00:25:31.100 01:26:39 -- scripts/common.sh@339 -- # ver1_l=2 00:25:31.100 01:26:39 -- scripts/common.sh@340 -- # ver2_l=1 00:25:31.100 01:26:39 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:31.100 01:26:39 -- scripts/common.sh@343 -- # case "$op" in 00:25:31.100 01:26:39 -- scripts/common.sh@344 -- # : 1 00:25:31.100 01:26:39 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:31.101 01:26:39 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:31.101 01:26:39 -- scripts/common.sh@364 -- # decimal 1 00:25:31.101 01:26:39 -- scripts/common.sh@352 -- # local d=1 00:25:31.101 01:26:39 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:31.101 01:26:39 -- scripts/common.sh@354 -- # echo 1 00:25:31.101 01:26:39 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:31.101 01:26:39 -- scripts/common.sh@365 -- # decimal 2 00:25:31.101 01:26:39 -- scripts/common.sh@352 -- # local d=2 00:25:31.101 01:26:39 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:31.101 01:26:39 -- scripts/common.sh@354 -- # echo 2 00:25:31.101 01:26:39 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:31.101 01:26:39 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:31.101 01:26:39 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:31.101 01:26:39 -- scripts/common.sh@367 -- # return 0 00:25:31.101 01:26:39 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:31.101 01:26:39 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:31.101 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:31.101 --rc genhtml_branch_coverage=1 00:25:31.101 --rc genhtml_function_coverage=1 00:25:31.101 --rc genhtml_legend=1 00:25:31.101 --rc geninfo_all_blocks=1 00:25:31.101 --rc geninfo_unexecuted_blocks=1 00:25:31.101 00:25:31.101 ' 00:25:31.101 01:26:39 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:31.101 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:31.101 --rc genhtml_branch_coverage=1 00:25:31.101 --rc genhtml_function_coverage=1 00:25:31.101 --rc genhtml_legend=1 00:25:31.101 --rc geninfo_all_blocks=1 00:25:31.101 --rc geninfo_unexecuted_blocks=1 00:25:31.101 00:25:31.101 ' 00:25:31.101 01:26:39 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:31.101 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:31.101 --rc genhtml_branch_coverage=1 00:25:31.101 --rc genhtml_function_coverage=1 00:25:31.101 --rc genhtml_legend=1 00:25:31.101 --rc geninfo_all_blocks=1 00:25:31.101 --rc geninfo_unexecuted_blocks=1 00:25:31.101 00:25:31.101 ' 00:25:31.101 01:26:39 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:31.101 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:31.101 --rc genhtml_branch_coverage=1 00:25:31.101 --rc genhtml_function_coverage=1 00:25:31.101 --rc genhtml_legend=1 00:25:31.101 --rc geninfo_all_blocks=1 00:25:31.101 --rc geninfo_unexecuted_blocks=1 00:25:31.101 00:25:31.101 ' 00:25:31.101 01:26:39 -- host/aer.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:31.101 01:26:39 -- nvmf/common.sh@7 -- # uname -s 00:25:31.101 01:26:39 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:31.101 01:26:39 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:31.101 01:26:39 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:31.101 01:26:39 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:31.101 01:26:39 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:31.101 01:26:39 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:31.101 01:26:39 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:31.101 01:26:39 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:31.101 01:26:39 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:31.101 01:26:39 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:31.101 01:26:39 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:31.101 01:26:39 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:31.101 01:26:39 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:31.101 01:26:39 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:31.101 01:26:39 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:31.101 01:26:39 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:31.101 01:26:39 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:31.101 01:26:39 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:31.101 01:26:39 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:31.101 01:26:39 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:31.101 01:26:39 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:31.101 01:26:39 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:31.101 01:26:39 -- paths/export.sh@5 -- # export PATH 00:25:31.101 01:26:39 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:31.101 01:26:39 -- nvmf/common.sh@46 -- # : 0 00:25:31.101 01:26:39 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:31.101 01:26:39 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:31.101 01:26:39 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:31.101 01:26:39 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:31.101 01:26:39 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:31.101 01:26:39 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:31.101 01:26:39 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:31.101 01:26:39 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:31.101 01:26:39 -- host/aer.sh@11 -- # nvmftestinit 00:25:31.101 01:26:39 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:31.101 01:26:39 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:31.101 01:26:39 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:31.101 01:26:39 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:31.101 01:26:39 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:31.101 01:26:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:31.101 01:26:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:31.101 01:26:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:31.101 01:26:39 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:31.101 01:26:39 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:31.101 01:26:39 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:31.101 01:26:39 -- common/autotest_common.sh@10 -- # set +x 00:25:33.003 01:26:41 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:33.003 01:26:41 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:33.003 01:26:41 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:33.003 01:26:41 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:33.003 01:26:41 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:33.003 01:26:41 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:33.003 01:26:41 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:33.003 01:26:41 -- nvmf/common.sh@294 -- # net_devs=() 00:25:33.003 01:26:41 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:33.003 01:26:41 -- nvmf/common.sh@295 -- # e810=() 00:25:33.003 01:26:41 -- nvmf/common.sh@295 -- # local -ga e810 00:25:33.003 01:26:41 -- nvmf/common.sh@296 -- # x722=() 00:25:33.003 01:26:41 -- nvmf/common.sh@296 -- # local -ga x722 00:25:33.003 01:26:41 -- nvmf/common.sh@297 -- # mlx=() 00:25:33.003 01:26:41 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:33.003 01:26:41 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:33.003 01:26:41 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:33.003 01:26:41 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:33.003 01:26:41 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:33.004 01:26:41 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:33.004 01:26:41 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:33.004 01:26:41 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:33.004 01:26:41 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:33.004 01:26:41 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:33.004 01:26:41 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:33.004 01:26:41 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:33.004 01:26:41 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:33.004 01:26:41 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:33.004 01:26:41 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:33.004 01:26:41 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:33.004 01:26:41 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:33.004 01:26:41 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:33.004 01:26:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:33.004 01:26:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:33.004 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:33.004 01:26:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:33.004 01:26:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:33.004 01:26:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:33.004 01:26:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:33.004 01:26:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:33.004 01:26:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:33.004 01:26:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:33.004 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:33.004 01:26:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:33.004 01:26:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:33.004 01:26:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:33.004 01:26:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:33.004 01:26:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:33.004 01:26:41 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:33.004 01:26:41 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:33.004 01:26:41 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:33.004 01:26:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:33.004 01:26:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:33.004 01:26:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:33.004 01:26:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:33.004 01:26:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:33.004 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:33.004 01:26:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:33.004 01:26:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:33.004 01:26:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:33.004 01:26:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:33.004 01:26:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:33.004 01:26:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:33.004 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:33.004 01:26:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:33.004 01:26:41 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:33.004 01:26:41 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:33.004 01:26:41 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:33.004 01:26:41 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:33.004 01:26:41 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:33.004 01:26:41 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:33.004 01:26:41 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:33.004 01:26:41 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:33.004 01:26:41 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:33.004 01:26:41 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:33.004 01:26:41 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:33.004 01:26:41 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:33.004 01:26:41 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:33.004 01:26:41 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:33.004 01:26:41 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:33.004 01:26:41 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:33.004 01:26:41 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:33.004 01:26:41 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:33.263 01:26:41 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:33.263 01:26:41 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:33.263 01:26:41 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:33.263 01:26:41 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:33.263 01:26:41 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:33.263 01:26:41 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:33.263 01:26:41 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:33.263 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:33.263 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.278 ms 00:25:33.263 00:25:33.263 --- 10.0.0.2 ping statistics --- 00:25:33.263 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:33.263 rtt min/avg/max/mdev = 0.278/0.278/0.278/0.000 ms 00:25:33.263 01:26:41 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:33.263 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:33.263 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.106 ms 00:25:33.263 00:25:33.263 --- 10.0.0.1 ping statistics --- 00:25:33.263 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:33.263 rtt min/avg/max/mdev = 0.106/0.106/0.106/0.000 ms 00:25:33.263 01:26:41 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:33.263 01:26:41 -- nvmf/common.sh@410 -- # return 0 00:25:33.263 01:26:41 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:33.263 01:26:41 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:33.263 01:26:41 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:33.263 01:26:41 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:33.263 01:26:41 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:33.263 01:26:41 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:33.263 01:26:41 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:33.263 01:26:41 -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:25:33.263 01:26:41 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:33.263 01:26:41 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:33.264 01:26:41 -- common/autotest_common.sh@10 -- # set +x 00:25:33.264 01:26:41 -- nvmf/common.sh@469 -- # nvmfpid=1221824 00:25:33.264 01:26:41 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:25:33.264 01:26:41 -- nvmf/common.sh@470 -- # waitforlisten 1221824 00:25:33.264 01:26:41 -- common/autotest_common.sh@829 -- # '[' -z 1221824 ']' 00:25:33.264 01:26:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:33.264 01:26:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:33.264 01:26:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:33.264 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:33.264 01:26:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:33.264 01:26:41 -- common/autotest_common.sh@10 -- # set +x 00:25:33.264 [2024-11-20 01:26:41.448025] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:33.264 [2024-11-20 01:26:41.448118] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:33.523 EAL: No free 2048 kB hugepages reported on node 1 00:25:33.523 [2024-11-20 01:26:41.516918] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:33.523 [2024-11-20 01:26:41.610702] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:33.523 [2024-11-20 01:26:41.610870] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:33.523 [2024-11-20 01:26:41.610891] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:33.523 [2024-11-20 01:26:41.610905] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:33.523 [2024-11-20 01:26:41.611003] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:33.523 [2024-11-20 01:26:41.611099] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:33.523 [2024-11-20 01:26:41.611175] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:33.523 [2024-11-20 01:26:41.611178] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:34.460 01:26:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:34.460 01:26:42 -- common/autotest_common.sh@862 -- # return 0 00:25:34.460 01:26:42 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:34.460 01:26:42 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:34.460 01:26:42 -- common/autotest_common.sh@10 -- # set +x 00:25:34.460 01:26:42 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:34.460 01:26:42 -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:34.460 01:26:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:34.460 01:26:42 -- common/autotest_common.sh@10 -- # set +x 00:25:34.460 [2024-11-20 01:26:42.446725] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:34.460 01:26:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:34.460 01:26:42 -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:25:34.460 01:26:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:34.460 01:26:42 -- common/autotest_common.sh@10 -- # set +x 00:25:34.460 Malloc0 00:25:34.460 01:26:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:34.460 01:26:42 -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:25:34.460 01:26:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:34.460 01:26:42 -- common/autotest_common.sh@10 -- # set +x 00:25:34.460 01:26:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:34.460 01:26:42 -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:34.460 01:26:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:34.460 01:26:42 -- common/autotest_common.sh@10 -- # set +x 00:25:34.460 01:26:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:34.460 01:26:42 -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:34.460 01:26:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:34.460 01:26:42 -- common/autotest_common.sh@10 -- # set +x 00:25:34.460 [2024-11-20 01:26:42.500025] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:34.460 01:26:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:34.460 01:26:42 -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:25:34.460 01:26:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:34.461 01:26:42 -- common/autotest_common.sh@10 -- # set +x 00:25:34.461 [2024-11-20 01:26:42.507743] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:25:34.461 [ 00:25:34.461 { 00:25:34.461 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:25:34.461 "subtype": "Discovery", 00:25:34.461 "listen_addresses": [], 00:25:34.461 "allow_any_host": true, 00:25:34.461 "hosts": [] 00:25:34.461 }, 00:25:34.461 { 00:25:34.461 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:25:34.461 "subtype": "NVMe", 00:25:34.461 "listen_addresses": [ 00:25:34.461 { 00:25:34.461 "transport": "TCP", 00:25:34.461 "trtype": "TCP", 00:25:34.461 "adrfam": "IPv4", 00:25:34.461 "traddr": "10.0.0.2", 00:25:34.461 "trsvcid": "4420" 00:25:34.461 } 00:25:34.461 ], 00:25:34.461 "allow_any_host": true, 00:25:34.461 "hosts": [], 00:25:34.461 "serial_number": "SPDK00000000000001", 00:25:34.461 "model_number": "SPDK bdev Controller", 00:25:34.461 "max_namespaces": 2, 00:25:34.461 "min_cntlid": 1, 00:25:34.461 "max_cntlid": 65519, 00:25:34.461 "namespaces": [ 00:25:34.461 { 00:25:34.461 "nsid": 1, 00:25:34.461 "bdev_name": "Malloc0", 00:25:34.461 "name": "Malloc0", 00:25:34.461 "nguid": "B0185BAB352A4141AA6343561B479488", 00:25:34.461 "uuid": "b0185bab-352a-4141-aa63-43561b479488" 00:25:34.461 } 00:25:34.461 ] 00:25:34.461 } 00:25:34.461 ] 00:25:34.461 01:26:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:34.461 01:26:42 -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:25:34.461 01:26:42 -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:25:34.461 01:26:42 -- host/aer.sh@33 -- # aerpid=1221987 00:25:34.461 01:26:42 -- host/aer.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:25:34.461 01:26:42 -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:25:34.461 01:26:42 -- common/autotest_common.sh@1254 -- # local i=0 00:25:34.461 01:26:42 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:34.461 01:26:42 -- common/autotest_common.sh@1256 -- # '[' 0 -lt 200 ']' 00:25:34.461 01:26:42 -- common/autotest_common.sh@1257 -- # i=1 00:25:34.461 01:26:42 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:25:34.461 EAL: No free 2048 kB hugepages reported on node 1 00:25:34.461 01:26:42 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:34.461 01:26:42 -- common/autotest_common.sh@1256 -- # '[' 1 -lt 200 ']' 00:25:34.461 01:26:42 -- common/autotest_common.sh@1257 -- # i=2 00:25:34.461 01:26:42 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:25:34.720 01:26:42 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:34.720 01:26:42 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:34.720 01:26:42 -- common/autotest_common.sh@1265 -- # return 0 00:25:34.720 01:26:42 -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:25:34.720 01:26:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:34.720 01:26:42 -- common/autotest_common.sh@10 -- # set +x 00:25:34.720 Malloc1 00:25:34.720 01:26:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:34.720 01:26:42 -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:25:34.720 01:26:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:34.720 01:26:42 -- common/autotest_common.sh@10 -- # set +x 00:25:34.720 01:26:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:34.720 01:26:42 -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:25:34.720 01:26:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:34.720 01:26:42 -- common/autotest_common.sh@10 -- # set +x 00:25:34.720 Asynchronous Event Request test 00:25:34.720 Attaching to 10.0.0.2 00:25:34.720 Attached to 10.0.0.2 00:25:34.720 Registering asynchronous event callbacks... 00:25:34.720 Starting namespace attribute notice tests for all controllers... 00:25:34.720 10.0.0.2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:25:34.720 aer_cb - Changed Namespace 00:25:34.720 Cleaning up... 00:25:34.720 [ 00:25:34.720 { 00:25:34.720 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:25:34.720 "subtype": "Discovery", 00:25:34.720 "listen_addresses": [], 00:25:34.720 "allow_any_host": true, 00:25:34.720 "hosts": [] 00:25:34.720 }, 00:25:34.720 { 00:25:34.720 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:25:34.720 "subtype": "NVMe", 00:25:34.720 "listen_addresses": [ 00:25:34.720 { 00:25:34.720 "transport": "TCP", 00:25:34.720 "trtype": "TCP", 00:25:34.720 "adrfam": "IPv4", 00:25:34.720 "traddr": "10.0.0.2", 00:25:34.720 "trsvcid": "4420" 00:25:34.720 } 00:25:34.720 ], 00:25:34.720 "allow_any_host": true, 00:25:34.720 "hosts": [], 00:25:34.720 "serial_number": "SPDK00000000000001", 00:25:34.720 "model_number": "SPDK bdev Controller", 00:25:34.720 "max_namespaces": 2, 00:25:34.720 "min_cntlid": 1, 00:25:34.720 "max_cntlid": 65519, 00:25:34.720 "namespaces": [ 00:25:34.720 { 00:25:34.720 "nsid": 1, 00:25:34.720 "bdev_name": "Malloc0", 00:25:34.720 "name": "Malloc0", 00:25:34.721 "nguid": "B0185BAB352A4141AA6343561B479488", 00:25:34.721 "uuid": "b0185bab-352a-4141-aa63-43561b479488" 00:25:34.721 }, 00:25:34.721 { 00:25:34.721 "nsid": 2, 00:25:34.721 "bdev_name": "Malloc1", 00:25:34.721 "name": "Malloc1", 00:25:34.721 "nguid": "275CA023D8A2479C81674A790F55D82D", 00:25:34.721 "uuid": "275ca023-d8a2-479c-8167-4a790f55d82d" 00:25:34.721 } 00:25:34.721 ] 00:25:34.721 } 00:25:34.721 ] 00:25:34.721 01:26:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:34.721 01:26:42 -- host/aer.sh@43 -- # wait 1221987 00:25:34.721 01:26:42 -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:25:34.721 01:26:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:34.721 01:26:42 -- common/autotest_common.sh@10 -- # set +x 00:25:34.721 01:26:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:34.721 01:26:42 -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:25:34.721 01:26:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:34.721 01:26:42 -- common/autotest_common.sh@10 -- # set +x 00:25:34.721 01:26:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:34.721 01:26:42 -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:34.721 01:26:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:34.721 01:26:42 -- common/autotest_common.sh@10 -- # set +x 00:25:34.721 01:26:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:34.721 01:26:42 -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:25:34.721 01:26:42 -- host/aer.sh@51 -- # nvmftestfini 00:25:34.721 01:26:42 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:34.721 01:26:42 -- nvmf/common.sh@116 -- # sync 00:25:34.721 01:26:42 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:34.721 01:26:42 -- nvmf/common.sh@119 -- # set +e 00:25:34.721 01:26:42 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:34.721 01:26:42 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:34.721 rmmod nvme_tcp 00:25:34.721 rmmod nvme_fabrics 00:25:34.721 rmmod nvme_keyring 00:25:34.721 01:26:42 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:34.721 01:26:42 -- nvmf/common.sh@123 -- # set -e 00:25:34.721 01:26:42 -- nvmf/common.sh@124 -- # return 0 00:25:34.721 01:26:42 -- nvmf/common.sh@477 -- # '[' -n 1221824 ']' 00:25:34.721 01:26:42 -- nvmf/common.sh@478 -- # killprocess 1221824 00:25:34.721 01:26:42 -- common/autotest_common.sh@936 -- # '[' -z 1221824 ']' 00:25:34.721 01:26:42 -- common/autotest_common.sh@940 -- # kill -0 1221824 00:25:34.721 01:26:42 -- common/autotest_common.sh@941 -- # uname 00:25:34.980 01:26:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:34.980 01:26:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1221824 00:25:34.980 01:26:42 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:34.980 01:26:42 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:34.980 01:26:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1221824' 00:25:34.980 killing process with pid 1221824 00:25:34.980 01:26:42 -- common/autotest_common.sh@955 -- # kill 1221824 00:25:34.980 [2024-11-20 01:26:42.980131] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:25:34.980 01:26:42 -- common/autotest_common.sh@960 -- # wait 1221824 00:25:35.239 01:26:43 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:35.239 01:26:43 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:35.239 01:26:43 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:35.239 01:26:43 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:35.239 01:26:43 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:35.239 01:26:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:35.239 01:26:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:35.239 01:26:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:37.148 01:26:45 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:37.148 00:25:37.148 real 0m6.265s 00:25:37.148 user 0m7.276s 00:25:37.148 sys 0m2.021s 00:25:37.148 01:26:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:37.148 01:26:45 -- common/autotest_common.sh@10 -- # set +x 00:25:37.148 ************************************ 00:25:37.148 END TEST nvmf_aer 00:25:37.148 ************************************ 00:25:37.148 01:26:45 -- nvmf/nvmf.sh@93 -- # run_test nvmf_async_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:25:37.148 01:26:45 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:37.148 01:26:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:37.148 01:26:45 -- common/autotest_common.sh@10 -- # set +x 00:25:37.148 ************************************ 00:25:37.148 START TEST nvmf_async_init 00:25:37.148 ************************************ 00:25:37.148 01:26:45 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:25:37.148 * Looking for test storage... 00:25:37.148 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:37.148 01:26:45 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:37.148 01:26:45 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:37.148 01:26:45 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:37.409 01:26:45 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:37.409 01:26:45 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:37.409 01:26:45 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:37.409 01:26:45 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:37.409 01:26:45 -- scripts/common.sh@335 -- # IFS=.-: 00:25:37.409 01:26:45 -- scripts/common.sh@335 -- # read -ra ver1 00:25:37.409 01:26:45 -- scripts/common.sh@336 -- # IFS=.-: 00:25:37.409 01:26:45 -- scripts/common.sh@336 -- # read -ra ver2 00:25:37.409 01:26:45 -- scripts/common.sh@337 -- # local 'op=<' 00:25:37.409 01:26:45 -- scripts/common.sh@339 -- # ver1_l=2 00:25:37.409 01:26:45 -- scripts/common.sh@340 -- # ver2_l=1 00:25:37.409 01:26:45 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:37.409 01:26:45 -- scripts/common.sh@343 -- # case "$op" in 00:25:37.409 01:26:45 -- scripts/common.sh@344 -- # : 1 00:25:37.409 01:26:45 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:37.409 01:26:45 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:37.409 01:26:45 -- scripts/common.sh@364 -- # decimal 1 00:25:37.409 01:26:45 -- scripts/common.sh@352 -- # local d=1 00:25:37.409 01:26:45 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:37.409 01:26:45 -- scripts/common.sh@354 -- # echo 1 00:25:37.409 01:26:45 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:37.409 01:26:45 -- scripts/common.sh@365 -- # decimal 2 00:25:37.409 01:26:45 -- scripts/common.sh@352 -- # local d=2 00:25:37.409 01:26:45 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:37.409 01:26:45 -- scripts/common.sh@354 -- # echo 2 00:25:37.409 01:26:45 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:37.409 01:26:45 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:37.409 01:26:45 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:37.409 01:26:45 -- scripts/common.sh@367 -- # return 0 00:25:37.409 01:26:45 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:37.409 01:26:45 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:37.409 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:37.409 --rc genhtml_branch_coverage=1 00:25:37.409 --rc genhtml_function_coverage=1 00:25:37.409 --rc genhtml_legend=1 00:25:37.409 --rc geninfo_all_blocks=1 00:25:37.409 --rc geninfo_unexecuted_blocks=1 00:25:37.409 00:25:37.409 ' 00:25:37.409 01:26:45 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:37.409 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:37.409 --rc genhtml_branch_coverage=1 00:25:37.409 --rc genhtml_function_coverage=1 00:25:37.409 --rc genhtml_legend=1 00:25:37.409 --rc geninfo_all_blocks=1 00:25:37.409 --rc geninfo_unexecuted_blocks=1 00:25:37.409 00:25:37.409 ' 00:25:37.409 01:26:45 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:37.409 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:37.409 --rc genhtml_branch_coverage=1 00:25:37.409 --rc genhtml_function_coverage=1 00:25:37.409 --rc genhtml_legend=1 00:25:37.409 --rc geninfo_all_blocks=1 00:25:37.409 --rc geninfo_unexecuted_blocks=1 00:25:37.409 00:25:37.409 ' 00:25:37.409 01:26:45 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:37.409 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:37.409 --rc genhtml_branch_coverage=1 00:25:37.409 --rc genhtml_function_coverage=1 00:25:37.409 --rc genhtml_legend=1 00:25:37.409 --rc geninfo_all_blocks=1 00:25:37.409 --rc geninfo_unexecuted_blocks=1 00:25:37.409 00:25:37.409 ' 00:25:37.409 01:26:45 -- host/async_init.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:37.409 01:26:45 -- nvmf/common.sh@7 -- # uname -s 00:25:37.409 01:26:45 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:37.409 01:26:45 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:37.409 01:26:45 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:37.409 01:26:45 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:37.409 01:26:45 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:37.409 01:26:45 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:37.409 01:26:45 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:37.409 01:26:45 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:37.409 01:26:45 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:37.409 01:26:45 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:37.409 01:26:45 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:37.409 01:26:45 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:37.409 01:26:45 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:37.409 01:26:45 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:37.409 01:26:45 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:37.409 01:26:45 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:37.409 01:26:45 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:37.409 01:26:45 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:37.409 01:26:45 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:37.409 01:26:45 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:37.409 01:26:45 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:37.409 01:26:45 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:37.409 01:26:45 -- paths/export.sh@5 -- # export PATH 00:25:37.409 01:26:45 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:37.409 01:26:45 -- nvmf/common.sh@46 -- # : 0 00:25:37.409 01:26:45 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:37.409 01:26:45 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:37.409 01:26:45 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:37.409 01:26:45 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:37.409 01:26:45 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:37.409 01:26:45 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:37.409 01:26:45 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:37.409 01:26:45 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:37.409 01:26:45 -- host/async_init.sh@13 -- # null_bdev_size=1024 00:25:37.409 01:26:45 -- host/async_init.sh@14 -- # null_block_size=512 00:25:37.409 01:26:45 -- host/async_init.sh@15 -- # null_bdev=null0 00:25:37.409 01:26:45 -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:25:37.409 01:26:45 -- host/async_init.sh@20 -- # uuidgen 00:25:37.409 01:26:45 -- host/async_init.sh@20 -- # tr -d - 00:25:37.409 01:26:45 -- host/async_init.sh@20 -- # nguid=e8ab1dafefd1444aa9bc89badd5df923 00:25:37.409 01:26:45 -- host/async_init.sh@22 -- # nvmftestinit 00:25:37.409 01:26:45 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:37.409 01:26:45 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:37.409 01:26:45 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:37.409 01:26:45 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:37.409 01:26:45 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:37.409 01:26:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:37.409 01:26:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:37.409 01:26:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:37.409 01:26:45 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:37.409 01:26:45 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:37.409 01:26:45 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:37.409 01:26:45 -- common/autotest_common.sh@10 -- # set +x 00:25:39.313 01:26:47 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:39.313 01:26:47 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:39.313 01:26:47 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:39.313 01:26:47 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:39.313 01:26:47 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:39.313 01:26:47 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:39.313 01:26:47 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:39.313 01:26:47 -- nvmf/common.sh@294 -- # net_devs=() 00:25:39.313 01:26:47 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:39.313 01:26:47 -- nvmf/common.sh@295 -- # e810=() 00:25:39.313 01:26:47 -- nvmf/common.sh@295 -- # local -ga e810 00:25:39.313 01:26:47 -- nvmf/common.sh@296 -- # x722=() 00:25:39.313 01:26:47 -- nvmf/common.sh@296 -- # local -ga x722 00:25:39.313 01:26:47 -- nvmf/common.sh@297 -- # mlx=() 00:25:39.313 01:26:47 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:39.313 01:26:47 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:39.313 01:26:47 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:39.313 01:26:47 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:39.313 01:26:47 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:39.313 01:26:47 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:39.313 01:26:47 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:39.313 01:26:47 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:39.313 01:26:47 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:39.313 01:26:47 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:39.313 01:26:47 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:39.313 01:26:47 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:39.313 01:26:47 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:39.313 01:26:47 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:39.313 01:26:47 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:39.313 01:26:47 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:39.313 01:26:47 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:39.314 01:26:47 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:39.314 01:26:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:39.314 01:26:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:39.314 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:39.314 01:26:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:39.314 01:26:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:39.314 01:26:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:39.314 01:26:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:39.314 01:26:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:39.314 01:26:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:39.314 01:26:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:39.314 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:39.314 01:26:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:39.314 01:26:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:39.314 01:26:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:39.314 01:26:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:39.314 01:26:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:39.314 01:26:47 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:39.314 01:26:47 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:39.314 01:26:47 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:39.314 01:26:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:39.314 01:26:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:39.314 01:26:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:39.314 01:26:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:39.314 01:26:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:39.314 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:39.314 01:26:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:39.314 01:26:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:39.314 01:26:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:39.314 01:26:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:39.314 01:26:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:39.314 01:26:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:39.314 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:39.314 01:26:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:39.314 01:26:47 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:39.314 01:26:47 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:39.314 01:26:47 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:39.314 01:26:47 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:39.314 01:26:47 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:39.314 01:26:47 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:39.314 01:26:47 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:39.314 01:26:47 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:39.314 01:26:47 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:39.314 01:26:47 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:39.314 01:26:47 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:39.314 01:26:47 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:39.314 01:26:47 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:39.314 01:26:47 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:39.314 01:26:47 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:39.314 01:26:47 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:39.314 01:26:47 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:39.314 01:26:47 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:39.314 01:26:47 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:39.314 01:26:47 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:39.314 01:26:47 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:39.314 01:26:47 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:39.314 01:26:47 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:39.314 01:26:47 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:39.314 01:26:47 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:39.314 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:39.314 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.263 ms 00:25:39.314 00:25:39.314 --- 10.0.0.2 ping statistics --- 00:25:39.314 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:39.314 rtt min/avg/max/mdev = 0.263/0.263/0.263/0.000 ms 00:25:39.314 01:26:47 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:39.314 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:39.314 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.071 ms 00:25:39.314 00:25:39.314 --- 10.0.0.1 ping statistics --- 00:25:39.314 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:39.314 rtt min/avg/max/mdev = 0.071/0.071/0.071/0.000 ms 00:25:39.314 01:26:47 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:39.314 01:26:47 -- nvmf/common.sh@410 -- # return 0 00:25:39.314 01:26:47 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:39.314 01:26:47 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:39.314 01:26:47 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:39.314 01:26:47 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:39.314 01:26:47 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:39.314 01:26:47 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:39.314 01:26:47 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:39.314 01:26:47 -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:25:39.314 01:26:47 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:39.314 01:26:47 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:39.314 01:26:47 -- common/autotest_common.sh@10 -- # set +x 00:25:39.314 01:26:47 -- nvmf/common.sh@469 -- # nvmfpid=1223954 00:25:39.314 01:26:47 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:25:39.314 01:26:47 -- nvmf/common.sh@470 -- # waitforlisten 1223954 00:25:39.314 01:26:47 -- common/autotest_common.sh@829 -- # '[' -z 1223954 ']' 00:25:39.314 01:26:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:39.314 01:26:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:39.314 01:26:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:39.314 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:39.314 01:26:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:39.314 01:26:47 -- common/autotest_common.sh@10 -- # set +x 00:25:39.573 [2024-11-20 01:26:47.541571] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:39.573 [2024-11-20 01:26:47.541639] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:39.573 EAL: No free 2048 kB hugepages reported on node 1 00:25:39.573 [2024-11-20 01:26:47.606853] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:39.573 [2024-11-20 01:26:47.691872] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:39.573 [2024-11-20 01:26:47.692022] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:39.573 [2024-11-20 01:26:47.692052] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:39.573 [2024-11-20 01:26:47.692084] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:39.573 [2024-11-20 01:26:47.692127] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:40.510 01:26:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:40.510 01:26:48 -- common/autotest_common.sh@862 -- # return 0 00:25:40.510 01:26:48 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:40.510 01:26:48 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:40.510 01:26:48 -- common/autotest_common.sh@10 -- # set +x 00:25:40.510 01:26:48 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:40.510 01:26:48 -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:25:40.510 01:26:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:40.510 01:26:48 -- common/autotest_common.sh@10 -- # set +x 00:25:40.510 [2024-11-20 01:26:48.547648] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:40.510 01:26:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:40.510 01:26:48 -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:25:40.510 01:26:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:40.510 01:26:48 -- common/autotest_common.sh@10 -- # set +x 00:25:40.510 null0 00:25:40.510 01:26:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:40.510 01:26:48 -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:25:40.510 01:26:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:40.510 01:26:48 -- common/autotest_common.sh@10 -- # set +x 00:25:40.510 01:26:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:40.510 01:26:48 -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:25:40.510 01:26:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:40.510 01:26:48 -- common/autotest_common.sh@10 -- # set +x 00:25:40.510 01:26:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:40.510 01:26:48 -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g e8ab1dafefd1444aa9bc89badd5df923 00:25:40.510 01:26:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:40.510 01:26:48 -- common/autotest_common.sh@10 -- # set +x 00:25:40.510 01:26:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:40.510 01:26:48 -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:25:40.510 01:26:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:40.510 01:26:48 -- common/autotest_common.sh@10 -- # set +x 00:25:40.510 [2024-11-20 01:26:48.587917] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:40.510 01:26:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:40.510 01:26:48 -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:25:40.510 01:26:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:40.510 01:26:48 -- common/autotest_common.sh@10 -- # set +x 00:25:40.769 nvme0n1 00:25:40.769 01:26:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:40.769 01:26:48 -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:25:40.769 01:26:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:40.769 01:26:48 -- common/autotest_common.sh@10 -- # set +x 00:25:40.769 [ 00:25:40.769 { 00:25:40.769 "name": "nvme0n1", 00:25:40.769 "aliases": [ 00:25:40.769 "e8ab1daf-efd1-444a-a9bc-89badd5df923" 00:25:40.769 ], 00:25:40.769 "product_name": "NVMe disk", 00:25:40.769 "block_size": 512, 00:25:40.769 "num_blocks": 2097152, 00:25:40.769 "uuid": "e8ab1daf-efd1-444a-a9bc-89badd5df923", 00:25:40.769 "assigned_rate_limits": { 00:25:40.769 "rw_ios_per_sec": 0, 00:25:40.769 "rw_mbytes_per_sec": 0, 00:25:40.769 "r_mbytes_per_sec": 0, 00:25:40.769 "w_mbytes_per_sec": 0 00:25:40.769 }, 00:25:40.769 "claimed": false, 00:25:40.769 "zoned": false, 00:25:40.769 "supported_io_types": { 00:25:40.769 "read": true, 00:25:40.769 "write": true, 00:25:40.769 "unmap": false, 00:25:40.769 "write_zeroes": true, 00:25:40.769 "flush": true, 00:25:40.769 "reset": true, 00:25:40.769 "compare": true, 00:25:40.769 "compare_and_write": true, 00:25:40.769 "abort": true, 00:25:40.769 "nvme_admin": true, 00:25:40.769 "nvme_io": true 00:25:40.769 }, 00:25:40.769 "driver_specific": { 00:25:40.769 "nvme": [ 00:25:40.769 { 00:25:40.769 "trid": { 00:25:40.769 "trtype": "TCP", 00:25:40.769 "adrfam": "IPv4", 00:25:40.769 "traddr": "10.0.0.2", 00:25:40.769 "trsvcid": "4420", 00:25:40.769 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:25:40.769 }, 00:25:40.769 "ctrlr_data": { 00:25:40.769 "cntlid": 1, 00:25:40.769 "vendor_id": "0x8086", 00:25:40.769 "model_number": "SPDK bdev Controller", 00:25:40.769 "serial_number": "00000000000000000000", 00:25:40.769 "firmware_revision": "24.01.1", 00:25:40.769 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:25:40.769 "oacs": { 00:25:40.769 "security": 0, 00:25:40.769 "format": 0, 00:25:40.769 "firmware": 0, 00:25:40.769 "ns_manage": 0 00:25:40.769 }, 00:25:40.769 "multi_ctrlr": true, 00:25:40.769 "ana_reporting": false 00:25:40.769 }, 00:25:40.769 "vs": { 00:25:40.769 "nvme_version": "1.3" 00:25:40.769 }, 00:25:40.769 "ns_data": { 00:25:40.769 "id": 1, 00:25:40.769 "can_share": true 00:25:40.769 } 00:25:40.769 } 00:25:40.769 ], 00:25:40.769 "mp_policy": "active_passive" 00:25:40.769 } 00:25:40.769 } 00:25:40.769 ] 00:25:40.769 01:26:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:40.769 01:26:48 -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:25:40.769 01:26:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:40.769 01:26:48 -- common/autotest_common.sh@10 -- # set +x 00:25:40.769 [2024-11-20 01:26:48.836543] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:40.769 [2024-11-20 01:26:48.836632] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d9ba0 (9): Bad file descriptor 00:25:40.769 [2024-11-20 01:26:48.969217] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:40.769 01:26:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:40.769 01:26:48 -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:25:40.769 01:26:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:40.769 01:26:48 -- common/autotest_common.sh@10 -- # set +x 00:25:40.769 [ 00:25:40.769 { 00:25:40.769 "name": "nvme0n1", 00:25:40.769 "aliases": [ 00:25:40.769 "e8ab1daf-efd1-444a-a9bc-89badd5df923" 00:25:40.769 ], 00:25:40.769 "product_name": "NVMe disk", 00:25:40.769 "block_size": 512, 00:25:40.769 "num_blocks": 2097152, 00:25:40.769 "uuid": "e8ab1daf-efd1-444a-a9bc-89badd5df923", 00:25:40.769 "assigned_rate_limits": { 00:25:40.769 "rw_ios_per_sec": 0, 00:25:40.769 "rw_mbytes_per_sec": 0, 00:25:40.769 "r_mbytes_per_sec": 0, 00:25:40.769 "w_mbytes_per_sec": 0 00:25:40.769 }, 00:25:40.769 "claimed": false, 00:25:40.769 "zoned": false, 00:25:40.769 "supported_io_types": { 00:25:40.769 "read": true, 00:25:40.769 "write": true, 00:25:40.769 "unmap": false, 00:25:40.769 "write_zeroes": true, 00:25:40.769 "flush": true, 00:25:40.769 "reset": true, 00:25:40.769 "compare": true, 00:25:40.769 "compare_and_write": true, 00:25:40.769 "abort": true, 00:25:40.769 "nvme_admin": true, 00:25:40.769 "nvme_io": true 00:25:40.769 }, 00:25:40.769 "driver_specific": { 00:25:40.769 "nvme": [ 00:25:40.769 { 00:25:40.769 "trid": { 00:25:40.769 "trtype": "TCP", 00:25:40.769 "adrfam": "IPv4", 00:25:40.769 "traddr": "10.0.0.2", 00:25:40.769 "trsvcid": "4420", 00:25:40.769 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:25:40.769 }, 00:25:40.769 "ctrlr_data": { 00:25:40.769 "cntlid": 2, 00:25:40.769 "vendor_id": "0x8086", 00:25:40.769 "model_number": "SPDK bdev Controller", 00:25:40.769 "serial_number": "00000000000000000000", 00:25:40.769 "firmware_revision": "24.01.1", 00:25:40.769 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:25:40.769 "oacs": { 00:25:40.769 "security": 0, 00:25:40.769 "format": 0, 00:25:40.769 "firmware": 0, 00:25:40.769 "ns_manage": 0 00:25:40.769 }, 00:25:41.028 "multi_ctrlr": true, 00:25:41.028 "ana_reporting": false 00:25:41.028 }, 00:25:41.028 "vs": { 00:25:41.028 "nvme_version": "1.3" 00:25:41.028 }, 00:25:41.028 "ns_data": { 00:25:41.028 "id": 1, 00:25:41.028 "can_share": true 00:25:41.028 } 00:25:41.028 } 00:25:41.028 ], 00:25:41.028 "mp_policy": "active_passive" 00:25:41.028 } 00:25:41.028 } 00:25:41.028 ] 00:25:41.028 01:26:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:41.028 01:26:48 -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:25:41.028 01:26:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:41.028 01:26:48 -- common/autotest_common.sh@10 -- # set +x 00:25:41.028 01:26:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:41.028 01:26:49 -- host/async_init.sh@53 -- # mktemp 00:25:41.028 01:26:49 -- host/async_init.sh@53 -- # key_path=/tmp/tmp.CTV6ZyUjFi 00:25:41.028 01:26:49 -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:25:41.028 01:26:49 -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.CTV6ZyUjFi 00:25:41.028 01:26:49 -- host/async_init.sh@56 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:25:41.028 01:26:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:41.028 01:26:49 -- common/autotest_common.sh@10 -- # set +x 00:25:41.028 01:26:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:41.028 01:26:49 -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 --secure-channel 00:25:41.028 01:26:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:41.028 01:26:49 -- common/autotest_common.sh@10 -- # set +x 00:25:41.028 [2024-11-20 01:26:49.017180] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:25:41.028 [2024-11-20 01:26:49.017300] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:41.028 01:26:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:41.028 01:26:49 -- host/async_init.sh@59 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.CTV6ZyUjFi 00:25:41.028 01:26:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:41.028 01:26:49 -- common/autotest_common.sh@10 -- # set +x 00:25:41.028 01:26:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:41.028 01:26:49 -- host/async_init.sh@65 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.CTV6ZyUjFi 00:25:41.028 01:26:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:41.028 01:26:49 -- common/autotest_common.sh@10 -- # set +x 00:25:41.029 [2024-11-20 01:26:49.033206] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:25:41.029 nvme0n1 00:25:41.029 01:26:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:41.029 01:26:49 -- host/async_init.sh@69 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:25:41.029 01:26:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:41.029 01:26:49 -- common/autotest_common.sh@10 -- # set +x 00:25:41.029 [ 00:25:41.029 { 00:25:41.029 "name": "nvme0n1", 00:25:41.029 "aliases": [ 00:25:41.029 "e8ab1daf-efd1-444a-a9bc-89badd5df923" 00:25:41.029 ], 00:25:41.029 "product_name": "NVMe disk", 00:25:41.029 "block_size": 512, 00:25:41.029 "num_blocks": 2097152, 00:25:41.029 "uuid": "e8ab1daf-efd1-444a-a9bc-89badd5df923", 00:25:41.029 "assigned_rate_limits": { 00:25:41.029 "rw_ios_per_sec": 0, 00:25:41.029 "rw_mbytes_per_sec": 0, 00:25:41.029 "r_mbytes_per_sec": 0, 00:25:41.029 "w_mbytes_per_sec": 0 00:25:41.029 }, 00:25:41.029 "claimed": false, 00:25:41.029 "zoned": false, 00:25:41.029 "supported_io_types": { 00:25:41.029 "read": true, 00:25:41.029 "write": true, 00:25:41.029 "unmap": false, 00:25:41.029 "write_zeroes": true, 00:25:41.029 "flush": true, 00:25:41.029 "reset": true, 00:25:41.029 "compare": true, 00:25:41.029 "compare_and_write": true, 00:25:41.029 "abort": true, 00:25:41.029 "nvme_admin": true, 00:25:41.029 "nvme_io": true 00:25:41.029 }, 00:25:41.029 "driver_specific": { 00:25:41.029 "nvme": [ 00:25:41.029 { 00:25:41.029 "trid": { 00:25:41.029 "trtype": "TCP", 00:25:41.029 "adrfam": "IPv4", 00:25:41.029 "traddr": "10.0.0.2", 00:25:41.029 "trsvcid": "4421", 00:25:41.029 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:25:41.029 }, 00:25:41.029 "ctrlr_data": { 00:25:41.029 "cntlid": 3, 00:25:41.029 "vendor_id": "0x8086", 00:25:41.029 "model_number": "SPDK bdev Controller", 00:25:41.029 "serial_number": "00000000000000000000", 00:25:41.029 "firmware_revision": "24.01.1", 00:25:41.029 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:25:41.029 "oacs": { 00:25:41.029 "security": 0, 00:25:41.029 "format": 0, 00:25:41.029 "firmware": 0, 00:25:41.029 "ns_manage": 0 00:25:41.029 }, 00:25:41.029 "multi_ctrlr": true, 00:25:41.029 "ana_reporting": false 00:25:41.029 }, 00:25:41.029 "vs": { 00:25:41.029 "nvme_version": "1.3" 00:25:41.029 }, 00:25:41.029 "ns_data": { 00:25:41.029 "id": 1, 00:25:41.029 "can_share": true 00:25:41.029 } 00:25:41.029 } 00:25:41.029 ], 00:25:41.029 "mp_policy": "active_passive" 00:25:41.029 } 00:25:41.029 } 00:25:41.029 ] 00:25:41.029 01:26:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:41.029 01:26:49 -- host/async_init.sh@72 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:25:41.029 01:26:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:41.029 01:26:49 -- common/autotest_common.sh@10 -- # set +x 00:25:41.029 01:26:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:41.029 01:26:49 -- host/async_init.sh@75 -- # rm -f /tmp/tmp.CTV6ZyUjFi 00:25:41.029 01:26:49 -- host/async_init.sh@77 -- # trap - SIGINT SIGTERM EXIT 00:25:41.029 01:26:49 -- host/async_init.sh@78 -- # nvmftestfini 00:25:41.029 01:26:49 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:41.029 01:26:49 -- nvmf/common.sh@116 -- # sync 00:25:41.029 01:26:49 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:41.029 01:26:49 -- nvmf/common.sh@119 -- # set +e 00:25:41.029 01:26:49 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:41.029 01:26:49 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:41.029 rmmod nvme_tcp 00:25:41.029 rmmod nvme_fabrics 00:25:41.029 rmmod nvme_keyring 00:25:41.029 01:26:49 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:41.029 01:26:49 -- nvmf/common.sh@123 -- # set -e 00:25:41.029 01:26:49 -- nvmf/common.sh@124 -- # return 0 00:25:41.029 01:26:49 -- nvmf/common.sh@477 -- # '[' -n 1223954 ']' 00:25:41.029 01:26:49 -- nvmf/common.sh@478 -- # killprocess 1223954 00:25:41.029 01:26:49 -- common/autotest_common.sh@936 -- # '[' -z 1223954 ']' 00:25:41.029 01:26:49 -- common/autotest_common.sh@940 -- # kill -0 1223954 00:25:41.029 01:26:49 -- common/autotest_common.sh@941 -- # uname 00:25:41.029 01:26:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:41.029 01:26:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1223954 00:25:41.029 01:26:49 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:41.029 01:26:49 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:41.029 01:26:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1223954' 00:25:41.029 killing process with pid 1223954 00:25:41.029 01:26:49 -- common/autotest_common.sh@955 -- # kill 1223954 00:25:41.029 01:26:49 -- common/autotest_common.sh@960 -- # wait 1223954 00:25:41.286 01:26:49 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:41.286 01:26:49 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:41.286 01:26:49 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:41.286 01:26:49 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:41.286 01:26:49 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:41.286 01:26:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:41.286 01:26:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:41.286 01:26:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:43.824 01:26:51 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:43.824 00:25:43.824 real 0m6.185s 00:25:43.824 user 0m2.984s 00:25:43.824 sys 0m1.836s 00:25:43.824 01:26:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:43.824 01:26:51 -- common/autotest_common.sh@10 -- # set +x 00:25:43.824 ************************************ 00:25:43.824 END TEST nvmf_async_init 00:25:43.824 ************************************ 00:25:43.824 01:26:51 -- nvmf/nvmf.sh@94 -- # run_test dma /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:25:43.824 01:26:51 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:43.824 01:26:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:43.824 01:26:51 -- common/autotest_common.sh@10 -- # set +x 00:25:43.824 ************************************ 00:25:43.824 START TEST dma 00:25:43.824 ************************************ 00:25:43.824 01:26:51 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:25:43.824 * Looking for test storage... 00:25:43.824 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:43.824 01:26:51 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:43.824 01:26:51 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:43.824 01:26:51 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:43.824 01:26:51 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:43.824 01:26:51 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:43.824 01:26:51 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:43.824 01:26:51 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:43.824 01:26:51 -- scripts/common.sh@335 -- # IFS=.-: 00:25:43.824 01:26:51 -- scripts/common.sh@335 -- # read -ra ver1 00:25:43.824 01:26:51 -- scripts/common.sh@336 -- # IFS=.-: 00:25:43.824 01:26:51 -- scripts/common.sh@336 -- # read -ra ver2 00:25:43.824 01:26:51 -- scripts/common.sh@337 -- # local 'op=<' 00:25:43.824 01:26:51 -- scripts/common.sh@339 -- # ver1_l=2 00:25:43.824 01:26:51 -- scripts/common.sh@340 -- # ver2_l=1 00:25:43.824 01:26:51 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:43.824 01:26:51 -- scripts/common.sh@343 -- # case "$op" in 00:25:43.824 01:26:51 -- scripts/common.sh@344 -- # : 1 00:25:43.824 01:26:51 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:43.824 01:26:51 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:43.824 01:26:51 -- scripts/common.sh@364 -- # decimal 1 00:25:43.824 01:26:51 -- scripts/common.sh@352 -- # local d=1 00:25:43.824 01:26:51 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:43.824 01:26:51 -- scripts/common.sh@354 -- # echo 1 00:25:43.824 01:26:51 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:43.824 01:26:51 -- scripts/common.sh@365 -- # decimal 2 00:25:43.824 01:26:51 -- scripts/common.sh@352 -- # local d=2 00:25:43.824 01:26:51 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:43.824 01:26:51 -- scripts/common.sh@354 -- # echo 2 00:25:43.824 01:26:51 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:43.824 01:26:51 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:43.824 01:26:51 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:43.824 01:26:51 -- scripts/common.sh@367 -- # return 0 00:25:43.824 01:26:51 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:43.824 01:26:51 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:43.824 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:43.824 --rc genhtml_branch_coverage=1 00:25:43.824 --rc genhtml_function_coverage=1 00:25:43.824 --rc genhtml_legend=1 00:25:43.824 --rc geninfo_all_blocks=1 00:25:43.824 --rc geninfo_unexecuted_blocks=1 00:25:43.824 00:25:43.824 ' 00:25:43.824 01:26:51 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:43.824 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:43.824 --rc genhtml_branch_coverage=1 00:25:43.824 --rc genhtml_function_coverage=1 00:25:43.824 --rc genhtml_legend=1 00:25:43.824 --rc geninfo_all_blocks=1 00:25:43.824 --rc geninfo_unexecuted_blocks=1 00:25:43.824 00:25:43.824 ' 00:25:43.824 01:26:51 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:43.824 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:43.824 --rc genhtml_branch_coverage=1 00:25:43.824 --rc genhtml_function_coverage=1 00:25:43.824 --rc genhtml_legend=1 00:25:43.824 --rc geninfo_all_blocks=1 00:25:43.824 --rc geninfo_unexecuted_blocks=1 00:25:43.824 00:25:43.824 ' 00:25:43.824 01:26:51 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:43.824 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:43.824 --rc genhtml_branch_coverage=1 00:25:43.824 --rc genhtml_function_coverage=1 00:25:43.824 --rc genhtml_legend=1 00:25:43.824 --rc geninfo_all_blocks=1 00:25:43.824 --rc geninfo_unexecuted_blocks=1 00:25:43.824 00:25:43.824 ' 00:25:43.824 01:26:51 -- host/dma.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:43.824 01:26:51 -- nvmf/common.sh@7 -- # uname -s 00:25:43.824 01:26:51 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:43.824 01:26:51 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:43.824 01:26:51 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:43.824 01:26:51 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:43.824 01:26:51 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:43.824 01:26:51 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:43.824 01:26:51 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:43.824 01:26:51 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:43.824 01:26:51 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:43.824 01:26:51 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:43.824 01:26:51 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:43.824 01:26:51 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:43.824 01:26:51 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:43.824 01:26:51 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:43.824 01:26:51 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:43.824 01:26:51 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:43.824 01:26:51 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:43.824 01:26:51 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:43.824 01:26:51 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:43.824 01:26:51 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:43.824 01:26:51 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:43.824 01:26:51 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:43.824 01:26:51 -- paths/export.sh@5 -- # export PATH 00:25:43.824 01:26:51 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:43.824 01:26:51 -- nvmf/common.sh@46 -- # : 0 00:25:43.824 01:26:51 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:43.824 01:26:51 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:43.824 01:26:51 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:43.825 01:26:51 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:43.825 01:26:51 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:43.825 01:26:51 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:43.825 01:26:51 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:43.825 01:26:51 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:43.825 01:26:51 -- host/dma.sh@12 -- # '[' tcp '!=' rdma ']' 00:25:43.825 01:26:51 -- host/dma.sh@13 -- # exit 0 00:25:43.825 00:25:43.825 real 0m0.160s 00:25:43.825 user 0m0.113s 00:25:43.825 sys 0m0.056s 00:25:43.825 01:26:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:43.825 01:26:51 -- common/autotest_common.sh@10 -- # set +x 00:25:43.825 ************************************ 00:25:43.825 END TEST dma 00:25:43.825 ************************************ 00:25:43.825 01:26:51 -- nvmf/nvmf.sh@97 -- # run_test nvmf_identify /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:25:43.825 01:26:51 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:43.825 01:26:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:43.825 01:26:51 -- common/autotest_common.sh@10 -- # set +x 00:25:43.825 ************************************ 00:25:43.825 START TEST nvmf_identify 00:25:43.825 ************************************ 00:25:43.825 01:26:51 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:25:43.825 * Looking for test storage... 00:25:43.825 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:43.825 01:26:51 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:43.825 01:26:51 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:43.825 01:26:51 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:43.825 01:26:51 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:43.825 01:26:51 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:43.825 01:26:51 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:43.825 01:26:51 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:43.825 01:26:51 -- scripts/common.sh@335 -- # IFS=.-: 00:25:43.825 01:26:51 -- scripts/common.sh@335 -- # read -ra ver1 00:25:43.825 01:26:51 -- scripts/common.sh@336 -- # IFS=.-: 00:25:43.825 01:26:51 -- scripts/common.sh@336 -- # read -ra ver2 00:25:43.825 01:26:51 -- scripts/common.sh@337 -- # local 'op=<' 00:25:43.825 01:26:51 -- scripts/common.sh@339 -- # ver1_l=2 00:25:43.825 01:26:51 -- scripts/common.sh@340 -- # ver2_l=1 00:25:43.825 01:26:51 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:43.825 01:26:51 -- scripts/common.sh@343 -- # case "$op" in 00:25:43.825 01:26:51 -- scripts/common.sh@344 -- # : 1 00:25:43.825 01:26:51 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:43.825 01:26:51 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:43.825 01:26:51 -- scripts/common.sh@364 -- # decimal 1 00:25:43.825 01:26:51 -- scripts/common.sh@352 -- # local d=1 00:25:43.825 01:26:51 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:43.825 01:26:51 -- scripts/common.sh@354 -- # echo 1 00:25:43.825 01:26:51 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:43.825 01:26:51 -- scripts/common.sh@365 -- # decimal 2 00:25:43.825 01:26:51 -- scripts/common.sh@352 -- # local d=2 00:25:43.825 01:26:51 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:43.825 01:26:51 -- scripts/common.sh@354 -- # echo 2 00:25:43.825 01:26:51 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:43.825 01:26:51 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:43.825 01:26:51 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:43.825 01:26:51 -- scripts/common.sh@367 -- # return 0 00:25:43.825 01:26:51 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:43.825 01:26:51 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:43.825 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:43.825 --rc genhtml_branch_coverage=1 00:25:43.825 --rc genhtml_function_coverage=1 00:25:43.825 --rc genhtml_legend=1 00:25:43.825 --rc geninfo_all_blocks=1 00:25:43.825 --rc geninfo_unexecuted_blocks=1 00:25:43.825 00:25:43.825 ' 00:25:43.825 01:26:51 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:43.825 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:43.825 --rc genhtml_branch_coverage=1 00:25:43.825 --rc genhtml_function_coverage=1 00:25:43.825 --rc genhtml_legend=1 00:25:43.825 --rc geninfo_all_blocks=1 00:25:43.825 --rc geninfo_unexecuted_blocks=1 00:25:43.825 00:25:43.825 ' 00:25:43.825 01:26:51 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:43.825 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:43.825 --rc genhtml_branch_coverage=1 00:25:43.825 --rc genhtml_function_coverage=1 00:25:43.825 --rc genhtml_legend=1 00:25:43.825 --rc geninfo_all_blocks=1 00:25:43.825 --rc geninfo_unexecuted_blocks=1 00:25:43.825 00:25:43.825 ' 00:25:43.825 01:26:51 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:43.825 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:43.825 --rc genhtml_branch_coverage=1 00:25:43.825 --rc genhtml_function_coverage=1 00:25:43.825 --rc genhtml_legend=1 00:25:43.825 --rc geninfo_all_blocks=1 00:25:43.825 --rc geninfo_unexecuted_blocks=1 00:25:43.825 00:25:43.825 ' 00:25:43.825 01:26:51 -- host/identify.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:43.825 01:26:51 -- nvmf/common.sh@7 -- # uname -s 00:25:43.825 01:26:51 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:43.825 01:26:51 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:43.825 01:26:51 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:43.825 01:26:51 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:43.825 01:26:51 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:43.825 01:26:51 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:43.825 01:26:51 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:43.825 01:26:51 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:43.825 01:26:51 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:43.825 01:26:51 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:43.825 01:26:51 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:43.825 01:26:51 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:43.825 01:26:51 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:43.825 01:26:51 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:43.825 01:26:51 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:43.825 01:26:51 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:43.825 01:26:51 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:43.825 01:26:51 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:43.825 01:26:51 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:43.825 01:26:51 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:43.825 01:26:51 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:43.825 01:26:51 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:43.825 01:26:51 -- paths/export.sh@5 -- # export PATH 00:25:43.825 01:26:51 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:43.825 01:26:51 -- nvmf/common.sh@46 -- # : 0 00:25:43.825 01:26:51 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:43.825 01:26:51 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:43.825 01:26:51 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:43.825 01:26:51 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:43.825 01:26:51 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:43.825 01:26:51 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:43.825 01:26:51 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:43.825 01:26:51 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:43.825 01:26:51 -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:43.825 01:26:51 -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:43.825 01:26:51 -- host/identify.sh@14 -- # nvmftestinit 00:25:43.825 01:26:51 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:43.825 01:26:51 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:43.825 01:26:51 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:43.825 01:26:51 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:43.825 01:26:51 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:43.825 01:26:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:43.825 01:26:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:43.825 01:26:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:43.825 01:26:51 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:43.825 01:26:51 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:43.825 01:26:51 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:43.825 01:26:51 -- common/autotest_common.sh@10 -- # set +x 00:25:45.783 01:26:53 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:45.783 01:26:53 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:45.783 01:26:53 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:45.783 01:26:53 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:45.783 01:26:53 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:45.783 01:26:53 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:45.783 01:26:53 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:45.783 01:26:53 -- nvmf/common.sh@294 -- # net_devs=() 00:25:45.783 01:26:53 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:45.783 01:26:53 -- nvmf/common.sh@295 -- # e810=() 00:25:45.783 01:26:53 -- nvmf/common.sh@295 -- # local -ga e810 00:25:45.783 01:26:53 -- nvmf/common.sh@296 -- # x722=() 00:25:45.783 01:26:53 -- nvmf/common.sh@296 -- # local -ga x722 00:25:45.783 01:26:53 -- nvmf/common.sh@297 -- # mlx=() 00:25:45.783 01:26:53 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:45.783 01:26:53 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:45.783 01:26:53 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:45.783 01:26:53 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:45.783 01:26:53 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:45.783 01:26:53 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:45.783 01:26:53 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:45.783 01:26:53 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:45.783 01:26:53 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:45.783 01:26:53 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:45.783 01:26:53 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:45.783 01:26:53 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:45.783 01:26:53 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:45.783 01:26:53 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:45.783 01:26:53 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:45.783 01:26:53 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:45.783 01:26:53 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:45.783 01:26:53 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:45.783 01:26:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:45.783 01:26:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:45.783 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:45.783 01:26:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:45.783 01:26:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:45.783 01:26:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:45.783 01:26:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:45.783 01:26:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:45.783 01:26:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:45.783 01:26:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:45.783 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:45.783 01:26:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:45.783 01:26:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:45.783 01:26:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:45.783 01:26:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:45.783 01:26:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:45.783 01:26:53 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:45.783 01:26:53 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:45.783 01:26:53 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:45.783 01:26:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:45.783 01:26:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:45.783 01:26:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:45.783 01:26:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:45.783 01:26:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:45.783 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:45.783 01:26:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:45.783 01:26:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:45.783 01:26:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:45.783 01:26:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:45.783 01:26:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:45.783 01:26:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:45.783 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:45.783 01:26:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:45.784 01:26:53 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:45.784 01:26:53 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:45.784 01:26:53 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:45.784 01:26:53 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:45.784 01:26:53 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:45.784 01:26:53 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:45.784 01:26:53 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:45.784 01:26:53 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:45.784 01:26:53 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:45.784 01:26:53 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:45.784 01:26:53 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:45.784 01:26:53 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:45.784 01:26:53 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:45.784 01:26:53 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:45.784 01:26:53 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:45.784 01:26:53 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:45.784 01:26:53 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:45.784 01:26:53 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:45.784 01:26:53 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:45.784 01:26:53 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:45.784 01:26:53 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:45.784 01:26:53 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:45.784 01:26:53 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:45.784 01:26:53 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:45.784 01:26:53 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:45.784 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:45.784 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.204 ms 00:25:45.784 00:25:45.784 --- 10.0.0.2 ping statistics --- 00:25:45.784 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:45.784 rtt min/avg/max/mdev = 0.204/0.204/0.204/0.000 ms 00:25:45.784 01:26:53 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:45.784 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:45.784 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.165 ms 00:25:45.784 00:25:45.784 --- 10.0.0.1 ping statistics --- 00:25:45.784 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:45.784 rtt min/avg/max/mdev = 0.165/0.165/0.165/0.000 ms 00:25:45.784 01:26:53 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:45.784 01:26:53 -- nvmf/common.sh@410 -- # return 0 00:25:45.784 01:26:53 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:45.784 01:26:53 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:45.784 01:26:53 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:45.784 01:26:53 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:45.784 01:26:53 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:45.784 01:26:53 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:45.784 01:26:53 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:45.784 01:26:53 -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:25:45.784 01:26:53 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:45.784 01:26:53 -- common/autotest_common.sh@10 -- # set +x 00:25:45.784 01:26:53 -- host/identify.sh@19 -- # nvmfpid=1226233 00:25:45.784 01:26:53 -- host/identify.sh@18 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:25:45.784 01:26:53 -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:45.784 01:26:53 -- host/identify.sh@23 -- # waitforlisten 1226233 00:25:45.784 01:26:53 -- common/autotest_common.sh@829 -- # '[' -z 1226233 ']' 00:25:45.784 01:26:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:45.784 01:26:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:45.784 01:26:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:45.784 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:45.784 01:26:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:45.784 01:26:53 -- common/autotest_common.sh@10 -- # set +x 00:25:46.043 [2024-11-20 01:26:54.028524] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:46.043 [2024-11-20 01:26:54.028604] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:46.043 EAL: No free 2048 kB hugepages reported on node 1 00:25:46.043 [2024-11-20 01:26:54.100590] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:46.043 [2024-11-20 01:26:54.192723] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:46.043 [2024-11-20 01:26:54.192869] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:46.043 [2024-11-20 01:26:54.192899] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:46.043 [2024-11-20 01:26:54.192912] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:46.043 [2024-11-20 01:26:54.192970] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:46.043 [2024-11-20 01:26:54.193050] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:46.043 [2024-11-20 01:26:54.193141] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:46.043 [2024-11-20 01:26:54.193145] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:46.982 01:26:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:46.982 01:26:55 -- common/autotest_common.sh@862 -- # return 0 00:25:46.982 01:26:55 -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:46.982 01:26:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.982 01:26:55 -- common/autotest_common.sh@10 -- # set +x 00:25:46.982 [2024-11-20 01:26:55.041801] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:46.982 01:26:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:46.982 01:26:55 -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:25:46.982 01:26:55 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:46.982 01:26:55 -- common/autotest_common.sh@10 -- # set +x 00:25:46.982 01:26:55 -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:25:46.982 01:26:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.982 01:26:55 -- common/autotest_common.sh@10 -- # set +x 00:25:46.982 Malloc0 00:25:46.982 01:26:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:46.982 01:26:55 -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:46.982 01:26:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.982 01:26:55 -- common/autotest_common.sh@10 -- # set +x 00:25:46.982 01:26:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:46.982 01:26:55 -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:25:46.982 01:26:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.982 01:26:55 -- common/autotest_common.sh@10 -- # set +x 00:25:46.982 01:26:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:46.982 01:26:55 -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:46.982 01:26:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.982 01:26:55 -- common/autotest_common.sh@10 -- # set +x 00:25:46.982 [2024-11-20 01:26:55.123578] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:46.982 01:26:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:46.982 01:26:55 -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:25:46.982 01:26:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.982 01:26:55 -- common/autotest_common.sh@10 -- # set +x 00:25:46.982 01:26:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:46.982 01:26:55 -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:25:46.982 01:26:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.982 01:26:55 -- common/autotest_common.sh@10 -- # set +x 00:25:46.982 [2024-11-20 01:26:55.139305] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:25:46.982 [ 00:25:46.982 { 00:25:46.982 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:25:46.982 "subtype": "Discovery", 00:25:46.982 "listen_addresses": [ 00:25:46.982 { 00:25:46.982 "transport": "TCP", 00:25:46.982 "trtype": "TCP", 00:25:46.982 "adrfam": "IPv4", 00:25:46.982 "traddr": "10.0.0.2", 00:25:46.982 "trsvcid": "4420" 00:25:46.982 } 00:25:46.982 ], 00:25:46.982 "allow_any_host": true, 00:25:46.982 "hosts": [] 00:25:46.982 }, 00:25:46.982 { 00:25:46.982 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:25:46.982 "subtype": "NVMe", 00:25:46.982 "listen_addresses": [ 00:25:46.982 { 00:25:46.982 "transport": "TCP", 00:25:46.982 "trtype": "TCP", 00:25:46.982 "adrfam": "IPv4", 00:25:46.982 "traddr": "10.0.0.2", 00:25:46.982 "trsvcid": "4420" 00:25:46.982 } 00:25:46.982 ], 00:25:46.982 "allow_any_host": true, 00:25:46.982 "hosts": [], 00:25:46.982 "serial_number": "SPDK00000000000001", 00:25:46.982 "model_number": "SPDK bdev Controller", 00:25:46.982 "max_namespaces": 32, 00:25:46.982 "min_cntlid": 1, 00:25:46.982 "max_cntlid": 65519, 00:25:46.982 "namespaces": [ 00:25:46.982 { 00:25:46.982 "nsid": 1, 00:25:46.982 "bdev_name": "Malloc0", 00:25:46.982 "name": "Malloc0", 00:25:46.982 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:25:46.982 "eui64": "ABCDEF0123456789", 00:25:46.982 "uuid": "24850f11-7e85-4105-b8c0-031db7123cfd" 00:25:46.982 } 00:25:46.982 ] 00:25:46.982 } 00:25:46.982 ] 00:25:46.982 01:26:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:46.982 01:26:55 -- host/identify.sh@39 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:25:46.982 [2024-11-20 01:26:55.164199] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:46.982 [2024-11-20 01:26:55.164241] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1226392 ] 00:25:46.982 EAL: No free 2048 kB hugepages reported on node 1 00:25:46.982 [2024-11-20 01:26:55.197449] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:25:46.982 [2024-11-20 01:26:55.197511] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:25:46.982 [2024-11-20 01:26:55.197520] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:25:46.982 [2024-11-20 01:26:55.197535] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:25:46.982 [2024-11-20 01:26:55.197562] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:25:47.248 [2024-11-20 01:26:55.202131] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:25:47.248 [2024-11-20 01:26:55.202193] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x7fe2f0 0 00:25:47.248 [2024-11-20 01:26:55.210086] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:25:47.248 [2024-11-20 01:26:55.210106] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:25:47.248 [2024-11-20 01:26:55.210114] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:25:47.248 [2024-11-20 01:26:55.210120] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:25:47.248 [2024-11-20 01:26:55.210184] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.248 [2024-11-20 01:26:55.210197] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.248 [2024-11-20 01:26:55.210204] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x7fe2f0) 00:25:47.248 [2024-11-20 01:26:55.210221] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:25:47.248 [2024-11-20 01:26:55.210248] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x856ec0, cid 0, qid 0 00:25:47.248 [2024-11-20 01:26:55.218081] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.248 [2024-11-20 01:26:55.218098] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.248 [2024-11-20 01:26:55.218106] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.248 [2024-11-20 01:26:55.218113] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x856ec0) on tqpair=0x7fe2f0 00:25:47.248 [2024-11-20 01:26:55.218148] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:25:47.248 [2024-11-20 01:26:55.218159] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:25:47.248 [2024-11-20 01:26:55.218175] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:25:47.248 [2024-11-20 01:26:55.218194] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.248 [2024-11-20 01:26:55.218202] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.248 [2024-11-20 01:26:55.218209] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x7fe2f0) 00:25:47.248 [2024-11-20 01:26:55.218220] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.248 [2024-11-20 01:26:55.218243] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x856ec0, cid 0, qid 0 00:25:47.248 [2024-11-20 01:26:55.218357] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.248 [2024-11-20 01:26:55.218372] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.248 [2024-11-20 01:26:55.218379] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.248 [2024-11-20 01:26:55.218385] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x856ec0) on tqpair=0x7fe2f0 00:25:47.248 [2024-11-20 01:26:55.218395] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:25:47.248 [2024-11-20 01:26:55.218408] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:25:47.248 [2024-11-20 01:26:55.218420] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.248 [2024-11-20 01:26:55.218428] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.248 [2024-11-20 01:26:55.218434] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x7fe2f0) 00:25:47.248 [2024-11-20 01:26:55.218444] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.248 [2024-11-20 01:26:55.218465] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x856ec0, cid 0, qid 0 00:25:47.248 [2024-11-20 01:26:55.218557] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.248 [2024-11-20 01:26:55.218569] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.248 [2024-11-20 01:26:55.218576] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.248 [2024-11-20 01:26:55.218582] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x856ec0) on tqpair=0x7fe2f0 00:25:47.248 [2024-11-20 01:26:55.218590] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:25:47.248 [2024-11-20 01:26:55.218604] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:25:47.248 [2024-11-20 01:26:55.218615] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.248 [2024-11-20 01:26:55.218623] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.248 [2024-11-20 01:26:55.218629] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x7fe2f0) 00:25:47.248 [2024-11-20 01:26:55.218639] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.248 [2024-11-20 01:26:55.218659] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x856ec0, cid 0, qid 0 00:25:47.248 [2024-11-20 01:26:55.218747] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.248 [2024-11-20 01:26:55.218759] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.248 [2024-11-20 01:26:55.218766] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.248 [2024-11-20 01:26:55.218772] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x856ec0) on tqpair=0x7fe2f0 00:25:47.248 [2024-11-20 01:26:55.218781] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:25:47.248 [2024-11-20 01:26:55.218802] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.248 [2024-11-20 01:26:55.218811] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.248 [2024-11-20 01:26:55.218817] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x7fe2f0) 00:25:47.248 [2024-11-20 01:26:55.218828] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.248 [2024-11-20 01:26:55.218848] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x856ec0, cid 0, qid 0 00:25:47.248 [2024-11-20 01:26:55.218936] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.248 [2024-11-20 01:26:55.218948] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.248 [2024-11-20 01:26:55.218954] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.248 [2024-11-20 01:26:55.218961] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x856ec0) on tqpair=0x7fe2f0 00:25:47.248 [2024-11-20 01:26:55.218969] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:25:47.248 [2024-11-20 01:26:55.218977] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:25:47.248 [2024-11-20 01:26:55.218989] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:25:47.248 [2024-11-20 01:26:55.219099] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:25:47.248 [2024-11-20 01:26:55.219110] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:25:47.248 [2024-11-20 01:26:55.219125] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.248 [2024-11-20 01:26:55.219132] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.248 [2024-11-20 01:26:55.219138] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x7fe2f0) 00:25:47.248 [2024-11-20 01:26:55.219148] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.248 [2024-11-20 01:26:55.219170] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x856ec0, cid 0, qid 0 00:25:47.248 [2024-11-20 01:26:55.219261] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.248 [2024-11-20 01:26:55.219272] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.248 [2024-11-20 01:26:55.219279] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.248 [2024-11-20 01:26:55.219285] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x856ec0) on tqpair=0x7fe2f0 00:25:47.249 [2024-11-20 01:26:55.219294] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:25:47.249 [2024-11-20 01:26:55.219309] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.249 [2024-11-20 01:26:55.219318] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.249 [2024-11-20 01:26:55.219324] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x7fe2f0) 00:25:47.249 [2024-11-20 01:26:55.219334] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.249 [2024-11-20 01:26:55.219354] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x856ec0, cid 0, qid 0 00:25:47.249 [2024-11-20 01:26:55.219444] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.249 [2024-11-20 01:26:55.219458] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.249 [2024-11-20 01:26:55.219465] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.249 [2024-11-20 01:26:55.219471] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x856ec0) on tqpair=0x7fe2f0 00:25:47.249 [2024-11-20 01:26:55.219483] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:25:47.249 [2024-11-20 01:26:55.219492] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:25:47.249 [2024-11-20 01:26:55.219505] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:25:47.249 [2024-11-20 01:26:55.219524] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:25:47.249 [2024-11-20 01:26:55.219539] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.249 [2024-11-20 01:26:55.219546] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.249 [2024-11-20 01:26:55.219552] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x7fe2f0) 00:25:47.249 [2024-11-20 01:26:55.219563] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.249 [2024-11-20 01:26:55.219584] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x856ec0, cid 0, qid 0 00:25:47.249 [2024-11-20 01:26:55.219726] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:47.249 [2024-11-20 01:26:55.219738] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:47.249 [2024-11-20 01:26:55.219745] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:47.249 [2024-11-20 01:26:55.219751] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x7fe2f0): datao=0, datal=4096, cccid=0 00:25:47.249 [2024-11-20 01:26:55.219759] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x856ec0) on tqpair(0x7fe2f0): expected_datao=0, payload_size=4096 00:25:47.249 [2024-11-20 01:26:55.219770] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:47.249 [2024-11-20 01:26:55.219779] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:47.249 [2024-11-20 01:26:55.219790] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.249 [2024-11-20 01:26:55.219800] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.249 [2024-11-20 01:26:55.219806] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.249 [2024-11-20 01:26:55.219812] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x856ec0) on tqpair=0x7fe2f0 00:25:47.249 [2024-11-20 01:26:55.219823] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:25:47.249 [2024-11-20 01:26:55.219832] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:25:47.249 [2024-11-20 01:26:55.219840] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:25:47.249 [2024-11-20 01:26:55.219848] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 16 00:25:47.249 [2024-11-20 01:26:55.219855] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:25:47.249 [2024-11-20 01:26:55.219863] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:25:47.249 [2024-11-20 01:26:55.219881] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:25:47.249 [2024-11-20 01:26:55.219895] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.249 [2024-11-20 01:26:55.219902] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.249 [2024-11-20 01:26:55.219908] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x7fe2f0) 00:25:47.249 [2024-11-20 01:26:55.219919] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:25:47.249 [2024-11-20 01:26:55.219939] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x856ec0, cid 0, qid 0 00:25:47.249 [2024-11-20 01:26:55.220036] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.249 [2024-11-20 01:26:55.220051] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.249 [2024-11-20 01:26:55.220057] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.249 [2024-11-20 01:26:55.220064] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x856ec0) on tqpair=0x7fe2f0 00:25:47.249 [2024-11-20 01:26:55.220085] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.249 [2024-11-20 01:26:55.220093] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.249 [2024-11-20 01:26:55.220099] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x7fe2f0) 00:25:47.249 [2024-11-20 01:26:55.220109] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:47.249 [2024-11-20 01:26:55.220119] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.249 [2024-11-20 01:26:55.220126] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.249 [2024-11-20 01:26:55.220131] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x7fe2f0) 00:25:47.249 [2024-11-20 01:26:55.220140] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:47.249 [2024-11-20 01:26:55.220149] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.249 [2024-11-20 01:26:55.220156] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.249 [2024-11-20 01:26:55.220162] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x7fe2f0) 00:25:47.249 [2024-11-20 01:26:55.220170] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:47.249 [2024-11-20 01:26:55.220180] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.249 [2024-11-20 01:26:55.220186] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.249 [2024-11-20 01:26:55.220192] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x7fe2f0) 00:25:47.249 [2024-11-20 01:26:55.220201] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:47.249 [2024-11-20 01:26:55.220210] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:25:47.249 [2024-11-20 01:26:55.220229] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:25:47.249 [2024-11-20 01:26:55.220241] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.249 [2024-11-20 01:26:55.220248] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.249 [2024-11-20 01:26:55.220254] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x7fe2f0) 00:25:47.249 [2024-11-20 01:26:55.220264] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.249 [2024-11-20 01:26:55.220287] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x856ec0, cid 0, qid 0 00:25:47.249 [2024-11-20 01:26:55.220298] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x857020, cid 1, qid 0 00:25:47.249 [2024-11-20 01:26:55.220305] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x857180, cid 2, qid 0 00:25:47.249 [2024-11-20 01:26:55.220313] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8572e0, cid 3, qid 0 00:25:47.249 [2024-11-20 01:26:55.220320] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x857440, cid 4, qid 0 00:25:47.249 [2024-11-20 01:26:55.220434] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.249 [2024-11-20 01:26:55.220446] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.249 [2024-11-20 01:26:55.220452] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.249 [2024-11-20 01:26:55.220462] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x857440) on tqpair=0x7fe2f0 00:25:47.249 [2024-11-20 01:26:55.220472] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:25:47.249 [2024-11-20 01:26:55.220480] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:25:47.249 [2024-11-20 01:26:55.220496] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.249 [2024-11-20 01:26:55.220506] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.249 [2024-11-20 01:26:55.220512] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x7fe2f0) 00:25:47.249 [2024-11-20 01:26:55.220522] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.249 [2024-11-20 01:26:55.220542] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x857440, cid 4, qid 0 00:25:47.249 [2024-11-20 01:26:55.220639] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:47.249 [2024-11-20 01:26:55.220651] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:47.249 [2024-11-20 01:26:55.220657] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:47.249 [2024-11-20 01:26:55.220663] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x7fe2f0): datao=0, datal=4096, cccid=4 00:25:47.249 [2024-11-20 01:26:55.220671] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x857440) on tqpair(0x7fe2f0): expected_datao=0, payload_size=4096 00:25:47.249 [2024-11-20 01:26:55.220682] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:47.249 [2024-11-20 01:26:55.220689] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:47.249 [2024-11-20 01:26:55.220700] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.249 [2024-11-20 01:26:55.220710] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.249 [2024-11-20 01:26:55.220716] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.249 [2024-11-20 01:26:55.220722] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x857440) on tqpair=0x7fe2f0 00:25:47.249 [2024-11-20 01:26:55.220741] nvme_ctrlr.c:4024:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:25:47.249 [2024-11-20 01:26:55.220778] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.249 [2024-11-20 01:26:55.220789] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.249 [2024-11-20 01:26:55.220795] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x7fe2f0) 00:25:47.250 [2024-11-20 01:26:55.220805] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.250 [2024-11-20 01:26:55.220817] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.250 [2024-11-20 01:26:55.220824] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.250 [2024-11-20 01:26:55.220830] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x7fe2f0) 00:25:47.250 [2024-11-20 01:26:55.220839] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:25:47.250 [2024-11-20 01:26:55.220865] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x857440, cid 4, qid 0 00:25:47.250 [2024-11-20 01:26:55.220877] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8575a0, cid 5, qid 0 00:25:47.250 [2024-11-20 01:26:55.221006] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:47.250 [2024-11-20 01:26:55.221018] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:47.250 [2024-11-20 01:26:55.221024] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:47.250 [2024-11-20 01:26:55.221031] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x7fe2f0): datao=0, datal=1024, cccid=4 00:25:47.250 [2024-11-20 01:26:55.221038] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x857440) on tqpair(0x7fe2f0): expected_datao=0, payload_size=1024 00:25:47.250 [2024-11-20 01:26:55.221052] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:47.250 [2024-11-20 01:26:55.221060] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:47.250 [2024-11-20 01:26:55.221076] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.250 [2024-11-20 01:26:55.221088] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.250 [2024-11-20 01:26:55.221094] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.250 [2024-11-20 01:26:55.221100] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8575a0) on tqpair=0x7fe2f0 00:25:47.250 [2024-11-20 01:26:55.261156] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.250 [2024-11-20 01:26:55.261175] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.250 [2024-11-20 01:26:55.261184] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.250 [2024-11-20 01:26:55.261190] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x857440) on tqpair=0x7fe2f0 00:25:47.250 [2024-11-20 01:26:55.261207] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.250 [2024-11-20 01:26:55.261216] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.250 [2024-11-20 01:26:55.261223] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x7fe2f0) 00:25:47.250 [2024-11-20 01:26:55.261234] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.250 [2024-11-20 01:26:55.261264] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x857440, cid 4, qid 0 00:25:47.250 [2024-11-20 01:26:55.261377] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:47.250 [2024-11-20 01:26:55.261389] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:47.250 [2024-11-20 01:26:55.261396] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:47.250 [2024-11-20 01:26:55.261402] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x7fe2f0): datao=0, datal=3072, cccid=4 00:25:47.250 [2024-11-20 01:26:55.261409] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x857440) on tqpair(0x7fe2f0): expected_datao=0, payload_size=3072 00:25:47.250 [2024-11-20 01:26:55.261420] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:47.250 [2024-11-20 01:26:55.261428] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:47.250 [2024-11-20 01:26:55.261439] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.250 [2024-11-20 01:26:55.261449] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.250 [2024-11-20 01:26:55.261455] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.250 [2024-11-20 01:26:55.261461] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x857440) on tqpair=0x7fe2f0 00:25:47.250 [2024-11-20 01:26:55.261476] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.250 [2024-11-20 01:26:55.261484] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.250 [2024-11-20 01:26:55.261490] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x7fe2f0) 00:25:47.250 [2024-11-20 01:26:55.261500] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00010070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.250 [2024-11-20 01:26:55.261528] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x857440, cid 4, qid 0 00:25:47.250 [2024-11-20 01:26:55.261638] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:47.250 [2024-11-20 01:26:55.261652] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:47.250 [2024-11-20 01:26:55.261659] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:47.250 [2024-11-20 01:26:55.261665] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x7fe2f0): datao=0, datal=8, cccid=4 00:25:47.250 [2024-11-20 01:26:55.261673] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x857440) on tqpair(0x7fe2f0): expected_datao=0, payload_size=8 00:25:47.250 [2024-11-20 01:26:55.261688] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:47.250 [2024-11-20 01:26:55.261696] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:47.250 [2024-11-20 01:26:55.306085] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.250 [2024-11-20 01:26:55.306103] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.250 [2024-11-20 01:26:55.306110] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.250 [2024-11-20 01:26:55.306132] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x857440) on tqpair=0x7fe2f0 00:25:47.250 ===================================================== 00:25:47.250 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2014-08.org.nvmexpress.discovery 00:25:47.250 ===================================================== 00:25:47.250 Controller Capabilities/Features 00:25:47.250 ================================ 00:25:47.250 Vendor ID: 0000 00:25:47.250 Subsystem Vendor ID: 0000 00:25:47.250 Serial Number: .................... 00:25:47.250 Model Number: ........................................ 00:25:47.250 Firmware Version: 24.01.1 00:25:47.250 Recommended Arb Burst: 0 00:25:47.250 IEEE OUI Identifier: 00 00 00 00:25:47.250 Multi-path I/O 00:25:47.250 May have multiple subsystem ports: No 00:25:47.250 May have multiple controllers: No 00:25:47.250 Associated with SR-IOV VF: No 00:25:47.250 Max Data Transfer Size: 131072 00:25:47.250 Max Number of Namespaces: 0 00:25:47.250 Max Number of I/O Queues: 1024 00:25:47.250 NVMe Specification Version (VS): 1.3 00:25:47.250 NVMe Specification Version (Identify): 1.3 00:25:47.250 Maximum Queue Entries: 128 00:25:47.250 Contiguous Queues Required: Yes 00:25:47.250 Arbitration Mechanisms Supported 00:25:47.250 Weighted Round Robin: Not Supported 00:25:47.250 Vendor Specific: Not Supported 00:25:47.250 Reset Timeout: 15000 ms 00:25:47.250 Doorbell Stride: 4 bytes 00:25:47.250 NVM Subsystem Reset: Not Supported 00:25:47.250 Command Sets Supported 00:25:47.250 NVM Command Set: Supported 00:25:47.250 Boot Partition: Not Supported 00:25:47.250 Memory Page Size Minimum: 4096 bytes 00:25:47.250 Memory Page Size Maximum: 4096 bytes 00:25:47.250 Persistent Memory Region: Not Supported 00:25:47.250 Optional Asynchronous Events Supported 00:25:47.250 Namespace Attribute Notices: Not Supported 00:25:47.250 Firmware Activation Notices: Not Supported 00:25:47.250 ANA Change Notices: Not Supported 00:25:47.250 PLE Aggregate Log Change Notices: Not Supported 00:25:47.250 LBA Status Info Alert Notices: Not Supported 00:25:47.250 EGE Aggregate Log Change Notices: Not Supported 00:25:47.250 Normal NVM Subsystem Shutdown event: Not Supported 00:25:47.250 Zone Descriptor Change Notices: Not Supported 00:25:47.250 Discovery Log Change Notices: Supported 00:25:47.250 Controller Attributes 00:25:47.250 128-bit Host Identifier: Not Supported 00:25:47.250 Non-Operational Permissive Mode: Not Supported 00:25:47.250 NVM Sets: Not Supported 00:25:47.250 Read Recovery Levels: Not Supported 00:25:47.250 Endurance Groups: Not Supported 00:25:47.250 Predictable Latency Mode: Not Supported 00:25:47.250 Traffic Based Keep ALive: Not Supported 00:25:47.250 Namespace Granularity: Not Supported 00:25:47.250 SQ Associations: Not Supported 00:25:47.250 UUID List: Not Supported 00:25:47.250 Multi-Domain Subsystem: Not Supported 00:25:47.250 Fixed Capacity Management: Not Supported 00:25:47.250 Variable Capacity Management: Not Supported 00:25:47.250 Delete Endurance Group: Not Supported 00:25:47.250 Delete NVM Set: Not Supported 00:25:47.250 Extended LBA Formats Supported: Not Supported 00:25:47.250 Flexible Data Placement Supported: Not Supported 00:25:47.250 00:25:47.250 Controller Memory Buffer Support 00:25:47.250 ================================ 00:25:47.250 Supported: No 00:25:47.250 00:25:47.250 Persistent Memory Region Support 00:25:47.250 ================================ 00:25:47.250 Supported: No 00:25:47.250 00:25:47.250 Admin Command Set Attributes 00:25:47.250 ============================ 00:25:47.250 Security Send/Receive: Not Supported 00:25:47.250 Format NVM: Not Supported 00:25:47.250 Firmware Activate/Download: Not Supported 00:25:47.250 Namespace Management: Not Supported 00:25:47.250 Device Self-Test: Not Supported 00:25:47.250 Directives: Not Supported 00:25:47.250 NVMe-MI: Not Supported 00:25:47.250 Virtualization Management: Not Supported 00:25:47.250 Doorbell Buffer Config: Not Supported 00:25:47.250 Get LBA Status Capability: Not Supported 00:25:47.250 Command & Feature Lockdown Capability: Not Supported 00:25:47.250 Abort Command Limit: 1 00:25:47.250 Async Event Request Limit: 4 00:25:47.250 Number of Firmware Slots: N/A 00:25:47.250 Firmware Slot 1 Read-Only: N/A 00:25:47.250 Firmware Activation Without Reset: N/A 00:25:47.250 Multiple Update Detection Support: N/A 00:25:47.251 Firmware Update Granularity: No Information Provided 00:25:47.251 Per-Namespace SMART Log: No 00:25:47.251 Asymmetric Namespace Access Log Page: Not Supported 00:25:47.251 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:25:47.251 Command Effects Log Page: Not Supported 00:25:47.251 Get Log Page Extended Data: Supported 00:25:47.251 Telemetry Log Pages: Not Supported 00:25:47.251 Persistent Event Log Pages: Not Supported 00:25:47.251 Supported Log Pages Log Page: May Support 00:25:47.251 Commands Supported & Effects Log Page: Not Supported 00:25:47.251 Feature Identifiers & Effects Log Page:May Support 00:25:47.251 NVMe-MI Commands & Effects Log Page: May Support 00:25:47.251 Data Area 4 for Telemetry Log: Not Supported 00:25:47.251 Error Log Page Entries Supported: 128 00:25:47.251 Keep Alive: Not Supported 00:25:47.251 00:25:47.251 NVM Command Set Attributes 00:25:47.251 ========================== 00:25:47.251 Submission Queue Entry Size 00:25:47.251 Max: 1 00:25:47.251 Min: 1 00:25:47.251 Completion Queue Entry Size 00:25:47.251 Max: 1 00:25:47.251 Min: 1 00:25:47.251 Number of Namespaces: 0 00:25:47.251 Compare Command: Not Supported 00:25:47.251 Write Uncorrectable Command: Not Supported 00:25:47.251 Dataset Management Command: Not Supported 00:25:47.251 Write Zeroes Command: Not Supported 00:25:47.251 Set Features Save Field: Not Supported 00:25:47.251 Reservations: Not Supported 00:25:47.251 Timestamp: Not Supported 00:25:47.251 Copy: Not Supported 00:25:47.251 Volatile Write Cache: Not Present 00:25:47.251 Atomic Write Unit (Normal): 1 00:25:47.251 Atomic Write Unit (PFail): 1 00:25:47.251 Atomic Compare & Write Unit: 1 00:25:47.251 Fused Compare & Write: Supported 00:25:47.251 Scatter-Gather List 00:25:47.251 SGL Command Set: Supported 00:25:47.251 SGL Keyed: Supported 00:25:47.251 SGL Bit Bucket Descriptor: Not Supported 00:25:47.251 SGL Metadata Pointer: Not Supported 00:25:47.251 Oversized SGL: Not Supported 00:25:47.251 SGL Metadata Address: Not Supported 00:25:47.251 SGL Offset: Supported 00:25:47.251 Transport SGL Data Block: Not Supported 00:25:47.251 Replay Protected Memory Block: Not Supported 00:25:47.251 00:25:47.251 Firmware Slot Information 00:25:47.251 ========================= 00:25:47.251 Active slot: 0 00:25:47.251 00:25:47.251 00:25:47.251 Error Log 00:25:47.251 ========= 00:25:47.251 00:25:47.251 Active Namespaces 00:25:47.251 ================= 00:25:47.251 Discovery Log Page 00:25:47.251 ================== 00:25:47.251 Generation Counter: 2 00:25:47.251 Number of Records: 2 00:25:47.251 Record Format: 0 00:25:47.251 00:25:47.251 Discovery Log Entry 0 00:25:47.251 ---------------------- 00:25:47.251 Transport Type: 3 (TCP) 00:25:47.251 Address Family: 1 (IPv4) 00:25:47.251 Subsystem Type: 3 (Current Discovery Subsystem) 00:25:47.251 Entry Flags: 00:25:47.251 Duplicate Returned Information: 1 00:25:47.251 Explicit Persistent Connection Support for Discovery: 1 00:25:47.251 Transport Requirements: 00:25:47.251 Secure Channel: Not Required 00:25:47.251 Port ID: 0 (0x0000) 00:25:47.251 Controller ID: 65535 (0xffff) 00:25:47.251 Admin Max SQ Size: 128 00:25:47.251 Transport Service Identifier: 4420 00:25:47.251 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:25:47.251 Transport Address: 10.0.0.2 00:25:47.251 Discovery Log Entry 1 00:25:47.251 ---------------------- 00:25:47.251 Transport Type: 3 (TCP) 00:25:47.251 Address Family: 1 (IPv4) 00:25:47.251 Subsystem Type: 2 (NVM Subsystem) 00:25:47.251 Entry Flags: 00:25:47.251 Duplicate Returned Information: 0 00:25:47.251 Explicit Persistent Connection Support for Discovery: 0 00:25:47.251 Transport Requirements: 00:25:47.251 Secure Channel: Not Required 00:25:47.251 Port ID: 0 (0x0000) 00:25:47.251 Controller ID: 65535 (0xffff) 00:25:47.251 Admin Max SQ Size: 128 00:25:47.251 Transport Service Identifier: 4420 00:25:47.251 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:25:47.251 Transport Address: 10.0.0.2 [2024-11-20 01:26:55.306253] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:25:47.251 [2024-11-20 01:26:55.306279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.251 [2024-11-20 01:26:55.306291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.251 [2024-11-20 01:26:55.306301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.251 [2024-11-20 01:26:55.306310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.251 [2024-11-20 01:26:55.306323] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.251 [2024-11-20 01:26:55.306331] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.251 [2024-11-20 01:26:55.306338] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x7fe2f0) 00:25:47.251 [2024-11-20 01:26:55.306349] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.251 [2024-11-20 01:26:55.306374] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8572e0, cid 3, qid 0 00:25:47.251 [2024-11-20 01:26:55.306467] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.251 [2024-11-20 01:26:55.306481] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.251 [2024-11-20 01:26:55.306488] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.251 [2024-11-20 01:26:55.306495] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8572e0) on tqpair=0x7fe2f0 00:25:47.251 [2024-11-20 01:26:55.306506] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.251 [2024-11-20 01:26:55.306514] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.251 [2024-11-20 01:26:55.306520] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x7fe2f0) 00:25:47.251 [2024-11-20 01:26:55.306531] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.251 [2024-11-20 01:26:55.306557] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8572e0, cid 3, qid 0 00:25:47.251 [2024-11-20 01:26:55.306673] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.251 [2024-11-20 01:26:55.306688] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.251 [2024-11-20 01:26:55.306694] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.251 [2024-11-20 01:26:55.306701] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8572e0) on tqpair=0x7fe2f0 00:25:47.251 [2024-11-20 01:26:55.306708] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:25:47.251 [2024-11-20 01:26:55.306716] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:25:47.251 [2024-11-20 01:26:55.306732] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.251 [2024-11-20 01:26:55.306741] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.251 [2024-11-20 01:26:55.306748] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x7fe2f0) 00:25:47.251 [2024-11-20 01:26:55.306758] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.251 [2024-11-20 01:26:55.306783] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8572e0, cid 3, qid 0 00:25:47.251 [2024-11-20 01:26:55.306875] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.251 [2024-11-20 01:26:55.306889] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.251 [2024-11-20 01:26:55.306896] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.251 [2024-11-20 01:26:55.306902] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8572e0) on tqpair=0x7fe2f0 00:25:47.251 [2024-11-20 01:26:55.306919] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.251 [2024-11-20 01:26:55.306928] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.251 [2024-11-20 01:26:55.306935] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x7fe2f0) 00:25:47.251 [2024-11-20 01:26:55.306945] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.251 [2024-11-20 01:26:55.306965] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8572e0, cid 3, qid 0 00:25:47.251 [2024-11-20 01:26:55.307059] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.251 [2024-11-20 01:26:55.307082] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.251 [2024-11-20 01:26:55.307090] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.251 [2024-11-20 01:26:55.307096] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8572e0) on tqpair=0x7fe2f0 00:25:47.251 [2024-11-20 01:26:55.307112] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.251 [2024-11-20 01:26:55.307122] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.251 [2024-11-20 01:26:55.307128] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x7fe2f0) 00:25:47.251 [2024-11-20 01:26:55.307139] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.251 [2024-11-20 01:26:55.307160] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8572e0, cid 3, qid 0 00:25:47.251 [2024-11-20 01:26:55.307250] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.251 [2024-11-20 01:26:55.307265] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.251 [2024-11-20 01:26:55.307271] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.252 [2024-11-20 01:26:55.307278] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8572e0) on tqpair=0x7fe2f0 00:25:47.252 [2024-11-20 01:26:55.307294] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.252 [2024-11-20 01:26:55.307303] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.252 [2024-11-20 01:26:55.307309] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x7fe2f0) 00:25:47.252 [2024-11-20 01:26:55.307319] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.252 [2024-11-20 01:26:55.307340] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8572e0, cid 3, qid 0 00:25:47.252 [2024-11-20 01:26:55.307426] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.252 [2024-11-20 01:26:55.307441] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.252 [2024-11-20 01:26:55.307447] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.252 [2024-11-20 01:26:55.307454] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8572e0) on tqpair=0x7fe2f0 00:25:47.252 [2024-11-20 01:26:55.307469] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.252 [2024-11-20 01:26:55.307478] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.252 [2024-11-20 01:26:55.307485] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x7fe2f0) 00:25:47.252 [2024-11-20 01:26:55.307495] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.252 [2024-11-20 01:26:55.307515] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8572e0, cid 3, qid 0 00:25:47.252 [2024-11-20 01:26:55.307612] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.252 [2024-11-20 01:26:55.307625] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.252 [2024-11-20 01:26:55.307631] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.252 [2024-11-20 01:26:55.307637] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8572e0) on tqpair=0x7fe2f0 00:25:47.252 [2024-11-20 01:26:55.307653] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.252 [2024-11-20 01:26:55.307662] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.252 [2024-11-20 01:26:55.307668] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x7fe2f0) 00:25:47.252 [2024-11-20 01:26:55.307678] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.252 [2024-11-20 01:26:55.307698] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8572e0, cid 3, qid 0 00:25:47.252 [2024-11-20 01:26:55.307786] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.252 [2024-11-20 01:26:55.307798] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.252 [2024-11-20 01:26:55.307805] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.252 [2024-11-20 01:26:55.307811] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8572e0) on tqpair=0x7fe2f0 00:25:47.252 [2024-11-20 01:26:55.307827] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.252 [2024-11-20 01:26:55.307836] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.252 [2024-11-20 01:26:55.307842] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x7fe2f0) 00:25:47.252 [2024-11-20 01:26:55.307852] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.252 [2024-11-20 01:26:55.307872] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8572e0, cid 3, qid 0 00:25:47.252 [2024-11-20 01:26:55.307965] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.252 [2024-11-20 01:26:55.307979] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.252 [2024-11-20 01:26:55.307986] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.252 [2024-11-20 01:26:55.307992] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8572e0) on tqpair=0x7fe2f0 00:25:47.252 [2024-11-20 01:26:55.308008] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.252 [2024-11-20 01:26:55.308017] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.252 [2024-11-20 01:26:55.308023] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x7fe2f0) 00:25:47.252 [2024-11-20 01:26:55.308033] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.252 [2024-11-20 01:26:55.308054] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8572e0, cid 3, qid 0 00:25:47.252 [2024-11-20 01:26:55.308147] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.252 [2024-11-20 01:26:55.308162] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.252 [2024-11-20 01:26:55.308169] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.252 [2024-11-20 01:26:55.308175] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8572e0) on tqpair=0x7fe2f0 00:25:47.252 [2024-11-20 01:26:55.308191] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.252 [2024-11-20 01:26:55.308200] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.252 [2024-11-20 01:26:55.308206] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x7fe2f0) 00:25:47.252 [2024-11-20 01:26:55.308217] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.252 [2024-11-20 01:26:55.308238] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8572e0, cid 3, qid 0 00:25:47.252 [2024-11-20 01:26:55.308326] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.252 [2024-11-20 01:26:55.308340] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.252 [2024-11-20 01:26:55.308347] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.252 [2024-11-20 01:26:55.308353] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8572e0) on tqpair=0x7fe2f0 00:25:47.252 [2024-11-20 01:26:55.308369] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.252 [2024-11-20 01:26:55.308378] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.252 [2024-11-20 01:26:55.308384] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x7fe2f0) 00:25:47.252 [2024-11-20 01:26:55.308394] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.252 [2024-11-20 01:26:55.308415] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8572e0, cid 3, qid 0 00:25:47.252 [2024-11-20 01:26:55.308501] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.252 [2024-11-20 01:26:55.308513] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.252 [2024-11-20 01:26:55.308519] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.252 [2024-11-20 01:26:55.308526] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8572e0) on tqpair=0x7fe2f0 00:25:47.252 [2024-11-20 01:26:55.308541] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.252 [2024-11-20 01:26:55.308550] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.252 [2024-11-20 01:26:55.308556] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x7fe2f0) 00:25:47.252 [2024-11-20 01:26:55.308566] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.252 [2024-11-20 01:26:55.308586] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8572e0, cid 3, qid 0 00:25:47.252 [2024-11-20 01:26:55.308668] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.252 [2024-11-20 01:26:55.308680] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.252 [2024-11-20 01:26:55.308686] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.252 [2024-11-20 01:26:55.308693] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8572e0) on tqpair=0x7fe2f0 00:25:47.252 [2024-11-20 01:26:55.308708] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.252 [2024-11-20 01:26:55.308717] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.252 [2024-11-20 01:26:55.308723] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x7fe2f0) 00:25:47.252 [2024-11-20 01:26:55.308733] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.252 [2024-11-20 01:26:55.308753] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8572e0, cid 3, qid 0 00:25:47.252 [2024-11-20 01:26:55.308838] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.252 [2024-11-20 01:26:55.308850] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.252 [2024-11-20 01:26:55.308857] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.252 [2024-11-20 01:26:55.308863] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8572e0) on tqpair=0x7fe2f0 00:25:47.252 [2024-11-20 01:26:55.308878] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.252 [2024-11-20 01:26:55.308887] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.252 [2024-11-20 01:26:55.308893] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x7fe2f0) 00:25:47.252 [2024-11-20 01:26:55.308903] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.252 [2024-11-20 01:26:55.308923] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8572e0, cid 3, qid 0 00:25:47.252 [2024-11-20 01:26:55.309013] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.252 [2024-11-20 01:26:55.309031] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.252 [2024-11-20 01:26:55.309038] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.253 [2024-11-20 01:26:55.309044] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8572e0) on tqpair=0x7fe2f0 00:25:47.253 [2024-11-20 01:26:55.309060] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.253 [2024-11-20 01:26:55.309077] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.253 [2024-11-20 01:26:55.309085] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x7fe2f0) 00:25:47.253 [2024-11-20 01:26:55.309095] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.253 [2024-11-20 01:26:55.309116] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8572e0, cid 3, qid 0 00:25:47.253 [2024-11-20 01:26:55.309203] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.253 [2024-11-20 01:26:55.309217] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.253 [2024-11-20 01:26:55.309224] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.253 [2024-11-20 01:26:55.309230] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8572e0) on tqpair=0x7fe2f0 00:25:47.253 [2024-11-20 01:26:55.309246] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.253 [2024-11-20 01:26:55.309255] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.253 [2024-11-20 01:26:55.309261] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x7fe2f0) 00:25:47.253 [2024-11-20 01:26:55.309271] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.253 [2024-11-20 01:26:55.309292] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8572e0, cid 3, qid 0 00:25:47.253 [2024-11-20 01:26:55.309377] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.253 [2024-11-20 01:26:55.309392] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.253 [2024-11-20 01:26:55.309398] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.253 [2024-11-20 01:26:55.309405] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8572e0) on tqpair=0x7fe2f0 00:25:47.253 [2024-11-20 01:26:55.313097] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.253 [2024-11-20 01:26:55.313112] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.253 [2024-11-20 01:26:55.313119] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x7fe2f0) 00:25:47.253 [2024-11-20 01:26:55.313129] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.253 [2024-11-20 01:26:55.313150] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8572e0, cid 3, qid 0 00:25:47.253 [2024-11-20 01:26:55.313267] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.253 [2024-11-20 01:26:55.313280] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.253 [2024-11-20 01:26:55.313287] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.253 [2024-11-20 01:26:55.313293] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8572e0) on tqpair=0x7fe2f0 00:25:47.253 [2024-11-20 01:26:55.313306] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 6 milliseconds 00:25:47.253 00:25:47.253 01:26:55 -- host/identify.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:25:47.253 [2024-11-20 01:26:55.347022] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:47.253 [2024-11-20 01:26:55.347085] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1226394 ] 00:25:47.253 EAL: No free 2048 kB hugepages reported on node 1 00:25:47.253 [2024-11-20 01:26:55.378851] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:25:47.253 [2024-11-20 01:26:55.378901] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:25:47.253 [2024-11-20 01:26:55.378910] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:25:47.253 [2024-11-20 01:26:55.378927] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:25:47.253 [2024-11-20 01:26:55.378938] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:25:47.253 [2024-11-20 01:26:55.382120] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:25:47.253 [2024-11-20 01:26:55.382162] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x15a32f0 0 00:25:47.253 [2024-11-20 01:26:55.390101] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:25:47.253 [2024-11-20 01:26:55.390120] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:25:47.253 [2024-11-20 01:26:55.390127] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:25:47.253 [2024-11-20 01:26:55.390133] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:25:47.253 [2024-11-20 01:26:55.390185] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.253 [2024-11-20 01:26:55.390197] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.253 [2024-11-20 01:26:55.390204] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x15a32f0) 00:25:47.253 [2024-11-20 01:26:55.390218] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:25:47.253 [2024-11-20 01:26:55.390244] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x15fbec0, cid 0, qid 0 00:25:47.253 [2024-11-20 01:26:55.397099] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.253 [2024-11-20 01:26:55.397117] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.253 [2024-11-20 01:26:55.397125] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.253 [2024-11-20 01:26:55.397132] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x15fbec0) on tqpair=0x15a32f0 00:25:47.253 [2024-11-20 01:26:55.397147] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:25:47.253 [2024-11-20 01:26:55.397157] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:25:47.253 [2024-11-20 01:26:55.397166] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:25:47.253 [2024-11-20 01:26:55.397183] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.253 [2024-11-20 01:26:55.397192] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.253 [2024-11-20 01:26:55.397199] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x15a32f0) 00:25:47.253 [2024-11-20 01:26:55.397210] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.253 [2024-11-20 01:26:55.397234] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x15fbec0, cid 0, qid 0 00:25:47.253 [2024-11-20 01:26:55.397364] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.253 [2024-11-20 01:26:55.397379] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.253 [2024-11-20 01:26:55.397386] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.253 [2024-11-20 01:26:55.397392] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x15fbec0) on tqpair=0x15a32f0 00:25:47.253 [2024-11-20 01:26:55.397402] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:25:47.253 [2024-11-20 01:26:55.397419] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:25:47.253 [2024-11-20 01:26:55.397433] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.253 [2024-11-20 01:26:55.397440] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.253 [2024-11-20 01:26:55.397446] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x15a32f0) 00:25:47.253 [2024-11-20 01:26:55.397457] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.253 [2024-11-20 01:26:55.397478] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x15fbec0, cid 0, qid 0 00:25:47.253 [2024-11-20 01:26:55.397622] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.253 [2024-11-20 01:26:55.397636] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.253 [2024-11-20 01:26:55.397643] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.253 [2024-11-20 01:26:55.397649] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x15fbec0) on tqpair=0x15a32f0 00:25:47.253 [2024-11-20 01:26:55.397659] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:25:47.253 [2024-11-20 01:26:55.397672] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:25:47.253 [2024-11-20 01:26:55.397684] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.253 [2024-11-20 01:26:55.397692] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.253 [2024-11-20 01:26:55.397698] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x15a32f0) 00:25:47.253 [2024-11-20 01:26:55.397708] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.253 [2024-11-20 01:26:55.397729] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x15fbec0, cid 0, qid 0 00:25:47.253 [2024-11-20 01:26:55.397870] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.253 [2024-11-20 01:26:55.397882] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.253 [2024-11-20 01:26:55.397888] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.253 [2024-11-20 01:26:55.397895] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x15fbec0) on tqpair=0x15a32f0 00:25:47.253 [2024-11-20 01:26:55.397904] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:25:47.253 [2024-11-20 01:26:55.397920] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.253 [2024-11-20 01:26:55.397929] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.253 [2024-11-20 01:26:55.397935] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x15a32f0) 00:25:47.253 [2024-11-20 01:26:55.397945] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.253 [2024-11-20 01:26:55.397965] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x15fbec0, cid 0, qid 0 00:25:47.253 [2024-11-20 01:26:55.398045] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.253 [2024-11-20 01:26:55.398057] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.253 [2024-11-20 01:26:55.398063] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.253 [2024-11-20 01:26:55.398078] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x15fbec0) on tqpair=0x15a32f0 00:25:47.253 [2024-11-20 01:26:55.398088] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:25:47.253 [2024-11-20 01:26:55.398096] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:25:47.254 [2024-11-20 01:26:55.398109] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:25:47.254 [2024-11-20 01:26:55.398223] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:25:47.254 [2024-11-20 01:26:55.398231] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:25:47.254 [2024-11-20 01:26:55.398243] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.254 [2024-11-20 01:26:55.398251] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.254 [2024-11-20 01:26:55.398257] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x15a32f0) 00:25:47.254 [2024-11-20 01:26:55.398267] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.254 [2024-11-20 01:26:55.398288] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x15fbec0, cid 0, qid 0 00:25:47.254 [2024-11-20 01:26:55.398410] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.254 [2024-11-20 01:26:55.398424] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.254 [2024-11-20 01:26:55.398431] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.254 [2024-11-20 01:26:55.398437] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x15fbec0) on tqpair=0x15a32f0 00:25:47.254 [2024-11-20 01:26:55.398446] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:25:47.254 [2024-11-20 01:26:55.398463] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.254 [2024-11-20 01:26:55.398471] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.254 [2024-11-20 01:26:55.398477] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x15a32f0) 00:25:47.254 [2024-11-20 01:26:55.398487] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.254 [2024-11-20 01:26:55.398508] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x15fbec0, cid 0, qid 0 00:25:47.254 [2024-11-20 01:26:55.398622] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.254 [2024-11-20 01:26:55.398636] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.254 [2024-11-20 01:26:55.398643] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.254 [2024-11-20 01:26:55.398649] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x15fbec0) on tqpair=0x15a32f0 00:25:47.254 [2024-11-20 01:26:55.398658] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:25:47.254 [2024-11-20 01:26:55.398666] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:25:47.254 [2024-11-20 01:26:55.398679] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:25:47.254 [2024-11-20 01:26:55.398693] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:25:47.254 [2024-11-20 01:26:55.398706] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.254 [2024-11-20 01:26:55.398713] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.254 [2024-11-20 01:26:55.398720] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x15a32f0) 00:25:47.254 [2024-11-20 01:26:55.398730] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.254 [2024-11-20 01:26:55.398751] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x15fbec0, cid 0, qid 0 00:25:47.254 [2024-11-20 01:26:55.398883] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:47.254 [2024-11-20 01:26:55.398898] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:47.254 [2024-11-20 01:26:55.398904] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:47.254 [2024-11-20 01:26:55.398914] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x15a32f0): datao=0, datal=4096, cccid=0 00:25:47.254 [2024-11-20 01:26:55.398923] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x15fbec0) on tqpair(0x15a32f0): expected_datao=0, payload_size=4096 00:25:47.254 [2024-11-20 01:26:55.398934] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:47.254 [2024-11-20 01:26:55.398941] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:47.254 [2024-11-20 01:26:55.398981] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.254 [2024-11-20 01:26:55.398993] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.254 [2024-11-20 01:26:55.398999] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.254 [2024-11-20 01:26:55.399005] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x15fbec0) on tqpair=0x15a32f0 00:25:47.254 [2024-11-20 01:26:55.399016] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:25:47.254 [2024-11-20 01:26:55.399024] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:25:47.254 [2024-11-20 01:26:55.399032] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:25:47.254 [2024-11-20 01:26:55.399038] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 16 00:25:47.254 [2024-11-20 01:26:55.399045] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:25:47.254 [2024-11-20 01:26:55.399053] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:25:47.254 [2024-11-20 01:26:55.399078] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:25:47.254 [2024-11-20 01:26:55.399093] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.254 [2024-11-20 01:26:55.399101] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.254 [2024-11-20 01:26:55.399107] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x15a32f0) 00:25:47.254 [2024-11-20 01:26:55.399117] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:25:47.254 [2024-11-20 01:26:55.399139] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x15fbec0, cid 0, qid 0 00:25:47.254 [2024-11-20 01:26:55.399275] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.254 [2024-11-20 01:26:55.399290] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.254 [2024-11-20 01:26:55.399296] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.254 [2024-11-20 01:26:55.399302] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x15fbec0) on tqpair=0x15a32f0 00:25:47.254 [2024-11-20 01:26:55.399314] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.254 [2024-11-20 01:26:55.399321] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.254 [2024-11-20 01:26:55.399327] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x15a32f0) 00:25:47.254 [2024-11-20 01:26:55.399337] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:47.254 [2024-11-20 01:26:55.399346] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.254 [2024-11-20 01:26:55.399353] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.254 [2024-11-20 01:26:55.399359] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x15a32f0) 00:25:47.254 [2024-11-20 01:26:55.399367] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:47.254 [2024-11-20 01:26:55.399376] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.254 [2024-11-20 01:26:55.399383] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.254 [2024-11-20 01:26:55.399393] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x15a32f0) 00:25:47.254 [2024-11-20 01:26:55.399402] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:47.254 [2024-11-20 01:26:55.399411] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.254 [2024-11-20 01:26:55.399418] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.254 [2024-11-20 01:26:55.399424] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x15a32f0) 00:25:47.254 [2024-11-20 01:26:55.399432] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:47.254 [2024-11-20 01:26:55.399441] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:25:47.254 [2024-11-20 01:26:55.399474] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:25:47.254 [2024-11-20 01:26:55.399487] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.254 [2024-11-20 01:26:55.399494] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.254 [2024-11-20 01:26:55.399500] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x15a32f0) 00:25:47.254 [2024-11-20 01:26:55.399510] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.254 [2024-11-20 01:26:55.399532] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x15fbec0, cid 0, qid 0 00:25:47.254 [2024-11-20 01:26:55.399558] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x15fc020, cid 1, qid 0 00:25:47.254 [2024-11-20 01:26:55.399565] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x15fc180, cid 2, qid 0 00:25:47.254 [2024-11-20 01:26:55.399573] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x15fc2e0, cid 3, qid 0 00:25:47.254 [2024-11-20 01:26:55.399580] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x15fc440, cid 4, qid 0 00:25:47.254 [2024-11-20 01:26:55.399757] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.254 [2024-11-20 01:26:55.399769] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.254 [2024-11-20 01:26:55.399776] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.254 [2024-11-20 01:26:55.399782] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x15fc440) on tqpair=0x15a32f0 00:25:47.254 [2024-11-20 01:26:55.399791] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:25:47.254 [2024-11-20 01:26:55.399799] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:25:47.254 [2024-11-20 01:26:55.399813] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:25:47.254 [2024-11-20 01:26:55.399827] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:25:47.254 [2024-11-20 01:26:55.399839] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.254 [2024-11-20 01:26:55.399846] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.254 [2024-11-20 01:26:55.399867] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x15a32f0) 00:25:47.254 [2024-11-20 01:26:55.399878] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:4 cdw10:00000007 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:25:47.255 [2024-11-20 01:26:55.399898] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x15fc440, cid 4, qid 0 00:25:47.255 [2024-11-20 01:26:55.400039] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.255 [2024-11-20 01:26:55.400054] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.255 [2024-11-20 01:26:55.400064] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.255 [2024-11-20 01:26:55.400079] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x15fc440) on tqpair=0x15a32f0 00:25:47.255 [2024-11-20 01:26:55.400146] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:25:47.255 [2024-11-20 01:26:55.400164] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:25:47.255 [2024-11-20 01:26:55.400177] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.255 [2024-11-20 01:26:55.400185] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.255 [2024-11-20 01:26:55.400191] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x15a32f0) 00:25:47.255 [2024-11-20 01:26:55.400201] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.255 [2024-11-20 01:26:55.400222] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x15fc440, cid 4, qid 0 00:25:47.255 [2024-11-20 01:26:55.400362] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:47.255 [2024-11-20 01:26:55.400377] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:47.255 [2024-11-20 01:26:55.400384] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:47.255 [2024-11-20 01:26:55.400390] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x15a32f0): datao=0, datal=4096, cccid=4 00:25:47.255 [2024-11-20 01:26:55.400397] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x15fc440) on tqpair(0x15a32f0): expected_datao=0, payload_size=4096 00:25:47.255 [2024-11-20 01:26:55.400407] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:47.255 [2024-11-20 01:26:55.400414] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:47.255 [2024-11-20 01:26:55.400439] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.255 [2024-11-20 01:26:55.400452] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.255 [2024-11-20 01:26:55.400458] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.255 [2024-11-20 01:26:55.400464] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x15fc440) on tqpair=0x15a32f0 00:25:47.255 [2024-11-20 01:26:55.400485] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:25:47.255 [2024-11-20 01:26:55.400500] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:25:47.255 [2024-11-20 01:26:55.400517] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:25:47.255 [2024-11-20 01:26:55.400531] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.255 [2024-11-20 01:26:55.400538] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.255 [2024-11-20 01:26:55.400544] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x15a32f0) 00:25:47.255 [2024-11-20 01:26:55.400554] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000000 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.255 [2024-11-20 01:26:55.400575] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x15fc440, cid 4, qid 0 00:25:47.255 [2024-11-20 01:26:55.400714] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:47.255 [2024-11-20 01:26:55.400726] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:47.255 [2024-11-20 01:26:55.400732] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:47.255 [2024-11-20 01:26:55.400738] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x15a32f0): datao=0, datal=4096, cccid=4 00:25:47.255 [2024-11-20 01:26:55.400746] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x15fc440) on tqpair(0x15a32f0): expected_datao=0, payload_size=4096 00:25:47.255 [2024-11-20 01:26:55.400756] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:47.255 [2024-11-20 01:26:55.400767] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:47.255 [2024-11-20 01:26:55.400779] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.255 [2024-11-20 01:26:55.400789] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.255 [2024-11-20 01:26:55.400795] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.255 [2024-11-20 01:26:55.400801] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x15fc440) on tqpair=0x15a32f0 00:25:47.255 [2024-11-20 01:26:55.400824] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:25:47.255 [2024-11-20 01:26:55.400842] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:25:47.255 [2024-11-20 01:26:55.400856] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.255 [2024-11-20 01:26:55.400863] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.255 [2024-11-20 01:26:55.400869] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x15a32f0) 00:25:47.255 [2024-11-20 01:26:55.400879] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.255 [2024-11-20 01:26:55.400899] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x15fc440, cid 4, qid 0 00:25:47.255 [2024-11-20 01:26:55.401040] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:47.255 [2024-11-20 01:26:55.401054] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:47.255 [2024-11-20 01:26:55.401061] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:47.255 [2024-11-20 01:26:55.401067] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x15a32f0): datao=0, datal=4096, cccid=4 00:25:47.255 [2024-11-20 01:26:55.405089] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x15fc440) on tqpair(0x15a32f0): expected_datao=0, payload_size=4096 00:25:47.255 [2024-11-20 01:26:55.405102] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:47.255 [2024-11-20 01:26:55.405109] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:47.255 [2024-11-20 01:26:55.405121] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.255 [2024-11-20 01:26:55.405130] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.255 [2024-11-20 01:26:55.405136] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.255 [2024-11-20 01:26:55.405142] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x15fc440) on tqpair=0x15a32f0 00:25:47.255 [2024-11-20 01:26:55.405156] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:25:47.255 [2024-11-20 01:26:55.405170] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:25:47.255 [2024-11-20 01:26:55.405202] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:25:47.255 [2024-11-20 01:26:55.405213] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:25:47.255 [2024-11-20 01:26:55.405222] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:25:47.255 [2024-11-20 01:26:55.405229] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:25:47.255 [2024-11-20 01:26:55.405237] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:25:47.255 [2024-11-20 01:26:55.405245] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:25:47.255 [2024-11-20 01:26:55.405264] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.255 [2024-11-20 01:26:55.405276] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.255 [2024-11-20 01:26:55.405283] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x15a32f0) 00:25:47.255 [2024-11-20 01:26:55.405293] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:4 cdw10:00000001 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.255 [2024-11-20 01:26:55.405304] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.255 [2024-11-20 01:26:55.405311] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.255 [2024-11-20 01:26:55.405317] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x15a32f0) 00:25:47.255 [2024-11-20 01:26:55.405325] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:25:47.255 [2024-11-20 01:26:55.405351] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x15fc440, cid 4, qid 0 00:25:47.255 [2024-11-20 01:26:55.405364] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x15fc5a0, cid 5, qid 0 00:25:47.255 [2024-11-20 01:26:55.405516] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.255 [2024-11-20 01:26:55.405531] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.255 [2024-11-20 01:26:55.405538] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.255 [2024-11-20 01:26:55.405544] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x15fc440) on tqpair=0x15a32f0 00:25:47.255 [2024-11-20 01:26:55.405558] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.255 [2024-11-20 01:26:55.405567] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.255 [2024-11-20 01:26:55.405573] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.255 [2024-11-20 01:26:55.405579] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x15fc5a0) on tqpair=0x15a32f0 00:25:47.255 [2024-11-20 01:26:55.405597] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.255 [2024-11-20 01:26:55.405606] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.255 [2024-11-20 01:26:55.405612] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x15a32f0) 00:25:47.255 [2024-11-20 01:26:55.405622] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:5 cdw10:00000002 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.255 [2024-11-20 01:26:55.405643] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x15fc5a0, cid 5, qid 0 00:25:47.255 [2024-11-20 01:26:55.405776] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.255 [2024-11-20 01:26:55.405790] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.255 [2024-11-20 01:26:55.405796] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.255 [2024-11-20 01:26:55.405803] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x15fc5a0) on tqpair=0x15a32f0 00:25:47.255 [2024-11-20 01:26:55.405820] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.255 [2024-11-20 01:26:55.405828] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.255 [2024-11-20 01:26:55.405834] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x15a32f0) 00:25:47.255 [2024-11-20 01:26:55.405844] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:5 cdw10:00000004 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.255 [2024-11-20 01:26:55.405865] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x15fc5a0, cid 5, qid 0 00:25:47.255 [2024-11-20 01:26:55.405981] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.256 [2024-11-20 01:26:55.405994] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.256 [2024-11-20 01:26:55.406000] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.256 [2024-11-20 01:26:55.406006] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x15fc5a0) on tqpair=0x15a32f0 00:25:47.256 [2024-11-20 01:26:55.406023] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.256 [2024-11-20 01:26:55.406031] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.256 [2024-11-20 01:26:55.406041] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x15a32f0) 00:25:47.256 [2024-11-20 01:26:55.406052] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:5 cdw10:00000007 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.256 [2024-11-20 01:26:55.406080] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x15fc5a0, cid 5, qid 0 00:25:47.256 [2024-11-20 01:26:55.406164] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.256 [2024-11-20 01:26:55.406178] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.256 [2024-11-20 01:26:55.406185] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.256 [2024-11-20 01:26:55.406191] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x15fc5a0) on tqpair=0x15a32f0 00:25:47.256 [2024-11-20 01:26:55.406211] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.256 [2024-11-20 01:26:55.406221] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.256 [2024-11-20 01:26:55.406227] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x15a32f0) 00:25:47.256 [2024-11-20 01:26:55.406237] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.256 [2024-11-20 01:26:55.406248] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.256 [2024-11-20 01:26:55.406255] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.256 [2024-11-20 01:26:55.406261] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x15a32f0) 00:25:47.256 [2024-11-20 01:26:55.406270] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.256 [2024-11-20 01:26:55.406281] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.256 [2024-11-20 01:26:55.406288] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.256 [2024-11-20 01:26:55.406294] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=6 on tqpair(0x15a32f0) 00:25:47.256 [2024-11-20 01:26:55.406303] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.256 [2024-11-20 01:26:55.406314] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.256 [2024-11-20 01:26:55.406321] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.256 [2024-11-20 01:26:55.406327] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x15a32f0) 00:25:47.256 [2024-11-20 01:26:55.406336] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.256 [2024-11-20 01:26:55.406372] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x15fc5a0, cid 5, qid 0 00:25:47.256 [2024-11-20 01:26:55.406384] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x15fc440, cid 4, qid 0 00:25:47.256 [2024-11-20 01:26:55.406391] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x15fc700, cid 6, qid 0 00:25:47.256 [2024-11-20 01:26:55.406398] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x15fc860, cid 7, qid 0 00:25:47.256 [2024-11-20 01:26:55.406660] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:47.256 [2024-11-20 01:26:55.406676] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:47.256 [2024-11-20 01:26:55.406682] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:47.256 [2024-11-20 01:26:55.406688] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x15a32f0): datao=0, datal=8192, cccid=5 00:25:47.256 [2024-11-20 01:26:55.406696] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x15fc5a0) on tqpair(0x15a32f0): expected_datao=0, payload_size=8192 00:25:47.256 [2024-11-20 01:26:55.406706] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:47.256 [2024-11-20 01:26:55.406718] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:47.256 [2024-11-20 01:26:55.406727] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:47.256 [2024-11-20 01:26:55.406736] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:47.256 [2024-11-20 01:26:55.406742] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:47.256 [2024-11-20 01:26:55.406748] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x15a32f0): datao=0, datal=512, cccid=4 00:25:47.256 [2024-11-20 01:26:55.406755] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x15fc440) on tqpair(0x15a32f0): expected_datao=0, payload_size=512 00:25:47.256 [2024-11-20 01:26:55.406765] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:47.256 [2024-11-20 01:26:55.406772] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:47.256 [2024-11-20 01:26:55.406780] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:47.256 [2024-11-20 01:26:55.406788] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:47.256 [2024-11-20 01:26:55.406794] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:47.256 [2024-11-20 01:26:55.406800] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x15a32f0): datao=0, datal=512, cccid=6 00:25:47.256 [2024-11-20 01:26:55.406807] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x15fc700) on tqpair(0x15a32f0): expected_datao=0, payload_size=512 00:25:47.256 [2024-11-20 01:26:55.406817] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:47.256 [2024-11-20 01:26:55.406824] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:47.256 [2024-11-20 01:26:55.406832] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:47.256 [2024-11-20 01:26:55.406840] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:47.256 [2024-11-20 01:26:55.406846] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:47.256 [2024-11-20 01:26:55.406852] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x15a32f0): datao=0, datal=4096, cccid=7 00:25:47.256 [2024-11-20 01:26:55.406859] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x15fc860) on tqpair(0x15a32f0): expected_datao=0, payload_size=4096 00:25:47.256 [2024-11-20 01:26:55.406878] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:47.256 [2024-11-20 01:26:55.406886] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:47.256 [2024-11-20 01:26:55.406897] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.256 [2024-11-20 01:26:55.406907] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.256 [2024-11-20 01:26:55.406913] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.256 [2024-11-20 01:26:55.406919] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x15fc5a0) on tqpair=0x15a32f0 00:25:47.256 [2024-11-20 01:26:55.406940] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.256 [2024-11-20 01:26:55.406951] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.256 [2024-11-20 01:26:55.406972] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.256 [2024-11-20 01:26:55.406978] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x15fc440) on tqpair=0x15a32f0 00:25:47.256 [2024-11-20 01:26:55.406992] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.256 [2024-11-20 01:26:55.407002] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.256 [2024-11-20 01:26:55.407008] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.256 [2024-11-20 01:26:55.407014] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x15fc700) on tqpair=0x15a32f0 00:25:47.256 [2024-11-20 01:26:55.407025] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.256 [2024-11-20 01:26:55.407034] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.256 [2024-11-20 01:26:55.407040] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.256 [2024-11-20 01:26:55.407046] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x15fc860) on tqpair=0x15a32f0 00:25:47.256 ===================================================== 00:25:47.256 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:47.256 ===================================================== 00:25:47.256 Controller Capabilities/Features 00:25:47.256 ================================ 00:25:47.256 Vendor ID: 8086 00:25:47.256 Subsystem Vendor ID: 8086 00:25:47.256 Serial Number: SPDK00000000000001 00:25:47.256 Model Number: SPDK bdev Controller 00:25:47.256 Firmware Version: 24.01.1 00:25:47.256 Recommended Arb Burst: 6 00:25:47.256 IEEE OUI Identifier: e4 d2 5c 00:25:47.256 Multi-path I/O 00:25:47.256 May have multiple subsystem ports: Yes 00:25:47.256 May have multiple controllers: Yes 00:25:47.256 Associated with SR-IOV VF: No 00:25:47.256 Max Data Transfer Size: 131072 00:25:47.256 Max Number of Namespaces: 32 00:25:47.256 Max Number of I/O Queues: 127 00:25:47.256 NVMe Specification Version (VS): 1.3 00:25:47.256 NVMe Specification Version (Identify): 1.3 00:25:47.256 Maximum Queue Entries: 128 00:25:47.256 Contiguous Queues Required: Yes 00:25:47.256 Arbitration Mechanisms Supported 00:25:47.256 Weighted Round Robin: Not Supported 00:25:47.256 Vendor Specific: Not Supported 00:25:47.256 Reset Timeout: 15000 ms 00:25:47.256 Doorbell Stride: 4 bytes 00:25:47.256 NVM Subsystem Reset: Not Supported 00:25:47.256 Command Sets Supported 00:25:47.256 NVM Command Set: Supported 00:25:47.256 Boot Partition: Not Supported 00:25:47.256 Memory Page Size Minimum: 4096 bytes 00:25:47.256 Memory Page Size Maximum: 4096 bytes 00:25:47.256 Persistent Memory Region: Not Supported 00:25:47.256 Optional Asynchronous Events Supported 00:25:47.256 Namespace Attribute Notices: Supported 00:25:47.256 Firmware Activation Notices: Not Supported 00:25:47.256 ANA Change Notices: Not Supported 00:25:47.256 PLE Aggregate Log Change Notices: Not Supported 00:25:47.256 LBA Status Info Alert Notices: Not Supported 00:25:47.256 EGE Aggregate Log Change Notices: Not Supported 00:25:47.256 Normal NVM Subsystem Shutdown event: Not Supported 00:25:47.256 Zone Descriptor Change Notices: Not Supported 00:25:47.256 Discovery Log Change Notices: Not Supported 00:25:47.256 Controller Attributes 00:25:47.256 128-bit Host Identifier: Supported 00:25:47.256 Non-Operational Permissive Mode: Not Supported 00:25:47.256 NVM Sets: Not Supported 00:25:47.256 Read Recovery Levels: Not Supported 00:25:47.257 Endurance Groups: Not Supported 00:25:47.257 Predictable Latency Mode: Not Supported 00:25:47.257 Traffic Based Keep ALive: Not Supported 00:25:47.257 Namespace Granularity: Not Supported 00:25:47.257 SQ Associations: Not Supported 00:25:47.257 UUID List: Not Supported 00:25:47.257 Multi-Domain Subsystem: Not Supported 00:25:47.257 Fixed Capacity Management: Not Supported 00:25:47.257 Variable Capacity Management: Not Supported 00:25:47.257 Delete Endurance Group: Not Supported 00:25:47.257 Delete NVM Set: Not Supported 00:25:47.257 Extended LBA Formats Supported: Not Supported 00:25:47.257 Flexible Data Placement Supported: Not Supported 00:25:47.257 00:25:47.257 Controller Memory Buffer Support 00:25:47.257 ================================ 00:25:47.257 Supported: No 00:25:47.257 00:25:47.257 Persistent Memory Region Support 00:25:47.257 ================================ 00:25:47.257 Supported: No 00:25:47.257 00:25:47.257 Admin Command Set Attributes 00:25:47.257 ============================ 00:25:47.257 Security Send/Receive: Not Supported 00:25:47.257 Format NVM: Not Supported 00:25:47.257 Firmware Activate/Download: Not Supported 00:25:47.257 Namespace Management: Not Supported 00:25:47.257 Device Self-Test: Not Supported 00:25:47.257 Directives: Not Supported 00:25:47.257 NVMe-MI: Not Supported 00:25:47.257 Virtualization Management: Not Supported 00:25:47.257 Doorbell Buffer Config: Not Supported 00:25:47.257 Get LBA Status Capability: Not Supported 00:25:47.257 Command & Feature Lockdown Capability: Not Supported 00:25:47.257 Abort Command Limit: 4 00:25:47.257 Async Event Request Limit: 4 00:25:47.257 Number of Firmware Slots: N/A 00:25:47.257 Firmware Slot 1 Read-Only: N/A 00:25:47.257 Firmware Activation Without Reset: N/A 00:25:47.257 Multiple Update Detection Support: N/A 00:25:47.257 Firmware Update Granularity: No Information Provided 00:25:47.257 Per-Namespace SMART Log: No 00:25:47.257 Asymmetric Namespace Access Log Page: Not Supported 00:25:47.257 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:25:47.257 Command Effects Log Page: Supported 00:25:47.257 Get Log Page Extended Data: Supported 00:25:47.257 Telemetry Log Pages: Not Supported 00:25:47.257 Persistent Event Log Pages: Not Supported 00:25:47.257 Supported Log Pages Log Page: May Support 00:25:47.257 Commands Supported & Effects Log Page: Not Supported 00:25:47.257 Feature Identifiers & Effects Log Page:May Support 00:25:47.257 NVMe-MI Commands & Effects Log Page: May Support 00:25:47.257 Data Area 4 for Telemetry Log: Not Supported 00:25:47.257 Error Log Page Entries Supported: 128 00:25:47.257 Keep Alive: Supported 00:25:47.257 Keep Alive Granularity: 10000 ms 00:25:47.257 00:25:47.257 NVM Command Set Attributes 00:25:47.257 ========================== 00:25:47.257 Submission Queue Entry Size 00:25:47.257 Max: 64 00:25:47.257 Min: 64 00:25:47.257 Completion Queue Entry Size 00:25:47.257 Max: 16 00:25:47.257 Min: 16 00:25:47.257 Number of Namespaces: 32 00:25:47.257 Compare Command: Supported 00:25:47.257 Write Uncorrectable Command: Not Supported 00:25:47.257 Dataset Management Command: Supported 00:25:47.257 Write Zeroes Command: Supported 00:25:47.257 Set Features Save Field: Not Supported 00:25:47.257 Reservations: Supported 00:25:47.257 Timestamp: Not Supported 00:25:47.257 Copy: Supported 00:25:47.257 Volatile Write Cache: Present 00:25:47.257 Atomic Write Unit (Normal): 1 00:25:47.257 Atomic Write Unit (PFail): 1 00:25:47.257 Atomic Compare & Write Unit: 1 00:25:47.257 Fused Compare & Write: Supported 00:25:47.257 Scatter-Gather List 00:25:47.257 SGL Command Set: Supported 00:25:47.257 SGL Keyed: Supported 00:25:47.257 SGL Bit Bucket Descriptor: Not Supported 00:25:47.257 SGL Metadata Pointer: Not Supported 00:25:47.257 Oversized SGL: Not Supported 00:25:47.257 SGL Metadata Address: Not Supported 00:25:47.257 SGL Offset: Supported 00:25:47.257 Transport SGL Data Block: Not Supported 00:25:47.257 Replay Protected Memory Block: Not Supported 00:25:47.257 00:25:47.257 Firmware Slot Information 00:25:47.257 ========================= 00:25:47.257 Active slot: 1 00:25:47.257 Slot 1 Firmware Revision: 24.01.1 00:25:47.257 00:25:47.257 00:25:47.257 Commands Supported and Effects 00:25:47.257 ============================== 00:25:47.257 Admin Commands 00:25:47.257 -------------- 00:25:47.257 Get Log Page (02h): Supported 00:25:47.257 Identify (06h): Supported 00:25:47.257 Abort (08h): Supported 00:25:47.257 Set Features (09h): Supported 00:25:47.257 Get Features (0Ah): Supported 00:25:47.257 Asynchronous Event Request (0Ch): Supported 00:25:47.257 Keep Alive (18h): Supported 00:25:47.257 I/O Commands 00:25:47.257 ------------ 00:25:47.257 Flush (00h): Supported LBA-Change 00:25:47.257 Write (01h): Supported LBA-Change 00:25:47.257 Read (02h): Supported 00:25:47.257 Compare (05h): Supported 00:25:47.257 Write Zeroes (08h): Supported LBA-Change 00:25:47.257 Dataset Management (09h): Supported LBA-Change 00:25:47.257 Copy (19h): Supported LBA-Change 00:25:47.257 Unknown (79h): Supported LBA-Change 00:25:47.257 Unknown (7Ah): Supported 00:25:47.257 00:25:47.257 Error Log 00:25:47.257 ========= 00:25:47.257 00:25:47.257 Arbitration 00:25:47.257 =========== 00:25:47.257 Arbitration Burst: 1 00:25:47.257 00:25:47.257 Power Management 00:25:47.257 ================ 00:25:47.257 Number of Power States: 1 00:25:47.257 Current Power State: Power State #0 00:25:47.257 Power State #0: 00:25:47.257 Max Power: 0.00 W 00:25:47.257 Non-Operational State: Operational 00:25:47.257 Entry Latency: Not Reported 00:25:47.257 Exit Latency: Not Reported 00:25:47.257 Relative Read Throughput: 0 00:25:47.257 Relative Read Latency: 0 00:25:47.257 Relative Write Throughput: 0 00:25:47.257 Relative Write Latency: 0 00:25:47.257 Idle Power: Not Reported 00:25:47.257 Active Power: Not Reported 00:25:47.257 Non-Operational Permissive Mode: Not Supported 00:25:47.257 00:25:47.257 Health Information 00:25:47.257 ================== 00:25:47.257 Critical Warnings: 00:25:47.257 Available Spare Space: OK 00:25:47.257 Temperature: OK 00:25:47.257 Device Reliability: OK 00:25:47.257 Read Only: No 00:25:47.257 Volatile Memory Backup: OK 00:25:47.257 Current Temperature: 0 Kelvin (-273 Celsius) 00:25:47.257 Temperature Threshold: [2024-11-20 01:26:55.407195] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.257 [2024-11-20 01:26:55.407210] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.257 [2024-11-20 01:26:55.407217] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x15a32f0) 00:25:47.257 [2024-11-20 01:26:55.407228] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.257 [2024-11-20 01:26:55.407250] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x15fc860, cid 7, qid 0 00:25:47.257 [2024-11-20 01:26:55.407376] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.257 [2024-11-20 01:26:55.407390] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.257 [2024-11-20 01:26:55.407397] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.257 [2024-11-20 01:26:55.407403] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x15fc860) on tqpair=0x15a32f0 00:25:47.257 [2024-11-20 01:26:55.407446] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:25:47.257 [2024-11-20 01:26:55.407468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.257 [2024-11-20 01:26:55.407480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.257 [2024-11-20 01:26:55.407489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.258 [2024-11-20 01:26:55.407499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.258 [2024-11-20 01:26:55.407511] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.258 [2024-11-20 01:26:55.407519] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.258 [2024-11-20 01:26:55.407525] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x15a32f0) 00:25:47.258 [2024-11-20 01:26:55.407535] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.258 [2024-11-20 01:26:55.407557] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x15fc2e0, cid 3, qid 0 00:25:47.258 [2024-11-20 01:26:55.407689] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.258 [2024-11-20 01:26:55.407703] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.258 [2024-11-20 01:26:55.407710] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.258 [2024-11-20 01:26:55.407716] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x15fc2e0) on tqpair=0x15a32f0 00:25:47.258 [2024-11-20 01:26:55.407728] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.258 [2024-11-20 01:26:55.407736] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.258 [2024-11-20 01:26:55.407742] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x15a32f0) 00:25:47.258 [2024-11-20 01:26:55.407752] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.258 [2024-11-20 01:26:55.407778] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x15fc2e0, cid 3, qid 0 00:25:47.258 [2024-11-20 01:26:55.407887] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.258 [2024-11-20 01:26:55.407899] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.258 [2024-11-20 01:26:55.407906] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.258 [2024-11-20 01:26:55.407912] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x15fc2e0) on tqpair=0x15a32f0 00:25:47.258 [2024-11-20 01:26:55.407921] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:25:47.258 [2024-11-20 01:26:55.407928] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:25:47.258 [2024-11-20 01:26:55.407943] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.258 [2024-11-20 01:26:55.407955] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.258 [2024-11-20 01:26:55.407963] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x15a32f0) 00:25:47.258 [2024-11-20 01:26:55.407973] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.258 [2024-11-20 01:26:55.407993] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x15fc2e0, cid 3, qid 0 00:25:47.258 [2024-11-20 01:26:55.408093] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.258 [2024-11-20 01:26:55.408108] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.258 [2024-11-20 01:26:55.408115] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.258 [2024-11-20 01:26:55.408121] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x15fc2e0) on tqpair=0x15a32f0 00:25:47.258 [2024-11-20 01:26:55.408139] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.258 [2024-11-20 01:26:55.408148] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.258 [2024-11-20 01:26:55.408154] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x15a32f0) 00:25:47.258 [2024-11-20 01:26:55.408164] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.258 [2024-11-20 01:26:55.408185] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x15fc2e0, cid 3, qid 0 00:25:47.258 [2024-11-20 01:26:55.408270] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.258 [2024-11-20 01:26:55.408284] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.258 [2024-11-20 01:26:55.408291] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.258 [2024-11-20 01:26:55.408297] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x15fc2e0) on tqpair=0x15a32f0 00:25:47.258 [2024-11-20 01:26:55.408315] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.258 [2024-11-20 01:26:55.408323] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.258 [2024-11-20 01:26:55.408329] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x15a32f0) 00:25:47.258 [2024-11-20 01:26:55.408339] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.258 [2024-11-20 01:26:55.408359] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x15fc2e0, cid 3, qid 0 00:25:47.258 [2024-11-20 01:26:55.408445] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.258 [2024-11-20 01:26:55.408459] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.258 [2024-11-20 01:26:55.408466] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.258 [2024-11-20 01:26:55.408472] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x15fc2e0) on tqpair=0x15a32f0 00:25:47.258 [2024-11-20 01:26:55.408489] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.258 [2024-11-20 01:26:55.408498] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.258 [2024-11-20 01:26:55.408504] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x15a32f0) 00:25:47.258 [2024-11-20 01:26:55.408514] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.258 [2024-11-20 01:26:55.408535] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x15fc2e0, cid 3, qid 0 00:25:47.258 [2024-11-20 01:26:55.408646] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.258 [2024-11-20 01:26:55.408660] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.258 [2024-11-20 01:26:55.408666] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.258 [2024-11-20 01:26:55.408672] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x15fc2e0) on tqpair=0x15a32f0 00:25:47.258 [2024-11-20 01:26:55.408690] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.258 [2024-11-20 01:26:55.408699] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.258 [2024-11-20 01:26:55.408709] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x15a32f0) 00:25:47.258 [2024-11-20 01:26:55.408719] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.258 [2024-11-20 01:26:55.408740] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x15fc2e0, cid 3, qid 0 00:25:47.258 [2024-11-20 01:26:55.408848] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.258 [2024-11-20 01:26:55.408862] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.258 [2024-11-20 01:26:55.408868] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.258 [2024-11-20 01:26:55.408874] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x15fc2e0) on tqpair=0x15a32f0 00:25:47.258 [2024-11-20 01:26:55.408892] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.258 [2024-11-20 01:26:55.408900] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.258 [2024-11-20 01:26:55.408907] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x15a32f0) 00:25:47.258 [2024-11-20 01:26:55.408917] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.258 [2024-11-20 01:26:55.408937] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x15fc2e0, cid 3, qid 0 00:25:47.258 [2024-11-20 01:26:55.409012] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.258 [2024-11-20 01:26:55.409026] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.258 [2024-11-20 01:26:55.409033] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.258 [2024-11-20 01:26:55.409039] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x15fc2e0) on tqpair=0x15a32f0 00:25:47.258 [2024-11-20 01:26:55.409056] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:47.258 [2024-11-20 01:26:55.409065] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:47.258 [2024-11-20 01:26:55.413084] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x15a32f0) 00:25:47.258 [2024-11-20 01:26:55.413098] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.258 [2024-11-20 01:26:55.413136] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x15fc2e0, cid 3, qid 0 00:25:47.258 [2024-11-20 01:26:55.413275] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:47.258 [2024-11-20 01:26:55.413287] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:47.258 [2024-11-20 01:26:55.413294] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:47.258 [2024-11-20 01:26:55.413300] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x15fc2e0) on tqpair=0x15a32f0 00:25:47.258 [2024-11-20 01:26:55.413314] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 5 milliseconds 00:25:47.258 0 Kelvin (-273 Celsius) 00:25:47.258 Available Spare: 0% 00:25:47.258 Available Spare Threshold: 0% 00:25:47.258 Life Percentage Used: 0% 00:25:47.258 Data Units Read: 0 00:25:47.258 Data Units Written: 0 00:25:47.258 Host Read Commands: 0 00:25:47.258 Host Write Commands: 0 00:25:47.258 Controller Busy Time: 0 minutes 00:25:47.258 Power Cycles: 0 00:25:47.258 Power On Hours: 0 hours 00:25:47.258 Unsafe Shutdowns: 0 00:25:47.258 Unrecoverable Media Errors: 0 00:25:47.258 Lifetime Error Log Entries: 0 00:25:47.258 Warning Temperature Time: 0 minutes 00:25:47.258 Critical Temperature Time: 0 minutes 00:25:47.258 00:25:47.258 Number of Queues 00:25:47.258 ================ 00:25:47.258 Number of I/O Submission Queues: 127 00:25:47.258 Number of I/O Completion Queues: 127 00:25:47.258 00:25:47.258 Active Namespaces 00:25:47.258 ================= 00:25:47.258 Namespace ID:1 00:25:47.258 Error Recovery Timeout: Unlimited 00:25:47.258 Command Set Identifier: NVM (00h) 00:25:47.258 Deallocate: Supported 00:25:47.258 Deallocated/Unwritten Error: Not Supported 00:25:47.258 Deallocated Read Value: Unknown 00:25:47.258 Deallocate in Write Zeroes: Not Supported 00:25:47.258 Deallocated Guard Field: 0xFFFF 00:25:47.258 Flush: Supported 00:25:47.258 Reservation: Supported 00:25:47.258 Namespace Sharing Capabilities: Multiple Controllers 00:25:47.258 Size (in LBAs): 131072 (0GiB) 00:25:47.258 Capacity (in LBAs): 131072 (0GiB) 00:25:47.258 Utilization (in LBAs): 131072 (0GiB) 00:25:47.258 NGUID: ABCDEF0123456789ABCDEF0123456789 00:25:47.258 EUI64: ABCDEF0123456789 00:25:47.258 UUID: 24850f11-7e85-4105-b8c0-031db7123cfd 00:25:47.259 Thin Provisioning: Not Supported 00:25:47.259 Per-NS Atomic Units: Yes 00:25:47.259 Atomic Boundary Size (Normal): 0 00:25:47.259 Atomic Boundary Size (PFail): 0 00:25:47.259 Atomic Boundary Offset: 0 00:25:47.259 Maximum Single Source Range Length: 65535 00:25:47.259 Maximum Copy Length: 65535 00:25:47.259 Maximum Source Range Count: 1 00:25:47.259 NGUID/EUI64 Never Reused: No 00:25:47.259 Namespace Write Protected: No 00:25:47.259 Number of LBA Formats: 1 00:25:47.259 Current LBA Format: LBA Format #00 00:25:47.259 LBA Format #00: Data Size: 512 Metadata Size: 0 00:25:47.259 00:25:47.259 01:26:55 -- host/identify.sh@51 -- # sync 00:25:47.259 01:26:55 -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:47.259 01:26:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:47.259 01:26:55 -- common/autotest_common.sh@10 -- # set +x 00:25:47.259 01:26:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:47.259 01:26:55 -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:25:47.259 01:26:55 -- host/identify.sh@56 -- # nvmftestfini 00:25:47.259 01:26:55 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:47.259 01:26:55 -- nvmf/common.sh@116 -- # sync 00:25:47.259 01:26:55 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:47.259 01:26:55 -- nvmf/common.sh@119 -- # set +e 00:25:47.259 01:26:55 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:47.259 01:26:55 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:47.259 rmmod nvme_tcp 00:25:47.519 rmmod nvme_fabrics 00:25:47.519 rmmod nvme_keyring 00:25:47.519 01:26:55 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:47.519 01:26:55 -- nvmf/common.sh@123 -- # set -e 00:25:47.519 01:26:55 -- nvmf/common.sh@124 -- # return 0 00:25:47.519 01:26:55 -- nvmf/common.sh@477 -- # '[' -n 1226233 ']' 00:25:47.519 01:26:55 -- nvmf/common.sh@478 -- # killprocess 1226233 00:25:47.519 01:26:55 -- common/autotest_common.sh@936 -- # '[' -z 1226233 ']' 00:25:47.519 01:26:55 -- common/autotest_common.sh@940 -- # kill -0 1226233 00:25:47.519 01:26:55 -- common/autotest_common.sh@941 -- # uname 00:25:47.519 01:26:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:47.519 01:26:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1226233 00:25:47.519 01:26:55 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:47.519 01:26:55 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:47.519 01:26:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1226233' 00:25:47.519 killing process with pid 1226233 00:25:47.519 01:26:55 -- common/autotest_common.sh@955 -- # kill 1226233 00:25:47.519 [2024-11-20 01:26:55.533098] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:25:47.519 01:26:55 -- common/autotest_common.sh@960 -- # wait 1226233 00:25:47.780 01:26:55 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:47.780 01:26:55 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:47.780 01:26:55 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:47.780 01:26:55 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:47.780 01:26:55 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:47.780 01:26:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:47.780 01:26:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:47.780 01:26:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:49.690 01:26:57 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:49.690 00:25:49.690 real 0m6.152s 00:25:49.690 user 0m7.319s 00:25:49.690 sys 0m1.925s 00:25:49.690 01:26:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:49.690 01:26:57 -- common/autotest_common.sh@10 -- # set +x 00:25:49.690 ************************************ 00:25:49.690 END TEST nvmf_identify 00:25:49.690 ************************************ 00:25:49.690 01:26:57 -- nvmf/nvmf.sh@98 -- # run_test nvmf_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:25:49.690 01:26:57 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:49.690 01:26:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:49.690 01:26:57 -- common/autotest_common.sh@10 -- # set +x 00:25:49.690 ************************************ 00:25:49.690 START TEST nvmf_perf 00:25:49.690 ************************************ 00:25:49.690 01:26:57 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:25:49.949 * Looking for test storage... 00:25:49.949 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:49.949 01:26:57 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:49.949 01:26:57 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:49.949 01:26:57 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:49.949 01:26:57 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:49.949 01:26:57 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:49.949 01:26:57 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:49.949 01:26:57 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:49.949 01:26:57 -- scripts/common.sh@335 -- # IFS=.-: 00:25:49.949 01:26:57 -- scripts/common.sh@335 -- # read -ra ver1 00:25:49.949 01:26:57 -- scripts/common.sh@336 -- # IFS=.-: 00:25:49.949 01:26:57 -- scripts/common.sh@336 -- # read -ra ver2 00:25:49.949 01:26:57 -- scripts/common.sh@337 -- # local 'op=<' 00:25:49.949 01:26:57 -- scripts/common.sh@339 -- # ver1_l=2 00:25:49.949 01:26:57 -- scripts/common.sh@340 -- # ver2_l=1 00:25:49.949 01:26:57 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:49.949 01:26:57 -- scripts/common.sh@343 -- # case "$op" in 00:25:49.949 01:26:57 -- scripts/common.sh@344 -- # : 1 00:25:49.949 01:26:57 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:49.949 01:26:57 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:49.949 01:26:57 -- scripts/common.sh@364 -- # decimal 1 00:25:49.949 01:26:57 -- scripts/common.sh@352 -- # local d=1 00:25:49.949 01:26:57 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:49.949 01:26:57 -- scripts/common.sh@354 -- # echo 1 00:25:49.949 01:26:57 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:49.949 01:26:57 -- scripts/common.sh@365 -- # decimal 2 00:25:49.949 01:26:57 -- scripts/common.sh@352 -- # local d=2 00:25:49.949 01:26:57 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:49.949 01:26:57 -- scripts/common.sh@354 -- # echo 2 00:25:49.949 01:26:57 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:49.949 01:26:57 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:49.949 01:26:57 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:49.949 01:26:57 -- scripts/common.sh@367 -- # return 0 00:25:49.949 01:26:57 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:49.949 01:26:57 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:49.949 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:49.949 --rc genhtml_branch_coverage=1 00:25:49.949 --rc genhtml_function_coverage=1 00:25:49.949 --rc genhtml_legend=1 00:25:49.949 --rc geninfo_all_blocks=1 00:25:49.949 --rc geninfo_unexecuted_blocks=1 00:25:49.949 00:25:49.949 ' 00:25:49.949 01:26:57 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:49.949 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:49.949 --rc genhtml_branch_coverage=1 00:25:49.949 --rc genhtml_function_coverage=1 00:25:49.949 --rc genhtml_legend=1 00:25:49.949 --rc geninfo_all_blocks=1 00:25:49.949 --rc geninfo_unexecuted_blocks=1 00:25:49.949 00:25:49.949 ' 00:25:49.949 01:26:57 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:49.949 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:49.949 --rc genhtml_branch_coverage=1 00:25:49.949 --rc genhtml_function_coverage=1 00:25:49.949 --rc genhtml_legend=1 00:25:49.949 --rc geninfo_all_blocks=1 00:25:49.949 --rc geninfo_unexecuted_blocks=1 00:25:49.949 00:25:49.949 ' 00:25:49.949 01:26:57 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:49.949 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:49.949 --rc genhtml_branch_coverage=1 00:25:49.949 --rc genhtml_function_coverage=1 00:25:49.949 --rc genhtml_legend=1 00:25:49.949 --rc geninfo_all_blocks=1 00:25:49.949 --rc geninfo_unexecuted_blocks=1 00:25:49.949 00:25:49.949 ' 00:25:49.949 01:26:58 -- host/perf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:49.949 01:26:58 -- nvmf/common.sh@7 -- # uname -s 00:25:49.949 01:26:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:49.949 01:26:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:49.950 01:26:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:49.950 01:26:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:49.950 01:26:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:49.950 01:26:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:49.950 01:26:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:49.950 01:26:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:49.950 01:26:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:49.950 01:26:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:49.950 01:26:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:49.950 01:26:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:49.950 01:26:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:49.950 01:26:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:49.950 01:26:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:49.950 01:26:58 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:49.950 01:26:58 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:49.950 01:26:58 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:49.950 01:26:58 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:49.950 01:26:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:49.950 01:26:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:49.950 01:26:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:49.950 01:26:58 -- paths/export.sh@5 -- # export PATH 00:25:49.950 01:26:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:49.950 01:26:58 -- nvmf/common.sh@46 -- # : 0 00:25:49.950 01:26:58 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:49.950 01:26:58 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:49.950 01:26:58 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:49.950 01:26:58 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:49.950 01:26:58 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:49.950 01:26:58 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:49.950 01:26:58 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:49.950 01:26:58 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:49.950 01:26:58 -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:25:49.950 01:26:58 -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:25:49.950 01:26:58 -- host/perf.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:25:49.950 01:26:58 -- host/perf.sh@17 -- # nvmftestinit 00:25:49.950 01:26:58 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:49.950 01:26:58 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:49.950 01:26:58 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:49.950 01:26:58 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:49.950 01:26:58 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:49.950 01:26:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:49.950 01:26:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:49.950 01:26:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:49.950 01:26:58 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:49.950 01:26:58 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:49.950 01:26:58 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:49.950 01:26:58 -- common/autotest_common.sh@10 -- # set +x 00:25:51.853 01:27:00 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:51.853 01:27:00 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:51.853 01:27:00 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:51.853 01:27:00 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:51.853 01:27:00 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:51.853 01:27:00 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:51.853 01:27:00 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:51.853 01:27:00 -- nvmf/common.sh@294 -- # net_devs=() 00:25:51.853 01:27:00 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:51.853 01:27:00 -- nvmf/common.sh@295 -- # e810=() 00:25:51.853 01:27:00 -- nvmf/common.sh@295 -- # local -ga e810 00:25:51.853 01:27:00 -- nvmf/common.sh@296 -- # x722=() 00:25:51.853 01:27:00 -- nvmf/common.sh@296 -- # local -ga x722 00:25:51.853 01:27:00 -- nvmf/common.sh@297 -- # mlx=() 00:25:51.853 01:27:00 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:51.853 01:27:00 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:51.853 01:27:00 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:51.853 01:27:00 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:51.853 01:27:00 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:51.853 01:27:00 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:51.853 01:27:00 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:51.853 01:27:00 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:51.853 01:27:00 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:51.853 01:27:00 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:51.853 01:27:00 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:51.853 01:27:00 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:51.853 01:27:00 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:51.853 01:27:00 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:51.853 01:27:00 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:51.853 01:27:00 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:51.853 01:27:00 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:51.853 01:27:00 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:51.853 01:27:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:51.853 01:27:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:51.853 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:51.853 01:27:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:51.853 01:27:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:51.853 01:27:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:51.853 01:27:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:51.853 01:27:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:51.853 01:27:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:51.853 01:27:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:51.853 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:51.853 01:27:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:51.853 01:27:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:51.853 01:27:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:51.853 01:27:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:51.853 01:27:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:51.853 01:27:00 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:51.853 01:27:00 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:51.853 01:27:00 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:51.853 01:27:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:51.853 01:27:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:51.853 01:27:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:51.853 01:27:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:51.853 01:27:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:51.853 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:51.853 01:27:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:51.853 01:27:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:51.853 01:27:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:51.853 01:27:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:51.853 01:27:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:51.853 01:27:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:51.853 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:51.853 01:27:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:51.853 01:27:00 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:51.853 01:27:00 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:51.853 01:27:00 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:51.853 01:27:00 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:51.853 01:27:00 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:51.853 01:27:00 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:51.853 01:27:00 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:51.854 01:27:00 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:51.854 01:27:00 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:51.854 01:27:00 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:51.854 01:27:00 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:51.854 01:27:00 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:51.854 01:27:00 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:51.854 01:27:00 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:51.854 01:27:00 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:51.854 01:27:00 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:51.854 01:27:00 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:51.854 01:27:00 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:52.112 01:27:00 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:52.112 01:27:00 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:52.112 01:27:00 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:52.112 01:27:00 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:52.112 01:27:00 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:52.112 01:27:00 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:52.112 01:27:00 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:52.112 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:52.112 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.332 ms 00:25:52.112 00:25:52.112 --- 10.0.0.2 ping statistics --- 00:25:52.112 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:52.112 rtt min/avg/max/mdev = 0.332/0.332/0.332/0.000 ms 00:25:52.112 01:27:00 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:52.112 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:52.112 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.136 ms 00:25:52.112 00:25:52.112 --- 10.0.0.1 ping statistics --- 00:25:52.112 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:52.112 rtt min/avg/max/mdev = 0.136/0.136/0.136/0.000 ms 00:25:52.112 01:27:00 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:52.112 01:27:00 -- nvmf/common.sh@410 -- # return 0 00:25:52.112 01:27:00 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:52.112 01:27:00 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:52.112 01:27:00 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:52.112 01:27:00 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:52.112 01:27:00 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:52.112 01:27:00 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:52.112 01:27:00 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:52.112 01:27:00 -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:25:52.112 01:27:00 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:52.112 01:27:00 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:52.112 01:27:00 -- common/autotest_common.sh@10 -- # set +x 00:25:52.112 01:27:00 -- nvmf/common.sh@469 -- # nvmfpid=1228487 00:25:52.112 01:27:00 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:25:52.112 01:27:00 -- nvmf/common.sh@470 -- # waitforlisten 1228487 00:25:52.112 01:27:00 -- common/autotest_common.sh@829 -- # '[' -z 1228487 ']' 00:25:52.112 01:27:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:52.112 01:27:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:52.112 01:27:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:52.112 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:52.112 01:27:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:52.112 01:27:00 -- common/autotest_common.sh@10 -- # set +x 00:25:52.112 [2024-11-20 01:27:00.221839] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:52.112 [2024-11-20 01:27:00.221928] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:52.112 EAL: No free 2048 kB hugepages reported on node 1 00:25:52.112 [2024-11-20 01:27:00.289153] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:52.370 [2024-11-20 01:27:00.375187] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:52.370 [2024-11-20 01:27:00.375336] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:52.370 [2024-11-20 01:27:00.375352] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:52.370 [2024-11-20 01:27:00.375363] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:52.370 [2024-11-20 01:27:00.375429] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:52.370 [2024-11-20 01:27:00.375499] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:52.370 [2024-11-20 01:27:00.375572] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:52.370 [2024-11-20 01:27:00.375575] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:53.336 01:27:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:53.336 01:27:01 -- common/autotest_common.sh@862 -- # return 0 00:25:53.336 01:27:01 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:53.336 01:27:01 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:53.336 01:27:01 -- common/autotest_common.sh@10 -- # set +x 00:25:53.336 01:27:01 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:53.336 01:27:01 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:25:53.336 01:27:01 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_subsystem_config 00:25:56.620 01:27:04 -- host/perf.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_get_config bdev 00:25:56.620 01:27:04 -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:25:56.620 01:27:04 -- host/perf.sh@30 -- # local_nvme_trid=0000:88:00.0 00:25:56.620 01:27:04 -- host/perf.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:25:56.878 01:27:04 -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:25:56.878 01:27:04 -- host/perf.sh@33 -- # '[' -n 0000:88:00.0 ']' 00:25:56.878 01:27:04 -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:25:56.878 01:27:04 -- host/perf.sh@37 -- # '[' tcp == rdma ']' 00:25:56.878 01:27:04 -- host/perf.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:25:57.136 [2024-11-20 01:27:05.109441] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:57.136 01:27:05 -- host/perf.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:57.394 01:27:05 -- host/perf.sh@45 -- # for bdev in $bdevs 00:25:57.394 01:27:05 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:57.651 01:27:05 -- host/perf.sh@45 -- # for bdev in $bdevs 00:25:57.651 01:27:05 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:25:57.909 01:27:05 -- host/perf.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:58.166 [2024-11-20 01:27:06.157453] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:58.166 01:27:06 -- host/perf.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:25:58.424 01:27:06 -- host/perf.sh@52 -- # '[' -n 0000:88:00.0 ']' 00:25:58.424 01:27:06 -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:25:58.424 01:27:06 -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:25:58.424 01:27:06 -- host/perf.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:25:59.802 Initializing NVMe Controllers 00:25:59.802 Attached to NVMe Controller at 0000:88:00.0 [8086:0a54] 00:25:59.802 Associating PCIE (0000:88:00.0) NSID 1 with lcore 0 00:25:59.802 Initialization complete. Launching workers. 00:25:59.802 ======================================================== 00:25:59.802 Latency(us) 00:25:59.802 Device Information : IOPS MiB/s Average min max 00:25:59.802 PCIE (0000:88:00.0) NSID 1 from core 0: 86135.53 336.47 371.13 42.22 5272.95 00:25:59.802 ======================================================== 00:25:59.802 Total : 86135.53 336.47 371.13 42.22 5272.95 00:25:59.802 00:25:59.802 01:27:07 -- host/perf.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:25:59.802 EAL: No free 2048 kB hugepages reported on node 1 00:26:01.179 Initializing NVMe Controllers 00:26:01.179 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:01.179 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:01.179 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:26:01.179 Initialization complete. Launching workers. 00:26:01.179 ======================================================== 00:26:01.179 Latency(us) 00:26:01.179 Device Information : IOPS MiB/s Average min max 00:26:01.179 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 63.97 0.25 16256.15 140.10 45819.64 00:26:01.179 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 69.96 0.27 14748.21 4959.94 51899.30 00:26:01.179 ======================================================== 00:26:01.179 Total : 133.93 0.52 15468.42 140.10 51899.30 00:26:01.179 00:26:01.179 01:27:09 -- host/perf.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:01.179 EAL: No free 2048 kB hugepages reported on node 1 00:26:02.556 Initializing NVMe Controllers 00:26:02.556 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:02.556 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:02.556 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:26:02.556 Initialization complete. Launching workers. 00:26:02.556 ======================================================== 00:26:02.556 Latency(us) 00:26:02.556 Device Information : IOPS MiB/s Average min max 00:26:02.556 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 8677.98 33.90 3691.31 532.23 8086.31 00:26:02.556 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 3938.99 15.39 8175.78 6192.33 16616.96 00:26:02.556 ======================================================== 00:26:02.556 Total : 12616.97 49.29 5091.35 532.23 16616.96 00:26:02.556 00:26:02.556 01:27:10 -- host/perf.sh@59 -- # [[ e810 == \e\8\1\0 ]] 00:26:02.556 01:27:10 -- host/perf.sh@59 -- # [[ tcp == \r\d\m\a ]] 00:26:02.556 01:27:10 -- host/perf.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -O 16384 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:02.556 EAL: No free 2048 kB hugepages reported on node 1 00:26:05.093 Initializing NVMe Controllers 00:26:05.093 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:05.093 Controller IO queue size 128, less than required. 00:26:05.093 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:05.093 Controller IO queue size 128, less than required. 00:26:05.093 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:05.093 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:05.093 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:26:05.093 Initialization complete. Launching workers. 00:26:05.093 ======================================================== 00:26:05.093 Latency(us) 00:26:05.093 Device Information : IOPS MiB/s Average min max 00:26:05.093 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1484.81 371.20 88018.12 46035.96 164193.87 00:26:05.093 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 568.35 142.09 238851.96 85523.80 343040.85 00:26:05.093 ======================================================== 00:26:05.093 Total : 2053.16 513.29 129771.69 46035.96 343040.85 00:26:05.093 00:26:05.093 01:27:13 -- host/perf.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0xf -P 4 00:26:05.093 EAL: No free 2048 kB hugepages reported on node 1 00:26:05.352 No valid NVMe controllers or AIO or URING devices found 00:26:05.352 Initializing NVMe Controllers 00:26:05.352 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:05.352 Controller IO queue size 128, less than required. 00:26:05.352 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:05.352 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:26:05.352 Controller IO queue size 128, less than required. 00:26:05.352 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:05.352 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 512. Removing this ns from test 00:26:05.352 WARNING: Some requested NVMe devices were skipped 00:26:05.352 01:27:13 -- host/perf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' --transport-stat 00:26:05.611 EAL: No free 2048 kB hugepages reported on node 1 00:26:08.145 Initializing NVMe Controllers 00:26:08.145 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:08.145 Controller IO queue size 128, less than required. 00:26:08.145 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:08.145 Controller IO queue size 128, less than required. 00:26:08.145 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:08.145 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:08.145 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:26:08.145 Initialization complete. Launching workers. 00:26:08.145 00:26:08.145 ==================== 00:26:08.145 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:26:08.145 TCP transport: 00:26:08.145 polls: 8910 00:26:08.145 idle_polls: 5727 00:26:08.145 sock_completions: 3183 00:26:08.145 nvme_completions: 5967 00:26:08.145 submitted_requests: 9089 00:26:08.145 queued_requests: 1 00:26:08.145 00:26:08.145 ==================== 00:26:08.145 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:26:08.145 TCP transport: 00:26:08.145 polls: 9099 00:26:08.145 idle_polls: 5739 00:26:08.145 sock_completions: 3360 00:26:08.145 nvme_completions: 5930 00:26:08.145 submitted_requests: 9052 00:26:08.145 queued_requests: 1 00:26:08.145 ======================================================== 00:26:08.145 Latency(us) 00:26:08.145 Device Information : IOPS MiB/s Average min max 00:26:08.145 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1553.01 388.25 84075.77 47757.30 135529.54 00:26:08.145 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 1543.53 385.88 84125.21 46328.47 144084.86 00:26:08.145 ======================================================== 00:26:08.145 Total : 3096.54 774.14 84100.42 46328.47 144084.86 00:26:08.145 00:26:08.145 01:27:16 -- host/perf.sh@66 -- # sync 00:26:08.145 01:27:16 -- host/perf.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:08.145 01:27:16 -- host/perf.sh@69 -- # '[' 1 -eq 1 ']' 00:26:08.145 01:27:16 -- host/perf.sh@71 -- # '[' -n 0000:88:00.0 ']' 00:26:08.145 01:27:16 -- host/perf.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore Nvme0n1 lvs_0 00:26:12.336 01:27:19 -- host/perf.sh@72 -- # ls_guid=a535e059-3366-40d2-b126-72485f564f29 00:26:12.336 01:27:19 -- host/perf.sh@73 -- # get_lvs_free_mb a535e059-3366-40d2-b126-72485f564f29 00:26:12.336 01:27:19 -- common/autotest_common.sh@1353 -- # local lvs_uuid=a535e059-3366-40d2-b126-72485f564f29 00:26:12.336 01:27:19 -- common/autotest_common.sh@1354 -- # local lvs_info 00:26:12.336 01:27:19 -- common/autotest_common.sh@1355 -- # local fc 00:26:12.336 01:27:19 -- common/autotest_common.sh@1356 -- # local cs 00:26:12.336 01:27:19 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:26:12.336 01:27:20 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:26:12.336 { 00:26:12.336 "uuid": "a535e059-3366-40d2-b126-72485f564f29", 00:26:12.336 "name": "lvs_0", 00:26:12.336 "base_bdev": "Nvme0n1", 00:26:12.336 "total_data_clusters": 238234, 00:26:12.336 "free_clusters": 238234, 00:26:12.336 "block_size": 512, 00:26:12.336 "cluster_size": 4194304 00:26:12.336 } 00:26:12.336 ]' 00:26:12.336 01:27:20 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="a535e059-3366-40d2-b126-72485f564f29") .free_clusters' 00:26:12.336 01:27:20 -- common/autotest_common.sh@1358 -- # fc=238234 00:26:12.336 01:27:20 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="a535e059-3366-40d2-b126-72485f564f29") .cluster_size' 00:26:12.336 01:27:20 -- common/autotest_common.sh@1359 -- # cs=4194304 00:26:12.336 01:27:20 -- common/autotest_common.sh@1362 -- # free_mb=952936 00:26:12.336 01:27:20 -- common/autotest_common.sh@1363 -- # echo 952936 00:26:12.336 952936 00:26:12.336 01:27:20 -- host/perf.sh@77 -- # '[' 952936 -gt 20480 ']' 00:26:12.336 01:27:20 -- host/perf.sh@78 -- # free_mb=20480 00:26:12.336 01:27:20 -- host/perf.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u a535e059-3366-40d2-b126-72485f564f29 lbd_0 20480 00:26:12.594 01:27:20 -- host/perf.sh@80 -- # lb_guid=f4e1901d-9a09-4813-a017-f09def580bf1 00:26:12.595 01:27:20 -- host/perf.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore f4e1901d-9a09-4813-a017-f09def580bf1 lvs_n_0 00:26:13.531 01:27:21 -- host/perf.sh@83 -- # ls_nested_guid=40680355-b87c-4dde-a9ff-e2a45e24a006 00:26:13.531 01:27:21 -- host/perf.sh@84 -- # get_lvs_free_mb 40680355-b87c-4dde-a9ff-e2a45e24a006 00:26:13.531 01:27:21 -- common/autotest_common.sh@1353 -- # local lvs_uuid=40680355-b87c-4dde-a9ff-e2a45e24a006 00:26:13.531 01:27:21 -- common/autotest_common.sh@1354 -- # local lvs_info 00:26:13.531 01:27:21 -- common/autotest_common.sh@1355 -- # local fc 00:26:13.531 01:27:21 -- common/autotest_common.sh@1356 -- # local cs 00:26:13.531 01:27:21 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:26:13.531 01:27:21 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:26:13.531 { 00:26:13.531 "uuid": "a535e059-3366-40d2-b126-72485f564f29", 00:26:13.531 "name": "lvs_0", 00:26:13.531 "base_bdev": "Nvme0n1", 00:26:13.531 "total_data_clusters": 238234, 00:26:13.531 "free_clusters": 233114, 00:26:13.531 "block_size": 512, 00:26:13.531 "cluster_size": 4194304 00:26:13.531 }, 00:26:13.531 { 00:26:13.531 "uuid": "40680355-b87c-4dde-a9ff-e2a45e24a006", 00:26:13.531 "name": "lvs_n_0", 00:26:13.531 "base_bdev": "f4e1901d-9a09-4813-a017-f09def580bf1", 00:26:13.531 "total_data_clusters": 5114, 00:26:13.531 "free_clusters": 5114, 00:26:13.531 "block_size": 512, 00:26:13.531 "cluster_size": 4194304 00:26:13.531 } 00:26:13.531 ]' 00:26:13.531 01:27:21 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="40680355-b87c-4dde-a9ff-e2a45e24a006") .free_clusters' 00:26:13.531 01:27:21 -- common/autotest_common.sh@1358 -- # fc=5114 00:26:13.531 01:27:21 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="40680355-b87c-4dde-a9ff-e2a45e24a006") .cluster_size' 00:26:13.791 01:27:21 -- common/autotest_common.sh@1359 -- # cs=4194304 00:26:13.791 01:27:21 -- common/autotest_common.sh@1362 -- # free_mb=20456 00:26:13.791 01:27:21 -- common/autotest_common.sh@1363 -- # echo 20456 00:26:13.791 20456 00:26:13.791 01:27:21 -- host/perf.sh@85 -- # '[' 20456 -gt 20480 ']' 00:26:13.791 01:27:21 -- host/perf.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 40680355-b87c-4dde-a9ff-e2a45e24a006 lbd_nest_0 20456 00:26:14.049 01:27:22 -- host/perf.sh@88 -- # lb_nested_guid=8d9811e5-d79c-44e0-9cba-cfdf75757f72 00:26:14.049 01:27:22 -- host/perf.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:14.049 01:27:22 -- host/perf.sh@90 -- # for bdev in $lb_nested_guid 00:26:14.049 01:27:22 -- host/perf.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 8d9811e5-d79c-44e0-9cba-cfdf75757f72 00:26:14.308 01:27:22 -- host/perf.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:14.567 01:27:22 -- host/perf.sh@95 -- # qd_depth=("1" "32" "128") 00:26:14.567 01:27:22 -- host/perf.sh@96 -- # io_size=("512" "131072") 00:26:14.567 01:27:22 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:26:14.567 01:27:22 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:14.567 01:27:22 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:14.830 EAL: No free 2048 kB hugepages reported on node 1 00:26:27.037 Initializing NVMe Controllers 00:26:27.037 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:27.037 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:27.037 Initialization complete. Launching workers. 00:26:27.037 ======================================================== 00:26:27.037 Latency(us) 00:26:27.037 Device Information : IOPS MiB/s Average min max 00:26:27.037 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 49.59 0.02 20179.93 170.51 48561.42 00:26:27.037 ======================================================== 00:26:27.037 Total : 49.59 0.02 20179.93 170.51 48561.42 00:26:27.037 00:26:27.037 01:27:33 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:27.037 01:27:33 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:27.037 EAL: No free 2048 kB hugepages reported on node 1 00:26:35.251 Initializing NVMe Controllers 00:26:35.251 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:35.251 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:35.251 Initialization complete. Launching workers. 00:26:35.251 ======================================================== 00:26:35.251 Latency(us) 00:26:35.251 Device Information : IOPS MiB/s Average min max 00:26:35.251 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 86.40 10.80 11591.48 5007.91 23939.33 00:26:35.251 ======================================================== 00:26:35.251 Total : 86.40 10.80 11591.48 5007.91 23939.33 00:26:35.251 00:26:35.251 01:27:43 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:26:35.251 01:27:43 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:35.251 01:27:43 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:35.251 EAL: No free 2048 kB hugepages reported on node 1 00:26:47.488 Initializing NVMe Controllers 00:26:47.488 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:47.488 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:47.488 Initialization complete. Launching workers. 00:26:47.488 ======================================================== 00:26:47.488 Latency(us) 00:26:47.488 Device Information : IOPS MiB/s Average min max 00:26:47.488 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7687.80 3.75 4170.56 288.10 47877.13 00:26:47.488 ======================================================== 00:26:47.488 Total : 7687.80 3.75 4170.56 288.10 47877.13 00:26:47.489 00:26:47.489 01:27:53 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:47.489 01:27:53 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:47.489 EAL: No free 2048 kB hugepages reported on node 1 00:26:57.470 Initializing NVMe Controllers 00:26:57.470 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:57.470 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:57.470 Initialization complete. Launching workers. 00:26:57.470 ======================================================== 00:26:57.470 Latency(us) 00:26:57.470 Device Information : IOPS MiB/s Average min max 00:26:57.470 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 4061.90 507.74 7879.21 569.05 17037.47 00:26:57.470 ======================================================== 00:26:57.470 Total : 4061.90 507.74 7879.21 569.05 17037.47 00:26:57.470 00:26:57.470 01:28:04 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:26:57.470 01:28:04 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:57.470 01:28:04 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:57.470 EAL: No free 2048 kB hugepages reported on node 1 00:27:07.457 Initializing NVMe Controllers 00:27:07.457 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:07.457 Controller IO queue size 128, less than required. 00:27:07.457 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:27:07.457 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:07.457 Initialization complete. Launching workers. 00:27:07.457 ======================================================== 00:27:07.457 Latency(us) 00:27:07.457 Device Information : IOPS MiB/s Average min max 00:27:07.457 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 12091.86 5.90 10590.75 1840.09 23577.96 00:27:07.457 ======================================================== 00:27:07.457 Total : 12091.86 5.90 10590.75 1840.09 23577.96 00:27:07.457 00:27:07.457 01:28:14 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:27:07.457 01:28:14 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:07.457 EAL: No free 2048 kB hugepages reported on node 1 00:27:17.441 Initializing NVMe Controllers 00:27:17.441 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:17.441 Controller IO queue size 128, less than required. 00:27:17.441 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:27:17.441 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:17.441 Initialization complete. Launching workers. 00:27:17.441 ======================================================== 00:27:17.441 Latency(us) 00:27:17.441 Device Information : IOPS MiB/s Average min max 00:27:17.441 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1174.30 146.79 109878.05 8921.54 231777.61 00:27:17.441 ======================================================== 00:27:17.441 Total : 1174.30 146.79 109878.05 8921.54 231777.61 00:27:17.441 00:27:17.441 01:28:24 -- host/perf.sh@104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:17.441 01:28:25 -- host/perf.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 8d9811e5-d79c-44e0-9cba-cfdf75757f72 00:27:18.010 01:28:25 -- host/perf.sh@106 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:27:18.269 01:28:26 -- host/perf.sh@107 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete f4e1901d-9a09-4813-a017-f09def580bf1 00:27:18.528 01:28:26 -- host/perf.sh@108 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:27:18.786 01:28:26 -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:27:18.786 01:28:26 -- host/perf.sh@114 -- # nvmftestfini 00:27:18.786 01:28:26 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:18.786 01:28:26 -- nvmf/common.sh@116 -- # sync 00:27:18.786 01:28:26 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:18.786 01:28:26 -- nvmf/common.sh@119 -- # set +e 00:27:18.786 01:28:26 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:18.786 01:28:26 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:18.786 rmmod nvme_tcp 00:27:18.786 rmmod nvme_fabrics 00:27:18.786 rmmod nvme_keyring 00:27:18.786 01:28:26 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:18.786 01:28:26 -- nvmf/common.sh@123 -- # set -e 00:27:18.786 01:28:26 -- nvmf/common.sh@124 -- # return 0 00:27:18.786 01:28:26 -- nvmf/common.sh@477 -- # '[' -n 1228487 ']' 00:27:18.786 01:28:26 -- nvmf/common.sh@478 -- # killprocess 1228487 00:27:18.786 01:28:26 -- common/autotest_common.sh@936 -- # '[' -z 1228487 ']' 00:27:18.786 01:28:26 -- common/autotest_common.sh@940 -- # kill -0 1228487 00:27:18.786 01:28:26 -- common/autotest_common.sh@941 -- # uname 00:27:18.786 01:28:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:18.786 01:28:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1228487 00:27:18.786 01:28:26 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:18.786 01:28:26 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:18.786 01:28:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1228487' 00:27:18.786 killing process with pid 1228487 00:27:18.786 01:28:26 -- common/autotest_common.sh@955 -- # kill 1228487 00:27:18.786 01:28:26 -- common/autotest_common.sh@960 -- # wait 1228487 00:27:20.690 01:28:28 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:20.690 01:28:28 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:20.690 01:28:28 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:20.690 01:28:28 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:20.690 01:28:28 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:20.690 01:28:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:20.690 01:28:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:20.690 01:28:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:22.596 01:28:30 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:22.596 00:27:22.596 real 1m32.675s 00:27:22.596 user 5m41.947s 00:27:22.596 sys 0m15.948s 00:27:22.596 01:28:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:22.596 01:28:30 -- common/autotest_common.sh@10 -- # set +x 00:27:22.596 ************************************ 00:27:22.596 END TEST nvmf_perf 00:27:22.596 ************************************ 00:27:22.596 01:28:30 -- nvmf/nvmf.sh@99 -- # run_test nvmf_fio_host /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:27:22.596 01:28:30 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:22.596 01:28:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:22.596 01:28:30 -- common/autotest_common.sh@10 -- # set +x 00:27:22.596 ************************************ 00:27:22.596 START TEST nvmf_fio_host 00:27:22.596 ************************************ 00:27:22.596 01:28:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:27:22.596 * Looking for test storage... 00:27:22.596 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:22.596 01:28:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:22.596 01:28:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:22.596 01:28:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:22.596 01:28:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:22.596 01:28:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:22.596 01:28:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:22.596 01:28:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:22.596 01:28:30 -- scripts/common.sh@335 -- # IFS=.-: 00:27:22.596 01:28:30 -- scripts/common.sh@335 -- # read -ra ver1 00:27:22.596 01:28:30 -- scripts/common.sh@336 -- # IFS=.-: 00:27:22.596 01:28:30 -- scripts/common.sh@336 -- # read -ra ver2 00:27:22.596 01:28:30 -- scripts/common.sh@337 -- # local 'op=<' 00:27:22.596 01:28:30 -- scripts/common.sh@339 -- # ver1_l=2 00:27:22.596 01:28:30 -- scripts/common.sh@340 -- # ver2_l=1 00:27:22.596 01:28:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:22.596 01:28:30 -- scripts/common.sh@343 -- # case "$op" in 00:27:22.596 01:28:30 -- scripts/common.sh@344 -- # : 1 00:27:22.596 01:28:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:22.596 01:28:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:22.596 01:28:30 -- scripts/common.sh@364 -- # decimal 1 00:27:22.596 01:28:30 -- scripts/common.sh@352 -- # local d=1 00:27:22.596 01:28:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:22.596 01:28:30 -- scripts/common.sh@354 -- # echo 1 00:27:22.597 01:28:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:22.597 01:28:30 -- scripts/common.sh@365 -- # decimal 2 00:27:22.597 01:28:30 -- scripts/common.sh@352 -- # local d=2 00:27:22.597 01:28:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:22.597 01:28:30 -- scripts/common.sh@354 -- # echo 2 00:27:22.597 01:28:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:22.597 01:28:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:22.597 01:28:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:22.597 01:28:30 -- scripts/common.sh@367 -- # return 0 00:27:22.597 01:28:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:22.597 01:28:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:22.597 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:22.597 --rc genhtml_branch_coverage=1 00:27:22.597 --rc genhtml_function_coverage=1 00:27:22.597 --rc genhtml_legend=1 00:27:22.597 --rc geninfo_all_blocks=1 00:27:22.597 --rc geninfo_unexecuted_blocks=1 00:27:22.597 00:27:22.597 ' 00:27:22.597 01:28:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:22.597 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:22.597 --rc genhtml_branch_coverage=1 00:27:22.597 --rc genhtml_function_coverage=1 00:27:22.597 --rc genhtml_legend=1 00:27:22.597 --rc geninfo_all_blocks=1 00:27:22.597 --rc geninfo_unexecuted_blocks=1 00:27:22.597 00:27:22.597 ' 00:27:22.597 01:28:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:22.597 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:22.597 --rc genhtml_branch_coverage=1 00:27:22.597 --rc genhtml_function_coverage=1 00:27:22.597 --rc genhtml_legend=1 00:27:22.597 --rc geninfo_all_blocks=1 00:27:22.597 --rc geninfo_unexecuted_blocks=1 00:27:22.597 00:27:22.597 ' 00:27:22.597 01:28:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:22.597 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:22.597 --rc genhtml_branch_coverage=1 00:27:22.597 --rc genhtml_function_coverage=1 00:27:22.597 --rc genhtml_legend=1 00:27:22.597 --rc geninfo_all_blocks=1 00:27:22.597 --rc geninfo_unexecuted_blocks=1 00:27:22.597 00:27:22.597 ' 00:27:22.597 01:28:30 -- host/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:22.597 01:28:30 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:22.597 01:28:30 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:22.597 01:28:30 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:22.597 01:28:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:22.597 01:28:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:22.597 01:28:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:22.597 01:28:30 -- paths/export.sh@5 -- # export PATH 00:27:22.597 01:28:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:22.597 01:28:30 -- host/fio.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:22.597 01:28:30 -- nvmf/common.sh@7 -- # uname -s 00:27:22.597 01:28:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:22.597 01:28:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:22.597 01:28:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:22.597 01:28:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:22.597 01:28:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:22.597 01:28:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:22.597 01:28:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:22.597 01:28:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:22.597 01:28:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:22.597 01:28:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:22.597 01:28:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:22.597 01:28:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:22.597 01:28:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:22.597 01:28:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:22.597 01:28:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:22.597 01:28:30 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:22.597 01:28:30 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:22.597 01:28:30 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:22.597 01:28:30 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:22.597 01:28:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:22.597 01:28:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:22.597 01:28:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:22.597 01:28:30 -- paths/export.sh@5 -- # export PATH 00:27:22.597 01:28:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:22.597 01:28:30 -- nvmf/common.sh@46 -- # : 0 00:27:22.597 01:28:30 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:22.597 01:28:30 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:22.597 01:28:30 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:22.597 01:28:30 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:22.597 01:28:30 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:22.597 01:28:30 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:22.597 01:28:30 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:22.597 01:28:30 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:22.597 01:28:30 -- host/fio.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:27:22.597 01:28:30 -- host/fio.sh@14 -- # nvmftestinit 00:27:22.597 01:28:30 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:22.597 01:28:30 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:22.597 01:28:30 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:22.597 01:28:30 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:22.597 01:28:30 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:22.597 01:28:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:22.597 01:28:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:22.597 01:28:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:22.597 01:28:30 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:22.597 01:28:30 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:22.597 01:28:30 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:22.597 01:28:30 -- common/autotest_common.sh@10 -- # set +x 00:27:25.135 01:28:32 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:25.135 01:28:32 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:25.135 01:28:32 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:25.135 01:28:32 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:25.135 01:28:32 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:25.135 01:28:32 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:25.135 01:28:32 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:25.135 01:28:32 -- nvmf/common.sh@294 -- # net_devs=() 00:27:25.135 01:28:32 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:25.135 01:28:32 -- nvmf/common.sh@295 -- # e810=() 00:27:25.135 01:28:32 -- nvmf/common.sh@295 -- # local -ga e810 00:27:25.135 01:28:32 -- nvmf/common.sh@296 -- # x722=() 00:27:25.135 01:28:32 -- nvmf/common.sh@296 -- # local -ga x722 00:27:25.135 01:28:32 -- nvmf/common.sh@297 -- # mlx=() 00:27:25.135 01:28:32 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:25.135 01:28:32 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:25.135 01:28:32 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:25.135 01:28:32 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:25.135 01:28:32 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:25.135 01:28:32 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:25.135 01:28:32 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:25.135 01:28:32 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:25.135 01:28:32 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:25.135 01:28:32 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:25.135 01:28:32 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:25.135 01:28:32 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:25.135 01:28:32 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:25.135 01:28:32 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:25.135 01:28:32 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:25.135 01:28:32 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:25.135 01:28:32 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:25.135 01:28:32 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:25.135 01:28:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:25.135 01:28:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:25.135 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:25.135 01:28:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:25.135 01:28:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:25.135 01:28:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:25.135 01:28:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:25.135 01:28:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:25.135 01:28:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:25.135 01:28:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:25.135 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:25.135 01:28:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:25.135 01:28:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:25.135 01:28:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:25.135 01:28:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:25.135 01:28:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:25.135 01:28:32 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:25.135 01:28:32 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:25.135 01:28:32 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:25.135 01:28:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:25.135 01:28:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:25.135 01:28:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:25.135 01:28:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:25.135 01:28:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:25.135 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:25.135 01:28:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:25.135 01:28:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:25.135 01:28:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:25.135 01:28:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:25.136 01:28:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:25.136 01:28:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:25.136 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:25.136 01:28:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:25.136 01:28:32 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:25.136 01:28:32 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:25.136 01:28:32 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:25.136 01:28:32 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:25.136 01:28:32 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:25.136 01:28:32 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:25.136 01:28:32 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:25.136 01:28:32 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:25.136 01:28:32 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:25.136 01:28:32 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:25.136 01:28:32 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:25.136 01:28:32 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:25.136 01:28:32 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:25.136 01:28:32 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:25.136 01:28:32 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:25.136 01:28:32 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:25.136 01:28:32 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:25.136 01:28:32 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:25.136 01:28:32 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:25.136 01:28:32 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:25.136 01:28:32 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:25.136 01:28:32 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:25.136 01:28:32 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:25.136 01:28:32 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:25.136 01:28:32 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:25.136 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:25.136 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.254 ms 00:27:25.136 00:27:25.136 --- 10.0.0.2 ping statistics --- 00:27:25.136 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:25.136 rtt min/avg/max/mdev = 0.254/0.254/0.254/0.000 ms 00:27:25.136 01:28:32 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:25.136 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:25.136 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.125 ms 00:27:25.136 00:27:25.136 --- 10.0.0.1 ping statistics --- 00:27:25.136 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:25.136 rtt min/avg/max/mdev = 0.125/0.125/0.125/0.000 ms 00:27:25.136 01:28:32 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:25.136 01:28:32 -- nvmf/common.sh@410 -- # return 0 00:27:25.136 01:28:32 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:25.136 01:28:32 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:25.136 01:28:32 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:25.136 01:28:32 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:25.136 01:28:32 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:25.136 01:28:32 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:25.136 01:28:32 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:25.136 01:28:32 -- host/fio.sh@16 -- # [[ y != y ]] 00:27:25.136 01:28:32 -- host/fio.sh@21 -- # timing_enter start_nvmf_tgt 00:27:25.136 01:28:32 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:25.136 01:28:32 -- common/autotest_common.sh@10 -- # set +x 00:27:25.136 01:28:32 -- host/fio.sh@24 -- # nvmfpid=1241557 00:27:25.136 01:28:32 -- host/fio.sh@23 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:27:25.136 01:28:32 -- host/fio.sh@26 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:27:25.136 01:28:32 -- host/fio.sh@28 -- # waitforlisten 1241557 00:27:25.136 01:28:32 -- common/autotest_common.sh@829 -- # '[' -z 1241557 ']' 00:27:25.136 01:28:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:25.136 01:28:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:25.136 01:28:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:25.136 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:25.136 01:28:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:25.136 01:28:32 -- common/autotest_common.sh@10 -- # set +x 00:27:25.136 [2024-11-20 01:28:32.961607] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:27:25.136 [2024-11-20 01:28:32.961696] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:25.136 EAL: No free 2048 kB hugepages reported on node 1 00:27:25.136 [2024-11-20 01:28:33.034250] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:25.136 [2024-11-20 01:28:33.126169] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:25.136 [2024-11-20 01:28:33.126328] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:25.136 [2024-11-20 01:28:33.126345] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:25.136 [2024-11-20 01:28:33.126358] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:25.136 [2024-11-20 01:28:33.126428] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:25.136 [2024-11-20 01:28:33.126456] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:25.136 [2024-11-20 01:28:33.126515] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:25.136 [2024-11-20 01:28:33.126518] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:26.073 01:28:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:26.073 01:28:33 -- common/autotest_common.sh@862 -- # return 0 00:27:26.073 01:28:33 -- host/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:27:26.073 [2024-11-20 01:28:34.223650] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:26.073 01:28:34 -- host/fio.sh@30 -- # timing_exit start_nvmf_tgt 00:27:26.073 01:28:34 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:26.073 01:28:34 -- common/autotest_common.sh@10 -- # set +x 00:27:26.073 01:28:34 -- host/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:27:26.331 Malloc1 00:27:26.331 01:28:34 -- host/fio.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:26.589 01:28:34 -- host/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:27:26.847 01:28:35 -- host/fio.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:27.109 [2024-11-20 01:28:35.293703] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:27.109 01:28:35 -- host/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:27:27.372 01:28:35 -- host/fio.sh@38 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:27:27.372 01:28:35 -- host/fio.sh@41 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:27.372 01:28:35 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:27.372 01:28:35 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:27:27.372 01:28:35 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:27.372 01:28:35 -- common/autotest_common.sh@1328 -- # local sanitizers 00:27:27.372 01:28:35 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:27.372 01:28:35 -- common/autotest_common.sh@1330 -- # shift 00:27:27.372 01:28:35 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:27:27.372 01:28:35 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:27.372 01:28:35 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:27.372 01:28:35 -- common/autotest_common.sh@1334 -- # grep libasan 00:27:27.372 01:28:35 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:27.372 01:28:35 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:27.372 01:28:35 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:27.372 01:28:35 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:27.372 01:28:35 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:27.372 01:28:35 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:27:27.372 01:28:35 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:27.631 01:28:35 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:27.631 01:28:35 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:27.631 01:28:35 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:27.631 01:28:35 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:27.631 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:27:27.631 fio-3.35 00:27:27.631 Starting 1 thread 00:27:27.631 EAL: No free 2048 kB hugepages reported on node 1 00:27:30.162 00:27:30.162 test: (groupid=0, jobs=1): err= 0: pid=1242036: Wed Nov 20 01:28:38 2024 00:27:30.162 read: IOPS=9670, BW=37.8MiB/s (39.6MB/s)(75.8MiB/2006msec) 00:27:30.162 slat (nsec): min=1824, max=147723, avg=2350.12, stdev=1774.60 00:27:30.162 clat (usec): min=2098, max=12371, avg=7271.77, stdev=584.52 00:27:30.162 lat (usec): min=2120, max=12373, avg=7274.12, stdev=584.43 00:27:30.162 clat percentiles (usec): 00:27:30.162 | 1.00th=[ 5932], 5.00th=[ 6325], 10.00th=[ 6587], 20.00th=[ 6849], 00:27:30.162 | 30.00th=[ 6980], 40.00th=[ 7177], 50.00th=[ 7308], 60.00th=[ 7439], 00:27:30.162 | 70.00th=[ 7570], 80.00th=[ 7767], 90.00th=[ 7963], 95.00th=[ 8160], 00:27:30.162 | 99.00th=[ 8455], 99.50th=[ 8586], 99.90th=[11207], 99.95th=[11863], 00:27:30.162 | 99.99th=[12387] 00:27:30.162 bw ( KiB/s): min=37456, max=39504, per=99.94%, avg=38660.00, stdev=888.10, samples=4 00:27:30.162 iops : min= 9364, max= 9876, avg=9665.00, stdev=222.02, samples=4 00:27:30.162 write: IOPS=9679, BW=37.8MiB/s (39.6MB/s)(75.9MiB/2006msec); 0 zone resets 00:27:30.162 slat (nsec): min=1906, max=105008, avg=2410.40, stdev=1232.16 00:27:30.162 clat (usec): min=1512, max=11325, avg=5902.14, stdev=489.02 00:27:30.162 lat (usec): min=1521, max=11327, avg=5904.55, stdev=488.96 00:27:30.162 clat percentiles (usec): 00:27:30.162 | 1.00th=[ 4817], 5.00th=[ 5145], 10.00th=[ 5342], 20.00th=[ 5538], 00:27:30.162 | 30.00th=[ 5669], 40.00th=[ 5800], 50.00th=[ 5932], 60.00th=[ 5997], 00:27:30.162 | 70.00th=[ 6128], 80.00th=[ 6259], 90.00th=[ 6456], 95.00th=[ 6587], 00:27:30.162 | 99.00th=[ 6915], 99.50th=[ 7046], 99.90th=[ 9503], 99.95th=[10945], 00:27:30.162 | 99.99th=[11207] 00:27:30.162 bw ( KiB/s): min=38208, max=39232, per=100.00%, avg=38720.00, stdev=421.30, samples=4 00:27:30.162 iops : min= 9552, max= 9808, avg=9680.00, stdev=105.32, samples=4 00:27:30.162 lat (msec) : 2=0.02%, 4=0.10%, 10=99.76%, 20=0.12% 00:27:30.162 cpu : usr=64.89%, sys=32.97%, ctx=78, majf=0, minf=36 00:27:30.162 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:27:30.162 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:30.162 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:27:30.162 issued rwts: total=19399,19418,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:30.162 latency : target=0, window=0, percentile=100.00%, depth=128 00:27:30.162 00:27:30.162 Run status group 0 (all jobs): 00:27:30.162 READ: bw=37.8MiB/s (39.6MB/s), 37.8MiB/s-37.8MiB/s (39.6MB/s-39.6MB/s), io=75.8MiB (79.5MB), run=2006-2006msec 00:27:30.162 WRITE: bw=37.8MiB/s (39.6MB/s), 37.8MiB/s-37.8MiB/s (39.6MB/s-39.6MB/s), io=75.9MiB (79.5MB), run=2006-2006msec 00:27:30.162 01:28:38 -- host/fio.sh@45 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:27:30.162 01:28:38 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:27:30.162 01:28:38 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:27:30.162 01:28:38 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:30.162 01:28:38 -- common/autotest_common.sh@1328 -- # local sanitizers 00:27:30.162 01:28:38 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:30.162 01:28:38 -- common/autotest_common.sh@1330 -- # shift 00:27:30.162 01:28:38 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:27:30.162 01:28:38 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:30.162 01:28:38 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:30.162 01:28:38 -- common/autotest_common.sh@1334 -- # grep libasan 00:27:30.162 01:28:38 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:30.162 01:28:38 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:30.162 01:28:38 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:30.162 01:28:38 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:30.162 01:28:38 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:30.162 01:28:38 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:27:30.162 01:28:38 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:30.162 01:28:38 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:30.162 01:28:38 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:30.162 01:28:38 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:30.162 01:28:38 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:27:30.162 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:27:30.162 fio-3.35 00:27:30.162 Starting 1 thread 00:27:30.162 EAL: No free 2048 kB hugepages reported on node 1 00:27:32.062 [2024-11-20 01:28:39.759746] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2035610 is same with the state(5) to be set 00:27:32.062 [2024-11-20 01:28:39.759817] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2035610 is same with the state(5) to be set 00:27:32.062 [2024-11-20 01:28:39.759849] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2035610 is same with the state(5) to be set 00:27:32.320 [2024-11-20 01:28:40.534186] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2037140 is same with the state(5) to be set 00:27:32.578 00:27:32.578 test: (groupid=0, jobs=1): err= 0: pid=1242385: Wed Nov 20 01:28:40 2024 00:27:32.578 read: IOPS=8971, BW=140MiB/s (147MB/s)(282MiB/2009msec) 00:27:32.578 slat (usec): min=2, max=134, avg= 3.54, stdev= 1.84 00:27:32.578 clat (usec): min=2112, max=16517, avg=8351.95, stdev=1912.97 00:27:32.578 lat (usec): min=2115, max=16520, avg=8355.48, stdev=1913.06 00:27:32.578 clat percentiles (usec): 00:27:32.578 | 1.00th=[ 4359], 5.00th=[ 5276], 10.00th=[ 5866], 20.00th=[ 6718], 00:27:32.578 | 30.00th=[ 7308], 40.00th=[ 7767], 50.00th=[ 8291], 60.00th=[ 8848], 00:27:32.578 | 70.00th=[ 9372], 80.00th=[10028], 90.00th=[10814], 95.00th=[11469], 00:27:32.578 | 99.00th=[13042], 99.50th=[13698], 99.90th=[14484], 99.95th=[16057], 00:27:32.578 | 99.99th=[16450] 00:27:32.578 bw ( KiB/s): min=66240, max=79776, per=49.08%, avg=70448.00, stdev=6347.22, samples=4 00:27:32.578 iops : min= 4140, max= 4986, avg=4403.00, stdev=396.70, samples=4 00:27:32.578 write: IOPS=5172, BW=80.8MiB/s (84.7MB/s)(144MiB/1783msec); 0 zone resets 00:27:32.578 slat (usec): min=30, max=148, avg=32.87, stdev= 4.65 00:27:32.578 clat (usec): min=5615, max=18233, avg=10570.89, stdev=1905.71 00:27:32.578 lat (usec): min=5648, max=18264, avg=10603.76, stdev=1905.87 00:27:32.578 clat percentiles (usec): 00:27:32.578 | 1.00th=[ 7046], 5.00th=[ 7898], 10.00th=[ 8356], 20.00th=[ 8979], 00:27:32.578 | 30.00th=[ 9372], 40.00th=[ 9896], 50.00th=[10290], 60.00th=[10814], 00:27:32.578 | 70.00th=[11338], 80.00th=[12125], 90.00th=[13304], 95.00th=[13960], 00:27:32.578 | 99.00th=[15795], 99.50th=[16581], 99.90th=[17957], 99.95th=[17957], 00:27:32.578 | 99.99th=[18220] 00:27:32.578 bw ( KiB/s): min=68960, max=81632, per=88.51%, avg=73248.00, stdev=5836.29, samples=4 00:27:32.578 iops : min= 4310, max= 5102, avg=4578.00, stdev=364.77, samples=4 00:27:32.578 lat (msec) : 4=0.33%, 10=67.49%, 20=32.18% 00:27:32.578 cpu : usr=76.89%, sys=21.56%, ctx=44, majf=0, minf=56 00:27:32.578 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.4% 00:27:32.578 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:32.578 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:27:32.578 issued rwts: total=18024,9222,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:32.578 latency : target=0, window=0, percentile=100.00%, depth=128 00:27:32.578 00:27:32.578 Run status group 0 (all jobs): 00:27:32.578 READ: bw=140MiB/s (147MB/s), 140MiB/s-140MiB/s (147MB/s-147MB/s), io=282MiB (295MB), run=2009-2009msec 00:27:32.578 WRITE: bw=80.8MiB/s (84.7MB/s), 80.8MiB/s-80.8MiB/s (84.7MB/s-84.7MB/s), io=144MiB (151MB), run=1783-1783msec 00:27:32.579 01:28:40 -- host/fio.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:32.836 01:28:40 -- host/fio.sh@49 -- # '[' 1 -eq 1 ']' 00:27:32.836 01:28:40 -- host/fio.sh@51 -- # bdfs=($(get_nvme_bdfs)) 00:27:32.836 01:28:40 -- host/fio.sh@51 -- # get_nvme_bdfs 00:27:32.836 01:28:40 -- common/autotest_common.sh@1508 -- # bdfs=() 00:27:32.836 01:28:40 -- common/autotest_common.sh@1508 -- # local bdfs 00:27:32.836 01:28:40 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:27:32.836 01:28:40 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:27:32.836 01:28:40 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:27:32.836 01:28:40 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:27:32.836 01:28:40 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:27:32.836 01:28:40 -- host/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 -i 10.0.0.2 00:27:36.127 Nvme0n1 00:27:36.127 01:28:43 -- host/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore -c 1073741824 Nvme0n1 lvs_0 00:27:39.465 01:28:46 -- host/fio.sh@53 -- # ls_guid=32e6cf7c-80a9-4289-b2cd-413f8d784144 00:27:39.465 01:28:46 -- host/fio.sh@54 -- # get_lvs_free_mb 32e6cf7c-80a9-4289-b2cd-413f8d784144 00:27:39.465 01:28:46 -- common/autotest_common.sh@1353 -- # local lvs_uuid=32e6cf7c-80a9-4289-b2cd-413f8d784144 00:27:39.465 01:28:46 -- common/autotest_common.sh@1354 -- # local lvs_info 00:27:39.465 01:28:46 -- common/autotest_common.sh@1355 -- # local fc 00:27:39.465 01:28:46 -- common/autotest_common.sh@1356 -- # local cs 00:27:39.465 01:28:46 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:27:39.465 01:28:47 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:27:39.465 { 00:27:39.465 "uuid": "32e6cf7c-80a9-4289-b2cd-413f8d784144", 00:27:39.465 "name": "lvs_0", 00:27:39.465 "base_bdev": "Nvme0n1", 00:27:39.465 "total_data_clusters": 930, 00:27:39.465 "free_clusters": 930, 00:27:39.465 "block_size": 512, 00:27:39.465 "cluster_size": 1073741824 00:27:39.465 } 00:27:39.465 ]' 00:27:39.465 01:28:47 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="32e6cf7c-80a9-4289-b2cd-413f8d784144") .free_clusters' 00:27:39.465 01:28:47 -- common/autotest_common.sh@1358 -- # fc=930 00:27:39.465 01:28:47 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="32e6cf7c-80a9-4289-b2cd-413f8d784144") .cluster_size' 00:27:39.465 01:28:47 -- common/autotest_common.sh@1359 -- # cs=1073741824 00:27:39.465 01:28:47 -- common/autotest_common.sh@1362 -- # free_mb=952320 00:27:39.465 01:28:47 -- common/autotest_common.sh@1363 -- # echo 952320 00:27:39.465 952320 00:27:39.465 01:28:47 -- host/fio.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_0 lbd_0 952320 00:27:39.465 b06855f1-e395-4f69-8b21-62f460c75d02 00:27:39.465 01:28:47 -- host/fio.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000001 00:27:39.747 01:28:47 -- host/fio.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 lvs_0/lbd_0 00:27:40.005 01:28:48 -- host/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:27:40.263 01:28:48 -- host/fio.sh@59 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:40.263 01:28:48 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:40.263 01:28:48 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:27:40.263 01:28:48 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:40.263 01:28:48 -- common/autotest_common.sh@1328 -- # local sanitizers 00:27:40.263 01:28:48 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:40.263 01:28:48 -- common/autotest_common.sh@1330 -- # shift 00:27:40.263 01:28:48 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:27:40.263 01:28:48 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:40.263 01:28:48 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:40.263 01:28:48 -- common/autotest_common.sh@1334 -- # grep libasan 00:27:40.263 01:28:48 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:40.263 01:28:48 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:40.263 01:28:48 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:40.263 01:28:48 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:40.263 01:28:48 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:40.263 01:28:48 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:27:40.263 01:28:48 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:40.263 01:28:48 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:40.263 01:28:48 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:40.263 01:28:48 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:40.263 01:28:48 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:40.521 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:27:40.521 fio-3.35 00:27:40.521 Starting 1 thread 00:27:40.521 EAL: No free 2048 kB hugepages reported on node 1 00:27:43.051 00:27:43.051 test: (groupid=0, jobs=1): err= 0: pid=1243826: Wed Nov 20 01:28:51 2024 00:27:43.051 read: IOPS=6325, BW=24.7MiB/s (25.9MB/s)(49.6MiB/2008msec) 00:27:43.051 slat (nsec): min=1813, max=136254, avg=2421.93, stdev=1978.04 00:27:43.051 clat (usec): min=985, max=170729, avg=11107.95, stdev=11362.03 00:27:43.051 lat (usec): min=987, max=170760, avg=11110.37, stdev=11362.25 00:27:43.051 clat percentiles (msec): 00:27:43.051 | 1.00th=[ 9], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 10], 00:27:43.051 | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 11], 60.00th=[ 11], 00:27:43.051 | 70.00th=[ 11], 80.00th=[ 11], 90.00th=[ 12], 95.00th=[ 12], 00:27:43.051 | 99.00th=[ 13], 99.50th=[ 157], 99.90th=[ 171], 99.95th=[ 171], 00:27:43.051 | 99.99th=[ 171] 00:27:43.051 bw ( KiB/s): min=17856, max=27920, per=99.89%, avg=25276.00, stdev=4948.66, samples=4 00:27:43.051 iops : min= 4464, max= 6980, avg=6319.00, stdev=1237.17, samples=4 00:27:43.051 write: IOPS=6324, BW=24.7MiB/s (25.9MB/s)(49.6MiB/2008msec); 0 zone resets 00:27:43.051 slat (nsec): min=1877, max=92830, avg=2510.19, stdev=1375.06 00:27:43.051 clat (usec): min=251, max=169043, avg=8998.25, stdev=10659.06 00:27:43.051 lat (usec): min=253, max=169048, avg=9000.76, stdev=10659.26 00:27:43.051 clat percentiles (msec): 00:27:43.051 | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 8], 00:27:43.051 | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 9], 60.00th=[ 9], 00:27:43.051 | 70.00th=[ 9], 80.00th=[ 9], 90.00th=[ 10], 95.00th=[ 10], 00:27:43.051 | 99.00th=[ 11], 99.50th=[ 15], 99.90th=[ 169], 99.95th=[ 169], 00:27:43.051 | 99.99th=[ 169] 00:27:43.051 bw ( KiB/s): min=18872, max=27448, per=99.90%, avg=25272.00, stdev=4266.90, samples=4 00:27:43.051 iops : min= 4718, max= 6862, avg=6318.00, stdev=1066.72, samples=4 00:27:43.051 lat (usec) : 500=0.01%, 750=0.01%, 1000=0.01% 00:27:43.051 lat (msec) : 2=0.03%, 4=0.16%, 10=67.19%, 20=32.09%, 250=0.50% 00:27:43.051 cpu : usr=63.13%, sys=35.13%, ctx=96, majf=0, minf=36 00:27:43.051 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:27:43.051 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:43.051 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:27:43.051 issued rwts: total=12702,12699,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:43.051 latency : target=0, window=0, percentile=100.00%, depth=128 00:27:43.051 00:27:43.051 Run status group 0 (all jobs): 00:27:43.051 READ: bw=24.7MiB/s (25.9MB/s), 24.7MiB/s-24.7MiB/s (25.9MB/s-25.9MB/s), io=49.6MiB (52.0MB), run=2008-2008msec 00:27:43.051 WRITE: bw=24.7MiB/s (25.9MB/s), 24.7MiB/s-24.7MiB/s (25.9MB/s-25.9MB/s), io=49.6MiB (52.0MB), run=2008-2008msec 00:27:43.051 01:28:51 -- host/fio.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:27:43.309 01:28:51 -- host/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --clear-method none lvs_0/lbd_0 lvs_n_0 00:27:44.686 01:28:52 -- host/fio.sh@64 -- # ls_nested_guid=628e48c6-f505-4f19-bfc4-dc59215d5c9a 00:27:44.686 01:28:52 -- host/fio.sh@65 -- # get_lvs_free_mb 628e48c6-f505-4f19-bfc4-dc59215d5c9a 00:27:44.686 01:28:52 -- common/autotest_common.sh@1353 -- # local lvs_uuid=628e48c6-f505-4f19-bfc4-dc59215d5c9a 00:27:44.686 01:28:52 -- common/autotest_common.sh@1354 -- # local lvs_info 00:27:44.686 01:28:52 -- common/autotest_common.sh@1355 -- # local fc 00:27:44.686 01:28:52 -- common/autotest_common.sh@1356 -- # local cs 00:27:44.686 01:28:52 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:27:44.686 01:28:52 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:27:44.686 { 00:27:44.686 "uuid": "32e6cf7c-80a9-4289-b2cd-413f8d784144", 00:27:44.686 "name": "lvs_0", 00:27:44.686 "base_bdev": "Nvme0n1", 00:27:44.686 "total_data_clusters": 930, 00:27:44.686 "free_clusters": 0, 00:27:44.686 "block_size": 512, 00:27:44.686 "cluster_size": 1073741824 00:27:44.686 }, 00:27:44.686 { 00:27:44.686 "uuid": "628e48c6-f505-4f19-bfc4-dc59215d5c9a", 00:27:44.686 "name": "lvs_n_0", 00:27:44.686 "base_bdev": "b06855f1-e395-4f69-8b21-62f460c75d02", 00:27:44.686 "total_data_clusters": 237847, 00:27:44.686 "free_clusters": 237847, 00:27:44.686 "block_size": 512, 00:27:44.686 "cluster_size": 4194304 00:27:44.686 } 00:27:44.686 ]' 00:27:44.686 01:28:52 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="628e48c6-f505-4f19-bfc4-dc59215d5c9a") .free_clusters' 00:27:44.686 01:28:52 -- common/autotest_common.sh@1358 -- # fc=237847 00:27:44.686 01:28:52 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="628e48c6-f505-4f19-bfc4-dc59215d5c9a") .cluster_size' 00:27:44.686 01:28:52 -- common/autotest_common.sh@1359 -- # cs=4194304 00:27:44.686 01:28:52 -- common/autotest_common.sh@1362 -- # free_mb=951388 00:27:44.686 01:28:52 -- common/autotest_common.sh@1363 -- # echo 951388 00:27:44.686 951388 00:27:44.686 01:28:52 -- host/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_n_0 lbd_nest_0 951388 00:27:45.624 06d6927e-988e-484f-93b3-f3d8af770592 00:27:45.624 01:28:53 -- host/fio.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000001 00:27:45.624 01:28:53 -- host/fio.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 lvs_n_0/lbd_nest_0 00:27:45.882 01:28:54 -- host/fio.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:27:46.141 01:28:54 -- host/fio.sh@70 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:46.141 01:28:54 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:46.141 01:28:54 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:27:46.141 01:28:54 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:46.141 01:28:54 -- common/autotest_common.sh@1328 -- # local sanitizers 00:27:46.141 01:28:54 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:46.141 01:28:54 -- common/autotest_common.sh@1330 -- # shift 00:27:46.141 01:28:54 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:27:46.141 01:28:54 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:46.141 01:28:54 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:46.141 01:28:54 -- common/autotest_common.sh@1334 -- # grep libasan 00:27:46.141 01:28:54 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:46.141 01:28:54 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:46.141 01:28:54 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:46.141 01:28:54 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:46.141 01:28:54 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:46.141 01:28:54 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:27:46.141 01:28:54 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:46.141 01:28:54 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:46.141 01:28:54 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:46.141 01:28:54 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:46.141 01:28:54 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:46.401 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:27:46.401 fio-3.35 00:27:46.401 Starting 1 thread 00:27:46.401 EAL: No free 2048 kB hugepages reported on node 1 00:27:48.934 00:27:48.934 test: (groupid=0, jobs=1): err= 0: pid=1244584: Wed Nov 20 01:28:56 2024 00:27:48.934 read: IOPS=5394, BW=21.1MiB/s (22.1MB/s)(42.3MiB/2009msec) 00:27:48.934 slat (nsec): min=1861, max=158981, avg=2641.00, stdev=2619.72 00:27:48.934 clat (usec): min=5668, max=22097, avg=13055.47, stdev=1209.93 00:27:48.934 lat (usec): min=5675, max=22099, avg=13058.11, stdev=1209.79 00:27:48.934 clat percentiles (usec): 00:27:48.934 | 1.00th=[10290], 5.00th=[11076], 10.00th=[11600], 20.00th=[12125], 00:27:48.934 | 30.00th=[12518], 40.00th=[12780], 50.00th=[13042], 60.00th=[13304], 00:27:48.934 | 70.00th=[13698], 80.00th=[14091], 90.00th=[14484], 95.00th=[14877], 00:27:48.934 | 99.00th=[15664], 99.50th=[16188], 99.90th=[19530], 99.95th=[21365], 00:27:48.934 | 99.99th=[22152] 00:27:48.934 bw ( KiB/s): min=20472, max=22048, per=99.81%, avg=21536.00, stdev=725.11, samples=4 00:27:48.934 iops : min= 5118, max= 5512, avg=5384.00, stdev=181.28, samples=4 00:27:48.934 write: IOPS=5370, BW=21.0MiB/s (22.0MB/s)(42.1MiB/2009msec); 0 zone resets 00:27:48.934 slat (nsec): min=1986, max=131383, avg=2741.97, stdev=2126.86 00:27:48.934 clat (usec): min=2915, max=19426, avg=10535.77, stdev=989.34 00:27:48.934 lat (usec): min=2923, max=19429, avg=10538.51, stdev=989.28 00:27:48.934 clat percentiles (usec): 00:27:48.934 | 1.00th=[ 8356], 5.00th=[ 8979], 10.00th=[ 9372], 20.00th=[ 9765], 00:27:48.934 | 30.00th=[10028], 40.00th=[10290], 50.00th=[10552], 60.00th=[10683], 00:27:48.934 | 70.00th=[10945], 80.00th=[11338], 90.00th=[11731], 95.00th=[12125], 00:27:48.934 | 99.00th=[12649], 99.50th=[13042], 99.90th=[15533], 99.95th=[17433], 00:27:48.934 | 99.99th=[19268] 00:27:48.935 bw ( KiB/s): min=21344, max=21632, per=99.91%, avg=21462.00, stdev=130.86, samples=4 00:27:48.935 iops : min= 5336, max= 5408, avg=5365.50, stdev=32.72, samples=4 00:27:48.935 lat (msec) : 4=0.03%, 10=14.02%, 20=85.92%, 50=0.03% 00:27:48.935 cpu : usr=57.27%, sys=41.24%, ctx=101, majf=0, minf=36 00:27:48.935 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:27:48.935 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:48.935 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:27:48.935 issued rwts: total=10837,10789,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:48.935 latency : target=0, window=0, percentile=100.00%, depth=128 00:27:48.935 00:27:48.935 Run status group 0 (all jobs): 00:27:48.935 READ: bw=21.1MiB/s (22.1MB/s), 21.1MiB/s-21.1MiB/s (22.1MB/s-22.1MB/s), io=42.3MiB (44.4MB), run=2009-2009msec 00:27:48.935 WRITE: bw=21.0MiB/s (22.0MB/s), 21.0MiB/s-21.0MiB/s (22.0MB/s-22.0MB/s), io=42.1MiB (44.2MB), run=2009-2009msec 00:27:48.935 01:28:56 -- host/fio.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:27:49.193 01:28:57 -- host/fio.sh@74 -- # sync 00:27:49.193 01:28:57 -- host/fio.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -t 120 bdev_lvol_delete lvs_n_0/lbd_nest_0 00:27:53.384 01:29:01 -- host/fio.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:27:53.384 01:29:01 -- host/fio.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete lvs_0/lbd_0 00:27:56.672 01:29:04 -- host/fio.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:27:56.672 01:29:04 -- host/fio.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_detach_controller Nvme0 00:27:58.577 01:29:06 -- host/fio.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:27:58.577 01:29:06 -- host/fio.sh@85 -- # rm -f ./local-test-0-verify.state 00:27:58.577 01:29:06 -- host/fio.sh@86 -- # nvmftestfini 00:27:58.577 01:29:06 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:58.577 01:29:06 -- nvmf/common.sh@116 -- # sync 00:27:58.577 01:29:06 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:58.577 01:29:06 -- nvmf/common.sh@119 -- # set +e 00:27:58.577 01:29:06 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:58.577 01:29:06 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:58.577 rmmod nvme_tcp 00:27:58.577 rmmod nvme_fabrics 00:27:58.577 rmmod nvme_keyring 00:27:58.577 01:29:06 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:58.577 01:29:06 -- nvmf/common.sh@123 -- # set -e 00:27:58.577 01:29:06 -- nvmf/common.sh@124 -- # return 0 00:27:58.577 01:29:06 -- nvmf/common.sh@477 -- # '[' -n 1241557 ']' 00:27:58.577 01:29:06 -- nvmf/common.sh@478 -- # killprocess 1241557 00:27:58.577 01:29:06 -- common/autotest_common.sh@936 -- # '[' -z 1241557 ']' 00:27:58.577 01:29:06 -- common/autotest_common.sh@940 -- # kill -0 1241557 00:27:58.577 01:29:06 -- common/autotest_common.sh@941 -- # uname 00:27:58.577 01:29:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:58.577 01:29:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1241557 00:27:58.577 01:29:06 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:58.577 01:29:06 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:58.577 01:29:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1241557' 00:27:58.577 killing process with pid 1241557 00:27:58.577 01:29:06 -- common/autotest_common.sh@955 -- # kill 1241557 00:27:58.577 01:29:06 -- common/autotest_common.sh@960 -- # wait 1241557 00:27:58.577 01:29:06 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:58.577 01:29:06 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:58.577 01:29:06 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:58.577 01:29:06 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:58.577 01:29:06 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:58.577 01:29:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:58.577 01:29:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:58.577 01:29:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:01.129 01:29:08 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:01.129 00:28:01.129 real 0m38.201s 00:28:01.129 user 2m25.981s 00:28:01.129 sys 0m7.296s 00:28:01.129 01:29:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:01.129 01:29:08 -- common/autotest_common.sh@10 -- # set +x 00:28:01.129 ************************************ 00:28:01.129 END TEST nvmf_fio_host 00:28:01.129 ************************************ 00:28:01.129 01:29:08 -- nvmf/nvmf.sh@100 -- # run_test nvmf_failover /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:28:01.129 01:29:08 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:01.129 01:29:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:01.129 01:29:08 -- common/autotest_common.sh@10 -- # set +x 00:28:01.129 ************************************ 00:28:01.129 START TEST nvmf_failover 00:28:01.129 ************************************ 00:28:01.129 01:29:08 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:28:01.129 * Looking for test storage... 00:28:01.129 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:28:01.129 01:29:08 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:01.129 01:29:08 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:01.129 01:29:08 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:01.129 01:29:08 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:01.129 01:29:08 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:01.129 01:29:08 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:01.129 01:29:08 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:01.129 01:29:08 -- scripts/common.sh@335 -- # IFS=.-: 00:28:01.129 01:29:08 -- scripts/common.sh@335 -- # read -ra ver1 00:28:01.129 01:29:08 -- scripts/common.sh@336 -- # IFS=.-: 00:28:01.129 01:29:08 -- scripts/common.sh@336 -- # read -ra ver2 00:28:01.129 01:29:08 -- scripts/common.sh@337 -- # local 'op=<' 00:28:01.129 01:29:08 -- scripts/common.sh@339 -- # ver1_l=2 00:28:01.129 01:29:08 -- scripts/common.sh@340 -- # ver2_l=1 00:28:01.129 01:29:08 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:01.129 01:29:08 -- scripts/common.sh@343 -- # case "$op" in 00:28:01.129 01:29:08 -- scripts/common.sh@344 -- # : 1 00:28:01.129 01:29:08 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:01.129 01:29:08 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:01.129 01:29:08 -- scripts/common.sh@364 -- # decimal 1 00:28:01.129 01:29:08 -- scripts/common.sh@352 -- # local d=1 00:28:01.129 01:29:08 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:01.129 01:29:08 -- scripts/common.sh@354 -- # echo 1 00:28:01.129 01:29:08 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:01.129 01:29:08 -- scripts/common.sh@365 -- # decimal 2 00:28:01.129 01:29:08 -- scripts/common.sh@352 -- # local d=2 00:28:01.129 01:29:08 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:01.129 01:29:08 -- scripts/common.sh@354 -- # echo 2 00:28:01.129 01:29:08 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:01.129 01:29:08 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:01.129 01:29:08 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:01.129 01:29:08 -- scripts/common.sh@367 -- # return 0 00:28:01.129 01:29:08 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:01.129 01:29:08 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:01.129 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:01.129 --rc genhtml_branch_coverage=1 00:28:01.129 --rc genhtml_function_coverage=1 00:28:01.129 --rc genhtml_legend=1 00:28:01.129 --rc geninfo_all_blocks=1 00:28:01.129 --rc geninfo_unexecuted_blocks=1 00:28:01.129 00:28:01.129 ' 00:28:01.129 01:29:08 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:01.129 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:01.129 --rc genhtml_branch_coverage=1 00:28:01.129 --rc genhtml_function_coverage=1 00:28:01.129 --rc genhtml_legend=1 00:28:01.129 --rc geninfo_all_blocks=1 00:28:01.129 --rc geninfo_unexecuted_blocks=1 00:28:01.129 00:28:01.129 ' 00:28:01.129 01:29:08 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:01.129 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:01.129 --rc genhtml_branch_coverage=1 00:28:01.129 --rc genhtml_function_coverage=1 00:28:01.129 --rc genhtml_legend=1 00:28:01.129 --rc geninfo_all_blocks=1 00:28:01.129 --rc geninfo_unexecuted_blocks=1 00:28:01.129 00:28:01.129 ' 00:28:01.129 01:29:08 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:01.129 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:01.129 --rc genhtml_branch_coverage=1 00:28:01.129 --rc genhtml_function_coverage=1 00:28:01.129 --rc genhtml_legend=1 00:28:01.129 --rc geninfo_all_blocks=1 00:28:01.129 --rc geninfo_unexecuted_blocks=1 00:28:01.129 00:28:01.129 ' 00:28:01.129 01:29:08 -- host/failover.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:01.129 01:29:08 -- nvmf/common.sh@7 -- # uname -s 00:28:01.129 01:29:08 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:01.129 01:29:08 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:01.129 01:29:08 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:01.129 01:29:08 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:01.129 01:29:08 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:01.130 01:29:08 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:01.130 01:29:08 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:01.130 01:29:08 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:01.130 01:29:08 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:01.130 01:29:08 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:01.130 01:29:08 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:01.130 01:29:08 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:01.130 01:29:08 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:01.130 01:29:08 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:01.130 01:29:08 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:01.130 01:29:08 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:01.130 01:29:08 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:01.130 01:29:08 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:01.130 01:29:08 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:01.130 01:29:08 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:01.130 01:29:08 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:01.130 01:29:08 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:01.130 01:29:08 -- paths/export.sh@5 -- # export PATH 00:28:01.130 01:29:08 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:01.130 01:29:08 -- nvmf/common.sh@46 -- # : 0 00:28:01.130 01:29:08 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:01.130 01:29:08 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:01.130 01:29:08 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:01.130 01:29:08 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:01.130 01:29:08 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:01.130 01:29:08 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:01.130 01:29:08 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:01.130 01:29:08 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:01.130 01:29:08 -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:28:01.130 01:29:08 -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:28:01.130 01:29:08 -- host/failover.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:28:01.130 01:29:08 -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:28:01.130 01:29:08 -- host/failover.sh@18 -- # nvmftestinit 00:28:01.130 01:29:08 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:01.130 01:29:08 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:01.130 01:29:08 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:01.130 01:29:08 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:01.130 01:29:08 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:01.130 01:29:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:01.130 01:29:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:01.130 01:29:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:01.130 01:29:08 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:01.130 01:29:08 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:01.130 01:29:08 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:01.130 01:29:08 -- common/autotest_common.sh@10 -- # set +x 00:28:03.042 01:29:10 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:03.042 01:29:10 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:03.042 01:29:10 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:03.042 01:29:10 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:03.042 01:29:10 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:03.042 01:29:10 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:03.042 01:29:10 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:03.042 01:29:10 -- nvmf/common.sh@294 -- # net_devs=() 00:28:03.042 01:29:10 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:03.042 01:29:10 -- nvmf/common.sh@295 -- # e810=() 00:28:03.042 01:29:10 -- nvmf/common.sh@295 -- # local -ga e810 00:28:03.042 01:29:10 -- nvmf/common.sh@296 -- # x722=() 00:28:03.042 01:29:10 -- nvmf/common.sh@296 -- # local -ga x722 00:28:03.042 01:29:10 -- nvmf/common.sh@297 -- # mlx=() 00:28:03.042 01:29:10 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:03.042 01:29:10 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:03.042 01:29:10 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:03.042 01:29:10 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:03.042 01:29:10 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:03.042 01:29:10 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:03.042 01:29:10 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:03.042 01:29:10 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:03.042 01:29:10 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:03.042 01:29:10 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:03.042 01:29:10 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:03.042 01:29:10 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:03.042 01:29:10 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:03.042 01:29:10 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:03.042 01:29:10 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:03.042 01:29:10 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:03.042 01:29:10 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:03.042 01:29:10 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:03.042 01:29:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:03.042 01:29:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:03.042 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:03.042 01:29:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:03.042 01:29:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:03.042 01:29:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:03.042 01:29:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:03.042 01:29:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:03.042 01:29:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:03.042 01:29:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:03.042 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:03.042 01:29:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:03.042 01:29:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:03.042 01:29:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:03.042 01:29:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:03.042 01:29:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:03.042 01:29:10 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:03.042 01:29:10 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:03.042 01:29:10 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:03.042 01:29:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:03.042 01:29:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:03.042 01:29:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:03.042 01:29:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:03.042 01:29:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:03.042 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:03.042 01:29:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:03.042 01:29:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:03.042 01:29:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:03.042 01:29:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:03.042 01:29:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:03.042 01:29:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:03.042 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:03.042 01:29:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:03.042 01:29:10 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:03.042 01:29:10 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:03.042 01:29:10 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:03.042 01:29:10 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:03.042 01:29:10 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:03.042 01:29:10 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:03.042 01:29:10 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:03.042 01:29:10 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:03.042 01:29:10 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:03.043 01:29:10 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:03.043 01:29:10 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:03.043 01:29:10 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:03.043 01:29:10 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:03.043 01:29:10 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:03.043 01:29:10 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:03.043 01:29:10 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:03.043 01:29:10 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:03.043 01:29:10 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:03.043 01:29:10 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:03.043 01:29:10 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:03.043 01:29:10 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:03.043 01:29:10 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:03.043 01:29:10 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:03.043 01:29:10 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:03.043 01:29:10 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:03.043 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:03.043 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.305 ms 00:28:03.043 00:28:03.043 --- 10.0.0.2 ping statistics --- 00:28:03.043 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:03.043 rtt min/avg/max/mdev = 0.305/0.305/0.305/0.000 ms 00:28:03.043 01:29:11 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:03.043 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:03.043 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.187 ms 00:28:03.043 00:28:03.043 --- 10.0.0.1 ping statistics --- 00:28:03.043 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:03.043 rtt min/avg/max/mdev = 0.187/0.187/0.187/0.000 ms 00:28:03.043 01:29:11 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:03.043 01:29:11 -- nvmf/common.sh@410 -- # return 0 00:28:03.043 01:29:11 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:28:03.043 01:29:11 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:03.043 01:29:11 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:03.043 01:29:11 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:03.043 01:29:11 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:03.043 01:29:11 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:03.043 01:29:11 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:03.043 01:29:11 -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:28:03.043 01:29:11 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:03.043 01:29:11 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:03.043 01:29:11 -- common/autotest_common.sh@10 -- # set +x 00:28:03.043 01:29:11 -- nvmf/common.sh@469 -- # nvmfpid=1247886 00:28:03.043 01:29:11 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:28:03.043 01:29:11 -- nvmf/common.sh@470 -- # waitforlisten 1247886 00:28:03.043 01:29:11 -- common/autotest_common.sh@829 -- # '[' -z 1247886 ']' 00:28:03.043 01:29:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:03.043 01:29:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:03.043 01:29:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:03.043 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:03.043 01:29:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:03.043 01:29:11 -- common/autotest_common.sh@10 -- # set +x 00:28:03.043 [2024-11-20 01:29:11.081912] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:28:03.043 [2024-11-20 01:29:11.081998] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:03.043 EAL: No free 2048 kB hugepages reported on node 1 00:28:03.043 [2024-11-20 01:29:11.150998] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:28:03.043 [2024-11-20 01:29:11.241713] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:03.043 [2024-11-20 01:29:11.241854] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:03.043 [2024-11-20 01:29:11.241870] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:03.043 [2024-11-20 01:29:11.241883] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:03.043 [2024-11-20 01:29:11.241948] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:28:03.043 [2024-11-20 01:29:11.242004] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:28:03.043 [2024-11-20 01:29:11.242007] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:03.979 01:29:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:03.979 01:29:12 -- common/autotest_common.sh@862 -- # return 0 00:28:03.979 01:29:12 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:03.979 01:29:12 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:03.980 01:29:12 -- common/autotest_common.sh@10 -- # set +x 00:28:03.980 01:29:12 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:03.980 01:29:12 -- host/failover.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:28:04.237 [2024-11-20 01:29:12.353162] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:04.237 01:29:12 -- host/failover.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:28:04.496 Malloc0 00:28:04.496 01:29:12 -- host/failover.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:28:04.754 01:29:12 -- host/failover.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:28:05.012 01:29:13 -- host/failover.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:05.270 [2024-11-20 01:29:13.403859] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:05.270 01:29:13 -- host/failover.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:28:05.528 [2024-11-20 01:29:13.664624] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:28:05.528 01:29:13 -- host/failover.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:28:05.786 [2024-11-20 01:29:13.917468] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:28:05.786 01:29:13 -- host/failover.sh@31 -- # bdevperf_pid=1248318 00:28:05.786 01:29:13 -- host/failover.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:28:05.786 01:29:13 -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:05.786 01:29:13 -- host/failover.sh@34 -- # waitforlisten 1248318 /var/tmp/bdevperf.sock 00:28:05.786 01:29:13 -- common/autotest_common.sh@829 -- # '[' -z 1248318 ']' 00:28:05.786 01:29:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:28:05.786 01:29:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:05.786 01:29:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:28:05.787 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:28:05.787 01:29:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:05.787 01:29:13 -- common/autotest_common.sh@10 -- # set +x 00:28:06.724 01:29:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:06.724 01:29:14 -- common/autotest_common.sh@862 -- # return 0 00:28:06.724 01:29:14 -- host/failover.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:07.294 NVMe0n1 00:28:07.294 01:29:15 -- host/failover.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:07.552 00:28:07.552 01:29:15 -- host/failover.sh@39 -- # run_test_pid=1248487 00:28:07.552 01:29:15 -- host/failover.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:28:07.552 01:29:15 -- host/failover.sh@41 -- # sleep 1 00:28:08.490 01:29:16 -- host/failover.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:08.750 [2024-11-20 01:29:16.825769] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2244180 is same with the state(5) to be set 00:28:08.750 [2024-11-20 01:29:16.825842] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2244180 is same with the state(5) to be set 00:28:08.750 [2024-11-20 01:29:16.825866] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2244180 is same with the state(5) to be set 00:28:08.750 [2024-11-20 01:29:16.825878] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2244180 is same with the state(5) to be set 00:28:08.750 [2024-11-20 01:29:16.825889] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2244180 is same with the state(5) to be set 00:28:08.750 [2024-11-20 01:29:16.825900] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2244180 is same with the state(5) to be set 00:28:08.750 [2024-11-20 01:29:16.825912] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2244180 is same with the state(5) to be set 00:28:08.750 [2024-11-20 01:29:16.825922] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2244180 is same with the state(5) to be set 00:28:08.750 [2024-11-20 01:29:16.825933] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2244180 is same with the state(5) to be set 00:28:08.750 [2024-11-20 01:29:16.825944] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2244180 is same with the state(5) to be set 00:28:08.750 [2024-11-20 01:29:16.825955] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2244180 is same with the state(5) to be set 00:28:08.751 [2024-11-20 01:29:16.825966] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2244180 is same with the state(5) to be set 00:28:08.751 [2024-11-20 01:29:16.825977] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2244180 is same with the state(5) to be set 00:28:08.751 [2024-11-20 01:29:16.825988] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2244180 is same with the state(5) to be set 00:28:08.751 [2024-11-20 01:29:16.825999] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2244180 is same with the state(5) to be set 00:28:08.751 [2024-11-20 01:29:16.826010] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2244180 is same with the state(5) to be set 00:28:08.751 [2024-11-20 01:29:16.826021] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2244180 is same with the state(5) to be set 00:28:08.751 [2024-11-20 01:29:16.826033] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2244180 is same with the state(5) to be set 00:28:08.751 [2024-11-20 01:29:16.826055] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2244180 is same with the state(5) to be set 00:28:08.751 [2024-11-20 01:29:16.826067] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2244180 is same with the state(5) to be set 00:28:08.751 [2024-11-20 01:29:16.826104] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2244180 is same with the state(5) to be set 00:28:08.751 [2024-11-20 01:29:16.826116] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2244180 is same with the state(5) to be set 00:28:08.751 [2024-11-20 01:29:16.826127] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2244180 is same with the state(5) to be set 00:28:08.751 [2024-11-20 01:29:16.826138] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2244180 is same with the state(5) to be set 00:28:08.751 [2024-11-20 01:29:16.826150] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2244180 is same with the state(5) to be set 00:28:08.751 [2024-11-20 01:29:16.826161] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2244180 is same with the state(5) to be set 00:28:08.751 [2024-11-20 01:29:16.826171] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2244180 is same with the state(5) to be set 00:28:08.751 [2024-11-20 01:29:16.826182] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2244180 is same with the state(5) to be set 00:28:08.751 [2024-11-20 01:29:16.826193] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2244180 is same with the state(5) to be set 00:28:08.751 [2024-11-20 01:29:16.826205] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2244180 is same with the state(5) to be set 00:28:08.751 [2024-11-20 01:29:16.826216] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2244180 is same with the state(5) to be set 00:28:08.751 [2024-11-20 01:29:16.826227] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2244180 is same with the state(5) to be set 00:28:08.751 [2024-11-20 01:29:16.826239] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2244180 is same with the state(5) to be set 00:28:08.751 [2024-11-20 01:29:16.826250] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2244180 is same with the state(5) to be set 00:28:08.751 [2024-11-20 01:29:16.826261] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2244180 is same with the state(5) to be set 00:28:08.751 [2024-11-20 01:29:16.826272] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2244180 is same with the state(5) to be set 00:28:08.751 [2024-11-20 01:29:16.826283] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2244180 is same with the state(5) to be set 00:28:08.751 [2024-11-20 01:29:16.826295] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2244180 is same with the state(5) to be set 00:28:08.751 [2024-11-20 01:29:16.826306] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2244180 is same with the state(5) to be set 00:28:08.751 [2024-11-20 01:29:16.826316] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2244180 is same with the state(5) to be set 00:28:08.751 [2024-11-20 01:29:16.826328] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2244180 is same with the state(5) to be set 00:28:08.751 [2024-11-20 01:29:16.826339] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2244180 is same with the state(5) to be set 00:28:08.751 [2024-11-20 01:29:16.826350] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2244180 is same with the state(5) to be set 00:28:08.751 [2024-11-20 01:29:16.826361] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2244180 is same with the state(5) to be set 00:28:08.751 [2024-11-20 01:29:16.826373] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2244180 is same with the state(5) to be set 00:28:08.751 01:29:16 -- host/failover.sh@45 -- # sleep 3 00:28:12.040 01:29:19 -- host/failover.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:12.299 00:28:12.299 01:29:20 -- host/failover.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:28:12.558 [2024-11-20 01:29:20.613026] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2245530 is same with the state(5) to be set 00:28:12.558 [2024-11-20 01:29:20.613124] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2245530 is same with the state(5) to be set 00:28:12.558 [2024-11-20 01:29:20.613141] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2245530 is same with the state(5) to be set 00:28:12.558 [2024-11-20 01:29:20.613153] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2245530 is same with the state(5) to be set 00:28:12.558 [2024-11-20 01:29:20.613165] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2245530 is same with the state(5) to be set 00:28:12.558 [2024-11-20 01:29:20.613176] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2245530 is same with the state(5) to be set 00:28:12.558 [2024-11-20 01:29:20.613188] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2245530 is same with the state(5) to be set 00:28:12.558 [2024-11-20 01:29:20.613199] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2245530 is same with the state(5) to be set 00:28:12.558 [2024-11-20 01:29:20.613211] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2245530 is same with the state(5) to be set 00:28:12.558 [2024-11-20 01:29:20.613222] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2245530 is same with the state(5) to be set 00:28:12.558 [2024-11-20 01:29:20.613234] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2245530 is same with the state(5) to be set 00:28:12.558 [2024-11-20 01:29:20.613245] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2245530 is same with the state(5) to be set 00:28:12.558 [2024-11-20 01:29:20.613257] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2245530 is same with the state(5) to be set 00:28:12.558 [2024-11-20 01:29:20.613270] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2245530 is same with the state(5) to be set 00:28:12.558 [2024-11-20 01:29:20.613283] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2245530 is same with the state(5) to be set 00:28:12.558 [2024-11-20 01:29:20.613294] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2245530 is same with the state(5) to be set 00:28:12.558 [2024-11-20 01:29:20.613306] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2245530 is same with the state(5) to be set 00:28:12.558 [2024-11-20 01:29:20.613318] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2245530 is same with the state(5) to be set 00:28:12.558 [2024-11-20 01:29:20.613330] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2245530 is same with the state(5) to be set 00:28:12.558 [2024-11-20 01:29:20.613342] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2245530 is same with the state(5) to be set 00:28:12.558 [2024-11-20 01:29:20.613354] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2245530 is same with the state(5) to be set 00:28:12.558 [2024-11-20 01:29:20.613390] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2245530 is same with the state(5) to be set 00:28:12.558 [2024-11-20 01:29:20.613403] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2245530 is same with the state(5) to be set 00:28:12.558 [2024-11-20 01:29:20.613414] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2245530 is same with the state(5) to be set 00:28:12.558 [2024-11-20 01:29:20.613437] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2245530 is same with the state(5) to be set 00:28:12.558 [2024-11-20 01:29:20.613448] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2245530 is same with the state(5) to be set 00:28:12.558 [2024-11-20 01:29:20.613460] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2245530 is same with the state(5) to be set 00:28:12.558 [2024-11-20 01:29:20.613470] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2245530 is same with the state(5) to be set 00:28:12.558 [2024-11-20 01:29:20.613482] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2245530 is same with the state(5) to be set 00:28:12.558 [2024-11-20 01:29:20.613493] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2245530 is same with the state(5) to be set 00:28:12.558 [2024-11-20 01:29:20.613504] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2245530 is same with the state(5) to be set 00:28:12.558 [2024-11-20 01:29:20.613515] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2245530 is same with the state(5) to be set 00:28:12.558 [2024-11-20 01:29:20.613526] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2245530 is same with the state(5) to be set 00:28:12.558 [2024-11-20 01:29:20.613537] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2245530 is same with the state(5) to be set 00:28:12.558 [2024-11-20 01:29:20.613548] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2245530 is same with the state(5) to be set 00:28:12.558 [2024-11-20 01:29:20.613559] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2245530 is same with the state(5) to be set 00:28:12.558 [2024-11-20 01:29:20.613570] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2245530 is same with the state(5) to be set 00:28:12.558 [2024-11-20 01:29:20.613581] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2245530 is same with the state(5) to be set 00:28:12.558 [2024-11-20 01:29:20.613591] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2245530 is same with the state(5) to be set 00:28:12.558 [2024-11-20 01:29:20.613602] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2245530 is same with the state(5) to be set 00:28:12.558 [2024-11-20 01:29:20.613613] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2245530 is same with the state(5) to be set 00:28:12.558 [2024-11-20 01:29:20.613623] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2245530 is same with the state(5) to be set 00:28:12.558 [2024-11-20 01:29:20.613634] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2245530 is same with the state(5) to be set 00:28:12.558 [2024-11-20 01:29:20.613645] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2245530 is same with the state(5) to be set 00:28:12.559 [2024-11-20 01:29:20.613656] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2245530 is same with the state(5) to be set 00:28:12.559 [2024-11-20 01:29:20.613667] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2245530 is same with the state(5) to be set 00:28:12.559 [2024-11-20 01:29:20.613678] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2245530 is same with the state(5) to be set 00:28:12.559 [2024-11-20 01:29:20.613689] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2245530 is same with the state(5) to be set 00:28:12.559 [2024-11-20 01:29:20.613700] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2245530 is same with the state(5) to be set 00:28:12.559 [2024-11-20 01:29:20.613711] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2245530 is same with the state(5) to be set 00:28:12.559 [2024-11-20 01:29:20.613722] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2245530 is same with the state(5) to be set 00:28:12.559 01:29:20 -- host/failover.sh@50 -- # sleep 3 00:28:15.850 01:29:23 -- host/failover.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:15.850 [2024-11-20 01:29:23.919951] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:15.850 01:29:23 -- host/failover.sh@55 -- # sleep 1 00:28:16.787 01:29:24 -- host/failover.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:28:17.045 [2024-11-20 01:29:25.190609] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23fb5e0 is same with the state(5) to be set 00:28:17.045 [2024-11-20 01:29:25.190679] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23fb5e0 is same with the state(5) to be set 00:28:17.045 [2024-11-20 01:29:25.190702] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23fb5e0 is same with the state(5) to be set 00:28:17.045 [2024-11-20 01:29:25.190713] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23fb5e0 is same with the state(5) to be set 00:28:17.045 [2024-11-20 01:29:25.190725] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23fb5e0 is same with the state(5) to be set 00:28:17.045 [2024-11-20 01:29:25.190736] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23fb5e0 is same with the state(5) to be set 00:28:17.045 [2024-11-20 01:29:25.190747] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23fb5e0 is same with the state(5) to be set 00:28:17.045 [2024-11-20 01:29:25.190758] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23fb5e0 is same with the state(5) to be set 00:28:17.045 [2024-11-20 01:29:25.190769] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23fb5e0 is same with the state(5) to be set 00:28:17.045 [2024-11-20 01:29:25.190781] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23fb5e0 is same with the state(5) to be set 00:28:17.045 [2024-11-20 01:29:25.190792] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23fb5e0 is same with the state(5) to be set 00:28:17.045 [2024-11-20 01:29:25.190804] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23fb5e0 is same with the state(5) to be set 00:28:17.045 [2024-11-20 01:29:25.190816] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23fb5e0 is same with the state(5) to be set 00:28:17.045 [2024-11-20 01:29:25.190827] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23fb5e0 is same with the state(5) to be set 00:28:17.045 [2024-11-20 01:29:25.190838] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23fb5e0 is same with the state(5) to be set 00:28:17.045 [2024-11-20 01:29:25.190850] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23fb5e0 is same with the state(5) to be set 00:28:17.045 [2024-11-20 01:29:25.190862] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23fb5e0 is same with the state(5) to be set 00:28:17.045 [2024-11-20 01:29:25.190874] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23fb5e0 is same with the state(5) to be set 00:28:17.045 [2024-11-20 01:29:25.190885] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23fb5e0 is same with the state(5) to be set 00:28:17.045 [2024-11-20 01:29:25.190898] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23fb5e0 is same with the state(5) to be set 00:28:17.045 [2024-11-20 01:29:25.190910] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23fb5e0 is same with the state(5) to be set 00:28:17.045 [2024-11-20 01:29:25.190921] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23fb5e0 is same with the state(5) to be set 00:28:17.045 [2024-11-20 01:29:25.190933] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23fb5e0 is same with the state(5) to be set 00:28:17.045 [2024-11-20 01:29:25.190954] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23fb5e0 is same with the state(5) to be set 00:28:17.045 [2024-11-20 01:29:25.190967] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23fb5e0 is same with the state(5) to be set 00:28:17.045 [2024-11-20 01:29:25.190978] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23fb5e0 is same with the state(5) to be set 00:28:17.045 [2024-11-20 01:29:25.190990] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23fb5e0 is same with the state(5) to be set 00:28:17.045 [2024-11-20 01:29:25.191000] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23fb5e0 is same with the state(5) to be set 00:28:17.045 [2024-11-20 01:29:25.191012] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23fb5e0 is same with the state(5) to be set 00:28:17.045 [2024-11-20 01:29:25.191023] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23fb5e0 is same with the state(5) to be set 00:28:17.045 [2024-11-20 01:29:25.191033] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23fb5e0 is same with the state(5) to be set 00:28:17.045 [2024-11-20 01:29:25.191044] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23fb5e0 is same with the state(5) to be set 00:28:17.045 [2024-11-20 01:29:25.191055] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23fb5e0 is same with the state(5) to be set 00:28:17.045 [2024-11-20 01:29:25.191066] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23fb5e0 is same with the state(5) to be set 00:28:17.045 [2024-11-20 01:29:25.191104] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23fb5e0 is same with the state(5) to be set 00:28:17.045 [2024-11-20 01:29:25.191116] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23fb5e0 is same with the state(5) to be set 00:28:17.045 [2024-11-20 01:29:25.191128] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23fb5e0 is same with the state(5) to be set 00:28:17.045 01:29:25 -- host/failover.sh@59 -- # wait 1248487 00:28:23.691 0 00:28:23.691 01:29:30 -- host/failover.sh@61 -- # killprocess 1248318 00:28:23.691 01:29:30 -- common/autotest_common.sh@936 -- # '[' -z 1248318 ']' 00:28:23.691 01:29:30 -- common/autotest_common.sh@940 -- # kill -0 1248318 00:28:23.691 01:29:30 -- common/autotest_common.sh@941 -- # uname 00:28:23.691 01:29:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:23.691 01:29:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1248318 00:28:23.691 01:29:30 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:23.691 01:29:30 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:23.691 01:29:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1248318' 00:28:23.691 killing process with pid 1248318 00:28:23.691 01:29:30 -- common/autotest_common.sh@955 -- # kill 1248318 00:28:23.691 01:29:30 -- common/autotest_common.sh@960 -- # wait 1248318 00:28:23.691 01:29:31 -- host/failover.sh@63 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:28:23.691 [2024-11-20 01:29:13.974176] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:28:23.691 [2024-11-20 01:29:13.974279] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1248318 ] 00:28:23.691 EAL: No free 2048 kB hugepages reported on node 1 00:28:23.691 [2024-11-20 01:29:14.034836] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:23.691 [2024-11-20 01:29:14.118290] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:23.691 Running I/O for 15 seconds... 00:28:23.691 [2024-11-20 01:29:16.826662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:113152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.691 [2024-11-20 01:29:16.826702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.691 [2024-11-20 01:29:16.826731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:113160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.691 [2024-11-20 01:29:16.826748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.691 [2024-11-20 01:29:16.826765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:113168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.691 [2024-11-20 01:29:16.826779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.691 [2024-11-20 01:29:16.826795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:113176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.691 [2024-11-20 01:29:16.826810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.691 [2024-11-20 01:29:16.826825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:113184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.691 [2024-11-20 01:29:16.826838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.691 [2024-11-20 01:29:16.826854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:113216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.691 [2024-11-20 01:29:16.826867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.691 [2024-11-20 01:29:16.826883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:113232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.691 [2024-11-20 01:29:16.826897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.691 [2024-11-20 01:29:16.826911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:113240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.691 [2024-11-20 01:29:16.826926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.691 [2024-11-20 01:29:16.826941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:112656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.691 [2024-11-20 01:29:16.826955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.691 [2024-11-20 01:29:16.826969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:112688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.691 [2024-11-20 01:29:16.826983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.691 [2024-11-20 01:29:16.826998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:112696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.691 [2024-11-20 01:29:16.827027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.691 [2024-11-20 01:29:16.827049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:112704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.691 [2024-11-20 01:29:16.827063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.691 [2024-11-20 01:29:16.827102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:112712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.691 [2024-11-20 01:29:16.827117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.691 [2024-11-20 01:29:16.827132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:112720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.691 [2024-11-20 01:29:16.827146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.691 [2024-11-20 01:29:16.827161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:112744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.691 [2024-11-20 01:29:16.827175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.691 [2024-11-20 01:29:16.827189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:112752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.691 [2024-11-20 01:29:16.827203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.691 [2024-11-20 01:29:16.827218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:113264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.691 [2024-11-20 01:29:16.827233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.691 [2024-11-20 01:29:16.827248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:113280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.691 [2024-11-20 01:29:16.827262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.692 [2024-11-20 01:29:16.827276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:113296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.692 [2024-11-20 01:29:16.827290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.692 [2024-11-20 01:29:16.827305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:113304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.692 [2024-11-20 01:29:16.827318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.692 [2024-11-20 01:29:16.827333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:113320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.692 [2024-11-20 01:29:16.827346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.692 [2024-11-20 01:29:16.827361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:113328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.692 [2024-11-20 01:29:16.827375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.692 [2024-11-20 01:29:16.827390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:113352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.692 [2024-11-20 01:29:16.827403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.692 [2024-11-20 01:29:16.827418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:113376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.692 [2024-11-20 01:29:16.827437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.692 [2024-11-20 01:29:16.827454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:113384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.692 [2024-11-20 01:29:16.827468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.692 [2024-11-20 01:29:16.827484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:113392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.692 [2024-11-20 01:29:16.827499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.692 [2024-11-20 01:29:16.827515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:113400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.692 [2024-11-20 01:29:16.827530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.692 [2024-11-20 01:29:16.827546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:113408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.692 [2024-11-20 01:29:16.827560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.692 [2024-11-20 01:29:16.827574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:113416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.692 [2024-11-20 01:29:16.827588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.692 [2024-11-20 01:29:16.827603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:112760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.692 [2024-11-20 01:29:16.827616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.692 [2024-11-20 01:29:16.827631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:112768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.692 [2024-11-20 01:29:16.827645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.692 [2024-11-20 01:29:16.827660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:112776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.692 [2024-11-20 01:29:16.827673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.692 [2024-11-20 01:29:16.827688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:112800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.692 [2024-11-20 01:29:16.827703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.692 [2024-11-20 01:29:16.827718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:112808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.692 [2024-11-20 01:29:16.827731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.692 [2024-11-20 01:29:16.827746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:112816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.692 [2024-11-20 01:29:16.827760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.692 [2024-11-20 01:29:16.827775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:112824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.692 [2024-11-20 01:29:16.827788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.692 [2024-11-20 01:29:16.827807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:112840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.692 [2024-11-20 01:29:16.827821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.692 [2024-11-20 01:29:16.827837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:113424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.692 [2024-11-20 01:29:16.827851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.692 [2024-11-20 01:29:16.827867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:113432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.692 [2024-11-20 01:29:16.827880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.692 [2024-11-20 01:29:16.827895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:113440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.692 [2024-11-20 01:29:16.827908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.692 [2024-11-20 01:29:16.827923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:113448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.692 [2024-11-20 01:29:16.827937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.692 [2024-11-20 01:29:16.827952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:113456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.692 [2024-11-20 01:29:16.827965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.692 [2024-11-20 01:29:16.827981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:112856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.692 [2024-11-20 01:29:16.827994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.692 [2024-11-20 01:29:16.828009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:112880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.692 [2024-11-20 01:29:16.828023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.692 [2024-11-20 01:29:16.828037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:112904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.692 [2024-11-20 01:29:16.828051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.692 [2024-11-20 01:29:16.828066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:112936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.692 [2024-11-20 01:29:16.828102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.692 [2024-11-20 01:29:16.828119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:112952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.692 [2024-11-20 01:29:16.828134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.692 [2024-11-20 01:29:16.828149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:112960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.692 [2024-11-20 01:29:16.828163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.692 [2024-11-20 01:29:16.828179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:112984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.692 [2024-11-20 01:29:16.828197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.692 [2024-11-20 01:29:16.828212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:112992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.692 [2024-11-20 01:29:16.828226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.692 [2024-11-20 01:29:16.828242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:113464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.692 [2024-11-20 01:29:16.828256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.692 [2024-11-20 01:29:16.828271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:113472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.692 [2024-11-20 01:29:16.828285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.692 [2024-11-20 01:29:16.828300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:113480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.692 [2024-11-20 01:29:16.828314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.692 [2024-11-20 01:29:16.828329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:113488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.692 [2024-11-20 01:29:16.828353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.692 [2024-11-20 01:29:16.828368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:113496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.692 [2024-11-20 01:29:16.828397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.692 [2024-11-20 01:29:16.828413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:113504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.692 [2024-11-20 01:29:16.828426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.692 [2024-11-20 01:29:16.828441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:113512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.693 [2024-11-20 01:29:16.828454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.693 [2024-11-20 01:29:16.828469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:113520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.693 [2024-11-20 01:29:16.828482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.693 [2024-11-20 01:29:16.828497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:113528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.693 [2024-11-20 01:29:16.828510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.693 [2024-11-20 01:29:16.828524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:113536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.693 [2024-11-20 01:29:16.828538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.693 [2024-11-20 01:29:16.828552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:113544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.693 [2024-11-20 01:29:16.828566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.693 [2024-11-20 01:29:16.828584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:113552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.693 [2024-11-20 01:29:16.828599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.693 [2024-11-20 01:29:16.828614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:113560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.693 [2024-11-20 01:29:16.828627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.693 [2024-11-20 01:29:16.828644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:113568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.693 [2024-11-20 01:29:16.828658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.693 [2024-11-20 01:29:16.828673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:113576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.693 [2024-11-20 01:29:16.828687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.693 [2024-11-20 01:29:16.828702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:113584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.693 [2024-11-20 01:29:16.828717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.693 [2024-11-20 01:29:16.828732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:113592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.693 [2024-11-20 01:29:16.828746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.693 [2024-11-20 01:29:16.828761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:113600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.693 [2024-11-20 01:29:16.828775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.693 [2024-11-20 01:29:16.828790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:113608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.693 [2024-11-20 01:29:16.828804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.693 [2024-11-20 01:29:16.828819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:113616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.693 [2024-11-20 01:29:16.828833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.693 [2024-11-20 01:29:16.828848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:113624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.693 [2024-11-20 01:29:16.828861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.693 [2024-11-20 01:29:16.828876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:113632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.693 [2024-11-20 01:29:16.828891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.693 [2024-11-20 01:29:16.828906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:113640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.693 [2024-11-20 01:29:16.828920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.693 [2024-11-20 01:29:16.828935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:113648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.693 [2024-11-20 01:29:16.828952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.693 [2024-11-20 01:29:16.828970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:113656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.693 [2024-11-20 01:29:16.828984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.693 [2024-11-20 01:29:16.828999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:113664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.693 [2024-11-20 01:29:16.829012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.693 [2024-11-20 01:29:16.829028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:113672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.693 [2024-11-20 01:29:16.829042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.693 [2024-11-20 01:29:16.829080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:113680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.693 [2024-11-20 01:29:16.829096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.693 [2024-11-20 01:29:16.829111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:113688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.693 [2024-11-20 01:29:16.829126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.693 [2024-11-20 01:29:16.829142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:113696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.693 [2024-11-20 01:29:16.829156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.693 [2024-11-20 01:29:16.829171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:113704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.693 [2024-11-20 01:29:16.829184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.693 [2024-11-20 01:29:16.829200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:113712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.693 [2024-11-20 01:29:16.829214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.693 [2024-11-20 01:29:16.829229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:113720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.693 [2024-11-20 01:29:16.829242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.693 [2024-11-20 01:29:16.829257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:113728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.693 [2024-11-20 01:29:16.829271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.693 [2024-11-20 01:29:16.829287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:113736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.693 [2024-11-20 01:29:16.829301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.693 [2024-11-20 01:29:16.829316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:113744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.693 [2024-11-20 01:29:16.829329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.693 [2024-11-20 01:29:16.829345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:113752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.693 [2024-11-20 01:29:16.829363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.693 [2024-11-20 01:29:16.829394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:113760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.693 [2024-11-20 01:29:16.829408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.693 [2024-11-20 01:29:16.829423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:113768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.693 [2024-11-20 01:29:16.829437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.693 [2024-11-20 01:29:16.829452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:113776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.693 [2024-11-20 01:29:16.829466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.693 [2024-11-20 01:29:16.829480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:113016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.693 [2024-11-20 01:29:16.829494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.693 [2024-11-20 01:29:16.829509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:113032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.693 [2024-11-20 01:29:16.829522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.693 [2024-11-20 01:29:16.829537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:113040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.693 [2024-11-20 01:29:16.829551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.693 [2024-11-20 01:29:16.829567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:113072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.693 [2024-11-20 01:29:16.829580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.693 [2024-11-20 01:29:16.829594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:113080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.693 [2024-11-20 01:29:16.829607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.693 [2024-11-20 01:29:16.829623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:113088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.694 [2024-11-20 01:29:16.829637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.694 [2024-11-20 01:29:16.829651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:113112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.694 [2024-11-20 01:29:16.829664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.694 [2024-11-20 01:29:16.829679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:113120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.694 [2024-11-20 01:29:16.829693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.694 [2024-11-20 01:29:16.829707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:113128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.694 [2024-11-20 01:29:16.829721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.694 [2024-11-20 01:29:16.829739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:113136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.694 [2024-11-20 01:29:16.829753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.694 [2024-11-20 01:29:16.829768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:113144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.694 [2024-11-20 01:29:16.829781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.694 [2024-11-20 01:29:16.829796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:113192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.694 [2024-11-20 01:29:16.829809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.694 [2024-11-20 01:29:16.829823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:113200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.694 [2024-11-20 01:29:16.829837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.694 [2024-11-20 01:29:16.829852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:113208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.694 [2024-11-20 01:29:16.829865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.694 [2024-11-20 01:29:16.829880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:113224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.694 [2024-11-20 01:29:16.829894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.694 [2024-11-20 01:29:16.829909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:113248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.694 [2024-11-20 01:29:16.829922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.694 [2024-11-20 01:29:16.829937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:113784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.694 [2024-11-20 01:29:16.829950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.694 [2024-11-20 01:29:16.829965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:113792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.694 [2024-11-20 01:29:16.829979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.694 [2024-11-20 01:29:16.829994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:113800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.694 [2024-11-20 01:29:16.830007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.694 [2024-11-20 01:29:16.830022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:113808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.694 [2024-11-20 01:29:16.830035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.694 [2024-11-20 01:29:16.830050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:113816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.694 [2024-11-20 01:29:16.830064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.694 [2024-11-20 01:29:16.830106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:113824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.694 [2024-11-20 01:29:16.830126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.694 [2024-11-20 01:29:16.830142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:113832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.694 [2024-11-20 01:29:16.830157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.694 [2024-11-20 01:29:16.830173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:113840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.694 [2024-11-20 01:29:16.830188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.694 [2024-11-20 01:29:16.830203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:113848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.694 [2024-11-20 01:29:16.830217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.694 [2024-11-20 01:29:16.830233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:113856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.694 [2024-11-20 01:29:16.830247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.694 [2024-11-20 01:29:16.830263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:113864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.694 [2024-11-20 01:29:16.830277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.694 [2024-11-20 01:29:16.830292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:113872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.694 [2024-11-20 01:29:16.830307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.694 [2024-11-20 01:29:16.830322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:113880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.694 [2024-11-20 01:29:16.830336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.694 [2024-11-20 01:29:16.830352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:113888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.694 [2024-11-20 01:29:16.830367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.694 [2024-11-20 01:29:16.830398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:113256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.694 [2024-11-20 01:29:16.830412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.694 [2024-11-20 01:29:16.830427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:113272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.694 [2024-11-20 01:29:16.830442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.694 [2024-11-20 01:29:16.830457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:113288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.694 [2024-11-20 01:29:16.830472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.694 [2024-11-20 01:29:16.830486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:113312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.694 [2024-11-20 01:29:16.830500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.694 [2024-11-20 01:29:16.830519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:113336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.694 [2024-11-20 01:29:16.830533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.694 [2024-11-20 01:29:16.830548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:113344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.694 [2024-11-20 01:29:16.830562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.694 [2024-11-20 01:29:16.830577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:113360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.694 [2024-11-20 01:29:16.830597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.694 [2024-11-20 01:29:16.830617] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c92c70 is same with the state(5) to be set 00:28:23.694 [2024-11-20 01:29:16.830634] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:28:23.694 [2024-11-20 01:29:16.830646] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:28:23.694 [2024-11-20 01:29:16.830657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:113368 len:8 PRP1 0x0 PRP2 0x0 00:28:23.694 [2024-11-20 01:29:16.830669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.694 [2024-11-20 01:29:16.830732] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1c92c70 was disconnected and freed. reset controller. 00:28:23.694 [2024-11-20 01:29:16.830764] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:28:23.694 [2024-11-20 01:29:16.830799] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:23.694 [2024-11-20 01:29:16.830833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.694 [2024-11-20 01:29:16.830849] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:23.694 [2024-11-20 01:29:16.830863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.694 [2024-11-20 01:29:16.830878] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:23.694 [2024-11-20 01:29:16.830890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.694 [2024-11-20 01:29:16.830904] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:23.694 [2024-11-20 01:29:16.830917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.695 [2024-11-20 01:29:16.830930] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:23.695 [2024-11-20 01:29:16.833200] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:23.695 [2024-11-20 01:29:16.833239] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c73600 (9): Bad file descriptor 00:28:23.695 [2024-11-20 01:29:16.906347] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:23.695 [2024-11-20 01:29:20.613857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:3200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.695 [2024-11-20 01:29:20.613899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.695 [2024-11-20 01:29:20.613934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:3232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.695 [2024-11-20 01:29:20.613951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.695 [2024-11-20 01:29:20.613968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:3240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.695 [2024-11-20 01:29:20.613982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.695 [2024-11-20 01:29:20.613997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:2480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.695 [2024-11-20 01:29:20.614011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.695 [2024-11-20 01:29:20.614025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:2488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.695 [2024-11-20 01:29:20.614039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.695 [2024-11-20 01:29:20.614087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:2504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.695 [2024-11-20 01:29:20.614104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.695 [2024-11-20 01:29:20.614119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:2512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.695 [2024-11-20 01:29:20.614133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.695 [2024-11-20 01:29:20.614148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:2520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.695 [2024-11-20 01:29:20.614162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.695 [2024-11-20 01:29:20.614177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:2528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.695 [2024-11-20 01:29:20.614191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.695 [2024-11-20 01:29:20.614207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:2560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.695 [2024-11-20 01:29:20.614221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.695 [2024-11-20 01:29:20.614236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:2568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.695 [2024-11-20 01:29:20.614250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.695 [2024-11-20 01:29:20.614265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:2616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.695 [2024-11-20 01:29:20.614279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.695 [2024-11-20 01:29:20.614294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:2640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.695 [2024-11-20 01:29:20.614308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.695 [2024-11-20 01:29:20.614324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:2648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.695 [2024-11-20 01:29:20.614342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.695 [2024-11-20 01:29:20.614357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.695 [2024-11-20 01:29:20.614373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.695 [2024-11-20 01:29:20.614402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:2672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.695 [2024-11-20 01:29:20.614416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.695 [2024-11-20 01:29:20.614430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:2680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.695 [2024-11-20 01:29:20.614443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.695 [2024-11-20 01:29:20.614458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:2712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.695 [2024-11-20 01:29:20.614471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.695 [2024-11-20 01:29:20.614486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:2728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.695 [2024-11-20 01:29:20.614499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.695 [2024-11-20 01:29:20.614512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:3264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.695 [2024-11-20 01:29:20.614525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.695 [2024-11-20 01:29:20.614539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:3272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.695 [2024-11-20 01:29:20.614553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.695 [2024-11-20 01:29:20.614567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:3288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.695 [2024-11-20 01:29:20.614580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.695 [2024-11-20 01:29:20.614594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:3296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.695 [2024-11-20 01:29:20.614607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.695 [2024-11-20 01:29:20.614621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:3312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.695 [2024-11-20 01:29:20.614634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.695 [2024-11-20 01:29:20.614648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:3328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.695 [2024-11-20 01:29:20.614660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.695 [2024-11-20 01:29:20.614674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:3336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.695 [2024-11-20 01:29:20.614687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.695 [2024-11-20 01:29:20.614701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:3368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.695 [2024-11-20 01:29:20.614717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.695 [2024-11-20 01:29:20.614732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:2736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.695 [2024-11-20 01:29:20.614744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.695 [2024-11-20 01:29:20.614758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:2760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.695 [2024-11-20 01:29:20.614771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.695 [2024-11-20 01:29:20.614785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:2776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.695 [2024-11-20 01:29:20.614798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.695 [2024-11-20 01:29:20.614812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:2784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.695 [2024-11-20 01:29:20.614825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.695 [2024-11-20 01:29:20.614839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:2800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.695 [2024-11-20 01:29:20.614851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.695 [2024-11-20 01:29:20.614865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:2808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.696 [2024-11-20 01:29:20.614878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.696 [2024-11-20 01:29:20.614892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:2840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.696 [2024-11-20 01:29:20.614905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.696 [2024-11-20 01:29:20.614919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:2848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.696 [2024-11-20 01:29:20.614932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.696 [2024-11-20 01:29:20.614948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:3384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.696 [2024-11-20 01:29:20.614961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.696 [2024-11-20 01:29:20.614976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:3392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.696 [2024-11-20 01:29:20.614991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.696 [2024-11-20 01:29:20.615005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:3400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.696 [2024-11-20 01:29:20.615019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.696 [2024-11-20 01:29:20.615033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:3408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.696 [2024-11-20 01:29:20.615046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.696 [2024-11-20 01:29:20.615096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:3416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.696 [2024-11-20 01:29:20.615112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.696 [2024-11-20 01:29:20.615126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:3440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.696 [2024-11-20 01:29:20.615140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.696 [2024-11-20 01:29:20.615170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:3448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.696 [2024-11-20 01:29:20.615185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.696 [2024-11-20 01:29:20.615199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:3456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.696 [2024-11-20 01:29:20.615213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.696 [2024-11-20 01:29:20.615228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.696 [2024-11-20 01:29:20.615241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.696 [2024-11-20 01:29:20.615256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:3472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.696 [2024-11-20 01:29:20.615270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.696 [2024-11-20 01:29:20.615285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:3480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.696 [2024-11-20 01:29:20.615298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.696 [2024-11-20 01:29:20.615313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:3488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.696 [2024-11-20 01:29:20.615327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.696 [2024-11-20 01:29:20.615342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:3496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.696 [2024-11-20 01:29:20.615355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.696 [2024-11-20 01:29:20.615376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:2880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.696 [2024-11-20 01:29:20.615405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.696 [2024-11-20 01:29:20.615420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:2896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.696 [2024-11-20 01:29:20.615439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.696 [2024-11-20 01:29:20.615468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:2904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.696 [2024-11-20 01:29:20.615481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.696 [2024-11-20 01:29:20.615495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:2912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.696 [2024-11-20 01:29:20.615511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.696 [2024-11-20 01:29:20.615526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:2920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.696 [2024-11-20 01:29:20.615539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.696 [2024-11-20 01:29:20.615553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:2928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.696 [2024-11-20 01:29:20.615566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.696 [2024-11-20 01:29:20.615579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:2944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.696 [2024-11-20 01:29:20.615593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.696 [2024-11-20 01:29:20.615607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:2952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.696 [2024-11-20 01:29:20.615620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.696 [2024-11-20 01:29:20.615633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:3504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.696 [2024-11-20 01:29:20.615646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.696 [2024-11-20 01:29:20.615660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:3512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.696 [2024-11-20 01:29:20.615674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.696 [2024-11-20 01:29:20.615688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:3520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.696 [2024-11-20 01:29:20.615700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.696 [2024-11-20 01:29:20.615715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:3528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.696 [2024-11-20 01:29:20.615727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.696 [2024-11-20 01:29:20.615742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:3536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.696 [2024-11-20 01:29:20.615754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.696 [2024-11-20 01:29:20.615770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:3544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.696 [2024-11-20 01:29:20.615782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.696 [2024-11-20 01:29:20.615796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:3552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.696 [2024-11-20 01:29:20.615809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.696 [2024-11-20 01:29:20.615823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:3560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.696 [2024-11-20 01:29:20.615836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.696 [2024-11-20 01:29:20.615856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:3568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.696 [2024-11-20 01:29:20.615870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.696 [2024-11-20 01:29:20.615885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:3576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.696 [2024-11-20 01:29:20.615898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.696 [2024-11-20 01:29:20.615912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:3584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.696 [2024-11-20 01:29:20.615925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.696 [2024-11-20 01:29:20.615939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:3592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.696 [2024-11-20 01:29:20.615952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.696 [2024-11-20 01:29:20.615966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:3600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.696 [2024-11-20 01:29:20.615979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.696 [2024-11-20 01:29:20.615993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:3608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.696 [2024-11-20 01:29:20.616006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.696 [2024-11-20 01:29:20.616020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:3616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.696 [2024-11-20 01:29:20.616033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.696 [2024-11-20 01:29:20.616047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:3624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.697 [2024-11-20 01:29:20.616094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.697 [2024-11-20 01:29:20.616112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:3632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.697 [2024-11-20 01:29:20.616126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.697 [2024-11-20 01:29:20.616141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:3640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.697 [2024-11-20 01:29:20.616154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.697 [2024-11-20 01:29:20.616168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:3648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.697 [2024-11-20 01:29:20.616182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.697 [2024-11-20 01:29:20.616197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:3656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.697 [2024-11-20 01:29:20.616210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.697 [2024-11-20 01:29:20.616224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:3664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.697 [2024-11-20 01:29:20.616238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.697 [2024-11-20 01:29:20.616257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:3672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.697 [2024-11-20 01:29:20.616270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.697 [2024-11-20 01:29:20.616285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:3680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.697 [2024-11-20 01:29:20.616299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.697 [2024-11-20 01:29:20.616314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:3688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.697 [2024-11-20 01:29:20.616328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.697 [2024-11-20 01:29:20.616343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:3696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.697 [2024-11-20 01:29:20.616356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.697 [2024-11-20 01:29:20.616371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:3704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.697 [2024-11-20 01:29:20.616402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.697 [2024-11-20 01:29:20.616416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:2960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.697 [2024-11-20 01:29:20.616430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.697 [2024-11-20 01:29:20.616448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:2984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.697 [2024-11-20 01:29:20.616461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.697 [2024-11-20 01:29:20.616476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:2992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.697 [2024-11-20 01:29:20.616489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.697 [2024-11-20 01:29:20.616504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:3024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.697 [2024-11-20 01:29:20.616517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.697 [2024-11-20 01:29:20.616531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:3048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.697 [2024-11-20 01:29:20.616545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.697 [2024-11-20 01:29:20.616559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:3056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.697 [2024-11-20 01:29:20.616573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.697 [2024-11-20 01:29:20.616587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:3072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.697 [2024-11-20 01:29:20.616600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.697 [2024-11-20 01:29:20.616615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:3080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.697 [2024-11-20 01:29:20.616631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.697 [2024-11-20 01:29:20.616647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:3712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.697 [2024-11-20 01:29:20.616661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.697 [2024-11-20 01:29:20.616675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:3720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.697 [2024-11-20 01:29:20.616688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.697 [2024-11-20 01:29:20.616704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:3088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.697 [2024-11-20 01:29:20.616718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.697 [2024-11-20 01:29:20.616732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:3096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.697 [2024-11-20 01:29:20.616746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.697 [2024-11-20 01:29:20.616760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:3104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.697 [2024-11-20 01:29:20.616774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.697 [2024-11-20 01:29:20.616789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:3112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.697 [2024-11-20 01:29:20.616803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.697 [2024-11-20 01:29:20.616832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:3128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.697 [2024-11-20 01:29:20.616847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.697 [2024-11-20 01:29:20.616862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:3136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.697 [2024-11-20 01:29:20.616875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.697 [2024-11-20 01:29:20.616890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:3144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.697 [2024-11-20 01:29:20.616903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.697 [2024-11-20 01:29:20.616918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:3168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.697 [2024-11-20 01:29:20.616931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.697 [2024-11-20 01:29:20.616946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:3728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.697 [2024-11-20 01:29:20.616959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.697 [2024-11-20 01:29:20.616974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:3736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.697 [2024-11-20 01:29:20.616988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.697 [2024-11-20 01:29:20.617006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:3744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.697 [2024-11-20 01:29:20.617020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.697 [2024-11-20 01:29:20.617035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:3752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.697 [2024-11-20 01:29:20.617048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.697 [2024-11-20 01:29:20.617062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:3760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.697 [2024-11-20 01:29:20.617099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.697 [2024-11-20 01:29:20.617116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:3768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.697 [2024-11-20 01:29:20.617136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.697 [2024-11-20 01:29:20.617151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:3776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.697 [2024-11-20 01:29:20.617164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.697 [2024-11-20 01:29:20.617179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:3784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.697 [2024-11-20 01:29:20.617193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.697 [2024-11-20 01:29:20.617208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:3184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.697 [2024-11-20 01:29:20.617222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.697 [2024-11-20 01:29:20.617237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:3192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.697 [2024-11-20 01:29:20.617251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.697 [2024-11-20 01:29:20.617266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:3208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.698 [2024-11-20 01:29:20.617280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.698 [2024-11-20 01:29:20.617295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:3216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.698 [2024-11-20 01:29:20.617309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.698 [2024-11-20 01:29:20.617324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:3224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.698 [2024-11-20 01:29:20.617338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.698 [2024-11-20 01:29:20.617352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:3248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.698 [2024-11-20 01:29:20.617366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.698 [2024-11-20 01:29:20.617406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:3256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.698 [2024-11-20 01:29:20.617419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.698 [2024-11-20 01:29:20.617438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:3280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.698 [2024-11-20 01:29:20.617452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.698 [2024-11-20 01:29:20.617467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:3792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.698 [2024-11-20 01:29:20.617480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.698 [2024-11-20 01:29:20.617494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:3800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.698 [2024-11-20 01:29:20.617507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.698 [2024-11-20 01:29:20.617523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:3808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.698 [2024-11-20 01:29:20.617537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.698 [2024-11-20 01:29:20.617551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:3816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.698 [2024-11-20 01:29:20.617565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.698 [2024-11-20 01:29:20.617579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:3304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.698 [2024-11-20 01:29:20.617593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.698 [2024-11-20 01:29:20.617607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:3320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.698 [2024-11-20 01:29:20.617621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.698 [2024-11-20 01:29:20.617635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:3344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.698 [2024-11-20 01:29:20.617648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.698 [2024-11-20 01:29:20.617663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:3352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.698 [2024-11-20 01:29:20.617677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.698 [2024-11-20 01:29:20.617691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:3360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.698 [2024-11-20 01:29:20.617704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.698 [2024-11-20 01:29:20.617718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:3376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.698 [2024-11-20 01:29:20.617741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.698 [2024-11-20 01:29:20.617756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.698 [2024-11-20 01:29:20.617770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.698 [2024-11-20 01:29:20.617784] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c7fa90 is same with the state(5) to be set 00:28:23.698 [2024-11-20 01:29:20.617804] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:28:23.698 [2024-11-20 01:29:20.617816] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:28:23.698 [2024-11-20 01:29:20.617827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:3432 len:8 PRP1 0x0 PRP2 0x0 00:28:23.698 [2024-11-20 01:29:20.617840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.698 [2024-11-20 01:29:20.617902] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1c7fa90 was disconnected and freed. reset controller. 00:28:23.698 [2024-11-20 01:29:20.617920] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4421 to 10.0.0.2:4422 00:28:23.698 [2024-11-20 01:29:20.617952] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:23.698 [2024-11-20 01:29:20.617985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.698 [2024-11-20 01:29:20.618000] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:23.698 [2024-11-20 01:29:20.618014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.698 [2024-11-20 01:29:20.618028] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:23.698 [2024-11-20 01:29:20.618041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.698 [2024-11-20 01:29:20.618054] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:23.698 [2024-11-20 01:29:20.618067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.698 [2024-11-20 01:29:20.618088] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:23.698 [2024-11-20 01:29:20.618137] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c73600 (9): Bad file descriptor 00:28:23.698 [2024-11-20 01:29:20.620412] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:23.698 [2024-11-20 01:29:20.769818] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:23.698 [2024-11-20 01:29:25.191278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:9176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.698 [2024-11-20 01:29:25.191318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.698 [2024-11-20 01:29:25.191347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:9184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.698 [2024-11-20 01:29:25.191363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.698 [2024-11-20 01:29:25.191396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:8584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.698 [2024-11-20 01:29:25.191411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.698 [2024-11-20 01:29:25.191426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:8592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.698 [2024-11-20 01:29:25.191440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.698 [2024-11-20 01:29:25.191455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:8608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.698 [2024-11-20 01:29:25.191475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.698 [2024-11-20 01:29:25.191491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:8616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.698 [2024-11-20 01:29:25.191505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.698 [2024-11-20 01:29:25.191535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:8640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.698 [2024-11-20 01:29:25.191548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.698 [2024-11-20 01:29:25.191562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:8664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.698 [2024-11-20 01:29:25.191575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.698 [2024-11-20 01:29:25.191590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:8672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.698 [2024-11-20 01:29:25.191602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.698 [2024-11-20 01:29:25.191616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:8688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.698 [2024-11-20 01:29:25.191629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.698 [2024-11-20 01:29:25.191643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:9192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.698 [2024-11-20 01:29:25.191657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.698 [2024-11-20 01:29:25.191671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:9208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.698 [2024-11-20 01:29:25.191684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.698 [2024-11-20 01:29:25.191698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:9216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.698 [2024-11-20 01:29:25.191710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.698 [2024-11-20 01:29:25.191725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:9288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.698 [2024-11-20 01:29:25.191738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.699 [2024-11-20 01:29:25.191753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:9304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.699 [2024-11-20 01:29:25.191766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.699 [2024-11-20 01:29:25.191780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:9320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.699 [2024-11-20 01:29:25.191793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.699 [2024-11-20 01:29:25.191807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:9344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.699 [2024-11-20 01:29:25.191821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.699 [2024-11-20 01:29:25.191839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:8696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.699 [2024-11-20 01:29:25.191853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.699 [2024-11-20 01:29:25.191868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:8704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.699 [2024-11-20 01:29:25.191882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.699 [2024-11-20 01:29:25.191896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:8720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.699 [2024-11-20 01:29:25.191908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.699 [2024-11-20 01:29:25.191923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:8728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.699 [2024-11-20 01:29:25.191937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.699 [2024-11-20 01:29:25.191951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:8736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.699 [2024-11-20 01:29:25.191964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.699 [2024-11-20 01:29:25.191978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:8752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.699 [2024-11-20 01:29:25.191991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.699 [2024-11-20 01:29:25.192005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:8776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.699 [2024-11-20 01:29:25.192018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.699 [2024-11-20 01:29:25.192033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:8792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.699 [2024-11-20 01:29:25.192060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.699 [2024-11-20 01:29:25.192084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:9360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.699 [2024-11-20 01:29:25.192099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.699 [2024-11-20 01:29:25.192130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:9376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.699 [2024-11-20 01:29:25.192146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.699 [2024-11-20 01:29:25.192161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:9384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.699 [2024-11-20 01:29:25.192176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.699 [2024-11-20 01:29:25.192191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:9392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.699 [2024-11-20 01:29:25.192206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.699 [2024-11-20 01:29:25.192221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:9400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.699 [2024-11-20 01:29:25.192235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.699 [2024-11-20 01:29:25.192254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:9408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.699 [2024-11-20 01:29:25.192268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.699 [2024-11-20 01:29:25.192283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:9416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.699 [2024-11-20 01:29:25.192297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.699 [2024-11-20 01:29:25.192312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:9424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.699 [2024-11-20 01:29:25.192326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.699 [2024-11-20 01:29:25.192342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:9432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.699 [2024-11-20 01:29:25.192355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.699 [2024-11-20 01:29:25.192386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:9440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.699 [2024-11-20 01:29:25.192400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.699 [2024-11-20 01:29:25.192415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:9448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.699 [2024-11-20 01:29:25.192442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.699 [2024-11-20 01:29:25.192457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:9456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.699 [2024-11-20 01:29:25.192470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.699 [2024-11-20 01:29:25.192484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.699 [2024-11-20 01:29:25.192497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.699 [2024-11-20 01:29:25.192511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:8808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.699 [2024-11-20 01:29:25.192524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.699 [2024-11-20 01:29:25.192538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:8848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.699 [2024-11-20 01:29:25.192551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.699 [2024-11-20 01:29:25.192565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:8880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.699 [2024-11-20 01:29:25.192578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.699 [2024-11-20 01:29:25.192592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:8888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.699 [2024-11-20 01:29:25.192605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.699 [2024-11-20 01:29:25.192619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:8896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.699 [2024-11-20 01:29:25.192636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.699 [2024-11-20 01:29:25.192650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:8912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.699 [2024-11-20 01:29:25.192678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.699 [2024-11-20 01:29:25.192694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:8920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.699 [2024-11-20 01:29:25.192708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.699 [2024-11-20 01:29:25.192722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:9464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.699 [2024-11-20 01:29:25.192735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.699 [2024-11-20 01:29:25.192750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:9472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.699 [2024-11-20 01:29:25.192763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.699 [2024-11-20 01:29:25.192778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:9480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.699 [2024-11-20 01:29:25.192792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.699 [2024-11-20 01:29:25.192807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:9488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.699 [2024-11-20 01:29:25.192821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.699 [2024-11-20 01:29:25.192836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:9496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.699 [2024-11-20 01:29:25.192849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.699 [2024-11-20 01:29:25.192864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:9504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.699 [2024-11-20 01:29:25.192877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.699 [2024-11-20 01:29:25.192892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:9512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.699 [2024-11-20 01:29:25.192905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.699 [2024-11-20 01:29:25.192920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:9520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.700 [2024-11-20 01:29:25.192934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.700 [2024-11-20 01:29:25.192948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:9528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.700 [2024-11-20 01:29:25.192961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.700 [2024-11-20 01:29:25.192976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.700 [2024-11-20 01:29:25.193005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.700 [2024-11-20 01:29:25.193023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:9544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.700 [2024-11-20 01:29:25.193036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.700 [2024-11-20 01:29:25.193050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:9552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.700 [2024-11-20 01:29:25.193063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.700 [2024-11-20 01:29:25.193103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:9560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.700 [2024-11-20 01:29:25.193118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.700 [2024-11-20 01:29:25.193133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:8928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.700 [2024-11-20 01:29:25.193147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.700 [2024-11-20 01:29:25.193161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:8952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.700 [2024-11-20 01:29:25.193175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.700 [2024-11-20 01:29:25.193190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:8976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.700 [2024-11-20 01:29:25.193203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.700 [2024-11-20 01:29:25.193218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:8992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.700 [2024-11-20 01:29:25.193232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.700 [2024-11-20 01:29:25.193246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:9000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.700 [2024-11-20 01:29:25.193260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.700 [2024-11-20 01:29:25.193275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:9008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.700 [2024-11-20 01:29:25.193288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.700 [2024-11-20 01:29:25.193303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:9024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.700 [2024-11-20 01:29:25.193317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.700 [2024-11-20 01:29:25.193331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:9056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.700 [2024-11-20 01:29:25.193345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.700 [2024-11-20 01:29:25.193359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:9568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.700 [2024-11-20 01:29:25.193372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.700 [2024-11-20 01:29:25.193403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:9576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.700 [2024-11-20 01:29:25.193419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.700 [2024-11-20 01:29:25.193434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:9584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.700 [2024-11-20 01:29:25.193447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.700 [2024-11-20 01:29:25.193461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:9592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.700 [2024-11-20 01:29:25.193474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.700 [2024-11-20 01:29:25.193488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:9600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.700 [2024-11-20 01:29:25.193501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.700 [2024-11-20 01:29:25.193515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:9608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.700 [2024-11-20 01:29:25.193528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.700 [2024-11-20 01:29:25.193542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:9616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.700 [2024-11-20 01:29:25.193555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.700 [2024-11-20 01:29:25.193569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:9624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.700 [2024-11-20 01:29:25.193582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.700 [2024-11-20 01:29:25.193596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:9632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.700 [2024-11-20 01:29:25.193610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.700 [2024-11-20 01:29:25.193625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:9640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.700 [2024-11-20 01:29:25.193638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.700 [2024-11-20 01:29:25.193652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:9648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.700 [2024-11-20 01:29:25.193665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.700 [2024-11-20 01:29:25.193680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:9656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.700 [2024-11-20 01:29:25.193692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.700 [2024-11-20 01:29:25.193706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:9664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.700 [2024-11-20 01:29:25.193719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.700 [2024-11-20 01:29:25.193733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.700 [2024-11-20 01:29:25.193746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.700 [2024-11-20 01:29:25.193761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:9680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.700 [2024-11-20 01:29:25.193778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.700 [2024-11-20 01:29:25.193793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:9688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.700 [2024-11-20 01:29:25.193806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.700 [2024-11-20 01:29:25.193821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:9072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.700 [2024-11-20 01:29:25.193834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.700 [2024-11-20 01:29:25.193848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:9080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.700 [2024-11-20 01:29:25.193861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.700 [2024-11-20 01:29:25.193875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:9088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.700 [2024-11-20 01:29:25.193888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.700 [2024-11-20 01:29:25.193902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:9096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.700 [2024-11-20 01:29:25.193915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.700 [2024-11-20 01:29:25.193928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:9112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.701 [2024-11-20 01:29:25.193941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.701 [2024-11-20 01:29:25.193956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:9128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.701 [2024-11-20 01:29:25.193969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.701 [2024-11-20 01:29:25.193984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:9152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.701 [2024-11-20 01:29:25.193997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.701 [2024-11-20 01:29:25.194011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:9160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.701 [2024-11-20 01:29:25.194024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.701 [2024-11-20 01:29:25.194038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:9696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.701 [2024-11-20 01:29:25.194051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.701 [2024-11-20 01:29:25.194065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:9704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.701 [2024-11-20 01:29:25.194101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.701 [2024-11-20 01:29:25.194117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:9712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.701 [2024-11-20 01:29:25.194131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.701 [2024-11-20 01:29:25.194150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:9720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.701 [2024-11-20 01:29:25.194164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.701 [2024-11-20 01:29:25.194178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:9728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.701 [2024-11-20 01:29:25.194192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.701 [2024-11-20 01:29:25.194207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:9736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.701 [2024-11-20 01:29:25.194220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.701 [2024-11-20 01:29:25.194234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:9744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.701 [2024-11-20 01:29:25.194248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.701 [2024-11-20 01:29:25.194262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:9752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.701 [2024-11-20 01:29:25.194276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.701 [2024-11-20 01:29:25.194290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:9760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.701 [2024-11-20 01:29:25.194304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.701 [2024-11-20 01:29:25.194318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:9768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.701 [2024-11-20 01:29:25.194331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.701 [2024-11-20 01:29:25.194346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:9776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.701 [2024-11-20 01:29:25.194359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.701 [2024-11-20 01:29:25.194374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:9784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.701 [2024-11-20 01:29:25.194401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.701 [2024-11-20 01:29:25.194415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:9792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.701 [2024-11-20 01:29:25.194428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.701 [2024-11-20 01:29:25.194443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:9800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.701 [2024-11-20 01:29:25.194456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.701 [2024-11-20 01:29:25.194470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:9808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.701 [2024-11-20 01:29:25.194483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.701 [2024-11-20 01:29:25.194497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:9816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.701 [2024-11-20 01:29:25.194513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.701 [2024-11-20 01:29:25.194528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:9824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.701 [2024-11-20 01:29:25.194542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.701 [2024-11-20 01:29:25.194556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:9832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.701 [2024-11-20 01:29:25.194569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.701 [2024-11-20 01:29:25.194583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:9168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.701 [2024-11-20 01:29:25.194596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.701 [2024-11-20 01:29:25.194610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:9200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.701 [2024-11-20 01:29:25.194623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.701 [2024-11-20 01:29:25.194637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:9224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.701 [2024-11-20 01:29:25.194650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.701 [2024-11-20 01:29:25.194671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:9232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.701 [2024-11-20 01:29:25.194684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.701 [2024-11-20 01:29:25.194699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:9240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.701 [2024-11-20 01:29:25.194711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.701 [2024-11-20 01:29:25.194726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:9248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.701 [2024-11-20 01:29:25.194739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.701 [2024-11-20 01:29:25.194754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:9256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.701 [2024-11-20 01:29:25.194766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.701 [2024-11-20 01:29:25.194780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:9264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.701 [2024-11-20 01:29:25.194793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.701 [2024-11-20 01:29:25.194807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:9840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.701 [2024-11-20 01:29:25.194820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.701 [2024-11-20 01:29:25.194834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:9848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.701 [2024-11-20 01:29:25.194847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.701 [2024-11-20 01:29:25.194861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:9856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:23.701 [2024-11-20 01:29:25.194881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.701 [2024-11-20 01:29:25.194896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:9864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.701 [2024-11-20 01:29:25.194909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.701 [2024-11-20 01:29:25.194923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:9272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.701 [2024-11-20 01:29:25.194936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.701 [2024-11-20 01:29:25.194950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:9280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.701 [2024-11-20 01:29:25.194963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.701 [2024-11-20 01:29:25.194977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:9296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.701 [2024-11-20 01:29:25.194990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.701 [2024-11-20 01:29:25.195005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:9312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.701 [2024-11-20 01:29:25.195018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.701 [2024-11-20 01:29:25.195032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:9328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.701 [2024-11-20 01:29:25.195045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.701 [2024-11-20 01:29:25.195059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:9336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.701 [2024-11-20 01:29:25.195092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.702 [2024-11-20 01:29:25.195110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:9352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.702 [2024-11-20 01:29:25.195123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.702 [2024-11-20 01:29:25.195139] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c94c50 is same with the state(5) to be set 00:28:23.702 [2024-11-20 01:29:25.195155] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:28:23.702 [2024-11-20 01:29:25.195166] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:28:23.702 [2024-11-20 01:29:25.195177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9368 len:8 PRP1 0x0 PRP2 0x0 00:28:23.702 [2024-11-20 01:29:25.195190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.702 [2024-11-20 01:29:25.195246] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1c94c50 was disconnected and freed. reset controller. 00:28:23.702 [2024-11-20 01:29:25.195263] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4422 to 10.0.0.2:4420 00:28:23.702 [2024-11-20 01:29:25.195311] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:23.702 [2024-11-20 01:29:25.195331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.702 [2024-11-20 01:29:25.195351] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:23.702 [2024-11-20 01:29:25.195365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.702 [2024-11-20 01:29:25.195379] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:23.702 [2024-11-20 01:29:25.195391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.702 [2024-11-20 01:29:25.195405] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:23.702 [2024-11-20 01:29:25.195418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:23.702 [2024-11-20 01:29:25.195431] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:23.702 [2024-11-20 01:29:25.195467] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c73600 (9): Bad file descriptor 00:28:23.702 [2024-11-20 01:29:25.197710] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:23.702 [2024-11-20 01:29:25.230211] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:23.702 00:28:23.702 Latency(us) 00:28:23.702 [2024-11-20T00:29:31.921Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:23.702 [2024-11-20T00:29:31.921Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:28:23.702 Verification LBA range: start 0x0 length 0x4000 00:28:23.702 NVMe0n1 : 15.05 12681.79 49.54 991.32 0.00 9320.65 527.93 40972.14 00:28:23.702 [2024-11-20T00:29:31.921Z] =================================================================================================================== 00:28:23.702 [2024-11-20T00:29:31.921Z] Total : 12681.79 49.54 991.32 0.00 9320.65 527.93 40972.14 00:28:23.702 Received shutdown signal, test time was about 15.000000 seconds 00:28:23.702 00:28:23.702 Latency(us) 00:28:23.702 [2024-11-20T00:29:31.921Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:23.702 [2024-11-20T00:29:31.921Z] =================================================================================================================== 00:28:23.702 [2024-11-20T00:29:31.921Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:28:23.702 01:29:31 -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:28:23.702 01:29:31 -- host/failover.sh@65 -- # count=3 00:28:23.702 01:29:31 -- host/failover.sh@67 -- # (( count != 3 )) 00:28:23.702 01:29:31 -- host/failover.sh@73 -- # bdevperf_pid=1250366 00:28:23.702 01:29:31 -- host/failover.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 1 -f 00:28:23.702 01:29:31 -- host/failover.sh@75 -- # waitforlisten 1250366 /var/tmp/bdevperf.sock 00:28:23.702 01:29:31 -- common/autotest_common.sh@829 -- # '[' -z 1250366 ']' 00:28:23.702 01:29:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:28:23.702 01:29:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:23.702 01:29:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:28:23.702 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:28:23.702 01:29:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:23.702 01:29:31 -- common/autotest_common.sh@10 -- # set +x 00:28:24.032 01:29:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:24.032 01:29:32 -- common/autotest_common.sh@862 -- # return 0 00:28:24.032 01:29:32 -- host/failover.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:28:24.290 [2024-11-20 01:29:32.287139] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:28:24.290 01:29:32 -- host/failover.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:28:24.548 [2024-11-20 01:29:32.543906] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:28:24.548 01:29:32 -- host/failover.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:24.805 NVMe0n1 00:28:24.805 01:29:32 -- host/failover.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:25.062 00:28:25.062 01:29:33 -- host/failover.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:25.320 00:28:25.320 01:29:33 -- host/failover.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:25.320 01:29:33 -- host/failover.sh@82 -- # grep -q NVMe0 00:28:25.578 01:29:33 -- host/failover.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:25.837 01:29:34 -- host/failover.sh@87 -- # sleep 3 00:28:29.127 01:29:37 -- host/failover.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:29.127 01:29:37 -- host/failover.sh@88 -- # grep -q NVMe0 00:28:29.127 01:29:37 -- host/failover.sh@90 -- # run_test_pid=1251180 00:28:29.127 01:29:37 -- host/failover.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:28:29.127 01:29:37 -- host/failover.sh@92 -- # wait 1251180 00:28:30.504 0 00:28:30.504 01:29:38 -- host/failover.sh@94 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:28:30.504 [2024-11-20 01:29:31.078608] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:28:30.504 [2024-11-20 01:29:31.078691] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1250366 ] 00:28:30.504 EAL: No free 2048 kB hugepages reported on node 1 00:28:30.504 [2024-11-20 01:29:31.136666] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:30.504 [2024-11-20 01:29:31.217561] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:30.504 [2024-11-20 01:29:34.013339] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:28:30.504 [2024-11-20 01:29:34.013427] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:30.504 [2024-11-20 01:29:34.013464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:30.504 [2024-11-20 01:29:34.013480] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:30.504 [2024-11-20 01:29:34.013494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:30.504 [2024-11-20 01:29:34.013508] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:30.504 [2024-11-20 01:29:34.013522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:30.505 [2024-11-20 01:29:34.013536] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:30.505 [2024-11-20 01:29:34.013549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:30.505 [2024-11-20 01:29:34.013564] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:30.505 [2024-11-20 01:29:34.013602] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:30.505 [2024-11-20 01:29:34.013634] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1107600 (9): Bad file descriptor 00:28:30.505 [2024-11-20 01:29:34.062567] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:30.505 Running I/O for 1 seconds... 00:28:30.505 00:28:30.505 Latency(us) 00:28:30.505 [2024-11-20T00:29:38.724Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:30.505 [2024-11-20T00:29:38.724Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:28:30.505 Verification LBA range: start 0x0 length 0x4000 00:28:30.505 NVMe0n1 : 1.01 12704.33 49.63 0.00 0.00 10028.26 1426.01 15728.64 00:28:30.505 [2024-11-20T00:29:38.724Z] =================================================================================================================== 00:28:30.505 [2024-11-20T00:29:38.724Z] Total : 12704.33 49.63 0.00 0.00 10028.26 1426.01 15728.64 00:28:30.505 01:29:38 -- host/failover.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:30.505 01:29:38 -- host/failover.sh@95 -- # grep -q NVMe0 00:28:30.764 01:29:38 -- host/failover.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:31.022 01:29:39 -- host/failover.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:31.022 01:29:39 -- host/failover.sh@99 -- # grep -q NVMe0 00:28:31.280 01:29:39 -- host/failover.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:31.537 01:29:39 -- host/failover.sh@101 -- # sleep 3 00:28:34.828 01:29:42 -- host/failover.sh@103 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:34.828 01:29:42 -- host/failover.sh@103 -- # grep -q NVMe0 00:28:34.828 01:29:42 -- host/failover.sh@108 -- # killprocess 1250366 00:28:34.828 01:29:42 -- common/autotest_common.sh@936 -- # '[' -z 1250366 ']' 00:28:34.828 01:29:42 -- common/autotest_common.sh@940 -- # kill -0 1250366 00:28:34.828 01:29:42 -- common/autotest_common.sh@941 -- # uname 00:28:34.828 01:29:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:34.828 01:29:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1250366 00:28:34.828 01:29:42 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:34.828 01:29:42 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:34.828 01:29:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1250366' 00:28:34.828 killing process with pid 1250366 00:28:34.828 01:29:42 -- common/autotest_common.sh@955 -- # kill 1250366 00:28:34.828 01:29:42 -- common/autotest_common.sh@960 -- # wait 1250366 00:28:35.086 01:29:43 -- host/failover.sh@110 -- # sync 00:28:35.086 01:29:43 -- host/failover.sh@111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:35.347 01:29:43 -- host/failover.sh@113 -- # trap - SIGINT SIGTERM EXIT 00:28:35.347 01:29:43 -- host/failover.sh@115 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:28:35.347 01:29:43 -- host/failover.sh@116 -- # nvmftestfini 00:28:35.347 01:29:43 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:35.347 01:29:43 -- nvmf/common.sh@116 -- # sync 00:28:35.347 01:29:43 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:35.347 01:29:43 -- nvmf/common.sh@119 -- # set +e 00:28:35.347 01:29:43 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:35.347 01:29:43 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:35.347 rmmod nvme_tcp 00:28:35.347 rmmod nvme_fabrics 00:28:35.347 rmmod nvme_keyring 00:28:35.347 01:29:43 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:35.347 01:29:43 -- nvmf/common.sh@123 -- # set -e 00:28:35.347 01:29:43 -- nvmf/common.sh@124 -- # return 0 00:28:35.347 01:29:43 -- nvmf/common.sh@477 -- # '[' -n 1247886 ']' 00:28:35.347 01:29:43 -- nvmf/common.sh@478 -- # killprocess 1247886 00:28:35.347 01:29:43 -- common/autotest_common.sh@936 -- # '[' -z 1247886 ']' 00:28:35.347 01:29:43 -- common/autotest_common.sh@940 -- # kill -0 1247886 00:28:35.347 01:29:43 -- common/autotest_common.sh@941 -- # uname 00:28:35.347 01:29:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:35.347 01:29:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1247886 00:28:35.347 01:29:43 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:28:35.347 01:29:43 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:28:35.347 01:29:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1247886' 00:28:35.347 killing process with pid 1247886 00:28:35.347 01:29:43 -- common/autotest_common.sh@955 -- # kill 1247886 00:28:35.347 01:29:43 -- common/autotest_common.sh@960 -- # wait 1247886 00:28:35.606 01:29:43 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:35.606 01:29:43 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:35.606 01:29:43 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:35.606 01:29:43 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:35.606 01:29:43 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:35.606 01:29:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:35.606 01:29:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:35.606 01:29:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:38.145 01:29:45 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:38.145 00:28:38.145 real 0m36.947s 00:28:38.145 user 2m11.349s 00:28:38.145 sys 0m5.842s 00:28:38.145 01:29:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:38.145 01:29:45 -- common/autotest_common.sh@10 -- # set +x 00:28:38.145 ************************************ 00:28:38.145 END TEST nvmf_failover 00:28:38.145 ************************************ 00:28:38.145 01:29:45 -- nvmf/nvmf.sh@101 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:28:38.145 01:29:45 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:38.145 01:29:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:38.145 01:29:45 -- common/autotest_common.sh@10 -- # set +x 00:28:38.145 ************************************ 00:28:38.145 START TEST nvmf_discovery 00:28:38.145 ************************************ 00:28:38.145 01:29:45 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:28:38.145 * Looking for test storage... 00:28:38.145 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:28:38.145 01:29:45 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:38.145 01:29:45 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:38.145 01:29:45 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:38.145 01:29:45 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:38.145 01:29:45 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:38.145 01:29:45 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:38.145 01:29:45 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:38.145 01:29:45 -- scripts/common.sh@335 -- # IFS=.-: 00:28:38.145 01:29:45 -- scripts/common.sh@335 -- # read -ra ver1 00:28:38.145 01:29:45 -- scripts/common.sh@336 -- # IFS=.-: 00:28:38.145 01:29:45 -- scripts/common.sh@336 -- # read -ra ver2 00:28:38.145 01:29:45 -- scripts/common.sh@337 -- # local 'op=<' 00:28:38.145 01:29:45 -- scripts/common.sh@339 -- # ver1_l=2 00:28:38.145 01:29:45 -- scripts/common.sh@340 -- # ver2_l=1 00:28:38.145 01:29:45 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:38.145 01:29:45 -- scripts/common.sh@343 -- # case "$op" in 00:28:38.145 01:29:45 -- scripts/common.sh@344 -- # : 1 00:28:38.145 01:29:45 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:38.145 01:29:45 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:38.145 01:29:45 -- scripts/common.sh@364 -- # decimal 1 00:28:38.145 01:29:45 -- scripts/common.sh@352 -- # local d=1 00:28:38.145 01:29:45 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:38.145 01:29:45 -- scripts/common.sh@354 -- # echo 1 00:28:38.145 01:29:45 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:38.145 01:29:45 -- scripts/common.sh@365 -- # decimal 2 00:28:38.145 01:29:45 -- scripts/common.sh@352 -- # local d=2 00:28:38.145 01:29:45 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:38.145 01:29:45 -- scripts/common.sh@354 -- # echo 2 00:28:38.145 01:29:45 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:38.145 01:29:45 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:38.145 01:29:45 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:38.145 01:29:45 -- scripts/common.sh@367 -- # return 0 00:28:38.145 01:29:45 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:38.145 01:29:45 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:38.145 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:38.145 --rc genhtml_branch_coverage=1 00:28:38.145 --rc genhtml_function_coverage=1 00:28:38.145 --rc genhtml_legend=1 00:28:38.145 --rc geninfo_all_blocks=1 00:28:38.145 --rc geninfo_unexecuted_blocks=1 00:28:38.145 00:28:38.145 ' 00:28:38.145 01:29:45 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:38.145 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:38.145 --rc genhtml_branch_coverage=1 00:28:38.145 --rc genhtml_function_coverage=1 00:28:38.145 --rc genhtml_legend=1 00:28:38.145 --rc geninfo_all_blocks=1 00:28:38.145 --rc geninfo_unexecuted_blocks=1 00:28:38.145 00:28:38.145 ' 00:28:38.145 01:29:45 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:38.145 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:38.145 --rc genhtml_branch_coverage=1 00:28:38.145 --rc genhtml_function_coverage=1 00:28:38.145 --rc genhtml_legend=1 00:28:38.145 --rc geninfo_all_blocks=1 00:28:38.145 --rc geninfo_unexecuted_blocks=1 00:28:38.145 00:28:38.145 ' 00:28:38.145 01:29:45 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:38.145 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:38.145 --rc genhtml_branch_coverage=1 00:28:38.145 --rc genhtml_function_coverage=1 00:28:38.145 --rc genhtml_legend=1 00:28:38.145 --rc geninfo_all_blocks=1 00:28:38.145 --rc geninfo_unexecuted_blocks=1 00:28:38.145 00:28:38.145 ' 00:28:38.145 01:29:45 -- host/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:38.145 01:29:45 -- nvmf/common.sh@7 -- # uname -s 00:28:38.145 01:29:45 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:38.145 01:29:45 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:38.145 01:29:45 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:38.145 01:29:45 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:38.145 01:29:45 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:38.145 01:29:45 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:38.145 01:29:45 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:38.145 01:29:45 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:38.145 01:29:45 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:38.145 01:29:45 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:38.145 01:29:45 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:38.145 01:29:45 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:38.145 01:29:45 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:38.145 01:29:45 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:38.145 01:29:45 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:38.145 01:29:45 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:38.145 01:29:45 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:38.145 01:29:45 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:38.145 01:29:45 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:38.145 01:29:45 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:38.145 01:29:45 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:38.145 01:29:45 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:38.145 01:29:45 -- paths/export.sh@5 -- # export PATH 00:28:38.146 01:29:45 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:38.146 01:29:45 -- nvmf/common.sh@46 -- # : 0 00:28:38.146 01:29:45 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:38.146 01:29:45 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:38.146 01:29:45 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:38.146 01:29:45 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:38.146 01:29:45 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:38.146 01:29:45 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:38.146 01:29:45 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:38.146 01:29:45 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:38.146 01:29:45 -- host/discovery.sh@11 -- # '[' tcp == rdma ']' 00:28:38.146 01:29:45 -- host/discovery.sh@16 -- # DISCOVERY_PORT=8009 00:28:38.146 01:29:45 -- host/discovery.sh@17 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:28:38.146 01:29:45 -- host/discovery.sh@20 -- # NQN=nqn.2016-06.io.spdk:cnode 00:28:38.146 01:29:45 -- host/discovery.sh@22 -- # HOST_NQN=nqn.2021-12.io.spdk:test 00:28:38.146 01:29:45 -- host/discovery.sh@23 -- # HOST_SOCK=/tmp/host.sock 00:28:38.146 01:29:45 -- host/discovery.sh@25 -- # nvmftestinit 00:28:38.146 01:29:45 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:38.146 01:29:45 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:38.146 01:29:45 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:38.146 01:29:45 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:38.146 01:29:45 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:38.146 01:29:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:38.146 01:29:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:38.146 01:29:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:38.146 01:29:45 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:38.146 01:29:45 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:38.146 01:29:45 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:38.146 01:29:45 -- common/autotest_common.sh@10 -- # set +x 00:28:40.048 01:29:48 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:40.048 01:29:48 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:40.048 01:29:48 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:40.048 01:29:48 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:40.048 01:29:48 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:40.048 01:29:48 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:40.048 01:29:48 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:40.048 01:29:48 -- nvmf/common.sh@294 -- # net_devs=() 00:28:40.048 01:29:48 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:40.048 01:29:48 -- nvmf/common.sh@295 -- # e810=() 00:28:40.048 01:29:48 -- nvmf/common.sh@295 -- # local -ga e810 00:28:40.048 01:29:48 -- nvmf/common.sh@296 -- # x722=() 00:28:40.048 01:29:48 -- nvmf/common.sh@296 -- # local -ga x722 00:28:40.048 01:29:48 -- nvmf/common.sh@297 -- # mlx=() 00:28:40.048 01:29:48 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:40.048 01:29:48 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:40.048 01:29:48 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:40.048 01:29:48 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:40.048 01:29:48 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:40.048 01:29:48 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:40.048 01:29:48 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:40.048 01:29:48 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:40.048 01:29:48 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:40.048 01:29:48 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:40.048 01:29:48 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:40.048 01:29:48 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:40.048 01:29:48 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:40.048 01:29:48 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:40.048 01:29:48 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:40.048 01:29:48 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:40.048 01:29:48 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:40.048 01:29:48 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:40.048 01:29:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:40.048 01:29:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:40.048 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:40.048 01:29:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:40.048 01:29:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:40.048 01:29:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:40.048 01:29:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:40.048 01:29:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:40.048 01:29:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:40.048 01:29:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:40.048 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:40.048 01:29:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:40.048 01:29:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:40.048 01:29:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:40.048 01:29:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:40.048 01:29:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:40.048 01:29:48 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:40.048 01:29:48 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:40.048 01:29:48 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:40.048 01:29:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:40.048 01:29:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:40.048 01:29:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:40.048 01:29:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:40.048 01:29:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:40.048 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:40.048 01:29:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:40.048 01:29:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:40.048 01:29:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:40.048 01:29:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:40.048 01:29:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:40.048 01:29:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:40.048 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:40.048 01:29:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:40.048 01:29:48 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:40.048 01:29:48 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:40.048 01:29:48 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:40.048 01:29:48 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:40.048 01:29:48 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:40.048 01:29:48 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:40.048 01:29:48 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:40.048 01:29:48 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:40.048 01:29:48 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:40.048 01:29:48 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:40.048 01:29:48 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:40.048 01:29:48 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:40.048 01:29:48 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:40.048 01:29:48 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:40.048 01:29:48 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:40.048 01:29:48 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:40.048 01:29:48 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:40.048 01:29:48 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:40.048 01:29:48 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:40.048 01:29:48 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:40.048 01:29:48 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:40.048 01:29:48 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:40.048 01:29:48 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:40.048 01:29:48 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:40.048 01:29:48 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:40.048 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:40.048 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.231 ms 00:28:40.048 00:28:40.048 --- 10.0.0.2 ping statistics --- 00:28:40.048 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:40.048 rtt min/avg/max/mdev = 0.231/0.231/0.231/0.000 ms 00:28:40.048 01:29:48 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:40.048 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:40.048 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.099 ms 00:28:40.048 00:28:40.048 --- 10.0.0.1 ping statistics --- 00:28:40.048 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:40.048 rtt min/avg/max/mdev = 0.099/0.099/0.099/0.000 ms 00:28:40.048 01:29:48 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:40.048 01:29:48 -- nvmf/common.sh@410 -- # return 0 00:28:40.048 01:29:48 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:28:40.048 01:29:48 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:40.048 01:29:48 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:40.048 01:29:48 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:40.048 01:29:48 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:40.048 01:29:48 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:40.048 01:29:48 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:40.048 01:29:48 -- host/discovery.sh@30 -- # nvmfappstart -m 0x2 00:28:40.049 01:29:48 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:40.049 01:29:48 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:40.049 01:29:48 -- common/autotest_common.sh@10 -- # set +x 00:28:40.049 01:29:48 -- nvmf/common.sh@469 -- # nvmfpid=1253824 00:28:40.049 01:29:48 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:28:40.049 01:29:48 -- nvmf/common.sh@470 -- # waitforlisten 1253824 00:28:40.049 01:29:48 -- common/autotest_common.sh@829 -- # '[' -z 1253824 ']' 00:28:40.049 01:29:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:40.049 01:29:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:40.049 01:29:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:40.049 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:40.049 01:29:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:40.049 01:29:48 -- common/autotest_common.sh@10 -- # set +x 00:28:40.308 [2024-11-20 01:29:48.293606] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:28:40.308 [2024-11-20 01:29:48.293689] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:40.308 EAL: No free 2048 kB hugepages reported on node 1 00:28:40.308 [2024-11-20 01:29:48.361208] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:40.308 [2024-11-20 01:29:48.449689] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:40.308 [2024-11-20 01:29:48.449856] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:40.308 [2024-11-20 01:29:48.449875] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:40.308 [2024-11-20 01:29:48.449889] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:40.308 [2024-11-20 01:29:48.449926] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:41.241 01:29:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:41.241 01:29:49 -- common/autotest_common.sh@862 -- # return 0 00:28:41.241 01:29:49 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:41.241 01:29:49 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:41.242 01:29:49 -- common/autotest_common.sh@10 -- # set +x 00:28:41.242 01:29:49 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:41.242 01:29:49 -- host/discovery.sh@32 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:28:41.242 01:29:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:41.242 01:29:49 -- common/autotest_common.sh@10 -- # set +x 00:28:41.242 [2024-11-20 01:29:49.323615] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:41.242 01:29:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:41.242 01:29:49 -- host/discovery.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2014-08.org.nvmexpress.discovery -t tcp -a 10.0.0.2 -s 8009 00:28:41.242 01:29:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:41.242 01:29:49 -- common/autotest_common.sh@10 -- # set +x 00:28:41.242 [2024-11-20 01:29:49.331763] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:28:41.242 01:29:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:41.242 01:29:49 -- host/discovery.sh@35 -- # rpc_cmd bdev_null_create null0 1000 512 00:28:41.242 01:29:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:41.242 01:29:49 -- common/autotest_common.sh@10 -- # set +x 00:28:41.242 null0 00:28:41.242 01:29:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:41.242 01:29:49 -- host/discovery.sh@36 -- # rpc_cmd bdev_null_create null1 1000 512 00:28:41.242 01:29:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:41.242 01:29:49 -- common/autotest_common.sh@10 -- # set +x 00:28:41.242 null1 00:28:41.242 01:29:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:41.242 01:29:49 -- host/discovery.sh@37 -- # rpc_cmd bdev_wait_for_examine 00:28:41.242 01:29:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:41.242 01:29:49 -- common/autotest_common.sh@10 -- # set +x 00:28:41.242 01:29:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:41.242 01:29:49 -- host/discovery.sh@45 -- # hostpid=1253979 00:28:41.242 01:29:49 -- host/discovery.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock 00:28:41.242 01:29:49 -- host/discovery.sh@46 -- # waitforlisten 1253979 /tmp/host.sock 00:28:41.242 01:29:49 -- common/autotest_common.sh@829 -- # '[' -z 1253979 ']' 00:28:41.242 01:29:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:28:41.242 01:29:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:41.242 01:29:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:28:41.242 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:28:41.242 01:29:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:41.242 01:29:49 -- common/autotest_common.sh@10 -- # set +x 00:28:41.242 [2024-11-20 01:29:49.403804] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:28:41.242 [2024-11-20 01:29:49.403881] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1253979 ] 00:28:41.242 EAL: No free 2048 kB hugepages reported on node 1 00:28:41.501 [2024-11-20 01:29:49.472763] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:41.501 [2024-11-20 01:29:49.563244] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:41.501 [2024-11-20 01:29:49.563409] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:42.436 01:29:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:42.436 01:29:50 -- common/autotest_common.sh@862 -- # return 0 00:28:42.436 01:29:50 -- host/discovery.sh@48 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:42.436 01:29:50 -- host/discovery.sh@50 -- # rpc_cmd -s /tmp/host.sock log_set_flag bdev_nvme 00:28:42.436 01:29:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:42.436 01:29:50 -- common/autotest_common.sh@10 -- # set +x 00:28:42.436 01:29:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:42.436 01:29:50 -- host/discovery.sh@51 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test 00:28:42.436 01:29:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:42.436 01:29:50 -- common/autotest_common.sh@10 -- # set +x 00:28:42.436 01:29:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:42.436 01:29:50 -- host/discovery.sh@72 -- # notify_id=0 00:28:42.436 01:29:50 -- host/discovery.sh@78 -- # get_subsystem_names 00:28:42.436 01:29:50 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:42.436 01:29:50 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:42.436 01:29:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:42.436 01:29:50 -- common/autotest_common.sh@10 -- # set +x 00:28:42.436 01:29:50 -- host/discovery.sh@59 -- # sort 00:28:42.436 01:29:50 -- host/discovery.sh@59 -- # xargs 00:28:42.436 01:29:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:42.436 01:29:50 -- host/discovery.sh@78 -- # [[ '' == '' ]] 00:28:42.436 01:29:50 -- host/discovery.sh@79 -- # get_bdev_list 00:28:42.436 01:29:50 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:42.436 01:29:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:42.436 01:29:50 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:42.436 01:29:50 -- common/autotest_common.sh@10 -- # set +x 00:28:42.436 01:29:50 -- host/discovery.sh@55 -- # sort 00:28:42.437 01:29:50 -- host/discovery.sh@55 -- # xargs 00:28:42.437 01:29:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:42.437 01:29:50 -- host/discovery.sh@79 -- # [[ '' == '' ]] 00:28:42.437 01:29:50 -- host/discovery.sh@81 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 00:28:42.437 01:29:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:42.437 01:29:50 -- common/autotest_common.sh@10 -- # set +x 00:28:42.437 01:29:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:42.437 01:29:50 -- host/discovery.sh@82 -- # get_subsystem_names 00:28:42.437 01:29:50 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:42.437 01:29:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:42.437 01:29:50 -- common/autotest_common.sh@10 -- # set +x 00:28:42.437 01:29:50 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:42.437 01:29:50 -- host/discovery.sh@59 -- # sort 00:28:42.437 01:29:50 -- host/discovery.sh@59 -- # xargs 00:28:42.437 01:29:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:42.437 01:29:50 -- host/discovery.sh@82 -- # [[ '' == '' ]] 00:28:42.437 01:29:50 -- host/discovery.sh@83 -- # get_bdev_list 00:28:42.437 01:29:50 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:42.437 01:29:50 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:42.437 01:29:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:42.437 01:29:50 -- host/discovery.sh@55 -- # sort 00:28:42.437 01:29:50 -- common/autotest_common.sh@10 -- # set +x 00:28:42.437 01:29:50 -- host/discovery.sh@55 -- # xargs 00:28:42.437 01:29:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:42.437 01:29:50 -- host/discovery.sh@83 -- # [[ '' == '' ]] 00:28:42.437 01:29:50 -- host/discovery.sh@85 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 00:28:42.437 01:29:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:42.437 01:29:50 -- common/autotest_common.sh@10 -- # set +x 00:28:42.437 01:29:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:42.437 01:29:50 -- host/discovery.sh@86 -- # get_subsystem_names 00:28:42.437 01:29:50 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:42.437 01:29:50 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:42.437 01:29:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:42.437 01:29:50 -- common/autotest_common.sh@10 -- # set +x 00:28:42.437 01:29:50 -- host/discovery.sh@59 -- # sort 00:28:42.437 01:29:50 -- host/discovery.sh@59 -- # xargs 00:28:42.437 01:29:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:42.437 01:29:50 -- host/discovery.sh@86 -- # [[ '' == '' ]] 00:28:42.437 01:29:50 -- host/discovery.sh@87 -- # get_bdev_list 00:28:42.437 01:29:50 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:42.437 01:29:50 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:42.437 01:29:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:42.437 01:29:50 -- host/discovery.sh@55 -- # sort 00:28:42.437 01:29:50 -- common/autotest_common.sh@10 -- # set +x 00:28:42.437 01:29:50 -- host/discovery.sh@55 -- # xargs 00:28:42.437 01:29:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:42.695 01:29:50 -- host/discovery.sh@87 -- # [[ '' == '' ]] 00:28:42.695 01:29:50 -- host/discovery.sh@91 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:42.695 01:29:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:42.695 01:29:50 -- common/autotest_common.sh@10 -- # set +x 00:28:42.695 [2024-11-20 01:29:50.659692] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:42.695 01:29:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:42.695 01:29:50 -- host/discovery.sh@92 -- # get_subsystem_names 00:28:42.695 01:29:50 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:42.695 01:29:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:42.695 01:29:50 -- common/autotest_common.sh@10 -- # set +x 00:28:42.695 01:29:50 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:42.695 01:29:50 -- host/discovery.sh@59 -- # sort 00:28:42.695 01:29:50 -- host/discovery.sh@59 -- # xargs 00:28:42.695 01:29:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:42.695 01:29:50 -- host/discovery.sh@92 -- # [[ '' == '' ]] 00:28:42.695 01:29:50 -- host/discovery.sh@93 -- # get_bdev_list 00:28:42.695 01:29:50 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:42.695 01:29:50 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:42.695 01:29:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:42.695 01:29:50 -- host/discovery.sh@55 -- # sort 00:28:42.695 01:29:50 -- common/autotest_common.sh@10 -- # set +x 00:28:42.695 01:29:50 -- host/discovery.sh@55 -- # xargs 00:28:42.695 01:29:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:42.695 01:29:50 -- host/discovery.sh@93 -- # [[ '' == '' ]] 00:28:42.695 01:29:50 -- host/discovery.sh@94 -- # get_notification_count 00:28:42.695 01:29:50 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:28:42.695 01:29:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:42.695 01:29:50 -- common/autotest_common.sh@10 -- # set +x 00:28:42.695 01:29:50 -- host/discovery.sh@74 -- # jq '. | length' 00:28:42.695 01:29:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:42.695 01:29:50 -- host/discovery.sh@74 -- # notification_count=0 00:28:42.695 01:29:50 -- host/discovery.sh@75 -- # notify_id=0 00:28:42.695 01:29:50 -- host/discovery.sh@95 -- # [[ 0 == 0 ]] 00:28:42.695 01:29:50 -- host/discovery.sh@99 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2021-12.io.spdk:test 00:28:42.695 01:29:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:42.695 01:29:50 -- common/autotest_common.sh@10 -- # set +x 00:28:42.695 01:29:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:42.695 01:29:50 -- host/discovery.sh@100 -- # sleep 1 00:28:43.263 [2024-11-20 01:29:51.444204] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:28:43.263 [2024-11-20 01:29:51.444236] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:28:43.263 [2024-11-20 01:29:51.444260] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:28:43.522 [2024-11-20 01:29:51.531551] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:28:43.522 [2024-11-20 01:29:51.593229] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:28:43.522 [2024-11-20 01:29:51.593252] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:28:43.781 01:29:51 -- host/discovery.sh@101 -- # get_subsystem_names 00:28:43.781 01:29:51 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:43.781 01:29:51 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:43.781 01:29:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:43.781 01:29:51 -- host/discovery.sh@59 -- # sort 00:28:43.781 01:29:51 -- common/autotest_common.sh@10 -- # set +x 00:28:43.781 01:29:51 -- host/discovery.sh@59 -- # xargs 00:28:43.781 01:29:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:43.781 01:29:51 -- host/discovery.sh@101 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:43.781 01:29:51 -- host/discovery.sh@102 -- # get_bdev_list 00:28:43.781 01:29:51 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:43.781 01:29:51 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:43.781 01:29:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:43.781 01:29:51 -- common/autotest_common.sh@10 -- # set +x 00:28:43.781 01:29:51 -- host/discovery.sh@55 -- # sort 00:28:43.781 01:29:51 -- host/discovery.sh@55 -- # xargs 00:28:43.781 01:29:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:43.781 01:29:51 -- host/discovery.sh@102 -- # [[ nvme0n1 == \n\v\m\e\0\n\1 ]] 00:28:43.781 01:29:51 -- host/discovery.sh@103 -- # get_subsystem_paths nvme0 00:28:43.781 01:29:51 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:28:43.781 01:29:51 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:28:43.781 01:29:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:43.781 01:29:51 -- host/discovery.sh@63 -- # sort -n 00:28:43.781 01:29:51 -- common/autotest_common.sh@10 -- # set +x 00:28:43.781 01:29:51 -- host/discovery.sh@63 -- # xargs 00:28:43.781 01:29:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:43.781 01:29:51 -- host/discovery.sh@103 -- # [[ 4420 == \4\4\2\0 ]] 00:28:43.782 01:29:51 -- host/discovery.sh@104 -- # get_notification_count 00:28:43.782 01:29:51 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:28:43.782 01:29:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:43.782 01:29:51 -- host/discovery.sh@74 -- # jq '. | length' 00:28:43.782 01:29:51 -- common/autotest_common.sh@10 -- # set +x 00:28:43.782 01:29:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:43.782 01:29:51 -- host/discovery.sh@74 -- # notification_count=1 00:28:43.782 01:29:51 -- host/discovery.sh@75 -- # notify_id=1 00:28:43.782 01:29:51 -- host/discovery.sh@105 -- # [[ 1 == 1 ]] 00:28:43.782 01:29:51 -- host/discovery.sh@108 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null1 00:28:43.782 01:29:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:43.782 01:29:51 -- common/autotest_common.sh@10 -- # set +x 00:28:43.782 01:29:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:43.782 01:29:51 -- host/discovery.sh@109 -- # sleep 1 00:28:45.158 01:29:52 -- host/discovery.sh@110 -- # get_bdev_list 00:28:45.158 01:29:52 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:45.158 01:29:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:45.158 01:29:52 -- common/autotest_common.sh@10 -- # set +x 00:28:45.158 01:29:52 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:45.158 01:29:52 -- host/discovery.sh@55 -- # sort 00:28:45.158 01:29:52 -- host/discovery.sh@55 -- # xargs 00:28:45.158 01:29:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:45.158 01:29:52 -- host/discovery.sh@110 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:28:45.158 01:29:52 -- host/discovery.sh@111 -- # get_notification_count 00:28:45.158 01:29:52 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 1 00:28:45.158 01:29:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:45.158 01:29:52 -- host/discovery.sh@74 -- # jq '. | length' 00:28:45.158 01:29:52 -- common/autotest_common.sh@10 -- # set +x 00:28:45.158 01:29:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:45.158 01:29:53 -- host/discovery.sh@74 -- # notification_count=1 00:28:45.158 01:29:53 -- host/discovery.sh@75 -- # notify_id=2 00:28:45.158 01:29:53 -- host/discovery.sh@112 -- # [[ 1 == 1 ]] 00:28:45.158 01:29:53 -- host/discovery.sh@116 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 00:28:45.158 01:29:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:45.158 01:29:53 -- common/autotest_common.sh@10 -- # set +x 00:28:45.158 [2024-11-20 01:29:53.038798] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:28:45.158 [2024-11-20 01:29:53.039594] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:28:45.158 [2024-11-20 01:29:53.039628] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:28:45.158 01:29:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:45.158 01:29:53 -- host/discovery.sh@117 -- # sleep 1 00:28:45.158 [2024-11-20 01:29:53.125895] bdev_nvme.c:6683:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new path for nvme0 00:28:45.158 [2024-11-20 01:29:53.188420] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:28:45.158 [2024-11-20 01:29:53.188445] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:28:45.158 [2024-11-20 01:29:53.188455] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:28:46.096 01:29:54 -- host/discovery.sh@118 -- # get_subsystem_names 00:28:46.096 01:29:54 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:46.096 01:29:54 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:46.096 01:29:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:46.096 01:29:54 -- host/discovery.sh@59 -- # sort 00:28:46.097 01:29:54 -- common/autotest_common.sh@10 -- # set +x 00:28:46.097 01:29:54 -- host/discovery.sh@59 -- # xargs 00:28:46.097 01:29:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:46.097 01:29:54 -- host/discovery.sh@118 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:46.097 01:29:54 -- host/discovery.sh@119 -- # get_bdev_list 00:28:46.097 01:29:54 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:46.097 01:29:54 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:46.097 01:29:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:46.097 01:29:54 -- host/discovery.sh@55 -- # sort 00:28:46.097 01:29:54 -- common/autotest_common.sh@10 -- # set +x 00:28:46.097 01:29:54 -- host/discovery.sh@55 -- # xargs 00:28:46.097 01:29:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:46.097 01:29:54 -- host/discovery.sh@119 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:28:46.097 01:29:54 -- host/discovery.sh@120 -- # get_subsystem_paths nvme0 00:28:46.097 01:29:54 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:28:46.097 01:29:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:46.097 01:29:54 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:28:46.097 01:29:54 -- common/autotest_common.sh@10 -- # set +x 00:28:46.097 01:29:54 -- host/discovery.sh@63 -- # sort -n 00:28:46.097 01:29:54 -- host/discovery.sh@63 -- # xargs 00:28:46.097 01:29:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:46.097 01:29:54 -- host/discovery.sh@120 -- # [[ 4420 4421 == \4\4\2\0\ \4\4\2\1 ]] 00:28:46.097 01:29:54 -- host/discovery.sh@121 -- # get_notification_count 00:28:46.097 01:29:54 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:28:46.097 01:29:54 -- host/discovery.sh@74 -- # jq '. | length' 00:28:46.097 01:29:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:46.097 01:29:54 -- common/autotest_common.sh@10 -- # set +x 00:28:46.097 01:29:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:46.097 01:29:54 -- host/discovery.sh@74 -- # notification_count=0 00:28:46.097 01:29:54 -- host/discovery.sh@75 -- # notify_id=2 00:28:46.097 01:29:54 -- host/discovery.sh@122 -- # [[ 0 == 0 ]] 00:28:46.097 01:29:54 -- host/discovery.sh@126 -- # rpc_cmd nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:46.097 01:29:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:46.097 01:29:54 -- common/autotest_common.sh@10 -- # set +x 00:28:46.097 [2024-11-20 01:29:54.211104] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:28:46.097 [2024-11-20 01:29:54.211162] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:28:46.097 01:29:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:46.097 01:29:54 -- host/discovery.sh@127 -- # sleep 1 00:28:46.097 [2024-11-20 01:29:54.216739] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:46.097 [2024-11-20 01:29:54.216771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.097 [2024-11-20 01:29:54.216803] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:46.097 [2024-11-20 01:29:54.216818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.097 [2024-11-20 01:29:54.216833] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:46.097 [2024-11-20 01:29:54.216847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.097 [2024-11-20 01:29:54.216860] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:46.097 [2024-11-20 01:29:54.216874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.097 [2024-11-20 01:29:54.216887] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b09b80 is same with the state(5) to be set 00:28:46.097 [2024-11-20 01:29:54.226733] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b09b80 (9): Bad file descriptor 00:28:46.097 [2024-11-20 01:29:54.236780] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:46.097 [2024-11-20 01:29:54.237079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.097 [2024-11-20 01:29:54.237215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.097 [2024-11-20 01:29:54.237242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b09b80 with addr=10.0.0.2, port=4420 00:28:46.097 [2024-11-20 01:29:54.237259] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b09b80 is same with the state(5) to be set 00:28:46.097 [2024-11-20 01:29:54.237282] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b09b80 (9): Bad file descriptor 00:28:46.097 [2024-11-20 01:29:54.237324] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:46.097 [2024-11-20 01:29:54.237343] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:46.097 [2024-11-20 01:29:54.237358] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:46.097 [2024-11-20 01:29:54.237379] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.097 [2024-11-20 01:29:54.246870] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:46.097 [2024-11-20 01:29:54.247132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.097 [2024-11-20 01:29:54.247287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.097 [2024-11-20 01:29:54.247313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b09b80 with addr=10.0.0.2, port=4420 00:28:46.097 [2024-11-20 01:29:54.247329] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b09b80 is same with the state(5) to be set 00:28:46.097 [2024-11-20 01:29:54.247350] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b09b80 (9): Bad file descriptor 00:28:46.097 [2024-11-20 01:29:54.247383] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:46.097 [2024-11-20 01:29:54.247400] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:46.097 [2024-11-20 01:29:54.247413] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:46.097 [2024-11-20 01:29:54.247431] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.097 [2024-11-20 01:29:54.256952] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:46.097 [2024-11-20 01:29:54.257188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.097 [2024-11-20 01:29:54.257311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.097 [2024-11-20 01:29:54.257337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b09b80 with addr=10.0.0.2, port=4420 00:28:46.097 [2024-11-20 01:29:54.257353] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b09b80 is same with the state(5) to be set 00:28:46.097 [2024-11-20 01:29:54.257374] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b09b80 (9): Bad file descriptor 00:28:46.097 [2024-11-20 01:29:54.257394] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:46.097 [2024-11-20 01:29:54.257408] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:46.097 [2024-11-20 01:29:54.257420] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:46.097 [2024-11-20 01:29:54.257454] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.097 [2024-11-20 01:29:54.267036] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:46.097 [2024-11-20 01:29:54.267210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.097 [2024-11-20 01:29:54.267342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.097 [2024-11-20 01:29:54.267367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b09b80 with addr=10.0.0.2, port=4420 00:28:46.097 [2024-11-20 01:29:54.267383] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b09b80 is same with the state(5) to be set 00:28:46.097 [2024-11-20 01:29:54.267405] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b09b80 (9): Bad file descriptor 00:28:46.097 [2024-11-20 01:29:54.267425] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:46.097 [2024-11-20 01:29:54.267444] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:46.097 [2024-11-20 01:29:54.267457] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:46.097 [2024-11-20 01:29:54.267476] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.097 [2024-11-20 01:29:54.277107] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:46.097 [2024-11-20 01:29:54.277272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.097 [2024-11-20 01:29:54.277420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.097 [2024-11-20 01:29:54.277445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b09b80 with addr=10.0.0.2, port=4420 00:28:46.097 [2024-11-20 01:29:54.277460] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b09b80 is same with the state(5) to be set 00:28:46.097 [2024-11-20 01:29:54.277481] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b09b80 (9): Bad file descriptor 00:28:46.097 [2024-11-20 01:29:54.277501] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:46.097 [2024-11-20 01:29:54.277515] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:46.097 [2024-11-20 01:29:54.277527] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:46.097 [2024-11-20 01:29:54.277546] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.097 [2024-11-20 01:29:54.287175] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:46.097 [2024-11-20 01:29:54.287349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.097 [2024-11-20 01:29:54.287475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.097 [2024-11-20 01:29:54.287500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b09b80 with addr=10.0.0.2, port=4420 00:28:46.097 [2024-11-20 01:29:54.287515] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b09b80 is same with the state(5) to be set 00:28:46.097 [2024-11-20 01:29:54.287536] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b09b80 (9): Bad file descriptor 00:28:46.097 [2024-11-20 01:29:54.287556] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:46.098 [2024-11-20 01:29:54.287570] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:46.098 [2024-11-20 01:29:54.287583] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:46.098 [2024-11-20 01:29:54.287601] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.098 [2024-11-20 01:29:54.297259] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:46.098 [2024-11-20 01:29:54.297451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.098 [2024-11-20 01:29:54.297580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.098 [2024-11-20 01:29:54.297606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b09b80 with addr=10.0.0.2, port=4420 00:28:46.098 [2024-11-20 01:29:54.297621] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b09b80 is same with the state(5) to be set 00:28:46.098 [2024-11-20 01:29:54.297642] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b09b80 (9): Bad file descriptor 00:28:46.098 [2024-11-20 01:29:54.297698] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:46.098 [2024-11-20 01:29:54.297719] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:46.098 [2024-11-20 01:29:54.297737] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:46.098 [2024-11-20 01:29:54.297757] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.098 [2024-11-20 01:29:54.307344] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:46.098 [2024-11-20 01:29:54.307520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.098 [2024-11-20 01:29:54.307606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.098 [2024-11-20 01:29:54.307632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b09b80 with addr=10.0.0.2, port=4420 00:28:46.098 [2024-11-20 01:29:54.307647] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b09b80 is same with the state(5) to be set 00:28:46.098 [2024-11-20 01:29:54.307669] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b09b80 (9): Bad file descriptor 00:28:46.098 [2024-11-20 01:29:54.307689] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:46.098 [2024-11-20 01:29:54.307702] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:46.098 [2024-11-20 01:29:54.307714] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:46.098 [2024-11-20 01:29:54.307746] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.358 [2024-11-20 01:29:54.317429] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:46.358 [2024-11-20 01:29:54.317647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.358 [2024-11-20 01:29:54.317775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.358 [2024-11-20 01:29:54.317799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b09b80 with addr=10.0.0.2, port=4420 00:28:46.358 [2024-11-20 01:29:54.317815] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b09b80 is same with the state(5) to be set 00:28:46.358 [2024-11-20 01:29:54.317836] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b09b80 (9): Bad file descriptor 00:28:46.358 [2024-11-20 01:29:54.317880] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:46.358 [2024-11-20 01:29:54.317898] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:46.358 [2024-11-20 01:29:54.317912] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:46.358 [2024-11-20 01:29:54.317930] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.358 [2024-11-20 01:29:54.327512] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:46.358 [2024-11-20 01:29:54.327686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.358 [2024-11-20 01:29:54.327834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.358 [2024-11-20 01:29:54.327859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b09b80 with addr=10.0.0.2, port=4420 00:28:46.358 [2024-11-20 01:29:54.327874] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b09b80 is same with the state(5) to be set 00:28:46.358 [2024-11-20 01:29:54.327896] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b09b80 (9): Bad file descriptor 00:28:46.358 [2024-11-20 01:29:54.327928] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:46.358 [2024-11-20 01:29:54.327945] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:46.358 [2024-11-20 01:29:54.327958] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:46.358 [2024-11-20 01:29:54.327982] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.358 [2024-11-20 01:29:54.337592] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:46.358 [2024-11-20 01:29:54.337776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.358 [2024-11-20 01:29:54.337893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.358 [2024-11-20 01:29:54.337918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b09b80 with addr=10.0.0.2, port=4420 00:28:46.358 [2024-11-20 01:29:54.337933] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b09b80 is same with the state(5) to be set 00:28:46.358 [2024-11-20 01:29:54.337955] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b09b80 (9): Bad file descriptor 00:28:46.359 [2024-11-20 01:29:54.337999] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:46.359 [2024-11-20 01:29:54.338018] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:46.359 [2024-11-20 01:29:54.338032] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:46.359 [2024-11-20 01:29:54.338050] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.359 [2024-11-20 01:29:54.338989] bdev_nvme.c:6546:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 not found 00:28:46.359 [2024-11-20 01:29:54.339017] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:28:47.297 01:29:55 -- host/discovery.sh@128 -- # get_subsystem_names 00:28:47.297 01:29:55 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:47.297 01:29:55 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:47.297 01:29:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:47.297 01:29:55 -- host/discovery.sh@59 -- # sort 00:28:47.297 01:29:55 -- common/autotest_common.sh@10 -- # set +x 00:28:47.297 01:29:55 -- host/discovery.sh@59 -- # xargs 00:28:47.297 01:29:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:47.297 01:29:55 -- host/discovery.sh@128 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:47.297 01:29:55 -- host/discovery.sh@129 -- # get_bdev_list 00:28:47.297 01:29:55 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:47.297 01:29:55 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:47.297 01:29:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:47.297 01:29:55 -- common/autotest_common.sh@10 -- # set +x 00:28:47.297 01:29:55 -- host/discovery.sh@55 -- # sort 00:28:47.297 01:29:55 -- host/discovery.sh@55 -- # xargs 00:28:47.297 01:29:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:47.297 01:29:55 -- host/discovery.sh@129 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:28:47.297 01:29:55 -- host/discovery.sh@130 -- # get_subsystem_paths nvme0 00:28:47.297 01:29:55 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:28:47.297 01:29:55 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:28:47.297 01:29:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:47.297 01:29:55 -- common/autotest_common.sh@10 -- # set +x 00:28:47.297 01:29:55 -- host/discovery.sh@63 -- # sort -n 00:28:47.297 01:29:55 -- host/discovery.sh@63 -- # xargs 00:28:47.297 01:29:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:47.297 01:29:55 -- host/discovery.sh@130 -- # [[ 4421 == \4\4\2\1 ]] 00:28:47.297 01:29:55 -- host/discovery.sh@131 -- # get_notification_count 00:28:47.297 01:29:55 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:28:47.297 01:29:55 -- host/discovery.sh@74 -- # jq '. | length' 00:28:47.297 01:29:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:47.297 01:29:55 -- common/autotest_common.sh@10 -- # set +x 00:28:47.297 01:29:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:47.297 01:29:55 -- host/discovery.sh@74 -- # notification_count=0 00:28:47.297 01:29:55 -- host/discovery.sh@75 -- # notify_id=2 00:28:47.297 01:29:55 -- host/discovery.sh@132 -- # [[ 0 == 0 ]] 00:28:47.297 01:29:55 -- host/discovery.sh@134 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_stop_discovery -b nvme 00:28:47.297 01:29:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:47.297 01:29:55 -- common/autotest_common.sh@10 -- # set +x 00:28:47.297 01:29:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:47.297 01:29:55 -- host/discovery.sh@135 -- # sleep 1 00:28:48.237 01:29:56 -- host/discovery.sh@136 -- # get_subsystem_names 00:28:48.237 01:29:56 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:48.237 01:29:56 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:48.237 01:29:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:48.237 01:29:56 -- common/autotest_common.sh@10 -- # set +x 00:28:48.237 01:29:56 -- host/discovery.sh@59 -- # sort 00:28:48.237 01:29:56 -- host/discovery.sh@59 -- # xargs 00:28:48.237 01:29:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:48.237 01:29:56 -- host/discovery.sh@136 -- # [[ '' == '' ]] 00:28:48.237 01:29:56 -- host/discovery.sh@137 -- # get_bdev_list 00:28:48.237 01:29:56 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:48.237 01:29:56 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:48.237 01:29:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:48.237 01:29:56 -- host/discovery.sh@55 -- # sort 00:28:48.237 01:29:56 -- common/autotest_common.sh@10 -- # set +x 00:28:48.237 01:29:56 -- host/discovery.sh@55 -- # xargs 00:28:48.496 01:29:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:48.496 01:29:56 -- host/discovery.sh@137 -- # [[ '' == '' ]] 00:28:48.496 01:29:56 -- host/discovery.sh@138 -- # get_notification_count 00:28:48.496 01:29:56 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:28:48.496 01:29:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:48.496 01:29:56 -- host/discovery.sh@74 -- # jq '. | length' 00:28:48.496 01:29:56 -- common/autotest_common.sh@10 -- # set +x 00:28:48.496 01:29:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:48.496 01:29:56 -- host/discovery.sh@74 -- # notification_count=2 00:28:48.496 01:29:56 -- host/discovery.sh@75 -- # notify_id=4 00:28:48.496 01:29:56 -- host/discovery.sh@139 -- # [[ 2 == 2 ]] 00:28:48.496 01:29:56 -- host/discovery.sh@142 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:48.496 01:29:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:48.496 01:29:56 -- common/autotest_common.sh@10 -- # set +x 00:28:49.437 [2024-11-20 01:29:57.588687] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:28:49.437 [2024-11-20 01:29:57.588715] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:28:49.437 [2024-11-20 01:29:57.588738] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:28:49.696 [2024-11-20 01:29:57.675009] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new subsystem nvme0 00:28:49.955 [2024-11-20 01:29:57.938694] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:28:49.955 [2024-11-20 01:29:57.938747] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:28:49.955 01:29:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:49.955 01:29:57 -- host/discovery.sh@144 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:49.955 01:29:57 -- common/autotest_common.sh@650 -- # local es=0 00:28:49.955 01:29:57 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:49.955 01:29:57 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:28:49.955 01:29:57 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:28:49.955 01:29:57 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:28:49.955 01:29:57 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:28:49.955 01:29:57 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:49.955 01:29:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:49.955 01:29:57 -- common/autotest_common.sh@10 -- # set +x 00:28:49.955 request: 00:28:49.955 { 00:28:49.955 "name": "nvme", 00:28:49.955 "trtype": "tcp", 00:28:49.955 "traddr": "10.0.0.2", 00:28:49.955 "hostnqn": "nqn.2021-12.io.spdk:test", 00:28:49.955 "adrfam": "ipv4", 00:28:49.955 "trsvcid": "8009", 00:28:49.955 "wait_for_attach": true, 00:28:49.955 "method": "bdev_nvme_start_discovery", 00:28:49.955 "req_id": 1 00:28:49.955 } 00:28:49.955 Got JSON-RPC error response 00:28:49.955 response: 00:28:49.955 { 00:28:49.955 "code": -17, 00:28:49.955 "message": "File exists" 00:28:49.955 } 00:28:49.955 01:29:57 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:28:49.955 01:29:57 -- common/autotest_common.sh@653 -- # es=1 00:28:49.955 01:29:57 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:28:49.955 01:29:57 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:28:49.955 01:29:57 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:28:49.955 01:29:57 -- host/discovery.sh@146 -- # get_discovery_ctrlrs 00:28:49.955 01:29:57 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:28:49.955 01:29:57 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:28:49.955 01:29:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:49.955 01:29:57 -- host/discovery.sh@67 -- # sort 00:28:49.955 01:29:57 -- common/autotest_common.sh@10 -- # set +x 00:28:49.955 01:29:57 -- host/discovery.sh@67 -- # xargs 00:28:49.955 01:29:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:49.955 01:29:57 -- host/discovery.sh@146 -- # [[ nvme == \n\v\m\e ]] 00:28:49.955 01:29:57 -- host/discovery.sh@147 -- # get_bdev_list 00:28:49.955 01:29:57 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:49.955 01:29:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:49.955 01:29:57 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:49.955 01:29:57 -- common/autotest_common.sh@10 -- # set +x 00:28:49.955 01:29:57 -- host/discovery.sh@55 -- # sort 00:28:49.955 01:29:57 -- host/discovery.sh@55 -- # xargs 00:28:49.955 01:29:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:49.955 01:29:58 -- host/discovery.sh@147 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:28:49.955 01:29:58 -- host/discovery.sh@150 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:49.955 01:29:58 -- common/autotest_common.sh@650 -- # local es=0 00:28:49.955 01:29:58 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:49.955 01:29:58 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:28:49.955 01:29:58 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:28:49.955 01:29:58 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:28:49.955 01:29:58 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:28:49.955 01:29:58 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:49.955 01:29:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:49.955 01:29:58 -- common/autotest_common.sh@10 -- # set +x 00:28:49.955 request: 00:28:49.955 { 00:28:49.955 "name": "nvme_second", 00:28:49.955 "trtype": "tcp", 00:28:49.955 "traddr": "10.0.0.2", 00:28:49.955 "hostnqn": "nqn.2021-12.io.spdk:test", 00:28:49.955 "adrfam": "ipv4", 00:28:49.955 "trsvcid": "8009", 00:28:49.955 "wait_for_attach": true, 00:28:49.955 "method": "bdev_nvme_start_discovery", 00:28:49.955 "req_id": 1 00:28:49.955 } 00:28:49.955 Got JSON-RPC error response 00:28:49.955 response: 00:28:49.955 { 00:28:49.955 "code": -17, 00:28:49.955 "message": "File exists" 00:28:49.955 } 00:28:49.955 01:29:58 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:28:49.955 01:29:58 -- common/autotest_common.sh@653 -- # es=1 00:28:49.955 01:29:58 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:28:49.955 01:29:58 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:28:49.955 01:29:58 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:28:49.955 01:29:58 -- host/discovery.sh@152 -- # get_discovery_ctrlrs 00:28:49.955 01:29:58 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:28:49.955 01:29:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:49.955 01:29:58 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:28:49.955 01:29:58 -- common/autotest_common.sh@10 -- # set +x 00:28:49.955 01:29:58 -- host/discovery.sh@67 -- # sort 00:28:49.955 01:29:58 -- host/discovery.sh@67 -- # xargs 00:28:49.955 01:29:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:49.955 01:29:58 -- host/discovery.sh@152 -- # [[ nvme == \n\v\m\e ]] 00:28:49.955 01:29:58 -- host/discovery.sh@153 -- # get_bdev_list 00:28:49.955 01:29:58 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:49.955 01:29:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:49.955 01:29:58 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:49.955 01:29:58 -- common/autotest_common.sh@10 -- # set +x 00:28:49.955 01:29:58 -- host/discovery.sh@55 -- # sort 00:28:49.955 01:29:58 -- host/discovery.sh@55 -- # xargs 00:28:49.955 01:29:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:49.955 01:29:58 -- host/discovery.sh@153 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:28:49.955 01:29:58 -- host/discovery.sh@156 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:28:49.955 01:29:58 -- common/autotest_common.sh@650 -- # local es=0 00:28:49.955 01:29:58 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:28:49.955 01:29:58 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:28:49.955 01:29:58 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:28:49.955 01:29:58 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:28:49.955 01:29:58 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:28:49.955 01:29:58 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:28:49.955 01:29:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:49.955 01:29:58 -- common/autotest_common.sh@10 -- # set +x 00:28:51.335 [2024-11-20 01:29:59.130098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:51.335 [2024-11-20 01:29:59.130277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:51.335 [2024-11-20 01:29:59.130305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b40830 with addr=10.0.0.2, port=8010 00:28:51.335 [2024-11-20 01:29:59.130326] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:28:51.335 [2024-11-20 01:29:59.130339] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:28:51.335 [2024-11-20 01:29:59.130353] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:28:52.269 [2024-11-20 01:30:00.132617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:52.269 [2024-11-20 01:30:00.132806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:52.269 [2024-11-20 01:30:00.132852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b24b50 with addr=10.0.0.2, port=8010 00:28:52.270 [2024-11-20 01:30:00.132882] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:28:52.270 [2024-11-20 01:30:00.132899] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:28:52.270 [2024-11-20 01:30:00.132913] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:28:53.204 [2024-11-20 01:30:01.134774] bdev_nvme.c:6802:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] timed out while attaching discovery ctrlr 00:28:53.204 request: 00:28:53.204 { 00:28:53.204 "name": "nvme_second", 00:28:53.204 "trtype": "tcp", 00:28:53.204 "traddr": "10.0.0.2", 00:28:53.204 "hostnqn": "nqn.2021-12.io.spdk:test", 00:28:53.204 "adrfam": "ipv4", 00:28:53.204 "trsvcid": "8010", 00:28:53.204 "attach_timeout_ms": 3000, 00:28:53.204 "method": "bdev_nvme_start_discovery", 00:28:53.204 "req_id": 1 00:28:53.204 } 00:28:53.204 Got JSON-RPC error response 00:28:53.204 response: 00:28:53.205 { 00:28:53.205 "code": -110, 00:28:53.205 "message": "Connection timed out" 00:28:53.205 } 00:28:53.205 01:30:01 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:28:53.205 01:30:01 -- common/autotest_common.sh@653 -- # es=1 00:28:53.205 01:30:01 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:28:53.205 01:30:01 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:28:53.205 01:30:01 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:28:53.205 01:30:01 -- host/discovery.sh@158 -- # get_discovery_ctrlrs 00:28:53.205 01:30:01 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:28:53.205 01:30:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:53.205 01:30:01 -- common/autotest_common.sh@10 -- # set +x 00:28:53.205 01:30:01 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:28:53.205 01:30:01 -- host/discovery.sh@67 -- # sort 00:28:53.205 01:30:01 -- host/discovery.sh@67 -- # xargs 00:28:53.205 01:30:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:53.205 01:30:01 -- host/discovery.sh@158 -- # [[ nvme == \n\v\m\e ]] 00:28:53.205 01:30:01 -- host/discovery.sh@160 -- # trap - SIGINT SIGTERM EXIT 00:28:53.205 01:30:01 -- host/discovery.sh@162 -- # kill 1253979 00:28:53.205 01:30:01 -- host/discovery.sh@163 -- # nvmftestfini 00:28:53.205 01:30:01 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:53.205 01:30:01 -- nvmf/common.sh@116 -- # sync 00:28:53.205 01:30:01 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:53.205 01:30:01 -- nvmf/common.sh@119 -- # set +e 00:28:53.205 01:30:01 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:53.205 01:30:01 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:53.205 rmmod nvme_tcp 00:28:53.205 rmmod nvme_fabrics 00:28:53.205 rmmod nvme_keyring 00:28:53.205 01:30:01 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:53.205 01:30:01 -- nvmf/common.sh@123 -- # set -e 00:28:53.205 01:30:01 -- nvmf/common.sh@124 -- # return 0 00:28:53.205 01:30:01 -- nvmf/common.sh@477 -- # '[' -n 1253824 ']' 00:28:53.205 01:30:01 -- nvmf/common.sh@478 -- # killprocess 1253824 00:28:53.205 01:30:01 -- common/autotest_common.sh@936 -- # '[' -z 1253824 ']' 00:28:53.205 01:30:01 -- common/autotest_common.sh@940 -- # kill -0 1253824 00:28:53.205 01:30:01 -- common/autotest_common.sh@941 -- # uname 00:28:53.205 01:30:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:53.205 01:30:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1253824 00:28:53.205 01:30:01 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:28:53.205 01:30:01 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:28:53.205 01:30:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1253824' 00:28:53.205 killing process with pid 1253824 00:28:53.205 01:30:01 -- common/autotest_common.sh@955 -- # kill 1253824 00:28:53.205 01:30:01 -- common/autotest_common.sh@960 -- # wait 1253824 00:28:53.462 01:30:01 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:53.462 01:30:01 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:53.462 01:30:01 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:53.462 01:30:01 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:53.462 01:30:01 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:53.462 01:30:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:53.462 01:30:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:53.462 01:30:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:55.365 01:30:03 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:55.365 00:28:55.365 real 0m17.777s 00:28:55.365 user 0m27.328s 00:28:55.365 sys 0m3.084s 00:28:55.365 01:30:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:55.365 01:30:03 -- common/autotest_common.sh@10 -- # set +x 00:28:55.365 ************************************ 00:28:55.365 END TEST nvmf_discovery 00:28:55.365 ************************************ 00:28:55.365 01:30:03 -- nvmf/nvmf.sh@102 -- # run_test nvmf_discovery_remove_ifc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:28:55.365 01:30:03 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:55.365 01:30:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:55.365 01:30:03 -- common/autotest_common.sh@10 -- # set +x 00:28:55.365 ************************************ 00:28:55.365 START TEST nvmf_discovery_remove_ifc 00:28:55.365 ************************************ 00:28:55.365 01:30:03 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:28:55.624 * Looking for test storage... 00:28:55.624 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:28:55.624 01:30:03 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:55.624 01:30:03 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:55.624 01:30:03 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:55.624 01:30:03 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:55.624 01:30:03 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:55.624 01:30:03 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:55.624 01:30:03 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:55.624 01:30:03 -- scripts/common.sh@335 -- # IFS=.-: 00:28:55.624 01:30:03 -- scripts/common.sh@335 -- # read -ra ver1 00:28:55.624 01:30:03 -- scripts/common.sh@336 -- # IFS=.-: 00:28:55.624 01:30:03 -- scripts/common.sh@336 -- # read -ra ver2 00:28:55.624 01:30:03 -- scripts/common.sh@337 -- # local 'op=<' 00:28:55.624 01:30:03 -- scripts/common.sh@339 -- # ver1_l=2 00:28:55.624 01:30:03 -- scripts/common.sh@340 -- # ver2_l=1 00:28:55.624 01:30:03 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:55.624 01:30:03 -- scripts/common.sh@343 -- # case "$op" in 00:28:55.624 01:30:03 -- scripts/common.sh@344 -- # : 1 00:28:55.624 01:30:03 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:55.624 01:30:03 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:55.624 01:30:03 -- scripts/common.sh@364 -- # decimal 1 00:28:55.624 01:30:03 -- scripts/common.sh@352 -- # local d=1 00:28:55.624 01:30:03 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:55.624 01:30:03 -- scripts/common.sh@354 -- # echo 1 00:28:55.624 01:30:03 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:55.624 01:30:03 -- scripts/common.sh@365 -- # decimal 2 00:28:55.624 01:30:03 -- scripts/common.sh@352 -- # local d=2 00:28:55.624 01:30:03 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:55.624 01:30:03 -- scripts/common.sh@354 -- # echo 2 00:28:55.624 01:30:03 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:55.624 01:30:03 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:55.624 01:30:03 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:55.624 01:30:03 -- scripts/common.sh@367 -- # return 0 00:28:55.624 01:30:03 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:55.624 01:30:03 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:55.624 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:55.624 --rc genhtml_branch_coverage=1 00:28:55.624 --rc genhtml_function_coverage=1 00:28:55.624 --rc genhtml_legend=1 00:28:55.624 --rc geninfo_all_blocks=1 00:28:55.624 --rc geninfo_unexecuted_blocks=1 00:28:55.624 00:28:55.624 ' 00:28:55.624 01:30:03 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:55.624 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:55.624 --rc genhtml_branch_coverage=1 00:28:55.624 --rc genhtml_function_coverage=1 00:28:55.624 --rc genhtml_legend=1 00:28:55.624 --rc geninfo_all_blocks=1 00:28:55.624 --rc geninfo_unexecuted_blocks=1 00:28:55.624 00:28:55.624 ' 00:28:55.624 01:30:03 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:55.624 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:55.624 --rc genhtml_branch_coverage=1 00:28:55.624 --rc genhtml_function_coverage=1 00:28:55.624 --rc genhtml_legend=1 00:28:55.624 --rc geninfo_all_blocks=1 00:28:55.624 --rc geninfo_unexecuted_blocks=1 00:28:55.624 00:28:55.624 ' 00:28:55.624 01:30:03 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:55.624 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:55.624 --rc genhtml_branch_coverage=1 00:28:55.624 --rc genhtml_function_coverage=1 00:28:55.624 --rc genhtml_legend=1 00:28:55.624 --rc geninfo_all_blocks=1 00:28:55.624 --rc geninfo_unexecuted_blocks=1 00:28:55.624 00:28:55.624 ' 00:28:55.624 01:30:03 -- host/discovery_remove_ifc.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:55.624 01:30:03 -- nvmf/common.sh@7 -- # uname -s 00:28:55.624 01:30:03 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:55.624 01:30:03 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:55.624 01:30:03 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:55.624 01:30:03 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:55.624 01:30:03 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:55.624 01:30:03 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:55.624 01:30:03 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:55.624 01:30:03 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:55.624 01:30:03 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:55.624 01:30:03 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:55.624 01:30:03 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:55.624 01:30:03 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:55.624 01:30:03 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:55.624 01:30:03 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:55.624 01:30:03 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:55.624 01:30:03 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:55.624 01:30:03 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:55.624 01:30:03 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:55.624 01:30:03 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:55.625 01:30:03 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:55.625 01:30:03 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:55.625 01:30:03 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:55.625 01:30:03 -- paths/export.sh@5 -- # export PATH 00:28:55.625 01:30:03 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:55.625 01:30:03 -- nvmf/common.sh@46 -- # : 0 00:28:55.625 01:30:03 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:55.625 01:30:03 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:55.625 01:30:03 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:55.625 01:30:03 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:55.625 01:30:03 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:55.625 01:30:03 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:55.625 01:30:03 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:55.625 01:30:03 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:55.625 01:30:03 -- host/discovery_remove_ifc.sh@14 -- # '[' tcp == rdma ']' 00:28:55.625 01:30:03 -- host/discovery_remove_ifc.sh@19 -- # discovery_port=8009 00:28:55.625 01:30:03 -- host/discovery_remove_ifc.sh@20 -- # discovery_nqn=nqn.2014-08.org.nvmexpress.discovery 00:28:55.625 01:30:03 -- host/discovery_remove_ifc.sh@23 -- # nqn=nqn.2016-06.io.spdk:cnode 00:28:55.625 01:30:03 -- host/discovery_remove_ifc.sh@25 -- # host_nqn=nqn.2021-12.io.spdk:test 00:28:55.625 01:30:03 -- host/discovery_remove_ifc.sh@26 -- # host_sock=/tmp/host.sock 00:28:55.625 01:30:03 -- host/discovery_remove_ifc.sh@39 -- # nvmftestinit 00:28:55.625 01:30:03 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:55.625 01:30:03 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:55.625 01:30:03 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:55.625 01:30:03 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:55.625 01:30:03 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:55.625 01:30:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:55.625 01:30:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:55.625 01:30:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:55.625 01:30:03 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:55.625 01:30:03 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:55.625 01:30:03 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:55.625 01:30:03 -- common/autotest_common.sh@10 -- # set +x 00:28:58.161 01:30:05 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:58.161 01:30:05 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:58.161 01:30:05 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:58.161 01:30:05 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:58.161 01:30:05 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:58.161 01:30:05 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:58.161 01:30:05 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:58.161 01:30:05 -- nvmf/common.sh@294 -- # net_devs=() 00:28:58.161 01:30:05 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:58.161 01:30:05 -- nvmf/common.sh@295 -- # e810=() 00:28:58.161 01:30:05 -- nvmf/common.sh@295 -- # local -ga e810 00:28:58.161 01:30:05 -- nvmf/common.sh@296 -- # x722=() 00:28:58.161 01:30:05 -- nvmf/common.sh@296 -- # local -ga x722 00:28:58.162 01:30:05 -- nvmf/common.sh@297 -- # mlx=() 00:28:58.162 01:30:05 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:58.162 01:30:05 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:58.162 01:30:05 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:58.162 01:30:05 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:58.162 01:30:05 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:58.162 01:30:05 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:58.162 01:30:05 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:58.162 01:30:05 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:58.162 01:30:05 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:58.162 01:30:05 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:58.162 01:30:05 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:58.162 01:30:05 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:58.162 01:30:05 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:58.162 01:30:05 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:58.162 01:30:05 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:58.162 01:30:05 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:58.162 01:30:05 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:58.162 01:30:05 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:58.162 01:30:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:58.162 01:30:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:58.162 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:58.162 01:30:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:58.162 01:30:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:58.162 01:30:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:58.162 01:30:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:58.162 01:30:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:58.162 01:30:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:58.162 01:30:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:58.162 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:58.162 01:30:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:58.162 01:30:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:58.162 01:30:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:58.162 01:30:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:58.162 01:30:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:58.162 01:30:05 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:58.162 01:30:05 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:58.162 01:30:05 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:58.162 01:30:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:58.162 01:30:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:58.162 01:30:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:58.162 01:30:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:58.162 01:30:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:58.162 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:58.162 01:30:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:58.162 01:30:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:58.162 01:30:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:58.162 01:30:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:58.162 01:30:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:58.162 01:30:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:58.162 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:58.162 01:30:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:58.162 01:30:05 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:58.162 01:30:05 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:58.162 01:30:05 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:58.162 01:30:05 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:58.162 01:30:05 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:58.162 01:30:05 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:58.162 01:30:05 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:58.162 01:30:05 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:58.162 01:30:05 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:58.162 01:30:05 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:58.162 01:30:05 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:58.162 01:30:05 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:58.162 01:30:05 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:58.162 01:30:05 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:58.162 01:30:05 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:58.162 01:30:05 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:58.162 01:30:05 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:58.162 01:30:05 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:58.162 01:30:05 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:58.162 01:30:05 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:58.162 01:30:05 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:58.162 01:30:05 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:58.162 01:30:05 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:58.162 01:30:05 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:58.162 01:30:05 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:58.162 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:58.162 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.313 ms 00:28:58.162 00:28:58.162 --- 10.0.0.2 ping statistics --- 00:28:58.162 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:58.162 rtt min/avg/max/mdev = 0.313/0.313/0.313/0.000 ms 00:28:58.162 01:30:05 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:58.162 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:58.162 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.114 ms 00:28:58.162 00:28:58.162 --- 10.0.0.1 ping statistics --- 00:28:58.162 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:58.162 rtt min/avg/max/mdev = 0.114/0.114/0.114/0.000 ms 00:28:58.162 01:30:05 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:58.162 01:30:05 -- nvmf/common.sh@410 -- # return 0 00:28:58.162 01:30:05 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:28:58.162 01:30:05 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:58.162 01:30:05 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:58.162 01:30:05 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:58.162 01:30:05 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:58.162 01:30:05 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:58.162 01:30:05 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:58.162 01:30:05 -- host/discovery_remove_ifc.sh@40 -- # nvmfappstart -m 0x2 00:28:58.162 01:30:05 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:58.162 01:30:05 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:58.162 01:30:05 -- common/autotest_common.sh@10 -- # set +x 00:28:58.162 01:30:05 -- nvmf/common.sh@469 -- # nvmfpid=1257691 00:28:58.162 01:30:05 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:28:58.162 01:30:05 -- nvmf/common.sh@470 -- # waitforlisten 1257691 00:28:58.162 01:30:05 -- common/autotest_common.sh@829 -- # '[' -z 1257691 ']' 00:28:58.162 01:30:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:58.162 01:30:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:58.162 01:30:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:58.162 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:58.162 01:30:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:58.162 01:30:05 -- common/autotest_common.sh@10 -- # set +x 00:28:58.162 [2024-11-20 01:30:05.953334] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:28:58.162 [2024-11-20 01:30:05.953417] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:58.162 EAL: No free 2048 kB hugepages reported on node 1 00:28:58.162 [2024-11-20 01:30:06.019209] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:58.162 [2024-11-20 01:30:06.106669] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:58.162 [2024-11-20 01:30:06.106852] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:58.162 [2024-11-20 01:30:06.106872] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:58.162 [2024-11-20 01:30:06.106886] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:58.162 [2024-11-20 01:30:06.106918] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:58.771 01:30:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:58.771 01:30:06 -- common/autotest_common.sh@862 -- # return 0 00:28:58.771 01:30:06 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:58.771 01:30:06 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:58.771 01:30:06 -- common/autotest_common.sh@10 -- # set +x 00:28:58.771 01:30:06 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:58.771 01:30:06 -- host/discovery_remove_ifc.sh@43 -- # rpc_cmd 00:28:58.771 01:30:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:58.771 01:30:06 -- common/autotest_common.sh@10 -- # set +x 00:28:58.771 [2024-11-20 01:30:06.960598] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:59.054 [2024-11-20 01:30:06.968756] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:28:59.054 null0 00:28:59.054 [2024-11-20 01:30:07.000752] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:59.054 01:30:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.054 01:30:07 -- host/discovery_remove_ifc.sh@59 -- # hostpid=1257848 00:28:59.054 01:30:07 -- host/discovery_remove_ifc.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock --wait-for-rpc -L bdev_nvme 00:28:59.054 01:30:07 -- host/discovery_remove_ifc.sh@60 -- # waitforlisten 1257848 /tmp/host.sock 00:28:59.054 01:30:07 -- common/autotest_common.sh@829 -- # '[' -z 1257848 ']' 00:28:59.054 01:30:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:28:59.054 01:30:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:59.054 01:30:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:28:59.054 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:28:59.054 01:30:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:59.054 01:30:07 -- common/autotest_common.sh@10 -- # set +x 00:28:59.054 [2024-11-20 01:30:07.063177] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:28:59.054 [2024-11-20 01:30:07.063244] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1257848 ] 00:28:59.054 EAL: No free 2048 kB hugepages reported on node 1 00:28:59.054 [2024-11-20 01:30:07.123975] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:59.054 [2024-11-20 01:30:07.217014] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:59.054 [2024-11-20 01:30:07.217192] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:59.312 01:30:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:59.312 01:30:07 -- common/autotest_common.sh@862 -- # return 0 00:28:59.312 01:30:07 -- host/discovery_remove_ifc.sh@62 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:59.312 01:30:07 -- host/discovery_remove_ifc.sh@65 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_set_options -e 1 00:28:59.312 01:30:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.312 01:30:07 -- common/autotest_common.sh@10 -- # set +x 00:28:59.312 01:30:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.312 01:30:07 -- host/discovery_remove_ifc.sh@66 -- # rpc_cmd -s /tmp/host.sock framework_start_init 00:28:59.312 01:30:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.312 01:30:07 -- common/autotest_common.sh@10 -- # set +x 00:28:59.312 01:30:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.312 01:30:07 -- host/discovery_remove_ifc.sh@69 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test --ctrlr-loss-timeout-sec 2 --reconnect-delay-sec 1 --fast-io-fail-timeout-sec 1 --wait-for-attach 00:28:59.312 01:30:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.312 01:30:07 -- common/autotest_common.sh@10 -- # set +x 00:29:00.688 [2024-11-20 01:30:08.489694] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:29:00.688 [2024-11-20 01:30:08.489731] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:29:00.688 [2024-11-20 01:30:08.489756] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:00.688 [2024-11-20 01:30:08.617178] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:29:00.688 [2024-11-20 01:30:08.718749] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:29:00.688 [2024-11-20 01:30:08.718805] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:29:00.688 [2024-11-20 01:30:08.718849] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:29:00.688 [2024-11-20 01:30:08.718880] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:29:00.688 [2024-11-20 01:30:08.718933] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:29:00.688 01:30:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:00.688 01:30:08 -- host/discovery_remove_ifc.sh@72 -- # wait_for_bdev nvme0n1 00:29:00.688 01:30:08 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:00.688 01:30:08 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:00.688 01:30:08 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:00.688 01:30:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:00.688 01:30:08 -- common/autotest_common.sh@10 -- # set +x 00:29:00.688 01:30:08 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:00.688 01:30:08 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:00.688 [2024-11-20 01:30:08.726907] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x111e4b0 was disconnected and freed. delete nvme_qpair. 00:29:00.688 01:30:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:00.688 01:30:08 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != \n\v\m\e\0\n\1 ]] 00:29:00.688 01:30:08 -- host/discovery_remove_ifc.sh@75 -- # ip netns exec cvl_0_0_ns_spdk ip addr del 10.0.0.2/24 dev cvl_0_0 00:29:00.688 01:30:08 -- host/discovery_remove_ifc.sh@76 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 down 00:29:00.688 01:30:08 -- host/discovery_remove_ifc.sh@79 -- # wait_for_bdev '' 00:29:00.688 01:30:08 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:00.688 01:30:08 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:00.688 01:30:08 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:00.688 01:30:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:00.688 01:30:08 -- common/autotest_common.sh@10 -- # set +x 00:29:00.688 01:30:08 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:00.688 01:30:08 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:00.688 01:30:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:00.688 01:30:08 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:00.688 01:30:08 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:02.067 01:30:09 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:02.067 01:30:09 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:02.067 01:30:09 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:02.067 01:30:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:02.067 01:30:09 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:02.067 01:30:09 -- common/autotest_common.sh@10 -- # set +x 00:29:02.067 01:30:09 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:02.067 01:30:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:02.067 01:30:09 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:02.067 01:30:09 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:03.007 01:30:10 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:03.007 01:30:10 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:03.007 01:30:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:03.007 01:30:10 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:03.007 01:30:10 -- common/autotest_common.sh@10 -- # set +x 00:29:03.007 01:30:10 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:03.007 01:30:10 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:03.007 01:30:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:03.007 01:30:10 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:03.007 01:30:10 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:03.941 01:30:11 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:03.941 01:30:11 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:03.941 01:30:11 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:03.941 01:30:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:03.941 01:30:11 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:03.941 01:30:11 -- common/autotest_common.sh@10 -- # set +x 00:29:03.941 01:30:11 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:03.941 01:30:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:03.941 01:30:11 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:03.941 01:30:11 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:04.881 01:30:12 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:04.881 01:30:12 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:04.881 01:30:12 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:04.881 01:30:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.881 01:30:12 -- common/autotest_common.sh@10 -- # set +x 00:29:04.881 01:30:12 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:04.881 01:30:12 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:04.881 01:30:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.881 01:30:13 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:04.881 01:30:13 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:06.262 01:30:14 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:06.262 01:30:14 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:06.262 01:30:14 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:06.262 01:30:14 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:06.262 01:30:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:06.262 01:30:14 -- common/autotest_common.sh@10 -- # set +x 00:29:06.262 01:30:14 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:06.262 01:30:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:06.262 01:30:14 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:06.262 01:30:14 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:06.262 [2024-11-20 01:30:14.160151] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 110: Connection timed out 00:29:06.262 [2024-11-20 01:30:14.160211] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:29:06.262 [2024-11-20 01:30:14.160232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:06.262 [2024-11-20 01:30:14.160262] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:29:06.262 [2024-11-20 01:30:14.160276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:06.262 [2024-11-20 01:30:14.160291] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:29:06.262 [2024-11-20 01:30:14.160304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:06.262 [2024-11-20 01:30:14.160328] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:29:06.262 [2024-11-20 01:30:14.160340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:06.262 [2024-11-20 01:30:14.160354] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:29:06.262 [2024-11-20 01:30:14.160383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:06.262 [2024-11-20 01:30:14.160410] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10e5790 is same with the state(5) to be set 00:29:06.262 [2024-11-20 01:30:14.170171] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10e5790 (9): Bad file descriptor 00:29:06.262 [2024-11-20 01:30:14.180223] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:07.197 01:30:15 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:07.197 01:30:15 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:07.197 01:30:15 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:07.197 01:30:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:07.197 01:30:15 -- common/autotest_common.sh@10 -- # set +x 00:29:07.197 01:30:15 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:07.197 01:30:15 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:07.197 [2024-11-20 01:30:15.231105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:29:08.137 [2024-11-20 01:30:16.255122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:29:08.137 [2024-11-20 01:30:16.255197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10e5790 with addr=10.0.0.2, port=4420 00:29:08.137 [2024-11-20 01:30:16.255239] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10e5790 is same with the state(5) to be set 00:29:08.137 [2024-11-20 01:30:16.255275] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:08.137 [2024-11-20 01:30:16.255291] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:08.137 [2024-11-20 01:30:16.255305] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:08.137 [2024-11-20 01:30:16.255318] nvme_ctrlr.c:1017:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] already in failed state 00:29:08.137 [2024-11-20 01:30:16.255768] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10e5790 (9): Bad file descriptor 00:29:08.137 [2024-11-20 01:30:16.255805] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:08.137 [2024-11-20 01:30:16.255850] bdev_nvme.c:6510:remove_discovery_entry: *INFO*: Discovery[10.0.0.2:8009] Remove discovery entry: nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 00:29:08.137 [2024-11-20 01:30:16.255901] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:29:08.137 [2024-11-20 01:30:16.255922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:08.137 [2024-11-20 01:30:16.255939] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:29:08.137 [2024-11-20 01:30:16.255952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:08.137 [2024-11-20 01:30:16.255966] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:29:08.137 [2024-11-20 01:30:16.255978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:08.137 [2024-11-20 01:30:16.255991] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:29:08.137 [2024-11-20 01:30:16.256004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:08.137 [2024-11-20 01:30:16.256018] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:29:08.137 [2024-11-20 01:30:16.256031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:08.137 [2024-11-20 01:30:16.256043] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] in failed state. 00:29:08.137 [2024-11-20 01:30:16.256276] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10e4c40 (9): Bad file descriptor 00:29:08.137 [2024-11-20 01:30:16.257293] nvme_fabric.c: 214:nvme_fabric_prop_get_cmd_async: *ERROR*: Failed to send Property Get fabrics command 00:29:08.137 [2024-11-20 01:30:16.257315] nvme_ctrlr.c:1136:nvme_ctrlr_shutdown_async: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] Failed to read the CC register 00:29:08.137 01:30:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:08.137 01:30:16 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:08.138 01:30:16 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:09.075 01:30:17 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:09.075 01:30:17 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:09.075 01:30:17 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:09.075 01:30:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:09.075 01:30:17 -- common/autotest_common.sh@10 -- # set +x 00:29:09.075 01:30:17 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:09.075 01:30:17 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:09.075 01:30:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:09.334 01:30:17 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != '' ]] 00:29:09.334 01:30:17 -- host/discovery_remove_ifc.sh@82 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:09.334 01:30:17 -- host/discovery_remove_ifc.sh@83 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:09.334 01:30:17 -- host/discovery_remove_ifc.sh@86 -- # wait_for_bdev nvme1n1 00:29:09.334 01:30:17 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:09.334 01:30:17 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:09.334 01:30:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:09.334 01:30:17 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:09.334 01:30:17 -- common/autotest_common.sh@10 -- # set +x 00:29:09.334 01:30:17 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:09.334 01:30:17 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:09.334 01:30:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:09.334 01:30:17 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:29:09.334 01:30:17 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:10.271 [2024-11-20 01:30:18.314697] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:29:10.271 [2024-11-20 01:30:18.314723] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:29:10.271 [2024-11-20 01:30:18.314748] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:10.271 [2024-11-20 01:30:18.444307] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme1 00:29:10.271 01:30:18 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:10.271 01:30:18 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:10.271 01:30:18 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:10.271 01:30:18 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:10.271 01:30:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:10.271 01:30:18 -- common/autotest_common.sh@10 -- # set +x 00:29:10.271 01:30:18 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:10.271 01:30:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:10.271 01:30:18 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:29:10.271 01:30:18 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:10.529 [2024-11-20 01:30:18.627519] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:29:10.529 [2024-11-20 01:30:18.627571] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:29:10.529 [2024-11-20 01:30:18.627606] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:29:10.529 [2024-11-20 01:30:18.627630] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme1 done 00:29:10.529 [2024-11-20 01:30:18.627645] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:29:10.529 [2024-11-20 01:30:18.633285] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x1105970 was disconnected and freed. delete nvme_qpair. 00:29:11.464 01:30:19 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:11.464 01:30:19 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:11.464 01:30:19 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:11.464 01:30:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:11.464 01:30:19 -- common/autotest_common.sh@10 -- # set +x 00:29:11.464 01:30:19 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:11.464 01:30:19 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:11.464 01:30:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:11.464 01:30:19 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme1n1 != \n\v\m\e\1\n\1 ]] 00:29:11.464 01:30:19 -- host/discovery_remove_ifc.sh@88 -- # trap - SIGINT SIGTERM EXIT 00:29:11.464 01:30:19 -- host/discovery_remove_ifc.sh@90 -- # killprocess 1257848 00:29:11.464 01:30:19 -- common/autotest_common.sh@936 -- # '[' -z 1257848 ']' 00:29:11.464 01:30:19 -- common/autotest_common.sh@940 -- # kill -0 1257848 00:29:11.464 01:30:19 -- common/autotest_common.sh@941 -- # uname 00:29:11.464 01:30:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:11.464 01:30:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1257848 00:29:11.464 01:30:19 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:11.464 01:30:19 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:11.464 01:30:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1257848' 00:29:11.464 killing process with pid 1257848 00:29:11.464 01:30:19 -- common/autotest_common.sh@955 -- # kill 1257848 00:29:11.464 01:30:19 -- common/autotest_common.sh@960 -- # wait 1257848 00:29:11.724 01:30:19 -- host/discovery_remove_ifc.sh@91 -- # nvmftestfini 00:29:11.724 01:30:19 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:11.724 01:30:19 -- nvmf/common.sh@116 -- # sync 00:29:11.724 01:30:19 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:11.724 01:30:19 -- nvmf/common.sh@119 -- # set +e 00:29:11.724 01:30:19 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:11.724 01:30:19 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:11.724 rmmod nvme_tcp 00:29:11.724 rmmod nvme_fabrics 00:29:11.724 rmmod nvme_keyring 00:29:11.724 01:30:19 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:11.724 01:30:19 -- nvmf/common.sh@123 -- # set -e 00:29:11.724 01:30:19 -- nvmf/common.sh@124 -- # return 0 00:29:11.724 01:30:19 -- nvmf/common.sh@477 -- # '[' -n 1257691 ']' 00:29:11.724 01:30:19 -- nvmf/common.sh@478 -- # killprocess 1257691 00:29:11.724 01:30:19 -- common/autotest_common.sh@936 -- # '[' -z 1257691 ']' 00:29:11.724 01:30:19 -- common/autotest_common.sh@940 -- # kill -0 1257691 00:29:11.724 01:30:19 -- common/autotest_common.sh@941 -- # uname 00:29:11.724 01:30:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:11.724 01:30:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1257691 00:29:11.724 01:30:19 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:11.724 01:30:19 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:11.724 01:30:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1257691' 00:29:11.724 killing process with pid 1257691 00:29:11.724 01:30:19 -- common/autotest_common.sh@955 -- # kill 1257691 00:29:11.724 01:30:19 -- common/autotest_common.sh@960 -- # wait 1257691 00:29:11.984 01:30:20 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:29:11.984 01:30:20 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:11.984 01:30:20 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:11.984 01:30:20 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:11.984 01:30:20 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:11.984 01:30:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:11.984 01:30:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:11.984 01:30:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:14.520 01:30:22 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:14.520 00:29:14.520 real 0m18.590s 00:29:14.520 user 0m25.932s 00:29:14.520 sys 0m2.927s 00:29:14.520 01:30:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:14.520 01:30:22 -- common/autotest_common.sh@10 -- # set +x 00:29:14.520 ************************************ 00:29:14.520 END TEST nvmf_discovery_remove_ifc 00:29:14.520 ************************************ 00:29:14.520 01:30:22 -- nvmf/nvmf.sh@106 -- # [[ tcp == \t\c\p ]] 00:29:14.520 01:30:22 -- nvmf/nvmf.sh@107 -- # run_test nvmf_digest /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:29:14.520 01:30:22 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:29:14.520 01:30:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:14.520 01:30:22 -- common/autotest_common.sh@10 -- # set +x 00:29:14.520 ************************************ 00:29:14.520 START TEST nvmf_digest 00:29:14.520 ************************************ 00:29:14.520 01:30:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:29:14.520 * Looking for test storage... 00:29:14.520 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:29:14.520 01:30:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:29:14.520 01:30:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:29:14.520 01:30:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:29:14.520 01:30:22 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:29:14.520 01:30:22 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:29:14.520 01:30:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:29:14.520 01:30:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:29:14.520 01:30:22 -- scripts/common.sh@335 -- # IFS=.-: 00:29:14.520 01:30:22 -- scripts/common.sh@335 -- # read -ra ver1 00:29:14.520 01:30:22 -- scripts/common.sh@336 -- # IFS=.-: 00:29:14.520 01:30:22 -- scripts/common.sh@336 -- # read -ra ver2 00:29:14.520 01:30:22 -- scripts/common.sh@337 -- # local 'op=<' 00:29:14.520 01:30:22 -- scripts/common.sh@339 -- # ver1_l=2 00:29:14.521 01:30:22 -- scripts/common.sh@340 -- # ver2_l=1 00:29:14.521 01:30:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:29:14.521 01:30:22 -- scripts/common.sh@343 -- # case "$op" in 00:29:14.521 01:30:22 -- scripts/common.sh@344 -- # : 1 00:29:14.521 01:30:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:29:14.521 01:30:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:29:14.521 01:30:22 -- scripts/common.sh@364 -- # decimal 1 00:29:14.521 01:30:22 -- scripts/common.sh@352 -- # local d=1 00:29:14.521 01:30:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:29:14.521 01:30:22 -- scripts/common.sh@354 -- # echo 1 00:29:14.521 01:30:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:29:14.521 01:30:22 -- scripts/common.sh@365 -- # decimal 2 00:29:14.521 01:30:22 -- scripts/common.sh@352 -- # local d=2 00:29:14.521 01:30:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:29:14.521 01:30:22 -- scripts/common.sh@354 -- # echo 2 00:29:14.521 01:30:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:29:14.521 01:30:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:29:14.521 01:30:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:29:14.521 01:30:22 -- scripts/common.sh@367 -- # return 0 00:29:14.521 01:30:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:29:14.521 01:30:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:29:14.521 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:14.521 --rc genhtml_branch_coverage=1 00:29:14.521 --rc genhtml_function_coverage=1 00:29:14.521 --rc genhtml_legend=1 00:29:14.521 --rc geninfo_all_blocks=1 00:29:14.521 --rc geninfo_unexecuted_blocks=1 00:29:14.521 00:29:14.521 ' 00:29:14.521 01:30:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:29:14.521 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:14.521 --rc genhtml_branch_coverage=1 00:29:14.521 --rc genhtml_function_coverage=1 00:29:14.521 --rc genhtml_legend=1 00:29:14.521 --rc geninfo_all_blocks=1 00:29:14.521 --rc geninfo_unexecuted_blocks=1 00:29:14.521 00:29:14.521 ' 00:29:14.521 01:30:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:29:14.521 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:14.521 --rc genhtml_branch_coverage=1 00:29:14.521 --rc genhtml_function_coverage=1 00:29:14.521 --rc genhtml_legend=1 00:29:14.521 --rc geninfo_all_blocks=1 00:29:14.521 --rc geninfo_unexecuted_blocks=1 00:29:14.521 00:29:14.521 ' 00:29:14.521 01:30:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:29:14.521 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:14.521 --rc genhtml_branch_coverage=1 00:29:14.521 --rc genhtml_function_coverage=1 00:29:14.521 --rc genhtml_legend=1 00:29:14.521 --rc geninfo_all_blocks=1 00:29:14.521 --rc geninfo_unexecuted_blocks=1 00:29:14.521 00:29:14.521 ' 00:29:14.521 01:30:22 -- host/digest.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:14.521 01:30:22 -- nvmf/common.sh@7 -- # uname -s 00:29:14.521 01:30:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:14.521 01:30:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:14.521 01:30:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:14.521 01:30:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:14.521 01:30:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:14.521 01:30:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:14.521 01:30:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:14.521 01:30:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:14.521 01:30:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:14.521 01:30:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:14.521 01:30:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:14.521 01:30:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:14.521 01:30:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:14.521 01:30:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:14.521 01:30:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:14.521 01:30:22 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:14.521 01:30:22 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:14.521 01:30:22 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:14.521 01:30:22 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:14.521 01:30:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:14.521 01:30:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:14.521 01:30:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:14.521 01:30:22 -- paths/export.sh@5 -- # export PATH 00:29:14.521 01:30:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:14.521 01:30:22 -- nvmf/common.sh@46 -- # : 0 00:29:14.521 01:30:22 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:14.521 01:30:22 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:14.521 01:30:22 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:14.521 01:30:22 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:14.521 01:30:22 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:14.521 01:30:22 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:14.521 01:30:22 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:14.521 01:30:22 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:14.521 01:30:22 -- host/digest.sh@14 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:29:14.521 01:30:22 -- host/digest.sh@15 -- # bperfsock=/var/tmp/bperf.sock 00:29:14.521 01:30:22 -- host/digest.sh@16 -- # runtime=2 00:29:14.521 01:30:22 -- host/digest.sh@130 -- # [[ tcp != \t\c\p ]] 00:29:14.521 01:30:22 -- host/digest.sh@132 -- # nvmftestinit 00:29:14.521 01:30:22 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:14.521 01:30:22 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:14.521 01:30:22 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:14.521 01:30:22 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:14.521 01:30:22 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:14.521 01:30:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:14.521 01:30:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:14.521 01:30:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:14.521 01:30:22 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:14.521 01:30:22 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:14.521 01:30:22 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:14.521 01:30:22 -- common/autotest_common.sh@10 -- # set +x 00:29:16.426 01:30:24 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:16.426 01:30:24 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:16.426 01:30:24 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:16.426 01:30:24 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:16.426 01:30:24 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:16.426 01:30:24 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:16.426 01:30:24 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:16.426 01:30:24 -- nvmf/common.sh@294 -- # net_devs=() 00:29:16.426 01:30:24 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:16.426 01:30:24 -- nvmf/common.sh@295 -- # e810=() 00:29:16.426 01:30:24 -- nvmf/common.sh@295 -- # local -ga e810 00:29:16.426 01:30:24 -- nvmf/common.sh@296 -- # x722=() 00:29:16.426 01:30:24 -- nvmf/common.sh@296 -- # local -ga x722 00:29:16.426 01:30:24 -- nvmf/common.sh@297 -- # mlx=() 00:29:16.426 01:30:24 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:16.426 01:30:24 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:16.426 01:30:24 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:16.426 01:30:24 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:16.426 01:30:24 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:16.426 01:30:24 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:16.426 01:30:24 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:16.426 01:30:24 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:16.426 01:30:24 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:16.426 01:30:24 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:16.426 01:30:24 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:16.426 01:30:24 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:16.426 01:30:24 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:16.426 01:30:24 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:16.426 01:30:24 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:16.426 01:30:24 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:16.426 01:30:24 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:16.426 01:30:24 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:16.426 01:30:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:16.426 01:30:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:16.427 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:16.427 01:30:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:16.427 01:30:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:16.427 01:30:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:16.427 01:30:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:16.427 01:30:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:16.427 01:30:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:16.427 01:30:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:16.427 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:16.427 01:30:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:16.427 01:30:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:16.427 01:30:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:16.427 01:30:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:16.427 01:30:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:16.427 01:30:24 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:16.427 01:30:24 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:16.427 01:30:24 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:16.427 01:30:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:16.427 01:30:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:16.427 01:30:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:16.427 01:30:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:16.427 01:30:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:16.427 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:16.427 01:30:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:16.427 01:30:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:16.427 01:30:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:16.427 01:30:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:16.427 01:30:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:16.427 01:30:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:16.427 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:16.427 01:30:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:16.427 01:30:24 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:16.427 01:30:24 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:16.427 01:30:24 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:16.427 01:30:24 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:16.427 01:30:24 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:16.427 01:30:24 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:16.427 01:30:24 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:16.427 01:30:24 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:16.427 01:30:24 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:16.427 01:30:24 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:16.427 01:30:24 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:16.427 01:30:24 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:16.427 01:30:24 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:16.427 01:30:24 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:16.427 01:30:24 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:16.427 01:30:24 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:16.427 01:30:24 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:16.427 01:30:24 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:16.427 01:30:24 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:16.427 01:30:24 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:16.427 01:30:24 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:16.427 01:30:24 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:16.427 01:30:24 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:16.427 01:30:24 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:16.427 01:30:24 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:16.427 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:16.427 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.249 ms 00:29:16.427 00:29:16.427 --- 10.0.0.2 ping statistics --- 00:29:16.427 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:16.427 rtt min/avg/max/mdev = 0.249/0.249/0.249/0.000 ms 00:29:16.427 01:30:24 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:16.427 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:16.427 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.075 ms 00:29:16.427 00:29:16.427 --- 10.0.0.1 ping statistics --- 00:29:16.427 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:16.427 rtt min/avg/max/mdev = 0.075/0.075/0.075/0.000 ms 00:29:16.427 01:30:24 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:16.427 01:30:24 -- nvmf/common.sh@410 -- # return 0 00:29:16.427 01:30:24 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:29:16.427 01:30:24 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:16.427 01:30:24 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:16.427 01:30:24 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:16.427 01:30:24 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:16.427 01:30:24 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:16.427 01:30:24 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:16.427 01:30:24 -- host/digest.sh@134 -- # trap cleanup SIGINT SIGTERM EXIT 00:29:16.427 01:30:24 -- host/digest.sh@135 -- # run_test nvmf_digest_clean run_digest 00:29:16.427 01:30:24 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:16.427 01:30:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:16.427 01:30:24 -- common/autotest_common.sh@10 -- # set +x 00:29:16.427 ************************************ 00:29:16.427 START TEST nvmf_digest_clean 00:29:16.427 ************************************ 00:29:16.427 01:30:24 -- common/autotest_common.sh@1114 -- # run_digest 00:29:16.427 01:30:24 -- host/digest.sh@119 -- # nvmfappstart --wait-for-rpc 00:29:16.427 01:30:24 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:16.427 01:30:24 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:16.427 01:30:24 -- common/autotest_common.sh@10 -- # set +x 00:29:16.427 01:30:24 -- nvmf/common.sh@469 -- # nvmfpid=1261884 00:29:16.427 01:30:24 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:29:16.427 01:30:24 -- nvmf/common.sh@470 -- # waitforlisten 1261884 00:29:16.427 01:30:24 -- common/autotest_common.sh@829 -- # '[' -z 1261884 ']' 00:29:16.427 01:30:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:16.427 01:30:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:16.427 01:30:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:16.427 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:16.427 01:30:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:16.427 01:30:24 -- common/autotest_common.sh@10 -- # set +x 00:29:16.427 [2024-11-20 01:30:24.565525] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:16.427 [2024-11-20 01:30:24.565593] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:16.427 EAL: No free 2048 kB hugepages reported on node 1 00:29:16.427 [2024-11-20 01:30:24.633920] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:16.686 [2024-11-20 01:30:24.726931] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:16.687 [2024-11-20 01:30:24.727108] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:16.687 [2024-11-20 01:30:24.727146] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:16.687 [2024-11-20 01:30:24.727159] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:16.687 [2024-11-20 01:30:24.727185] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:16.687 01:30:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:16.687 01:30:24 -- common/autotest_common.sh@862 -- # return 0 00:29:16.687 01:30:24 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:16.687 01:30:24 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:16.687 01:30:24 -- common/autotest_common.sh@10 -- # set +x 00:29:16.687 01:30:24 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:16.687 01:30:24 -- host/digest.sh@120 -- # common_target_config 00:29:16.687 01:30:24 -- host/digest.sh@43 -- # rpc_cmd 00:29:16.687 01:30:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:16.687 01:30:24 -- common/autotest_common.sh@10 -- # set +x 00:29:16.945 null0 00:29:16.945 [2024-11-20 01:30:24.929568] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:16.945 [2024-11-20 01:30:24.953797] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:16.945 01:30:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:16.945 01:30:24 -- host/digest.sh@122 -- # run_bperf randread 4096 128 00:29:16.945 01:30:24 -- host/digest.sh@77 -- # local rw bs qd 00:29:16.945 01:30:24 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:16.945 01:30:24 -- host/digest.sh@80 -- # rw=randread 00:29:16.945 01:30:24 -- host/digest.sh@80 -- # bs=4096 00:29:16.945 01:30:24 -- host/digest.sh@80 -- # qd=128 00:29:16.945 01:30:24 -- host/digest.sh@82 -- # bperfpid=1262026 00:29:16.945 01:30:24 -- host/digest.sh@83 -- # waitforlisten 1262026 /var/tmp/bperf.sock 00:29:16.945 01:30:24 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:29:16.945 01:30:24 -- common/autotest_common.sh@829 -- # '[' -z 1262026 ']' 00:29:16.945 01:30:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:16.945 01:30:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:16.945 01:30:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:16.945 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:16.945 01:30:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:16.945 01:30:24 -- common/autotest_common.sh@10 -- # set +x 00:29:16.945 [2024-11-20 01:30:25.000645] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:16.945 [2024-11-20 01:30:25.000718] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1262026 ] 00:29:16.945 EAL: No free 2048 kB hugepages reported on node 1 00:29:16.945 [2024-11-20 01:30:25.063229] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:16.945 [2024-11-20 01:30:25.151428] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:17.203 01:30:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:17.203 01:30:25 -- common/autotest_common.sh@862 -- # return 0 00:29:17.203 01:30:25 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:17.203 01:30:25 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:17.203 01:30:25 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:17.462 01:30:25 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:17.462 01:30:25 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:17.720 nvme0n1 00:29:17.720 01:30:25 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:17.720 01:30:25 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:17.978 Running I/O for 2 seconds... 00:29:19.879 00:29:19.879 Latency(us) 00:29:19.879 [2024-11-20T00:30:28.098Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:19.879 [2024-11-20T00:30:28.098Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:29:19.879 nvme0n1 : 2.01 16650.49 65.04 0.00 0.00 7680.34 3495.25 18544.26 00:29:19.879 [2024-11-20T00:30:28.098Z] =================================================================================================================== 00:29:19.879 [2024-11-20T00:30:28.098Z] Total : 16650.49 65.04 0.00 0.00 7680.34 3495.25 18544.26 00:29:19.879 0 00:29:19.879 01:30:28 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:19.879 01:30:28 -- host/digest.sh@92 -- # get_accel_stats 00:29:19.879 01:30:28 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:19.879 01:30:28 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:19.880 | select(.opcode=="crc32c") 00:29:19.880 | "\(.module_name) \(.executed)"' 00:29:19.880 01:30:28 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:20.138 01:30:28 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:20.138 01:30:28 -- host/digest.sh@93 -- # exp_module=software 00:29:20.138 01:30:28 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:20.138 01:30:28 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:20.138 01:30:28 -- host/digest.sh@97 -- # killprocess 1262026 00:29:20.138 01:30:28 -- common/autotest_common.sh@936 -- # '[' -z 1262026 ']' 00:29:20.138 01:30:28 -- common/autotest_common.sh@940 -- # kill -0 1262026 00:29:20.138 01:30:28 -- common/autotest_common.sh@941 -- # uname 00:29:20.138 01:30:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:20.138 01:30:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1262026 00:29:20.138 01:30:28 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:20.138 01:30:28 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:20.138 01:30:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1262026' 00:29:20.138 killing process with pid 1262026 00:29:20.138 01:30:28 -- common/autotest_common.sh@955 -- # kill 1262026 00:29:20.138 Received shutdown signal, test time was about 2.000000 seconds 00:29:20.138 00:29:20.138 Latency(us) 00:29:20.138 [2024-11-20T00:30:28.357Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:20.138 [2024-11-20T00:30:28.357Z] =================================================================================================================== 00:29:20.138 [2024-11-20T00:30:28.357Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:20.138 01:30:28 -- common/autotest_common.sh@960 -- # wait 1262026 00:29:20.396 01:30:28 -- host/digest.sh@123 -- # run_bperf randread 131072 16 00:29:20.396 01:30:28 -- host/digest.sh@77 -- # local rw bs qd 00:29:20.396 01:30:28 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:20.396 01:30:28 -- host/digest.sh@80 -- # rw=randread 00:29:20.396 01:30:28 -- host/digest.sh@80 -- # bs=131072 00:29:20.396 01:30:28 -- host/digest.sh@80 -- # qd=16 00:29:20.396 01:30:28 -- host/digest.sh@82 -- # bperfpid=1262449 00:29:20.396 01:30:28 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:29:20.396 01:30:28 -- host/digest.sh@83 -- # waitforlisten 1262449 /var/tmp/bperf.sock 00:29:20.396 01:30:28 -- common/autotest_common.sh@829 -- # '[' -z 1262449 ']' 00:29:20.396 01:30:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:20.396 01:30:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:20.396 01:30:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:20.396 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:20.396 01:30:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:20.396 01:30:28 -- common/autotest_common.sh@10 -- # set +x 00:29:20.396 [2024-11-20 01:30:28.589300] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:20.396 [2024-11-20 01:30:28.589387] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1262449 ] 00:29:20.396 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:20.396 Zero copy mechanism will not be used. 00:29:20.655 EAL: No free 2048 kB hugepages reported on node 1 00:29:20.655 [2024-11-20 01:30:28.650489] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:20.655 [2024-11-20 01:30:28.743156] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:20.655 01:30:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:20.655 01:30:28 -- common/autotest_common.sh@862 -- # return 0 00:29:20.655 01:30:28 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:20.655 01:30:28 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:20.655 01:30:28 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:21.222 01:30:29 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:21.222 01:30:29 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:21.480 nvme0n1 00:29:21.480 01:30:29 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:21.480 01:30:29 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:21.480 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:21.480 Zero copy mechanism will not be used. 00:29:21.480 Running I/O for 2 seconds... 00:29:24.015 00:29:24.015 Latency(us) 00:29:24.015 [2024-11-20T00:30:32.234Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:24.015 [2024-11-20T00:30:32.234Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:29:24.015 nvme0n1 : 2.00 6111.23 763.90 0.00 0.00 2614.18 782.79 4878.79 00:29:24.015 [2024-11-20T00:30:32.234Z] =================================================================================================================== 00:29:24.015 [2024-11-20T00:30:32.234Z] Total : 6111.23 763.90 0.00 0.00 2614.18 782.79 4878.79 00:29:24.015 0 00:29:24.015 01:30:31 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:24.015 01:30:31 -- host/digest.sh@92 -- # get_accel_stats 00:29:24.015 01:30:31 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:24.015 01:30:31 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:24.015 | select(.opcode=="crc32c") 00:29:24.015 | "\(.module_name) \(.executed)"' 00:29:24.015 01:30:31 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:24.015 01:30:31 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:24.015 01:30:31 -- host/digest.sh@93 -- # exp_module=software 00:29:24.015 01:30:31 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:24.015 01:30:31 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:24.015 01:30:31 -- host/digest.sh@97 -- # killprocess 1262449 00:29:24.016 01:30:31 -- common/autotest_common.sh@936 -- # '[' -z 1262449 ']' 00:29:24.016 01:30:31 -- common/autotest_common.sh@940 -- # kill -0 1262449 00:29:24.016 01:30:31 -- common/autotest_common.sh@941 -- # uname 00:29:24.016 01:30:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:24.016 01:30:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1262449 00:29:24.016 01:30:31 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:24.016 01:30:31 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:24.016 01:30:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1262449' 00:29:24.016 killing process with pid 1262449 00:29:24.016 01:30:31 -- common/autotest_common.sh@955 -- # kill 1262449 00:29:24.016 Received shutdown signal, test time was about 2.000000 seconds 00:29:24.016 00:29:24.016 Latency(us) 00:29:24.016 [2024-11-20T00:30:32.235Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:24.016 [2024-11-20T00:30:32.235Z] =================================================================================================================== 00:29:24.016 [2024-11-20T00:30:32.235Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:24.016 01:30:31 -- common/autotest_common.sh@960 -- # wait 1262449 00:29:24.016 01:30:32 -- host/digest.sh@124 -- # run_bperf randwrite 4096 128 00:29:24.016 01:30:32 -- host/digest.sh@77 -- # local rw bs qd 00:29:24.016 01:30:32 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:24.016 01:30:32 -- host/digest.sh@80 -- # rw=randwrite 00:29:24.016 01:30:32 -- host/digest.sh@80 -- # bs=4096 00:29:24.016 01:30:32 -- host/digest.sh@80 -- # qd=128 00:29:24.016 01:30:32 -- host/digest.sh@82 -- # bperfpid=1262865 00:29:24.016 01:30:32 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:29:24.016 01:30:32 -- host/digest.sh@83 -- # waitforlisten 1262865 /var/tmp/bperf.sock 00:29:24.016 01:30:32 -- common/autotest_common.sh@829 -- # '[' -z 1262865 ']' 00:29:24.016 01:30:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:24.016 01:30:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:24.016 01:30:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:24.016 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:24.016 01:30:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:24.016 01:30:32 -- common/autotest_common.sh@10 -- # set +x 00:29:24.016 [2024-11-20 01:30:32.166276] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:24.016 [2024-11-20 01:30:32.166368] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1262865 ] 00:29:24.016 EAL: No free 2048 kB hugepages reported on node 1 00:29:24.016 [2024-11-20 01:30:32.224100] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:24.274 [2024-11-20 01:30:32.308854] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:24.274 01:30:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:24.274 01:30:32 -- common/autotest_common.sh@862 -- # return 0 00:29:24.274 01:30:32 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:24.274 01:30:32 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:24.274 01:30:32 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:24.844 01:30:32 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:24.844 01:30:32 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:25.105 nvme0n1 00:29:25.105 01:30:33 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:25.105 01:30:33 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:25.105 Running I/O for 2 seconds... 00:29:27.640 00:29:27.640 Latency(us) 00:29:27.640 [2024-11-20T00:30:35.859Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:27.640 [2024-11-20T00:30:35.859Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:29:27.640 nvme0n1 : 2.00 20937.94 81.79 0.00 0.00 6106.17 2572.89 12718.84 00:29:27.640 [2024-11-20T00:30:35.859Z] =================================================================================================================== 00:29:27.640 [2024-11-20T00:30:35.859Z] Total : 20937.94 81.79 0.00 0.00 6106.17 2572.89 12718.84 00:29:27.640 0 00:29:27.640 01:30:35 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:27.640 01:30:35 -- host/digest.sh@92 -- # get_accel_stats 00:29:27.640 01:30:35 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:27.640 01:30:35 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:27.640 01:30:35 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:27.640 | select(.opcode=="crc32c") 00:29:27.640 | "\(.module_name) \(.executed)"' 00:29:27.640 01:30:35 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:27.640 01:30:35 -- host/digest.sh@93 -- # exp_module=software 00:29:27.640 01:30:35 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:27.640 01:30:35 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:27.640 01:30:35 -- host/digest.sh@97 -- # killprocess 1262865 00:29:27.640 01:30:35 -- common/autotest_common.sh@936 -- # '[' -z 1262865 ']' 00:29:27.640 01:30:35 -- common/autotest_common.sh@940 -- # kill -0 1262865 00:29:27.640 01:30:35 -- common/autotest_common.sh@941 -- # uname 00:29:27.640 01:30:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:27.640 01:30:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1262865 00:29:27.640 01:30:35 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:27.640 01:30:35 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:27.640 01:30:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1262865' 00:29:27.640 killing process with pid 1262865 00:29:27.640 01:30:35 -- common/autotest_common.sh@955 -- # kill 1262865 00:29:27.640 Received shutdown signal, test time was about 2.000000 seconds 00:29:27.640 00:29:27.640 Latency(us) 00:29:27.640 [2024-11-20T00:30:35.859Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:27.640 [2024-11-20T00:30:35.859Z] =================================================================================================================== 00:29:27.640 [2024-11-20T00:30:35.859Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:27.640 01:30:35 -- common/autotest_common.sh@960 -- # wait 1262865 00:29:27.640 01:30:35 -- host/digest.sh@125 -- # run_bperf randwrite 131072 16 00:29:27.640 01:30:35 -- host/digest.sh@77 -- # local rw bs qd 00:29:27.640 01:30:35 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:27.640 01:30:35 -- host/digest.sh@80 -- # rw=randwrite 00:29:27.640 01:30:35 -- host/digest.sh@80 -- # bs=131072 00:29:27.640 01:30:35 -- host/digest.sh@80 -- # qd=16 00:29:27.640 01:30:35 -- host/digest.sh@82 -- # bperfpid=1263289 00:29:27.640 01:30:35 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:29:27.640 01:30:35 -- host/digest.sh@83 -- # waitforlisten 1263289 /var/tmp/bperf.sock 00:29:27.640 01:30:35 -- common/autotest_common.sh@829 -- # '[' -z 1263289 ']' 00:29:27.640 01:30:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:27.640 01:30:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:27.640 01:30:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:27.640 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:27.640 01:30:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:27.640 01:30:35 -- common/autotest_common.sh@10 -- # set +x 00:29:27.640 [2024-11-20 01:30:35.818092] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:27.640 [2024-11-20 01:30:35.818168] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1263289 ] 00:29:27.640 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:27.640 Zero copy mechanism will not be used. 00:29:27.640 EAL: No free 2048 kB hugepages reported on node 1 00:29:27.899 [2024-11-20 01:30:35.876525] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:27.899 [2024-11-20 01:30:35.962934] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:27.899 01:30:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:27.899 01:30:36 -- common/autotest_common.sh@862 -- # return 0 00:29:27.899 01:30:36 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:27.899 01:30:36 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:27.899 01:30:36 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:28.467 01:30:36 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:28.467 01:30:36 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:28.726 nvme0n1 00:29:28.726 01:30:36 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:28.726 01:30:36 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:28.985 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:28.985 Zero copy mechanism will not be used. 00:29:28.985 Running I/O for 2 seconds... 00:29:30.892 00:29:30.892 Latency(us) 00:29:30.892 [2024-11-20T00:30:39.111Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:30.892 [2024-11-20T00:30:39.111Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:29:30.892 nvme0n1 : 2.00 6531.40 816.43 0.00 0.00 2442.10 1953.94 8689.59 00:29:30.892 [2024-11-20T00:30:39.111Z] =================================================================================================================== 00:29:30.892 [2024-11-20T00:30:39.111Z] Total : 6531.40 816.43 0.00 0.00 2442.10 1953.94 8689.59 00:29:30.892 0 00:29:30.892 01:30:39 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:30.892 01:30:39 -- host/digest.sh@92 -- # get_accel_stats 00:29:30.892 01:30:39 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:30.892 01:30:39 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:30.892 01:30:39 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:30.892 | select(.opcode=="crc32c") 00:29:30.892 | "\(.module_name) \(.executed)"' 00:29:31.150 01:30:39 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:31.150 01:30:39 -- host/digest.sh@93 -- # exp_module=software 00:29:31.150 01:30:39 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:31.150 01:30:39 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:31.150 01:30:39 -- host/digest.sh@97 -- # killprocess 1263289 00:29:31.150 01:30:39 -- common/autotest_common.sh@936 -- # '[' -z 1263289 ']' 00:29:31.150 01:30:39 -- common/autotest_common.sh@940 -- # kill -0 1263289 00:29:31.150 01:30:39 -- common/autotest_common.sh@941 -- # uname 00:29:31.150 01:30:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:31.150 01:30:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1263289 00:29:31.150 01:30:39 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:31.150 01:30:39 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:31.150 01:30:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1263289' 00:29:31.150 killing process with pid 1263289 00:29:31.150 01:30:39 -- common/autotest_common.sh@955 -- # kill 1263289 00:29:31.150 Received shutdown signal, test time was about 2.000000 seconds 00:29:31.150 00:29:31.150 Latency(us) 00:29:31.150 [2024-11-20T00:30:39.369Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:31.150 [2024-11-20T00:30:39.369Z] =================================================================================================================== 00:29:31.150 [2024-11-20T00:30:39.369Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:31.150 01:30:39 -- common/autotest_common.sh@960 -- # wait 1263289 00:29:31.408 01:30:39 -- host/digest.sh@126 -- # killprocess 1261884 00:29:31.408 01:30:39 -- common/autotest_common.sh@936 -- # '[' -z 1261884 ']' 00:29:31.408 01:30:39 -- common/autotest_common.sh@940 -- # kill -0 1261884 00:29:31.408 01:30:39 -- common/autotest_common.sh@941 -- # uname 00:29:31.408 01:30:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:31.408 01:30:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1261884 00:29:31.408 01:30:39 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:31.408 01:30:39 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:31.408 01:30:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1261884' 00:29:31.408 killing process with pid 1261884 00:29:31.408 01:30:39 -- common/autotest_common.sh@955 -- # kill 1261884 00:29:31.409 01:30:39 -- common/autotest_common.sh@960 -- # wait 1261884 00:29:31.667 00:29:31.667 real 0m15.277s 00:29:31.667 user 0m30.306s 00:29:31.667 sys 0m4.353s 00:29:31.667 01:30:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:31.667 01:30:39 -- common/autotest_common.sh@10 -- # set +x 00:29:31.667 ************************************ 00:29:31.667 END TEST nvmf_digest_clean 00:29:31.667 ************************************ 00:29:31.667 01:30:39 -- host/digest.sh@136 -- # run_test nvmf_digest_error run_digest_error 00:29:31.667 01:30:39 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:31.667 01:30:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:31.667 01:30:39 -- common/autotest_common.sh@10 -- # set +x 00:29:31.667 ************************************ 00:29:31.667 START TEST nvmf_digest_error 00:29:31.667 ************************************ 00:29:31.667 01:30:39 -- common/autotest_common.sh@1114 -- # run_digest_error 00:29:31.667 01:30:39 -- host/digest.sh@101 -- # nvmfappstart --wait-for-rpc 00:29:31.667 01:30:39 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:31.667 01:30:39 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:31.667 01:30:39 -- common/autotest_common.sh@10 -- # set +x 00:29:31.667 01:30:39 -- nvmf/common.sh@469 -- # nvmfpid=1263858 00:29:31.667 01:30:39 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:29:31.667 01:30:39 -- nvmf/common.sh@470 -- # waitforlisten 1263858 00:29:31.667 01:30:39 -- common/autotest_common.sh@829 -- # '[' -z 1263858 ']' 00:29:31.667 01:30:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:31.667 01:30:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:31.667 01:30:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:31.667 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:31.667 01:30:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:31.667 01:30:39 -- common/autotest_common.sh@10 -- # set +x 00:29:31.667 [2024-11-20 01:30:39.871079] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:31.667 [2024-11-20 01:30:39.871170] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:31.927 EAL: No free 2048 kB hugepages reported on node 1 00:29:31.927 [2024-11-20 01:30:39.939047] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:31.927 [2024-11-20 01:30:40.030765] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:31.927 [2024-11-20 01:30:40.030946] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:31.927 [2024-11-20 01:30:40.030976] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:31.927 [2024-11-20 01:30:40.030991] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:31.927 [2024-11-20 01:30:40.031021] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:31.927 01:30:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:31.927 01:30:40 -- common/autotest_common.sh@862 -- # return 0 00:29:31.927 01:30:40 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:31.927 01:30:40 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:31.927 01:30:40 -- common/autotest_common.sh@10 -- # set +x 00:29:31.927 01:30:40 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:31.927 01:30:40 -- host/digest.sh@103 -- # rpc_cmd accel_assign_opc -o crc32c -m error 00:29:31.927 01:30:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:31.927 01:30:40 -- common/autotest_common.sh@10 -- # set +x 00:29:31.927 [2024-11-20 01:30:40.119698] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation crc32c will be assigned to module error 00:29:31.927 01:30:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:31.927 01:30:40 -- host/digest.sh@104 -- # common_target_config 00:29:31.927 01:30:40 -- host/digest.sh@43 -- # rpc_cmd 00:29:31.927 01:30:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:31.927 01:30:40 -- common/autotest_common.sh@10 -- # set +x 00:29:32.185 null0 00:29:32.185 [2024-11-20 01:30:40.238655] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:32.185 [2024-11-20 01:30:40.262916] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:32.185 01:30:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:32.185 01:30:40 -- host/digest.sh@107 -- # run_bperf_err randread 4096 128 00:29:32.185 01:30:40 -- host/digest.sh@54 -- # local rw bs qd 00:29:32.185 01:30:40 -- host/digest.sh@56 -- # rw=randread 00:29:32.185 01:30:40 -- host/digest.sh@56 -- # bs=4096 00:29:32.185 01:30:40 -- host/digest.sh@56 -- # qd=128 00:29:32.185 01:30:40 -- host/digest.sh@58 -- # bperfpid=1263878 00:29:32.185 01:30:40 -- host/digest.sh@60 -- # waitforlisten 1263878 /var/tmp/bperf.sock 00:29:32.185 01:30:40 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z 00:29:32.185 01:30:40 -- common/autotest_common.sh@829 -- # '[' -z 1263878 ']' 00:29:32.185 01:30:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:32.185 01:30:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:32.185 01:30:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:32.185 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:32.185 01:30:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:32.185 01:30:40 -- common/autotest_common.sh@10 -- # set +x 00:29:32.185 [2024-11-20 01:30:40.307960] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:32.185 [2024-11-20 01:30:40.308031] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1263878 ] 00:29:32.185 EAL: No free 2048 kB hugepages reported on node 1 00:29:32.185 [2024-11-20 01:30:40.371540] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:32.444 [2024-11-20 01:30:40.463406] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:33.379 01:30:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:33.379 01:30:41 -- common/autotest_common.sh@862 -- # return 0 00:29:33.379 01:30:41 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:33.379 01:30:41 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:33.379 01:30:41 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:29:33.380 01:30:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:33.380 01:30:41 -- common/autotest_common.sh@10 -- # set +x 00:29:33.380 01:30:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:33.380 01:30:41 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:33.380 01:30:41 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:33.967 nvme0n1 00:29:33.967 01:30:41 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:29:33.967 01:30:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:33.967 01:30:41 -- common/autotest_common.sh@10 -- # set +x 00:29:33.967 01:30:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:33.967 01:30:41 -- host/digest.sh@69 -- # bperf_py perform_tests 00:29:33.967 01:30:41 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:33.967 Running I/O for 2 seconds... 00:29:33.967 [2024-11-20 01:30:42.128953] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:33.967 [2024-11-20 01:30:42.129002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:23030 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:33.967 [2024-11-20 01:30:42.129026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:33.967 [2024-11-20 01:30:42.146426] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:33.967 [2024-11-20 01:30:42.146464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:251 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:33.967 [2024-11-20 01:30:42.146485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:33.967 [2024-11-20 01:30:42.163951] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:33.967 [2024-11-20 01:30:42.163995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:25476 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:33.967 [2024-11-20 01:30:42.164015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.226 [2024-11-20 01:30:42.181364] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:34.226 [2024-11-20 01:30:42.181416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:20866 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.226 [2024-11-20 01:30:42.181437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.226 [2024-11-20 01:30:42.198461] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:34.226 [2024-11-20 01:30:42.198497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:20121 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.226 [2024-11-20 01:30:42.198517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.226 [2024-11-20 01:30:42.215624] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:34.226 [2024-11-20 01:30:42.215660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:12633 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.226 [2024-11-20 01:30:42.215680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.226 [2024-11-20 01:30:42.233170] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:34.226 [2024-11-20 01:30:42.233200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:17086 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.226 [2024-11-20 01:30:42.233243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.226 [2024-11-20 01:30:42.244754] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:34.226 [2024-11-20 01:30:42.244802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:24577 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.226 [2024-11-20 01:30:42.244823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.226 [2024-11-20 01:30:42.262112] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:34.226 [2024-11-20 01:30:42.262158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:24436 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.226 [2024-11-20 01:30:42.262175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.226 [2024-11-20 01:30:42.278777] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:34.226 [2024-11-20 01:30:42.278814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:103 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.227 [2024-11-20 01:30:42.278834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.227 [2024-11-20 01:30:42.297094] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:34.227 [2024-11-20 01:30:42.297140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:20704 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.227 [2024-11-20 01:30:42.297157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.227 [2024-11-20 01:30:42.314545] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:34.227 [2024-11-20 01:30:42.314581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:16150 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.227 [2024-11-20 01:30:42.314601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.227 [2024-11-20 01:30:42.331879] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:34.227 [2024-11-20 01:30:42.331915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:14210 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.227 [2024-11-20 01:30:42.331935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.227 [2024-11-20 01:30:42.349244] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:34.227 [2024-11-20 01:30:42.349274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:14189 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.227 [2024-11-20 01:30:42.349306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.227 [2024-11-20 01:30:42.366331] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:34.227 [2024-11-20 01:30:42.366362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:6879 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.227 [2024-11-20 01:30:42.366392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.227 [2024-11-20 01:30:42.383531] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:34.227 [2024-11-20 01:30:42.383574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:9156 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.227 [2024-11-20 01:30:42.383595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.227 [2024-11-20 01:30:42.400967] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:34.227 [2024-11-20 01:30:42.401004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:4913 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.227 [2024-11-20 01:30:42.401025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.227 [2024-11-20 01:30:42.418489] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:34.227 [2024-11-20 01:30:42.418525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:7333 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.227 [2024-11-20 01:30:42.418544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.227 [2024-11-20 01:30:42.435902] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:34.227 [2024-11-20 01:30:42.435938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:21022 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.227 [2024-11-20 01:30:42.435959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.486 [2024-11-20 01:30:42.453517] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:34.486 [2024-11-20 01:30:42.453553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:25338 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.486 [2024-11-20 01:30:42.453573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.486 [2024-11-20 01:30:42.470790] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:34.486 [2024-11-20 01:30:42.470826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:16992 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.486 [2024-11-20 01:30:42.470846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.486 [2024-11-20 01:30:42.488167] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:34.486 [2024-11-20 01:30:42.488196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:2361 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.486 [2024-11-20 01:30:42.488227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.486 [2024-11-20 01:30:42.505455] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:34.486 [2024-11-20 01:30:42.505492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:17014 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.486 [2024-11-20 01:30:42.505512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.486 [2024-11-20 01:30:42.522907] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:34.486 [2024-11-20 01:30:42.522943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:12185 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.486 [2024-11-20 01:30:42.522963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.486 [2024-11-20 01:30:42.540521] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:34.486 [2024-11-20 01:30:42.540557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:9818 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.486 [2024-11-20 01:30:42.540577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.486 [2024-11-20 01:30:42.557558] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:34.486 [2024-11-20 01:30:42.557594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6977 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.486 [2024-11-20 01:30:42.557613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.486 [2024-11-20 01:30:42.574971] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:34.486 [2024-11-20 01:30:42.575007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:23595 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.486 [2024-11-20 01:30:42.575027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.486 [2024-11-20 01:30:42.592247] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:34.486 [2024-11-20 01:30:42.592277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:11382 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.486 [2024-11-20 01:30:42.592308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.486 [2024-11-20 01:30:42.609331] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:34.486 [2024-11-20 01:30:42.609360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:14302 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.486 [2024-11-20 01:30:42.609376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.486 [2024-11-20 01:30:42.626409] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:34.486 [2024-11-20 01:30:42.626446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:23496 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.486 [2024-11-20 01:30:42.626466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.486 [2024-11-20 01:30:42.643767] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:34.486 [2024-11-20 01:30:42.643803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:19953 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.486 [2024-11-20 01:30:42.643824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.486 [2024-11-20 01:30:42.661250] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:34.486 [2024-11-20 01:30:42.661281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:14926 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.486 [2024-11-20 01:30:42.661313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.486 [2024-11-20 01:30:42.678633] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:34.486 [2024-11-20 01:30:42.678665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:14617 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.486 [2024-11-20 01:30:42.678703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.486 [2024-11-20 01:30:42.695512] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:34.486 [2024-11-20 01:30:42.695549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:8392 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.486 [2024-11-20 01:30:42.695571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.745 [2024-11-20 01:30:42.712967] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:34.745 [2024-11-20 01:30:42.713005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:14064 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.745 [2024-11-20 01:30:42.713025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.745 [2024-11-20 01:30:42.730805] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:34.745 [2024-11-20 01:30:42.730842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20950 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.745 [2024-11-20 01:30:42.730862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.745 [2024-11-20 01:30:42.747427] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:34.745 [2024-11-20 01:30:42.747458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:1961 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.745 [2024-11-20 01:30:42.747476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.745 [2024-11-20 01:30:42.763151] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:34.745 [2024-11-20 01:30:42.763183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:12074 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.745 [2024-11-20 01:30:42.763215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.745 [2024-11-20 01:30:42.779306] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:34.745 [2024-11-20 01:30:42.779337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:22716 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.745 [2024-11-20 01:30:42.779369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.745 [2024-11-20 01:30:42.795426] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:34.746 [2024-11-20 01:30:42.795456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:20911 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.746 [2024-11-20 01:30:42.795488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.746 [2024-11-20 01:30:42.811520] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:34.746 [2024-11-20 01:30:42.811550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:13979 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.746 [2024-11-20 01:30:42.811581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.746 [2024-11-20 01:30:42.827455] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:34.746 [2024-11-20 01:30:42.827497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:7366 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.746 [2024-11-20 01:30:42.827530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.746 [2024-11-20 01:30:42.843382] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:34.746 [2024-11-20 01:30:42.843413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:22876 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.746 [2024-11-20 01:30:42.843445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.746 [2024-11-20 01:30:42.859940] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:34.746 [2024-11-20 01:30:42.859970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24682 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.746 [2024-11-20 01:30:42.860002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.746 [2024-11-20 01:30:42.876116] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:34.746 [2024-11-20 01:30:42.876146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:3181 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.746 [2024-11-20 01:30:42.876178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.746 [2024-11-20 01:30:42.892147] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:34.746 [2024-11-20 01:30:42.892177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:15975 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.746 [2024-11-20 01:30:42.892208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.746 [2024-11-20 01:30:42.908206] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:34.746 [2024-11-20 01:30:42.908237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:1348 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.746 [2024-11-20 01:30:42.908270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.746 [2024-11-20 01:30:42.924239] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:34.746 [2024-11-20 01:30:42.924270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:647 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.746 [2024-11-20 01:30:42.924302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.746 [2024-11-20 01:30:42.940220] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:34.746 [2024-11-20 01:30:42.940250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:10508 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.746 [2024-11-20 01:30:42.940283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.746 [2024-11-20 01:30:42.956240] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:34.746 [2024-11-20 01:30:42.956270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:2501 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.746 [2024-11-20 01:30:42.956303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.005 [2024-11-20 01:30:42.972520] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.005 [2024-11-20 01:30:42.972550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:14682 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.005 [2024-11-20 01:30:42.972583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.005 [2024-11-20 01:30:42.988444] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.005 [2024-11-20 01:30:42.988473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:6266 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.005 [2024-11-20 01:30:42.988505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.005 [2024-11-20 01:30:43.004367] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.005 [2024-11-20 01:30:43.004413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:23510 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.005 [2024-11-20 01:30:43.004430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.005 [2024-11-20 01:30:43.020613] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.005 [2024-11-20 01:30:43.020643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:17292 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.005 [2024-11-20 01:30:43.020675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.005 [2024-11-20 01:30:43.036291] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.005 [2024-11-20 01:30:43.036322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:3315 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.005 [2024-11-20 01:30:43.036354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.005 [2024-11-20 01:30:43.052326] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.005 [2024-11-20 01:30:43.052370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:12451 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.005 [2024-11-20 01:30:43.052388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.005 [2024-11-20 01:30:43.068064] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.005 [2024-11-20 01:30:43.068115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:18840 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.005 [2024-11-20 01:30:43.068132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.005 [2024-11-20 01:30:43.083943] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.005 [2024-11-20 01:30:43.083972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:340 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.005 [2024-11-20 01:30:43.084004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.005 [2024-11-20 01:30:43.099498] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.005 [2024-11-20 01:30:43.099534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:18390 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.005 [2024-11-20 01:30:43.099567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.005 [2024-11-20 01:30:43.114987] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.006 [2024-11-20 01:30:43.115017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:11604 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.006 [2024-11-20 01:30:43.115049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.006 [2024-11-20 01:30:43.131010] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.006 [2024-11-20 01:30:43.131039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:14992 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.006 [2024-11-20 01:30:43.131078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.006 [2024-11-20 01:30:43.147293] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.006 [2024-11-20 01:30:43.147323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24486 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.006 [2024-11-20 01:30:43.147355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.006 [2024-11-20 01:30:43.162830] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.006 [2024-11-20 01:30:43.162860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:12342 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.006 [2024-11-20 01:30:43.162891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.006 [2024-11-20 01:30:43.178707] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.006 [2024-11-20 01:30:43.178736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:8910 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.006 [2024-11-20 01:30:43.178768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.006 [2024-11-20 01:30:43.194645] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.006 [2024-11-20 01:30:43.194675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:9324 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.006 [2024-11-20 01:30:43.194707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.006 [2024-11-20 01:30:43.210324] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.006 [2024-11-20 01:30:43.210355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:11261 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.006 [2024-11-20 01:30:43.210388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.265 [2024-11-20 01:30:43.226539] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.265 [2024-11-20 01:30:43.226569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:23739 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.265 [2024-11-20 01:30:43.226602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.265 [2024-11-20 01:30:43.242589] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.265 [2024-11-20 01:30:43.242618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:16707 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.265 [2024-11-20 01:30:43.242650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.265 [2024-11-20 01:30:43.258561] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.265 [2024-11-20 01:30:43.258590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:6215 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.265 [2024-11-20 01:30:43.258622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.265 [2024-11-20 01:30:43.274518] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.265 [2024-11-20 01:30:43.274549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:22209 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.265 [2024-11-20 01:30:43.274583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.265 [2024-11-20 01:30:43.290688] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.265 [2024-11-20 01:30:43.290718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:10873 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.265 [2024-11-20 01:30:43.290749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.265 [2024-11-20 01:30:43.306298] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.265 [2024-11-20 01:30:43.306329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:20180 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.265 [2024-11-20 01:30:43.306361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.265 [2024-11-20 01:30:43.322562] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.265 [2024-11-20 01:30:43.322591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:20657 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.265 [2024-11-20 01:30:43.322623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.265 [2024-11-20 01:30:43.338539] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.265 [2024-11-20 01:30:43.338568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:20811 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.265 [2024-11-20 01:30:43.338600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.265 [2024-11-20 01:30:43.354452] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.265 [2024-11-20 01:30:43.354482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:16119 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.265 [2024-11-20 01:30:43.354514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.265 [2024-11-20 01:30:43.370506] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.265 [2024-11-20 01:30:43.370536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:17812 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.265 [2024-11-20 01:30:43.370575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.265 [2024-11-20 01:30:43.386285] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.265 [2024-11-20 01:30:43.386315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:12199 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.265 [2024-11-20 01:30:43.386347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.265 [2024-11-20 01:30:43.402197] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.265 [2024-11-20 01:30:43.402227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:12264 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.265 [2024-11-20 01:30:43.402260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.265 [2024-11-20 01:30:43.417860] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.265 [2024-11-20 01:30:43.417890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:15912 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.265 [2024-11-20 01:30:43.417922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.265 [2024-11-20 01:30:43.433831] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.265 [2024-11-20 01:30:43.433861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:21890 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.265 [2024-11-20 01:30:43.433894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.265 [2024-11-20 01:30:43.449691] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.265 [2024-11-20 01:30:43.449721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:5270 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.265 [2024-11-20 01:30:43.449753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.265 [2024-11-20 01:30:43.465469] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.265 [2024-11-20 01:30:43.465498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:4045 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.265 [2024-11-20 01:30:43.465530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.524 [2024-11-20 01:30:43.481678] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.524 [2024-11-20 01:30:43.481708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:23668 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.524 [2024-11-20 01:30:43.481741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.524 [2024-11-20 01:30:43.497710] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.524 [2024-11-20 01:30:43.497739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:17042 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.524 [2024-11-20 01:30:43.497772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.524 [2024-11-20 01:30:43.513826] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.524 [2024-11-20 01:30:43.513862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:15964 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.524 [2024-11-20 01:30:43.513895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.524 [2024-11-20 01:30:43.529715] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.524 [2024-11-20 01:30:43.529744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:6439 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.524 [2024-11-20 01:30:43.529776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.524 [2024-11-20 01:30:43.545701] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.524 [2024-11-20 01:30:43.545730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:10415 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.524 [2024-11-20 01:30:43.545762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.524 [2024-11-20 01:30:43.561228] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.524 [2024-11-20 01:30:43.561259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:675 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.524 [2024-11-20 01:30:43.561292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.524 [2024-11-20 01:30:43.576935] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.524 [2024-11-20 01:30:43.576965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:21830 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.524 [2024-11-20 01:30:43.576997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.524 [2024-11-20 01:30:43.593188] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.524 [2024-11-20 01:30:43.593219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:6414 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.524 [2024-11-20 01:30:43.593252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.524 [2024-11-20 01:30:43.609664] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.524 [2024-11-20 01:30:43.609693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:11807 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.524 [2024-11-20 01:30:43.609726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.524 [2024-11-20 01:30:43.625621] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.524 [2024-11-20 01:30:43.625650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:14217 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.524 [2024-11-20 01:30:43.625682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.524 [2024-11-20 01:30:43.641858] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.524 [2024-11-20 01:30:43.641889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:18706 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.524 [2024-11-20 01:30:43.641921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.524 [2024-11-20 01:30:43.657722] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.524 [2024-11-20 01:30:43.657751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24459 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.524 [2024-11-20 01:30:43.657783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.524 [2024-11-20 01:30:43.673930] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.524 [2024-11-20 01:30:43.673959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:7802 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.524 [2024-11-20 01:30:43.673990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.524 [2024-11-20 01:30:43.690324] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.524 [2024-11-20 01:30:43.690356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:15620 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.524 [2024-11-20 01:30:43.690387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.524 [2024-11-20 01:30:43.708230] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.524 [2024-11-20 01:30:43.708272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:3820 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.524 [2024-11-20 01:30:43.708290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.524 [2024-11-20 01:30:43.725753] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.524 [2024-11-20 01:30:43.725790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:16791 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.524 [2024-11-20 01:30:43.725810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.782 [2024-11-20 01:30:43.743582] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.782 [2024-11-20 01:30:43.743618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:16357 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.782 [2024-11-20 01:30:43.743638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.782 [2024-11-20 01:30:43.761147] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.782 [2024-11-20 01:30:43.761177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:9926 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.782 [2024-11-20 01:30:43.761193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.782 [2024-11-20 01:30:43.778677] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.782 [2024-11-20 01:30:43.778713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:2932 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.782 [2024-11-20 01:30:43.778733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.782 [2024-11-20 01:30:43.795940] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.782 [2024-11-20 01:30:43.795984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:10015 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.782 [2024-11-20 01:30:43.796004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.782 [2024-11-20 01:30:43.813457] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.783 [2024-11-20 01:30:43.813492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:10997 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.783 [2024-11-20 01:30:43.813513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.783 [2024-11-20 01:30:43.830728] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.783 [2024-11-20 01:30:43.830765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:25200 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.783 [2024-11-20 01:30:43.830785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.783 [2024-11-20 01:30:43.848005] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.783 [2024-11-20 01:30:43.848041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:19638 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.783 [2024-11-20 01:30:43.848061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.783 [2024-11-20 01:30:43.872778] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.783 [2024-11-20 01:30:43.872815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:23801 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.783 [2024-11-20 01:30:43.872834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.783 [2024-11-20 01:30:43.889818] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.783 [2024-11-20 01:30:43.889855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:16560 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.783 [2024-11-20 01:30:43.889875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.783 [2024-11-20 01:30:43.907021] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.783 [2024-11-20 01:30:43.907056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:4500 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.783 [2024-11-20 01:30:43.907086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.783 [2024-11-20 01:30:43.924316] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.783 [2024-11-20 01:30:43.924347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:10288 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.783 [2024-11-20 01:30:43.924382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.783 [2024-11-20 01:30:43.941627] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.783 [2024-11-20 01:30:43.941665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:22256 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.783 [2024-11-20 01:30:43.941685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.783 [2024-11-20 01:30:43.959128] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.783 [2024-11-20 01:30:43.959172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:2188 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.783 [2024-11-20 01:30:43.959188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.783 [2024-11-20 01:30:43.976474] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.783 [2024-11-20 01:30:43.976511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:24500 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.783 [2024-11-20 01:30:43.976531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.783 [2024-11-20 01:30:43.993840] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:35.783 [2024-11-20 01:30:43.993876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:21711 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.783 [2024-11-20 01:30:43.993896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.042 [2024-11-20 01:30:44.010995] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:36.042 [2024-11-20 01:30:44.011031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:8636 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.042 [2024-11-20 01:30:44.011051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.042 [2024-11-20 01:30:44.028003] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:36.042 [2024-11-20 01:30:44.028038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:2669 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.042 [2024-11-20 01:30:44.028059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.042 [2024-11-20 01:30:44.043960] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:36.042 [2024-11-20 01:30:44.043990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:2112 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.042 [2024-11-20 01:30:44.044021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.042 [2024-11-20 01:30:44.056002] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:36.042 [2024-11-20 01:30:44.056037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:20721 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.042 [2024-11-20 01:30:44.056057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.042 [2024-11-20 01:30:44.073507] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:36.042 [2024-11-20 01:30:44.073542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:23817 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.042 [2024-11-20 01:30:44.073561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.042 [2024-11-20 01:30:44.091000] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:36.042 [2024-11-20 01:30:44.091037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:10410 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.042 [2024-11-20 01:30:44.091076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.042 [2024-11-20 01:30:44.106182] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10fa400) 00:29:36.042 [2024-11-20 01:30:44.106211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:12443 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.042 [2024-11-20 01:30:44.106243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.042 00:29:36.042 Latency(us) 00:29:36.042 [2024-11-20T00:30:44.261Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:36.042 [2024-11-20T00:30:44.261Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:29:36.042 nvme0n1 : 2.05 14992.04 58.56 0.00 0.00 8358.36 3713.71 47962.64 00:29:36.042 [2024-11-20T00:30:44.261Z] =================================================================================================================== 00:29:36.042 [2024-11-20T00:30:44.261Z] Total : 14992.04 58.56 0.00 0.00 8358.36 3713.71 47962.64 00:29:36.042 0 00:29:36.042 01:30:44 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:29:36.042 01:30:44 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:29:36.042 01:30:44 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:29:36.042 | .driver_specific 00:29:36.042 | .nvme_error 00:29:36.042 | .status_code 00:29:36.042 | .command_transient_transport_error' 00:29:36.042 01:30:44 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:29:36.300 01:30:44 -- host/digest.sh@71 -- # (( 120 > 0 )) 00:29:36.300 01:30:44 -- host/digest.sh@73 -- # killprocess 1263878 00:29:36.300 01:30:44 -- common/autotest_common.sh@936 -- # '[' -z 1263878 ']' 00:29:36.300 01:30:44 -- common/autotest_common.sh@940 -- # kill -0 1263878 00:29:36.300 01:30:44 -- common/autotest_common.sh@941 -- # uname 00:29:36.301 01:30:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:36.301 01:30:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1263878 00:29:36.301 01:30:44 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:36.301 01:30:44 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:36.301 01:30:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1263878' 00:29:36.301 killing process with pid 1263878 00:29:36.301 01:30:44 -- common/autotest_common.sh@955 -- # kill 1263878 00:29:36.301 Received shutdown signal, test time was about 2.000000 seconds 00:29:36.301 00:29:36.301 Latency(us) 00:29:36.301 [2024-11-20T00:30:44.520Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:36.301 [2024-11-20T00:30:44.520Z] =================================================================================================================== 00:29:36.301 [2024-11-20T00:30:44.520Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:36.301 01:30:44 -- common/autotest_common.sh@960 -- # wait 1263878 00:29:36.559 01:30:44 -- host/digest.sh@108 -- # run_bperf_err randread 131072 16 00:29:36.559 01:30:44 -- host/digest.sh@54 -- # local rw bs qd 00:29:36.559 01:30:44 -- host/digest.sh@56 -- # rw=randread 00:29:36.559 01:30:44 -- host/digest.sh@56 -- # bs=131072 00:29:36.559 01:30:44 -- host/digest.sh@56 -- # qd=16 00:29:36.559 01:30:44 -- host/digest.sh@58 -- # bperfpid=1264430 00:29:36.559 01:30:44 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z 00:29:36.559 01:30:44 -- host/digest.sh@60 -- # waitforlisten 1264430 /var/tmp/bperf.sock 00:29:36.559 01:30:44 -- common/autotest_common.sh@829 -- # '[' -z 1264430 ']' 00:29:36.559 01:30:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:36.559 01:30:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:36.559 01:30:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:36.559 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:36.559 01:30:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:36.559 01:30:44 -- common/autotest_common.sh@10 -- # set +x 00:29:36.559 [2024-11-20 01:30:44.731724] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:36.559 [2024-11-20 01:30:44.731805] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1264430 ] 00:29:36.559 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:36.559 Zero copy mechanism will not be used. 00:29:36.559 EAL: No free 2048 kB hugepages reported on node 1 00:29:36.817 [2024-11-20 01:30:44.795733] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:36.817 [2024-11-20 01:30:44.883487] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:37.750 01:30:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:37.750 01:30:45 -- common/autotest_common.sh@862 -- # return 0 00:29:37.750 01:30:45 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:37.750 01:30:45 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:37.750 01:30:45 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:29:37.750 01:30:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:37.750 01:30:45 -- common/autotest_common.sh@10 -- # set +x 00:29:37.750 01:30:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:37.750 01:30:45 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:37.750 01:30:45 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:38.316 nvme0n1 00:29:38.316 01:30:46 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:29:38.316 01:30:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:38.316 01:30:46 -- common/autotest_common.sh@10 -- # set +x 00:29:38.316 01:30:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:38.316 01:30:46 -- host/digest.sh@69 -- # bperf_py perform_tests 00:29:38.316 01:30:46 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:38.316 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:38.316 Zero copy mechanism will not be used. 00:29:38.316 Running I/O for 2 seconds... 00:29:38.316 [2024-11-20 01:30:46.401507] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.316 [2024-11-20 01:30:46.401564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.316 [2024-11-20 01:30:46.401587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:38.316 [2024-11-20 01:30:46.407450] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.316 [2024-11-20 01:30:46.407487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.316 [2024-11-20 01:30:46.407507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:38.316 [2024-11-20 01:30:46.414163] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.316 [2024-11-20 01:30:46.414196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.316 [2024-11-20 01:30:46.414214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:38.316 [2024-11-20 01:30:46.420047] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.316 [2024-11-20 01:30:46.420117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.316 [2024-11-20 01:30:46.420137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:38.316 [2024-11-20 01:30:46.425901] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.316 [2024-11-20 01:30:46.425935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.316 [2024-11-20 01:30:46.425954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:38.316 [2024-11-20 01:30:46.431685] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.316 [2024-11-20 01:30:46.431719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.316 [2024-11-20 01:30:46.431738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:38.316 [2024-11-20 01:30:46.437646] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.316 [2024-11-20 01:30:46.437680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:11872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.316 [2024-11-20 01:30:46.437700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:38.316 [2024-11-20 01:30:46.443975] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.316 [2024-11-20 01:30:46.444010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.316 [2024-11-20 01:30:46.444029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:38.316 [2024-11-20 01:30:46.451415] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.316 [2024-11-20 01:30:46.451450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.316 [2024-11-20 01:30:46.451469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:38.316 [2024-11-20 01:30:46.458680] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.316 [2024-11-20 01:30:46.458714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.316 [2024-11-20 01:30:46.458733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:38.316 [2024-11-20 01:30:46.466526] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.317 [2024-11-20 01:30:46.466561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:2336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.317 [2024-11-20 01:30:46.466581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:38.317 [2024-11-20 01:30:46.474022] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.317 [2024-11-20 01:30:46.474056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.317 [2024-11-20 01:30:46.474085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:38.317 [2024-11-20 01:30:46.480767] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.317 [2024-11-20 01:30:46.480802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.317 [2024-11-20 01:30:46.480822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:38.317 [2024-11-20 01:30:46.486784] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.317 [2024-11-20 01:30:46.486818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.317 [2024-11-20 01:30:46.486837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:38.317 [2024-11-20 01:30:46.492805] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.317 [2024-11-20 01:30:46.492839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.317 [2024-11-20 01:30:46.492859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:38.317 [2024-11-20 01:30:46.498633] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.317 [2024-11-20 01:30:46.498668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.317 [2024-11-20 01:30:46.498687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:38.317 [2024-11-20 01:30:46.503813] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.317 [2024-11-20 01:30:46.503847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.317 [2024-11-20 01:30:46.503866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:38.317 [2024-11-20 01:30:46.508760] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.317 [2024-11-20 01:30:46.508794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.317 [2024-11-20 01:30:46.508813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:38.317 [2024-11-20 01:30:46.513052] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.317 [2024-11-20 01:30:46.513093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.317 [2024-11-20 01:30:46.513127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:38.317 [2024-11-20 01:30:46.517233] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.317 [2024-11-20 01:30:46.517266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.317 [2024-11-20 01:30:46.517283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:38.317 [2024-11-20 01:30:46.521464] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.317 [2024-11-20 01:30:46.521497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:25280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.317 [2024-11-20 01:30:46.521522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:38.317 [2024-11-20 01:30:46.525705] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.317 [2024-11-20 01:30:46.525738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.317 [2024-11-20 01:30:46.525757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:38.317 [2024-11-20 01:30:46.529910] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.317 [2024-11-20 01:30:46.529943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:18336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.317 [2024-11-20 01:30:46.529961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:38.576 [2024-11-20 01:30:46.534129] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.577 [2024-11-20 01:30:46.534159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.577 [2024-11-20 01:30:46.534175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:38.577 [2024-11-20 01:30:46.538283] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.577 [2024-11-20 01:30:46.538313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.577 [2024-11-20 01:30:46.538330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:38.577 [2024-11-20 01:30:46.542387] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.577 [2024-11-20 01:30:46.542419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.577 [2024-11-20 01:30:46.542438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:38.577 [2024-11-20 01:30:46.546541] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.577 [2024-11-20 01:30:46.546573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.577 [2024-11-20 01:30:46.546591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:38.577 [2024-11-20 01:30:46.551113] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.577 [2024-11-20 01:30:46.551143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.577 [2024-11-20 01:30:46.551160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:38.577 [2024-11-20 01:30:46.555585] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.577 [2024-11-20 01:30:46.555618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.577 [2024-11-20 01:30:46.555637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:38.577 [2024-11-20 01:30:46.560056] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.577 [2024-11-20 01:30:46.560097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.577 [2024-11-20 01:30:46.560131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:38.577 [2024-11-20 01:30:46.563842] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.577 [2024-11-20 01:30:46.563875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.577 [2024-11-20 01:30:46.563894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:38.577 [2024-11-20 01:30:46.567789] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.577 [2024-11-20 01:30:46.567822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.577 [2024-11-20 01:30:46.567840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:38.577 [2024-11-20 01:30:46.571868] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.577 [2024-11-20 01:30:46.571901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.577 [2024-11-20 01:30:46.571919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:38.577 [2024-11-20 01:30:46.576473] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.577 [2024-11-20 01:30:46.576505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.577 [2024-11-20 01:30:46.576524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:38.577 [2024-11-20 01:30:46.581566] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.577 [2024-11-20 01:30:46.581599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.577 [2024-11-20 01:30:46.581617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:38.577 [2024-11-20 01:30:46.586687] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.577 [2024-11-20 01:30:46.586717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:10816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.577 [2024-11-20 01:30:46.586749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:38.577 [2024-11-20 01:30:46.591814] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.577 [2024-11-20 01:30:46.591847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:5408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.577 [2024-11-20 01:30:46.591865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:38.577 [2024-11-20 01:30:46.596954] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.577 [2024-11-20 01:30:46.596986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.577 [2024-11-20 01:30:46.597011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:38.577 [2024-11-20 01:30:46.602038] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.577 [2024-11-20 01:30:46.602081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.577 [2024-11-20 01:30:46.602103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:38.577 [2024-11-20 01:30:46.607297] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.577 [2024-11-20 01:30:46.607326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.577 [2024-11-20 01:30:46.607356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:38.577 [2024-11-20 01:30:46.612564] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.577 [2024-11-20 01:30:46.612599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:24544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.577 [2024-11-20 01:30:46.612618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:38.577 [2024-11-20 01:30:46.617808] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.577 [2024-11-20 01:30:46.617840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:14624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.577 [2024-11-20 01:30:46.617859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:38.577 [2024-11-20 01:30:46.622706] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.577 [2024-11-20 01:30:46.622739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.577 [2024-11-20 01:30:46.622756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:38.577 [2024-11-20 01:30:46.627790] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.577 [2024-11-20 01:30:46.627822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.578 [2024-11-20 01:30:46.627840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:38.578 [2024-11-20 01:30:46.632926] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.578 [2024-11-20 01:30:46.632959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:7296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.578 [2024-11-20 01:30:46.632977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:38.578 [2024-11-20 01:30:46.637892] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.578 [2024-11-20 01:30:46.637928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:23616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.578 [2024-11-20 01:30:46.637947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:38.578 [2024-11-20 01:30:46.643246] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.578 [2024-11-20 01:30:46.643281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.578 [2024-11-20 01:30:46.643314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:38.578 [2024-11-20 01:30:46.648735] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.578 [2024-11-20 01:30:46.648769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.578 [2024-11-20 01:30:46.648788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:38.578 [2024-11-20 01:30:46.654059] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.578 [2024-11-20 01:30:46.654118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.578 [2024-11-20 01:30:46.654157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:38.578 [2024-11-20 01:30:46.658390] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.578 [2024-11-20 01:30:46.658424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:8288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.578 [2024-11-20 01:30:46.658444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:38.578 [2024-11-20 01:30:46.662642] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.578 [2024-11-20 01:30:46.662676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:21632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.578 [2024-11-20 01:30:46.662694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:38.578 [2024-11-20 01:30:46.666612] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.578 [2024-11-20 01:30:46.666646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.578 [2024-11-20 01:30:46.666664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:38.578 [2024-11-20 01:30:46.670557] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.578 [2024-11-20 01:30:46.670589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.578 [2024-11-20 01:30:46.670606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:38.578 [2024-11-20 01:30:46.674765] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.578 [2024-11-20 01:30:46.674798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.578 [2024-11-20 01:30:46.674816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:38.578 [2024-11-20 01:30:46.679149] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.578 [2024-11-20 01:30:46.679180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:17120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.578 [2024-11-20 01:30:46.679197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:38.578 [2024-11-20 01:30:46.683630] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.578 [2024-11-20 01:30:46.683663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.578 [2024-11-20 01:30:46.683681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:38.578 [2024-11-20 01:30:46.688061] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.578 [2024-11-20 01:30:46.688116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.578 [2024-11-20 01:30:46.688134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:38.578 [2024-11-20 01:30:46.692425] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.578 [2024-11-20 01:30:46.692467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.578 [2024-11-20 01:30:46.692486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:38.578 [2024-11-20 01:30:46.696884] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.578 [2024-11-20 01:30:46.696917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:20064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.578 [2024-11-20 01:30:46.696935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:38.578 [2024-11-20 01:30:46.700868] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.578 [2024-11-20 01:30:46.700900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.578 [2024-11-20 01:30:46.700918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:38.578 [2024-11-20 01:30:46.704943] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.578 [2024-11-20 01:30:46.704976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:18336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.578 [2024-11-20 01:30:46.704996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:38.578 [2024-11-20 01:30:46.709776] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.578 [2024-11-20 01:30:46.709809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:1920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.578 [2024-11-20 01:30:46.709827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:38.578 [2024-11-20 01:30:46.714598] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.578 [2024-11-20 01:30:46.714632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:21952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.578 [2024-11-20 01:30:46.714651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:38.578 [2024-11-20 01:30:46.719238] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.578 [2024-11-20 01:30:46.719268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:15072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.578 [2024-11-20 01:30:46.719291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:38.578 [2024-11-20 01:30:46.724700] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.578 [2024-11-20 01:30:46.724734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:17376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.578 [2024-11-20 01:30:46.724754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:38.578 [2024-11-20 01:30:46.730774] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.578 [2024-11-20 01:30:46.730805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:23232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.578 [2024-11-20 01:30:46.730824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:38.578 [2024-11-20 01:30:46.736692] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.578 [2024-11-20 01:30:46.736723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:18880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.579 [2024-11-20 01:30:46.736765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:38.579 [2024-11-20 01:30:46.742571] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.579 [2024-11-20 01:30:46.742603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:7648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.579 [2024-11-20 01:30:46.742620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:38.579 [2024-11-20 01:30:46.748376] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.579 [2024-11-20 01:30:46.748406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:12864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.579 [2024-11-20 01:30:46.748423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:38.579 [2024-11-20 01:30:46.754280] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.579 [2024-11-20 01:30:46.754310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:16576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.579 [2024-11-20 01:30:46.754328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:38.579 [2024-11-20 01:30:46.760468] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.579 [2024-11-20 01:30:46.760497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:5376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.579 [2024-11-20 01:30:46.760529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:38.579 [2024-11-20 01:30:46.766559] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.579 [2024-11-20 01:30:46.766593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:14240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.579 [2024-11-20 01:30:46.766612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:38.579 [2024-11-20 01:30:46.772653] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.579 [2024-11-20 01:30:46.772693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:8320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.579 [2024-11-20 01:30:46.772713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:38.579 [2024-11-20 01:30:46.778750] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.579 [2024-11-20 01:30:46.778784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:21696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.579 [2024-11-20 01:30:46.778803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:38.579 [2024-11-20 01:30:46.784822] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.579 [2024-11-20 01:30:46.784856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:15392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.579 [2024-11-20 01:30:46.784875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:38.579 [2024-11-20 01:30:46.790768] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.579 [2024-11-20 01:30:46.790803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:16960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.579 [2024-11-20 01:30:46.790822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:38.838 [2024-11-20 01:30:46.796914] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.838 [2024-11-20 01:30:46.796949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:17952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.838 [2024-11-20 01:30:46.796967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:38.838 [2024-11-20 01:30:46.803286] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.838 [2024-11-20 01:30:46.803316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:7136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.838 [2024-11-20 01:30:46.803333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:38.838 [2024-11-20 01:30:46.809966] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.838 [2024-11-20 01:30:46.810000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:16864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.838 [2024-11-20 01:30:46.810018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:38.838 [2024-11-20 01:30:46.814744] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.838 [2024-11-20 01:30:46.814777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:3520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.838 [2024-11-20 01:30:46.814802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:38.838 [2024-11-20 01:30:46.820520] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.838 [2024-11-20 01:30:46.820555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:20768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.838 [2024-11-20 01:30:46.820573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:38.839 [2024-11-20 01:30:46.827854] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.839 [2024-11-20 01:30:46.827888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:18784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.839 [2024-11-20 01:30:46.827908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:38.839 [2024-11-20 01:30:46.835814] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.839 [2024-11-20 01:30:46.835843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:20192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.839 [2024-11-20 01:30:46.835876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:38.839 [2024-11-20 01:30:46.843991] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.839 [2024-11-20 01:30:46.844025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:23648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.839 [2024-11-20 01:30:46.844044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:38.839 [2024-11-20 01:30:46.850761] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.839 [2024-11-20 01:30:46.850794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.839 [2024-11-20 01:30:46.850814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:38.839 [2024-11-20 01:30:46.856261] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.839 [2024-11-20 01:30:46.856290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:1632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.839 [2024-11-20 01:30:46.856322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:38.839 [2024-11-20 01:30:46.861595] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.839 [2024-11-20 01:30:46.861629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:8704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.839 [2024-11-20 01:30:46.861648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:38.839 [2024-11-20 01:30:46.866691] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.839 [2024-11-20 01:30:46.866725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:21120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.839 [2024-11-20 01:30:46.866743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:38.839 [2024-11-20 01:30:46.871788] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.839 [2024-11-20 01:30:46.871820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:20352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.839 [2024-11-20 01:30:46.871839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:38.839 [2024-11-20 01:30:46.876733] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.839 [2024-11-20 01:30:46.876764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:25088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.839 [2024-11-20 01:30:46.876788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:38.839 [2024-11-20 01:30:46.881734] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.839 [2024-11-20 01:30:46.881769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:7104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.839 [2024-11-20 01:30:46.881788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:38.839 [2024-11-20 01:30:46.886889] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.839 [2024-11-20 01:30:46.886922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:23040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.839 [2024-11-20 01:30:46.886941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:38.839 [2024-11-20 01:30:46.891956] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.839 [2024-11-20 01:30:46.891990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:11328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.839 [2024-11-20 01:30:46.892008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:38.839 [2024-11-20 01:30:46.897197] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.839 [2024-11-20 01:30:46.897226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:3488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.839 [2024-11-20 01:30:46.897242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:38.839 [2024-11-20 01:30:46.901875] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.839 [2024-11-20 01:30:46.901907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:5856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.839 [2024-11-20 01:30:46.901925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:38.839 [2024-11-20 01:30:46.907080] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.839 [2024-11-20 01:30:46.907125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:23392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.839 [2024-11-20 01:30:46.907141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:38.839 [2024-11-20 01:30:46.911616] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.839 [2024-11-20 01:30:46.911649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:8416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.839 [2024-11-20 01:30:46.911668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:38.839 [2024-11-20 01:30:46.916236] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.839 [2024-11-20 01:30:46.916266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:16448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.839 [2024-11-20 01:30:46.916283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:38.839 [2024-11-20 01:30:46.920661] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.839 [2024-11-20 01:30:46.920700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:4128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.839 [2024-11-20 01:30:46.920719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:38.839 [2024-11-20 01:30:46.925699] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.839 [2024-11-20 01:30:46.925732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:17568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.839 [2024-11-20 01:30:46.925751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:38.839 [2024-11-20 01:30:46.931171] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.839 [2024-11-20 01:30:46.931202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:12608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.839 [2024-11-20 01:30:46.931219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:38.839 [2024-11-20 01:30:46.936537] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.839 [2024-11-20 01:30:46.936571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:12032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.839 [2024-11-20 01:30:46.936589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:38.839 [2024-11-20 01:30:46.941551] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.839 [2024-11-20 01:30:46.941583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.839 [2024-11-20 01:30:46.941603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:38.839 [2024-11-20 01:30:46.946841] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.839 [2024-11-20 01:30:46.946873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:5632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.840 [2024-11-20 01:30:46.946891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:38.840 [2024-11-20 01:30:46.952188] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.840 [2024-11-20 01:30:46.952222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:23264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.840 [2024-11-20 01:30:46.952239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:38.840 [2024-11-20 01:30:46.956429] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.840 [2024-11-20 01:30:46.956463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:5504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.840 [2024-11-20 01:30:46.956482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:38.840 [2024-11-20 01:30:46.960610] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.840 [2024-11-20 01:30:46.960644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.840 [2024-11-20 01:30:46.960662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:38.840 [2024-11-20 01:30:46.964663] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.840 [2024-11-20 01:30:46.964695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:2432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.840 [2024-11-20 01:30:46.964714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:38.840 [2024-11-20 01:30:46.968614] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.840 [2024-11-20 01:30:46.968646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.840 [2024-11-20 01:30:46.968665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:38.840 [2024-11-20 01:30:46.972926] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.840 [2024-11-20 01:30:46.972959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:23648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.840 [2024-11-20 01:30:46.972977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:38.840 [2024-11-20 01:30:46.976896] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.840 [2024-11-20 01:30:46.976928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:14560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.840 [2024-11-20 01:30:46.976946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:38.840 [2024-11-20 01:30:46.980850] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.840 [2024-11-20 01:30:46.980882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.840 [2024-11-20 01:30:46.980900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:38.840 [2024-11-20 01:30:46.985034] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.840 [2024-11-20 01:30:46.985075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:13088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.840 [2024-11-20 01:30:46.985096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:38.840 [2024-11-20 01:30:46.990472] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.840 [2024-11-20 01:30:46.990507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:3904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.840 [2024-11-20 01:30:46.990525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:38.840 [2024-11-20 01:30:46.995865] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.840 [2024-11-20 01:30:46.995899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.840 [2024-11-20 01:30:46.995917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:38.840 [2024-11-20 01:30:47.000915] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.840 [2024-11-20 01:30:47.000948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:4736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.840 [2024-11-20 01:30:47.000976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:38.840 [2024-11-20 01:30:47.006011] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.840 [2024-11-20 01:30:47.006043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:13024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.840 [2024-11-20 01:30:47.006061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:38.840 [2024-11-20 01:30:47.010803] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.840 [2024-11-20 01:30:47.010836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:11008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.840 [2024-11-20 01:30:47.010854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:38.840 [2024-11-20 01:30:47.015260] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.840 [2024-11-20 01:30:47.015304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.840 [2024-11-20 01:30:47.015321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:38.840 [2024-11-20 01:30:47.020417] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.840 [2024-11-20 01:30:47.020451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:15904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.840 [2024-11-20 01:30:47.020469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:38.840 [2024-11-20 01:30:47.025443] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.840 [2024-11-20 01:30:47.025476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:22240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.840 [2024-11-20 01:30:47.025494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:38.840 [2024-11-20 01:30:47.030566] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.840 [2024-11-20 01:30:47.030599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.840 [2024-11-20 01:30:47.030618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:38.840 [2024-11-20 01:30:47.035439] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.840 [2024-11-20 01:30:47.035471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:17664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.840 [2024-11-20 01:30:47.035489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:38.840 [2024-11-20 01:30:47.040419] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.840 [2024-11-20 01:30:47.040452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:22720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.840 [2024-11-20 01:30:47.040470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:38.840 [2024-11-20 01:30:47.045330] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.840 [2024-11-20 01:30:47.045365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:20128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.840 [2024-11-20 01:30:47.045382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:38.841 [2024-11-20 01:30:47.050186] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:38.841 [2024-11-20 01:30:47.050215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.841 [2024-11-20 01:30:47.050232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.099 [2024-11-20 01:30:47.055065] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.099 [2024-11-20 01:30:47.055119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.099 [2024-11-20 01:30:47.055135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.099 [2024-11-20 01:30:47.060052] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.099 [2024-11-20 01:30:47.060112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:15040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.099 [2024-11-20 01:30:47.060129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.099 [2024-11-20 01:30:47.064863] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.099 [2024-11-20 01:30:47.064895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:13248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.099 [2024-11-20 01:30:47.064914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.099 [2024-11-20 01:30:47.069775] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.099 [2024-11-20 01:30:47.069808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:7808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.099 [2024-11-20 01:30:47.069827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.099 [2024-11-20 01:30:47.074887] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.099 [2024-11-20 01:30:47.074919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.099 [2024-11-20 01:30:47.074938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.099 [2024-11-20 01:30:47.080151] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.099 [2024-11-20 01:30:47.080181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:1568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.099 [2024-11-20 01:30:47.080198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.099 [2024-11-20 01:30:47.085633] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.099 [2024-11-20 01:30:47.085667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:5664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.099 [2024-11-20 01:30:47.085686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.099 [2024-11-20 01:30:47.090662] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.099 [2024-11-20 01:30:47.090695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:9792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.099 [2024-11-20 01:30:47.090714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.099 [2024-11-20 01:30:47.095464] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.099 [2024-11-20 01:30:47.095497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:12032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.099 [2024-11-20 01:30:47.095515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.100 [2024-11-20 01:30:47.099541] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.100 [2024-11-20 01:30:47.099574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.100 [2024-11-20 01:30:47.099593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.100 [2024-11-20 01:30:47.103566] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.100 [2024-11-20 01:30:47.103598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.100 [2024-11-20 01:30:47.103617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.100 [2024-11-20 01:30:47.107542] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.100 [2024-11-20 01:30:47.107574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:21216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.100 [2024-11-20 01:30:47.107592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.100 [2024-11-20 01:30:47.112390] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.100 [2024-11-20 01:30:47.112423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:23200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.100 [2024-11-20 01:30:47.112441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.100 [2024-11-20 01:30:47.117225] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.100 [2024-11-20 01:30:47.117255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:19392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.100 [2024-11-20 01:30:47.117271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.100 [2024-11-20 01:30:47.122222] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.100 [2024-11-20 01:30:47.122252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:17184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.100 [2024-11-20 01:30:47.122268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.100 [2024-11-20 01:30:47.127161] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.100 [2024-11-20 01:30:47.127197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:11712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.100 [2024-11-20 01:30:47.127215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.100 [2024-11-20 01:30:47.131952] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.100 [2024-11-20 01:30:47.131986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:10208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.100 [2024-11-20 01:30:47.132004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.100 [2024-11-20 01:30:47.136969] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.100 [2024-11-20 01:30:47.137005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.100 [2024-11-20 01:30:47.137024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.100 [2024-11-20 01:30:47.142027] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.100 [2024-11-20 01:30:47.142060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:14080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.100 [2024-11-20 01:30:47.142087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.100 [2024-11-20 01:30:47.147156] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.100 [2024-11-20 01:30:47.147188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.100 [2024-11-20 01:30:47.147205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.100 [2024-11-20 01:30:47.152149] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.100 [2024-11-20 01:30:47.152178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:24416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.100 [2024-11-20 01:30:47.152195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.100 [2024-11-20 01:30:47.157031] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.100 [2024-11-20 01:30:47.157085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:24416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.100 [2024-11-20 01:30:47.157104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.100 [2024-11-20 01:30:47.161973] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.100 [2024-11-20 01:30:47.162006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:13024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.100 [2024-11-20 01:30:47.162030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.100 [2024-11-20 01:30:47.167242] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.100 [2024-11-20 01:30:47.167273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:11424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.100 [2024-11-20 01:30:47.167290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.100 [2024-11-20 01:30:47.172787] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.100 [2024-11-20 01:30:47.172821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:8160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.100 [2024-11-20 01:30:47.172839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.100 [2024-11-20 01:30:47.178255] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.100 [2024-11-20 01:30:47.178285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.100 [2024-11-20 01:30:47.178302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.100 [2024-11-20 01:30:47.183772] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.100 [2024-11-20 01:30:47.183806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:18496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.100 [2024-11-20 01:30:47.183825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.100 [2024-11-20 01:30:47.188848] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.100 [2024-11-20 01:30:47.188882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:23808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.100 [2024-11-20 01:30:47.188900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.100 [2024-11-20 01:30:47.194642] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.100 [2024-11-20 01:30:47.194675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:17984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.100 [2024-11-20 01:30:47.194694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.100 [2024-11-20 01:30:47.200504] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.100 [2024-11-20 01:30:47.200538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:10880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.100 [2024-11-20 01:30:47.200557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.100 [2024-11-20 01:30:47.206562] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.100 [2024-11-20 01:30:47.206598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:4832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.100 [2024-11-20 01:30:47.206617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.101 [2024-11-20 01:30:47.212536] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.101 [2024-11-20 01:30:47.212570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:9280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.101 [2024-11-20 01:30:47.212590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.101 [2024-11-20 01:30:47.218115] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.101 [2024-11-20 01:30:47.218147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.101 [2024-11-20 01:30:47.218170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.101 [2024-11-20 01:30:47.223932] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.101 [2024-11-20 01:30:47.223967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:4352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.101 [2024-11-20 01:30:47.223986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.101 [2024-11-20 01:30:47.229846] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.101 [2024-11-20 01:30:47.229880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:2208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.101 [2024-11-20 01:30:47.229899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.101 [2024-11-20 01:30:47.235913] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.101 [2024-11-20 01:30:47.235947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:20896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.101 [2024-11-20 01:30:47.235966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.101 [2024-11-20 01:30:47.242081] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.101 [2024-11-20 01:30:47.242130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:1120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.101 [2024-11-20 01:30:47.242147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.101 [2024-11-20 01:30:47.248241] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.101 [2024-11-20 01:30:47.248272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:10880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.101 [2024-11-20 01:30:47.248289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.101 [2024-11-20 01:30:47.254173] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.101 [2024-11-20 01:30:47.254204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.101 [2024-11-20 01:30:47.254221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.101 [2024-11-20 01:30:47.260190] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.101 [2024-11-20 01:30:47.260222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.101 [2024-11-20 01:30:47.260239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.101 [2024-11-20 01:30:47.265459] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.101 [2024-11-20 01:30:47.265494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:19392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.101 [2024-11-20 01:30:47.265512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.101 [2024-11-20 01:30:47.268731] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.101 [2024-11-20 01:30:47.268770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:25376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.101 [2024-11-20 01:30:47.268789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.101 [2024-11-20 01:30:47.274719] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.101 [2024-11-20 01:30:47.274754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.101 [2024-11-20 01:30:47.274773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.101 [2024-11-20 01:30:47.280365] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.101 [2024-11-20 01:30:47.280414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:18752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.101 [2024-11-20 01:30:47.280433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.101 [2024-11-20 01:30:47.285627] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.101 [2024-11-20 01:30:47.285662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:18368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.101 [2024-11-20 01:30:47.285681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.101 [2024-11-20 01:30:47.290963] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.101 [2024-11-20 01:30:47.290997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:8416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.101 [2024-11-20 01:30:47.291016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.101 [2024-11-20 01:30:47.295970] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.101 [2024-11-20 01:30:47.296004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:18016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.101 [2024-11-20 01:30:47.296023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.101 [2024-11-20 01:30:47.301203] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.101 [2024-11-20 01:30:47.301233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:3072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.101 [2024-11-20 01:30:47.301250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.101 [2024-11-20 01:30:47.306673] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.101 [2024-11-20 01:30:47.306708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:15008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.101 [2024-11-20 01:30:47.306727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.101 [2024-11-20 01:30:47.312440] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.101 [2024-11-20 01:30:47.312475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:11328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.101 [2024-11-20 01:30:47.312494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.360 [2024-11-20 01:30:47.319480] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.360 [2024-11-20 01:30:47.319514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:12480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.360 [2024-11-20 01:30:47.319533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.360 [2024-11-20 01:30:47.325825] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.360 [2024-11-20 01:30:47.325859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:14720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.360 [2024-11-20 01:30:47.325878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.360 [2024-11-20 01:30:47.331659] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.360 [2024-11-20 01:30:47.331693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:23904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.360 [2024-11-20 01:30:47.331711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.360 [2024-11-20 01:30:47.338033] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.360 [2024-11-20 01:30:47.338066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:15168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.360 [2024-11-20 01:30:47.338096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.360 [2024-11-20 01:30:47.344805] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.360 [2024-11-20 01:30:47.344838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:22656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.360 [2024-11-20 01:30:47.344857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.360 [2024-11-20 01:30:47.350602] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.360 [2024-11-20 01:30:47.350636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:5888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.360 [2024-11-20 01:30:47.350655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.360 [2024-11-20 01:30:47.356739] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.360 [2024-11-20 01:30:47.356773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:3776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.360 [2024-11-20 01:30:47.356793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.360 [2024-11-20 01:30:47.361843] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.360 [2024-11-20 01:30:47.361877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:9760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.360 [2024-11-20 01:30:47.361896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.360 [2024-11-20 01:30:47.366874] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.360 [2024-11-20 01:30:47.366914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.360 [2024-11-20 01:30:47.366939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.360 [2024-11-20 01:30:47.371453] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.361 [2024-11-20 01:30:47.371486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.361 [2024-11-20 01:30:47.371506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.361 [2024-11-20 01:30:47.378052] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.361 [2024-11-20 01:30:47.378118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:18208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.361 [2024-11-20 01:30:47.378136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.361 [2024-11-20 01:30:47.383352] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.361 [2024-11-20 01:30:47.383396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:2848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.361 [2024-11-20 01:30:47.383412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.361 [2024-11-20 01:30:47.388572] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.361 [2024-11-20 01:30:47.388605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:17696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.361 [2024-11-20 01:30:47.388623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.361 [2024-11-20 01:30:47.394034] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.361 [2024-11-20 01:30:47.394067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:2272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.361 [2024-11-20 01:30:47.394099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.361 [2024-11-20 01:30:47.399844] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.361 [2024-11-20 01:30:47.399877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:6528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.361 [2024-11-20 01:30:47.399895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.361 [2024-11-20 01:30:47.406178] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.361 [2024-11-20 01:30:47.406208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:14912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.361 [2024-11-20 01:30:47.406225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.361 [2024-11-20 01:30:47.413406] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.361 [2024-11-20 01:30:47.413436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:25408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.361 [2024-11-20 01:30:47.413453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.361 [2024-11-20 01:30:47.419718] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.361 [2024-11-20 01:30:47.419758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:12704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.361 [2024-11-20 01:30:47.419778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.361 [2024-11-20 01:30:47.425832] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.361 [2024-11-20 01:30:47.425866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:8800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.361 [2024-11-20 01:30:47.425886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.361 [2024-11-20 01:30:47.430826] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.361 [2024-11-20 01:30:47.430860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.361 [2024-11-20 01:30:47.430879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.361 [2024-11-20 01:30:47.435215] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.361 [2024-11-20 01:30:47.435245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:3488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.361 [2024-11-20 01:30:47.435262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.361 [2024-11-20 01:30:47.439656] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.361 [2024-11-20 01:30:47.439689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:25344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.361 [2024-11-20 01:30:47.439708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.361 [2024-11-20 01:30:47.444016] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.361 [2024-11-20 01:30:47.444050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:6272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.361 [2024-11-20 01:30:47.444077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.361 [2024-11-20 01:30:47.448187] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.361 [2024-11-20 01:30:47.448216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.361 [2024-11-20 01:30:47.448233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.361 [2024-11-20 01:30:47.452283] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.361 [2024-11-20 01:30:47.452313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:8640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.361 [2024-11-20 01:30:47.452337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.361 [2024-11-20 01:30:47.456540] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.361 [2024-11-20 01:30:47.456571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:4256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.361 [2024-11-20 01:30:47.456590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.361 [2024-11-20 01:30:47.461274] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.361 [2024-11-20 01:30:47.461305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.361 [2024-11-20 01:30:47.461322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.361 [2024-11-20 01:30:47.465739] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.361 [2024-11-20 01:30:47.465772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:1280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.361 [2024-11-20 01:30:47.465790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.361 [2024-11-20 01:30:47.470201] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.361 [2024-11-20 01:30:47.470231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:8064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.361 [2024-11-20 01:30:47.470249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.361 [2024-11-20 01:30:47.475024] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.361 [2024-11-20 01:30:47.475057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:13056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.361 [2024-11-20 01:30:47.475086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.361 [2024-11-20 01:30:47.480229] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.361 [2024-11-20 01:30:47.480259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.361 [2024-11-20 01:30:47.480276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.361 [2024-11-20 01:30:47.485343] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.361 [2024-11-20 01:30:47.485374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:15072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.361 [2024-11-20 01:30:47.485392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.361 [2024-11-20 01:30:47.490234] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.361 [2024-11-20 01:30:47.490265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:6208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.362 [2024-11-20 01:30:47.490282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.362 [2024-11-20 01:30:47.494463] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.362 [2024-11-20 01:30:47.494496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:18944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.362 [2024-11-20 01:30:47.494515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.362 [2024-11-20 01:30:47.498822] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.362 [2024-11-20 01:30:47.498855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:23392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.362 [2024-11-20 01:30:47.498880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.362 [2024-11-20 01:30:47.503257] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.362 [2024-11-20 01:30:47.503286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:12800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.362 [2024-11-20 01:30:47.503311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.362 [2024-11-20 01:30:47.507983] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.362 [2024-11-20 01:30:47.508015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.362 [2024-11-20 01:30:47.508034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.362 [2024-11-20 01:30:47.513248] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.362 [2024-11-20 01:30:47.513291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:19040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.362 [2024-11-20 01:30:47.513307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.362 [2024-11-20 01:30:47.518242] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.362 [2024-11-20 01:30:47.518272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.362 [2024-11-20 01:30:47.518288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.362 [2024-11-20 01:30:47.523233] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.362 [2024-11-20 01:30:47.523261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.362 [2024-11-20 01:30:47.523293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.362 [2024-11-20 01:30:47.528201] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.362 [2024-11-20 01:30:47.528230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.362 [2024-11-20 01:30:47.528247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.362 [2024-11-20 01:30:47.533281] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.362 [2024-11-20 01:30:47.533326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.362 [2024-11-20 01:30:47.533344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.362 [2024-11-20 01:30:47.538593] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.362 [2024-11-20 01:30:47.538622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:8224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.362 [2024-11-20 01:30:47.538638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.362 [2024-11-20 01:30:47.544015] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.362 [2024-11-20 01:30:47.544049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:10880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.362 [2024-11-20 01:30:47.544076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.362 [2024-11-20 01:30:47.549063] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.362 [2024-11-20 01:30:47.549104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:24896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.362 [2024-11-20 01:30:47.549123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.362 [2024-11-20 01:30:47.554360] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.362 [2024-11-20 01:30:47.554403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:10848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.362 [2024-11-20 01:30:47.554419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.362 [2024-11-20 01:30:47.559745] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.362 [2024-11-20 01:30:47.559777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:11808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.362 [2024-11-20 01:30:47.559796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.362 [2024-11-20 01:30:47.565034] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.362 [2024-11-20 01:30:47.565067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:3648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.362 [2024-11-20 01:30:47.565118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.362 [2024-11-20 01:30:47.568904] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.362 [2024-11-20 01:30:47.568937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:2016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.362 [2024-11-20 01:30:47.568955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.362 [2024-11-20 01:30:47.572705] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.362 [2024-11-20 01:30:47.572748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:11904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.362 [2024-11-20 01:30:47.572768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.621 [2024-11-20 01:30:47.576444] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.621 [2024-11-20 01:30:47.576477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:4160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.621 [2024-11-20 01:30:47.576495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.621 [2024-11-20 01:30:47.580708] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.621 [2024-11-20 01:30:47.580741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:2048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.621 [2024-11-20 01:30:47.580765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.621 [2024-11-20 01:30:47.584979] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.621 [2024-11-20 01:30:47.585012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.621 [2024-11-20 01:30:47.585031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.621 [2024-11-20 01:30:47.588971] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.621 [2024-11-20 01:30:47.589002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:16608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.621 [2024-11-20 01:30:47.589021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.621 [2024-11-20 01:30:47.592894] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.621 [2024-11-20 01:30:47.592927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:8480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.621 [2024-11-20 01:30:47.592946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.621 [2024-11-20 01:30:47.596884] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.621 [2024-11-20 01:30:47.596916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:15264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.621 [2024-11-20 01:30:47.596935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.621 [2024-11-20 01:30:47.600734] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.621 [2024-11-20 01:30:47.600766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:3008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.622 [2024-11-20 01:30:47.600784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.622 [2024-11-20 01:30:47.604485] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.622 [2024-11-20 01:30:47.604517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:10400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.622 [2024-11-20 01:30:47.604535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.622 [2024-11-20 01:30:47.609364] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.622 [2024-11-20 01:30:47.609394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.622 [2024-11-20 01:30:47.609428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.622 [2024-11-20 01:30:47.614457] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.622 [2024-11-20 01:30:47.614486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.622 [2024-11-20 01:30:47.614503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.622 [2024-11-20 01:30:47.619304] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.622 [2024-11-20 01:30:47.619349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:6752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.622 [2024-11-20 01:30:47.619368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.622 [2024-11-20 01:30:47.624602] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.622 [2024-11-20 01:30:47.624636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:11008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.622 [2024-11-20 01:30:47.624655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.622 [2024-11-20 01:30:47.628627] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.622 [2024-11-20 01:30:47.628660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:2048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.622 [2024-11-20 01:30:47.628679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.622 [2024-11-20 01:30:47.632677] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.622 [2024-11-20 01:30:47.632709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:7264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.622 [2024-11-20 01:30:47.632728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.622 [2024-11-20 01:30:47.637235] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.622 [2024-11-20 01:30:47.637265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:19936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.622 [2024-11-20 01:30:47.637281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.622 [2024-11-20 01:30:47.642772] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.622 [2024-11-20 01:30:47.642810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:7008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.622 [2024-11-20 01:30:47.642829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.622 [2024-11-20 01:30:47.648041] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.622 [2024-11-20 01:30:47.648082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:6432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.622 [2024-11-20 01:30:47.648102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.622 [2024-11-20 01:30:47.653052] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.622 [2024-11-20 01:30:47.653097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.622 [2024-11-20 01:30:47.653117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.622 [2024-11-20 01:30:47.658159] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.622 [2024-11-20 01:30:47.658207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.622 [2024-11-20 01:30:47.658224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.622 [2024-11-20 01:30:47.663284] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.622 [2024-11-20 01:30:47.663314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:12928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.622 [2024-11-20 01:30:47.663330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.622 [2024-11-20 01:30:47.668509] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.622 [2024-11-20 01:30:47.668541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:23520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.622 [2024-11-20 01:30:47.668560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.622 [2024-11-20 01:30:47.673537] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.622 [2024-11-20 01:30:47.673569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:13760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.622 [2024-11-20 01:30:47.673587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.622 [2024-11-20 01:30:47.678689] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.622 [2024-11-20 01:30:47.678741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.622 [2024-11-20 01:30:47.678765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.622 [2024-11-20 01:30:47.683813] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.622 [2024-11-20 01:30:47.683846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.622 [2024-11-20 01:30:47.683865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.622 [2024-11-20 01:30:47.688887] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.622 [2024-11-20 01:30:47.688921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:24768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.622 [2024-11-20 01:30:47.688940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.622 [2024-11-20 01:30:47.693995] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.622 [2024-11-20 01:30:47.694028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:5344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.622 [2024-11-20 01:30:47.694046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.622 [2024-11-20 01:30:47.699291] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.622 [2024-11-20 01:30:47.699322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.622 [2024-11-20 01:30:47.699339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.622 [2024-11-20 01:30:47.704522] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.622 [2024-11-20 01:30:47.704555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.622 [2024-11-20 01:30:47.704579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.622 [2024-11-20 01:30:47.709768] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.622 [2024-11-20 01:30:47.709801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:23200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.622 [2024-11-20 01:30:47.709820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.622 [2024-11-20 01:30:47.715060] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.622 [2024-11-20 01:30:47.715101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:8480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.622 [2024-11-20 01:30:47.715136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.622 [2024-11-20 01:30:47.720257] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.622 [2024-11-20 01:30:47.720287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:16960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.622 [2024-11-20 01:30:47.720304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.622 [2024-11-20 01:30:47.725314] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.622 [2024-11-20 01:30:47.725343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.622 [2024-11-20 01:30:47.725360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.622 [2024-11-20 01:30:47.730243] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.622 [2024-11-20 01:30:47.730272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:7648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.622 [2024-11-20 01:30:47.730288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.622 [2024-11-20 01:30:47.735327] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.623 [2024-11-20 01:30:47.735360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:18688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.623 [2024-11-20 01:30:47.735378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.623 [2024-11-20 01:30:47.739951] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.623 [2024-11-20 01:30:47.739986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.623 [2024-11-20 01:30:47.740005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.623 [2024-11-20 01:30:47.745269] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.623 [2024-11-20 01:30:47.745300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:25472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.623 [2024-11-20 01:30:47.745317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.623 [2024-11-20 01:30:47.750165] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.623 [2024-11-20 01:30:47.750203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:3488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.623 [2024-11-20 01:30:47.750220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.623 [2024-11-20 01:30:47.754966] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.623 [2024-11-20 01:30:47.754999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.623 [2024-11-20 01:30:47.755017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.623 [2024-11-20 01:30:47.759986] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.623 [2024-11-20 01:30:47.760019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:17344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.623 [2024-11-20 01:30:47.760037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.623 [2024-11-20 01:30:47.764979] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.623 [2024-11-20 01:30:47.765011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:6560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.623 [2024-11-20 01:30:47.765030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.623 [2024-11-20 01:30:47.769963] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.623 [2024-11-20 01:30:47.769999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:2592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.623 [2024-11-20 01:30:47.770019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.623 [2024-11-20 01:30:47.775177] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.623 [2024-11-20 01:30:47.775207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:2432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.623 [2024-11-20 01:30:47.775223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.623 [2024-11-20 01:30:47.780425] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.623 [2024-11-20 01:30:47.780459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.623 [2024-11-20 01:30:47.780477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.623 [2024-11-20 01:30:47.785481] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.623 [2024-11-20 01:30:47.785514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:9184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.623 [2024-11-20 01:30:47.785532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.623 [2024-11-20 01:30:47.790615] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.623 [2024-11-20 01:30:47.790648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.623 [2024-11-20 01:30:47.790666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.623 [2024-11-20 01:30:47.795986] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.623 [2024-11-20 01:30:47.796019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:4288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.623 [2024-11-20 01:30:47.796038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.623 [2024-11-20 01:30:47.801083] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.623 [2024-11-20 01:30:47.801129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:9504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.623 [2024-11-20 01:30:47.801146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.623 [2024-11-20 01:30:47.806419] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.623 [2024-11-20 01:30:47.806453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:5504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.623 [2024-11-20 01:30:47.806472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.623 [2024-11-20 01:30:47.811423] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.623 [2024-11-20 01:30:47.811457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:13024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.623 [2024-11-20 01:30:47.811476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.623 [2024-11-20 01:30:47.816684] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.623 [2024-11-20 01:30:47.816722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:7200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.623 [2024-11-20 01:30:47.816741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.623 [2024-11-20 01:30:47.821539] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.623 [2024-11-20 01:30:47.821571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:17632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.623 [2024-11-20 01:30:47.821589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.623 [2024-11-20 01:30:47.826621] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.623 [2024-11-20 01:30:47.826654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:15264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.623 [2024-11-20 01:30:47.826673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.623 [2024-11-20 01:30:47.831904] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.623 [2024-11-20 01:30:47.831937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:14912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.623 [2024-11-20 01:30:47.831956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.881 [2024-11-20 01:30:47.836974] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.881 [2024-11-20 01:30:47.837007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:21408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.881 [2024-11-20 01:30:47.837033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.882 [2024-11-20 01:30:47.842305] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.882 [2024-11-20 01:30:47.842335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.882 [2024-11-20 01:30:47.842357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.882 [2024-11-20 01:30:47.847497] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.882 [2024-11-20 01:30:47.847534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:11648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.882 [2024-11-20 01:30:47.847555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.882 [2024-11-20 01:30:47.852739] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.882 [2024-11-20 01:30:47.852771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:4480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.882 [2024-11-20 01:30:47.852793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.882 [2024-11-20 01:30:47.857933] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.882 [2024-11-20 01:30:47.857966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:4576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.882 [2024-11-20 01:30:47.857985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.882 [2024-11-20 01:30:47.863091] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.882 [2024-11-20 01:30:47.863150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.882 [2024-11-20 01:30:47.863167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.882 [2024-11-20 01:30:47.868134] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.882 [2024-11-20 01:30:47.868164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:23616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.882 [2024-11-20 01:30:47.868181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.882 [2024-11-20 01:30:47.873248] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.882 [2024-11-20 01:30:47.873282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:22272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.882 [2024-11-20 01:30:47.873299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.882 [2024-11-20 01:30:47.878241] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.882 [2024-11-20 01:30:47.878272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:16128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.882 [2024-11-20 01:30:47.878289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.882 [2024-11-20 01:30:47.883263] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.882 [2024-11-20 01:30:47.883300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.882 [2024-11-20 01:30:47.883318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.882 [2024-11-20 01:30:47.888226] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.882 [2024-11-20 01:30:47.888255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:14080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.882 [2024-11-20 01:30:47.888272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.882 [2024-11-20 01:30:47.893035] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.882 [2024-11-20 01:30:47.893067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:16256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.882 [2024-11-20 01:30:47.893122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.882 [2024-11-20 01:30:47.898144] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.882 [2024-11-20 01:30:47.898174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:8416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.882 [2024-11-20 01:30:47.898191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.882 [2024-11-20 01:30:47.903097] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.882 [2024-11-20 01:30:47.903142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:5824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.882 [2024-11-20 01:30:47.903159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.882 [2024-11-20 01:30:47.908265] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.882 [2024-11-20 01:30:47.908295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:22304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.882 [2024-11-20 01:30:47.908311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.882 [2024-11-20 01:30:47.913421] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.882 [2024-11-20 01:30:47.913454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:7648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.882 [2024-11-20 01:30:47.913473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.882 [2024-11-20 01:30:47.918738] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.882 [2024-11-20 01:30:47.918770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.882 [2024-11-20 01:30:47.918789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.882 [2024-11-20 01:30:47.924063] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.882 [2024-11-20 01:30:47.924117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.882 [2024-11-20 01:30:47.924140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.882 [2024-11-20 01:30:47.929315] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.882 [2024-11-20 01:30:47.929344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:14208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.882 [2024-11-20 01:30:47.929361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.882 [2024-11-20 01:30:47.934523] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.882 [2024-11-20 01:30:47.934561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:21184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.882 [2024-11-20 01:30:47.934580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.882 [2024-11-20 01:30:47.939565] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.882 [2024-11-20 01:30:47.939598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:20000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.882 [2024-11-20 01:30:47.939617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.882 [2024-11-20 01:30:47.944820] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.882 [2024-11-20 01:30:47.944852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:17920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.882 [2024-11-20 01:30:47.944871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.882 [2024-11-20 01:30:47.949786] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.882 [2024-11-20 01:30:47.949822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:10656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.882 [2024-11-20 01:30:47.949841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.882 [2024-11-20 01:30:47.954764] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.882 [2024-11-20 01:30:47.954800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.882 [2024-11-20 01:30:47.954819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.882 [2024-11-20 01:30:47.959906] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.882 [2024-11-20 01:30:47.959943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:17376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.882 [2024-11-20 01:30:47.959962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.882 [2024-11-20 01:30:47.964918] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.882 [2024-11-20 01:30:47.964955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:21088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.882 [2024-11-20 01:30:47.964975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.882 [2024-11-20 01:30:47.969936] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.882 [2024-11-20 01:30:47.969977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:10400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.882 [2024-11-20 01:30:47.969997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.882 [2024-11-20 01:30:47.974838] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.882 [2024-11-20 01:30:47.974871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:4160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.883 [2024-11-20 01:30:47.974888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.883 [2024-11-20 01:30:47.979865] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.883 [2024-11-20 01:30:47.979897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:1888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.883 [2024-11-20 01:30:47.979916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.883 [2024-11-20 01:30:47.984983] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.883 [2024-11-20 01:30:47.985015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:3648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.883 [2024-11-20 01:30:47.985032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.883 [2024-11-20 01:30:47.989867] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.883 [2024-11-20 01:30:47.989899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:22944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.883 [2024-11-20 01:30:47.989917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.883 [2024-11-20 01:30:47.995153] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.883 [2024-11-20 01:30:47.995183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:5248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.883 [2024-11-20 01:30:47.995200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.883 [2024-11-20 01:30:48.000234] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.883 [2024-11-20 01:30:48.000263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.883 [2024-11-20 01:30:48.000280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.883 [2024-11-20 01:30:48.005261] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.883 [2024-11-20 01:30:48.005290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.883 [2024-11-20 01:30:48.005306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.883 [2024-11-20 01:30:48.010397] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.883 [2024-11-20 01:30:48.010429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:20416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.883 [2024-11-20 01:30:48.010447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.883 [2024-11-20 01:30:48.015440] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.883 [2024-11-20 01:30:48.015486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:7680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.883 [2024-11-20 01:30:48.015504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.883 [2024-11-20 01:30:48.020577] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.883 [2024-11-20 01:30:48.020610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:22016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.883 [2024-11-20 01:30:48.020628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.883 [2024-11-20 01:30:48.025695] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.883 [2024-11-20 01:30:48.025727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:20640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.883 [2024-11-20 01:30:48.025745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.883 [2024-11-20 01:30:48.030723] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.883 [2024-11-20 01:30:48.030753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:22624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.883 [2024-11-20 01:30:48.030772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.883 [2024-11-20 01:30:48.035842] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.883 [2024-11-20 01:30:48.035875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.883 [2024-11-20 01:30:48.035893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.883 [2024-11-20 01:30:48.041020] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.883 [2024-11-20 01:30:48.041053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:12192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.883 [2024-11-20 01:30:48.041079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.883 [2024-11-20 01:30:48.045900] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.883 [2024-11-20 01:30:48.045932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:22720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.883 [2024-11-20 01:30:48.045951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.883 [2024-11-20 01:30:48.051009] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.883 [2024-11-20 01:30:48.051040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:19072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.883 [2024-11-20 01:30:48.051058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.883 [2024-11-20 01:30:48.056088] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.883 [2024-11-20 01:30:48.056132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:17696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.883 [2024-11-20 01:30:48.056154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.883 [2024-11-20 01:30:48.061183] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.883 [2024-11-20 01:30:48.061212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:6048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.883 [2024-11-20 01:30:48.061233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.883 [2024-11-20 01:30:48.066273] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.883 [2024-11-20 01:30:48.066302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:21248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.883 [2024-11-20 01:30:48.066319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.883 [2024-11-20 01:30:48.071357] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.883 [2024-11-20 01:30:48.071387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.883 [2024-11-20 01:30:48.071405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.883 [2024-11-20 01:30:48.076524] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.883 [2024-11-20 01:30:48.076557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:7712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.883 [2024-11-20 01:30:48.076576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.883 [2024-11-20 01:30:48.081601] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.883 [2024-11-20 01:30:48.081634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:12864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.883 [2024-11-20 01:30:48.081652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.883 [2024-11-20 01:30:48.086804] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.883 [2024-11-20 01:30:48.086836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:24864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.883 [2024-11-20 01:30:48.086854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.883 [2024-11-20 01:30:48.092289] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:39.883 [2024-11-20 01:30:48.092319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:15936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.883 [2024-11-20 01:30:48.092335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.142 [2024-11-20 01:30:48.097842] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.142 [2024-11-20 01:30:48.097877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:12064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.142 [2024-11-20 01:30:48.097896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.142 [2024-11-20 01:30:48.102843] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.142 [2024-11-20 01:30:48.102882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:21920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.142 [2024-11-20 01:30:48.102902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.142 [2024-11-20 01:30:48.107377] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.142 [2024-11-20 01:30:48.107410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:20128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.142 [2024-11-20 01:30:48.107430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.142 [2024-11-20 01:30:48.110947] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.142 [2024-11-20 01:30:48.110979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:13408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.142 [2024-11-20 01:30:48.110996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.142 [2024-11-20 01:30:48.115347] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.142 [2024-11-20 01:30:48.115393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:15040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.142 [2024-11-20 01:30:48.115412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.142 [2024-11-20 01:30:48.120043] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.142 [2024-11-20 01:30:48.120083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:6656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.142 [2024-11-20 01:30:48.120104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.142 [2024-11-20 01:30:48.124782] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.142 [2024-11-20 01:30:48.124816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:2464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.142 [2024-11-20 01:30:48.124834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.142 [2024-11-20 01:30:48.130325] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.142 [2024-11-20 01:30:48.130355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:18592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.142 [2024-11-20 01:30:48.130372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.142 [2024-11-20 01:30:48.135543] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.142 [2024-11-20 01:30:48.135575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:6592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.142 [2024-11-20 01:30:48.135593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.143 [2024-11-20 01:30:48.140619] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.143 [2024-11-20 01:30:48.140652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:13728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.143 [2024-11-20 01:30:48.140670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.143 [2024-11-20 01:30:48.145888] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.143 [2024-11-20 01:30:48.145920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:22848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.143 [2024-11-20 01:30:48.145938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.143 [2024-11-20 01:30:48.151234] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.143 [2024-11-20 01:30:48.151264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:10336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.143 [2024-11-20 01:30:48.151281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.143 [2024-11-20 01:30:48.156204] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.143 [2024-11-20 01:30:48.156249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:14016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.143 [2024-11-20 01:30:48.156265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.143 [2024-11-20 01:30:48.161550] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.143 [2024-11-20 01:30:48.161583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:5248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.143 [2024-11-20 01:30:48.161601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.143 [2024-11-20 01:30:48.166555] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.143 [2024-11-20 01:30:48.166588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.143 [2024-11-20 01:30:48.166607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.143 [2024-11-20 01:30:48.172000] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.143 [2024-11-20 01:30:48.172033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:20224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.143 [2024-11-20 01:30:48.172051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.143 [2024-11-20 01:30:48.178546] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.143 [2024-11-20 01:30:48.178581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:2656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.143 [2024-11-20 01:30:48.178600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.143 [2024-11-20 01:30:48.183344] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.143 [2024-11-20 01:30:48.183389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:16640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.143 [2024-11-20 01:30:48.183409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.143 [2024-11-20 01:30:48.187827] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.143 [2024-11-20 01:30:48.187861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:2112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.143 [2024-11-20 01:30:48.187887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.143 [2024-11-20 01:30:48.192658] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.143 [2024-11-20 01:30:48.192691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:4448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.143 [2024-11-20 01:30:48.192709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.143 [2024-11-20 01:30:48.198336] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.143 [2024-11-20 01:30:48.198367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:19296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.143 [2024-11-20 01:30:48.198385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.143 [2024-11-20 01:30:48.203593] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.143 [2024-11-20 01:30:48.203632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:11040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.143 [2024-11-20 01:30:48.203653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.143 [2024-11-20 01:30:48.208265] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.143 [2024-11-20 01:30:48.208300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:23744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.143 [2024-11-20 01:30:48.208317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.143 [2024-11-20 01:30:48.212847] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.143 [2024-11-20 01:30:48.212880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:10976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.143 [2024-11-20 01:30:48.212899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.143 [2024-11-20 01:30:48.217687] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.143 [2024-11-20 01:30:48.217720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:4704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.143 [2024-11-20 01:30:48.217739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.143 [2024-11-20 01:30:48.224458] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.143 [2024-11-20 01:30:48.224491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:18752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.143 [2024-11-20 01:30:48.224510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.143 [2024-11-20 01:30:48.231001] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.143 [2024-11-20 01:30:48.231035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:15648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.143 [2024-11-20 01:30:48.231054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.143 [2024-11-20 01:30:48.238421] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.143 [2024-11-20 01:30:48.238455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:18624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.143 [2024-11-20 01:30:48.238488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.143 [2024-11-20 01:30:48.245421] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.143 [2024-11-20 01:30:48.245455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.143 [2024-11-20 01:30:48.245474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.143 [2024-11-20 01:30:48.250970] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.143 [2024-11-20 01:30:48.251003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:24448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.143 [2024-11-20 01:30:48.251022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.143 [2024-11-20 01:30:48.255859] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.143 [2024-11-20 01:30:48.255897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:16032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.143 [2024-11-20 01:30:48.255916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.143 [2024-11-20 01:30:48.259791] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.143 [2024-11-20 01:30:48.259823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.143 [2024-11-20 01:30:48.259842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.143 [2024-11-20 01:30:48.263630] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.143 [2024-11-20 01:30:48.263662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:20352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.143 [2024-11-20 01:30:48.263680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.143 [2024-11-20 01:30:48.267596] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.143 [2024-11-20 01:30:48.267628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:1024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.143 [2024-11-20 01:30:48.267646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.143 [2024-11-20 01:30:48.271459] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.143 [2024-11-20 01:30:48.271491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:5440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.143 [2024-11-20 01:30:48.271510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.143 [2024-11-20 01:30:48.275206] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.143 [2024-11-20 01:30:48.275234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.144 [2024-11-20 01:30:48.275251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.144 [2024-11-20 01:30:48.279112] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.144 [2024-11-20 01:30:48.279142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:2272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.144 [2024-11-20 01:30:48.279158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.144 [2024-11-20 01:30:48.283058] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.144 [2024-11-20 01:30:48.283113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:8960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.144 [2024-11-20 01:30:48.283131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.144 [2024-11-20 01:30:48.287177] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.144 [2024-11-20 01:30:48.287206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.144 [2024-11-20 01:30:48.287223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.144 [2024-11-20 01:30:48.291492] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.144 [2024-11-20 01:30:48.291525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:12672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.144 [2024-11-20 01:30:48.291543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.144 [2024-11-20 01:30:48.296643] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.144 [2024-11-20 01:30:48.296675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:3840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.144 [2024-11-20 01:30:48.296693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.144 [2024-11-20 01:30:48.301802] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.144 [2024-11-20 01:30:48.301833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:22176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.144 [2024-11-20 01:30:48.301851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.144 [2024-11-20 01:30:48.306939] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.144 [2024-11-20 01:30:48.306972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:5696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.144 [2024-11-20 01:30:48.306990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.144 [2024-11-20 01:30:48.312159] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.144 [2024-11-20 01:30:48.312188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.144 [2024-11-20 01:30:48.312204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.144 [2024-11-20 01:30:48.317266] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.144 [2024-11-20 01:30:48.317297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:6304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.144 [2024-11-20 01:30:48.317323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.144 [2024-11-20 01:30:48.322388] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.144 [2024-11-20 01:30:48.322422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:22336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.144 [2024-11-20 01:30:48.322440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.144 [2024-11-20 01:30:48.327524] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.144 [2024-11-20 01:30:48.327557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:9760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.144 [2024-11-20 01:30:48.327576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.144 [2024-11-20 01:30:48.332537] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.144 [2024-11-20 01:30:48.332567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:13056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.144 [2024-11-20 01:30:48.332584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.144 [2024-11-20 01:30:48.338240] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.144 [2024-11-20 01:30:48.338270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:8832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.144 [2024-11-20 01:30:48.338302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.144 [2024-11-20 01:30:48.343250] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.144 [2024-11-20 01:30:48.343282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:8896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.144 [2024-11-20 01:30:48.343299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.144 [2024-11-20 01:30:48.347688] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.144 [2024-11-20 01:30:48.347722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:12704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.144 [2024-11-20 01:30:48.347741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.144 [2024-11-20 01:30:48.351686] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.144 [2024-11-20 01:30:48.351719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:14176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.144 [2024-11-20 01:30:48.351738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.144 [2024-11-20 01:30:48.355804] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.144 [2024-11-20 01:30:48.355838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:9056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.144 [2024-11-20 01:30:48.355857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.402 [2024-11-20 01:30:48.359779] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.402 [2024-11-20 01:30:48.359813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:17792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.402 [2024-11-20 01:30:48.359832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.402 [2024-11-20 01:30:48.363807] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.402 [2024-11-20 01:30:48.363840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:18112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.402 [2024-11-20 01:30:48.363858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.402 [2024-11-20 01:30:48.368014] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.402 [2024-11-20 01:30:48.368046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.402 [2024-11-20 01:30:48.368064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.402 [2024-11-20 01:30:48.372403] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.402 [2024-11-20 01:30:48.372437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:10144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.402 [2024-11-20 01:30:48.372456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.402 [2024-11-20 01:30:48.376631] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.402 [2024-11-20 01:30:48.376664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:2528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.402 [2024-11-20 01:30:48.376683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.402 [2024-11-20 01:30:48.380767] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.402 [2024-11-20 01:30:48.380800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:5344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.402 [2024-11-20 01:30:48.380818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.402 [2024-11-20 01:30:48.384740] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.402 [2024-11-20 01:30:48.384772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.402 [2024-11-20 01:30:48.384798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.402 [2024-11-20 01:30:48.389250] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.402 [2024-11-20 01:30:48.389281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:5696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.402 [2024-11-20 01:30:48.389297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.402 [2024-11-20 01:30:48.394345] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xe212f0) 00:29:40.402 [2024-11-20 01:30:48.394383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.402 [2024-11-20 01:30:48.394405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.402 00:29:40.402 Latency(us) 00:29:40.402 [2024-11-20T00:30:48.621Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:40.402 [2024-11-20T00:30:48.621Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:29:40.402 nvme0n1 : 2.00 6079.12 759.89 0.00 0.00 2627.71 640.19 9466.31 00:29:40.402 [2024-11-20T00:30:48.621Z] =================================================================================================================== 00:29:40.402 [2024-11-20T00:30:48.621Z] Total : 6079.12 759.89 0.00 0.00 2627.71 640.19 9466.31 00:29:40.402 0 00:29:40.402 01:30:48 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:29:40.402 01:30:48 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:29:40.402 01:30:48 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:29:40.402 01:30:48 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:29:40.402 | .driver_specific 00:29:40.402 | .nvme_error 00:29:40.402 | .status_code 00:29:40.402 | .command_transient_transport_error' 00:29:40.660 01:30:48 -- host/digest.sh@71 -- # (( 392 > 0 )) 00:29:40.660 01:30:48 -- host/digest.sh@73 -- # killprocess 1264430 00:29:40.660 01:30:48 -- common/autotest_common.sh@936 -- # '[' -z 1264430 ']' 00:29:40.660 01:30:48 -- common/autotest_common.sh@940 -- # kill -0 1264430 00:29:40.660 01:30:48 -- common/autotest_common.sh@941 -- # uname 00:29:40.660 01:30:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:40.660 01:30:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1264430 00:29:40.660 01:30:48 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:40.660 01:30:48 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:40.660 01:30:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1264430' 00:29:40.660 killing process with pid 1264430 00:29:40.660 01:30:48 -- common/autotest_common.sh@955 -- # kill 1264430 00:29:40.660 Received shutdown signal, test time was about 2.000000 seconds 00:29:40.660 00:29:40.660 Latency(us) 00:29:40.660 [2024-11-20T00:30:48.879Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:40.660 [2024-11-20T00:30:48.879Z] =================================================================================================================== 00:29:40.660 [2024-11-20T00:30:48.879Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:40.660 01:30:48 -- common/autotest_common.sh@960 -- # wait 1264430 00:29:40.918 01:30:48 -- host/digest.sh@113 -- # run_bperf_err randwrite 4096 128 00:29:40.918 01:30:48 -- host/digest.sh@54 -- # local rw bs qd 00:29:40.918 01:30:48 -- host/digest.sh@56 -- # rw=randwrite 00:29:40.918 01:30:48 -- host/digest.sh@56 -- # bs=4096 00:29:40.918 01:30:48 -- host/digest.sh@56 -- # qd=128 00:29:40.918 01:30:48 -- host/digest.sh@58 -- # bperfpid=1264985 00:29:40.918 01:30:48 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z 00:29:40.918 01:30:48 -- host/digest.sh@60 -- # waitforlisten 1264985 /var/tmp/bperf.sock 00:29:40.918 01:30:48 -- common/autotest_common.sh@829 -- # '[' -z 1264985 ']' 00:29:40.918 01:30:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:40.918 01:30:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:40.918 01:30:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:40.918 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:40.918 01:30:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:40.918 01:30:48 -- common/autotest_common.sh@10 -- # set +x 00:29:40.918 [2024-11-20 01:30:48.949128] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:40.918 [2024-11-20 01:30:48.949211] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1264985 ] 00:29:40.918 EAL: No free 2048 kB hugepages reported on node 1 00:29:40.918 [2024-11-20 01:30:49.009025] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:40.918 [2024-11-20 01:30:49.094451] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:41.850 01:30:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:41.850 01:30:49 -- common/autotest_common.sh@862 -- # return 0 00:29:41.850 01:30:49 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:41.850 01:30:49 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:42.107 01:30:50 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:29:42.107 01:30:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:42.107 01:30:50 -- common/autotest_common.sh@10 -- # set +x 00:29:42.107 01:30:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:42.108 01:30:50 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:42.108 01:30:50 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:42.674 nvme0n1 00:29:42.674 01:30:50 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:29:42.674 01:30:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:42.674 01:30:50 -- common/autotest_common.sh@10 -- # set +x 00:29:42.674 01:30:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:42.674 01:30:50 -- host/digest.sh@69 -- # bperf_py perform_tests 00:29:42.674 01:30:50 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:42.674 Running I/O for 2 seconds... 00:29:42.674 [2024-11-20 01:30:50.774212] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190eea00 00:29:42.674 [2024-11-20 01:30:50.775563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:24482 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.674 [2024-11-20 01:30:50.775602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:42.674 [2024-11-20 01:30:50.786304] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190fb480 00:29:42.674 [2024-11-20 01:30:50.787821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:10765 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.674 [2024-11-20 01:30:50.787852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:42.674 [2024-11-20 01:30:50.797547] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190ea680 00:29:42.674 [2024-11-20 01:30:50.799389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:19810 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.674 [2024-11-20 01:30:50.799419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:42.674 [2024-11-20 01:30:50.807863] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190fa7d8 00:29:42.674 [2024-11-20 01:30:50.808737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:10358 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.674 [2024-11-20 01:30:50.808767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0043 p:0 m:0 dnr:0 00:29:42.674 [2024-11-20 01:30:50.821899] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190e4578 00:29:42.674 [2024-11-20 01:30:50.823541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:24493 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.674 [2024-11-20 01:30:50.823586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:42.674 [2024-11-20 01:30:50.833543] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190f2948 00:29:42.674 [2024-11-20 01:30:50.835156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:2571 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.674 [2024-11-20 01:30:50.835209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:42.674 [2024-11-20 01:30:50.844945] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190edd58 00:29:42.674 [2024-11-20 01:30:50.846625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:18702 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.674 [2024-11-20 01:30:50.846654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:42.674 [2024-11-20 01:30:50.856393] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190fb480 00:29:42.674 [2024-11-20 01:30:50.858065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:3110 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.674 [2024-11-20 01:30:50.858102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:42.674 [2024-11-20 01:30:50.867797] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190f46d0 00:29:42.674 [2024-11-20 01:30:50.869458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:1949 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.674 [2024-11-20 01:30:50.869487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:42.674 [2024-11-20 01:30:50.879126] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190f9f68 00:29:42.674 [2024-11-20 01:30:50.880791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:17895 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.674 [2024-11-20 01:30:50.880825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:42.674 [2024-11-20 01:30:50.889430] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190eaef0 00:29:42.934 [2024-11-20 01:30:50.890824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:11566 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.934 [2024-11-20 01:30:50.890853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.934 [2024-11-20 01:30:50.900871] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190eaef0 00:29:42.934 [2024-11-20 01:30:50.902276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:4585 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.934 [2024-11-20 01:30:50.902305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:42.934 [2024-11-20 01:30:50.911845] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190f5378 00:29:42.934 [2024-11-20 01:30:50.912876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:20104 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.934 [2024-11-20 01:30:50.912906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:0045 p:0 m:0 dnr:0 00:29:42.934 [2024-11-20 01:30:50.923881] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190e1710 00:29:42.934 [2024-11-20 01:30:50.925170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:6890 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.934 [2024-11-20 01:30:50.925206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0057 p:0 m:0 dnr:0 00:29:42.934 [2024-11-20 01:30:50.936228] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190edd58 00:29:42.934 [2024-11-20 01:30:50.936752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:10640 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.934 [2024-11-20 01:30:50.936779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0057 p:0 m:0 dnr:0 00:29:42.934 [2024-11-20 01:30:50.947937] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190ec408 00:29:42.934 [2024-11-20 01:30:50.948634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:9086 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.934 [2024-11-20 01:30:50.948662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:29:42.934 [2024-11-20 01:30:50.959373] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190f31b8 00:29:42.934 [2024-11-20 01:30:50.959956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:10875 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.934 [2024-11-20 01:30:50.959997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:29:42.934 [2024-11-20 01:30:50.970744] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190ee5c8 00:29:42.934 [2024-11-20 01:30:50.971335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:20677 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.934 [2024-11-20 01:30:50.971364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:29:42.934 [2024-11-20 01:30:50.983896] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190f7538 00:29:42.934 [2024-11-20 01:30:50.985442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:22522 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.934 [2024-11-20 01:30:50.985471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.934 [2024-11-20 01:30:50.993298] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190f0350 00:29:42.934 [2024-11-20 01:30:50.993930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:20498 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.934 [2024-11-20 01:30:50.993959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:29:42.934 [2024-11-20 01:30:51.004793] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190f3a28 00:29:42.934 [2024-11-20 01:30:51.005330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:11886 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.934 [2024-11-20 01:30:51.005359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:42.934 [2024-11-20 01:30:51.016036] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190f9f68 00:29:42.934 [2024-11-20 01:30:51.016646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:13218 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.934 [2024-11-20 01:30:51.016675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:29:42.934 [2024-11-20 01:30:51.027317] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190eea00 00:29:42.934 [2024-11-20 01:30:51.028021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:19993 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.934 [2024-11-20 01:30:51.028050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:29:42.934 [2024-11-20 01:30:51.038684] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190fb048 00:29:42.934 [2024-11-20 01:30:51.039119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:15940 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.934 [2024-11-20 01:30:51.039152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:005e p:0 m:0 dnr:0 00:29:42.934 [2024-11-20 01:30:51.052243] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190ed920 00:29:42.934 [2024-11-20 01:30:51.053926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:10314 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.934 [2024-11-20 01:30:51.053956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:42.934 [2024-11-20 01:30:51.063532] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190e5658 00:29:42.934 [2024-11-20 01:30:51.065264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:25107 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.934 [2024-11-20 01:30:51.065294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:42.934 [2024-11-20 01:30:51.073772] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190e0630 00:29:42.934 [2024-11-20 01:30:51.075132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:18321 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.934 [2024-11-20 01:30:51.075161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:42.934 [2024-11-20 01:30:51.084981] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190e49b0 00:29:42.934 [2024-11-20 01:30:51.086765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:2591 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.934 [2024-11-20 01:30:51.086794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:42.934 [2024-11-20 01:30:51.097334] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190f7100 00:29:42.934 [2024-11-20 01:30:51.098536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:3817 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.934 [2024-11-20 01:30:51.098563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:42.934 [2024-11-20 01:30:51.108900] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190e4de8 00:29:42.934 [2024-11-20 01:30:51.110730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:21280 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.934 [2024-11-20 01:30:51.110759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:42.934 [2024-11-20 01:30:51.120285] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190f7100 00:29:42.934 [2024-11-20 01:30:51.122096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:9202 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.934 [2024-11-20 01:30:51.122125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:42.934 [2024-11-20 01:30:51.131585] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190f96f8 00:29:42.934 [2024-11-20 01:30:51.133226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:16162 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.934 [2024-11-20 01:30:51.133259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:42.934 [2024-11-20 01:30:51.142990] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190e49b0 00:29:42.934 [2024-11-20 01:30:51.144667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:16406 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.934 [2024-11-20 01:30:51.144697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:43.193 [2024-11-20 01:30:51.154547] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190e6b70 00:29:43.194 [2024-11-20 01:30:51.156368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:7229 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.194 [2024-11-20 01:30:51.156398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0079 p:0 m:0 dnr:0 00:29:43.194 [2024-11-20 01:30:51.164695] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190e88f8 00:29:43.194 [2024-11-20 01:30:51.165240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:7359 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.194 [2024-11-20 01:30:51.165270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:29:43.194 [2024-11-20 01:30:51.175867] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190f6458 00:29:43.194 [2024-11-20 01:30:51.176557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:20027 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.194 [2024-11-20 01:30:51.176589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:29:43.194 [2024-11-20 01:30:51.187185] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190f7da8 00:29:43.194 [2024-11-20 01:30:51.188635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:22152 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.194 [2024-11-20 01:30:51.188664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:29:43.194 [2024-11-20 01:30:51.198228] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190dfdc0 00:29:43.194 [2024-11-20 01:30:51.198379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:17232 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.194 [2024-11-20 01:30:51.198406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:29:43.194 [2024-11-20 01:30:51.211014] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190e84c0 00:29:43.194 [2024-11-20 01:30:51.211864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:15209 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.194 [2024-11-20 01:30:51.211897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0045 p:0 m:0 dnr:0 00:29:43.194 [2024-11-20 01:30:51.225734] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190f35f0 00:29:43.194 [2024-11-20 01:30:51.227443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:9158 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.194 [2024-11-20 01:30:51.227484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.194 [2024-11-20 01:30:51.238047] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190e1b48 00:29:43.194 [2024-11-20 01:30:51.239777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:4073 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.194 [2024-11-20 01:30:51.239810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:43.194 [2024-11-20 01:30:51.250380] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190ecc78 00:29:43.194 [2024-11-20 01:30:51.252107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:24751 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.194 [2024-11-20 01:30:51.252152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:43.194 [2024-11-20 01:30:51.262716] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190ec408 00:29:43.194 [2024-11-20 01:30:51.264466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:25425 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.194 [2024-11-20 01:30:51.264502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:43.194 [2024-11-20 01:30:51.275010] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190e1710 00:29:43.194 [2024-11-20 01:30:51.276823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:18834 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.194 [2024-11-20 01:30:51.276850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:43.194 [2024-11-20 01:30:51.287283] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190e4140 00:29:43.194 [2024-11-20 01:30:51.289122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:725 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.194 [2024-11-20 01:30:51.289157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:43.194 [2024-11-20 01:30:51.299766] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190f0350 00:29:43.194 [2024-11-20 01:30:51.300671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:13598 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.194 [2024-11-20 01:30:51.300703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:43.194 [2024-11-20 01:30:51.310490] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190e5a90 00:29:43.194 [2024-11-20 01:30:51.311894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:5065 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.194 [2024-11-20 01:30:51.311927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:43.194 [2024-11-20 01:30:51.322763] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190e5a90 00:29:43.194 [2024-11-20 01:30:51.324289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:21723 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.194 [2024-11-20 01:30:51.324317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:43.194 [2024-11-20 01:30:51.334391] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190e5ec8 00:29:43.194 [2024-11-20 01:30:51.335687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:21714 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.194 [2024-11-20 01:30:51.335723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0044 p:0 m:0 dnr:0 00:29:43.194 [2024-11-20 01:30:51.346735] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190eaab8 00:29:43.194 [2024-11-20 01:30:51.347783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:12245 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.194 [2024-11-20 01:30:51.347816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0043 p:0 m:0 dnr:0 00:29:43.194 [2024-11-20 01:30:51.359024] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190eff18 00:29:43.194 [2024-11-20 01:30:51.360126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:8722 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.194 [2024-11-20 01:30:51.360156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0042 p:0 m:0 dnr:0 00:29:43.194 [2024-11-20 01:30:51.371305] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190eaef0 00:29:43.194 [2024-11-20 01:30:51.372417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:2127 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.194 [2024-11-20 01:30:51.372449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:43.194 [2024-11-20 01:30:51.383799] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190e6b70 00:29:43.194 [2024-11-20 01:30:51.385145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:2140 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.194 [2024-11-20 01:30:51.385174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0051 p:0 m:0 dnr:0 00:29:43.194 [2024-11-20 01:30:51.397774] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190fb8b8 00:29:43.194 [2024-11-20 01:30:51.398601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:16502 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.194 [2024-11-20 01:30:51.398633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0044 p:0 m:0 dnr:0 00:29:43.194 [2024-11-20 01:30:51.408814] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190fe2e8 00:29:43.194 [2024-11-20 01:30:51.409614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:5983 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.194 [2024-11-20 01:30:51.409643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0054 p:0 m:0 dnr:0 00:29:43.453 [2024-11-20 01:30:51.421155] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190f4f40 00:29:43.453 [2024-11-20 01:30:51.422055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:1549 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.453 [2024-11-20 01:30:51.422098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0055 p:0 m:0 dnr:0 00:29:43.453 [2024-11-20 01:30:51.436242] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190e49b0 00:29:43.453 [2024-11-20 01:30:51.437285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:1755 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.453 [2024-11-20 01:30:51.437314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.453 [2024-11-20 01:30:51.447419] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190ec408 00:29:43.453 [2024-11-20 01:30:51.448427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:10522 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.453 [2024-11-20 01:30:51.448459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:43.453 [2024-11-20 01:30:51.459576] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190de038 00:29:43.453 [2024-11-20 01:30:51.460577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:21199 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.453 [2024-11-20 01:30:51.460609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:43.453 [2024-11-20 01:30:51.471577] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190f3a28 00:29:43.453 [2024-11-20 01:30:51.473478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:9632 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.453 [2024-11-20 01:30:51.473511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:43.453 [2024-11-20 01:30:51.483949] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190de470 00:29:43.453 [2024-11-20 01:30:51.485477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:17066 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.453 [2024-11-20 01:30:51.485509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:43.453 [2024-11-20 01:30:51.496341] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190fe2e8 00:29:43.453 [2024-11-20 01:30:51.497917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:8260 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.453 [2024-11-20 01:30:51.497950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.453 [2024-11-20 01:30:51.507275] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190fef90 00:29:43.453 [2024-11-20 01:30:51.508174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:12150 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.453 [2024-11-20 01:30:51.508203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0043 p:0 m:0 dnr:0 00:29:43.453 [2024-11-20 01:30:51.521361] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190f4298 00:29:43.453 [2024-11-20 01:30:51.522245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:8711 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.453 [2024-11-20 01:30:51.522272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0043 p:0 m:0 dnr:0 00:29:43.453 [2024-11-20 01:30:51.533052] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190ee5c8 00:29:43.453 [2024-11-20 01:30:51.534432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:9488 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.453 [2024-11-20 01:30:51.534463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:29:43.453 [2024-11-20 01:30:51.545484] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190e3d08 00:29:43.453 [2024-11-20 01:30:51.546771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:22252 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.453 [2024-11-20 01:30:51.546806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0045 p:0 m:0 dnr:0 00:29:43.453 [2024-11-20 01:30:51.558026] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190e01f8 00:29:43.453 [2024-11-20 01:30:51.558849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:1620 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.453 [2024-11-20 01:30:51.558881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0055 p:0 m:0 dnr:0 00:29:43.453 [2024-11-20 01:30:51.570466] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190e5ec8 00:29:43.453 [2024-11-20 01:30:51.570981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:23471 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.453 [2024-11-20 01:30:51.571013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0054 p:0 m:0 dnr:0 00:29:43.453 [2024-11-20 01:30:51.582774] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190f8a50 00:29:43.453 [2024-11-20 01:30:51.583268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:24650 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.453 [2024-11-20 01:30:51.583295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0053 p:0 m:0 dnr:0 00:29:43.453 [2024-11-20 01:30:51.594984] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190fb480 00:29:43.454 [2024-11-20 01:30:51.595426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:22132 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.454 [2024-11-20 01:30:51.595458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0052 p:0 m:0 dnr:0 00:29:43.454 [2024-11-20 01:30:51.607228] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190e4578 00:29:43.454 [2024-11-20 01:30:51.607604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:6235 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.454 [2024-11-20 01:30:51.607636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0051 p:0 m:0 dnr:0 00:29:43.454 [2024-11-20 01:30:51.621204] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190e3d08 00:29:43.454 [2024-11-20 01:30:51.622616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:630 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.454 [2024-11-20 01:30:51.622648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:29:43.454 [2024-11-20 01:30:51.631817] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190f7538 00:29:43.454 [2024-11-20 01:30:51.632107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:3454 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.454 [2024-11-20 01:30:51.632153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:004e p:0 m:0 dnr:0 00:29:43.454 [2024-11-20 01:30:51.643882] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190f6458 00:29:43.454 [2024-11-20 01:30:51.644206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:17077 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.454 [2024-11-20 01:30:51.644236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:004d p:0 m:0 dnr:0 00:29:43.454 [2024-11-20 01:30:51.656351] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190fd208 00:29:43.454 [2024-11-20 01:30:51.657014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:23660 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.454 [2024-11-20 01:30:51.657046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:29:43.454 [2024-11-20 01:30:51.668985] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190e7818 00:29:43.712 [2024-11-20 01:30:51.669784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:7081 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.712 [2024-11-20 01:30:51.669817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:29:43.712 [2024-11-20 01:30:51.681424] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190ed920 00:29:43.712 [2024-11-20 01:30:51.681929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:2760 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.712 [2024-11-20 01:30:51.681961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:005e p:0 m:0 dnr:0 00:29:43.712 [2024-11-20 01:30:51.693626] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190fb480 00:29:43.712 [2024-11-20 01:30:51.695115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:23538 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.713 [2024-11-20 01:30:51.695175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:005e p:0 m:0 dnr:0 00:29:43.713 [2024-11-20 01:30:51.705764] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190ee190 00:29:43.713 [2024-11-20 01:30:51.707173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:14680 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.713 [2024-11-20 01:30:51.707216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:005d p:0 m:0 dnr:0 00:29:43.713 [2024-11-20 01:30:51.717875] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190f1ca0 00:29:43.713 [2024-11-20 01:30:51.718888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:9222 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.713 [2024-11-20 01:30:51.718920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:003f p:0 m:0 dnr:0 00:29:43.713 [2024-11-20 01:30:51.730328] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190ea680 00:29:43.713 [2024-11-20 01:30:51.731600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:5424 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.713 [2024-11-20 01:30:51.731632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:004f p:0 m:0 dnr:0 00:29:43.713 [2024-11-20 01:30:51.742949] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190f9f68 00:29:43.713 [2024-11-20 01:30:51.743318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:20706 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.713 [2024-11-20 01:30:51.743346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:004e p:0 m:0 dnr:0 00:29:43.713 [2024-11-20 01:30:51.755560] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190eaef0 00:29:43.713 [2024-11-20 01:30:51.756155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:19427 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.713 [2024-11-20 01:30:51.756183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:005e p:0 m:0 dnr:0 00:29:43.713 [2024-11-20 01:30:51.767718] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190ea248 00:29:43.713 [2024-11-20 01:30:51.768237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:2491 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.713 [2024-11-20 01:30:51.768265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:005d p:0 m:0 dnr:0 00:29:43.713 [2024-11-20 01:30:51.780031] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190fc560 00:29:43.713 [2024-11-20 01:30:51.780563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:9905 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.713 [2024-11-20 01:30:51.780596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:29:43.713 [2024-11-20 01:30:51.792289] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190e7c50 00:29:43.713 [2024-11-20 01:30:51.792739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:12458 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.713 [2024-11-20 01:30:51.792771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:005b p:0 m:0 dnr:0 00:29:43.713 [2024-11-20 01:30:51.804395] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190f0350 00:29:43.713 [2024-11-20 01:30:51.804803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:2236 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.713 [2024-11-20 01:30:51.804835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:005a p:0 m:0 dnr:0 00:29:43.713 [2024-11-20 01:30:51.816982] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190e27f0 00:29:43.713 [2024-11-20 01:30:51.817368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:13923 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.713 [2024-11-20 01:30:51.817406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0059 p:0 m:0 dnr:0 00:29:43.713 [2024-11-20 01:30:51.829377] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190e4140 00:29:43.713 [2024-11-20 01:30:51.829723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:8243 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.713 [2024-11-20 01:30:51.829755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0058 p:0 m:0 dnr:0 00:29:43.713 [2024-11-20 01:30:51.841727] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190e12d8 00:29:43.713 [2024-11-20 01:30:51.842037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:224 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.713 [2024-11-20 01:30:51.842078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0057 p:0 m:0 dnr:0 00:29:43.713 [2024-11-20 01:30:51.854006] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190e0630 00:29:43.713 [2024-11-20 01:30:51.854335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:3718 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.713 [2024-11-20 01:30:51.854369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:32 cdw0:0 sqhd:0056 p:0 m:0 dnr:0 00:29:43.713 [2024-11-20 01:30:51.866641] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190fef90 00:29:43.713 [2024-11-20 01:30:51.867927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:4366 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.713 [2024-11-20 01:30:51.867967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:29:43.713 [2024-11-20 01:30:51.878725] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190e99d8 00:29:43.713 [2024-11-20 01:30:51.880452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:20369 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.713 [2024-11-20 01:30:51.880485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0055 p:0 m:0 dnr:0 00:29:43.713 [2024-11-20 01:30:51.893204] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190fb480 00:29:43.713 [2024-11-20 01:30:51.895014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9096 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.713 [2024-11-20 01:30:51.895043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:29:43.713 [2024-11-20 01:30:51.905602] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190e3060 00:29:43.713 [2024-11-20 01:30:51.906457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:13265 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.713 [2024-11-20 01:30:51.906489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:29:43.713 [2024-11-20 01:30:51.916267] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190fef90 00:29:43.713 [2024-11-20 01:30:51.917730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:17466 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.713 [2024-11-20 01:30:51.917763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:29:43.713 [2024-11-20 01:30:51.928791] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190f4298 00:29:43.972 [2024-11-20 01:30:51.930583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:403 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.972 [2024-11-20 01:30:51.930616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:29:43.972 [2024-11-20 01:30:51.941117] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190e6738 00:29:43.972 [2024-11-20 01:30:51.942333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:4377 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.972 [2024-11-20 01:30:51.942360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0079 p:0 m:0 dnr:0 00:29:43.972 [2024-11-20 01:30:51.954839] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190e84c0 00:29:43.972 [2024-11-20 01:30:51.955754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:15647 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.972 [2024-11-20 01:30:51.955786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.972 [2024-11-20 01:30:51.967179] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190fd208 00:29:43.972 [2024-11-20 01:30:51.968091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:5074 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.972 [2024-11-20 01:30:51.968139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:43.972 [2024-11-20 01:30:51.979254] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190ed0b0 00:29:43.972 [2024-11-20 01:30:51.981081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:15347 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.972 [2024-11-20 01:30:51.981142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:43.972 [2024-11-20 01:30:51.991454] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190fda78 00:29:43.972 [2024-11-20 01:30:51.992696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:22136 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.972 [2024-11-20 01:30:51.992728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:43.972 [2024-11-20 01:30:52.004733] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190eee38 00:29:43.972 [2024-11-20 01:30:52.005681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:739 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.972 [2024-11-20 01:30:52.005713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:43.972 [2024-11-20 01:30:52.015471] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190e1f80 00:29:43.972 [2024-11-20 01:30:52.016621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:25397 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.973 [2024-11-20 01:30:52.016654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:43.973 [2024-11-20 01:30:52.027651] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190e1f80 00:29:43.973 [2024-11-20 01:30:52.029204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:14170 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.973 [2024-11-20 01:30:52.029232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:43.973 [2024-11-20 01:30:52.039327] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190efae0 00:29:43.973 [2024-11-20 01:30:52.040465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:5882 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.973 [2024-11-20 01:30:52.040507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:004a p:0 m:0 dnr:0 00:29:43.973 [2024-11-20 01:30:52.051592] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190fc128 00:29:43.973 [2024-11-20 01:30:52.052965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:22397 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.973 [2024-11-20 01:30:52.052994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0049 p:0 m:0 dnr:0 00:29:43.973 [2024-11-20 01:30:52.063901] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190e1710 00:29:43.973 [2024-11-20 01:30:52.065041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:3888 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.973 [2024-11-20 01:30:52.065083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0048 p:0 m:0 dnr:0 00:29:43.973 [2024-11-20 01:30:52.076311] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190f46d0 00:29:43.973 [2024-11-20 01:30:52.077468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:2403 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.973 [2024-11-20 01:30:52.077517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0047 p:0 m:0 dnr:0 00:29:43.973 [2024-11-20 01:30:52.088595] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190f7538 00:29:43.973 [2024-11-20 01:30:52.090014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:22117 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.973 [2024-11-20 01:30:52.090047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0046 p:0 m:0 dnr:0 00:29:43.973 [2024-11-20 01:30:52.102758] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190f8a50 00:29:43.973 [2024-11-20 01:30:52.104524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24895 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.973 [2024-11-20 01:30:52.104568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:29:43.973 [2024-11-20 01:30:52.113503] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190e5220 00:29:43.973 [2024-11-20 01:30:52.114554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:9216 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.973 [2024-11-20 01:30:52.114587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:29:43.973 [2024-11-20 01:30:52.125559] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190dece0 00:29:43.973 [2024-11-20 01:30:52.127061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:16022 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.973 [2024-11-20 01:30:52.127101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:32 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:29:43.973 [2024-11-20 01:30:52.138592] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190fa3a0 00:29:43.973 [2024-11-20 01:30:52.140295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:18159 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.973 [2024-11-20 01:30:52.140324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.973 [2024-11-20 01:30:52.149514] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190e23b8 00:29:43.973 [2024-11-20 01:30:52.150532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:14442 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.973 [2024-11-20 01:30:52.150564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:003f p:0 m:0 dnr:0 00:29:43.973 [2024-11-20 01:30:52.161808] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190e4578 00:29:43.973 [2024-11-20 01:30:52.162856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:21333 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.973 [2024-11-20 01:30:52.162889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:003e p:0 m:0 dnr:0 00:29:43.973 [2024-11-20 01:30:52.174076] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190f7da8 00:29:43.973 [2024-11-20 01:30:52.175198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:4205 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.973 [2024-11-20 01:30:52.175240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:003d p:0 m:0 dnr:0 00:29:43.973 [2024-11-20 01:30:52.186473] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190fe2e8 00:29:43.973 [2024-11-20 01:30:52.187529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:3901 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.973 [2024-11-20 01:30:52.187581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:003c p:0 m:0 dnr:0 00:29:44.232 [2024-11-20 01:30:52.199278] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190ea680 00:29:44.232 [2024-11-20 01:30:52.199992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:2353 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.232 [2024-11-20 01:30:52.200023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:004c p:0 m:0 dnr:0 00:29:44.232 [2024-11-20 01:30:52.211305] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190ebfd0 00:29:44.232 [2024-11-20 01:30:52.211721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:23114 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.232 [2024-11-20 01:30:52.211754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:004b p:0 m:0 dnr:0 00:29:44.232 [2024-11-20 01:30:52.223732] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190f2510 00:29:44.232 [2024-11-20 01:30:52.224098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:21330 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.232 [2024-11-20 01:30:52.224144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:004a p:0 m:0 dnr:0 00:29:44.232 [2024-11-20 01:30:52.236139] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190e4140 00:29:44.232 [2024-11-20 01:30:52.236441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:12388 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.232 [2024-11-20 01:30:52.236473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0049 p:0 m:0 dnr:0 00:29:44.232 [2024-11-20 01:30:52.250388] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190fa3a0 00:29:44.232 [2024-11-20 01:30:52.252169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:8627 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.232 [2024-11-20 01:30:52.252225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.232 [2024-11-20 01:30:52.262785] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190eaef0 00:29:44.232 [2024-11-20 01:30:52.264826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:3949 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.232 [2024-11-20 01:30:52.264863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:44.232 [2024-11-20 01:30:52.275035] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190ea680 00:29:44.232 [2024-11-20 01:30:52.276869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:24734 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.232 [2024-11-20 01:30:52.276902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:44.232 [2024-11-20 01:30:52.287680] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190e38d0 00:29:44.232 [2024-11-20 01:30:52.289591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:3050 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.232 [2024-11-20 01:30:52.289636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:44.232 [2024-11-20 01:30:52.300002] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190e8088 00:29:44.232 [2024-11-20 01:30:52.301901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:6147 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.232 [2024-11-20 01:30:52.301940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:44.232 [2024-11-20 01:30:52.312247] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190ea248 00:29:44.232 [2024-11-20 01:30:52.313937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:21692 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.232 [2024-11-20 01:30:52.313969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:44.232 [2024-11-20 01:30:52.324517] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190fbcf0 00:29:44.232 [2024-11-20 01:30:52.326237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:8348 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.232 [2024-11-20 01:30:52.326306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:44.232 [2024-11-20 01:30:52.336835] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190f46d0 00:29:44.232 [2024-11-20 01:30:52.338620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:21958 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.232 [2024-11-20 01:30:52.338649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:44.232 [2024-11-20 01:30:52.347775] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190eea00 00:29:44.232 [2024-11-20 01:30:52.348789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:2082 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.232 [2024-11-20 01:30:52.348821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0079 p:0 m:0 dnr:0 00:29:44.232 [2024-11-20 01:30:52.359910] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190f5be8 00:29:44.232 [2024-11-20 01:30:52.361440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:24996 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.232 [2024-11-20 01:30:52.361472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:44.232 [2024-11-20 01:30:52.371803] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190e12d8 00:29:44.232 [2024-11-20 01:30:52.372885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:5250 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.232 [2024-11-20 01:30:52.372917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0046 p:0 m:0 dnr:0 00:29:44.232 [2024-11-20 01:30:52.384142] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190fb480 00:29:44.232 [2024-11-20 01:30:52.385238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:5722 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.232 [2024-11-20 01:30:52.385280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0045 p:0 m:0 dnr:0 00:29:44.232 [2024-11-20 01:30:52.396554] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190f46d0 00:29:44.232 [2024-11-20 01:30:52.397648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:8707 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.232 [2024-11-20 01:30:52.397680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0044 p:0 m:0 dnr:0 00:29:44.232 [2024-11-20 01:30:52.408744] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190fbcf0 00:29:44.232 [2024-11-20 01:30:52.409871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:9475 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.232 [2024-11-20 01:30:52.409903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0043 p:0 m:0 dnr:0 00:29:44.232 [2024-11-20 01:30:52.420918] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190f0350 00:29:44.232 [2024-11-20 01:30:52.422062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:19580 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.232 [2024-11-20 01:30:52.422098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0042 p:0 m:0 dnr:0 00:29:44.232 [2024-11-20 01:30:52.433299] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190e4578 00:29:44.232 [2024-11-20 01:30:52.434466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:6271 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.232 [2024-11-20 01:30:52.434499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.232 [2024-11-20 01:30:52.445627] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190e8088 00:29:44.232 [2024-11-20 01:30:52.446782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:11142 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.232 [2024-11-20 01:30:52.446811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0040 p:0 m:0 dnr:0 00:29:44.491 [2024-11-20 01:30:52.458339] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190e73e0 00:29:44.491 [2024-11-20 01:30:52.459083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:18214 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.491 [2024-11-20 01:30:52.459126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0050 p:0 m:0 dnr:0 00:29:44.491 [2024-11-20 01:30:52.470658] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190e9168 00:29:44.491 [2024-11-20 01:30:52.471026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:19876 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.491 [2024-11-20 01:30:52.471059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:004f p:0 m:0 dnr:0 00:29:44.491 [2024-11-20 01:30:52.483085] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190f5be8 00:29:44.491 [2024-11-20 01:30:52.483517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:15224 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.491 [2024-11-20 01:30:52.483549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:004e p:0 m:0 dnr:0 00:29:44.491 [2024-11-20 01:30:52.495474] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190e9168 00:29:44.491 [2024-11-20 01:30:52.495779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:13948 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.491 [2024-11-20 01:30:52.495812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:004d p:0 m:0 dnr:0 00:29:44.491 [2024-11-20 01:30:52.507661] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190e73e0 00:29:44.491 [2024-11-20 01:30:52.507928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:10186 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.491 [2024-11-20 01:30:52.507960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:004c p:0 m:0 dnr:0 00:29:44.491 [2024-11-20 01:30:52.521928] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190f0788 00:29:44.491 [2024-11-20 01:30:52.523665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:15363 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.491 [2024-11-20 01:30:52.523698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:44.491 [2024-11-20 01:30:52.534341] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190f0350 00:29:44.491 [2024-11-20 01:30:52.536232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:1275 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.491 [2024-11-20 01:30:52.536262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:44.491 [2024-11-20 01:30:52.545353] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190f35f0 00:29:44.491 [2024-11-20 01:30:52.546641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:24233 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.491 [2024-11-20 01:30:52.546674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:44.491 [2024-11-20 01:30:52.558544] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190ff3c8 00:29:44.491 [2024-11-20 01:30:52.559917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:4126 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.491 [2024-11-20 01:30:52.559950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:44.491 [2024-11-20 01:30:52.571001] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190efae0 00:29:44.491 [2024-11-20 01:30:52.572401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:15505 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.491 [2024-11-20 01:30:52.572434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:44.491 [2024-11-20 01:30:52.583556] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190e5658 00:29:44.491 [2024-11-20 01:30:52.585038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:14127 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.491 [2024-11-20 01:30:52.585084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:44.491 [2024-11-20 01:30:52.596064] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190e38d0 00:29:44.491 [2024-11-20 01:30:52.597542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14268 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.491 [2024-11-20 01:30:52.597574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.491 [2024-11-20 01:30:52.606875] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190f57b0 00:29:44.491 [2024-11-20 01:30:52.607835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:5311 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.491 [2024-11-20 01:30:52.607867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0059 p:0 m:0 dnr:0 00:29:44.491 [2024-11-20 01:30:52.619331] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190de038 00:29:44.491 [2024-11-20 01:30:52.620317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:12088 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.491 [2024-11-20 01:30:52.620364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:005a p:0 m:0 dnr:0 00:29:44.492 [2024-11-20 01:30:52.633564] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190ef6a8 00:29:44.492 [2024-11-20 01:30:52.634996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:13992 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.492 [2024-11-20 01:30:52.635028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.492 [2024-11-20 01:30:52.644350] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190f57b0 00:29:44.492 [2024-11-20 01:30:52.645347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:9047 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.492 [2024-11-20 01:30:52.645375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:005b p:0 m:0 dnr:0 00:29:44.492 [2024-11-20 01:30:52.656997] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190ea248 00:29:44.492 [2024-11-20 01:30:52.658230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:8122 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.492 [2024-11-20 01:30:52.658259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:29:44.492 [2024-11-20 01:30:52.669424] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190ea248 00:29:44.492 [2024-11-20 01:30:52.670458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:20692 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.492 [2024-11-20 01:30:52.670490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:005d p:0 m:0 dnr:0 00:29:44.492 [2024-11-20 01:30:52.681950] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190ea248 00:29:44.492 [2024-11-20 01:30:52.683224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:15468 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.492 [2024-11-20 01:30:52.683253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:005e p:0 m:0 dnr:0 00:29:44.492 [2024-11-20 01:30:52.694484] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190ea248 00:29:44.492 [2024-11-20 01:30:52.695535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:24331 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.492 [2024-11-20 01:30:52.695566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:29:44.492 [2024-11-20 01:30:52.707165] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190fd640 00:29:44.750 [2024-11-20 01:30:52.707671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:24205 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.750 [2024-11-20 01:30:52.707702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:29:44.750 [2024-11-20 01:30:52.719689] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190ea248 00:29:44.750 [2024-11-20 01:30:52.720101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:21804 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.750 [2024-11-20 01:30:52.720148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0059 p:0 m:0 dnr:0 00:29:44.750 [2024-11-20 01:30:52.733280] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190e5ec8 00:29:44.750 [2024-11-20 01:30:52.734669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:19440 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.750 [2024-11-20 01:30:52.734701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.750 [2024-11-20 01:30:52.743607] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190feb58 00:29:44.750 [2024-11-20 01:30:52.744228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:13916 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.750 [2024-11-20 01:30:52.744256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:0033 p:0 m:0 dnr:0 00:29:44.750 [2024-11-20 01:30:52.759285] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449920) with pdu=0x2000190feb58 00:29:44.750 [2024-11-20 01:30:52.760445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:2084 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.750 [2024-11-20 01:30:52.760476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:29:44.750 00:29:44.750 Latency(us) 00:29:44.750 [2024-11-20T00:30:52.969Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:44.750 [2024-11-20T00:30:52.969Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:29:44.750 nvme0n1 : 2.00 20983.84 81.97 0.00 0.00 6093.50 2888.44 14951.92 00:29:44.750 [2024-11-20T00:30:52.969Z] =================================================================================================================== 00:29:44.750 [2024-11-20T00:30:52.970Z] Total : 20983.84 81.97 0.00 0.00 6093.50 2888.44 14951.92 00:29:44.751 0 00:29:44.751 01:30:52 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:29:44.751 01:30:52 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:29:44.751 01:30:52 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:29:44.751 01:30:52 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:29:44.751 | .driver_specific 00:29:44.751 | .nvme_error 00:29:44.751 | .status_code 00:29:44.751 | .command_transient_transport_error' 00:29:45.009 01:30:53 -- host/digest.sh@71 -- # (( 164 > 0 )) 00:29:45.009 01:30:53 -- host/digest.sh@73 -- # killprocess 1264985 00:29:45.009 01:30:53 -- common/autotest_common.sh@936 -- # '[' -z 1264985 ']' 00:29:45.009 01:30:53 -- common/autotest_common.sh@940 -- # kill -0 1264985 00:29:45.009 01:30:53 -- common/autotest_common.sh@941 -- # uname 00:29:45.009 01:30:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:45.009 01:30:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1264985 00:29:45.009 01:30:53 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:45.009 01:30:53 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:45.009 01:30:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1264985' 00:29:45.009 killing process with pid 1264985 00:29:45.009 01:30:53 -- common/autotest_common.sh@955 -- # kill 1264985 00:29:45.009 Received shutdown signal, test time was about 2.000000 seconds 00:29:45.009 00:29:45.009 Latency(us) 00:29:45.009 [2024-11-20T00:30:53.228Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:45.009 [2024-11-20T00:30:53.228Z] =================================================================================================================== 00:29:45.009 [2024-11-20T00:30:53.228Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:45.009 01:30:53 -- common/autotest_common.sh@960 -- # wait 1264985 00:29:45.267 01:30:53 -- host/digest.sh@114 -- # run_bperf_err randwrite 131072 16 00:29:45.267 01:30:53 -- host/digest.sh@54 -- # local rw bs qd 00:29:45.267 01:30:53 -- host/digest.sh@56 -- # rw=randwrite 00:29:45.267 01:30:53 -- host/digest.sh@56 -- # bs=131072 00:29:45.267 01:30:53 -- host/digest.sh@56 -- # qd=16 00:29:45.267 01:30:53 -- host/digest.sh@58 -- # bperfpid=1265534 00:29:45.267 01:30:53 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z 00:29:45.267 01:30:53 -- host/digest.sh@60 -- # waitforlisten 1265534 /var/tmp/bperf.sock 00:29:45.267 01:30:53 -- common/autotest_common.sh@829 -- # '[' -z 1265534 ']' 00:29:45.267 01:30:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:45.267 01:30:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:45.267 01:30:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:45.267 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:45.267 01:30:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:45.267 01:30:53 -- common/autotest_common.sh@10 -- # set +x 00:29:45.267 [2024-11-20 01:30:53.362276] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:45.267 [2024-11-20 01:30:53.362352] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1265534 ] 00:29:45.267 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:45.267 Zero copy mechanism will not be used. 00:29:45.267 EAL: No free 2048 kB hugepages reported on node 1 00:29:45.267 [2024-11-20 01:30:53.423624] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:45.525 [2024-11-20 01:30:53.510205] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:46.459 01:30:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:46.459 01:30:54 -- common/autotest_common.sh@862 -- # return 0 00:29:46.459 01:30:54 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:46.459 01:30:54 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:46.459 01:30:54 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:29:46.459 01:30:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:46.459 01:30:54 -- common/autotest_common.sh@10 -- # set +x 00:29:46.459 01:30:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:46.459 01:30:54 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:46.459 01:30:54 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:47.025 nvme0n1 00:29:47.025 01:30:55 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:29:47.025 01:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:47.025 01:30:55 -- common/autotest_common.sh@10 -- # set +x 00:29:47.025 01:30:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:47.025 01:30:55 -- host/digest.sh@69 -- # bperf_py perform_tests 00:29:47.025 01:30:55 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:47.285 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:47.285 Zero copy mechanism will not be used. 00:29:47.285 Running I/O for 2 seconds... 00:29:47.285 [2024-11-20 01:30:55.256161] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.285 [2024-11-20 01:30:55.256504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.285 [2024-11-20 01:30:55.256555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.285 [2024-11-20 01:30:55.261232] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.285 [2024-11-20 01:30:55.261388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.285 [2024-11-20 01:30:55.261437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.285 [2024-11-20 01:30:55.266021] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.285 [2024-11-20 01:30:55.266203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.285 [2024-11-20 01:30:55.266237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.285 [2024-11-20 01:30:55.270628] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.285 [2024-11-20 01:30:55.270746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.285 [2024-11-20 01:30:55.270783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.285 [2024-11-20 01:30:55.275285] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.285 [2024-11-20 01:30:55.275443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.285 [2024-11-20 01:30:55.275475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.285 [2024-11-20 01:30:55.279845] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.285 [2024-11-20 01:30:55.279957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.285 [2024-11-20 01:30:55.279988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.285 [2024-11-20 01:30:55.284512] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.285 [2024-11-20 01:30:55.284679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.285 [2024-11-20 01:30:55.284710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.285 [2024-11-20 01:30:55.289284] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.285 [2024-11-20 01:30:55.289559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.285 [2024-11-20 01:30:55.289592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.285 [2024-11-20 01:30:55.293850] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.285 [2024-11-20 01:30:55.294120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.285 [2024-11-20 01:30:55.294156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.285 [2024-11-20 01:30:55.298462] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.285 [2024-11-20 01:30:55.298664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.285 [2024-11-20 01:30:55.298701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.285 [2024-11-20 01:30:55.303083] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.285 [2024-11-20 01:30:55.303238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.285 [2024-11-20 01:30:55.303271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.285 [2024-11-20 01:30:55.307632] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.285 [2024-11-20 01:30:55.307779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.285 [2024-11-20 01:30:55.307816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.285 [2024-11-20 01:30:55.312172] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.285 [2024-11-20 01:30:55.312310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.285 [2024-11-20 01:30:55.312344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.286 [2024-11-20 01:30:55.316780] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.286 [2024-11-20 01:30:55.316970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.286 [2024-11-20 01:30:55.317007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.286 [2024-11-20 01:30:55.321326] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.286 [2024-11-20 01:30:55.321538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.286 [2024-11-20 01:30:55.321575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.286 [2024-11-20 01:30:55.326017] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.286 [2024-11-20 01:30:55.326277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.286 [2024-11-20 01:30:55.326307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.286 [2024-11-20 01:30:55.330671] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.286 [2024-11-20 01:30:55.330853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.286 [2024-11-20 01:30:55.330890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.286 [2024-11-20 01:30:55.336242] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.286 [2024-11-20 01:30:55.336443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.286 [2024-11-20 01:30:55.336476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.286 [2024-11-20 01:30:55.340700] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.286 [2024-11-20 01:30:55.340845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.286 [2024-11-20 01:30:55.340878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.286 [2024-11-20 01:30:55.345197] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.286 [2024-11-20 01:30:55.345296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.286 [2024-11-20 01:30:55.345329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.286 [2024-11-20 01:30:55.349792] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.286 [2024-11-20 01:30:55.349936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.286 [2024-11-20 01:30:55.349968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.286 [2024-11-20 01:30:55.354318] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.286 [2024-11-20 01:30:55.354519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.286 [2024-11-20 01:30:55.354551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.286 [2024-11-20 01:30:55.359949] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.286 [2024-11-20 01:30:55.360135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.286 [2024-11-20 01:30:55.360170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.286 [2024-11-20 01:30:55.365612] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.286 [2024-11-20 01:30:55.365895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.286 [2024-11-20 01:30:55.365927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.286 [2024-11-20 01:30:55.371875] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.286 [2024-11-20 01:30:55.372183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.286 [2024-11-20 01:30:55.372212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.286 [2024-11-20 01:30:55.377232] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.286 [2024-11-20 01:30:55.377492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.286 [2024-11-20 01:30:55.377533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.286 [2024-11-20 01:30:55.382329] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.286 [2024-11-20 01:30:55.382520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.286 [2024-11-20 01:30:55.382551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.286 [2024-11-20 01:30:55.387807] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.286 [2024-11-20 01:30:55.387998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.286 [2024-11-20 01:30:55.388037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.286 [2024-11-20 01:30:55.393163] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.286 [2024-11-20 01:30:55.393402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.286 [2024-11-20 01:30:55.393431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.286 [2024-11-20 01:30:55.398197] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.286 [2024-11-20 01:30:55.398358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.286 [2024-11-20 01:30:55.398403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.286 [2024-11-20 01:30:55.403484] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.286 [2024-11-20 01:30:55.403718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.286 [2024-11-20 01:30:55.403751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.286 [2024-11-20 01:30:55.408355] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.286 [2024-11-20 01:30:55.408634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.286 [2024-11-20 01:30:55.408666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.286 [2024-11-20 01:30:55.412907] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.286 [2024-11-20 01:30:55.413097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.286 [2024-11-20 01:30:55.413148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.286 [2024-11-20 01:30:55.417368] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.286 [2024-11-20 01:30:55.417533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.286 [2024-11-20 01:30:55.417571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.286 [2024-11-20 01:30:55.422088] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.286 [2024-11-20 01:30:55.422266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.286 [2024-11-20 01:30:55.422296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.286 [2024-11-20 01:30:55.426665] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.286 [2024-11-20 01:30:55.426786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.286 [2024-11-20 01:30:55.426818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.286 [2024-11-20 01:30:55.431215] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.286 [2024-11-20 01:30:55.431352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.287 [2024-11-20 01:30:55.431397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.287 [2024-11-20 01:30:55.435789] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.287 [2024-11-20 01:30:55.436033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.287 [2024-11-20 01:30:55.436065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.287 [2024-11-20 01:30:55.440746] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.287 [2024-11-20 01:30:55.440934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.287 [2024-11-20 01:30:55.440966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.287 [2024-11-20 01:30:55.445940] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.287 [2024-11-20 01:30:55.446235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.287 [2024-11-20 01:30:55.446265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.287 [2024-11-20 01:30:55.451079] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.287 [2024-11-20 01:30:55.451334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.287 [2024-11-20 01:30:55.451385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.287 [2024-11-20 01:30:55.456944] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.287 [2024-11-20 01:30:55.457163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.287 [2024-11-20 01:30:55.457193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.287 [2024-11-20 01:30:55.462785] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.287 [2024-11-20 01:30:55.462967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.287 [2024-11-20 01:30:55.463007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.287 [2024-11-20 01:30:55.468053] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.287 [2024-11-20 01:30:55.468249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.287 [2024-11-20 01:30:55.468279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.287 [2024-11-20 01:30:55.473814] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.287 [2024-11-20 01:30:55.474027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.287 [2024-11-20 01:30:55.474059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.287 [2024-11-20 01:30:55.479214] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.287 [2024-11-20 01:30:55.479443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.287 [2024-11-20 01:30:55.479480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.287 [2024-11-20 01:30:55.484369] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.287 [2024-11-20 01:30:55.484573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.287 [2024-11-20 01:30:55.484605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.287 [2024-11-20 01:30:55.490126] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.287 [2024-11-20 01:30:55.490407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.287 [2024-11-20 01:30:55.490444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.287 [2024-11-20 01:30:55.495699] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.287 [2024-11-20 01:30:55.495902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.287 [2024-11-20 01:30:55.495934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.546 [2024-11-20 01:30:55.501193] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.546 [2024-11-20 01:30:55.501448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.546 [2024-11-20 01:30:55.501481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.546 [2024-11-20 01:30:55.506481] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.546 [2024-11-20 01:30:55.506717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.546 [2024-11-20 01:30:55.506756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.546 [2024-11-20 01:30:55.512154] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.546 [2024-11-20 01:30:55.512308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.546 [2024-11-20 01:30:55.512338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.546 [2024-11-20 01:30:55.517973] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.546 [2024-11-20 01:30:55.518202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.546 [2024-11-20 01:30:55.518232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.546 [2024-11-20 01:30:55.523443] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.546 [2024-11-20 01:30:55.523645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.546 [2024-11-20 01:30:55.523685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.546 [2024-11-20 01:30:55.528958] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.546 [2024-11-20 01:30:55.529178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.546 [2024-11-20 01:30:55.529208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.546 [2024-11-20 01:30:55.534375] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.546 [2024-11-20 01:30:55.534590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.547 [2024-11-20 01:30:55.534623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.547 [2024-11-20 01:30:55.539900] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.547 [2024-11-20 01:30:55.540186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.547 [2024-11-20 01:30:55.540216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.547 [2024-11-20 01:30:55.545477] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.547 [2024-11-20 01:30:55.545684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.547 [2024-11-20 01:30:55.545720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.547 [2024-11-20 01:30:55.551090] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.547 [2024-11-20 01:30:55.551278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.547 [2024-11-20 01:30:55.551307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.547 [2024-11-20 01:30:55.556691] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.547 [2024-11-20 01:30:55.556860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.547 [2024-11-20 01:30:55.556896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.547 [2024-11-20 01:30:55.562337] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.547 [2024-11-20 01:30:55.562538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.547 [2024-11-20 01:30:55.562571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.547 [2024-11-20 01:30:55.567660] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.547 [2024-11-20 01:30:55.567851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.547 [2024-11-20 01:30:55.567883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.547 [2024-11-20 01:30:55.573110] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.547 [2024-11-20 01:30:55.573289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.547 [2024-11-20 01:30:55.573317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.547 [2024-11-20 01:30:55.578696] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.547 [2024-11-20 01:30:55.578890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.547 [2024-11-20 01:30:55.578925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.547 [2024-11-20 01:30:55.584187] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.547 [2024-11-20 01:30:55.584323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.547 [2024-11-20 01:30:55.584361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.547 [2024-11-20 01:30:55.589606] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.547 [2024-11-20 01:30:55.589769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.547 [2024-11-20 01:30:55.589801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.547 [2024-11-20 01:30:55.595170] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.547 [2024-11-20 01:30:55.595343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.547 [2024-11-20 01:30:55.595388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.547 [2024-11-20 01:30:55.600558] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.547 [2024-11-20 01:30:55.600725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.547 [2024-11-20 01:30:55.600757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.547 [2024-11-20 01:30:55.606254] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.547 [2024-11-20 01:30:55.606533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.547 [2024-11-20 01:30:55.606570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.547 [2024-11-20 01:30:55.611686] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.547 [2024-11-20 01:30:55.611979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.547 [2024-11-20 01:30:55.612011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.547 [2024-11-20 01:30:55.617283] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.547 [2024-11-20 01:30:55.617533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.547 [2024-11-20 01:30:55.617566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.547 [2024-11-20 01:30:55.622572] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.547 [2024-11-20 01:30:55.622834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.547 [2024-11-20 01:30:55.622866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.547 [2024-11-20 01:30:55.627985] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.547 [2024-11-20 01:30:55.628136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.547 [2024-11-20 01:30:55.628165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.547 [2024-11-20 01:30:55.633269] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.547 [2024-11-20 01:30:55.633456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.547 [2024-11-20 01:30:55.633487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.547 [2024-11-20 01:30:55.638715] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.547 [2024-11-20 01:30:55.638978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.547 [2024-11-20 01:30:55.639007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.547 [2024-11-20 01:30:55.643981] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.547 [2024-11-20 01:30:55.644184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.547 [2024-11-20 01:30:55.644219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.547 [2024-11-20 01:30:55.649618] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.547 [2024-11-20 01:30:55.649863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.548 [2024-11-20 01:30:55.649895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.548 [2024-11-20 01:30:55.655140] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.548 [2024-11-20 01:30:55.655398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.548 [2024-11-20 01:30:55.655427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.548 [2024-11-20 01:30:55.660500] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.548 [2024-11-20 01:30:55.660785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.548 [2024-11-20 01:30:55.660818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.548 [2024-11-20 01:30:55.665861] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.548 [2024-11-20 01:30:55.666081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.548 [2024-11-20 01:30:55.666119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.548 [2024-11-20 01:30:55.671372] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.548 [2024-11-20 01:30:55.671558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.548 [2024-11-20 01:30:55.671590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.548 [2024-11-20 01:30:55.676808] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.548 [2024-11-20 01:30:55.677104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.548 [2024-11-20 01:30:55.677134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.548 [2024-11-20 01:30:55.682339] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.548 [2024-11-20 01:30:55.682551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.548 [2024-11-20 01:30:55.682583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.548 [2024-11-20 01:30:55.687793] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.548 [2024-11-20 01:30:55.687986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.548 [2024-11-20 01:30:55.688019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.548 [2024-11-20 01:30:55.693214] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.548 [2024-11-20 01:30:55.693427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.548 [2024-11-20 01:30:55.693460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.548 [2024-11-20 01:30:55.698819] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.548 [2024-11-20 01:30:55.699170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.548 [2024-11-20 01:30:55.699200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.548 [2024-11-20 01:30:55.704769] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.548 [2024-11-20 01:30:55.705049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.548 [2024-11-20 01:30:55.705093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.548 [2024-11-20 01:30:55.710137] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.548 [2024-11-20 01:30:55.710353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.548 [2024-11-20 01:30:55.710406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.548 [2024-11-20 01:30:55.715721] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.548 [2024-11-20 01:30:55.715890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.548 [2024-11-20 01:30:55.715922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.548 [2024-11-20 01:30:55.720980] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.548 [2024-11-20 01:30:55.721122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.548 [2024-11-20 01:30:55.721166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.548 [2024-11-20 01:30:55.726522] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.548 [2024-11-20 01:30:55.726681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.548 [2024-11-20 01:30:55.726713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.548 [2024-11-20 01:30:55.731924] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.548 [2024-11-20 01:30:55.732178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.548 [2024-11-20 01:30:55.732207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.548 [2024-11-20 01:30:55.737943] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.548 [2024-11-20 01:30:55.738249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.548 [2024-11-20 01:30:55.738279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.548 [2024-11-20 01:30:55.743506] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.548 [2024-11-20 01:30:55.743881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.548 [2024-11-20 01:30:55.743926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.548 [2024-11-20 01:30:55.749215] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.548 [2024-11-20 01:30:55.749426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.548 [2024-11-20 01:30:55.749460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.548 [2024-11-20 01:30:55.755469] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.548 [2024-11-20 01:30:55.755629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.548 [2024-11-20 01:30:55.755662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.548 [2024-11-20 01:30:55.760061] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.548 [2024-11-20 01:30:55.760221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.548 [2024-11-20 01:30:55.760257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.808 [2024-11-20 01:30:55.764480] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.808 [2024-11-20 01:30:55.764600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.808 [2024-11-20 01:30:55.764632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.808 [2024-11-20 01:30:55.769113] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.808 [2024-11-20 01:30:55.769315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.808 [2024-11-20 01:30:55.769363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.808 [2024-11-20 01:30:55.773939] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.808 [2024-11-20 01:30:55.774194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.808 [2024-11-20 01:30:55.774224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.808 [2024-11-20 01:30:55.779574] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.808 [2024-11-20 01:30:55.779834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.808 [2024-11-20 01:30:55.779866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.808 [2024-11-20 01:30:55.785329] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.808 [2024-11-20 01:30:55.785597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.808 [2024-11-20 01:30:55.785630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.808 [2024-11-20 01:30:55.791673] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.808 [2024-11-20 01:30:55.791855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.808 [2024-11-20 01:30:55.791888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.808 [2024-11-20 01:30:55.796319] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.808 [2024-11-20 01:30:55.796507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.808 [2024-11-20 01:30:55.796539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.808 [2024-11-20 01:30:55.801096] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.808 [2024-11-20 01:30:55.801237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.808 [2024-11-20 01:30:55.801264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.808 [2024-11-20 01:30:55.805885] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.808 [2024-11-20 01:30:55.805983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.808 [2024-11-20 01:30:55.806019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.808 [2024-11-20 01:30:55.810892] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.808 [2024-11-20 01:30:55.811081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.808 [2024-11-20 01:30:55.811130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.808 [2024-11-20 01:30:55.815796] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.808 [2024-11-20 01:30:55.815966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.808 [2024-11-20 01:30:55.815998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.808 [2024-11-20 01:30:55.820906] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.808 [2024-11-20 01:30:55.821150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.808 [2024-11-20 01:30:55.821180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.808 [2024-11-20 01:30:55.825824] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.808 [2024-11-20 01:30:55.826023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.808 [2024-11-20 01:30:55.826056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.808 [2024-11-20 01:30:55.830849] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.808 [2024-11-20 01:30:55.831061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.808 [2024-11-20 01:30:55.831103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.808 [2024-11-20 01:30:55.835817] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.808 [2024-11-20 01:30:55.835983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.808 [2024-11-20 01:30:55.836016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.808 [2024-11-20 01:30:55.840582] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.808 [2024-11-20 01:30:55.840758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.808 [2024-11-20 01:30:55.840790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.808 [2024-11-20 01:30:55.845424] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.808 [2024-11-20 01:30:55.845598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.808 [2024-11-20 01:30:55.845630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.808 [2024-11-20 01:30:55.850478] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.808 [2024-11-20 01:30:55.850681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.808 [2024-11-20 01:30:55.850713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.808 [2024-11-20 01:30:55.855152] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.809 [2024-11-20 01:30:55.855310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.809 [2024-11-20 01:30:55.855347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.809 [2024-11-20 01:30:55.860257] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.809 [2024-11-20 01:30:55.860524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.809 [2024-11-20 01:30:55.860561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.809 [2024-11-20 01:30:55.865067] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.809 [2024-11-20 01:30:55.865305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.809 [2024-11-20 01:30:55.865334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.809 [2024-11-20 01:30:55.870093] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.809 [2024-11-20 01:30:55.870340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.809 [2024-11-20 01:30:55.870387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.809 [2024-11-20 01:30:55.875023] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.809 [2024-11-20 01:30:55.875196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.809 [2024-11-20 01:30:55.875227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.809 [2024-11-20 01:30:55.879708] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.809 [2024-11-20 01:30:55.879850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.809 [2024-11-20 01:30:55.879882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.809 [2024-11-20 01:30:55.884816] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.809 [2024-11-20 01:30:55.885008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.809 [2024-11-20 01:30:55.885041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.809 [2024-11-20 01:30:55.890481] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.809 [2024-11-20 01:30:55.890664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.809 [2024-11-20 01:30:55.890697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.809 [2024-11-20 01:30:55.895260] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.809 [2024-11-20 01:30:55.895422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.809 [2024-11-20 01:30:55.895474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.809 [2024-11-20 01:30:55.899935] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.809 [2024-11-20 01:30:55.900196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.809 [2024-11-20 01:30:55.900226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.809 [2024-11-20 01:30:55.904756] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.809 [2024-11-20 01:30:55.904998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.809 [2024-11-20 01:30:55.905040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.809 [2024-11-20 01:30:55.910186] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.809 [2024-11-20 01:30:55.910369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.809 [2024-11-20 01:30:55.910417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.809 [2024-11-20 01:30:55.915109] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.809 [2024-11-20 01:30:55.915263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.809 [2024-11-20 01:30:55.915292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.809 [2024-11-20 01:30:55.919456] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.809 [2024-11-20 01:30:55.919576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.809 [2024-11-20 01:30:55.919607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.809 [2024-11-20 01:30:55.923806] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.809 [2024-11-20 01:30:55.923917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.809 [2024-11-20 01:30:55.923950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.809 [2024-11-20 01:30:55.928319] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.809 [2024-11-20 01:30:55.928545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.809 [2024-11-20 01:30:55.928579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.809 [2024-11-20 01:30:55.932981] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.809 [2024-11-20 01:30:55.933161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.809 [2024-11-20 01:30:55.933204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.809 [2024-11-20 01:30:55.938363] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.809 [2024-11-20 01:30:55.938629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.809 [2024-11-20 01:30:55.938662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.809 [2024-11-20 01:30:55.942854] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.809 [2024-11-20 01:30:55.943058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.809 [2024-11-20 01:30:55.943115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.809 [2024-11-20 01:30:55.947330] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.809 [2024-11-20 01:30:55.947529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.809 [2024-11-20 01:30:55.947561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.809 [2024-11-20 01:30:55.951730] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.809 [2024-11-20 01:30:55.951883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.809 [2024-11-20 01:30:55.951915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.809 [2024-11-20 01:30:55.956151] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.809 [2024-11-20 01:30:55.956263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.810 [2024-11-20 01:30:55.956291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.810 [2024-11-20 01:30:55.960545] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.810 [2024-11-20 01:30:55.960653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.810 [2024-11-20 01:30:55.960684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.810 [2024-11-20 01:30:55.964991] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.810 [2024-11-20 01:30:55.965192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.810 [2024-11-20 01:30:55.965222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.810 [2024-11-20 01:30:55.969433] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.810 [2024-11-20 01:30:55.969596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.810 [2024-11-20 01:30:55.969628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.810 [2024-11-20 01:30:55.974213] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.810 [2024-11-20 01:30:55.974480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.810 [2024-11-20 01:30:55.974512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.810 [2024-11-20 01:30:55.978587] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.810 [2024-11-20 01:30:55.978832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.810 [2024-11-20 01:30:55.978864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.810 [2024-11-20 01:30:55.983202] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.810 [2024-11-20 01:30:55.983375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.810 [2024-11-20 01:30:55.983421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.810 [2024-11-20 01:30:55.987578] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.810 [2024-11-20 01:30:55.987720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.810 [2024-11-20 01:30:55.987751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.810 [2024-11-20 01:30:55.991939] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.810 [2024-11-20 01:30:55.992048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.810 [2024-11-20 01:30:55.992087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.810 [2024-11-20 01:30:55.996301] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.810 [2024-11-20 01:30:55.996433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.810 [2024-11-20 01:30:55.996481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.810 [2024-11-20 01:30:56.000770] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.810 [2024-11-20 01:30:56.000943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.810 [2024-11-20 01:30:56.000974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.810 [2024-11-20 01:30:56.005181] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.810 [2024-11-20 01:30:56.005335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.810 [2024-11-20 01:30:56.005363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.810 [2024-11-20 01:30:56.009692] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.810 [2024-11-20 01:30:56.009938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.810 [2024-11-20 01:30:56.009971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.810 [2024-11-20 01:30:56.014125] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.810 [2024-11-20 01:30:56.014357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.810 [2024-11-20 01:30:56.014386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.810 [2024-11-20 01:30:56.018286] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.810 [2024-11-20 01:30:56.018406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.810 [2024-11-20 01:30:56.018436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.810 [2024-11-20 01:30:56.022648] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:47.810 [2024-11-20 01:30:56.022784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.810 [2024-11-20 01:30:56.022817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.070 [2024-11-20 01:30:56.027177] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.070 [2024-11-20 01:30:56.027269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.070 [2024-11-20 01:30:56.027296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.070 [2024-11-20 01:30:56.032147] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.070 [2024-11-20 01:30:56.032279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.070 [2024-11-20 01:30:56.032308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.070 [2024-11-20 01:30:56.036569] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.070 [2024-11-20 01:30:56.036746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.070 [2024-11-20 01:30:56.036779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.070 [2024-11-20 01:30:56.041011] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.070 [2024-11-20 01:30:56.041182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.070 [2024-11-20 01:30:56.041211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.070 [2024-11-20 01:30:56.045573] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.070 [2024-11-20 01:30:56.045815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.070 [2024-11-20 01:30:56.045847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.070 [2024-11-20 01:30:56.049996] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.070 [2024-11-20 01:30:56.050248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.070 [2024-11-20 01:30:56.050289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.070 [2024-11-20 01:30:56.054485] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.070 [2024-11-20 01:30:56.054667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.070 [2024-11-20 01:30:56.054705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.070 [2024-11-20 01:30:56.058932] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.070 [2024-11-20 01:30:56.059083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.070 [2024-11-20 01:30:56.059130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.070 [2024-11-20 01:30:56.063361] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.070 [2024-11-20 01:30:56.063503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.070 [2024-11-20 01:30:56.063535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.070 [2024-11-20 01:30:56.067781] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.070 [2024-11-20 01:30:56.067904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.070 [2024-11-20 01:30:56.067936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.070 [2024-11-20 01:30:56.072206] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.070 [2024-11-20 01:30:56.072381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.070 [2024-11-20 01:30:56.072414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.070 [2024-11-20 01:30:56.076706] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.070 [2024-11-20 01:30:56.076824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.070 [2024-11-20 01:30:56.076856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.070 [2024-11-20 01:30:56.081245] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.070 [2024-11-20 01:30:56.081507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.070 [2024-11-20 01:30:56.081539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.070 [2024-11-20 01:30:56.085690] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.070 [2024-11-20 01:30:56.085885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.070 [2024-11-20 01:30:56.085916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.070 [2024-11-20 01:30:56.090062] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.070 [2024-11-20 01:30:56.090242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.070 [2024-11-20 01:30:56.090270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.070 [2024-11-20 01:30:56.094520] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.070 [2024-11-20 01:30:56.094670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.070 [2024-11-20 01:30:56.094702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.071 [2024-11-20 01:30:56.098969] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.071 [2024-11-20 01:30:56.099094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.071 [2024-11-20 01:30:56.099148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.071 [2024-11-20 01:30:56.103351] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.071 [2024-11-20 01:30:56.103472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.071 [2024-11-20 01:30:56.103511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.071 [2024-11-20 01:30:56.107845] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.071 [2024-11-20 01:30:56.108021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.071 [2024-11-20 01:30:56.108053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.071 [2024-11-20 01:30:56.112272] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.071 [2024-11-20 01:30:56.112433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.071 [2024-11-20 01:30:56.112479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.071 [2024-11-20 01:30:56.116800] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.071 [2024-11-20 01:30:56.117046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.071 [2024-11-20 01:30:56.117087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.071 [2024-11-20 01:30:56.121255] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.071 [2024-11-20 01:30:56.121490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.071 [2024-11-20 01:30:56.121522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.071 [2024-11-20 01:30:56.125690] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.071 [2024-11-20 01:30:56.125856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.071 [2024-11-20 01:30:56.125887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.071 [2024-11-20 01:30:56.130087] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.071 [2024-11-20 01:30:56.130254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.071 [2024-11-20 01:30:56.130282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.071 [2024-11-20 01:30:56.134434] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.071 [2024-11-20 01:30:56.134543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.071 [2024-11-20 01:30:56.134575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.071 [2024-11-20 01:30:56.138813] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.071 [2024-11-20 01:30:56.138931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:96 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.071 [2024-11-20 01:30:56.138962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.071 [2024-11-20 01:30:56.143302] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.071 [2024-11-20 01:30:56.143485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.071 [2024-11-20 01:30:56.143523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.071 [2024-11-20 01:30:56.147721] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.071 [2024-11-20 01:30:56.147850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.071 [2024-11-20 01:30:56.147882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.071 [2024-11-20 01:30:56.152260] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.071 [2024-11-20 01:30:56.152508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.071 [2024-11-20 01:30:56.152546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.071 [2024-11-20 01:30:56.156679] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.071 [2024-11-20 01:30:56.156874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.071 [2024-11-20 01:30:56.156907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.071 [2024-11-20 01:30:56.161110] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.071 [2024-11-20 01:30:56.161281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.071 [2024-11-20 01:30:56.161315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.071 [2024-11-20 01:30:56.165524] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.071 [2024-11-20 01:30:56.165674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.071 [2024-11-20 01:30:56.165713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.071 [2024-11-20 01:30:56.169943] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.071 [2024-11-20 01:30:56.170057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.071 [2024-11-20 01:30:56.170117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.071 [2024-11-20 01:30:56.174950] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.071 [2024-11-20 01:30:56.175110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.071 [2024-11-20 01:30:56.175155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.071 [2024-11-20 01:30:56.180503] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.071 [2024-11-20 01:30:56.180755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.071 [2024-11-20 01:30:56.180787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.071 [2024-11-20 01:30:56.185971] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.071 [2024-11-20 01:30:56.186225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.071 [2024-11-20 01:30:56.186255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.071 [2024-11-20 01:30:56.191757] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.071 [2024-11-20 01:30:56.192084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.071 [2024-11-20 01:30:56.192116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.071 [2024-11-20 01:30:56.197831] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.071 [2024-11-20 01:30:56.198183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.071 [2024-11-20 01:30:56.198212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.071 [2024-11-20 01:30:56.202806] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.071 [2024-11-20 01:30:56.202989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.071 [2024-11-20 01:30:56.203021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.071 [2024-11-20 01:30:56.207490] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.071 [2024-11-20 01:30:56.207615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.071 [2024-11-20 01:30:56.207646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.071 [2024-11-20 01:30:56.212044] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.071 [2024-11-20 01:30:56.212179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.071 [2024-11-20 01:30:56.212208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.071 [2024-11-20 01:30:56.216518] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.071 [2024-11-20 01:30:56.216638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.071 [2024-11-20 01:30:56.216670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.071 [2024-11-20 01:30:56.221442] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.071 [2024-11-20 01:30:56.221598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.071 [2024-11-20 01:30:56.221629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.072 [2024-11-20 01:30:56.226502] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.072 [2024-11-20 01:30:56.226658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.072 [2024-11-20 01:30:56.226690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.072 [2024-11-20 01:30:56.231299] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.072 [2024-11-20 01:30:56.231543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.072 [2024-11-20 01:30:56.231574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.072 [2024-11-20 01:30:56.235795] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.072 [2024-11-20 01:30:56.236038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.072 [2024-11-20 01:30:56.236077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.072 [2024-11-20 01:30:56.240856] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.072 [2024-11-20 01:30:56.241137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.072 [2024-11-20 01:30:56.241166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.072 [2024-11-20 01:30:56.246255] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.072 [2024-11-20 01:30:56.246452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.072 [2024-11-20 01:30:56.246484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.072 [2024-11-20 01:30:56.252291] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.072 [2024-11-20 01:30:56.252497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.072 [2024-11-20 01:30:56.252530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.072 [2024-11-20 01:30:56.257641] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.072 [2024-11-20 01:30:56.257819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.072 [2024-11-20 01:30:56.257849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.072 [2024-11-20 01:30:56.262216] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.072 [2024-11-20 01:30:56.262398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.072 [2024-11-20 01:30:56.262429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.072 [2024-11-20 01:30:56.266636] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.072 [2024-11-20 01:30:56.266795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.072 [2024-11-20 01:30:56.266834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.072 [2024-11-20 01:30:56.271225] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.072 [2024-11-20 01:30:56.271490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.072 [2024-11-20 01:30:56.271526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.072 [2024-11-20 01:30:56.275738] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.072 [2024-11-20 01:30:56.275957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.072 [2024-11-20 01:30:56.275989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.072 [2024-11-20 01:30:56.280247] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.072 [2024-11-20 01:30:56.280401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.072 [2024-11-20 01:30:56.280440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.072 [2024-11-20 01:30:56.284707] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.072 [2024-11-20 01:30:56.284851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.072 [2024-11-20 01:30:56.284884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.332 [2024-11-20 01:30:56.289051] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.332 [2024-11-20 01:30:56.289159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.332 [2024-11-20 01:30:56.289187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.332 [2024-11-20 01:30:56.294023] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.332 [2024-11-20 01:30:56.294183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.332 [2024-11-20 01:30:56.294210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.332 [2024-11-20 01:30:56.298877] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.332 [2024-11-20 01:30:56.299031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.332 [2024-11-20 01:30:56.299089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.332 [2024-11-20 01:30:56.302932] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.332 [2024-11-20 01:30:56.303126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.332 [2024-11-20 01:30:56.303155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.332 [2024-11-20 01:30:56.307314] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.332 [2024-11-20 01:30:56.307560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.332 [2024-11-20 01:30:56.307587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.332 [2024-11-20 01:30:56.311858] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.332 [2024-11-20 01:30:56.312118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.332 [2024-11-20 01:30:56.312148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.332 [2024-11-20 01:30:56.316185] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.332 [2024-11-20 01:30:56.316346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.333 [2024-11-20 01:30:56.316385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.333 [2024-11-20 01:30:56.320531] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.333 [2024-11-20 01:30:56.320670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.333 [2024-11-20 01:30:56.320699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.333 [2024-11-20 01:30:56.324937] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.333 [2024-11-20 01:30:56.325063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.333 [2024-11-20 01:30:56.325104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.333 [2024-11-20 01:30:56.329405] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.333 [2024-11-20 01:30:56.329534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.333 [2024-11-20 01:30:56.329565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.333 [2024-11-20 01:30:56.333951] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.333 [2024-11-20 01:30:56.334151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.333 [2024-11-20 01:30:56.334186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.333 [2024-11-20 01:30:56.338380] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.333 [2024-11-20 01:30:56.338549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.333 [2024-11-20 01:30:56.338590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.333 [2024-11-20 01:30:56.343053] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.333 [2024-11-20 01:30:56.343312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.333 [2024-11-20 01:30:56.343341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.333 [2024-11-20 01:30:56.347598] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.333 [2024-11-20 01:30:56.347799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.333 [2024-11-20 01:30:56.347832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.333 [2024-11-20 01:30:56.352157] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.333 [2024-11-20 01:30:56.352333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.334 [2024-11-20 01:30:56.352380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.334 [2024-11-20 01:30:56.356608] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.334 [2024-11-20 01:30:56.356760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.334 [2024-11-20 01:30:56.356791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.334 [2024-11-20 01:30:56.361055] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.334 [2024-11-20 01:30:56.361190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.334 [2024-11-20 01:30:56.361219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.334 [2024-11-20 01:30:56.365538] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.334 [2024-11-20 01:30:56.365668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.334 [2024-11-20 01:30:56.365699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.334 [2024-11-20 01:30:56.370054] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.334 [2024-11-20 01:30:56.370253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.334 [2024-11-20 01:30:56.370289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.334 [2024-11-20 01:30:56.374553] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.334 [2024-11-20 01:30:56.374717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.334 [2024-11-20 01:30:56.374749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.334 [2024-11-20 01:30:56.379047] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.334 [2024-11-20 01:30:56.379293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.334 [2024-11-20 01:30:56.379322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.334 [2024-11-20 01:30:56.383555] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.334 [2024-11-20 01:30:56.383737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.334 [2024-11-20 01:30:56.383768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.334 [2024-11-20 01:30:56.388491] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.334 [2024-11-20 01:30:56.388661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.334 [2024-11-20 01:30:56.388697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.334 [2024-11-20 01:30:56.393851] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.334 [2024-11-20 01:30:56.394037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.334 [2024-11-20 01:30:56.394079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.334 [2024-11-20 01:30:56.400389] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.334 [2024-11-20 01:30:56.400595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.334 [2024-11-20 01:30:56.400641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.334 [2024-11-20 01:30:56.405523] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.334 [2024-11-20 01:30:56.405701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.334 [2024-11-20 01:30:56.405733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.334 [2024-11-20 01:30:56.410190] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.334 [2024-11-20 01:30:56.410435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.334 [2024-11-20 01:30:56.410467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.334 [2024-11-20 01:30:56.414964] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.334 [2024-11-20 01:30:56.415196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.334 [2024-11-20 01:30:56.415226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.334 [2024-11-20 01:30:56.420767] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.334 [2024-11-20 01:30:56.420978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.334 [2024-11-20 01:30:56.421009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.334 [2024-11-20 01:30:56.425854] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.334 [2024-11-20 01:30:56.426083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.334 [2024-11-20 01:30:56.426128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.334 [2024-11-20 01:30:56.431223] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.334 [2024-11-20 01:30:56.431389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.334 [2024-11-20 01:30:56.431437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.334 [2024-11-20 01:30:56.436717] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.334 [2024-11-20 01:30:56.436991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.334 [2024-11-20 01:30:56.437023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.334 [2024-11-20 01:30:56.441870] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.334 [2024-11-20 01:30:56.442060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.334 [2024-11-20 01:30:56.442103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.334 [2024-11-20 01:30:56.446945] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.334 [2024-11-20 01:30:56.447153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.334 [2024-11-20 01:30:56.447182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.334 [2024-11-20 01:30:56.452176] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.334 [2024-11-20 01:30:56.452341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.334 [2024-11-20 01:30:56.452385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.334 [2024-11-20 01:30:56.457294] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.334 [2024-11-20 01:30:56.457546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.334 [2024-11-20 01:30:56.457577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.334 [2024-11-20 01:30:56.462408] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.334 [2024-11-20 01:30:56.462567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.334 [2024-11-20 01:30:56.462598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.334 [2024-11-20 01:30:56.467612] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.334 [2024-11-20 01:30:56.467889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.334 [2024-11-20 01:30:56.467920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.334 [2024-11-20 01:30:56.472685] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.334 [2024-11-20 01:30:56.472955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.334 [2024-11-20 01:30:56.472987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.334 [2024-11-20 01:30:56.477884] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.334 [2024-11-20 01:30:56.478150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.334 [2024-11-20 01:30:56.478181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.334 [2024-11-20 01:30:56.482915] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.334 [2024-11-20 01:30:56.483108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.334 [2024-11-20 01:30:56.483155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.334 [2024-11-20 01:30:56.488036] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.334 [2024-11-20 01:30:56.488229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.334 [2024-11-20 01:30:56.488258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.334 [2024-11-20 01:30:56.493186] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.334 [2024-11-20 01:30:56.493355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.334 [2024-11-20 01:30:56.493384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.334 [2024-11-20 01:30:56.498319] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.334 [2024-11-20 01:30:56.498533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.334 [2024-11-20 01:30:56.498565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.334 [2024-11-20 01:30:56.503530] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.334 [2024-11-20 01:30:56.503768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.334 [2024-11-20 01:30:56.503806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.334 [2024-11-20 01:30:56.508399] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.334 [2024-11-20 01:30:56.508613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.334 [2024-11-20 01:30:56.508646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.334 [2024-11-20 01:30:56.513213] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.334 [2024-11-20 01:30:56.513470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.334 [2024-11-20 01:30:56.513510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.334 [2024-11-20 01:30:56.518350] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.334 [2024-11-20 01:30:56.518597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.334 [2024-11-20 01:30:56.518630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.334 [2024-11-20 01:30:56.522963] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.334 [2024-11-20 01:30:56.523107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.334 [2024-11-20 01:30:56.523153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.334 [2024-11-20 01:30:56.527745] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.334 [2024-11-20 01:30:56.527872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.334 [2024-11-20 01:30:56.527903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.334 [2024-11-20 01:30:56.533436] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.334 [2024-11-20 01:30:56.533620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.334 [2024-11-20 01:30:56.533651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.334 [2024-11-20 01:30:56.537953] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.334 [2024-11-20 01:30:56.538113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.334 [2024-11-20 01:30:56.538142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.334 [2024-11-20 01:30:56.542365] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.334 [2024-11-20 01:30:56.542517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.334 [2024-11-20 01:30:56.542548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.593 [2024-11-20 01:30:56.546888] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.593 [2024-11-20 01:30:56.547137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.593 [2024-11-20 01:30:56.547166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.593 [2024-11-20 01:30:56.551438] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.593 [2024-11-20 01:30:56.551639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.593 [2024-11-20 01:30:56.551670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.593 [2024-11-20 01:30:56.555900] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.593 [2024-11-20 01:30:56.556085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.593 [2024-11-20 01:30:56.556128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.593 [2024-11-20 01:30:56.560319] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.593 [2024-11-20 01:30:56.560466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.593 [2024-11-20 01:30:56.560497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.593 [2024-11-20 01:30:56.564837] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.593 [2024-11-20 01:30:56.564945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.593 [2024-11-20 01:30:56.564976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.593 [2024-11-20 01:30:56.569304] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.593 [2024-11-20 01:30:56.569432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.593 [2024-11-20 01:30:56.569461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.593 [2024-11-20 01:30:56.573715] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.593 [2024-11-20 01:30:56.573835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.593 [2024-11-20 01:30:56.573867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.593 [2024-11-20 01:30:56.578203] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.593 [2024-11-20 01:30:56.578349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.593 [2024-11-20 01:30:56.578377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.593 [2024-11-20 01:30:56.582751] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.593 [2024-11-20 01:30:56.582964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.593 [2024-11-20 01:30:56.582997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.593 [2024-11-20 01:30:56.587226] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.593 [2024-11-20 01:30:56.587429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.593 [2024-11-20 01:30:56.587462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.593 [2024-11-20 01:30:56.591699] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.593 [2024-11-20 01:30:56.591847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.593 [2024-11-20 01:30:56.591879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.593 [2024-11-20 01:30:56.596135] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.593 [2024-11-20 01:30:56.596261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.593 [2024-11-20 01:30:56.596290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.593 [2024-11-20 01:30:56.600635] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.593 [2024-11-20 01:30:56.600752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.593 [2024-11-20 01:30:56.600785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.593 [2024-11-20 01:30:56.605077] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.593 [2024-11-20 01:30:56.605251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.593 [2024-11-20 01:30:56.605280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.593 [2024-11-20 01:30:56.609463] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.593 [2024-11-20 01:30:56.609578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.593 [2024-11-20 01:30:56.609611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.593 [2024-11-20 01:30:56.613863] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.593 [2024-11-20 01:30:56.614004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.593 [2024-11-20 01:30:56.614036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.593 [2024-11-20 01:30:56.618314] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.594 [2024-11-20 01:30:56.618542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.594 [2024-11-20 01:30:56.618573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.594 [2024-11-20 01:30:56.622753] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.594 [2024-11-20 01:30:56.622960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.594 [2024-11-20 01:30:56.623000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.594 [2024-11-20 01:30:56.627172] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.594 [2024-11-20 01:30:56.627324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.594 [2024-11-20 01:30:56.627352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.594 [2024-11-20 01:30:56.631612] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.594 [2024-11-20 01:30:56.631726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.594 [2024-11-20 01:30:56.631757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.594 [2024-11-20 01:30:56.636051] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.594 [2024-11-20 01:30:56.636193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.594 [2024-11-20 01:30:56.636221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.594 [2024-11-20 01:30:56.640552] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.594 [2024-11-20 01:30:56.640719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.594 [2024-11-20 01:30:56.640750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.594 [2024-11-20 01:30:56.645005] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.594 [2024-11-20 01:30:56.645143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.594 [2024-11-20 01:30:56.645172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.594 [2024-11-20 01:30:56.649462] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.594 [2024-11-20 01:30:56.649605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.594 [2024-11-20 01:30:56.649638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.594 [2024-11-20 01:30:56.653939] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.594 [2024-11-20 01:30:56.654174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.594 [2024-11-20 01:30:56.654203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.594 [2024-11-20 01:30:56.658384] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.594 [2024-11-20 01:30:56.658582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.594 [2024-11-20 01:30:56.658615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.594 [2024-11-20 01:30:56.662756] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.594 [2024-11-20 01:30:56.662923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.594 [2024-11-20 01:30:56.662955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.594 [2024-11-20 01:30:56.667151] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.594 [2024-11-20 01:30:56.667261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.594 [2024-11-20 01:30:56.667295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.594 [2024-11-20 01:30:56.671489] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.594 [2024-11-20 01:30:56.671608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.594 [2024-11-20 01:30:56.671640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.594 [2024-11-20 01:30:56.675849] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.594 [2024-11-20 01:30:56.675996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.594 [2024-11-20 01:30:56.676028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.594 [2024-11-20 01:30:56.680227] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.594 [2024-11-20 01:30:56.680368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.594 [2024-11-20 01:30:56.680399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.594 [2024-11-20 01:30:56.684917] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.594 [2024-11-20 01:30:56.685032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.594 [2024-11-20 01:30:56.685063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.594 [2024-11-20 01:30:56.690286] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.594 [2024-11-20 01:30:56.690504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.594 [2024-11-20 01:30:56.690543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.594 [2024-11-20 01:30:56.694716] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.594 [2024-11-20 01:30:56.694924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.594 [2024-11-20 01:30:56.694957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.594 [2024-11-20 01:30:56.699150] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.594 [2024-11-20 01:30:56.699313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.594 [2024-11-20 01:30:56.699347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.594 [2024-11-20 01:30:56.703564] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.594 [2024-11-20 01:30:56.703706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.594 [2024-11-20 01:30:56.703738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.594 [2024-11-20 01:30:56.707947] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.594 [2024-11-20 01:30:56.708081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.594 [2024-11-20 01:30:56.708128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.594 [2024-11-20 01:30:56.712358] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.594 [2024-11-20 01:30:56.712543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.594 [2024-11-20 01:30:56.712575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.594 [2024-11-20 01:30:56.716736] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.594 [2024-11-20 01:30:56.716881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.594 [2024-11-20 01:30:56.716913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.594 [2024-11-20 01:30:56.721230] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.594 [2024-11-20 01:30:56.721378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.594 [2024-11-20 01:30:56.721410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.594 [2024-11-20 01:30:56.725711] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.594 [2024-11-20 01:30:56.725924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.594 [2024-11-20 01:30:56.725955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.594 [2024-11-20 01:30:56.730262] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.594 [2024-11-20 01:30:56.730482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.594 [2024-11-20 01:30:56.730519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.594 [2024-11-20 01:30:56.734725] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.594 [2024-11-20 01:30:56.734882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.594 [2024-11-20 01:30:56.734922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.595 [2024-11-20 01:30:56.739142] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.595 [2024-11-20 01:30:56.739297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.595 [2024-11-20 01:30:56.739324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.595 [2024-11-20 01:30:56.743580] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.595 [2024-11-20 01:30:56.743714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.595 [2024-11-20 01:30:56.743746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.595 [2024-11-20 01:30:56.748117] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.595 [2024-11-20 01:30:56.748281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.595 [2024-11-20 01:30:56.748310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.595 [2024-11-20 01:30:56.752524] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.595 [2024-11-20 01:30:56.752630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.595 [2024-11-20 01:30:56.752662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.595 [2024-11-20 01:30:56.756976] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.595 [2024-11-20 01:30:56.757148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.595 [2024-11-20 01:30:56.757177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.595 [2024-11-20 01:30:56.761360] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.595 [2024-11-20 01:30:56.761592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.595 [2024-11-20 01:30:56.761624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.595 [2024-11-20 01:30:56.765882] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.595 [2024-11-20 01:30:56.766093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.595 [2024-11-20 01:30:56.766144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.595 [2024-11-20 01:30:56.770326] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.595 [2024-11-20 01:30:56.770519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.595 [2024-11-20 01:30:56.770550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.595 [2024-11-20 01:30:56.774699] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.595 [2024-11-20 01:30:56.774819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.595 [2024-11-20 01:30:56.774855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.595 [2024-11-20 01:30:56.779026] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.595 [2024-11-20 01:30:56.779177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.595 [2024-11-20 01:30:56.779206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.595 [2024-11-20 01:30:56.783450] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.595 [2024-11-20 01:30:56.783608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.595 [2024-11-20 01:30:56.783640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.595 [2024-11-20 01:30:56.787772] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.595 [2024-11-20 01:30:56.787892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.595 [2024-11-20 01:30:56.787923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.595 [2024-11-20 01:30:56.792225] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.595 [2024-11-20 01:30:56.792388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.595 [2024-11-20 01:30:56.792424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.595 [2024-11-20 01:30:56.796732] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.595 [2024-11-20 01:30:56.796946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.595 [2024-11-20 01:30:56.796978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.595 [2024-11-20 01:30:56.801258] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.595 [2024-11-20 01:30:56.801499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.595 [2024-11-20 01:30:56.801537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.595 [2024-11-20 01:30:56.805752] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.595 [2024-11-20 01:30:56.805922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.595 [2024-11-20 01:30:56.805953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.854 [2024-11-20 01:30:56.810180] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.854 [2024-11-20 01:30:56.810305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.854 [2024-11-20 01:30:56.810334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.854 [2024-11-20 01:30:56.814531] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.854 [2024-11-20 01:30:56.814648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.854 [2024-11-20 01:30:56.814693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.854 [2024-11-20 01:30:56.818921] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.854 [2024-11-20 01:30:56.819094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.854 [2024-11-20 01:30:56.819139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.854 [2024-11-20 01:30:56.823284] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.854 [2024-11-20 01:30:56.823376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.854 [2024-11-20 01:30:56.823419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.854 [2024-11-20 01:30:56.827736] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.855 [2024-11-20 01:30:56.827888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.855 [2024-11-20 01:30:56.827920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.855 [2024-11-20 01:30:56.832200] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.855 [2024-11-20 01:30:56.832424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.855 [2024-11-20 01:30:56.832456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.855 [2024-11-20 01:30:56.836690] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.855 [2024-11-20 01:30:56.836907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.855 [2024-11-20 01:30:56.836939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.855 [2024-11-20 01:30:56.841201] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.855 [2024-11-20 01:30:56.841354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.855 [2024-11-20 01:30:56.841399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.855 [2024-11-20 01:30:56.845635] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.855 [2024-11-20 01:30:56.845742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.855 [2024-11-20 01:30:56.845774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.855 [2024-11-20 01:30:56.850037] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.855 [2024-11-20 01:30:56.850178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.855 [2024-11-20 01:30:56.850207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.855 [2024-11-20 01:30:56.854431] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.855 [2024-11-20 01:30:56.854593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.855 [2024-11-20 01:30:56.854625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.855 [2024-11-20 01:30:56.858775] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.855 [2024-11-20 01:30:56.858884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.855 [2024-11-20 01:30:56.858919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.855 [2024-11-20 01:30:56.863218] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.855 [2024-11-20 01:30:56.863348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.855 [2024-11-20 01:30:56.863401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.855 [2024-11-20 01:30:56.867417] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.855 [2024-11-20 01:30:56.867616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.855 [2024-11-20 01:30:56.867645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.855 [2024-11-20 01:30:56.871966] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.855 [2024-11-20 01:30:56.872185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.855 [2024-11-20 01:30:56.872215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.855 [2024-11-20 01:30:56.876465] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.855 [2024-11-20 01:30:56.876634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.855 [2024-11-20 01:30:56.876666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.855 [2024-11-20 01:30:56.880785] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.855 [2024-11-20 01:30:56.880900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.855 [2024-11-20 01:30:56.880930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.855 [2024-11-20 01:30:56.885204] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.855 [2024-11-20 01:30:56.885306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.855 [2024-11-20 01:30:56.885334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.855 [2024-11-20 01:30:56.889658] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.855 [2024-11-20 01:30:56.889822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.855 [2024-11-20 01:30:56.889855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.855 [2024-11-20 01:30:56.894122] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.855 [2024-11-20 01:30:56.894231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.855 [2024-11-20 01:30:56.894259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.855 [2024-11-20 01:30:56.898544] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.855 [2024-11-20 01:30:56.898688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.855 [2024-11-20 01:30:56.898719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.855 [2024-11-20 01:30:56.903018] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.855 [2024-11-20 01:30:56.903237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.855 [2024-11-20 01:30:56.903266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.855 [2024-11-20 01:30:56.907568] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.855 [2024-11-20 01:30:56.907762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.855 [2024-11-20 01:30:56.907794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.855 [2024-11-20 01:30:56.912020] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.855 [2024-11-20 01:30:56.912176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.855 [2024-11-20 01:30:56.912206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.855 [2024-11-20 01:30:56.916445] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.855 [2024-11-20 01:30:56.916554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.855 [2024-11-20 01:30:56.916586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.855 [2024-11-20 01:30:56.920884] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.855 [2024-11-20 01:30:56.920998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.855 [2024-11-20 01:30:56.921029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.855 [2024-11-20 01:30:56.925290] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.855 [2024-11-20 01:30:56.925468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.855 [2024-11-20 01:30:56.925500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.855 [2024-11-20 01:30:56.929687] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.855 [2024-11-20 01:30:56.929815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.855 [2024-11-20 01:30:56.929854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.855 [2024-11-20 01:30:56.934167] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.855 [2024-11-20 01:30:56.934310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.855 [2024-11-20 01:30:56.934339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.855 [2024-11-20 01:30:56.938617] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.855 [2024-11-20 01:30:56.938831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.855 [2024-11-20 01:30:56.938864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.855 [2024-11-20 01:30:56.943164] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.855 [2024-11-20 01:30:56.943326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.855 [2024-11-20 01:30:56.943355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.856 [2024-11-20 01:30:56.947586] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.856 [2024-11-20 01:30:56.947737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.856 [2024-11-20 01:30:56.947768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.856 [2024-11-20 01:30:56.951958] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.856 [2024-11-20 01:30:56.952082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.856 [2024-11-20 01:30:56.952120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.856 [2024-11-20 01:30:56.956360] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.856 [2024-11-20 01:30:56.956494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.856 [2024-11-20 01:30:56.956527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.856 [2024-11-20 01:30:56.960820] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.856 [2024-11-20 01:30:56.960992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.856 [2024-11-20 01:30:56.961024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.856 [2024-11-20 01:30:56.965191] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.856 [2024-11-20 01:30:56.965311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.856 [2024-11-20 01:30:56.965339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.856 [2024-11-20 01:30:56.969616] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.856 [2024-11-20 01:30:56.969766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.856 [2024-11-20 01:30:56.969798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.856 [2024-11-20 01:30:56.974168] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.856 [2024-11-20 01:30:56.974357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.856 [2024-11-20 01:30:56.974402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.856 [2024-11-20 01:30:56.978580] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.856 [2024-11-20 01:30:56.978783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.856 [2024-11-20 01:30:56.978821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.856 [2024-11-20 01:30:56.983950] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.856 [2024-11-20 01:30:56.984117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.856 [2024-11-20 01:30:56.984162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.856 [2024-11-20 01:30:56.988404] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.856 [2024-11-20 01:30:56.988528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.856 [2024-11-20 01:30:56.988560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.856 [2024-11-20 01:30:56.992977] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.856 [2024-11-20 01:30:56.993127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.856 [2024-11-20 01:30:56.993156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.856 [2024-11-20 01:30:56.997374] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.856 [2024-11-20 01:30:56.997553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.856 [2024-11-20 01:30:56.997585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.856 [2024-11-20 01:30:57.001834] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.856 [2024-11-20 01:30:57.001942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.856 [2024-11-20 01:30:57.001975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.856 [2024-11-20 01:30:57.006291] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.856 [2024-11-20 01:30:57.006463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.856 [2024-11-20 01:30:57.006502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.856 [2024-11-20 01:30:57.010781] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.856 [2024-11-20 01:30:57.010992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.856 [2024-11-20 01:30:57.011025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.856 [2024-11-20 01:30:57.015340] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.856 [2024-11-20 01:30:57.015549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.856 [2024-11-20 01:30:57.015581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.856 [2024-11-20 01:30:57.019853] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.856 [2024-11-20 01:30:57.020016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.856 [2024-11-20 01:30:57.020049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.856 [2024-11-20 01:30:57.024247] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.856 [2024-11-20 01:30:57.024371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.856 [2024-11-20 01:30:57.024416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.856 [2024-11-20 01:30:57.028626] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.856 [2024-11-20 01:30:57.028736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.856 [2024-11-20 01:30:57.028766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.856 [2024-11-20 01:30:57.033030] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.856 [2024-11-20 01:30:57.033213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.856 [2024-11-20 01:30:57.033251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.856 [2024-11-20 01:30:57.037403] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.856 [2024-11-20 01:30:57.037528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.856 [2024-11-20 01:30:57.037561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.856 [2024-11-20 01:30:57.041856] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.856 [2024-11-20 01:30:57.041998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.856 [2024-11-20 01:30:57.042037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.856 [2024-11-20 01:30:57.046388] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.856 [2024-11-20 01:30:57.046605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.856 [2024-11-20 01:30:57.046638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.856 [2024-11-20 01:30:57.050834] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.856 [2024-11-20 01:30:57.051081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.856 [2024-11-20 01:30:57.051113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.856 [2024-11-20 01:30:57.055337] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.856 [2024-11-20 01:30:57.055534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.856 [2024-11-20 01:30:57.055567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.856 [2024-11-20 01:30:57.059745] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.856 [2024-11-20 01:30:57.059909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.856 [2024-11-20 01:30:57.059941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.856 [2024-11-20 01:30:57.064371] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.856 [2024-11-20 01:30:57.064499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.856 [2024-11-20 01:30:57.064525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.857 [2024-11-20 01:30:57.069499] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:48.857 [2024-11-20 01:30:57.069652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.857 [2024-11-20 01:30:57.069685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:49.116 [2024-11-20 01:30:57.073932] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:49.116 [2024-11-20 01:30:57.074055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.116 [2024-11-20 01:30:57.074098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.116 [2024-11-20 01:30:57.078331] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:49.116 [2024-11-20 01:30:57.078525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.116 [2024-11-20 01:30:57.078558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:49.116 [2024-11-20 01:30:57.082869] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:49.116 [2024-11-20 01:30:57.083093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.116 [2024-11-20 01:30:57.083137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:49.116 [2024-11-20 01:30:57.087409] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:49.116 [2024-11-20 01:30:57.087636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.116 [2024-11-20 01:30:57.087668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:49.116 [2024-11-20 01:30:57.091781] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:49.116 [2024-11-20 01:30:57.091915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.116 [2024-11-20 01:30:57.091948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.116 [2024-11-20 01:30:57.096216] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:49.116 [2024-11-20 01:30:57.096334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.116 [2024-11-20 01:30:57.096363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:49.116 [2024-11-20 01:30:57.100625] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:49.116 [2024-11-20 01:30:57.100747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.116 [2024-11-20 01:30:57.100780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:49.116 [2024-11-20 01:30:57.105051] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:49.116 [2024-11-20 01:30:57.105221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.116 [2024-11-20 01:30:57.105255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:49.116 [2024-11-20 01:30:57.109422] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:49.116 [2024-11-20 01:30:57.109547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.116 [2024-11-20 01:30:57.109579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.116 [2024-11-20 01:30:57.113848] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:49.116 [2024-11-20 01:30:57.113990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.116 [2024-11-20 01:30:57.114029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:49.116 [2024-11-20 01:30:57.118359] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:49.116 [2024-11-20 01:30:57.118577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.116 [2024-11-20 01:30:57.118609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:49.116 [2024-11-20 01:30:57.122867] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:49.116 [2024-11-20 01:30:57.123065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.116 [2024-11-20 01:30:57.123129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:49.116 [2024-11-20 01:30:57.127334] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:49.116 [2024-11-20 01:30:57.127510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.116 [2024-11-20 01:30:57.127542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.116 [2024-11-20 01:30:57.131730] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:49.116 [2024-11-20 01:30:57.131852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.116 [2024-11-20 01:30:57.131884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:49.116 [2024-11-20 01:30:57.136091] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:49.116 [2024-11-20 01:30:57.136244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.116 [2024-11-20 01:30:57.136272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:49.116 [2024-11-20 01:30:57.140541] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:49.116 [2024-11-20 01:30:57.140688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.116 [2024-11-20 01:30:57.140719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:49.116 [2024-11-20 01:30:57.144877] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:49.116 [2024-11-20 01:30:57.145027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.116 [2024-11-20 01:30:57.145059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.116 [2024-11-20 01:30:57.149336] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:49.117 [2024-11-20 01:30:57.149501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.117 [2024-11-20 01:30:57.149534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:49.117 [2024-11-20 01:30:57.153862] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:49.117 [2024-11-20 01:30:57.154086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.117 [2024-11-20 01:30:57.154118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:49.117 [2024-11-20 01:30:57.158337] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:49.117 [2024-11-20 01:30:57.158560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.117 [2024-11-20 01:30:57.158592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:49.117 [2024-11-20 01:30:57.162732] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:49.117 [2024-11-20 01:30:57.162901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.117 [2024-11-20 01:30:57.162933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.117 [2024-11-20 01:30:57.167135] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:49.117 [2024-11-20 01:30:57.167270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.117 [2024-11-20 01:30:57.167298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:49.117 [2024-11-20 01:30:57.171509] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:49.117 [2024-11-20 01:30:57.171622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.117 [2024-11-20 01:30:57.171654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:49.117 [2024-11-20 01:30:57.175945] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:49.117 [2024-11-20 01:30:57.176101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.117 [2024-11-20 01:30:57.176147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:49.117 [2024-11-20 01:30:57.180340] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:49.117 [2024-11-20 01:30:57.180460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.117 [2024-11-20 01:30:57.180492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.117 [2024-11-20 01:30:57.184761] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:49.117 [2024-11-20 01:30:57.184904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.117 [2024-11-20 01:30:57.184935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:49.117 [2024-11-20 01:30:57.189257] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:49.117 [2024-11-20 01:30:57.189493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.117 [2024-11-20 01:30:57.189525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:49.117 [2024-11-20 01:30:57.193735] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:49.117 [2024-11-20 01:30:57.193930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.117 [2024-11-20 01:30:57.193961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:49.117 [2024-11-20 01:30:57.198212] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:49.117 [2024-11-20 01:30:57.198355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.117 [2024-11-20 01:30:57.198409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.117 [2024-11-20 01:30:57.202618] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:49.117 [2024-11-20 01:30:57.202726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.117 [2024-11-20 01:30:57.202758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:49.117 [2024-11-20 01:30:57.206967] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:49.117 [2024-11-20 01:30:57.207117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.117 [2024-11-20 01:30:57.207146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:49.117 [2024-11-20 01:30:57.211408] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:49.117 [2024-11-20 01:30:57.211569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.117 [2024-11-20 01:30:57.211601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:49.117 [2024-11-20 01:30:57.215838] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:49.117 [2024-11-20 01:30:57.215962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.117 [2024-11-20 01:30:57.215993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.117 [2024-11-20 01:30:57.220248] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:49.117 [2024-11-20 01:30:57.220418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.117 [2024-11-20 01:30:57.220450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:49.117 [2024-11-20 01:30:57.224777] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:49.117 [2024-11-20 01:30:57.224994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.117 [2024-11-20 01:30:57.225026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:49.117 [2024-11-20 01:30:57.229307] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:49.117 [2024-11-20 01:30:57.229530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.117 [2024-11-20 01:30:57.229562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:49.117 [2024-11-20 01:30:57.233803] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:49.117 [2024-11-20 01:30:57.233971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.117 [2024-11-20 01:30:57.234010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.117 [2024-11-20 01:30:57.238193] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:49.117 [2024-11-20 01:30:57.238324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.117 [2024-11-20 01:30:57.238374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:49.117 [2024-11-20 01:30:57.242550] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:49.117 [2024-11-20 01:30:57.242671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.117 [2024-11-20 01:30:57.242703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:49.117 [2024-11-20 01:30:57.246955] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:49.117 [2024-11-20 01:30:57.247104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.117 [2024-11-20 01:30:57.247136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:49.117 [2024-11-20 01:30:57.251341] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1449ac0) with pdu=0x2000190fef90 00:29:49.117 [2024-11-20 01:30:57.251469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.117 [2024-11-20 01:30:57.251501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.117 00:29:49.117 Latency(us) 00:29:49.117 [2024-11-20T00:30:57.336Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:49.117 [2024-11-20T00:30:57.336Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:29:49.117 nvme0n1 : 2.00 6518.67 814.83 0.00 0.00 2447.14 1820.44 6650.69 00:29:49.117 [2024-11-20T00:30:57.336Z] =================================================================================================================== 00:29:49.117 [2024-11-20T00:30:57.336Z] Total : 6518.67 814.83 0.00 0.00 2447.14 1820.44 6650.69 00:29:49.117 0 00:29:49.117 01:30:57 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:29:49.117 01:30:57 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:29:49.117 01:30:57 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:29:49.117 | .driver_specific 00:29:49.117 | .nvme_error 00:29:49.117 | .status_code 00:29:49.117 | .command_transient_transport_error' 00:29:49.117 01:30:57 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:29:49.398 01:30:57 -- host/digest.sh@71 -- # (( 420 > 0 )) 00:29:49.398 01:30:57 -- host/digest.sh@73 -- # killprocess 1265534 00:29:49.398 01:30:57 -- common/autotest_common.sh@936 -- # '[' -z 1265534 ']' 00:29:49.398 01:30:57 -- common/autotest_common.sh@940 -- # kill -0 1265534 00:29:49.398 01:30:57 -- common/autotest_common.sh@941 -- # uname 00:29:49.398 01:30:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:49.398 01:30:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1265534 00:29:49.398 01:30:57 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:49.398 01:30:57 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:49.398 01:30:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1265534' 00:29:49.398 killing process with pid 1265534 00:29:49.398 01:30:57 -- common/autotest_common.sh@955 -- # kill 1265534 00:29:49.398 Received shutdown signal, test time was about 2.000000 seconds 00:29:49.398 00:29:49.398 Latency(us) 00:29:49.398 [2024-11-20T00:30:57.617Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:49.398 [2024-11-20T00:30:57.617Z] =================================================================================================================== 00:29:49.398 [2024-11-20T00:30:57.617Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:49.398 01:30:57 -- common/autotest_common.sh@960 -- # wait 1265534 00:29:49.656 01:30:57 -- host/digest.sh@115 -- # killprocess 1263858 00:29:49.656 01:30:57 -- common/autotest_common.sh@936 -- # '[' -z 1263858 ']' 00:29:49.656 01:30:57 -- common/autotest_common.sh@940 -- # kill -0 1263858 00:29:49.656 01:30:57 -- common/autotest_common.sh@941 -- # uname 00:29:49.656 01:30:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:49.656 01:30:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1263858 00:29:49.656 01:30:57 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:49.656 01:30:57 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:49.656 01:30:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1263858' 00:29:49.656 killing process with pid 1263858 00:29:49.656 01:30:57 -- common/autotest_common.sh@955 -- # kill 1263858 00:29:49.656 01:30:57 -- common/autotest_common.sh@960 -- # wait 1263858 00:29:49.916 00:29:49.916 real 0m18.247s 00:29:49.916 user 0m36.973s 00:29:49.916 sys 0m4.559s 00:29:49.916 01:30:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:49.916 01:30:58 -- common/autotest_common.sh@10 -- # set +x 00:29:49.916 ************************************ 00:29:49.916 END TEST nvmf_digest_error 00:29:49.916 ************************************ 00:29:49.916 01:30:58 -- host/digest.sh@138 -- # trap - SIGINT SIGTERM EXIT 00:29:49.916 01:30:58 -- host/digest.sh@139 -- # nvmftestfini 00:29:49.916 01:30:58 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:49.916 01:30:58 -- nvmf/common.sh@116 -- # sync 00:29:49.916 01:30:58 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:49.916 01:30:58 -- nvmf/common.sh@119 -- # set +e 00:29:49.916 01:30:58 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:49.916 01:30:58 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:49.916 rmmod nvme_tcp 00:29:49.916 rmmod nvme_fabrics 00:29:50.174 rmmod nvme_keyring 00:29:50.174 01:30:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:50.174 01:30:58 -- nvmf/common.sh@123 -- # set -e 00:29:50.174 01:30:58 -- nvmf/common.sh@124 -- # return 0 00:29:50.174 01:30:58 -- nvmf/common.sh@477 -- # '[' -n 1263858 ']' 00:29:50.174 01:30:58 -- nvmf/common.sh@478 -- # killprocess 1263858 00:29:50.174 01:30:58 -- common/autotest_common.sh@936 -- # '[' -z 1263858 ']' 00:29:50.174 01:30:58 -- common/autotest_common.sh@940 -- # kill -0 1263858 00:29:50.174 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1263858) - No such process 00:29:50.174 01:30:58 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1263858 is not found' 00:29:50.174 Process with pid 1263858 is not found 00:29:50.174 01:30:58 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:29:50.174 01:30:58 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:50.174 01:30:58 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:50.174 01:30:58 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:50.174 01:30:58 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:50.174 01:30:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:50.174 01:30:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:50.174 01:30:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:52.076 01:31:00 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:52.076 00:29:52.076 real 0m37.999s 00:29:52.076 user 1m8.181s 00:29:52.076 sys 0m10.462s 00:29:52.076 01:31:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:52.076 01:31:00 -- common/autotest_common.sh@10 -- # set +x 00:29:52.076 ************************************ 00:29:52.076 END TEST nvmf_digest 00:29:52.076 ************************************ 00:29:52.076 01:31:00 -- nvmf/nvmf.sh@110 -- # [[ 0 -eq 1 ]] 00:29:52.076 01:31:00 -- nvmf/nvmf.sh@115 -- # [[ 0 -eq 1 ]] 00:29:52.076 01:31:00 -- nvmf/nvmf.sh@120 -- # [[ phy == phy ]] 00:29:52.076 01:31:00 -- nvmf/nvmf.sh@122 -- # run_test nvmf_bdevperf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:29:52.076 01:31:00 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:29:52.076 01:31:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:52.076 01:31:00 -- common/autotest_common.sh@10 -- # set +x 00:29:52.076 ************************************ 00:29:52.076 START TEST nvmf_bdevperf 00:29:52.076 ************************************ 00:29:52.076 01:31:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:29:52.076 * Looking for test storage... 00:29:52.076 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:29:52.076 01:31:00 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:29:52.076 01:31:00 -- common/autotest_common.sh@1690 -- # lcov --version 00:29:52.076 01:31:00 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:29:52.334 01:31:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:29:52.334 01:31:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:29:52.334 01:31:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:29:52.334 01:31:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:29:52.334 01:31:00 -- scripts/common.sh@335 -- # IFS=.-: 00:29:52.334 01:31:00 -- scripts/common.sh@335 -- # read -ra ver1 00:29:52.334 01:31:00 -- scripts/common.sh@336 -- # IFS=.-: 00:29:52.334 01:31:00 -- scripts/common.sh@336 -- # read -ra ver2 00:29:52.334 01:31:00 -- scripts/common.sh@337 -- # local 'op=<' 00:29:52.334 01:31:00 -- scripts/common.sh@339 -- # ver1_l=2 00:29:52.334 01:31:00 -- scripts/common.sh@340 -- # ver2_l=1 00:29:52.334 01:31:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:29:52.334 01:31:00 -- scripts/common.sh@343 -- # case "$op" in 00:29:52.334 01:31:00 -- scripts/common.sh@344 -- # : 1 00:29:52.334 01:31:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:29:52.334 01:31:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:29:52.334 01:31:00 -- scripts/common.sh@364 -- # decimal 1 00:29:52.334 01:31:00 -- scripts/common.sh@352 -- # local d=1 00:29:52.334 01:31:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:29:52.334 01:31:00 -- scripts/common.sh@354 -- # echo 1 00:29:52.334 01:31:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:29:52.334 01:31:00 -- scripts/common.sh@365 -- # decimal 2 00:29:52.334 01:31:00 -- scripts/common.sh@352 -- # local d=2 00:29:52.334 01:31:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:29:52.334 01:31:00 -- scripts/common.sh@354 -- # echo 2 00:29:52.334 01:31:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:29:52.335 01:31:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:29:52.335 01:31:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:29:52.335 01:31:00 -- scripts/common.sh@367 -- # return 0 00:29:52.335 01:31:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:29:52.335 01:31:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:29:52.335 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:52.335 --rc genhtml_branch_coverage=1 00:29:52.335 --rc genhtml_function_coverage=1 00:29:52.335 --rc genhtml_legend=1 00:29:52.335 --rc geninfo_all_blocks=1 00:29:52.335 --rc geninfo_unexecuted_blocks=1 00:29:52.335 00:29:52.335 ' 00:29:52.335 01:31:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:29:52.335 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:52.335 --rc genhtml_branch_coverage=1 00:29:52.335 --rc genhtml_function_coverage=1 00:29:52.335 --rc genhtml_legend=1 00:29:52.335 --rc geninfo_all_blocks=1 00:29:52.335 --rc geninfo_unexecuted_blocks=1 00:29:52.335 00:29:52.335 ' 00:29:52.335 01:31:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:29:52.335 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:52.335 --rc genhtml_branch_coverage=1 00:29:52.335 --rc genhtml_function_coverage=1 00:29:52.335 --rc genhtml_legend=1 00:29:52.335 --rc geninfo_all_blocks=1 00:29:52.335 --rc geninfo_unexecuted_blocks=1 00:29:52.335 00:29:52.335 ' 00:29:52.335 01:31:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:29:52.335 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:52.335 --rc genhtml_branch_coverage=1 00:29:52.335 --rc genhtml_function_coverage=1 00:29:52.335 --rc genhtml_legend=1 00:29:52.335 --rc geninfo_all_blocks=1 00:29:52.335 --rc geninfo_unexecuted_blocks=1 00:29:52.335 00:29:52.335 ' 00:29:52.335 01:31:00 -- host/bdevperf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:52.335 01:31:00 -- nvmf/common.sh@7 -- # uname -s 00:29:52.335 01:31:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:52.335 01:31:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:52.335 01:31:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:52.335 01:31:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:52.335 01:31:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:52.335 01:31:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:52.335 01:31:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:52.335 01:31:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:52.335 01:31:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:52.335 01:31:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:52.335 01:31:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:52.335 01:31:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:52.335 01:31:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:52.335 01:31:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:52.335 01:31:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:52.335 01:31:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:52.335 01:31:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:52.335 01:31:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:52.335 01:31:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:52.335 01:31:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:52.335 01:31:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:52.335 01:31:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:52.335 01:31:00 -- paths/export.sh@5 -- # export PATH 00:29:52.335 01:31:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:52.335 01:31:00 -- nvmf/common.sh@46 -- # : 0 00:29:52.335 01:31:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:52.335 01:31:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:52.335 01:31:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:52.335 01:31:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:52.335 01:31:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:52.335 01:31:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:52.335 01:31:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:52.335 01:31:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:52.335 01:31:00 -- host/bdevperf.sh@11 -- # MALLOC_BDEV_SIZE=64 00:29:52.335 01:31:00 -- host/bdevperf.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:29:52.335 01:31:00 -- host/bdevperf.sh@24 -- # nvmftestinit 00:29:52.335 01:31:00 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:52.335 01:31:00 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:52.335 01:31:00 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:52.335 01:31:00 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:52.335 01:31:00 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:52.335 01:31:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:52.335 01:31:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:52.335 01:31:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:52.335 01:31:00 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:52.335 01:31:00 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:52.335 01:31:00 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:52.335 01:31:00 -- common/autotest_common.sh@10 -- # set +x 00:29:54.236 01:31:02 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:54.236 01:31:02 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:54.236 01:31:02 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:54.236 01:31:02 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:54.236 01:31:02 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:54.236 01:31:02 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:54.236 01:31:02 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:54.236 01:31:02 -- nvmf/common.sh@294 -- # net_devs=() 00:29:54.236 01:31:02 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:54.236 01:31:02 -- nvmf/common.sh@295 -- # e810=() 00:29:54.236 01:31:02 -- nvmf/common.sh@295 -- # local -ga e810 00:29:54.236 01:31:02 -- nvmf/common.sh@296 -- # x722=() 00:29:54.236 01:31:02 -- nvmf/common.sh@296 -- # local -ga x722 00:29:54.236 01:31:02 -- nvmf/common.sh@297 -- # mlx=() 00:29:54.236 01:31:02 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:54.236 01:31:02 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:54.236 01:31:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:54.236 01:31:02 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:54.236 01:31:02 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:54.236 01:31:02 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:54.237 01:31:02 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:54.237 01:31:02 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:54.237 01:31:02 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:54.237 01:31:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:54.237 01:31:02 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:54.237 01:31:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:54.237 01:31:02 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:54.237 01:31:02 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:54.237 01:31:02 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:54.237 01:31:02 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:54.237 01:31:02 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:54.237 01:31:02 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:54.237 01:31:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:54.237 01:31:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:54.237 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:54.237 01:31:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:54.237 01:31:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:54.237 01:31:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:54.237 01:31:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:54.237 01:31:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:54.237 01:31:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:54.237 01:31:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:54.237 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:54.237 01:31:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:54.237 01:31:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:54.237 01:31:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:54.237 01:31:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:54.237 01:31:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:54.237 01:31:02 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:54.237 01:31:02 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:54.237 01:31:02 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:54.237 01:31:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:54.237 01:31:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:54.237 01:31:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:54.237 01:31:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:54.237 01:31:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:54.237 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:54.237 01:31:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:54.237 01:31:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:54.237 01:31:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:54.237 01:31:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:54.237 01:31:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:54.237 01:31:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:54.237 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:54.237 01:31:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:54.237 01:31:02 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:54.237 01:31:02 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:54.237 01:31:02 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:54.237 01:31:02 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:54.237 01:31:02 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:54.237 01:31:02 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:54.237 01:31:02 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:54.237 01:31:02 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:54.237 01:31:02 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:54.237 01:31:02 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:54.237 01:31:02 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:54.237 01:31:02 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:54.237 01:31:02 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:54.237 01:31:02 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:54.237 01:31:02 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:54.237 01:31:02 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:54.237 01:31:02 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:54.237 01:31:02 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:54.237 01:31:02 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:54.237 01:31:02 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:54.237 01:31:02 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:54.237 01:31:02 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:54.495 01:31:02 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:54.495 01:31:02 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:54.495 01:31:02 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:54.496 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:54.496 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.207 ms 00:29:54.496 00:29:54.496 --- 10.0.0.2 ping statistics --- 00:29:54.496 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:54.496 rtt min/avg/max/mdev = 0.207/0.207/0.207/0.000 ms 00:29:54.496 01:31:02 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:54.496 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:54.496 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.093 ms 00:29:54.496 00:29:54.496 --- 10.0.0.1 ping statistics --- 00:29:54.496 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:54.496 rtt min/avg/max/mdev = 0.093/0.093/0.093/0.000 ms 00:29:54.496 01:31:02 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:54.496 01:31:02 -- nvmf/common.sh@410 -- # return 0 00:29:54.496 01:31:02 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:29:54.496 01:31:02 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:54.496 01:31:02 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:54.496 01:31:02 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:54.496 01:31:02 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:54.496 01:31:02 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:54.496 01:31:02 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:54.496 01:31:02 -- host/bdevperf.sh@25 -- # tgt_init 00:29:54.496 01:31:02 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:29:54.496 01:31:02 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:54.496 01:31:02 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:54.496 01:31:02 -- common/autotest_common.sh@10 -- # set +x 00:29:54.496 01:31:02 -- nvmf/common.sh@469 -- # nvmfpid=1268046 00:29:54.496 01:31:02 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:29:54.496 01:31:02 -- nvmf/common.sh@470 -- # waitforlisten 1268046 00:29:54.496 01:31:02 -- common/autotest_common.sh@829 -- # '[' -z 1268046 ']' 00:29:54.496 01:31:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:54.496 01:31:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:54.496 01:31:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:54.496 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:54.496 01:31:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:54.496 01:31:02 -- common/autotest_common.sh@10 -- # set +x 00:29:54.496 [2024-11-20 01:31:02.552707] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:54.496 [2024-11-20 01:31:02.552796] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:54.496 EAL: No free 2048 kB hugepages reported on node 1 00:29:54.496 [2024-11-20 01:31:02.619657] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:29:54.496 [2024-11-20 01:31:02.708534] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:54.496 [2024-11-20 01:31:02.708718] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:54.496 [2024-11-20 01:31:02.708736] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:54.496 [2024-11-20 01:31:02.708749] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:54.496 [2024-11-20 01:31:02.708993] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:29:54.496 [2024-11-20 01:31:02.709098] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:29:54.496 [2024-11-20 01:31:02.709116] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:55.431 01:31:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:55.431 01:31:03 -- common/autotest_common.sh@862 -- # return 0 00:29:55.431 01:31:03 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:55.431 01:31:03 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:55.431 01:31:03 -- common/autotest_common.sh@10 -- # set +x 00:29:55.431 01:31:03 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:55.431 01:31:03 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:29:55.431 01:31:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:55.431 01:31:03 -- common/autotest_common.sh@10 -- # set +x 00:29:55.431 [2024-11-20 01:31:03.582469] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:55.431 01:31:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:55.431 01:31:03 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:29:55.431 01:31:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:55.431 01:31:03 -- common/autotest_common.sh@10 -- # set +x 00:29:55.431 Malloc0 00:29:55.431 01:31:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:55.431 01:31:03 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:29:55.431 01:31:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:55.431 01:31:03 -- common/autotest_common.sh@10 -- # set +x 00:29:55.431 01:31:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:55.431 01:31:03 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:29:55.431 01:31:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:55.431 01:31:03 -- common/autotest_common.sh@10 -- # set +x 00:29:55.431 01:31:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:55.431 01:31:03 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:55.431 01:31:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:55.431 01:31:03 -- common/autotest_common.sh@10 -- # set +x 00:29:55.431 [2024-11-20 01:31:03.645393] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:55.688 01:31:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:55.688 01:31:03 -- host/bdevperf.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 128 -o 4096 -w verify -t 1 00:29:55.689 01:31:03 -- host/bdevperf.sh@27 -- # gen_nvmf_target_json 00:29:55.689 01:31:03 -- nvmf/common.sh@520 -- # config=() 00:29:55.689 01:31:03 -- nvmf/common.sh@520 -- # local subsystem config 00:29:55.689 01:31:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:55.689 01:31:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:55.689 { 00:29:55.689 "params": { 00:29:55.689 "name": "Nvme$subsystem", 00:29:55.689 "trtype": "$TEST_TRANSPORT", 00:29:55.689 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:55.689 "adrfam": "ipv4", 00:29:55.689 "trsvcid": "$NVMF_PORT", 00:29:55.689 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:55.689 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:55.689 "hdgst": ${hdgst:-false}, 00:29:55.689 "ddgst": ${ddgst:-false} 00:29:55.689 }, 00:29:55.689 "method": "bdev_nvme_attach_controller" 00:29:55.689 } 00:29:55.689 EOF 00:29:55.689 )") 00:29:55.689 01:31:03 -- nvmf/common.sh@542 -- # cat 00:29:55.689 01:31:03 -- nvmf/common.sh@544 -- # jq . 00:29:55.689 01:31:03 -- nvmf/common.sh@545 -- # IFS=, 00:29:55.689 01:31:03 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:55.689 "params": { 00:29:55.689 "name": "Nvme1", 00:29:55.689 "trtype": "tcp", 00:29:55.689 "traddr": "10.0.0.2", 00:29:55.689 "adrfam": "ipv4", 00:29:55.689 "trsvcid": "4420", 00:29:55.689 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:29:55.689 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:29:55.689 "hdgst": false, 00:29:55.689 "ddgst": false 00:29:55.689 }, 00:29:55.689 "method": "bdev_nvme_attach_controller" 00:29:55.689 }' 00:29:55.689 [2024-11-20 01:31:03.689652] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:55.689 [2024-11-20 01:31:03.689727] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1268207 ] 00:29:55.689 EAL: No free 2048 kB hugepages reported on node 1 00:29:55.689 [2024-11-20 01:31:03.748801] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:55.689 [2024-11-20 01:31:03.832785] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:55.948 Running I/O for 1 seconds... 00:29:56.879 00:29:56.879 Latency(us) 00:29:56.879 [2024-11-20T00:31:05.098Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:56.879 [2024-11-20T00:31:05.098Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:29:56.879 Verification LBA range: start 0x0 length 0x4000 00:29:56.879 Nvme1n1 : 1.01 12891.36 50.36 0.00 0.00 9886.79 1601.99 13786.83 00:29:56.879 [2024-11-20T00:31:05.098Z] =================================================================================================================== 00:29:56.879 [2024-11-20T00:31:05.098Z] Total : 12891.36 50.36 0.00 0.00 9886.79 1601.99 13786.83 00:29:57.136 01:31:05 -- host/bdevperf.sh@30 -- # bdevperfpid=1268365 00:29:57.137 01:31:05 -- host/bdevperf.sh@32 -- # sleep 3 00:29:57.137 01:31:05 -- host/bdevperf.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -q 128 -o 4096 -w verify -t 15 -f 00:29:57.137 01:31:05 -- host/bdevperf.sh@29 -- # gen_nvmf_target_json 00:29:57.137 01:31:05 -- nvmf/common.sh@520 -- # config=() 00:29:57.137 01:31:05 -- nvmf/common.sh@520 -- # local subsystem config 00:29:57.137 01:31:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:57.137 01:31:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:57.137 { 00:29:57.137 "params": { 00:29:57.137 "name": "Nvme$subsystem", 00:29:57.137 "trtype": "$TEST_TRANSPORT", 00:29:57.137 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:57.137 "adrfam": "ipv4", 00:29:57.137 "trsvcid": "$NVMF_PORT", 00:29:57.137 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:57.137 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:57.137 "hdgst": ${hdgst:-false}, 00:29:57.137 "ddgst": ${ddgst:-false} 00:29:57.137 }, 00:29:57.137 "method": "bdev_nvme_attach_controller" 00:29:57.137 } 00:29:57.137 EOF 00:29:57.137 )") 00:29:57.137 01:31:05 -- nvmf/common.sh@542 -- # cat 00:29:57.137 01:31:05 -- nvmf/common.sh@544 -- # jq . 00:29:57.137 01:31:05 -- nvmf/common.sh@545 -- # IFS=, 00:29:57.137 01:31:05 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:57.137 "params": { 00:29:57.137 "name": "Nvme1", 00:29:57.137 "trtype": "tcp", 00:29:57.137 "traddr": "10.0.0.2", 00:29:57.137 "adrfam": "ipv4", 00:29:57.137 "trsvcid": "4420", 00:29:57.137 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:29:57.137 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:29:57.137 "hdgst": false, 00:29:57.137 "ddgst": false 00:29:57.137 }, 00:29:57.137 "method": "bdev_nvme_attach_controller" 00:29:57.137 }' 00:29:57.393 [2024-11-20 01:31:05.364734] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:57.393 [2024-11-20 01:31:05.364807] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1268365 ] 00:29:57.393 EAL: No free 2048 kB hugepages reported on node 1 00:29:57.393 [2024-11-20 01:31:05.428836] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:57.393 [2024-11-20 01:31:05.513117] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:57.651 Running I/O for 15 seconds... 00:30:00.185 01:31:08 -- host/bdevperf.sh@33 -- # kill -9 1268046 00:30:00.185 01:31:08 -- host/bdevperf.sh@35 -- # sleep 3 00:30:00.185 [2024-11-20 01:31:08.332827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:7424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.185 [2024-11-20 01:31:08.332898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.185 [2024-11-20 01:31:08.332932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:7432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.185 [2024-11-20 01:31:08.332951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.185 [2024-11-20 01:31:08.332971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:6864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.185 [2024-11-20 01:31:08.332988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.185 [2024-11-20 01:31:08.333007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:6872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.185 [2024-11-20 01:31:08.333024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.185 [2024-11-20 01:31:08.333042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:6896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.185 [2024-11-20 01:31:08.333057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.185 [2024-11-20 01:31:08.333083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:6920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.185 [2024-11-20 01:31:08.333122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.186 [2024-11-20 01:31:08.333140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:6928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.186 [2024-11-20 01:31:08.333155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.186 [2024-11-20 01:31:08.333171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:6952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.186 [2024-11-20 01:31:08.333184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.186 [2024-11-20 01:31:08.333200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:6976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.186 [2024-11-20 01:31:08.333215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.186 [2024-11-20 01:31:08.333230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:6984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.186 [2024-11-20 01:31:08.333244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.186 [2024-11-20 01:31:08.333261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:7456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.186 [2024-11-20 01:31:08.333275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.186 [2024-11-20 01:31:08.333291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:7464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.186 [2024-11-20 01:31:08.333306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.186 [2024-11-20 01:31:08.333322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:7472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.186 [2024-11-20 01:31:08.333338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.186 [2024-11-20 01:31:08.333374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:7480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.186 [2024-11-20 01:31:08.333389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.186 [2024-11-20 01:31:08.333403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:7488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.186 [2024-11-20 01:31:08.333432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.186 [2024-11-20 01:31:08.333450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:6992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.186 [2024-11-20 01:31:08.333465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.186 [2024-11-20 01:31:08.333482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:7032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.186 [2024-11-20 01:31:08.333497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.186 [2024-11-20 01:31:08.333515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:7040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.186 [2024-11-20 01:31:08.333531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.186 [2024-11-20 01:31:08.333548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:7080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.186 [2024-11-20 01:31:08.333563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.186 [2024-11-20 01:31:08.333580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:7128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.186 [2024-11-20 01:31:08.333595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.186 [2024-11-20 01:31:08.333612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:7136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.186 [2024-11-20 01:31:08.333627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.186 [2024-11-20 01:31:08.333644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:7144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.186 [2024-11-20 01:31:08.333659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.186 [2024-11-20 01:31:08.333676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:7168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.186 [2024-11-20 01:31:08.333691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.186 [2024-11-20 01:31:08.333708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:7512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.186 [2024-11-20 01:31:08.333724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.186 [2024-11-20 01:31:08.333741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:7520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.186 [2024-11-20 01:31:08.333756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.186 [2024-11-20 01:31:08.333773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:7528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.186 [2024-11-20 01:31:08.333789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.186 [2024-11-20 01:31:08.333809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:7536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.186 [2024-11-20 01:31:08.333826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.186 [2024-11-20 01:31:08.333843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:7544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.186 [2024-11-20 01:31:08.333858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.186 [2024-11-20 01:31:08.333875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:7552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.186 [2024-11-20 01:31:08.333890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.186 [2024-11-20 01:31:08.333907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:7560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.186 [2024-11-20 01:31:08.333923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.186 [2024-11-20 01:31:08.333940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:7568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.186 [2024-11-20 01:31:08.333956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.186 [2024-11-20 01:31:08.333973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:7576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.186 [2024-11-20 01:31:08.333988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.186 [2024-11-20 01:31:08.334005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:7584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.186 [2024-11-20 01:31:08.334020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.186 [2024-11-20 01:31:08.334038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:7592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.186 [2024-11-20 01:31:08.334053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.186 [2024-11-20 01:31:08.334077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:7600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.186 [2024-11-20 01:31:08.334096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.186 [2024-11-20 01:31:08.334138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:7608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.186 [2024-11-20 01:31:08.334153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.186 [2024-11-20 01:31:08.334168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:7616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.186 [2024-11-20 01:31:08.334182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.186 [2024-11-20 01:31:08.334197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:7624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.187 [2024-11-20 01:31:08.334211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.187 [2024-11-20 01:31:08.334230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:7632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.187 [2024-11-20 01:31:08.334248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.187 [2024-11-20 01:31:08.334263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:7640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.187 [2024-11-20 01:31:08.334277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.187 [2024-11-20 01:31:08.334293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:7648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.187 [2024-11-20 01:31:08.334306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.187 [2024-11-20 01:31:08.334321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:7656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.187 [2024-11-20 01:31:08.334334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.187 [2024-11-20 01:31:08.334365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:7664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.187 [2024-11-20 01:31:08.334382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.187 [2024-11-20 01:31:08.334399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:7672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.187 [2024-11-20 01:31:08.334414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.187 [2024-11-20 01:31:08.334431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:7680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.187 [2024-11-20 01:31:08.334446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.187 [2024-11-20 01:31:08.334463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:7688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.187 [2024-11-20 01:31:08.334478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.187 [2024-11-20 01:31:08.334495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:7696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.187 [2024-11-20 01:31:08.334510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.187 [2024-11-20 01:31:08.334527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:7704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.187 [2024-11-20 01:31:08.334543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.187 [2024-11-20 01:31:08.334559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:7712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.187 [2024-11-20 01:31:08.334575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.187 [2024-11-20 01:31:08.334592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:7720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.187 [2024-11-20 01:31:08.334607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.187 [2024-11-20 01:31:08.334624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:7728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.187 [2024-11-20 01:31:08.334639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.187 [2024-11-20 01:31:08.334663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:7736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.187 [2024-11-20 01:31:08.334679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.187 [2024-11-20 01:31:08.334696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:7744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.187 [2024-11-20 01:31:08.334712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.187 [2024-11-20 01:31:08.334728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:7752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.187 [2024-11-20 01:31:08.334744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.187 [2024-11-20 01:31:08.334760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:7760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.187 [2024-11-20 01:31:08.334775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.187 [2024-11-20 01:31:08.334791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:7768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.187 [2024-11-20 01:31:08.334807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.187 [2024-11-20 01:31:08.334824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:7776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.187 [2024-11-20 01:31:08.334839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.187 [2024-11-20 01:31:08.334856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:7784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.187 [2024-11-20 01:31:08.334870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.187 [2024-11-20 01:31:08.334887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:7792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.187 [2024-11-20 01:31:08.334902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.187 [2024-11-20 01:31:08.334919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:7800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.187 [2024-11-20 01:31:08.334935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.187 [2024-11-20 01:31:08.334952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:7808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.187 [2024-11-20 01:31:08.334967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.187 [2024-11-20 01:31:08.334985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:7816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.187 [2024-11-20 01:31:08.335000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.187 [2024-11-20 01:31:08.335017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:7824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.187 [2024-11-20 01:31:08.335032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.187 [2024-11-20 01:31:08.335049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:7832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.187 [2024-11-20 01:31:08.335065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.187 [2024-11-20 01:31:08.335096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:7840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.187 [2024-11-20 01:31:08.335132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.187 [2024-11-20 01:31:08.335150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:7848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.187 [2024-11-20 01:31:08.335164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.187 [2024-11-20 01:31:08.335180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:7856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.187 [2024-11-20 01:31:08.335194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.187 [2024-11-20 01:31:08.335209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:7864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.187 [2024-11-20 01:31:08.335223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.187 [2024-11-20 01:31:08.335239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:7872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.187 [2024-11-20 01:31:08.335253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.187 [2024-11-20 01:31:08.335269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:7880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.188 [2024-11-20 01:31:08.335283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.188 [2024-11-20 01:31:08.335298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:7888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.188 [2024-11-20 01:31:08.335311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.188 [2024-11-20 01:31:08.335327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:7896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.188 [2024-11-20 01:31:08.335340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.188 [2024-11-20 01:31:08.335356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:7904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.188 [2024-11-20 01:31:08.335386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.188 [2024-11-20 01:31:08.335403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:7912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.188 [2024-11-20 01:31:08.335418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.188 [2024-11-20 01:31:08.335435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:7920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.188 [2024-11-20 01:31:08.335450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.188 [2024-11-20 01:31:08.335466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:7928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.188 [2024-11-20 01:31:08.335482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.188 [2024-11-20 01:31:08.335498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:7936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.188 [2024-11-20 01:31:08.335518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.188 [2024-11-20 01:31:08.335535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.188 [2024-11-20 01:31:08.335551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.188 [2024-11-20 01:31:08.335567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:7952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.188 [2024-11-20 01:31:08.335582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.188 [2024-11-20 01:31:08.335599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:7960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.188 [2024-11-20 01:31:08.335615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.188 [2024-11-20 01:31:08.335631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:7968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.188 [2024-11-20 01:31:08.335647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.188 [2024-11-20 01:31:08.335663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:7976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.188 [2024-11-20 01:31:08.335679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.188 [2024-11-20 01:31:08.335695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:7984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.188 [2024-11-20 01:31:08.335711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.188 [2024-11-20 01:31:08.335728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:7992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.188 [2024-11-20 01:31:08.335743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.188 [2024-11-20 01:31:08.335760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:8000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.188 [2024-11-20 01:31:08.335775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.188 [2024-11-20 01:31:08.335791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:8008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.188 [2024-11-20 01:31:08.335806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.188 [2024-11-20 01:31:08.335822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:8016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.188 [2024-11-20 01:31:08.335838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.188 [2024-11-20 01:31:08.335854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:7192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.188 [2024-11-20 01:31:08.335870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.188 [2024-11-20 01:31:08.335886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:7208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.188 [2024-11-20 01:31:08.335901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.188 [2024-11-20 01:31:08.335922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:7232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.188 [2024-11-20 01:31:08.335938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.188 [2024-11-20 01:31:08.335955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:7248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.188 [2024-11-20 01:31:08.335970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.188 [2024-11-20 01:31:08.335987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:7256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.188 [2024-11-20 01:31:08.336002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.188 [2024-11-20 01:31:08.336019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:7264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.188 [2024-11-20 01:31:08.336034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.188 [2024-11-20 01:31:08.336050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:7288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.188 [2024-11-20 01:31:08.336066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.188 [2024-11-20 01:31:08.336094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:7328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.188 [2024-11-20 01:31:08.336135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.188 [2024-11-20 01:31:08.336152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:8024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.188 [2024-11-20 01:31:08.336166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.188 [2024-11-20 01:31:08.336181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:8032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.188 [2024-11-20 01:31:08.336195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.188 [2024-11-20 01:31:08.336210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:8040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.188 [2024-11-20 01:31:08.336224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.188 [2024-11-20 01:31:08.336239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:8048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.188 [2024-11-20 01:31:08.336253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.188 [2024-11-20 01:31:08.336267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:8056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.188 [2024-11-20 01:31:08.336282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.188 [2024-11-20 01:31:08.336297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:8064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.188 [2024-11-20 01:31:08.336310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.188 [2024-11-20 01:31:08.336325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:8072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.188 [2024-11-20 01:31:08.336339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.188 [2024-11-20 01:31:08.336374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:8080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.188 [2024-11-20 01:31:08.336391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.188 [2024-11-20 01:31:08.336407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:8088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.188 [2024-11-20 01:31:08.336422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.188 [2024-11-20 01:31:08.336439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:8096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.189 [2024-11-20 01:31:08.336454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.189 [2024-11-20 01:31:08.336471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:8104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.189 [2024-11-20 01:31:08.336486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.189 [2024-11-20 01:31:08.336503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:8112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.189 [2024-11-20 01:31:08.336518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.189 [2024-11-20 01:31:08.336534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:8120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.189 [2024-11-20 01:31:08.336550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.189 [2024-11-20 01:31:08.336567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:8128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.189 [2024-11-20 01:31:08.336582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.189 [2024-11-20 01:31:08.336598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:8136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.189 [2024-11-20 01:31:08.336613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.189 [2024-11-20 01:31:08.336630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:8144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.189 [2024-11-20 01:31:08.336645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.189 [2024-11-20 01:31:08.336662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:8152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.189 [2024-11-20 01:31:08.336677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.189 [2024-11-20 01:31:08.336694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:8160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.189 [2024-11-20 01:31:08.336709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.189 [2024-11-20 01:31:08.336726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:8168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.189 [2024-11-20 01:31:08.336741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.189 [2024-11-20 01:31:08.336757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:8176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.189 [2024-11-20 01:31:08.336776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.189 [2024-11-20 01:31:08.336793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:8184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.189 [2024-11-20 01:31:08.336808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.189 [2024-11-20 01:31:08.336825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:8192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.189 [2024-11-20 01:31:08.336840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.189 [2024-11-20 01:31:08.336856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:8200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.189 [2024-11-20 01:31:08.336871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.189 [2024-11-20 01:31:08.336888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:8208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.189 [2024-11-20 01:31:08.336903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.189 [2024-11-20 01:31:08.336920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:8216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.189 [2024-11-20 01:31:08.336935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.189 [2024-11-20 01:31:08.336951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:7392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.189 [2024-11-20 01:31:08.336966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.189 [2024-11-20 01:31:08.336983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:7400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.189 [2024-11-20 01:31:08.336998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.189 [2024-11-20 01:31:08.337014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:7408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.189 [2024-11-20 01:31:08.337029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.189 [2024-11-20 01:31:08.337046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:7416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.189 [2024-11-20 01:31:08.337060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.189 [2024-11-20 01:31:08.337084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:7440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.189 [2024-11-20 01:31:08.337101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.189 [2024-11-20 01:31:08.337131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:7448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.189 [2024-11-20 01:31:08.337144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.189 [2024-11-20 01:31:08.337160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:7496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.189 [2024-11-20 01:31:08.337174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.189 [2024-11-20 01:31:08.337201] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1db99a0 is same with the state(5) to be set 00:30:00.189 [2024-11-20 01:31:08.337223] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:30:00.189 [2024-11-20 01:31:08.337235] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:30:00.189 [2024-11-20 01:31:08.337247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:7504 len:8 PRP1 0x0 PRP2 0x0 00:30:00.189 [2024-11-20 01:31:08.337260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.189 [2024-11-20 01:31:08.337325] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1db99a0 was disconnected and freed. reset controller. 00:30:00.189 [2024-11-20 01:31:08.337415] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:30:00.189 [2024-11-20 01:31:08.337440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.189 [2024-11-20 01:31:08.337456] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:30:00.189 [2024-11-20 01:31:08.337471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.189 [2024-11-20 01:31:08.337487] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:30:00.189 [2024-11-20 01:31:08.337501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.189 [2024-11-20 01:31:08.337516] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:30:00.189 [2024-11-20 01:31:08.337531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:00.189 [2024-11-20 01:31:08.337545] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.189 [2024-11-20 01:31:08.340198] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.189 [2024-11-20 01:31:08.340234] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.189 [2024-11-20 01:31:08.340718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.189 [2024-11-20 01:31:08.340894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.189 [2024-11-20 01:31:08.340943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.189 [2024-11-20 01:31:08.340962] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.189 [2024-11-20 01:31:08.341191] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.189 [2024-11-20 01:31:08.341344] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.189 [2024-11-20 01:31:08.341379] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.189 [2024-11-20 01:31:08.341395] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.189 [2024-11-20 01:31:08.343958] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.189 [2024-11-20 01:31:08.352865] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.189 [2024-11-20 01:31:08.353169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.189 [2024-11-20 01:31:08.353272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.189 [2024-11-20 01:31:08.353307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.189 [2024-11-20 01:31:08.353326] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.190 [2024-11-20 01:31:08.353509] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.190 [2024-11-20 01:31:08.353642] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.190 [2024-11-20 01:31:08.353665] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.190 [2024-11-20 01:31:08.353680] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.190 [2024-11-20 01:31:08.356089] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.190 [2024-11-20 01:31:08.365421] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.190 [2024-11-20 01:31:08.365778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.190 [2024-11-20 01:31:08.365882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.190 [2024-11-20 01:31:08.365911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.190 [2024-11-20 01:31:08.365928] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.190 [2024-11-20 01:31:08.366103] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.190 [2024-11-20 01:31:08.366272] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.190 [2024-11-20 01:31:08.366295] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.190 [2024-11-20 01:31:08.366310] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.190 [2024-11-20 01:31:08.368821] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.190 [2024-11-20 01:31:08.378057] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.190 [2024-11-20 01:31:08.378346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.190 [2024-11-20 01:31:08.378504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.190 [2024-11-20 01:31:08.378533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.190 [2024-11-20 01:31:08.378550] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.190 [2024-11-20 01:31:08.378732] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.190 [2024-11-20 01:31:08.378901] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.190 [2024-11-20 01:31:08.378924] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.190 [2024-11-20 01:31:08.378939] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.190 [2024-11-20 01:31:08.381300] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.190 [2024-11-20 01:31:08.390511] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.190 [2024-11-20 01:31:08.390837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.190 [2024-11-20 01:31:08.390958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.190 [2024-11-20 01:31:08.390984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.190 [2024-11-20 01:31:08.391005] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.190 [2024-11-20 01:31:08.391162] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.190 [2024-11-20 01:31:08.391346] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.190 [2024-11-20 01:31:08.391370] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.190 [2024-11-20 01:31:08.391385] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.190 [2024-11-20 01:31:08.393661] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.450 [2024-11-20 01:31:08.402992] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.450 [2024-11-20 01:31:08.403324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.450 [2024-11-20 01:31:08.403460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.450 [2024-11-20 01:31:08.403489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.450 [2024-11-20 01:31:08.403507] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.450 [2024-11-20 01:31:08.403689] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.450 [2024-11-20 01:31:08.403840] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.450 [2024-11-20 01:31:08.403863] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.450 [2024-11-20 01:31:08.403878] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.450 [2024-11-20 01:31:08.406148] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.450 [2024-11-20 01:31:08.415769] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.450 [2024-11-20 01:31:08.416044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.450 [2024-11-20 01:31:08.416236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.450 [2024-11-20 01:31:08.416262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.450 [2024-11-20 01:31:08.416278] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.450 [2024-11-20 01:31:08.416474] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.450 [2024-11-20 01:31:08.416679] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.450 [2024-11-20 01:31:08.416701] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.450 [2024-11-20 01:31:08.416716] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.450 [2024-11-20 01:31:08.419046] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.450 [2024-11-20 01:31:08.428473] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.450 [2024-11-20 01:31:08.428795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.450 [2024-11-20 01:31:08.428930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.450 [2024-11-20 01:31:08.428973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.451 [2024-11-20 01:31:08.428989] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.451 [2024-11-20 01:31:08.429183] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.451 [2024-11-20 01:31:08.429394] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.451 [2024-11-20 01:31:08.429418] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.451 [2024-11-20 01:31:08.429433] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.451 [2024-11-20 01:31:08.431815] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.451 [2024-11-20 01:31:08.440834] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.451 [2024-11-20 01:31:08.441138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.451 [2024-11-20 01:31:08.441257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.451 [2024-11-20 01:31:08.441285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.451 [2024-11-20 01:31:08.441303] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.451 [2024-11-20 01:31:08.441449] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.451 [2024-11-20 01:31:08.441582] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.451 [2024-11-20 01:31:08.441605] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.451 [2024-11-20 01:31:08.441620] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.451 [2024-11-20 01:31:08.443878] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.451 [2024-11-20 01:31:08.453296] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.451 [2024-11-20 01:31:08.453629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.451 [2024-11-20 01:31:08.453822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.451 [2024-11-20 01:31:08.453850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.451 [2024-11-20 01:31:08.453868] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.451 [2024-11-20 01:31:08.454033] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.451 [2024-11-20 01:31:08.454213] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.451 [2024-11-20 01:31:08.454237] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.451 [2024-11-20 01:31:08.454252] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.451 [2024-11-20 01:31:08.456204] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.451 [2024-11-20 01:31:08.465759] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.451 [2024-11-20 01:31:08.466039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.451 [2024-11-20 01:31:08.466161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.451 [2024-11-20 01:31:08.466191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.451 [2024-11-20 01:31:08.466209] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.451 [2024-11-20 01:31:08.466393] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.451 [2024-11-20 01:31:08.466586] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.451 [2024-11-20 01:31:08.466610] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.451 [2024-11-20 01:31:08.466625] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.451 [2024-11-20 01:31:08.468987] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.451 [2024-11-20 01:31:08.478460] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.451 [2024-11-20 01:31:08.478838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.451 [2024-11-20 01:31:08.478994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.451 [2024-11-20 01:31:08.479023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.451 [2024-11-20 01:31:08.479041] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.451 [2024-11-20 01:31:08.479232] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.451 [2024-11-20 01:31:08.479420] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.451 [2024-11-20 01:31:08.479443] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.451 [2024-11-20 01:31:08.479459] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.451 [2024-11-20 01:31:08.482040] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.451 [2024-11-20 01:31:08.490895] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.451 [2024-11-20 01:31:08.491218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.451 [2024-11-20 01:31:08.491365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.451 [2024-11-20 01:31:08.491393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.451 [2024-11-20 01:31:08.491411] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.451 [2024-11-20 01:31:08.491577] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.451 [2024-11-20 01:31:08.491763] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.451 [2024-11-20 01:31:08.491786] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.451 [2024-11-20 01:31:08.491801] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.451 [2024-11-20 01:31:08.493987] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.451 [2024-11-20 01:31:08.503736] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.451 [2024-11-20 01:31:08.504084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.451 [2024-11-20 01:31:08.504246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.451 [2024-11-20 01:31:08.504275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.451 [2024-11-20 01:31:08.504292] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.451 [2024-11-20 01:31:08.504457] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.451 [2024-11-20 01:31:08.504626] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.451 [2024-11-20 01:31:08.504655] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.451 [2024-11-20 01:31:08.504671] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.451 [2024-11-20 01:31:08.507019] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.451 [2024-11-20 01:31:08.516372] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.451 [2024-11-20 01:31:08.516646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.451 [2024-11-20 01:31:08.516769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.451 [2024-11-20 01:31:08.516795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.451 [2024-11-20 01:31:08.516812] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.451 [2024-11-20 01:31:08.517006] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.451 [2024-11-20 01:31:08.517224] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.451 [2024-11-20 01:31:08.517249] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.451 [2024-11-20 01:31:08.517263] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.451 [2024-11-20 01:31:08.519377] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.451 [2024-11-20 01:31:08.529398] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.451 [2024-11-20 01:31:08.529653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.451 [2024-11-20 01:31:08.529802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.451 [2024-11-20 01:31:08.529828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.451 [2024-11-20 01:31:08.529844] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.452 [2024-11-20 01:31:08.530000] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.452 [2024-11-20 01:31:08.530161] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.452 [2024-11-20 01:31:08.530185] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.452 [2024-11-20 01:31:08.530201] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.452 [2024-11-20 01:31:08.532446] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.452 [2024-11-20 01:31:08.541954] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.452 [2024-11-20 01:31:08.542267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.452 [2024-11-20 01:31:08.542383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.452 [2024-11-20 01:31:08.542427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.452 [2024-11-20 01:31:08.542443] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.452 [2024-11-20 01:31:08.542623] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.452 [2024-11-20 01:31:08.542837] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.452 [2024-11-20 01:31:08.542860] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.452 [2024-11-20 01:31:08.542882] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.452 [2024-11-20 01:31:08.545388] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.452 [2024-11-20 01:31:08.554626] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.452 [2024-11-20 01:31:08.554906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.452 [2024-11-20 01:31:08.555043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.452 [2024-11-20 01:31:08.555083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.452 [2024-11-20 01:31:08.555103] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.452 [2024-11-20 01:31:08.555268] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.452 [2024-11-20 01:31:08.555455] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.452 [2024-11-20 01:31:08.555478] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.452 [2024-11-20 01:31:08.555493] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.452 [2024-11-20 01:31:08.557698] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.452 [2024-11-20 01:31:08.567310] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.452 [2024-11-20 01:31:08.567601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.452 [2024-11-20 01:31:08.567733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.452 [2024-11-20 01:31:08.567762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.452 [2024-11-20 01:31:08.567779] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.452 [2024-11-20 01:31:08.567944] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.452 [2024-11-20 01:31:08.568125] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.452 [2024-11-20 01:31:08.568149] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.452 [2024-11-20 01:31:08.568164] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.452 [2024-11-20 01:31:08.570587] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.452 [2024-11-20 01:31:08.579728] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.452 [2024-11-20 01:31:08.580025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.452 [2024-11-20 01:31:08.580214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.452 [2024-11-20 01:31:08.580240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.452 [2024-11-20 01:31:08.580256] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.452 [2024-11-20 01:31:08.580449] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.452 [2024-11-20 01:31:08.580643] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.452 [2024-11-20 01:31:08.580666] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.452 [2024-11-20 01:31:08.580682] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.452 [2024-11-20 01:31:08.583020] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.452 [2024-11-20 01:31:08.592341] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.452 [2024-11-20 01:31:08.592581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.452 [2024-11-20 01:31:08.592741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.452 [2024-11-20 01:31:08.592770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.452 [2024-11-20 01:31:08.592787] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.452 [2024-11-20 01:31:08.592988] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.452 [2024-11-20 01:31:08.593155] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.452 [2024-11-20 01:31:08.593179] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.452 [2024-11-20 01:31:08.593195] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.452 [2024-11-20 01:31:08.595328] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.452 [2024-11-20 01:31:08.604836] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.452 [2024-11-20 01:31:08.605217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.452 [2024-11-20 01:31:08.605349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.452 [2024-11-20 01:31:08.605398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.452 [2024-11-20 01:31:08.605415] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.452 [2024-11-20 01:31:08.605560] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.452 [2024-11-20 01:31:08.605739] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.452 [2024-11-20 01:31:08.605763] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.452 [2024-11-20 01:31:08.605779] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.452 [2024-11-20 01:31:08.608210] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.452 [2024-11-20 01:31:08.617458] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.452 [2024-11-20 01:31:08.617811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.452 [2024-11-20 01:31:08.617968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.452 [2024-11-20 01:31:08.617997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.452 [2024-11-20 01:31:08.618015] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.452 [2024-11-20 01:31:08.618210] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.452 [2024-11-20 01:31:08.618416] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.452 [2024-11-20 01:31:08.618439] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.452 [2024-11-20 01:31:08.618454] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.452 [2024-11-20 01:31:08.620738] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.452 [2024-11-20 01:31:08.629991] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.452 [2024-11-20 01:31:08.630332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.452 [2024-11-20 01:31:08.630475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.452 [2024-11-20 01:31:08.630500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.452 [2024-11-20 01:31:08.630516] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.453 [2024-11-20 01:31:08.630731] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.453 [2024-11-20 01:31:08.630846] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.453 [2024-11-20 01:31:08.630869] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.453 [2024-11-20 01:31:08.630883] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.453 [2024-11-20 01:31:08.633206] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.453 [2024-11-20 01:31:08.642425] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.453 [2024-11-20 01:31:08.642733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.453 [2024-11-20 01:31:08.642891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.453 [2024-11-20 01:31:08.642917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.453 [2024-11-20 01:31:08.642933] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.453 [2024-11-20 01:31:08.643063] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.453 [2024-11-20 01:31:08.643303] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.453 [2024-11-20 01:31:08.643327] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.453 [2024-11-20 01:31:08.643342] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.453 [2024-11-20 01:31:08.645670] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.453 [2024-11-20 01:31:08.655020] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.453 [2024-11-20 01:31:08.655328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.453 [2024-11-20 01:31:08.655497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.453 [2024-11-20 01:31:08.655523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.453 [2024-11-20 01:31:08.655539] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.453 [2024-11-20 01:31:08.655718] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.453 [2024-11-20 01:31:08.655890] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.453 [2024-11-20 01:31:08.655913] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.453 [2024-11-20 01:31:08.655928] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.453 [2024-11-20 01:31:08.658230] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.713 [2024-11-20 01:31:08.667690] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.713 [2024-11-20 01:31:08.667954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.713 [2024-11-20 01:31:08.668094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.713 [2024-11-20 01:31:08.668124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.713 [2024-11-20 01:31:08.668142] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.713 [2024-11-20 01:31:08.668289] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.713 [2024-11-20 01:31:08.668458] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.713 [2024-11-20 01:31:08.668481] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.713 [2024-11-20 01:31:08.668497] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.713 [2024-11-20 01:31:08.670700] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.713 [2024-11-20 01:31:08.680337] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.713 [2024-11-20 01:31:08.680591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.713 [2024-11-20 01:31:08.680727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.713 [2024-11-20 01:31:08.680757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.713 [2024-11-20 01:31:08.680775] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.713 [2024-11-20 01:31:08.680940] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.713 [2024-11-20 01:31:08.681139] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.713 [2024-11-20 01:31:08.681164] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.713 [2024-11-20 01:31:08.681179] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.713 [2024-11-20 01:31:08.683507] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.713 [2024-11-20 01:31:08.692690] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.713 [2024-11-20 01:31:08.692985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.713 [2024-11-20 01:31:08.693148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.713 [2024-11-20 01:31:08.693189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.713 [2024-11-20 01:31:08.693207] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.713 [2024-11-20 01:31:08.693354] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.713 [2024-11-20 01:31:08.693559] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.713 [2024-11-20 01:31:08.693582] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.713 [2024-11-20 01:31:08.693597] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.713 [2024-11-20 01:31:08.696131] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.713 [2024-11-20 01:31:08.705270] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.713 [2024-11-20 01:31:08.705581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.713 [2024-11-20 01:31:08.705702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.713 [2024-11-20 01:31:08.705733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.713 [2024-11-20 01:31:08.705750] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.713 [2024-11-20 01:31:08.705904] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.713 [2024-11-20 01:31:08.706085] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.713 [2024-11-20 01:31:08.706109] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.713 [2024-11-20 01:31:08.706124] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.713 [2024-11-20 01:31:08.708449] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.713 [2024-11-20 01:31:08.717894] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.713 [2024-11-20 01:31:08.718204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.713 [2024-11-20 01:31:08.718329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.713 [2024-11-20 01:31:08.718358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.713 [2024-11-20 01:31:08.718376] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.713 [2024-11-20 01:31:08.718541] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.713 [2024-11-20 01:31:08.718709] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.713 [2024-11-20 01:31:08.718732] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.713 [2024-11-20 01:31:08.718747] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.713 [2024-11-20 01:31:08.721090] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.713 [2024-11-20 01:31:08.730537] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.713 [2024-11-20 01:31:08.730840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.713 [2024-11-20 01:31:08.730973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.713 [2024-11-20 01:31:08.731002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.713 [2024-11-20 01:31:08.731019] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.713 [2024-11-20 01:31:08.731176] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.714 [2024-11-20 01:31:08.731346] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.714 [2024-11-20 01:31:08.731368] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.714 [2024-11-20 01:31:08.731384] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.714 [2024-11-20 01:31:08.733803] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.714 [2024-11-20 01:31:08.743050] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.714 [2024-11-20 01:31:08.743438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.714 [2024-11-20 01:31:08.743580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.714 [2024-11-20 01:31:08.743620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.714 [2024-11-20 01:31:08.743643] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.714 [2024-11-20 01:31:08.743772] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.714 [2024-11-20 01:31:08.743977] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.714 [2024-11-20 01:31:08.744000] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.714 [2024-11-20 01:31:08.744015] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.714 [2024-11-20 01:31:08.746352] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.714 [2024-11-20 01:31:08.755761] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.714 [2024-11-20 01:31:08.756081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.714 [2024-11-20 01:31:08.756204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.714 [2024-11-20 01:31:08.756230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.714 [2024-11-20 01:31:08.756245] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.714 [2024-11-20 01:31:08.756398] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.714 [2024-11-20 01:31:08.756567] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.714 [2024-11-20 01:31:08.756590] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.714 [2024-11-20 01:31:08.756605] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.714 [2024-11-20 01:31:08.758917] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.714 [2024-11-20 01:31:08.768031] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.714 [2024-11-20 01:31:08.768346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.714 [2024-11-20 01:31:08.768481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.714 [2024-11-20 01:31:08.768509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.714 [2024-11-20 01:31:08.768526] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.714 [2024-11-20 01:31:08.768726] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.714 [2024-11-20 01:31:08.768876] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.714 [2024-11-20 01:31:08.768899] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.714 [2024-11-20 01:31:08.768915] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.714 [2024-11-20 01:31:08.771124] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.714 [2024-11-20 01:31:08.780467] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.714 [2024-11-20 01:31:08.780765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.714 [2024-11-20 01:31:08.780976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.714 [2024-11-20 01:31:08.781005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.714 [2024-11-20 01:31:08.781022] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.714 [2024-11-20 01:31:08.781257] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.714 [2024-11-20 01:31:08.781409] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.714 [2024-11-20 01:31:08.781432] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.714 [2024-11-20 01:31:08.781446] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.714 [2024-11-20 01:31:08.783775] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.714 [2024-11-20 01:31:08.793212] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.714 [2024-11-20 01:31:08.793541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.714 [2024-11-20 01:31:08.793664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.714 [2024-11-20 01:31:08.793690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.714 [2024-11-20 01:31:08.793706] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.714 [2024-11-20 01:31:08.793880] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.714 [2024-11-20 01:31:08.794067] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.714 [2024-11-20 01:31:08.794102] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.714 [2024-11-20 01:31:08.794117] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.714 [2024-11-20 01:31:08.796198] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.714 [2024-11-20 01:31:08.805942] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.714 [2024-11-20 01:31:08.806251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.714 [2024-11-20 01:31:08.806403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.714 [2024-11-20 01:31:08.806429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.714 [2024-11-20 01:31:08.806445] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.714 [2024-11-20 01:31:08.806608] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.714 [2024-11-20 01:31:08.806772] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.714 [2024-11-20 01:31:08.806795] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.714 [2024-11-20 01:31:08.806810] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.714 [2024-11-20 01:31:08.809207] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.714 [2024-11-20 01:31:08.818349] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.714 [2024-11-20 01:31:08.818626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.714 [2024-11-20 01:31:08.818760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.714 [2024-11-20 01:31:08.818791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.714 [2024-11-20 01:31:08.818808] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.714 [2024-11-20 01:31:08.818955] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.714 [2024-11-20 01:31:08.819122] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.714 [2024-11-20 01:31:08.819146] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.714 [2024-11-20 01:31:08.819162] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.714 [2024-11-20 01:31:08.821406] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.714 [2024-11-20 01:31:08.830953] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.714 [2024-11-20 01:31:08.831280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.714 [2024-11-20 01:31:08.831415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.714 [2024-11-20 01:31:08.831443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.714 [2024-11-20 01:31:08.831461] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.714 [2024-11-20 01:31:08.831643] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.714 [2024-11-20 01:31:08.831776] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.714 [2024-11-20 01:31:08.831799] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.714 [2024-11-20 01:31:08.831814] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.714 [2024-11-20 01:31:08.834137] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.715 [2024-11-20 01:31:08.843438] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.715 [2024-11-20 01:31:08.843775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.715 [2024-11-20 01:31:08.843925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.715 [2024-11-20 01:31:08.843951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.715 [2024-11-20 01:31:08.843968] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.715 [2024-11-20 01:31:08.844159] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.715 [2024-11-20 01:31:08.844322] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.715 [2024-11-20 01:31:08.844358] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.715 [2024-11-20 01:31:08.844371] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.715 [2024-11-20 01:31:08.846593] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.715 [2024-11-20 01:31:08.856045] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.715 [2024-11-20 01:31:08.856326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.715 [2024-11-20 01:31:08.856449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.715 [2024-11-20 01:31:08.856477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.715 [2024-11-20 01:31:08.856495] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.715 [2024-11-20 01:31:08.856641] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.715 [2024-11-20 01:31:08.856792] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.715 [2024-11-20 01:31:08.856820] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.715 [2024-11-20 01:31:08.856836] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.715 [2024-11-20 01:31:08.859199] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.715 [2024-11-20 01:31:08.868750] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.715 [2024-11-20 01:31:08.869043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.715 [2024-11-20 01:31:08.869253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.715 [2024-11-20 01:31:08.869283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.715 [2024-11-20 01:31:08.869301] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.715 [2024-11-20 01:31:08.869449] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.715 [2024-11-20 01:31:08.869600] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.715 [2024-11-20 01:31:08.869622] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.715 [2024-11-20 01:31:08.869637] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.715 [2024-11-20 01:31:08.872019] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.715 [2024-11-20 01:31:08.881233] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.715 [2024-11-20 01:31:08.881585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.715 [2024-11-20 01:31:08.881741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.715 [2024-11-20 01:31:08.881770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.715 [2024-11-20 01:31:08.881787] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.715 [2024-11-20 01:31:08.881933] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.715 [2024-11-20 01:31:08.882067] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.715 [2024-11-20 01:31:08.882104] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.715 [2024-11-20 01:31:08.882119] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.715 [2024-11-20 01:31:08.884523] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.715 [2024-11-20 01:31:08.893646] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.715 [2024-11-20 01:31:08.893974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.715 [2024-11-20 01:31:08.894157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.715 [2024-11-20 01:31:08.894183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.715 [2024-11-20 01:31:08.894198] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.715 [2024-11-20 01:31:08.894345] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.715 [2024-11-20 01:31:08.894569] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.715 [2024-11-20 01:31:08.894592] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.715 [2024-11-20 01:31:08.894613] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.715 [2024-11-20 01:31:08.896958] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.715 [2024-11-20 01:31:08.906171] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.715 [2024-11-20 01:31:08.906513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.715 [2024-11-20 01:31:08.906603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.715 [2024-11-20 01:31:08.906628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.715 [2024-11-20 01:31:08.906644] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.715 [2024-11-20 01:31:08.906836] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.715 [2024-11-20 01:31:08.907041] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.715 [2024-11-20 01:31:08.907064] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.715 [2024-11-20 01:31:08.907092] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.715 [2024-11-20 01:31:08.909422] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.715 [2024-11-20 01:31:08.918636] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.715 [2024-11-20 01:31:08.918931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.715 [2024-11-20 01:31:08.919091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.715 [2024-11-20 01:31:08.919121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.715 [2024-11-20 01:31:08.919139] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.715 [2024-11-20 01:31:08.919267] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.715 [2024-11-20 01:31:08.919436] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.715 [2024-11-20 01:31:08.919460] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.715 [2024-11-20 01:31:08.919475] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.715 [2024-11-20 01:31:08.921733] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.975 [2024-11-20 01:31:08.931178] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.975 [2024-11-20 01:31:08.931526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-11-20 01:31:08.931645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-11-20 01:31:08.931671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.975 [2024-11-20 01:31:08.931687] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.975 [2024-11-20 01:31:08.931864] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.975 [2024-11-20 01:31:08.932032] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.975 [2024-11-20 01:31:08.932055] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.975 [2024-11-20 01:31:08.932082] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.975 [2024-11-20 01:31:08.934400] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.975 [2024-11-20 01:31:08.943975] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.975 [2024-11-20 01:31:08.944354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-11-20 01:31:08.944571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-11-20 01:31:08.944601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.975 [2024-11-20 01:31:08.944618] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.975 [2024-11-20 01:31:08.944783] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.975 [2024-11-20 01:31:08.944953] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.975 [2024-11-20 01:31:08.944976] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.975 [2024-11-20 01:31:08.944991] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.975 [2024-11-20 01:31:08.947346] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.975 [2024-11-20 01:31:08.956421] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.975 [2024-11-20 01:31:08.956712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-11-20 01:31:08.956847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-11-20 01:31:08.956873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.975 [2024-11-20 01:31:08.956889] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.975 [2024-11-20 01:31:08.957062] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.976 [2024-11-20 01:31:08.957244] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.976 [2024-11-20 01:31:08.957267] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.976 [2024-11-20 01:31:08.957281] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.976 [2024-11-20 01:31:08.959499] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.976 [2024-11-20 01:31:08.968846] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.976 [2024-11-20 01:31:08.969140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-11-20 01:31:08.969379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-11-20 01:31:08.969427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.976 [2024-11-20 01:31:08.969444] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.976 [2024-11-20 01:31:08.969591] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.976 [2024-11-20 01:31:08.969759] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.976 [2024-11-20 01:31:08.969782] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.976 [2024-11-20 01:31:08.969796] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.976 [2024-11-20 01:31:08.972207] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.976 [2024-11-20 01:31:08.981442] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.976 [2024-11-20 01:31:08.981721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-11-20 01:31:08.981857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-11-20 01:31:08.981885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.976 [2024-11-20 01:31:08.981903] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.976 [2024-11-20 01:31:08.982099] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.976 [2024-11-20 01:31:08.982287] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.976 [2024-11-20 01:31:08.982310] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.976 [2024-11-20 01:31:08.982325] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.976 [2024-11-20 01:31:08.984831] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.976 [2024-11-20 01:31:08.994179] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.976 [2024-11-20 01:31:08.994530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-11-20 01:31:08.994709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-11-20 01:31:08.994738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.976 [2024-11-20 01:31:08.994755] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.976 [2024-11-20 01:31:08.994938] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.976 [2024-11-20 01:31:08.995191] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.976 [2024-11-20 01:31:08.995215] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.976 [2024-11-20 01:31:08.995230] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.976 [2024-11-20 01:31:08.997664] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.976 [2024-11-20 01:31:09.006877] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.976 [2024-11-20 01:31:09.007243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-11-20 01:31:09.007423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-11-20 01:31:09.007474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.976 [2024-11-20 01:31:09.007491] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.976 [2024-11-20 01:31:09.007675] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.976 [2024-11-20 01:31:09.007808] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.976 [2024-11-20 01:31:09.007830] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.976 [2024-11-20 01:31:09.007845] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.976 [2024-11-20 01:31:09.010297] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.976 [2024-11-20 01:31:09.019423] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.976 [2024-11-20 01:31:09.019776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-11-20 01:31:09.019939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-11-20 01:31:09.019968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.976 [2024-11-20 01:31:09.019985] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.976 [2024-11-20 01:31:09.020180] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.976 [2024-11-20 01:31:09.020403] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.976 [2024-11-20 01:31:09.020426] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.976 [2024-11-20 01:31:09.020441] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.976 [2024-11-20 01:31:09.022769] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.976 [2024-11-20 01:31:09.032215] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.976 [2024-11-20 01:31:09.032541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-11-20 01:31:09.032688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-11-20 01:31:09.032714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.976 [2024-11-20 01:31:09.032730] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.976 [2024-11-20 01:31:09.032907] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.976 [2024-11-20 01:31:09.033087] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.976 [2024-11-20 01:31:09.033111] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.976 [2024-11-20 01:31:09.033126] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.976 [2024-11-20 01:31:09.035584] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.976 [2024-11-20 01:31:09.044799] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.976 [2024-11-20 01:31:09.045108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-11-20 01:31:09.045286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-11-20 01:31:09.045312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.976 [2024-11-20 01:31:09.045327] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.976 [2024-11-20 01:31:09.045450] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.976 [2024-11-20 01:31:09.045655] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.976 [2024-11-20 01:31:09.045678] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.976 [2024-11-20 01:31:09.045693] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.977 [2024-11-20 01:31:09.048084] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.977 [2024-11-20 01:31:09.057453] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.977 [2024-11-20 01:31:09.057770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-11-20 01:31:09.057906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-11-20 01:31:09.057941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.977 [2024-11-20 01:31:09.057959] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.977 [2024-11-20 01:31:09.058133] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.977 [2024-11-20 01:31:09.058321] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.977 [2024-11-20 01:31:09.058345] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.977 [2024-11-20 01:31:09.058360] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.977 [2024-11-20 01:31:09.060742] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.977 [2024-11-20 01:31:09.070165] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.977 [2024-11-20 01:31:09.070455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-11-20 01:31:09.070590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-11-20 01:31:09.070634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.977 [2024-11-20 01:31:09.070650] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.977 [2024-11-20 01:31:09.070858] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.977 [2024-11-20 01:31:09.071037] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.977 [2024-11-20 01:31:09.071060] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.977 [2024-11-20 01:31:09.071086] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.977 [2024-11-20 01:31:09.073436] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.977 [2024-11-20 01:31:09.082764] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.977 [2024-11-20 01:31:09.083120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-11-20 01:31:09.083275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-11-20 01:31:09.083326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.977 [2024-11-20 01:31:09.083345] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.977 [2024-11-20 01:31:09.083492] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.977 [2024-11-20 01:31:09.083661] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.977 [2024-11-20 01:31:09.083684] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.977 [2024-11-20 01:31:09.083698] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.977 [2024-11-20 01:31:09.086047] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.977 [2024-11-20 01:31:09.095323] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.977 [2024-11-20 01:31:09.095618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-11-20 01:31:09.095852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-11-20 01:31:09.095881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.977 [2024-11-20 01:31:09.095904] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.977 [2024-11-20 01:31:09.096016] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.977 [2024-11-20 01:31:09.096175] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.977 [2024-11-20 01:31:09.096200] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.977 [2024-11-20 01:31:09.096216] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.977 [2024-11-20 01:31:09.098614] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.977 [2024-11-20 01:31:09.107821] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.977 [2024-11-20 01:31:09.108201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-11-20 01:31:09.108308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-11-20 01:31:09.108337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.977 [2024-11-20 01:31:09.108355] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.977 [2024-11-20 01:31:09.108537] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.977 [2024-11-20 01:31:09.108706] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.977 [2024-11-20 01:31:09.108729] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.977 [2024-11-20 01:31:09.108744] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.977 [2024-11-20 01:31:09.111097] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.977 [2024-11-20 01:31:09.120565] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.977 [2024-11-20 01:31:09.120881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-11-20 01:31:09.120978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-11-20 01:31:09.121007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.977 [2024-11-20 01:31:09.121025] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.977 [2024-11-20 01:31:09.121236] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.977 [2024-11-20 01:31:09.121406] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.977 [2024-11-20 01:31:09.121429] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.977 [2024-11-20 01:31:09.121444] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.977 [2024-11-20 01:31:09.123811] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.977 [2024-11-20 01:31:09.133342] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.977 [2024-11-20 01:31:09.133728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-11-20 01:31:09.133859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-11-20 01:31:09.133888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.977 [2024-11-20 01:31:09.133905] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.977 [2024-11-20 01:31:09.134086] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.977 [2024-11-20 01:31:09.134310] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.977 [2024-11-20 01:31:09.134333] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.977 [2024-11-20 01:31:09.134349] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.977 [2024-11-20 01:31:09.136622] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.977 [2024-11-20 01:31:09.145996] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.977 [2024-11-20 01:31:09.146320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-11-20 01:31:09.146457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-11-20 01:31:09.146501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.977 [2024-11-20 01:31:09.146516] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.977 [2024-11-20 01:31:09.146693] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.977 [2024-11-20 01:31:09.146854] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.977 [2024-11-20 01:31:09.146877] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.977 [2024-11-20 01:31:09.146893] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.977 [2024-11-20 01:31:09.149272] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.978 [2024-11-20 01:31:09.158612] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.978 [2024-11-20 01:31:09.158924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-11-20 01:31:09.159078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-11-20 01:31:09.159104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.978 [2024-11-20 01:31:09.159119] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.978 [2024-11-20 01:31:09.159267] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.978 [2024-11-20 01:31:09.159431] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.978 [2024-11-20 01:31:09.159454] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.978 [2024-11-20 01:31:09.159469] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.978 [2024-11-20 01:31:09.161601] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.978 [2024-11-20 01:31:09.171215] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.978 [2024-11-20 01:31:09.171511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-11-20 01:31:09.171652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-11-20 01:31:09.171677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.978 [2024-11-20 01:31:09.171693] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.978 [2024-11-20 01:31:09.171887] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.978 [2024-11-20 01:31:09.172062] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.978 [2024-11-20 01:31:09.172096] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.978 [2024-11-20 01:31:09.172112] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.978 [2024-11-20 01:31:09.174623] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.978 [2024-11-20 01:31:09.183528] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.978 [2024-11-20 01:31:09.183935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-11-20 01:31:09.184095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-11-20 01:31:09.184138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:00.978 [2024-11-20 01:31:09.184154] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:00.978 [2024-11-20 01:31:09.184302] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:00.978 [2024-11-20 01:31:09.184512] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.978 [2024-11-20 01:31:09.184536] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.978 [2024-11-20 01:31:09.184550] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.978 [2024-11-20 01:31:09.186824] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.236 [2024-11-20 01:31:09.195964] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.236 [2024-11-20 01:31:09.196244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.236 [2024-11-20 01:31:09.196404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.236 [2024-11-20 01:31:09.196433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.236 [2024-11-20 01:31:09.196450] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.236 [2024-11-20 01:31:09.196579] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.236 [2024-11-20 01:31:09.196748] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.236 [2024-11-20 01:31:09.196771] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.236 [2024-11-20 01:31:09.196786] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.236 [2024-11-20 01:31:09.199217] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.236 [2024-11-20 01:31:09.208679] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.236 [2024-11-20 01:31:09.209020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.236 [2024-11-20 01:31:09.209220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.236 [2024-11-20 01:31:09.209246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.236 [2024-11-20 01:31:09.209262] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.236 [2024-11-20 01:31:09.209361] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.236 [2024-11-20 01:31:09.209550] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.236 [2024-11-20 01:31:09.209579] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.236 [2024-11-20 01:31:09.209595] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.236 [2024-11-20 01:31:09.211853] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.236 [2024-11-20 01:31:09.221275] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.236 [2024-11-20 01:31:09.221657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.236 [2024-11-20 01:31:09.221805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.236 [2024-11-20 01:31:09.221833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.236 [2024-11-20 01:31:09.221851] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.236 [2024-11-20 01:31:09.221979] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.236 [2024-11-20 01:31:09.222162] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.236 [2024-11-20 01:31:09.222186] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.236 [2024-11-20 01:31:09.222200] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.237 [2024-11-20 01:31:09.224619] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.237 [2024-11-20 01:31:09.233833] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.237 [2024-11-20 01:31:09.234128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.237 [2024-11-20 01:31:09.234302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.237 [2024-11-20 01:31:09.234329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.237 [2024-11-20 01:31:09.234344] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.237 [2024-11-20 01:31:09.234491] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.237 [2024-11-20 01:31:09.234678] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.237 [2024-11-20 01:31:09.234701] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.237 [2024-11-20 01:31:09.234716] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.237 [2024-11-20 01:31:09.236793] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.237 [2024-11-20 01:31:09.246414] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.237 [2024-11-20 01:31:09.246763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.237 [2024-11-20 01:31:09.246887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.237 [2024-11-20 01:31:09.246912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.237 [2024-11-20 01:31:09.246928] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.237 [2024-11-20 01:31:09.247080] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.237 [2024-11-20 01:31:09.247251] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.237 [2024-11-20 01:31:09.247274] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.237 [2024-11-20 01:31:09.247294] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.237 [2024-11-20 01:31:09.249405] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.237 [2024-11-20 01:31:09.259102] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.237 [2024-11-20 01:31:09.259539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.237 [2024-11-20 01:31:09.259665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.237 [2024-11-20 01:31:09.259693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.237 [2024-11-20 01:31:09.259709] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.237 [2024-11-20 01:31:09.259874] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.237 [2024-11-20 01:31:09.260025] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.237 [2024-11-20 01:31:09.260048] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.237 [2024-11-20 01:31:09.260063] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.237 [2024-11-20 01:31:09.262545] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.237 [2024-11-20 01:31:09.271612] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.237 [2024-11-20 01:31:09.271979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.237 [2024-11-20 01:31:09.272084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.237 [2024-11-20 01:31:09.272112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.237 [2024-11-20 01:31:09.272130] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.237 [2024-11-20 01:31:09.272313] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.237 [2024-11-20 01:31:09.272481] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.237 [2024-11-20 01:31:09.272503] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.237 [2024-11-20 01:31:09.272518] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.237 [2024-11-20 01:31:09.274815] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.237 [2024-11-20 01:31:09.284281] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.237 [2024-11-20 01:31:09.284606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.237 [2024-11-20 01:31:09.284784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.237 [2024-11-20 01:31:09.284812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.237 [2024-11-20 01:31:09.284830] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.237 [2024-11-20 01:31:09.284977] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.237 [2024-11-20 01:31:09.285198] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.237 [2024-11-20 01:31:09.285223] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.237 [2024-11-20 01:31:09.285239] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.237 [2024-11-20 01:31:09.287517] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.237 [2024-11-20 01:31:09.296844] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.237 [2024-11-20 01:31:09.297147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.237 [2024-11-20 01:31:09.297268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.237 [2024-11-20 01:31:09.297294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.237 [2024-11-20 01:31:09.297310] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.237 [2024-11-20 01:31:09.297442] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.237 [2024-11-20 01:31:09.297631] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.237 [2024-11-20 01:31:09.297654] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.237 [2024-11-20 01:31:09.297669] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.237 [2024-11-20 01:31:09.300033] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.237 [2024-11-20 01:31:09.309554] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.237 [2024-11-20 01:31:09.309930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.237 [2024-11-20 01:31:09.310087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.237 [2024-11-20 01:31:09.310113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.237 [2024-11-20 01:31:09.310129] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.237 [2024-11-20 01:31:09.310271] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.237 [2024-11-20 01:31:09.310439] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.237 [2024-11-20 01:31:09.310462] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.237 [2024-11-20 01:31:09.310477] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.237 [2024-11-20 01:31:09.312749] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.237 [2024-11-20 01:31:09.322109] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.237 [2024-11-20 01:31:09.322398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.237 [2024-11-20 01:31:09.322606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.237 [2024-11-20 01:31:09.322635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.237 [2024-11-20 01:31:09.322653] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.237 [2024-11-20 01:31:09.322781] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.237 [2024-11-20 01:31:09.322914] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.237 [2024-11-20 01:31:09.322936] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.237 [2024-11-20 01:31:09.322951] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.237 [2024-11-20 01:31:09.325180] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.237 [2024-11-20 01:31:09.334741] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.237 [2024-11-20 01:31:09.335106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.237 [2024-11-20 01:31:09.335252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.237 [2024-11-20 01:31:09.335278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.237 [2024-11-20 01:31:09.335294] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.237 [2024-11-20 01:31:09.335417] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.237 [2024-11-20 01:31:09.335604] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.237 [2024-11-20 01:31:09.335627] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.237 [2024-11-20 01:31:09.335641] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.237 [2024-11-20 01:31:09.338024] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.237 [2024-11-20 01:31:09.347391] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.237 [2024-11-20 01:31:09.347727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.237 [2024-11-20 01:31:09.347857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.237 [2024-11-20 01:31:09.347886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.237 [2024-11-20 01:31:09.347904] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.237 [2024-11-20 01:31:09.348078] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.237 [2024-11-20 01:31:09.348230] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.237 [2024-11-20 01:31:09.348254] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.237 [2024-11-20 01:31:09.348268] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.237 [2024-11-20 01:31:09.350412] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.237 [2024-11-20 01:31:09.359942] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.237 [2024-11-20 01:31:09.360327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.237 [2024-11-20 01:31:09.360445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.237 [2024-11-20 01:31:09.360470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.237 [2024-11-20 01:31:09.360485] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.237 [2024-11-20 01:31:09.360615] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.237 [2024-11-20 01:31:09.360769] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.237 [2024-11-20 01:31:09.360792] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.237 [2024-11-20 01:31:09.360807] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.237 [2024-11-20 01:31:09.363108] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.237 [2024-11-20 01:31:09.372385] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.237 [2024-11-20 01:31:09.372683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.237 [2024-11-20 01:31:09.372841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.237 [2024-11-20 01:31:09.372869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.237 [2024-11-20 01:31:09.372887] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.237 [2024-11-20 01:31:09.373103] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.237 [2024-11-20 01:31:09.373256] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.237 [2024-11-20 01:31:09.373279] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.237 [2024-11-20 01:31:09.373294] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.237 [2024-11-20 01:31:09.375625] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.237 [2024-11-20 01:31:09.384860] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.237 [2024-11-20 01:31:09.385142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.237 [2024-11-20 01:31:09.385310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.237 [2024-11-20 01:31:09.385335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.237 [2024-11-20 01:31:09.385351] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.237 [2024-11-20 01:31:09.385526] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.237 [2024-11-20 01:31:09.385730] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.237 [2024-11-20 01:31:09.385753] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.237 [2024-11-20 01:31:09.385769] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.237 [2024-11-20 01:31:09.388062] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.237 [2024-11-20 01:31:09.397494] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.237 [2024-11-20 01:31:09.397807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.237 [2024-11-20 01:31:09.397935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.237 [2024-11-20 01:31:09.397963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.237 [2024-11-20 01:31:09.397980] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.237 [2024-11-20 01:31:09.398157] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.237 [2024-11-20 01:31:09.398307] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.237 [2024-11-20 01:31:09.398330] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.237 [2024-11-20 01:31:09.398346] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.237 [2024-11-20 01:31:09.400654] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.237 [2024-11-20 01:31:09.410140] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.237 [2024-11-20 01:31:09.410442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.238 [2024-11-20 01:31:09.410596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.238 [2024-11-20 01:31:09.410628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.238 [2024-11-20 01:31:09.410645] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.238 [2024-11-20 01:31:09.410837] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.238 [2024-11-20 01:31:09.411043] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.238 [2024-11-20 01:31:09.411067] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.238 [2024-11-20 01:31:09.411094] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.238 [2024-11-20 01:31:09.413439] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.238 [2024-11-20 01:31:09.422558] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.238 [2024-11-20 01:31:09.422848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.238 [2024-11-20 01:31:09.423005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.238 [2024-11-20 01:31:09.423034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.238 [2024-11-20 01:31:09.423051] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.238 [2024-11-20 01:31:09.423207] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.238 [2024-11-20 01:31:09.423376] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.238 [2024-11-20 01:31:09.423399] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.238 [2024-11-20 01:31:09.423414] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.238 [2024-11-20 01:31:09.425722] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.238 [2024-11-20 01:31:09.434949] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.238 [2024-11-20 01:31:09.435209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.238 [2024-11-20 01:31:09.435341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.238 [2024-11-20 01:31:09.435370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.238 [2024-11-20 01:31:09.435387] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.238 [2024-11-20 01:31:09.435534] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.238 [2024-11-20 01:31:09.435702] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.238 [2024-11-20 01:31:09.435726] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.238 [2024-11-20 01:31:09.435741] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.238 [2024-11-20 01:31:09.437963] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.238 [2024-11-20 01:31:09.447512] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.238 [2024-11-20 01:31:09.447785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.238 [2024-11-20 01:31:09.447944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.238 [2024-11-20 01:31:09.447970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.238 [2024-11-20 01:31:09.447991] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.238 [2024-11-20 01:31:09.448177] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.238 [2024-11-20 01:31:09.448329] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.238 [2024-11-20 01:31:09.448352] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.238 [2024-11-20 01:31:09.448367] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.238 [2024-11-20 01:31:09.450712] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.528 [2024-11-20 01:31:09.460110] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.528 [2024-11-20 01:31:09.460402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.528 [2024-11-20 01:31:09.460561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.528 [2024-11-20 01:31:09.460590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.528 [2024-11-20 01:31:09.460607] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.528 [2024-11-20 01:31:09.460754] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.528 [2024-11-20 01:31:09.460923] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.528 [2024-11-20 01:31:09.460946] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.528 [2024-11-20 01:31:09.460961] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.528 [2024-11-20 01:31:09.463334] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.528 [2024-11-20 01:31:09.472629] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.528 [2024-11-20 01:31:09.472944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.528 [2024-11-20 01:31:09.473062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.528 [2024-11-20 01:31:09.473100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.528 [2024-11-20 01:31:09.473118] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.528 [2024-11-20 01:31:09.473264] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.528 [2024-11-20 01:31:09.473469] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.528 [2024-11-20 01:31:09.473491] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.528 [2024-11-20 01:31:09.473506] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.528 [2024-11-20 01:31:09.475674] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.528 [2024-11-20 01:31:09.485145] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.528 [2024-11-20 01:31:09.485419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.528 [2024-11-20 01:31:09.485590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.528 [2024-11-20 01:31:09.485616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.528 [2024-11-20 01:31:09.485631] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.528 [2024-11-20 01:31:09.485736] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.528 [2024-11-20 01:31:09.485927] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.528 [2024-11-20 01:31:09.485950] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.528 [2024-11-20 01:31:09.485965] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.528 [2024-11-20 01:31:09.488282] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.528 [2024-11-20 01:31:09.497727] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.528 [2024-11-20 01:31:09.498066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.528 [2024-11-20 01:31:09.498208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.528 [2024-11-20 01:31:09.498259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.528 [2024-11-20 01:31:09.498276] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.528 [2024-11-20 01:31:09.498441] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.528 [2024-11-20 01:31:09.498609] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.528 [2024-11-20 01:31:09.498632] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.528 [2024-11-20 01:31:09.498646] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.528 [2024-11-20 01:31:09.501048] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.528 [2024-11-20 01:31:09.510354] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.528 [2024-11-20 01:31:09.510642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.528 [2024-11-20 01:31:09.510799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.528 [2024-11-20 01:31:09.510827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.528 [2024-11-20 01:31:09.510845] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.528 [2024-11-20 01:31:09.511027] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.528 [2024-11-20 01:31:09.511206] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.528 [2024-11-20 01:31:09.511230] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.528 [2024-11-20 01:31:09.511245] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.528 [2024-11-20 01:31:09.513644] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.528 [2024-11-20 01:31:09.523100] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.528 [2024-11-20 01:31:09.523375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.528 [2024-11-20 01:31:09.523499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.528 [2024-11-20 01:31:09.523525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.528 [2024-11-20 01:31:09.523540] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.528 [2024-11-20 01:31:09.523689] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.528 [2024-11-20 01:31:09.523901] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.528 [2024-11-20 01:31:09.523925] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.528 [2024-11-20 01:31:09.523939] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.528 [2024-11-20 01:31:09.526276] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.528 [2024-11-20 01:31:09.535597] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.528 [2024-11-20 01:31:09.535907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.528 [2024-11-20 01:31:09.536037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.528 [2024-11-20 01:31:09.536062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.528 [2024-11-20 01:31:09.536088] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.528 [2024-11-20 01:31:09.536222] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.528 [2024-11-20 01:31:09.536424] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.528 [2024-11-20 01:31:09.536446] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.528 [2024-11-20 01:31:09.536461] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.528 [2024-11-20 01:31:09.538735] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.528 [2024-11-20 01:31:09.548075] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.528 [2024-11-20 01:31:09.548342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.528 [2024-11-20 01:31:09.548491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.528 [2024-11-20 01:31:09.548517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.528 [2024-11-20 01:31:09.548533] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.529 [2024-11-20 01:31:09.548712] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.529 [2024-11-20 01:31:09.548899] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.529 [2024-11-20 01:31:09.548922] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.529 [2024-11-20 01:31:09.548937] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.529 [2024-11-20 01:31:09.551326] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.529 [2024-11-20 01:31:09.560400] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.529 [2024-11-20 01:31:09.560787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.529 [2024-11-20 01:31:09.560966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.529 [2024-11-20 01:31:09.560992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.529 [2024-11-20 01:31:09.561008] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.529 [2024-11-20 01:31:09.561133] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.529 [2024-11-20 01:31:09.561357] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.529 [2024-11-20 01:31:09.561386] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.529 [2024-11-20 01:31:09.561401] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.529 [2024-11-20 01:31:09.563658] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.529 [2024-11-20 01:31:09.572932] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.529 [2024-11-20 01:31:09.573251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.529 [2024-11-20 01:31:09.573389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.529 [2024-11-20 01:31:09.573418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.529 [2024-11-20 01:31:09.573435] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.529 [2024-11-20 01:31:09.573600] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.529 [2024-11-20 01:31:09.573768] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.529 [2024-11-20 01:31:09.573791] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.529 [2024-11-20 01:31:09.573806] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.529 [2024-11-20 01:31:09.576047] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.529 [2024-11-20 01:31:09.585568] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.529 [2024-11-20 01:31:09.585841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.529 [2024-11-20 01:31:09.585966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.529 [2024-11-20 01:31:09.585995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.529 [2024-11-20 01:31:09.586012] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.529 [2024-11-20 01:31:09.586187] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.529 [2024-11-20 01:31:09.586338] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.529 [2024-11-20 01:31:09.586361] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.529 [2024-11-20 01:31:09.586376] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.529 [2024-11-20 01:31:09.588795] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.529 [2024-11-20 01:31:09.598065] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.529 [2024-11-20 01:31:09.598341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.529 [2024-11-20 01:31:09.598545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.529 [2024-11-20 01:31:09.598574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.529 [2024-11-20 01:31:09.598591] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.529 [2024-11-20 01:31:09.598756] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.529 [2024-11-20 01:31:09.598889] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.529 [2024-11-20 01:31:09.598911] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.529 [2024-11-20 01:31:09.598932] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.529 [2024-11-20 01:31:09.601386] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.529 [2024-11-20 01:31:09.610846] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.529 [2024-11-20 01:31:09.611124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.529 [2024-11-20 01:31:09.611274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.529 [2024-11-20 01:31:09.611300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.529 [2024-11-20 01:31:09.611316] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.529 [2024-11-20 01:31:09.611543] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.529 [2024-11-20 01:31:09.611712] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.529 [2024-11-20 01:31:09.611734] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.529 [2024-11-20 01:31:09.611749] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.529 [2024-11-20 01:31:09.614050] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.529 [2024-11-20 01:31:09.623546] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.529 [2024-11-20 01:31:09.623852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.529 [2024-11-20 01:31:09.624002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.529 [2024-11-20 01:31:09.624027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.529 [2024-11-20 01:31:09.624043] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.529 [2024-11-20 01:31:09.624261] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.529 [2024-11-20 01:31:09.624432] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.529 [2024-11-20 01:31:09.624455] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.529 [2024-11-20 01:31:09.624470] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.529 [2024-11-20 01:31:09.626963] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.529 [2024-11-20 01:31:09.636187] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.529 [2024-11-20 01:31:09.636542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.529 [2024-11-20 01:31:09.636787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.529 [2024-11-20 01:31:09.636842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.529 [2024-11-20 01:31:09.636859] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.529 [2024-11-20 01:31:09.637005] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.529 [2024-11-20 01:31:09.637173] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.529 [2024-11-20 01:31:09.637194] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.529 [2024-11-20 01:31:09.637207] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.529 [2024-11-20 01:31:09.639493] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.529 [2024-11-20 01:31:09.648756] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.529 [2024-11-20 01:31:09.649057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.529 [2024-11-20 01:31:09.649187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.529 [2024-11-20 01:31:09.649213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.529 [2024-11-20 01:31:09.649229] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.529 [2024-11-20 01:31:09.649396] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.529 [2024-11-20 01:31:09.649565] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.529 [2024-11-20 01:31:09.649588] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.529 [2024-11-20 01:31:09.649603] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.529 [2024-11-20 01:31:09.651779] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.529 [2024-11-20 01:31:09.661656] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.529 [2024-11-20 01:31:09.661940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.529 [2024-11-20 01:31:09.662042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.529 [2024-11-20 01:31:09.662091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.529 [2024-11-20 01:31:09.662109] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.529 [2024-11-20 01:31:09.662242] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.529 [2024-11-20 01:31:09.662418] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.529 [2024-11-20 01:31:09.662441] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.530 [2024-11-20 01:31:09.662456] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.530 [2024-11-20 01:31:09.664816] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.530 [2024-11-20 01:31:09.674308] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.530 [2024-11-20 01:31:09.674637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.530 [2024-11-20 01:31:09.674768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.530 [2024-11-20 01:31:09.674812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.530 [2024-11-20 01:31:09.674829] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.530 [2024-11-20 01:31:09.674992] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.530 [2024-11-20 01:31:09.675213] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.530 [2024-11-20 01:31:09.675238] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.530 [2024-11-20 01:31:09.675253] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.530 [2024-11-20 01:31:09.677398] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.530 [2024-11-20 01:31:09.686524] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.530 [2024-11-20 01:31:09.686802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.530 [2024-11-20 01:31:09.686924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.530 [2024-11-20 01:31:09.686950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.530 [2024-11-20 01:31:09.686966] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.530 [2024-11-20 01:31:09.687139] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.530 [2024-11-20 01:31:09.687292] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.530 [2024-11-20 01:31:09.687313] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.530 [2024-11-20 01:31:09.687327] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.530 [2024-11-20 01:31:09.689201] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.530 [2024-11-20 01:31:09.699015] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.530 [2024-11-20 01:31:09.699320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.530 [2024-11-20 01:31:09.699467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.530 [2024-11-20 01:31:09.699496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.530 [2024-11-20 01:31:09.699513] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.530 [2024-11-20 01:31:09.699678] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.530 [2024-11-20 01:31:09.699864] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.530 [2024-11-20 01:31:09.699887] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.530 [2024-11-20 01:31:09.699902] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.530 [2024-11-20 01:31:09.702315] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.530 [2024-11-20 01:31:09.711511] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.530 [2024-11-20 01:31:09.711757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.530 [2024-11-20 01:31:09.711899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.530 [2024-11-20 01:31:09.711927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.530 [2024-11-20 01:31:09.711944] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.530 [2024-11-20 01:31:09.712097] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.530 [2024-11-20 01:31:09.712260] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.530 [2024-11-20 01:31:09.712282] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.530 [2024-11-20 01:31:09.712296] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.817 [2024-11-20 01:31:09.714617] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.817 [2024-11-20 01:31:09.724149] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.817 [2024-11-20 01:31:09.724439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.817 [2024-11-20 01:31:09.724559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.817 [2024-11-20 01:31:09.724585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.817 [2024-11-20 01:31:09.724601] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.817 [2024-11-20 01:31:09.724790] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.817 [2024-11-20 01:31:09.724941] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.817 [2024-11-20 01:31:09.724964] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.817 [2024-11-20 01:31:09.724978] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.817 [2024-11-20 01:31:09.727404] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.817 [2024-11-20 01:31:09.736701] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.817 [2024-11-20 01:31:09.737084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.817 [2024-11-20 01:31:09.737240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.817 [2024-11-20 01:31:09.737268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.817 [2024-11-20 01:31:09.737285] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.817 [2024-11-20 01:31:09.737494] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.817 [2024-11-20 01:31:09.737626] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.817 [2024-11-20 01:31:09.737649] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.817 [2024-11-20 01:31:09.737664] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.817 [2024-11-20 01:31:09.739971] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.817 [2024-11-20 01:31:09.749393] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.817 [2024-11-20 01:31:09.749665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.817 [2024-11-20 01:31:09.749776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.817 [2024-11-20 01:31:09.749802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.817 [2024-11-20 01:31:09.749818] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.817 [2024-11-20 01:31:09.749968] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.817 [2024-11-20 01:31:09.750166] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.817 [2024-11-20 01:31:09.750190] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.817 [2024-11-20 01:31:09.750205] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.817 [2024-11-20 01:31:09.752551] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.817 [2024-11-20 01:31:09.762252] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.817 [2024-11-20 01:31:09.762599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.817 [2024-11-20 01:31:09.762746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.817 [2024-11-20 01:31:09.762781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.817 [2024-11-20 01:31:09.762799] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.817 [2024-11-20 01:31:09.762941] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.817 [2024-11-20 01:31:09.763117] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.817 [2024-11-20 01:31:09.763141] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.817 [2024-11-20 01:31:09.763156] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.817 [2024-11-20 01:31:09.765338] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.817 [2024-11-20 01:31:09.774805] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.817 [2024-11-20 01:31:09.775061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.817 [2024-11-20 01:31:09.775207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.817 [2024-11-20 01:31:09.775235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.817 [2024-11-20 01:31:09.775251] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.817 [2024-11-20 01:31:09.775392] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.817 [2024-11-20 01:31:09.775542] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.817 [2024-11-20 01:31:09.775565] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.817 [2024-11-20 01:31:09.775580] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.817 [2024-11-20 01:31:09.777961] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.817 [2024-11-20 01:31:09.787351] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.817 [2024-11-20 01:31:09.787715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.817 [2024-11-20 01:31:09.787811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.817 [2024-11-20 01:31:09.787837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.817 [2024-11-20 01:31:09.787852] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.817 [2024-11-20 01:31:09.788024] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.817 [2024-11-20 01:31:09.788182] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.817 [2024-11-20 01:31:09.788206] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.817 [2024-11-20 01:31:09.788221] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.817 [2024-11-20 01:31:09.790529] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.817 [2024-11-20 01:31:09.800029] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.817 [2024-11-20 01:31:09.800293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.817 [2024-11-20 01:31:09.800427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.817 [2024-11-20 01:31:09.800455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.817 [2024-11-20 01:31:09.800478] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.817 [2024-11-20 01:31:09.800662] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.817 [2024-11-20 01:31:09.800813] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.817 [2024-11-20 01:31:09.800835] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.817 [2024-11-20 01:31:09.800850] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.817 [2024-11-20 01:31:09.803183] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.817 [2024-11-20 01:31:09.812758] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.817 [2024-11-20 01:31:09.813077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.817 [2024-11-20 01:31:09.813252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.817 [2024-11-20 01:31:09.813280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.817 [2024-11-20 01:31:09.813297] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.817 [2024-11-20 01:31:09.813473] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.817 [2024-11-20 01:31:09.813655] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.817 [2024-11-20 01:31:09.813678] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.817 [2024-11-20 01:31:09.813692] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.817 [2024-11-20 01:31:09.815951] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.817 [2024-11-20 01:31:09.825277] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.817 [2024-11-20 01:31:09.825612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.817 [2024-11-20 01:31:09.825742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.817 [2024-11-20 01:31:09.825771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.818 [2024-11-20 01:31:09.825788] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.818 [2024-11-20 01:31:09.825971] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.818 [2024-11-20 01:31:09.826114] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.818 [2024-11-20 01:31:09.826137] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.818 [2024-11-20 01:31:09.826152] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.818 [2024-11-20 01:31:09.828349] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.818 [2024-11-20 01:31:09.837914] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.818 [2024-11-20 01:31:09.838220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.818 [2024-11-20 01:31:09.838358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.818 [2024-11-20 01:31:09.838387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.818 [2024-11-20 01:31:09.838406] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.818 [2024-11-20 01:31:09.838595] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.818 [2024-11-20 01:31:09.838764] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.818 [2024-11-20 01:31:09.838787] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.818 [2024-11-20 01:31:09.838802] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.818 [2024-11-20 01:31:09.841176] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.818 [2024-11-20 01:31:09.850370] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.818 [2024-11-20 01:31:09.850678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.818 [2024-11-20 01:31:09.850812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.818 [2024-11-20 01:31:09.850841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.818 [2024-11-20 01:31:09.850860] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.818 [2024-11-20 01:31:09.851024] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.818 [2024-11-20 01:31:09.851219] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.818 [2024-11-20 01:31:09.851243] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.818 [2024-11-20 01:31:09.851259] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.818 [2024-11-20 01:31:09.853715] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.818 [2024-11-20 01:31:09.862696] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.818 [2024-11-20 01:31:09.862947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.818 [2024-11-20 01:31:09.863087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.818 [2024-11-20 01:31:09.863118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.818 [2024-11-20 01:31:09.863150] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.818 [2024-11-20 01:31:09.863315] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.818 [2024-11-20 01:31:09.863462] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.818 [2024-11-20 01:31:09.863486] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.818 [2024-11-20 01:31:09.863501] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.818 [2024-11-20 01:31:09.865747] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.818 [2024-11-20 01:31:09.875205] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.818 [2024-11-20 01:31:09.875536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.818 [2024-11-20 01:31:09.875663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.818 [2024-11-20 01:31:09.875692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.818 [2024-11-20 01:31:09.875710] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.818 [2024-11-20 01:31:09.875910] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.818 [2024-11-20 01:31:09.876067] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.818 [2024-11-20 01:31:09.876100] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.818 [2024-11-20 01:31:09.876115] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.818 [2024-11-20 01:31:09.878479] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.818 [2024-11-20 01:31:09.887761] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.818 [2024-11-20 01:31:09.888087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.818 [2024-11-20 01:31:09.888203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.818 [2024-11-20 01:31:09.888229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.818 [2024-11-20 01:31:09.888245] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.818 [2024-11-20 01:31:09.888396] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.818 [2024-11-20 01:31:09.888510] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.818 [2024-11-20 01:31:09.888533] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.818 [2024-11-20 01:31:09.888548] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.818 [2024-11-20 01:31:09.891140] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.818 [2024-11-20 01:31:09.900196] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.818 [2024-11-20 01:31:09.900523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.818 [2024-11-20 01:31:09.900674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.818 [2024-11-20 01:31:09.900700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.818 [2024-11-20 01:31:09.900716] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.818 [2024-11-20 01:31:09.900848] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.818 [2024-11-20 01:31:09.901001] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.818 [2024-11-20 01:31:09.901024] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.818 [2024-11-20 01:31:09.901040] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.818 [2024-11-20 01:31:09.903449] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.818 [2024-11-20 01:31:09.912822] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.818 [2024-11-20 01:31:09.913141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.818 [2024-11-20 01:31:09.913271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.818 [2024-11-20 01:31:09.913297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.818 [2024-11-20 01:31:09.913313] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.818 [2024-11-20 01:31:09.913487] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.818 [2024-11-20 01:31:09.913638] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.818 [2024-11-20 01:31:09.913667] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.818 [2024-11-20 01:31:09.913683] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.818 [2024-11-20 01:31:09.915957] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.818 [2024-11-20 01:31:09.925427] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.818 [2024-11-20 01:31:09.925775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.818 [2024-11-20 01:31:09.925934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.818 [2024-11-20 01:31:09.925962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.818 [2024-11-20 01:31:09.925980] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.818 [2024-11-20 01:31:09.926133] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.818 [2024-11-20 01:31:09.926253] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.818 [2024-11-20 01:31:09.926274] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.818 [2024-11-20 01:31:09.926289] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.818 [2024-11-20 01:31:09.928517] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.818 [2024-11-20 01:31:09.938167] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.818 [2024-11-20 01:31:09.938460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.818 [2024-11-20 01:31:09.938638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.818 [2024-11-20 01:31:09.938664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.818 [2024-11-20 01:31:09.938680] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.818 [2024-11-20 01:31:09.938887] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.818 [2024-11-20 01:31:09.939094] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.819 [2024-11-20 01:31:09.939118] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.819 [2024-11-20 01:31:09.939133] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.819 [2024-11-20 01:31:09.941320] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.819 [2024-11-20 01:31:09.950836] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.819 [2024-11-20 01:31:09.951160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.819 [2024-11-20 01:31:09.951394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.819 [2024-11-20 01:31:09.951441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.819 [2024-11-20 01:31:09.951458] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.819 [2024-11-20 01:31:09.951624] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.819 [2024-11-20 01:31:09.951811] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.819 [2024-11-20 01:31:09.951834] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.819 [2024-11-20 01:31:09.951855] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.819 [2024-11-20 01:31:09.954392] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.819 [2024-11-20 01:31:09.963517] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.819 [2024-11-20 01:31:09.963855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.819 [2024-11-20 01:31:09.963985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.819 [2024-11-20 01:31:09.964028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.819 [2024-11-20 01:31:09.964044] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.819 [2024-11-20 01:31:09.964169] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.819 [2024-11-20 01:31:09.964312] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.819 [2024-11-20 01:31:09.964335] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.819 [2024-11-20 01:31:09.964351] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.819 [2024-11-20 01:31:09.966659] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.819 [2024-11-20 01:31:09.976152] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.819 [2024-11-20 01:31:09.976459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.819 [2024-11-20 01:31:09.976616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.819 [2024-11-20 01:31:09.976645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.819 [2024-11-20 01:31:09.976662] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.819 [2024-11-20 01:31:09.976809] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.819 [2024-11-20 01:31:09.977014] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.819 [2024-11-20 01:31:09.977037] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.819 [2024-11-20 01:31:09.977052] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.819 [2024-11-20 01:31:09.979386] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.819 [2024-11-20 01:31:09.988754] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.819 [2024-11-20 01:31:09.989112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.819 [2024-11-20 01:31:09.989221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.819 [2024-11-20 01:31:09.989265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.819 [2024-11-20 01:31:09.989281] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.819 [2024-11-20 01:31:09.989427] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.819 [2024-11-20 01:31:09.989580] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.819 [2024-11-20 01:31:09.989603] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.819 [2024-11-20 01:31:09.989618] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.819 [2024-11-20 01:31:09.991877] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.819 [2024-11-20 01:31:10.001134] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.819 [2024-11-20 01:31:10.001456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.819 [2024-11-20 01:31:10.001628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.819 [2024-11-20 01:31:10.001654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.819 [2024-11-20 01:31:10.001669] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.819 [2024-11-20 01:31:10.001817] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.819 [2024-11-20 01:31:10.001995] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.819 [2024-11-20 01:31:10.002019] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.819 [2024-11-20 01:31:10.002034] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.819 [2024-11-20 01:31:10.004281] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.819 [2024-11-20 01:31:10.013716] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.819 [2024-11-20 01:31:10.014005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.819 [2024-11-20 01:31:10.014137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.819 [2024-11-20 01:31:10.014164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:01.819 [2024-11-20 01:31:10.014180] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:01.819 [2024-11-20 01:31:10.014279] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:01.819 [2024-11-20 01:31:10.014472] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.819 [2024-11-20 01:31:10.014495] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.819 [2024-11-20 01:31:10.014510] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.819 [2024-11-20 01:31:10.016889] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.093 [2024-11-20 01:31:10.026356] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.093 [2024-11-20 01:31:10.026656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.093 [2024-11-20 01:31:10.026839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.094 [2024-11-20 01:31:10.026865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.094 [2024-11-20 01:31:10.026881] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.094 [2024-11-20 01:31:10.027029] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.094 [2024-11-20 01:31:10.027164] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.094 [2024-11-20 01:31:10.027188] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.094 [2024-11-20 01:31:10.027203] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.094 [2024-11-20 01:31:10.029764] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.094 [2024-11-20 01:31:10.038875] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.094 [2024-11-20 01:31:10.039221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.094 [2024-11-20 01:31:10.039337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.094 [2024-11-20 01:31:10.039364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.094 [2024-11-20 01:31:10.039380] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.094 [2024-11-20 01:31:10.039514] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.094 [2024-11-20 01:31:10.039695] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.094 [2024-11-20 01:31:10.039730] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.094 [2024-11-20 01:31:10.039746] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.094 [2024-11-20 01:31:10.041987] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.094 [2024-11-20 01:31:10.051397] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.094 [2024-11-20 01:31:10.051764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.094 [2024-11-20 01:31:10.051884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.094 [2024-11-20 01:31:10.051913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.094 [2024-11-20 01:31:10.051930] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.094 [2024-11-20 01:31:10.052089] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.094 [2024-11-20 01:31:10.052222] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.094 [2024-11-20 01:31:10.052245] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.094 [2024-11-20 01:31:10.052261] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.094 [2024-11-20 01:31:10.054711] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.094 [2024-11-20 01:31:10.064013] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.094 [2024-11-20 01:31:10.064319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.094 [2024-11-20 01:31:10.064457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.094 [2024-11-20 01:31:10.064486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.094 [2024-11-20 01:31:10.064503] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.094 [2024-11-20 01:31:10.064614] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.094 [2024-11-20 01:31:10.064801] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.094 [2024-11-20 01:31:10.064824] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.094 [2024-11-20 01:31:10.064840] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.094 [2024-11-20 01:31:10.067159] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.094 [2024-11-20 01:31:10.076568] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.094 [2024-11-20 01:31:10.076869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.094 [2024-11-20 01:31:10.077030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.094 [2024-11-20 01:31:10.077056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.094 [2024-11-20 01:31:10.077083] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.094 [2024-11-20 01:31:10.077320] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.094 [2024-11-20 01:31:10.077453] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.094 [2024-11-20 01:31:10.077476] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.094 [2024-11-20 01:31:10.077491] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.094 [2024-11-20 01:31:10.079689] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.094 [2024-11-20 01:31:10.089327] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.094 [2024-11-20 01:31:10.089677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.094 [2024-11-20 01:31:10.089797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.094 [2024-11-20 01:31:10.089822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.094 [2024-11-20 01:31:10.089838] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.094 [2024-11-20 01:31:10.090023] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.094 [2024-11-20 01:31:10.090167] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.094 [2024-11-20 01:31:10.090191] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.094 [2024-11-20 01:31:10.090206] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.094 [2024-11-20 01:31:10.092589] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.094 [2024-11-20 01:31:10.101760] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.094 [2024-11-20 01:31:10.102085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.094 [2024-11-20 01:31:10.102240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.094 [2024-11-20 01:31:10.102266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.094 [2024-11-20 01:31:10.102282] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.094 [2024-11-20 01:31:10.102487] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.094 [2024-11-20 01:31:10.102674] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.094 [2024-11-20 01:31:10.102698] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.094 [2024-11-20 01:31:10.102713] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.094 [2024-11-20 01:31:10.105092] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.094 [2024-11-20 01:31:10.114296] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.094 [2024-11-20 01:31:10.114575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.094 [2024-11-20 01:31:10.114762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.094 [2024-11-20 01:31:10.114793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.094 [2024-11-20 01:31:10.114810] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.094 [2024-11-20 01:31:10.114990] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.094 [2024-11-20 01:31:10.115192] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.094 [2024-11-20 01:31:10.115216] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.094 [2024-11-20 01:31:10.115231] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.094 [2024-11-20 01:31:10.117610] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.094 [2024-11-20 01:31:10.126971] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.094 [2024-11-20 01:31:10.127282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.094 [2024-11-20 01:31:10.127389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.094 [2024-11-20 01:31:10.127418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.094 [2024-11-20 01:31:10.127436] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.094 [2024-11-20 01:31:10.127565] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.094 [2024-11-20 01:31:10.127680] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.094 [2024-11-20 01:31:10.127703] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.094 [2024-11-20 01:31:10.127718] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.094 [2024-11-20 01:31:10.129981] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.094 [2024-11-20 01:31:10.139531] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.094 [2024-11-20 01:31:10.139836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.094 [2024-11-20 01:31:10.139994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.094 [2024-11-20 01:31:10.140019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.095 [2024-11-20 01:31:10.140035] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.095 [2024-11-20 01:31:10.140229] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.095 [2024-11-20 01:31:10.140399] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.095 [2024-11-20 01:31:10.140421] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.095 [2024-11-20 01:31:10.140436] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.095 [2024-11-20 01:31:10.142659] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.095 [2024-11-20 01:31:10.152048] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.095 [2024-11-20 01:31:10.152400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.095 [2024-11-20 01:31:10.152527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.095 [2024-11-20 01:31:10.152553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.095 [2024-11-20 01:31:10.152574] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.095 [2024-11-20 01:31:10.152773] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.095 [2024-11-20 01:31:10.152973] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.095 [2024-11-20 01:31:10.152996] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.095 [2024-11-20 01:31:10.153013] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.095 [2024-11-20 01:31:10.155252] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.095 [2024-11-20 01:31:10.164595] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.095 [2024-11-20 01:31:10.164908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.095 [2024-11-20 01:31:10.165042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.095 [2024-11-20 01:31:10.165081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.095 [2024-11-20 01:31:10.165101] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.095 [2024-11-20 01:31:10.165230] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.095 [2024-11-20 01:31:10.165399] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.095 [2024-11-20 01:31:10.165421] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.095 [2024-11-20 01:31:10.165437] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.095 [2024-11-20 01:31:10.167768] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.095 [2024-11-20 01:31:10.177124] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.095 [2024-11-20 01:31:10.177405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.095 [2024-11-20 01:31:10.177503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.095 [2024-11-20 01:31:10.177531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.095 [2024-11-20 01:31:10.177549] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.095 [2024-11-20 01:31:10.177713] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.095 [2024-11-20 01:31:10.177899] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.095 [2024-11-20 01:31:10.177922] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.095 [2024-11-20 01:31:10.177938] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.095 [2024-11-20 01:31:10.180299] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.095 [2024-11-20 01:31:10.189686] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.095 [2024-11-20 01:31:10.189986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.095 [2024-11-20 01:31:10.190096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.095 [2024-11-20 01:31:10.190125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.095 [2024-11-20 01:31:10.190143] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.095 [2024-11-20 01:31:10.190367] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.095 [2024-11-20 01:31:10.190554] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.095 [2024-11-20 01:31:10.190577] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.095 [2024-11-20 01:31:10.190592] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.095 [2024-11-20 01:31:10.192906] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.095 [2024-11-20 01:31:10.202545] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.095 [2024-11-20 01:31:10.202806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.095 [2024-11-20 01:31:10.202967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.095 [2024-11-20 01:31:10.202996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.095 [2024-11-20 01:31:10.203013] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.095 [2024-11-20 01:31:10.203207] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.095 [2024-11-20 01:31:10.203395] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.095 [2024-11-20 01:31:10.203418] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.095 [2024-11-20 01:31:10.203433] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.095 [2024-11-20 01:31:10.205655] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.095 [2024-11-20 01:31:10.215227] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.095 [2024-11-20 01:31:10.215577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.095 [2024-11-20 01:31:10.215696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.095 [2024-11-20 01:31:10.215722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.095 [2024-11-20 01:31:10.215737] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.095 [2024-11-20 01:31:10.215920] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.095 [2024-11-20 01:31:10.216053] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.095 [2024-11-20 01:31:10.216088] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.095 [2024-11-20 01:31:10.216104] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.095 [2024-11-20 01:31:10.218506] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.095 [2024-11-20 01:31:10.227665] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.095 [2024-11-20 01:31:10.228005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.095 [2024-11-20 01:31:10.228143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.095 [2024-11-20 01:31:10.228170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.095 [2024-11-20 01:31:10.228185] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.095 [2024-11-20 01:31:10.228366] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.095 [2024-11-20 01:31:10.228536] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.095 [2024-11-20 01:31:10.228560] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.095 [2024-11-20 01:31:10.228575] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.095 [2024-11-20 01:31:10.230799] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.095 [2024-11-20 01:31:10.240041] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.095 [2024-11-20 01:31:10.240331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.095 [2024-11-20 01:31:10.240504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.095 [2024-11-20 01:31:10.240550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.095 [2024-11-20 01:31:10.240567] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.095 [2024-11-20 01:31:10.240731] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.095 [2024-11-20 01:31:10.240880] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.095 [2024-11-20 01:31:10.240904] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.095 [2024-11-20 01:31:10.240919] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.095 [2024-11-20 01:31:10.243443] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.095 [2024-11-20 01:31:10.252739] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.095 [2024-11-20 01:31:10.253050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.095 [2024-11-20 01:31:10.253230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.095 [2024-11-20 01:31:10.253260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.095 [2024-11-20 01:31:10.253277] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.096 [2024-11-20 01:31:10.253441] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.096 [2024-11-20 01:31:10.253556] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.096 [2024-11-20 01:31:10.253578] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.096 [2024-11-20 01:31:10.253593] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.096 [2024-11-20 01:31:10.255968] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.096 [2024-11-20 01:31:10.265350] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.096 [2024-11-20 01:31:10.265708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.096 [2024-11-20 01:31:10.265828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.096 [2024-11-20 01:31:10.265853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.096 [2024-11-20 01:31:10.265869] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.096 [2024-11-20 01:31:10.266041] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.096 [2024-11-20 01:31:10.266241] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.096 [2024-11-20 01:31:10.266271] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.096 [2024-11-20 01:31:10.266286] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.096 [2024-11-20 01:31:10.268634] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.096 [2024-11-20 01:31:10.278054] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.096 [2024-11-20 01:31:10.278400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.096 [2024-11-20 01:31:10.278506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.096 [2024-11-20 01:31:10.278548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.096 [2024-11-20 01:31:10.278564] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.096 [2024-11-20 01:31:10.278712] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.096 [2024-11-20 01:31:10.278906] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.096 [2024-11-20 01:31:10.278929] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.096 [2024-11-20 01:31:10.278943] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.096 [2024-11-20 01:31:10.281198] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.096 [2024-11-20 01:31:10.290690] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.096 [2024-11-20 01:31:10.291019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.096 [2024-11-20 01:31:10.291152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.096 [2024-11-20 01:31:10.291179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.096 [2024-11-20 01:31:10.291194] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.096 [2024-11-20 01:31:10.291410] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.096 [2024-11-20 01:31:10.291579] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.096 [2024-11-20 01:31:10.291601] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.096 [2024-11-20 01:31:10.291616] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.096 [2024-11-20 01:31:10.293947] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.096 [2024-11-20 01:31:10.303276] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.096 [2024-11-20 01:31:10.303604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.096 [2024-11-20 01:31:10.303740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.096 [2024-11-20 01:31:10.303771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.096 [2024-11-20 01:31:10.303788] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.096 [2024-11-20 01:31:10.303971] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.096 [2024-11-20 01:31:10.304173] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.096 [2024-11-20 01:31:10.304197] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.096 [2024-11-20 01:31:10.304218] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.096 [2024-11-20 01:31:10.306538] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.358 [2024-11-20 01:31:10.315756] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.358 [2024-11-20 01:31:10.316086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.358 [2024-11-20 01:31:10.316231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.358 [2024-11-20 01:31:10.316259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.358 [2024-11-20 01:31:10.316277] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.358 [2024-11-20 01:31:10.316406] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.358 [2024-11-20 01:31:10.316593] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.358 [2024-11-20 01:31:10.316615] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.358 [2024-11-20 01:31:10.316630] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.358 [2024-11-20 01:31:10.319153] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.358 [2024-11-20 01:31:10.328160] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.358 [2024-11-20 01:31:10.328480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.358 [2024-11-20 01:31:10.328618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.358 [2024-11-20 01:31:10.328647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.358 [2024-11-20 01:31:10.328664] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.358 [2024-11-20 01:31:10.328794] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.358 [2024-11-20 01:31:10.328998] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.358 [2024-11-20 01:31:10.329020] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.358 [2024-11-20 01:31:10.329035] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.358 [2024-11-20 01:31:10.331522] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.358 [2024-11-20 01:31:10.340575] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.358 [2024-11-20 01:31:10.340916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.358 [2024-11-20 01:31:10.341056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.358 [2024-11-20 01:31:10.341096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.358 [2024-11-20 01:31:10.341115] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.358 [2024-11-20 01:31:10.341280] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.358 [2024-11-20 01:31:10.341431] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.358 [2024-11-20 01:31:10.341453] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.358 [2024-11-20 01:31:10.341468] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.358 [2024-11-20 01:31:10.343739] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.358 [2024-11-20 01:31:10.352994] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.358 [2024-11-20 01:31:10.353364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.358 [2024-11-20 01:31:10.353465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.358 [2024-11-20 01:31:10.353508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.358 [2024-11-20 01:31:10.353526] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.358 [2024-11-20 01:31:10.353642] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.358 [2024-11-20 01:31:10.353855] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.358 [2024-11-20 01:31:10.353894] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.358 [2024-11-20 01:31:10.353910] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.358 [2024-11-20 01:31:10.356471] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.358 [2024-11-20 01:31:10.365537] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.358 [2024-11-20 01:31:10.365810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.358 [2024-11-20 01:31:10.365933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.358 [2024-11-20 01:31:10.365959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.358 [2024-11-20 01:31:10.365975] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.358 [2024-11-20 01:31:10.366202] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.358 [2024-11-20 01:31:10.366391] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.358 [2024-11-20 01:31:10.366414] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.358 [2024-11-20 01:31:10.366429] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.358 [2024-11-20 01:31:10.368901] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.358 [2024-11-20 01:31:10.378242] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.358 [2024-11-20 01:31:10.378578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.358 [2024-11-20 01:31:10.378724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.358 [2024-11-20 01:31:10.378749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.359 [2024-11-20 01:31:10.378766] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.359 [2024-11-20 01:31:10.378881] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.359 [2024-11-20 01:31:10.379041] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.359 [2024-11-20 01:31:10.379064] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.359 [2024-11-20 01:31:10.379094] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.359 [2024-11-20 01:31:10.381498] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.359 [2024-11-20 01:31:10.390873] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.359 [2024-11-20 01:31:10.391204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.359 [2024-11-20 01:31:10.391346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.359 [2024-11-20 01:31:10.391375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.359 [2024-11-20 01:31:10.391393] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.359 [2024-11-20 01:31:10.391558] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.359 [2024-11-20 01:31:10.391709] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.359 [2024-11-20 01:31:10.391732] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.359 [2024-11-20 01:31:10.391747] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.359 [2024-11-20 01:31:10.393865] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.359 [2024-11-20 01:31:10.403514] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.359 [2024-11-20 01:31:10.403815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.359 [2024-11-20 01:31:10.403977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.359 [2024-11-20 01:31:10.404005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.359 [2024-11-20 01:31:10.404022] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.359 [2024-11-20 01:31:10.404200] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.359 [2024-11-20 01:31:10.404369] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.359 [2024-11-20 01:31:10.404392] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.359 [2024-11-20 01:31:10.404407] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.359 [2024-11-20 01:31:10.406594] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.359 [2024-11-20 01:31:10.416264] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.359 [2024-11-20 01:31:10.416554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.359 [2024-11-20 01:31:10.416653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.359 [2024-11-20 01:31:10.416681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.359 [2024-11-20 01:31:10.416698] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.359 [2024-11-20 01:31:10.416827] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.359 [2024-11-20 01:31:10.416977] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.359 [2024-11-20 01:31:10.416999] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.359 [2024-11-20 01:31:10.417015] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.359 [2024-11-20 01:31:10.419338] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.359 [2024-11-20 01:31:10.428745] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.359 [2024-11-20 01:31:10.429149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.359 [2024-11-20 01:31:10.429287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.359 [2024-11-20 01:31:10.429315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.359 [2024-11-20 01:31:10.429333] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.359 [2024-11-20 01:31:10.429498] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.359 [2024-11-20 01:31:10.429684] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.359 [2024-11-20 01:31:10.429707] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.359 [2024-11-20 01:31:10.429723] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.359 [2024-11-20 01:31:10.431944] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.359 [2024-11-20 01:31:10.441303] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.359 [2024-11-20 01:31:10.441688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.359 [2024-11-20 01:31:10.441888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.359 [2024-11-20 01:31:10.441917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.359 [2024-11-20 01:31:10.441934] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.359 [2024-11-20 01:31:10.442147] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.359 [2024-11-20 01:31:10.442297] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.359 [2024-11-20 01:31:10.442320] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.359 [2024-11-20 01:31:10.442336] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.359 [2024-11-20 01:31:10.444845] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.359 [2024-11-20 01:31:10.453880] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.359 [2024-11-20 01:31:10.454161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.359 [2024-11-20 01:31:10.454298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.359 [2024-11-20 01:31:10.454340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.359 [2024-11-20 01:31:10.454356] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.359 [2024-11-20 01:31:10.454486] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.359 [2024-11-20 01:31:10.454673] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.359 [2024-11-20 01:31:10.454696] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.359 [2024-11-20 01:31:10.454711] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.359 [2024-11-20 01:31:10.457025] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.359 [2024-11-20 01:31:10.466452] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.359 [2024-11-20 01:31:10.466830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.359 [2024-11-20 01:31:10.466973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.359 [2024-11-20 01:31:10.467002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.359 [2024-11-20 01:31:10.467020] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.359 [2024-11-20 01:31:10.467161] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.359 [2024-11-20 01:31:10.467348] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.359 [2024-11-20 01:31:10.467371] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.359 [2024-11-20 01:31:10.467386] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.359 [2024-11-20 01:31:10.469719] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.359 [2024-11-20 01:31:10.478989] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.359 [2024-11-20 01:31:10.479293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.359 [2024-11-20 01:31:10.479388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.359 [2024-11-20 01:31:10.479417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.359 [2024-11-20 01:31:10.479434] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.359 [2024-11-20 01:31:10.479581] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.359 [2024-11-20 01:31:10.479749] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.359 [2024-11-20 01:31:10.479773] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.359 [2024-11-20 01:31:10.479787] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.359 [2024-11-20 01:31:10.481996] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.359 [2024-11-20 01:31:10.491445] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.359 [2024-11-20 01:31:10.491756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.359 [2024-11-20 01:31:10.491885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.359 [2024-11-20 01:31:10.491910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.359 [2024-11-20 01:31:10.491926] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.359 [2024-11-20 01:31:10.492128] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.359 [2024-11-20 01:31:10.492298] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.360 [2024-11-20 01:31:10.492321] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.360 [2024-11-20 01:31:10.492336] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.360 [2024-11-20 01:31:10.494830] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.360 [2024-11-20 01:31:10.504168] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.360 [2024-11-20 01:31:10.504477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.360 [2024-11-20 01:31:10.504624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.360 [2024-11-20 01:31:10.504650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.360 [2024-11-20 01:31:10.504670] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.360 [2024-11-20 01:31:10.504836] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.360 [2024-11-20 01:31:10.504969] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.360 [2024-11-20 01:31:10.504992] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.360 [2024-11-20 01:31:10.505007] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.360 [2024-11-20 01:31:10.507475] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.360 [2024-11-20 01:31:10.516585] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.360 [2024-11-20 01:31:10.516897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.360 [2024-11-20 01:31:10.517037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.360 [2024-11-20 01:31:10.517066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.360 [2024-11-20 01:31:10.517097] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.360 [2024-11-20 01:31:10.517244] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.360 [2024-11-20 01:31:10.517431] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.360 [2024-11-20 01:31:10.517454] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.360 [2024-11-20 01:31:10.517469] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.360 [2024-11-20 01:31:10.519798] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.360 [2024-11-20 01:31:10.529147] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.360 [2024-11-20 01:31:10.529460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.360 [2024-11-20 01:31:10.529568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.360 [2024-11-20 01:31:10.529597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.360 [2024-11-20 01:31:10.529614] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.360 [2024-11-20 01:31:10.529779] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.360 [2024-11-20 01:31:10.529912] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.360 [2024-11-20 01:31:10.529934] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.360 [2024-11-20 01:31:10.529949] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.360 [2024-11-20 01:31:10.532203] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.360 [2024-11-20 01:31:10.541631] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.360 [2024-11-20 01:31:10.541951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.360 [2024-11-20 01:31:10.542103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.360 [2024-11-20 01:31:10.542133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.360 [2024-11-20 01:31:10.542150] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.360 [2024-11-20 01:31:10.542321] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.360 [2024-11-20 01:31:10.542472] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.360 [2024-11-20 01:31:10.542495] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.360 [2024-11-20 01:31:10.542510] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.360 [2024-11-20 01:31:10.544788] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.360 [2024-11-20 01:31:10.554302] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.360 [2024-11-20 01:31:10.554674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.360 [2024-11-20 01:31:10.554889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.360 [2024-11-20 01:31:10.554914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.360 [2024-11-20 01:31:10.554929] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.360 [2024-11-20 01:31:10.555056] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.360 [2024-11-20 01:31:10.555256] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.360 [2024-11-20 01:31:10.555279] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.360 [2024-11-20 01:31:10.555294] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.360 [2024-11-20 01:31:10.557623] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.360 [2024-11-20 01:31:10.566758] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.360 [2024-11-20 01:31:10.567049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.360 [2024-11-20 01:31:10.567195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.360 [2024-11-20 01:31:10.567224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.360 [2024-11-20 01:31:10.567242] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.360 [2024-11-20 01:31:10.567389] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.360 [2024-11-20 01:31:10.567539] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.360 [2024-11-20 01:31:10.567562] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.360 [2024-11-20 01:31:10.567577] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.360 [2024-11-20 01:31:10.569986] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.622 [2024-11-20 01:31:10.579263] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.622 [2024-11-20 01:31:10.579597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.622 [2024-11-20 01:31:10.579808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.622 [2024-11-20 01:31:10.579836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.622 [2024-11-20 01:31:10.579854] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.622 [2024-11-20 01:31:10.580001] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.622 [2024-11-20 01:31:10.580189] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.622 [2024-11-20 01:31:10.580213] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.622 [2024-11-20 01:31:10.580228] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.622 [2024-11-20 01:31:10.582629] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.622 [2024-11-20 01:31:10.591811] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.622 [2024-11-20 01:31:10.592150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.622 [2024-11-20 01:31:10.592302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.622 [2024-11-20 01:31:10.592328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.622 [2024-11-20 01:31:10.592344] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.623 [2024-11-20 01:31:10.592524] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.623 [2024-11-20 01:31:10.592674] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.623 [2024-11-20 01:31:10.592696] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.623 [2024-11-20 01:31:10.592712] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.623 [2024-11-20 01:31:10.594920] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.623 [2024-11-20 01:31:10.604364] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.623 [2024-11-20 01:31:10.604725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.623 [2024-11-20 01:31:10.604823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.623 [2024-11-20 01:31:10.604867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.623 [2024-11-20 01:31:10.604884] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.623 [2024-11-20 01:31:10.605017] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.623 [2024-11-20 01:31:10.605171] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.623 [2024-11-20 01:31:10.605195] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.623 [2024-11-20 01:31:10.605210] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.623 [2024-11-20 01:31:10.607541] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.623 [2024-11-20 01:31:10.617169] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.623 [2024-11-20 01:31:10.617455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.623 [2024-11-20 01:31:10.617613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.623 [2024-11-20 01:31:10.617642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.623 [2024-11-20 01:31:10.617660] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.623 [2024-11-20 01:31:10.617825] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.623 [2024-11-20 01:31:10.617994] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.623 [2024-11-20 01:31:10.618023] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.623 [2024-11-20 01:31:10.618040] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.623 [2024-11-20 01:31:10.620418] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.623 [2024-11-20 01:31:10.629700] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.623 [2024-11-20 01:31:10.630032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.623 [2024-11-20 01:31:10.630157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.623 [2024-11-20 01:31:10.630187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.623 [2024-11-20 01:31:10.630205] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.623 [2024-11-20 01:31:10.630388] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.623 [2024-11-20 01:31:10.630556] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.623 [2024-11-20 01:31:10.630578] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.623 [2024-11-20 01:31:10.630593] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.623 [2024-11-20 01:31:10.632853] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.623 [2024-11-20 01:31:10.642476] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.623 [2024-11-20 01:31:10.642777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.623 [2024-11-20 01:31:10.642922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.623 [2024-11-20 01:31:10.642948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.623 [2024-11-20 01:31:10.642964] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.623 [2024-11-20 01:31:10.643172] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.623 [2024-11-20 01:31:10.643306] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.623 [2024-11-20 01:31:10.643329] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.623 [2024-11-20 01:31:10.643344] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.623 [2024-11-20 01:31:10.645712] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.623 [2024-11-20 01:31:10.654882] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.623 [2024-11-20 01:31:10.655247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.623 [2024-11-20 01:31:10.655371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.623 [2024-11-20 01:31:10.655397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.623 [2024-11-20 01:31:10.655413] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.623 [2024-11-20 01:31:10.655582] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.623 [2024-11-20 01:31:10.655751] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.623 [2024-11-20 01:31:10.655774] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.623 [2024-11-20 01:31:10.655795] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.623 [2024-11-20 01:31:10.658372] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.623 [2024-11-20 01:31:10.667467] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.623 [2024-11-20 01:31:10.667786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.623 [2024-11-20 01:31:10.667961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.623 [2024-11-20 01:31:10.667986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.623 [2024-11-20 01:31:10.668002] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.623 [2024-11-20 01:31:10.668145] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.623 [2024-11-20 01:31:10.668362] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.623 [2024-11-20 01:31:10.668386] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.623 [2024-11-20 01:31:10.668400] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.623 [2024-11-20 01:31:10.670600] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.623 [2024-11-20 01:31:10.679920] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.623 [2024-11-20 01:31:10.680285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.623 [2024-11-20 01:31:10.680454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.623 [2024-11-20 01:31:10.680504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.623 [2024-11-20 01:31:10.680522] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.623 [2024-11-20 01:31:10.680650] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.623 [2024-11-20 01:31:10.680854] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.623 [2024-11-20 01:31:10.680877] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.623 [2024-11-20 01:31:10.680892] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.623 [2024-11-20 01:31:10.683179] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.623 [2024-11-20 01:31:10.692602] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.623 [2024-11-20 01:31:10.692922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.623 [2024-11-20 01:31:10.693136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.623 [2024-11-20 01:31:10.693165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.623 [2024-11-20 01:31:10.693182] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.623 [2024-11-20 01:31:10.693365] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.623 [2024-11-20 01:31:10.693534] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.623 [2024-11-20 01:31:10.693557] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.623 [2024-11-20 01:31:10.693572] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.623 [2024-11-20 01:31:10.696034] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.623 [2024-11-20 01:31:10.705031] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.623 [2024-11-20 01:31:10.705343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.623 [2024-11-20 01:31:10.705477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.623 [2024-11-20 01:31:10.705506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.623 [2024-11-20 01:31:10.705523] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.623 [2024-11-20 01:31:10.705669] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.623 [2024-11-20 01:31:10.705838] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.624 [2024-11-20 01:31:10.705861] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.624 [2024-11-20 01:31:10.705877] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.624 [2024-11-20 01:31:10.707959] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.624 [2024-11-20 01:31:10.717718] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.624 [2024-11-20 01:31:10.718125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.624 [2024-11-20 01:31:10.718337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.624 [2024-11-20 01:31:10.718363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.624 [2024-11-20 01:31:10.718379] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.624 [2024-11-20 01:31:10.718506] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.624 [2024-11-20 01:31:10.718703] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.624 [2024-11-20 01:31:10.718726] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.624 [2024-11-20 01:31:10.718742] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.624 [2024-11-20 01:31:10.720999] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.624 [2024-11-20 01:31:10.730322] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.624 [2024-11-20 01:31:10.730679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.624 [2024-11-20 01:31:10.730803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.624 [2024-11-20 01:31:10.730830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.624 [2024-11-20 01:31:10.730845] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.624 [2024-11-20 01:31:10.731057] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.624 [2024-11-20 01:31:10.731275] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.624 [2024-11-20 01:31:10.731298] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.624 [2024-11-20 01:31:10.731314] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.624 [2024-11-20 01:31:10.733567] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.624 [2024-11-20 01:31:10.742989] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.624 [2024-11-20 01:31:10.743234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.624 [2024-11-20 01:31:10.743365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.624 [2024-11-20 01:31:10.743392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.624 [2024-11-20 01:31:10.743409] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.624 [2024-11-20 01:31:10.743596] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.624 [2024-11-20 01:31:10.743736] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.624 [2024-11-20 01:31:10.743758] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.624 [2024-11-20 01:31:10.743772] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.624 [2024-11-20 01:31:10.745992] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.624 [2024-11-20 01:31:10.755113] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.624 [2024-11-20 01:31:10.755376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.624 [2024-11-20 01:31:10.755490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.624 [2024-11-20 01:31:10.755516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.624 [2024-11-20 01:31:10.755531] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.624 [2024-11-20 01:31:10.755663] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.624 [2024-11-20 01:31:10.755841] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.624 [2024-11-20 01:31:10.755861] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.624 [2024-11-20 01:31:10.755873] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.624 [2024-11-20 01:31:10.757806] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.624 [2024-11-20 01:31:10.767698] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.624 [2024-11-20 01:31:10.768017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.624 [2024-11-20 01:31:10.768158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.624 [2024-11-20 01:31:10.768188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.624 [2024-11-20 01:31:10.768206] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.624 [2024-11-20 01:31:10.768335] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.624 [2024-11-20 01:31:10.768486] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.624 [2024-11-20 01:31:10.768510] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.624 [2024-11-20 01:31:10.768525] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.624 [2024-11-20 01:31:10.770772] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.624 [2024-11-20 01:31:10.780416] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.624 [2024-11-20 01:31:10.780859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.624 [2024-11-20 01:31:10.781018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.624 [2024-11-20 01:31:10.781048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.624 [2024-11-20 01:31:10.781065] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.624 [2024-11-20 01:31:10.781192] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.624 [2024-11-20 01:31:10.781360] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.624 [2024-11-20 01:31:10.781384] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.624 [2024-11-20 01:31:10.781399] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.624 [2024-11-20 01:31:10.783766] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.624 [2024-11-20 01:31:10.792997] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.624 [2024-11-20 01:31:10.793332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.624 [2024-11-20 01:31:10.793444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.624 [2024-11-20 01:31:10.793469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.624 [2024-11-20 01:31:10.793484] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.624 [2024-11-20 01:31:10.793632] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.624 [2024-11-20 01:31:10.793801] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.624 [2024-11-20 01:31:10.793824] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.624 [2024-11-20 01:31:10.793839] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.624 [2024-11-20 01:31:10.796198] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.624 [2024-11-20 01:31:10.805819] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.624 [2024-11-20 01:31:10.806113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.624 [2024-11-20 01:31:10.806218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.624 [2024-11-20 01:31:10.806261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.624 [2024-11-20 01:31:10.806277] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.624 [2024-11-20 01:31:10.806409] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.624 [2024-11-20 01:31:10.806653] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.624 [2024-11-20 01:31:10.806676] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.624 [2024-11-20 01:31:10.806691] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.624 [2024-11-20 01:31:10.809060] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.624 [2024-11-20 01:31:10.818334] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.624 [2024-11-20 01:31:10.818730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.624 [2024-11-20 01:31:10.818859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.624 [2024-11-20 01:31:10.818885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.624 [2024-11-20 01:31:10.818901] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.624 [2024-11-20 01:31:10.819101] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.624 [2024-11-20 01:31:10.819323] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.624 [2024-11-20 01:31:10.819346] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.624 [2024-11-20 01:31:10.819361] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.624 [2024-11-20 01:31:10.821529] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.625 [2024-11-20 01:31:10.830834] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.625 [2024-11-20 01:31:10.831133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.625 [2024-11-20 01:31:10.831280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.625 [2024-11-20 01:31:10.831308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.625 [2024-11-20 01:31:10.831325] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.625 [2024-11-20 01:31:10.831466] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.625 [2024-11-20 01:31:10.831632] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.625 [2024-11-20 01:31:10.831655] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.625 [2024-11-20 01:31:10.831670] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.625 [2024-11-20 01:31:10.833933] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.885 [2024-11-20 01:31:10.843315] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.885 [2024-11-20 01:31:10.843588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.885 [2024-11-20 01:31:10.843722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.885 [2024-11-20 01:31:10.843747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.885 [2024-11-20 01:31:10.843763] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.885 [2024-11-20 01:31:10.843931] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.885 [2024-11-20 01:31:10.844092] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.885 [2024-11-20 01:31:10.844116] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.885 [2024-11-20 01:31:10.844137] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.885 [2024-11-20 01:31:10.846595] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.885 [2024-11-20 01:31:10.855913] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.885 [2024-11-20 01:31:10.856244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.885 [2024-11-20 01:31:10.856376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.885 [2024-11-20 01:31:10.856416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.885 [2024-11-20 01:31:10.856441] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.885 [2024-11-20 01:31:10.856590] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.885 [2024-11-20 01:31:10.856759] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.885 [2024-11-20 01:31:10.856782] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.885 [2024-11-20 01:31:10.856812] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.885 [2024-11-20 01:31:10.858925] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.885 [2024-11-20 01:31:10.868335] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.885 [2024-11-20 01:31:10.868716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.885 [2024-11-20 01:31:10.868857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.885 [2024-11-20 01:31:10.868885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.885 [2024-11-20 01:31:10.868903] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.885 [2024-11-20 01:31:10.869067] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.885 [2024-11-20 01:31:10.869262] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.885 [2024-11-20 01:31:10.869282] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.885 [2024-11-20 01:31:10.869295] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.885 [2024-11-20 01:31:10.871568] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.885 [2024-11-20 01:31:10.881122] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.885 [2024-11-20 01:31:10.881435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.885 [2024-11-20 01:31:10.881570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.885 [2024-11-20 01:31:10.881598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.885 [2024-11-20 01:31:10.881615] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.885 [2024-11-20 01:31:10.881852] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.885 [2024-11-20 01:31:10.882021] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.885 [2024-11-20 01:31:10.882044] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.885 [2024-11-20 01:31:10.882059] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.885 [2024-11-20 01:31:10.884344] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.885 [2024-11-20 01:31:10.893731] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.885 [2024-11-20 01:31:10.894058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.885 [2024-11-20 01:31:10.894184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.885 [2024-11-20 01:31:10.894210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.885 [2024-11-20 01:31:10.894225] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.885 [2024-11-20 01:31:10.894385] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.885 [2024-11-20 01:31:10.894554] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.885 [2024-11-20 01:31:10.894576] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.885 [2024-11-20 01:31:10.894591] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.885 [2024-11-20 01:31:10.896795] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.885 [2024-11-20 01:31:10.906367] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.885 [2024-11-20 01:31:10.906668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.885 [2024-11-20 01:31:10.906800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.885 [2024-11-20 01:31:10.906842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.885 [2024-11-20 01:31:10.906858] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.885 [2024-11-20 01:31:10.906974] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.885 [2024-11-20 01:31:10.907175] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.885 [2024-11-20 01:31:10.907200] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.885 [2024-11-20 01:31:10.907214] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.885 [2024-11-20 01:31:10.909381] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.885 [2024-11-20 01:31:10.919059] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.885 [2024-11-20 01:31:10.919454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.885 [2024-11-20 01:31:10.919578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.885 [2024-11-20 01:31:10.919602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.885 [2024-11-20 01:31:10.919633] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.886 [2024-11-20 01:31:10.919816] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.886 [2024-11-20 01:31:10.920002] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.886 [2024-11-20 01:31:10.920025] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.886 [2024-11-20 01:31:10.920040] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.886 [2024-11-20 01:31:10.922326] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.886 [2024-11-20 01:31:10.931899] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.886 [2024-11-20 01:31:10.932211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.886 [2024-11-20 01:31:10.932395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.886 [2024-11-20 01:31:10.932420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.886 [2024-11-20 01:31:10.932436] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.886 [2024-11-20 01:31:10.932568] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.886 [2024-11-20 01:31:10.932789] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.886 [2024-11-20 01:31:10.932813] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.886 [2024-11-20 01:31:10.932828] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.886 [2024-11-20 01:31:10.935205] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.886 [2024-11-20 01:31:10.944459] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.886 [2024-11-20 01:31:10.944778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.886 [2024-11-20 01:31:10.944885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.886 [2024-11-20 01:31:10.944914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.886 [2024-11-20 01:31:10.944931] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.886 [2024-11-20 01:31:10.945059] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.886 [2024-11-20 01:31:10.945257] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.886 [2024-11-20 01:31:10.945281] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.886 [2024-11-20 01:31:10.945295] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.886 [2024-11-20 01:31:10.947499] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.886 [2024-11-20 01:31:10.957200] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.886 [2024-11-20 01:31:10.957520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.886 [2024-11-20 01:31:10.957676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.886 [2024-11-20 01:31:10.957704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.886 [2024-11-20 01:31:10.957722] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.886 [2024-11-20 01:31:10.957869] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.886 [2024-11-20 01:31:10.958037] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.886 [2024-11-20 01:31:10.958060] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.886 [2024-11-20 01:31:10.958087] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.886 [2024-11-20 01:31:10.960349] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.886 [2024-11-20 01:31:10.969655] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.886 [2024-11-20 01:31:10.969939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.886 [2024-11-20 01:31:10.970096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.886 [2024-11-20 01:31:10.970123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.886 [2024-11-20 01:31:10.970139] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.886 [2024-11-20 01:31:10.970295] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.886 [2024-11-20 01:31:10.970446] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.886 [2024-11-20 01:31:10.970474] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.886 [2024-11-20 01:31:10.970491] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.886 [2024-11-20 01:31:10.972603] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.886 [2024-11-20 01:31:10.982239] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.886 [2024-11-20 01:31:10.982549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.886 [2024-11-20 01:31:10.982684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.886 [2024-11-20 01:31:10.982727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.886 [2024-11-20 01:31:10.982742] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.886 [2024-11-20 01:31:10.982889] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.886 [2024-11-20 01:31:10.983048] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.886 [2024-11-20 01:31:10.983081] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.886 [2024-11-20 01:31:10.983098] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.886 [2024-11-20 01:31:10.985354] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.886 [2024-11-20 01:31:10.995048] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.886 [2024-11-20 01:31:10.995343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.886 [2024-11-20 01:31:10.995480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.886 [2024-11-20 01:31:10.995509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.886 [2024-11-20 01:31:10.995526] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.886 [2024-11-20 01:31:10.995656] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.886 [2024-11-20 01:31:10.995825] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.886 [2024-11-20 01:31:10.995848] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.886 [2024-11-20 01:31:10.995863] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.886 [2024-11-20 01:31:10.998253] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.886 [2024-11-20 01:31:11.007528] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.886 [2024-11-20 01:31:11.007823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.886 [2024-11-20 01:31:11.007962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.886 [2024-11-20 01:31:11.007988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.886 [2024-11-20 01:31:11.008004] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.886 [2024-11-20 01:31:11.008253] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.886 [2024-11-20 01:31:11.008405] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.886 [2024-11-20 01:31:11.008429] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.886 [2024-11-20 01:31:11.008450] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.886 [2024-11-20 01:31:11.010848] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.886 [2024-11-20 01:31:11.020147] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.886 [2024-11-20 01:31:11.020494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.886 [2024-11-20 01:31:11.020767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.886 [2024-11-20 01:31:11.020820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.886 [2024-11-20 01:31:11.020837] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.886 [2024-11-20 01:31:11.021001] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.886 [2024-11-20 01:31:11.021199] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.886 [2024-11-20 01:31:11.021223] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.886 [2024-11-20 01:31:11.021238] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.886 [2024-11-20 01:31:11.023713] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.886 [2024-11-20 01:31:11.032655] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.886 [2024-11-20 01:31:11.032973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.886 [2024-11-20 01:31:11.033142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.886 [2024-11-20 01:31:11.033170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.886 [2024-11-20 01:31:11.033187] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.886 [2024-11-20 01:31:11.033312] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.886 [2024-11-20 01:31:11.033477] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.886 [2024-11-20 01:31:11.033500] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.886 [2024-11-20 01:31:11.033515] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.887 [2024-11-20 01:31:11.035718] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.887 [2024-11-20 01:31:11.045221] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.887 [2024-11-20 01:31:11.045571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.887 [2024-11-20 01:31:11.045692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.887 [2024-11-20 01:31:11.045718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.887 [2024-11-20 01:31:11.045734] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.887 [2024-11-20 01:31:11.045882] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.887 [2024-11-20 01:31:11.046051] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.887 [2024-11-20 01:31:11.046089] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.887 [2024-11-20 01:31:11.046122] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.887 [2024-11-20 01:31:11.048440] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.887 [2024-11-20 01:31:11.057361] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.887 [2024-11-20 01:31:11.057643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.887 [2024-11-20 01:31:11.057774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.887 [2024-11-20 01:31:11.057800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.887 [2024-11-20 01:31:11.057816] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.887 [2024-11-20 01:31:11.058027] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.887 [2024-11-20 01:31:11.058249] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.887 [2024-11-20 01:31:11.058271] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.887 [2024-11-20 01:31:11.058286] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.887 [2024-11-20 01:31:11.060839] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.887 [2024-11-20 01:31:11.069818] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.887 [2024-11-20 01:31:11.070182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.887 [2024-11-20 01:31:11.070286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.887 [2024-11-20 01:31:11.070311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.887 [2024-11-20 01:31:11.070326] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.887 [2024-11-20 01:31:11.070523] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.887 [2024-11-20 01:31:11.070728] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.887 [2024-11-20 01:31:11.070752] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.887 [2024-11-20 01:31:11.070766] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.887 [2024-11-20 01:31:11.072933] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.887 [2024-11-20 01:31:11.082621] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.887 [2024-11-20 01:31:11.082961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.887 [2024-11-20 01:31:11.083083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.887 [2024-11-20 01:31:11.083127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.887 [2024-11-20 01:31:11.083144] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.887 [2024-11-20 01:31:11.083276] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.887 [2024-11-20 01:31:11.083452] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.887 [2024-11-20 01:31:11.083475] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.887 [2024-11-20 01:31:11.083491] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.887 [2024-11-20 01:31:11.085810] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.887 [2024-11-20 01:31:11.095327] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.887 [2024-11-20 01:31:11.095672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.887 [2024-11-20 01:31:11.095777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.887 [2024-11-20 01:31:11.095805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:02.887 [2024-11-20 01:31:11.095823] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:02.887 [2024-11-20 01:31:11.095952] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:02.887 [2024-11-20 01:31:11.096162] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.887 [2024-11-20 01:31:11.096184] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.887 [2024-11-20 01:31:11.096198] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.887 [2024-11-20 01:31:11.098278] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.147 [2024-11-20 01:31:11.107906] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.147 [2024-11-20 01:31:11.108238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.147 [2024-11-20 01:31:11.108339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.147 [2024-11-20 01:31:11.108365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.147 [2024-11-20 01:31:11.108380] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.147 [2024-11-20 01:31:11.108512] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.147 [2024-11-20 01:31:11.108676] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.147 [2024-11-20 01:31:11.108700] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.147 [2024-11-20 01:31:11.108716] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.148 [2024-11-20 01:31:11.111094] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.148 [2024-11-20 01:31:11.120528] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.148 [2024-11-20 01:31:11.120788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.148 [2024-11-20 01:31:11.120934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.148 [2024-11-20 01:31:11.120962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.148 [2024-11-20 01:31:11.120979] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.148 [2024-11-20 01:31:11.121133] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.148 [2024-11-20 01:31:11.121270] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.148 [2024-11-20 01:31:11.121290] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.148 [2024-11-20 01:31:11.121304] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.148 [2024-11-20 01:31:11.123588] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.148 [2024-11-20 01:31:11.133176] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.148 [2024-11-20 01:31:11.133477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.148 [2024-11-20 01:31:11.133640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.148 [2024-11-20 01:31:11.133668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.148 [2024-11-20 01:31:11.133685] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.148 [2024-11-20 01:31:11.133777] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.148 [2024-11-20 01:31:11.133927] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.148 [2024-11-20 01:31:11.133950] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.148 [2024-11-20 01:31:11.133966] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.148 [2024-11-20 01:31:11.136140] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.148 [2024-11-20 01:31:11.145803] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.148 [2024-11-20 01:31:11.146085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.148 [2024-11-20 01:31:11.146243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.148 [2024-11-20 01:31:11.146270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.148 [2024-11-20 01:31:11.146287] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.148 [2024-11-20 01:31:11.146429] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.148 [2024-11-20 01:31:11.146558] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.148 [2024-11-20 01:31:11.146581] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.148 [2024-11-20 01:31:11.146596] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.148 [2024-11-20 01:31:11.148784] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.148 [2024-11-20 01:31:11.158429] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.148 [2024-11-20 01:31:11.158743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.148 [2024-11-20 01:31:11.158881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.148 [2024-11-20 01:31:11.158910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.148 [2024-11-20 01:31:11.158927] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.148 [2024-11-20 01:31:11.159057] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.148 [2024-11-20 01:31:11.159238] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.148 [2024-11-20 01:31:11.159262] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.148 [2024-11-20 01:31:11.159277] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.148 [2024-11-20 01:31:11.161589] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.148 [2024-11-20 01:31:11.170916] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.148 [2024-11-20 01:31:11.171237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.148 [2024-11-20 01:31:11.171389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.148 [2024-11-20 01:31:11.171415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.148 [2024-11-20 01:31:11.171431] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.148 [2024-11-20 01:31:11.171598] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.148 [2024-11-20 01:31:11.171772] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.148 [2024-11-20 01:31:11.171793] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.148 [2024-11-20 01:31:11.171807] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.148 [2024-11-20 01:31:11.173966] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.148 [2024-11-20 01:31:11.183021] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.148 [2024-11-20 01:31:11.183326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.148 [2024-11-20 01:31:11.183452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.148 [2024-11-20 01:31:11.183479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.148 [2024-11-20 01:31:11.183495] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.148 [2024-11-20 01:31:11.183676] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.148 [2024-11-20 01:31:11.183835] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.148 [2024-11-20 01:31:11.183854] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.148 [2024-11-20 01:31:11.183867] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.148 [2024-11-20 01:31:11.185944] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.148 [2024-11-20 01:31:11.194976] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.148 [2024-11-20 01:31:11.195359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.148 [2024-11-20 01:31:11.195487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.148 [2024-11-20 01:31:11.195514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.148 [2024-11-20 01:31:11.195530] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.148 [2024-11-20 01:31:11.195646] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.148 [2024-11-20 01:31:11.195824] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.148 [2024-11-20 01:31:11.195842] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.148 [2024-11-20 01:31:11.195855] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.148 [2024-11-20 01:31:11.197770] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.148 [2024-11-20 01:31:11.207116] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.148 [2024-11-20 01:31:11.207471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.148 [2024-11-20 01:31:11.207590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.148 [2024-11-20 01:31:11.207616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.148 [2024-11-20 01:31:11.207637] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.148 [2024-11-20 01:31:11.207832] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.148 [2024-11-20 01:31:11.208001] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.148 [2024-11-20 01:31:11.208020] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.148 [2024-11-20 01:31:11.208032] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.148 [2024-11-20 01:31:11.210017] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.148 [2024-11-20 01:31:11.219225] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.148 [2024-11-20 01:31:11.219614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.148 [2024-11-20 01:31:11.219737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.148 [2024-11-20 01:31:11.219763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.148 [2024-11-20 01:31:11.219778] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.148 [2024-11-20 01:31:11.219927] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.148 [2024-11-20 01:31:11.220103] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.148 [2024-11-20 01:31:11.220124] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.148 [2024-11-20 01:31:11.220137] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.148 [2024-11-20 01:31:11.222196] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.148 [2024-11-20 01:31:11.231595] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.148 [2024-11-20 01:31:11.231855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.149 [2024-11-20 01:31:11.231988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.149 [2024-11-20 01:31:11.232013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.149 [2024-11-20 01:31:11.232029] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.149 [2024-11-20 01:31:11.232205] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.149 [2024-11-20 01:31:11.232385] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.149 [2024-11-20 01:31:11.232404] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.149 [2024-11-20 01:31:11.232417] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.149 [2024-11-20 01:31:11.234272] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.149 [2024-11-20 01:31:11.243837] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.149 [2024-11-20 01:31:11.244182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.149 [2024-11-20 01:31:11.244280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.149 [2024-11-20 01:31:11.244306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.149 [2024-11-20 01:31:11.244322] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.149 [2024-11-20 01:31:11.244475] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.149 [2024-11-20 01:31:11.244666] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.149 [2024-11-20 01:31:11.244685] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.149 [2024-11-20 01:31:11.244698] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.149 [2024-11-20 01:31:11.246697] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.149 [2024-11-20 01:31:11.255953] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.149 [2024-11-20 01:31:11.256348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.149 [2024-11-20 01:31:11.256479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.149 [2024-11-20 01:31:11.256503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.149 [2024-11-20 01:31:11.256518] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.149 [2024-11-20 01:31:11.256649] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.149 [2024-11-20 01:31:11.256808] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.149 [2024-11-20 01:31:11.256827] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.149 [2024-11-20 01:31:11.256840] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.149 [2024-11-20 01:31:11.258888] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.149 [2024-11-20 01:31:11.268139] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.149 [2024-11-20 01:31:11.268449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.149 [2024-11-20 01:31:11.268571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.149 [2024-11-20 01:31:11.268596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.149 [2024-11-20 01:31:11.268612] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.149 [2024-11-20 01:31:11.268743] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.149 [2024-11-20 01:31:11.268964] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.149 [2024-11-20 01:31:11.268984] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.149 [2024-11-20 01:31:11.268996] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.149 [2024-11-20 01:31:11.270948] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.149 [2024-11-20 01:31:11.280177] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.149 [2024-11-20 01:31:11.280525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.149 [2024-11-20 01:31:11.280649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.149 [2024-11-20 01:31:11.280674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.149 [2024-11-20 01:31:11.280690] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.149 [2024-11-20 01:31:11.280843] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.149 [2024-11-20 01:31:11.281001] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.149 [2024-11-20 01:31:11.281020] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.149 [2024-11-20 01:31:11.281032] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.149 [2024-11-20 01:31:11.282957] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.149 [2024-11-20 01:31:11.292313] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.149 [2024-11-20 01:31:11.292645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.149 [2024-11-20 01:31:11.292736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.149 [2024-11-20 01:31:11.292762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.149 [2024-11-20 01:31:11.292778] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.149 [2024-11-20 01:31:11.292910] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.149 [2024-11-20 01:31:11.293086] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.149 [2024-11-20 01:31:11.293121] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.149 [2024-11-20 01:31:11.293135] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.149 [2024-11-20 01:31:11.295064] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.149 [2024-11-20 01:31:11.304336] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.149 [2024-11-20 01:31:11.304623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.149 [2024-11-20 01:31:11.304722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.149 [2024-11-20 01:31:11.304748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.149 [2024-11-20 01:31:11.304764] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.149 [2024-11-20 01:31:11.304926] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.149 [2024-11-20 01:31:11.305142] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.149 [2024-11-20 01:31:11.305163] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.149 [2024-11-20 01:31:11.305176] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.149 [2024-11-20 01:31:11.307173] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.149 [2024-11-20 01:31:11.316468] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.149 [2024-11-20 01:31:11.316830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.149 [2024-11-20 01:31:11.317003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.149 [2024-11-20 01:31:11.317027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.149 [2024-11-20 01:31:11.317043] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.149 [2024-11-20 01:31:11.317199] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.149 [2024-11-20 01:31:11.317378] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.149 [2024-11-20 01:31:11.317397] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.149 [2024-11-20 01:31:11.317410] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.149 [2024-11-20 01:31:11.319270] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.149 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh: line 35: 1268046 Killed "${NVMF_APP[@]}" "$@" 00:30:03.149 01:31:11 -- host/bdevperf.sh@36 -- # tgt_init 00:30:03.149 01:31:11 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:30:03.149 01:31:11 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:03.149 01:31:11 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:03.149 01:31:11 -- common/autotest_common.sh@10 -- # set +x 00:30:03.149 [2024-11-20 01:31:11.328648] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.149 [2024-11-20 01:31:11.328967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.149 [2024-11-20 01:31:11.329083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.149 [2024-11-20 01:31:11.329116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.149 [2024-11-20 01:31:11.329131] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.149 [2024-11-20 01:31:11.329296] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.149 [2024-11-20 01:31:11.329487] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.149 [2024-11-20 01:31:11.329507] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.149 [2024-11-20 01:31:11.329519] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.149 [2024-11-20 01:31:11.331544] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.149 01:31:11 -- nvmf/common.sh@469 -- # nvmfpid=1269169 00:30:03.150 01:31:11 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:30:03.150 01:31:11 -- nvmf/common.sh@470 -- # waitforlisten 1269169 00:30:03.150 01:31:11 -- common/autotest_common.sh@829 -- # '[' -z 1269169 ']' 00:30:03.150 01:31:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:03.150 01:31:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:03.150 01:31:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:03.150 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:03.150 01:31:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:03.150 01:31:11 -- common/autotest_common.sh@10 -- # set +x 00:30:03.150 [2024-11-20 01:31:11.340826] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.150 [2024-11-20 01:31:11.341116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.150 [2024-11-20 01:31:11.341213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.150 [2024-11-20 01:31:11.341238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.150 [2024-11-20 01:31:11.341254] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.150 [2024-11-20 01:31:11.341386] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.150 [2024-11-20 01:31:11.341517] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.150 [2024-11-20 01:31:11.341536] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.150 [2024-11-20 01:31:11.341554] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.150 [2024-11-20 01:31:11.343731] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.150 [2024-11-20 01:31:11.353003] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.150 [2024-11-20 01:31:11.353408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.150 [2024-11-20 01:31:11.353561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.150 [2024-11-20 01:31:11.353587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.150 [2024-11-20 01:31:11.353603] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.150 [2024-11-20 01:31:11.353736] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.150 [2024-11-20 01:31:11.353925] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.150 [2024-11-20 01:31:11.353944] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.150 [2024-11-20 01:31:11.353957] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.150 [2024-11-20 01:31:11.356162] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.412 [2024-11-20 01:31:11.365300] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.412 [2024-11-20 01:31:11.365668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.412 [2024-11-20 01:31:11.365820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.412 [2024-11-20 01:31:11.365846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.412 [2024-11-20 01:31:11.365862] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.412 [2024-11-20 01:31:11.366011] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.412 [2024-11-20 01:31:11.366227] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.412 [2024-11-20 01:31:11.366248] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.412 [2024-11-20 01:31:11.366260] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.412 [2024-11-20 01:31:11.368551] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.412 [2024-11-20 01:31:11.377498] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.412 [2024-11-20 01:31:11.377799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.412 [2024-11-20 01:31:11.377898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.412 [2024-11-20 01:31:11.377923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.412 [2024-11-20 01:31:11.377939] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.412 [2024-11-20 01:31:11.378112] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.412 [2024-11-20 01:31:11.378184] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:30:03.413 [2024-11-20 01:31:11.378260] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:03.413 [2024-11-20 01:31:11.378273] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.413 [2024-11-20 01:31:11.378293] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.413 [2024-11-20 01:31:11.378305] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.413 [2024-11-20 01:31:11.380274] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.413 [2024-11-20 01:31:11.389786] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.413 [2024-11-20 01:31:11.390159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.413 [2024-11-20 01:31:11.390282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.413 [2024-11-20 01:31:11.390308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.413 [2024-11-20 01:31:11.390324] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.413 [2024-11-20 01:31:11.390473] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.413 [2024-11-20 01:31:11.390631] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.413 [2024-11-20 01:31:11.390650] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.413 [2024-11-20 01:31:11.390662] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.413 [2024-11-20 01:31:11.392543] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.413 [2024-11-20 01:31:11.401881] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.413 [2024-11-20 01:31:11.402188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.413 [2024-11-20 01:31:11.402283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.413 [2024-11-20 01:31:11.402308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.413 [2024-11-20 01:31:11.402324] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.413 [2024-11-20 01:31:11.402489] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.413 [2024-11-20 01:31:11.402681] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.413 [2024-11-20 01:31:11.402700] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.413 [2024-11-20 01:31:11.402713] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.413 [2024-11-20 01:31:11.404710] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.413 EAL: No free 2048 kB hugepages reported on node 1 00:30:03.413 [2024-11-20 01:31:11.414155] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.413 [2024-11-20 01:31:11.414543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.413 [2024-11-20 01:31:11.414641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.413 [2024-11-20 01:31:11.414667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.413 [2024-11-20 01:31:11.414683] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.413 [2024-11-20 01:31:11.414815] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.413 [2024-11-20 01:31:11.414983] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.413 [2024-11-20 01:31:11.415009] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.413 [2024-11-20 01:31:11.415024] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.413 [2024-11-20 01:31:11.417136] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.413 [2024-11-20 01:31:11.426502] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.413 [2024-11-20 01:31:11.426788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.413 [2024-11-20 01:31:11.426886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.413 [2024-11-20 01:31:11.426912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.413 [2024-11-20 01:31:11.426928] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.413 [2024-11-20 01:31:11.427060] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.413 [2024-11-20 01:31:11.427234] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.413 [2024-11-20 01:31:11.427254] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.413 [2024-11-20 01:31:11.427267] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.413 [2024-11-20 01:31:11.429291] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.413 [2024-11-20 01:31:11.438687] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.413 [2024-11-20 01:31:11.439018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.413 [2024-11-20 01:31:11.439145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.413 [2024-11-20 01:31:11.439172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.413 [2024-11-20 01:31:11.439188] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.413 [2024-11-20 01:31:11.439337] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.413 [2024-11-20 01:31:11.439536] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.413 [2024-11-20 01:31:11.439555] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.413 [2024-11-20 01:31:11.439568] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.413 [2024-11-20 01:31:11.441339] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.413 [2024-11-20 01:31:11.443903] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:30:03.413 [2024-11-20 01:31:11.450917] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.413 [2024-11-20 01:31:11.451335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.413 [2024-11-20 01:31:11.451495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.413 [2024-11-20 01:31:11.451522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.413 [2024-11-20 01:31:11.451540] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.413 [2024-11-20 01:31:11.451693] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.413 [2024-11-20 01:31:11.451858] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.413 [2024-11-20 01:31:11.451879] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.413 [2024-11-20 01:31:11.451903] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.413 [2024-11-20 01:31:11.454018] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.413 [2024-11-20 01:31:11.463378] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.413 [2024-11-20 01:31:11.463863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.413 [2024-11-20 01:31:11.464020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.413 [2024-11-20 01:31:11.464047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.413 [2024-11-20 01:31:11.464064] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.413 [2024-11-20 01:31:11.464233] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.413 [2024-11-20 01:31:11.464431] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.413 [2024-11-20 01:31:11.464451] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.413 [2024-11-20 01:31:11.464466] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.413 [2024-11-20 01:31:11.466525] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.413 [2024-11-20 01:31:11.475508] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.413 [2024-11-20 01:31:11.475805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.413 [2024-11-20 01:31:11.475897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.413 [2024-11-20 01:31:11.475922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.413 [2024-11-20 01:31:11.475938] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.413 [2024-11-20 01:31:11.476055] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.413 [2024-11-20 01:31:11.476246] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.413 [2024-11-20 01:31:11.476267] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.413 [2024-11-20 01:31:11.476281] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.413 [2024-11-20 01:31:11.478274] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.413 [2024-11-20 01:31:11.487813] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.413 [2024-11-20 01:31:11.488162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.413 [2024-11-20 01:31:11.488266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.413 [2024-11-20 01:31:11.488293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.413 [2024-11-20 01:31:11.488309] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.413 [2024-11-20 01:31:11.488460] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.413 [2024-11-20 01:31:11.488642] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.414 [2024-11-20 01:31:11.488663] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.414 [2024-11-20 01:31:11.488685] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.414 [2024-11-20 01:31:11.490805] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.414 [2024-11-20 01:31:11.500105] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.414 [2024-11-20 01:31:11.500544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.414 [2024-11-20 01:31:11.500722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.414 [2024-11-20 01:31:11.500748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.414 [2024-11-20 01:31:11.500767] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.414 [2024-11-20 01:31:11.500909] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.414 [2024-11-20 01:31:11.501131] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.414 [2024-11-20 01:31:11.501170] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.414 [2024-11-20 01:31:11.501187] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.414 [2024-11-20 01:31:11.503160] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.414 [2024-11-20 01:31:11.512284] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.414 [2024-11-20 01:31:11.512655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.414 [2024-11-20 01:31:11.512747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.414 [2024-11-20 01:31:11.512773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.414 [2024-11-20 01:31:11.512789] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.414 [2024-11-20 01:31:11.512999] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.414 [2024-11-20 01:31:11.513157] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.414 [2024-11-20 01:31:11.513178] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.414 [2024-11-20 01:31:11.513193] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.414 [2024-11-20 01:31:11.515307] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.414 [2024-11-20 01:31:11.524804] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.414 [2024-11-20 01:31:11.525181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.414 [2024-11-20 01:31:11.525317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.414 [2024-11-20 01:31:11.525343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.414 [2024-11-20 01:31:11.525360] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.414 [2024-11-20 01:31:11.525542] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.414 [2024-11-20 01:31:11.525722] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.414 [2024-11-20 01:31:11.525741] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.414 [2024-11-20 01:31:11.525755] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.414 [2024-11-20 01:31:11.527754] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.414 [2024-11-20 01:31:11.529393] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:03.414 [2024-11-20 01:31:11.529530] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:03.414 [2024-11-20 01:31:11.529549] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:03.414 [2024-11-20 01:31:11.529562] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:03.414 [2024-11-20 01:31:11.529620] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:30:03.414 [2024-11-20 01:31:11.529682] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:30:03.414 [2024-11-20 01:31:11.529685] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:03.414 [2024-11-20 01:31:11.537117] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.414 [2024-11-20 01:31:11.537536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.414 [2024-11-20 01:31:11.537685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.414 [2024-11-20 01:31:11.537712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.414 [2024-11-20 01:31:11.537731] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.414 [2024-11-20 01:31:11.537922] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.414 [2024-11-20 01:31:11.538121] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.414 [2024-11-20 01:31:11.538144] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.414 [2024-11-20 01:31:11.538160] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.414 [2024-11-20 01:31:11.540253] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.414 [2024-11-20 01:31:11.549625] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.414 [2024-11-20 01:31:11.550052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.414 [2024-11-20 01:31:11.550173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.414 [2024-11-20 01:31:11.550201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.414 [2024-11-20 01:31:11.550221] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.414 [2024-11-20 01:31:11.550347] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.414 [2024-11-20 01:31:11.550536] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.414 [2024-11-20 01:31:11.550558] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.414 [2024-11-20 01:31:11.550574] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.414 [2024-11-20 01:31:11.552759] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.414 [2024-11-20 01:31:11.561863] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.414 [2024-11-20 01:31:11.562232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.414 [2024-11-20 01:31:11.562364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.414 [2024-11-20 01:31:11.562391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.414 [2024-11-20 01:31:11.562411] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.414 [2024-11-20 01:31:11.562545] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.414 [2024-11-20 01:31:11.562668] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.414 [2024-11-20 01:31:11.562689] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.414 [2024-11-20 01:31:11.562705] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.414 [2024-11-20 01:31:11.564878] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.414 [2024-11-20 01:31:11.574477] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.414 [2024-11-20 01:31:11.574901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.414 [2024-11-20 01:31:11.575014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.414 [2024-11-20 01:31:11.575041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.414 [2024-11-20 01:31:11.575076] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.414 [2024-11-20 01:31:11.575271] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.414 [2024-11-20 01:31:11.575416] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.414 [2024-11-20 01:31:11.575437] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.414 [2024-11-20 01:31:11.575454] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.414 [2024-11-20 01:31:11.577764] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.414 [2024-11-20 01:31:11.586904] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.414 [2024-11-20 01:31:11.587229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.414 [2024-11-20 01:31:11.587363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.414 [2024-11-20 01:31:11.587389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.414 [2024-11-20 01:31:11.587407] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.414 [2024-11-20 01:31:11.587556] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.414 [2024-11-20 01:31:11.587711] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.414 [2024-11-20 01:31:11.587733] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.414 [2024-11-20 01:31:11.587749] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.414 [2024-11-20 01:31:11.589859] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.414 [2024-11-20 01:31:11.599262] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.414 [2024-11-20 01:31:11.599739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.414 [2024-11-20 01:31:11.599861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.414 [2024-11-20 01:31:11.599888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.414 [2024-11-20 01:31:11.599907] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.415 [2024-11-20 01:31:11.600066] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.415 [2024-11-20 01:31:11.600248] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.415 [2024-11-20 01:31:11.600270] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.415 [2024-11-20 01:31:11.600286] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.415 [2024-11-20 01:31:11.602207] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.415 [2024-11-20 01:31:11.611696] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.415 [2024-11-20 01:31:11.612085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.415 [2024-11-20 01:31:11.612221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.415 [2024-11-20 01:31:11.612248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.415 [2024-11-20 01:31:11.612267] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.415 [2024-11-20 01:31:11.612423] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.415 [2024-11-20 01:31:11.612577] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.415 [2024-11-20 01:31:11.612598] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.415 [2024-11-20 01:31:11.612613] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.415 [2024-11-20 01:31:11.614914] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.415 [2024-11-20 01:31:11.624000] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.415 [2024-11-20 01:31:11.624309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.415 [2024-11-20 01:31:11.624446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.415 [2024-11-20 01:31:11.624472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.415 [2024-11-20 01:31:11.624489] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.415 [2024-11-20 01:31:11.624624] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.415 [2024-11-20 01:31:11.624760] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.415 [2024-11-20 01:31:11.624781] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.415 [2024-11-20 01:31:11.624795] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.415 [2024-11-20 01:31:11.626997] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.676 [2024-11-20 01:31:11.636532] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.676 [2024-11-20 01:31:11.636793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.676 [2024-11-20 01:31:11.636926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.676 [2024-11-20 01:31:11.636952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.676 [2024-11-20 01:31:11.636969] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.676 [2024-11-20 01:31:11.637093] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.676 [2024-11-20 01:31:11.637230] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.676 [2024-11-20 01:31:11.637260] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.676 [2024-11-20 01:31:11.637275] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.676 [2024-11-20 01:31:11.639285] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.676 [2024-11-20 01:31:11.648824] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.676 [2024-11-20 01:31:11.649060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.676 [2024-11-20 01:31:11.649159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.676 [2024-11-20 01:31:11.649184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.676 [2024-11-20 01:31:11.649200] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.676 [2024-11-20 01:31:11.649364] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.676 [2024-11-20 01:31:11.649515] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.676 [2024-11-20 01:31:11.649536] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.676 [2024-11-20 01:31:11.649550] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.676 [2024-11-20 01:31:11.651773] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.676 [2024-11-20 01:31:11.660940] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.676 [2024-11-20 01:31:11.661234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.676 [2024-11-20 01:31:11.661344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.676 [2024-11-20 01:31:11.661370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.676 [2024-11-20 01:31:11.661385] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.676 [2024-11-20 01:31:11.661550] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.676 [2024-11-20 01:31:11.661702] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.676 [2024-11-20 01:31:11.661722] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.676 [2024-11-20 01:31:11.661736] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.676 [2024-11-20 01:31:11.663904] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.676 [2024-11-20 01:31:11.673102] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.676 [2024-11-20 01:31:11.673394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.676 [2024-11-20 01:31:11.673491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.676 [2024-11-20 01:31:11.673517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.676 [2024-11-20 01:31:11.673533] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.676 [2024-11-20 01:31:11.673681] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.676 [2024-11-20 01:31:11.673800] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.676 [2024-11-20 01:31:11.673820] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.676 [2024-11-20 01:31:11.673840] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.676 [2024-11-20 01:31:11.676017] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.676 [2024-11-20 01:31:11.685565] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.676 [2024-11-20 01:31:11.685790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.676 [2024-11-20 01:31:11.685885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.676 [2024-11-20 01:31:11.685911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.676 [2024-11-20 01:31:11.685927] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.676 [2024-11-20 01:31:11.686099] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.676 [2024-11-20 01:31:11.686219] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.676 [2024-11-20 01:31:11.686240] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.676 [2024-11-20 01:31:11.686253] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.676 [2024-11-20 01:31:11.688218] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.676 [2024-11-20 01:31:11.697758] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.676 [2024-11-20 01:31:11.698041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.676 [2024-11-20 01:31:11.698149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.676 [2024-11-20 01:31:11.698175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.676 [2024-11-20 01:31:11.698191] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.676 [2024-11-20 01:31:11.698355] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.676 [2024-11-20 01:31:11.698539] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.676 [2024-11-20 01:31:11.698559] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.676 [2024-11-20 01:31:11.698573] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.676 [2024-11-20 01:31:11.700775] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.676 [2024-11-20 01:31:11.710197] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.676 [2024-11-20 01:31:11.710481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.676 [2024-11-20 01:31:11.710581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.676 [2024-11-20 01:31:11.710607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.676 [2024-11-20 01:31:11.710623] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.676 [2024-11-20 01:31:11.710803] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.676 [2024-11-20 01:31:11.710956] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.676 [2024-11-20 01:31:11.710977] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.676 [2024-11-20 01:31:11.710990] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.676 [2024-11-20 01:31:11.713174] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.676 [2024-11-20 01:31:11.722700] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.676 [2024-11-20 01:31:11.722976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.676 [2024-11-20 01:31:11.723076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.676 [2024-11-20 01:31:11.723103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.676 [2024-11-20 01:31:11.723119] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.676 [2024-11-20 01:31:11.723299] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.676 [2024-11-20 01:31:11.723419] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.677 [2024-11-20 01:31:11.723440] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.677 [2024-11-20 01:31:11.723453] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.677 [2024-11-20 01:31:11.725529] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.677 [2024-11-20 01:31:11.735116] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.677 [2024-11-20 01:31:11.735348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.677 [2024-11-20 01:31:11.735465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.677 [2024-11-20 01:31:11.735490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.677 [2024-11-20 01:31:11.735506] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.677 [2024-11-20 01:31:11.735670] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.677 [2024-11-20 01:31:11.735822] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.677 [2024-11-20 01:31:11.735842] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.677 [2024-11-20 01:31:11.735856] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.677 [2024-11-20 01:31:11.737991] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.677 [2024-11-20 01:31:11.747526] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.677 [2024-11-20 01:31:11.747839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.677 [2024-11-20 01:31:11.747989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.677 [2024-11-20 01:31:11.748014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.677 [2024-11-20 01:31:11.748029] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.677 [2024-11-20 01:31:11.748217] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.677 [2024-11-20 01:31:11.748337] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.677 [2024-11-20 01:31:11.748358] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.677 [2024-11-20 01:31:11.748372] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.677 [2024-11-20 01:31:11.750555] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.677 [2024-11-20 01:31:11.759790] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.677 [2024-11-20 01:31:11.760065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.677 [2024-11-20 01:31:11.760194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.677 [2024-11-20 01:31:11.760219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.677 [2024-11-20 01:31:11.760235] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.677 [2024-11-20 01:31:11.760367] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.677 [2024-11-20 01:31:11.760519] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.677 [2024-11-20 01:31:11.760539] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.677 [2024-11-20 01:31:11.760553] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.677 [2024-11-20 01:31:11.762796] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.677 [2024-11-20 01:31:11.772204] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.677 [2024-11-20 01:31:11.772474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.677 [2024-11-20 01:31:11.772571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.677 [2024-11-20 01:31:11.772597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.677 [2024-11-20 01:31:11.772612] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.677 [2024-11-20 01:31:11.772793] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.677 [2024-11-20 01:31:11.772912] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.677 [2024-11-20 01:31:11.772933] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.677 [2024-11-20 01:31:11.772947] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.677 [2024-11-20 01:31:11.775005] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.677 [2024-11-20 01:31:11.784372] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.677 [2024-11-20 01:31:11.784703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.677 [2024-11-20 01:31:11.784834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.677 [2024-11-20 01:31:11.784860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.677 [2024-11-20 01:31:11.784875] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.677 [2024-11-20 01:31:11.784991] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.677 [2024-11-20 01:31:11.785136] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.677 [2024-11-20 01:31:11.785157] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.677 [2024-11-20 01:31:11.785171] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.677 [2024-11-20 01:31:11.787305] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.677 [2024-11-20 01:31:11.796503] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.677 [2024-11-20 01:31:11.796780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.677 [2024-11-20 01:31:11.796887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.677 [2024-11-20 01:31:11.796913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.677 [2024-11-20 01:31:11.796929] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.677 [2024-11-20 01:31:11.797090] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.677 [2024-11-20 01:31:11.797300] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.677 [2024-11-20 01:31:11.797322] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.677 [2024-11-20 01:31:11.797336] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.677 [2024-11-20 01:31:11.799565] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.677 [2024-11-20 01:31:11.808979] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.677 [2024-11-20 01:31:11.809246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.677 [2024-11-20 01:31:11.809347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.677 [2024-11-20 01:31:11.809373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.677 [2024-11-20 01:31:11.809389] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.677 [2024-11-20 01:31:11.809522] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.677 [2024-11-20 01:31:11.809706] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.677 [2024-11-20 01:31:11.809727] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.677 [2024-11-20 01:31:11.809740] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.677 [2024-11-20 01:31:11.811780] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.677 [2024-11-20 01:31:11.821304] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.677 [2024-11-20 01:31:11.821608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.677 [2024-11-20 01:31:11.821699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.677 [2024-11-20 01:31:11.821725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.677 [2024-11-20 01:31:11.821741] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.677 [2024-11-20 01:31:11.821873] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.677 [2024-11-20 01:31:11.822025] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.677 [2024-11-20 01:31:11.822046] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.677 [2024-11-20 01:31:11.822059] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.677 [2024-11-20 01:31:11.824013] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.677 [2024-11-20 01:31:11.833530] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.677 [2024-11-20 01:31:11.833807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.677 [2024-11-20 01:31:11.833961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.677 [2024-11-20 01:31:11.833992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.677 [2024-11-20 01:31:11.834008] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.677 [2024-11-20 01:31:11.834132] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.677 [2024-11-20 01:31:11.834301] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.677 [2024-11-20 01:31:11.834322] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.677 [2024-11-20 01:31:11.834336] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.677 [2024-11-20 01:31:11.836392] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.678 [2024-11-20 01:31:11.845612] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.678 [2024-11-20 01:31:11.845903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.678 [2024-11-20 01:31:11.846002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.678 [2024-11-20 01:31:11.846028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.678 [2024-11-20 01:31:11.846043] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.678 [2024-11-20 01:31:11.846183] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.678 [2024-11-20 01:31:11.846353] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.678 [2024-11-20 01:31:11.846373] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.678 [2024-11-20 01:31:11.846387] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.678 [2024-11-20 01:31:11.848520] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.678 [2024-11-20 01:31:11.857924] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.678 [2024-11-20 01:31:11.858207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.678 [2024-11-20 01:31:11.858331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.678 [2024-11-20 01:31:11.858357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.678 [2024-11-20 01:31:11.858373] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.678 [2024-11-20 01:31:11.858521] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.678 [2024-11-20 01:31:11.858673] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.678 [2024-11-20 01:31:11.858695] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.678 [2024-11-20 01:31:11.858709] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.678 [2024-11-20 01:31:11.860737] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.678 [2024-11-20 01:31:11.870297] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.678 [2024-11-20 01:31:11.870567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.678 [2024-11-20 01:31:11.870662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.678 [2024-11-20 01:31:11.870689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.678 [2024-11-20 01:31:11.870711] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.678 [2024-11-20 01:31:11.870861] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.678 [2024-11-20 01:31:11.871046] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.678 [2024-11-20 01:31:11.871067] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.678 [2024-11-20 01:31:11.871089] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.678 [2024-11-20 01:31:11.873276] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.678 [2024-11-20 01:31:11.882645] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.678 [2024-11-20 01:31:11.882891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.678 [2024-11-20 01:31:11.882987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.678 [2024-11-20 01:31:11.883013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.678 [2024-11-20 01:31:11.883029] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.678 [2024-11-20 01:31:11.883234] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.678 [2024-11-20 01:31:11.883386] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.678 [2024-11-20 01:31:11.883406] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.678 [2024-11-20 01:31:11.883420] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.678 [2024-11-20 01:31:11.885656] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.938 [2024-11-20 01:31:11.895016] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.938 [2024-11-20 01:31:11.895262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.938 [2024-11-20 01:31:11.895360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.938 [2024-11-20 01:31:11.895385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.938 [2024-11-20 01:31:11.895401] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.938 [2024-11-20 01:31:11.895582] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.938 [2024-11-20 01:31:11.895734] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.938 [2024-11-20 01:31:11.895755] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.938 [2024-11-20 01:31:11.895769] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.938 [2024-11-20 01:31:11.897856] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.939 [2024-11-20 01:31:11.907321] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.939 [2024-11-20 01:31:11.907592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.939 [2024-11-20 01:31:11.907763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.939 [2024-11-20 01:31:11.907789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.939 [2024-11-20 01:31:11.907804] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.939 [2024-11-20 01:31:11.907958] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.939 [2024-11-20 01:31:11.908120] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.939 [2024-11-20 01:31:11.908141] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.939 [2024-11-20 01:31:11.908155] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.939 [2024-11-20 01:31:11.910192] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.939 [2024-11-20 01:31:11.919676] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.939 [2024-11-20 01:31:11.919973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.939 [2024-11-20 01:31:11.920114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.939 [2024-11-20 01:31:11.920141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.939 [2024-11-20 01:31:11.920157] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.939 [2024-11-20 01:31:11.920306] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.939 [2024-11-20 01:31:11.920457] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.939 [2024-11-20 01:31:11.920478] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.939 [2024-11-20 01:31:11.920491] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.939 [2024-11-20 01:31:11.922629] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.939 [2024-11-20 01:31:11.932134] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.939 [2024-11-20 01:31:11.932351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.939 [2024-11-20 01:31:11.932473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.939 [2024-11-20 01:31:11.932499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.939 [2024-11-20 01:31:11.932515] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.939 [2024-11-20 01:31:11.932663] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.939 [2024-11-20 01:31:11.932783] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.939 [2024-11-20 01:31:11.932804] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.939 [2024-11-20 01:31:11.932817] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.939 [2024-11-20 01:31:11.934920] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.939 [2024-11-20 01:31:11.944277] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.939 [2024-11-20 01:31:11.944562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.939 [2024-11-20 01:31:11.944684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.939 [2024-11-20 01:31:11.944710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.939 [2024-11-20 01:31:11.944726] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.939 [2024-11-20 01:31:11.944874] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.939 [2024-11-20 01:31:11.945015] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.939 [2024-11-20 01:31:11.945036] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.939 [2024-11-20 01:31:11.945050] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.939 [2024-11-20 01:31:11.947218] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.939 [2024-11-20 01:31:11.956621] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.939 [2024-11-20 01:31:11.956911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.939 [2024-11-20 01:31:11.957001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.939 [2024-11-20 01:31:11.957027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.939 [2024-11-20 01:31:11.957043] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.939 [2024-11-20 01:31:11.957166] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.939 [2024-11-20 01:31:11.957303] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.939 [2024-11-20 01:31:11.957324] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.939 [2024-11-20 01:31:11.957338] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.939 [2024-11-20 01:31:11.959585] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.939 [2024-11-20 01:31:11.968867] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.939 [2024-11-20 01:31:11.969172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.939 [2024-11-20 01:31:11.969274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.939 [2024-11-20 01:31:11.969301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.939 [2024-11-20 01:31:11.969316] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.939 [2024-11-20 01:31:11.969464] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.939 [2024-11-20 01:31:11.969632] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.939 [2024-11-20 01:31:11.969653] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.939 [2024-11-20 01:31:11.969666] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.939 [2024-11-20 01:31:11.971865] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.939 [2024-11-20 01:31:11.981173] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.939 [2024-11-20 01:31:11.981467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.939 [2024-11-20 01:31:11.981593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.939 [2024-11-20 01:31:11.981619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.939 [2024-11-20 01:31:11.981634] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.939 [2024-11-20 01:31:11.981799] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.939 [2024-11-20 01:31:11.981984] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.939 [2024-11-20 01:31:11.982010] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.939 [2024-11-20 01:31:11.982024] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.939 [2024-11-20 01:31:11.984062] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.939 [2024-11-20 01:31:11.993406] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.939 [2024-11-20 01:31:11.993729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.939 [2024-11-20 01:31:11.993831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.939 [2024-11-20 01:31:11.993857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.939 [2024-11-20 01:31:11.993873] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.939 [2024-11-20 01:31:11.994021] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.939 [2024-11-20 01:31:11.994216] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.939 [2024-11-20 01:31:11.994238] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.939 [2024-11-20 01:31:11.994251] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.939 [2024-11-20 01:31:11.996401] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.939 [2024-11-20 01:31:12.005811] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.939 [2024-11-20 01:31:12.006126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.939 [2024-11-20 01:31:12.006252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.939 [2024-11-20 01:31:12.006278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.939 [2024-11-20 01:31:12.006293] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.939 [2024-11-20 01:31:12.006458] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.939 [2024-11-20 01:31:12.006610] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.939 [2024-11-20 01:31:12.006631] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.939 [2024-11-20 01:31:12.006645] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.939 [2024-11-20 01:31:12.008705] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.939 [2024-11-20 01:31:12.017906] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.939 [2024-11-20 01:31:12.018148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.939 [2024-11-20 01:31:12.018248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.940 [2024-11-20 01:31:12.018273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.940 [2024-11-20 01:31:12.018289] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.940 [2024-11-20 01:31:12.018452] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.940 [2024-11-20 01:31:12.018604] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.940 [2024-11-20 01:31:12.018626] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.940 [2024-11-20 01:31:12.018644] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.940 [2024-11-20 01:31:12.020824] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.940 [2024-11-20 01:31:12.030271] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.940 [2024-11-20 01:31:12.030557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.940 [2024-11-20 01:31:12.030644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.940 [2024-11-20 01:31:12.030670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.940 [2024-11-20 01:31:12.030685] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.940 [2024-11-20 01:31:12.030833] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.940 [2024-11-20 01:31:12.030985] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.940 [2024-11-20 01:31:12.031006] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.940 [2024-11-20 01:31:12.031020] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.940 [2024-11-20 01:31:12.032943] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.940 [2024-11-20 01:31:12.042587] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.940 [2024-11-20 01:31:12.042841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.940 [2024-11-20 01:31:12.042965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.940 [2024-11-20 01:31:12.042991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.940 [2024-11-20 01:31:12.043007] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.940 [2024-11-20 01:31:12.043180] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.940 [2024-11-20 01:31:12.043348] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.940 [2024-11-20 01:31:12.043370] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.940 [2024-11-20 01:31:12.043383] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.940 [2024-11-20 01:31:12.045437] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.940 [2024-11-20 01:31:12.054850] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.940 [2024-11-20 01:31:12.055089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.940 [2024-11-20 01:31:12.055191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.940 [2024-11-20 01:31:12.055218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.940 [2024-11-20 01:31:12.055233] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.940 [2024-11-20 01:31:12.055382] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.940 [2024-11-20 01:31:12.055517] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.940 [2024-11-20 01:31:12.055538] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.940 [2024-11-20 01:31:12.055552] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.940 [2024-11-20 01:31:12.057538] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.940 [2024-11-20 01:31:12.067226] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.940 [2024-11-20 01:31:12.067454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.940 [2024-11-20 01:31:12.067574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.940 [2024-11-20 01:31:12.067600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.940 [2024-11-20 01:31:12.067617] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.940 [2024-11-20 01:31:12.067782] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.940 [2024-11-20 01:31:12.067982] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.940 [2024-11-20 01:31:12.068003] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.940 [2024-11-20 01:31:12.068017] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.940 [2024-11-20 01:31:12.070198] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.940 [2024-11-20 01:31:12.079538] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.940 [2024-11-20 01:31:12.079823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.940 [2024-11-20 01:31:12.079938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.940 [2024-11-20 01:31:12.079964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.940 [2024-11-20 01:31:12.079980] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.940 [2024-11-20 01:31:12.080187] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.940 [2024-11-20 01:31:12.080308] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.940 [2024-11-20 01:31:12.080329] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.940 [2024-11-20 01:31:12.080342] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.940 [2024-11-20 01:31:12.082650] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.940 [2024-11-20 01:31:12.091775] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.940 [2024-11-20 01:31:12.092043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.940 [2024-11-20 01:31:12.092151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.940 [2024-11-20 01:31:12.092177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.940 [2024-11-20 01:31:12.092193] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.940 [2024-11-20 01:31:12.092309] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.940 [2024-11-20 01:31:12.092413] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.940 [2024-11-20 01:31:12.092433] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.940 [2024-11-20 01:31:12.092447] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.940 [2024-11-20 01:31:12.094643] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.940 [2024-11-20 01:31:12.104281] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.940 [2024-11-20 01:31:12.104547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.940 [2024-11-20 01:31:12.104647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.940 [2024-11-20 01:31:12.104673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.940 [2024-11-20 01:31:12.104689] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.940 [2024-11-20 01:31:12.104821] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.940 [2024-11-20 01:31:12.104974] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.940 [2024-11-20 01:31:12.104994] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.940 [2024-11-20 01:31:12.105008] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.940 [2024-11-20 01:31:12.106979] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.940 [2024-11-20 01:31:12.116424] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.940 [2024-11-20 01:31:12.116704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.940 [2024-11-20 01:31:12.116801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.940 [2024-11-20 01:31:12.116828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.940 [2024-11-20 01:31:12.116843] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.940 [2024-11-20 01:31:12.117008] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.940 [2024-11-20 01:31:12.117138] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.940 [2024-11-20 01:31:12.117160] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.940 [2024-11-20 01:31:12.117174] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.940 [2024-11-20 01:31:12.119231] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.940 [2024-11-20 01:31:12.128741] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.940 [2024-11-20 01:31:12.129096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.940 [2024-11-20 01:31:12.129205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.940 [2024-11-20 01:31:12.129231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.940 [2024-11-20 01:31:12.129247] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.940 [2024-11-20 01:31:12.129363] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.941 [2024-11-20 01:31:12.129575] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.941 [2024-11-20 01:31:12.129596] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.941 [2024-11-20 01:31:12.129610] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.941 [2024-11-20 01:31:12.131768] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.941 [2024-11-20 01:31:12.141112] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.941 [2024-11-20 01:31:12.141363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.941 [2024-11-20 01:31:12.141491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.941 [2024-11-20 01:31:12.141517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.941 [2024-11-20 01:31:12.141532] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:03.941 [2024-11-20 01:31:12.141648] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:03.941 [2024-11-20 01:31:12.141814] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.941 [2024-11-20 01:31:12.141834] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.941 [2024-11-20 01:31:12.141848] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.941 [2024-11-20 01:31:12.143995] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.941 [2024-11-20 01:31:12.153342] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.941 [2024-11-20 01:31:12.153579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.941 [2024-11-20 01:31:12.153705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.941 [2024-11-20 01:31:12.153731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:03.941 [2024-11-20 01:31:12.153747] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:04.203 [2024-11-20 01:31:12.153911] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:04.203 [2024-11-20 01:31:12.154103] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.203 [2024-11-20 01:31:12.154125] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.203 [2024-11-20 01:31:12.154139] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.203 [2024-11-20 01:31:12.156172] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.203 [2024-11-20 01:31:12.165463] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.203 [2024-11-20 01:31:12.165753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.203 [2024-11-20 01:31:12.165879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.203 [2024-11-20 01:31:12.165905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:04.203 [2024-11-20 01:31:12.165921] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:04.203 [2024-11-20 01:31:12.166098] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:04.203 [2024-11-20 01:31:12.166251] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.203 [2024-11-20 01:31:12.166272] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.203 [2024-11-20 01:31:12.166285] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.203 [2024-11-20 01:31:12.168247] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.203 [2024-11-20 01:31:12.177736] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.203 [2024-11-20 01:31:12.178024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.203 [2024-11-20 01:31:12.178131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.203 [2024-11-20 01:31:12.178162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:04.203 [2024-11-20 01:31:12.178179] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:04.203 [2024-11-20 01:31:12.178327] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:04.203 [2024-11-20 01:31:12.178476] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.203 [2024-11-20 01:31:12.178496] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.203 [2024-11-20 01:31:12.178511] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.203 [2024-11-20 01:31:12.180608] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.203 [2024-11-20 01:31:12.190226] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.203 [2024-11-20 01:31:12.190488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.203 [2024-11-20 01:31:12.190619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.203 [2024-11-20 01:31:12.190645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:04.203 [2024-11-20 01:31:12.190661] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:04.203 [2024-11-20 01:31:12.190825] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:04.203 [2024-11-20 01:31:12.191007] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.203 [2024-11-20 01:31:12.191027] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.203 [2024-11-20 01:31:12.191040] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.203 [2024-11-20 01:31:12.193219] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.203 [2024-11-20 01:31:12.202402] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.203 [2024-11-20 01:31:12.202700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.203 [2024-11-20 01:31:12.202819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.203 [2024-11-20 01:31:12.202845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:04.203 [2024-11-20 01:31:12.202860] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:04.203 [2024-11-20 01:31:12.202992] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:04.203 [2024-11-20 01:31:12.203208] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.203 [2024-11-20 01:31:12.203230] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.203 [2024-11-20 01:31:12.203244] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.203 [2024-11-20 01:31:12.205269] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.203 [2024-11-20 01:31:12.214736] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.203 [2024-11-20 01:31:12.215107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.203 [2024-11-20 01:31:12.215195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.203 [2024-11-20 01:31:12.215221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:04.203 [2024-11-20 01:31:12.215242] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:04.203 [2024-11-20 01:31:12.215391] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:04.203 [2024-11-20 01:31:12.215555] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.203 [2024-11-20 01:31:12.215575] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.203 [2024-11-20 01:31:12.215588] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.203 [2024-11-20 01:31:12.217635] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.203 [2024-11-20 01:31:12.227140] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.203 [2024-11-20 01:31:12.227415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.203 [2024-11-20 01:31:12.227531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.203 [2024-11-20 01:31:12.227557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:04.203 [2024-11-20 01:31:12.227572] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:04.203 [2024-11-20 01:31:12.227721] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:04.204 [2024-11-20 01:31:12.227916] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.204 [2024-11-20 01:31:12.227936] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.204 [2024-11-20 01:31:12.227950] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.204 [2024-11-20 01:31:12.229990] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.204 [2024-11-20 01:31:12.239441] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.204 [2024-11-20 01:31:12.239717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.204 [2024-11-20 01:31:12.239835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.204 [2024-11-20 01:31:12.239861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:04.204 [2024-11-20 01:31:12.239877] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:04.204 [2024-11-20 01:31:12.240041] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:04.204 [2024-11-20 01:31:12.240185] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.204 [2024-11-20 01:31:12.240207] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.204 [2024-11-20 01:31:12.240221] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.204 [2024-11-20 01:31:12.242474] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.204 [2024-11-20 01:31:12.251806] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.204 [2024-11-20 01:31:12.252108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.204 [2024-11-20 01:31:12.252312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.204 [2024-11-20 01:31:12.252338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:04.204 [2024-11-20 01:31:12.252353] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:04.204 [2024-11-20 01:31:12.252524] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:04.204 [2024-11-20 01:31:12.252689] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.204 [2024-11-20 01:31:12.252709] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.204 [2024-11-20 01:31:12.252722] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.204 [2024-11-20 01:31:12.254867] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.204 [2024-11-20 01:31:12.264118] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.204 [2024-11-20 01:31:12.264477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.204 [2024-11-20 01:31:12.264565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.204 [2024-11-20 01:31:12.264591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:04.204 [2024-11-20 01:31:12.264607] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:04.204 [2024-11-20 01:31:12.264706] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:04.204 [2024-11-20 01:31:12.264840] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.204 [2024-11-20 01:31:12.264860] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.204 [2024-11-20 01:31:12.264873] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.204 [2024-11-20 01:31:12.266872] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.204 [2024-11-20 01:31:12.276418] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.204 [2024-11-20 01:31:12.276673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.204 [2024-11-20 01:31:12.276792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.204 [2024-11-20 01:31:12.276818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:04.204 [2024-11-20 01:31:12.276834] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:04.204 [2024-11-20 01:31:12.276966] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:04.204 [2024-11-20 01:31:12.277110] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.204 [2024-11-20 01:31:12.277133] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.204 [2024-11-20 01:31:12.277146] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.204 [2024-11-20 01:31:12.278964] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.204 [2024-11-20 01:31:12.288623] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.204 [2024-11-20 01:31:12.288943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.204 [2024-11-20 01:31:12.289075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.204 [2024-11-20 01:31:12.289102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:04.204 [2024-11-20 01:31:12.289118] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:04.204 [2024-11-20 01:31:12.289282] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:04.204 [2024-11-20 01:31:12.289422] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.204 [2024-11-20 01:31:12.289443] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.204 [2024-11-20 01:31:12.289456] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.204 [2024-11-20 01:31:12.291543] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.204 [2024-11-20 01:31:12.300711] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.204 [2024-11-20 01:31:12.300986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.204 [2024-11-20 01:31:12.301080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.204 [2024-11-20 01:31:12.301107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:04.204 [2024-11-20 01:31:12.301123] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:04.204 [2024-11-20 01:31:12.301239] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:04.204 [2024-11-20 01:31:12.301405] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.204 [2024-11-20 01:31:12.301425] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.204 [2024-11-20 01:31:12.301438] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.204 [2024-11-20 01:31:12.303495] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.204 [2024-11-20 01:31:12.312991] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.204 [2024-11-20 01:31:12.313290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.204 [2024-11-20 01:31:12.313414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.204 [2024-11-20 01:31:12.313441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:04.204 [2024-11-20 01:31:12.313457] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:04.204 [2024-11-20 01:31:12.313622] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:04.204 [2024-11-20 01:31:12.313817] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.204 [2024-11-20 01:31:12.313838] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.204 [2024-11-20 01:31:12.313851] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.204 [2024-11-20 01:31:12.315915] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.204 [2024-11-20 01:31:12.325298] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.204 [2024-11-20 01:31:12.325545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.204 [2024-11-20 01:31:12.325662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.204 [2024-11-20 01:31:12.325688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:04.204 [2024-11-20 01:31:12.325704] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:04.204 [2024-11-20 01:31:12.325852] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:04.204 [2024-11-20 01:31:12.326016] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.204 [2024-11-20 01:31:12.326042] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.204 [2024-11-20 01:31:12.326056] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.204 [2024-11-20 01:31:12.328106] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.204 [2024-11-20 01:31:12.337740] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.204 [2024-11-20 01:31:12.338055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.204 [2024-11-20 01:31:12.338180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.204 [2024-11-20 01:31:12.338208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:04.204 [2024-11-20 01:31:12.338224] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:04.204 [2024-11-20 01:31:12.338356] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:04.204 [2024-11-20 01:31:12.338540] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.205 [2024-11-20 01:31:12.338561] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.205 [2024-11-20 01:31:12.338574] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.205 [2024-11-20 01:31:12.340556] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.205 01:31:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:04.205 01:31:12 -- common/autotest_common.sh@862 -- # return 0 00:30:04.205 01:31:12 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:04.205 01:31:12 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:04.205 01:31:12 -- common/autotest_common.sh@10 -- # set +x 00:30:04.205 [2024-11-20 01:31:12.350228] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.205 [2024-11-20 01:31:12.350580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.205 [2024-11-20 01:31:12.350726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.205 [2024-11-20 01:31:12.350752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:04.205 [2024-11-20 01:31:12.350768] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:04.205 [2024-11-20 01:31:12.350916] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:04.205 [2024-11-20 01:31:12.351050] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.205 [2024-11-20 01:31:12.351093] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.205 [2024-11-20 01:31:12.351108] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.205 [2024-11-20 01:31:12.353201] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.205 [2024-11-20 01:31:12.362453] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.205 [2024-11-20 01:31:12.362725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.205 [2024-11-20 01:31:12.362844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.205 [2024-11-20 01:31:12.362870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:04.205 [2024-11-20 01:31:12.362886] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:04.205 [2024-11-20 01:31:12.363002] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:04.205 [2024-11-20 01:31:12.363171] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.205 [2024-11-20 01:31:12.363193] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.205 [2024-11-20 01:31:12.363206] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.205 [2024-11-20 01:31:12.365295] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.205 01:31:12 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:04.205 01:31:12 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:30:04.205 01:31:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:04.205 01:31:12 -- common/autotest_common.sh@10 -- # set +x 00:30:04.205 [2024-11-20 01:31:12.374619] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.205 [2024-11-20 01:31:12.374864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.205 [2024-11-20 01:31:12.374983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.205 [2024-11-20 01:31:12.375009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:04.205 [2024-11-20 01:31:12.375025] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:04.205 [2024-11-20 01:31:12.375183] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:04.205 [2024-11-20 01:31:12.375383] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.205 [2024-11-20 01:31:12.375404] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.205 [2024-11-20 01:31:12.375417] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.205 [2024-11-20 01:31:12.377578] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.205 [2024-11-20 01:31:12.378195] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:04.205 01:31:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:04.205 01:31:12 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:04.205 01:31:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:04.205 01:31:12 -- common/autotest_common.sh@10 -- # set +x 00:30:04.205 [2024-11-20 01:31:12.386955] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.205 [2024-11-20 01:31:12.387249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.205 [2024-11-20 01:31:12.387347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.205 [2024-11-20 01:31:12.387373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:04.205 [2024-11-20 01:31:12.387389] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:04.205 [2024-11-20 01:31:12.387570] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:04.205 [2024-11-20 01:31:12.387718] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.205 [2024-11-20 01:31:12.387738] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.205 [2024-11-20 01:31:12.387752] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.205 [2024-11-20 01:31:12.389773] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.205 [2024-11-20 01:31:12.399592] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.205 [2024-11-20 01:31:12.399869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.205 [2024-11-20 01:31:12.399989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.205 [2024-11-20 01:31:12.400016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:04.205 [2024-11-20 01:31:12.400031] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:04.205 [2024-11-20 01:31:12.400173] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:04.205 [2024-11-20 01:31:12.400326] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.205 [2024-11-20 01:31:12.400362] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.205 [2024-11-20 01:31:12.400388] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.205 [2024-11-20 01:31:12.402684] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.205 [2024-11-20 01:31:12.411970] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.205 [2024-11-20 01:31:12.412366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.205 [2024-11-20 01:31:12.412491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.205 [2024-11-20 01:31:12.412518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:04.205 [2024-11-20 01:31:12.412538] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:04.205 [2024-11-20 01:31:12.412689] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:04.205 [2024-11-20 01:31:12.412842] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.205 [2024-11-20 01:31:12.412863] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.205 [2024-11-20 01:31:12.412879] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.205 [2024-11-20 01:31:12.414851] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.466 Malloc0 00:30:04.466 01:31:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:04.466 01:31:12 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:04.466 [2024-11-20 01:31:12.424349] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.466 01:31:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:04.466 01:31:12 -- common/autotest_common.sh@10 -- # set +x 00:30:04.466 [2024-11-20 01:31:12.424612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.466 [2024-11-20 01:31:12.424743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.466 [2024-11-20 01:31:12.424769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:04.466 [2024-11-20 01:31:12.424788] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:04.466 [2024-11-20 01:31:12.424929] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:04.466 [2024-11-20 01:31:12.425092] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.466 [2024-11-20 01:31:12.425115] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.466 [2024-11-20 01:31:12.425131] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.466 [2024-11-20 01:31:12.427328] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.466 01:31:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:04.466 01:31:12 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:04.466 01:31:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:04.466 01:31:12 -- common/autotest_common.sh@10 -- # set +x 00:30:04.466 [2024-11-20 01:31:12.436896] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.466 [2024-11-20 01:31:12.437238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.466 [2024-11-20 01:31:12.437334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.466 [2024-11-20 01:31:12.437360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d941d0 with addr=10.0.0.2, port=4420 00:30:04.466 [2024-11-20 01:31:12.437376] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d941d0 is same with the state(5) to be set 00:30:04.467 [2024-11-20 01:31:12.437494] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d941d0 (9): Bad file descriptor 00:30:04.467 [2024-11-20 01:31:12.437675] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.467 [2024-11-20 01:31:12.437696] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.467 [2024-11-20 01:31:12.437709] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.467 01:31:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:04.467 01:31:12 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:04.467 01:31:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:04.467 [2024-11-20 01:31:12.439852] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.467 01:31:12 -- common/autotest_common.sh@10 -- # set +x 00:30:04.467 [2024-11-20 01:31:12.443567] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:04.467 01:31:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:04.467 01:31:12 -- host/bdevperf.sh@38 -- # wait 1268365 00:30:04.467 [2024-11-20 01:31:12.449479] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.467 [2024-11-20 01:31:12.518913] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:30:12.593 00:30:12.593 Latency(us) 00:30:12.593 [2024-11-20T00:31:20.812Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:12.593 [2024-11-20T00:31:20.812Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:30:12.593 Verification LBA range: start 0x0 length 0x4000 00:30:12.593 Nvme1n1 : 15.01 9443.68 36.89 16263.14 0.00 4964.50 676.60 20486.07 00:30:12.593 [2024-11-20T00:31:20.812Z] =================================================================================================================== 00:30:12.593 [2024-11-20T00:31:20.812Z] Total : 9443.68 36.89 16263.14 0.00 4964.50 676.60 20486.07 00:30:12.854 01:31:20 -- host/bdevperf.sh@39 -- # sync 00:30:12.854 01:31:20 -- host/bdevperf.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:30:12.854 01:31:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:12.854 01:31:20 -- common/autotest_common.sh@10 -- # set +x 00:30:12.854 01:31:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:12.854 01:31:20 -- host/bdevperf.sh@42 -- # trap - SIGINT SIGTERM EXIT 00:30:12.854 01:31:20 -- host/bdevperf.sh@44 -- # nvmftestfini 00:30:12.854 01:31:20 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:12.854 01:31:20 -- nvmf/common.sh@116 -- # sync 00:30:12.854 01:31:21 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:12.854 01:31:21 -- nvmf/common.sh@119 -- # set +e 00:30:12.854 01:31:21 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:12.854 01:31:21 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:12.854 rmmod nvme_tcp 00:30:12.854 rmmod nvme_fabrics 00:30:12.854 rmmod nvme_keyring 00:30:12.854 01:31:21 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:12.854 01:31:21 -- nvmf/common.sh@123 -- # set -e 00:30:12.854 01:31:21 -- nvmf/common.sh@124 -- # return 0 00:30:12.854 01:31:21 -- nvmf/common.sh@477 -- # '[' -n 1269169 ']' 00:30:12.854 01:31:21 -- nvmf/common.sh@478 -- # killprocess 1269169 00:30:12.854 01:31:21 -- common/autotest_common.sh@936 -- # '[' -z 1269169 ']' 00:30:12.854 01:31:21 -- common/autotest_common.sh@940 -- # kill -0 1269169 00:30:12.854 01:31:21 -- common/autotest_common.sh@941 -- # uname 00:30:12.854 01:31:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:12.854 01:31:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1269169 00:30:13.112 01:31:21 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:30:13.112 01:31:21 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:30:13.112 01:31:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1269169' 00:30:13.112 killing process with pid 1269169 00:30:13.112 01:31:21 -- common/autotest_common.sh@955 -- # kill 1269169 00:30:13.112 01:31:21 -- common/autotest_common.sh@960 -- # wait 1269169 00:30:13.371 01:31:21 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:30:13.371 01:31:21 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:13.371 01:31:21 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:13.371 01:31:21 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:13.371 01:31:21 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:13.371 01:31:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:13.371 01:31:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:13.371 01:31:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:15.278 01:31:23 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:15.278 00:30:15.278 real 0m23.157s 00:30:15.278 user 1m1.499s 00:30:15.278 sys 0m4.756s 00:30:15.278 01:31:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:15.278 01:31:23 -- common/autotest_common.sh@10 -- # set +x 00:30:15.278 ************************************ 00:30:15.278 END TEST nvmf_bdevperf 00:30:15.278 ************************************ 00:30:15.278 01:31:23 -- nvmf/nvmf.sh@124 -- # run_test nvmf_target_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:30:15.278 01:31:23 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:30:15.278 01:31:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:15.278 01:31:23 -- common/autotest_common.sh@10 -- # set +x 00:30:15.278 ************************************ 00:30:15.278 START TEST nvmf_target_disconnect 00:30:15.278 ************************************ 00:30:15.278 01:31:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:30:15.278 * Looking for test storage... 00:30:15.278 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:30:15.278 01:31:23 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:30:15.278 01:31:23 -- common/autotest_common.sh@1690 -- # lcov --version 00:30:15.278 01:31:23 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:30:15.537 01:31:23 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:30:15.537 01:31:23 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:30:15.537 01:31:23 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:30:15.537 01:31:23 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:30:15.537 01:31:23 -- scripts/common.sh@335 -- # IFS=.-: 00:30:15.537 01:31:23 -- scripts/common.sh@335 -- # read -ra ver1 00:30:15.537 01:31:23 -- scripts/common.sh@336 -- # IFS=.-: 00:30:15.537 01:31:23 -- scripts/common.sh@336 -- # read -ra ver2 00:30:15.537 01:31:23 -- scripts/common.sh@337 -- # local 'op=<' 00:30:15.537 01:31:23 -- scripts/common.sh@339 -- # ver1_l=2 00:30:15.537 01:31:23 -- scripts/common.sh@340 -- # ver2_l=1 00:30:15.537 01:31:23 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:30:15.537 01:31:23 -- scripts/common.sh@343 -- # case "$op" in 00:30:15.537 01:31:23 -- scripts/common.sh@344 -- # : 1 00:30:15.537 01:31:23 -- scripts/common.sh@363 -- # (( v = 0 )) 00:30:15.537 01:31:23 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:30:15.537 01:31:23 -- scripts/common.sh@364 -- # decimal 1 00:30:15.537 01:31:23 -- scripts/common.sh@352 -- # local d=1 00:30:15.537 01:31:23 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:30:15.537 01:31:23 -- scripts/common.sh@354 -- # echo 1 00:30:15.537 01:31:23 -- scripts/common.sh@364 -- # ver1[v]=1 00:30:15.537 01:31:23 -- scripts/common.sh@365 -- # decimal 2 00:30:15.537 01:31:23 -- scripts/common.sh@352 -- # local d=2 00:30:15.537 01:31:23 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:30:15.537 01:31:23 -- scripts/common.sh@354 -- # echo 2 00:30:15.537 01:31:23 -- scripts/common.sh@365 -- # ver2[v]=2 00:30:15.537 01:31:23 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:30:15.537 01:31:23 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:30:15.537 01:31:23 -- scripts/common.sh@367 -- # return 0 00:30:15.537 01:31:23 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:30:15.537 01:31:23 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:30:15.537 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:15.537 --rc genhtml_branch_coverage=1 00:30:15.537 --rc genhtml_function_coverage=1 00:30:15.537 --rc genhtml_legend=1 00:30:15.537 --rc geninfo_all_blocks=1 00:30:15.537 --rc geninfo_unexecuted_blocks=1 00:30:15.537 00:30:15.537 ' 00:30:15.537 01:31:23 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:30:15.537 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:15.537 --rc genhtml_branch_coverage=1 00:30:15.537 --rc genhtml_function_coverage=1 00:30:15.537 --rc genhtml_legend=1 00:30:15.537 --rc geninfo_all_blocks=1 00:30:15.537 --rc geninfo_unexecuted_blocks=1 00:30:15.537 00:30:15.537 ' 00:30:15.537 01:31:23 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:30:15.537 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:15.537 --rc genhtml_branch_coverage=1 00:30:15.537 --rc genhtml_function_coverage=1 00:30:15.537 --rc genhtml_legend=1 00:30:15.537 --rc geninfo_all_blocks=1 00:30:15.537 --rc geninfo_unexecuted_blocks=1 00:30:15.537 00:30:15.537 ' 00:30:15.537 01:31:23 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:30:15.537 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:15.537 --rc genhtml_branch_coverage=1 00:30:15.537 --rc genhtml_function_coverage=1 00:30:15.537 --rc genhtml_legend=1 00:30:15.537 --rc geninfo_all_blocks=1 00:30:15.537 --rc geninfo_unexecuted_blocks=1 00:30:15.537 00:30:15.537 ' 00:30:15.537 01:31:23 -- host/target_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:15.537 01:31:23 -- nvmf/common.sh@7 -- # uname -s 00:30:15.537 01:31:23 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:15.537 01:31:23 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:15.537 01:31:23 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:15.537 01:31:23 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:15.537 01:31:23 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:15.537 01:31:23 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:15.538 01:31:23 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:15.538 01:31:23 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:15.538 01:31:23 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:15.538 01:31:23 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:15.538 01:31:23 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:30:15.538 01:31:23 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:30:15.538 01:31:23 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:15.538 01:31:23 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:15.538 01:31:23 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:15.538 01:31:23 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:15.538 01:31:23 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:15.538 01:31:23 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:15.538 01:31:23 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:15.538 01:31:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:15.538 01:31:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:15.538 01:31:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:15.538 01:31:23 -- paths/export.sh@5 -- # export PATH 00:30:15.538 01:31:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:15.538 01:31:23 -- nvmf/common.sh@46 -- # : 0 00:30:15.538 01:31:23 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:15.538 01:31:23 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:15.538 01:31:23 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:15.538 01:31:23 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:15.538 01:31:23 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:15.538 01:31:23 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:15.538 01:31:23 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:15.538 01:31:23 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:15.538 01:31:23 -- host/target_disconnect.sh@11 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:30:15.538 01:31:23 -- host/target_disconnect.sh@13 -- # MALLOC_BDEV_SIZE=64 00:30:15.538 01:31:23 -- host/target_disconnect.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:30:15.538 01:31:23 -- host/target_disconnect.sh@77 -- # nvmftestinit 00:30:15.538 01:31:23 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:30:15.538 01:31:23 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:30:15.538 01:31:23 -- nvmf/common.sh@436 -- # prepare_net_devs 00:30:15.538 01:31:23 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:30:15.538 01:31:23 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:30:15.538 01:31:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:15.538 01:31:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:15.538 01:31:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:15.538 01:31:23 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:30:15.538 01:31:23 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:30:15.538 01:31:23 -- nvmf/common.sh@284 -- # xtrace_disable 00:30:15.538 01:31:23 -- common/autotest_common.sh@10 -- # set +x 00:30:17.443 01:31:25 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:30:17.443 01:31:25 -- nvmf/common.sh@290 -- # pci_devs=() 00:30:17.443 01:31:25 -- nvmf/common.sh@290 -- # local -a pci_devs 00:30:17.443 01:31:25 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:30:17.443 01:31:25 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:30:17.443 01:31:25 -- nvmf/common.sh@292 -- # pci_drivers=() 00:30:17.443 01:31:25 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:30:17.443 01:31:25 -- nvmf/common.sh@294 -- # net_devs=() 00:30:17.443 01:31:25 -- nvmf/common.sh@294 -- # local -ga net_devs 00:30:17.443 01:31:25 -- nvmf/common.sh@295 -- # e810=() 00:30:17.443 01:31:25 -- nvmf/common.sh@295 -- # local -ga e810 00:30:17.443 01:31:25 -- nvmf/common.sh@296 -- # x722=() 00:30:17.443 01:31:25 -- nvmf/common.sh@296 -- # local -ga x722 00:30:17.444 01:31:25 -- nvmf/common.sh@297 -- # mlx=() 00:30:17.444 01:31:25 -- nvmf/common.sh@297 -- # local -ga mlx 00:30:17.444 01:31:25 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:30:17.444 01:31:25 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:30:17.444 01:31:25 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:30:17.444 01:31:25 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:30:17.444 01:31:25 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:30:17.444 01:31:25 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:30:17.444 01:31:25 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:30:17.444 01:31:25 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:30:17.444 01:31:25 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:30:17.444 01:31:25 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:30:17.444 01:31:25 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:30:17.444 01:31:25 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:30:17.444 01:31:25 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:30:17.444 01:31:25 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:30:17.444 01:31:25 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:30:17.444 01:31:25 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:30:17.444 01:31:25 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:30:17.444 01:31:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:17.444 01:31:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:30:17.444 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:30:17.444 01:31:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:17.444 01:31:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:17.444 01:31:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:17.444 01:31:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:17.444 01:31:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:17.444 01:31:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:17.444 01:31:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:30:17.444 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:30:17.444 01:31:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:17.444 01:31:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:17.444 01:31:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:17.444 01:31:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:17.444 01:31:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:17.444 01:31:25 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:30:17.444 01:31:25 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:30:17.444 01:31:25 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:30:17.444 01:31:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:17.444 01:31:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:17.444 01:31:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:17.444 01:31:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:17.444 01:31:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:30:17.444 Found net devices under 0000:0a:00.0: cvl_0_0 00:30:17.444 01:31:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:17.444 01:31:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:17.444 01:31:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:17.444 01:31:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:17.444 01:31:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:17.444 01:31:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:30:17.444 Found net devices under 0000:0a:00.1: cvl_0_1 00:30:17.444 01:31:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:17.444 01:31:25 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:30:17.444 01:31:25 -- nvmf/common.sh@402 -- # is_hw=yes 00:30:17.444 01:31:25 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:30:17.444 01:31:25 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:30:17.444 01:31:25 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:30:17.444 01:31:25 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:30:17.444 01:31:25 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:30:17.444 01:31:25 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:30:17.444 01:31:25 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:30:17.444 01:31:25 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:30:17.444 01:31:25 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:30:17.444 01:31:25 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:30:17.444 01:31:25 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:30:17.444 01:31:25 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:30:17.444 01:31:25 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:30:17.444 01:31:25 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:30:17.444 01:31:25 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:30:17.444 01:31:25 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:30:17.444 01:31:25 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:30:17.444 01:31:25 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:30:17.444 01:31:25 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:30:17.444 01:31:25 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:30:17.444 01:31:25 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:30:17.444 01:31:25 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:30:17.444 01:31:25 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:30:17.444 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:30:17.444 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.278 ms 00:30:17.444 00:30:17.444 --- 10.0.0.2 ping statistics --- 00:30:17.444 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:17.444 rtt min/avg/max/mdev = 0.278/0.278/0.278/0.000 ms 00:30:17.444 01:31:25 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:30:17.444 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:30:17.444 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.107 ms 00:30:17.444 00:30:17.444 --- 10.0.0.1 ping statistics --- 00:30:17.444 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:17.444 rtt min/avg/max/mdev = 0.107/0.107/0.107/0.000 ms 00:30:17.444 01:31:25 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:30:17.444 01:31:25 -- nvmf/common.sh@410 -- # return 0 00:30:17.444 01:31:25 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:30:17.444 01:31:25 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:30:17.444 01:31:25 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:30:17.444 01:31:25 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:30:17.444 01:31:25 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:30:17.444 01:31:25 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:30:17.444 01:31:25 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:30:17.444 01:31:25 -- host/target_disconnect.sh@78 -- # run_test nvmf_target_disconnect_tc1 nvmf_target_disconnect_tc1 00:30:17.444 01:31:25 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:30:17.444 01:31:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:17.444 01:31:25 -- common/autotest_common.sh@10 -- # set +x 00:30:17.705 ************************************ 00:30:17.705 START TEST nvmf_target_disconnect_tc1 00:30:17.705 ************************************ 00:30:17.705 01:31:25 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc1 00:30:17.705 01:31:25 -- host/target_disconnect.sh@32 -- # set +e 00:30:17.705 01:31:25 -- host/target_disconnect.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:30:17.705 EAL: No free 2048 kB hugepages reported on node 1 00:30:17.705 [2024-11-20 01:31:25.739410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.705 [2024-11-20 01:31:25.739702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.705 [2024-11-20 01:31:25.739729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xabd270 with addr=10.0.0.2, port=4420 00:30:17.705 [2024-11-20 01:31:25.739759] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:30:17.705 [2024-11-20 01:31:25.739777] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:30:17.705 [2024-11-20 01:31:25.739790] nvme.c: 898:spdk_nvme_probe: *ERROR*: Create probe context failed 00:30:17.705 spdk_nvme_probe() failed for transport address '10.0.0.2' 00:30:17.705 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect: errors occurred 00:30:17.705 Initializing NVMe Controllers 00:30:17.705 01:31:25 -- host/target_disconnect.sh@33 -- # trap - ERR 00:30:17.705 01:31:25 -- host/target_disconnect.sh@33 -- # print_backtrace 00:30:17.705 01:31:25 -- common/autotest_common.sh@1142 -- # [[ hxBET =~ e ]] 00:30:17.705 01:31:25 -- common/autotest_common.sh@1142 -- # return 0 00:30:17.705 01:31:25 -- host/target_disconnect.sh@37 -- # '[' 1 '!=' 1 ']' 00:30:17.705 01:31:25 -- host/target_disconnect.sh@41 -- # set -e 00:30:17.705 00:30:17.705 real 0m0.090s 00:30:17.705 user 0m0.032s 00:30:17.705 sys 0m0.057s 00:30:17.705 01:31:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:17.705 01:31:25 -- common/autotest_common.sh@10 -- # set +x 00:30:17.705 ************************************ 00:30:17.705 END TEST nvmf_target_disconnect_tc1 00:30:17.705 ************************************ 00:30:17.705 01:31:25 -- host/target_disconnect.sh@79 -- # run_test nvmf_target_disconnect_tc2 nvmf_target_disconnect_tc2 00:30:17.705 01:31:25 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:30:17.705 01:31:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:17.705 01:31:25 -- common/autotest_common.sh@10 -- # set +x 00:30:17.705 ************************************ 00:30:17.705 START TEST nvmf_target_disconnect_tc2 00:30:17.705 ************************************ 00:30:17.705 01:31:25 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc2 00:30:17.705 01:31:25 -- host/target_disconnect.sh@45 -- # disconnect_init 10.0.0.2 00:30:17.705 01:31:25 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:30:17.705 01:31:25 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:17.705 01:31:25 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:17.705 01:31:25 -- common/autotest_common.sh@10 -- # set +x 00:30:17.705 01:31:25 -- nvmf/common.sh@469 -- # nvmfpid=1272350 00:30:17.705 01:31:25 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:30:17.705 01:31:25 -- nvmf/common.sh@470 -- # waitforlisten 1272350 00:30:17.705 01:31:25 -- common/autotest_common.sh@829 -- # '[' -z 1272350 ']' 00:30:17.705 01:31:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:17.705 01:31:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:17.705 01:31:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:17.705 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:17.705 01:31:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:17.705 01:31:25 -- common/autotest_common.sh@10 -- # set +x 00:30:17.705 [2024-11-20 01:31:25.826022] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:30:17.705 [2024-11-20 01:31:25.826156] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:17.705 EAL: No free 2048 kB hugepages reported on node 1 00:30:17.705 [2024-11-20 01:31:25.891923] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:30:17.965 [2024-11-20 01:31:25.983330] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:17.965 [2024-11-20 01:31:25.983501] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:17.965 [2024-11-20 01:31:25.983520] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:17.965 [2024-11-20 01:31:25.983532] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:17.965 [2024-11-20 01:31:25.983689] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:30:17.965 [2024-11-20 01:31:25.983756] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:30:17.965 [2024-11-20 01:31:25.983848] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:30:17.965 [2024-11-20 01:31:25.983844] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:30:18.901 01:31:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:18.901 01:31:26 -- common/autotest_common.sh@862 -- # return 0 00:30:18.901 01:31:26 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:18.901 01:31:26 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:18.901 01:31:26 -- common/autotest_common.sh@10 -- # set +x 00:30:18.901 01:31:26 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:18.901 01:31:26 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:18.901 01:31:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:18.901 01:31:26 -- common/autotest_common.sh@10 -- # set +x 00:30:18.901 Malloc0 00:30:18.901 01:31:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:18.901 01:31:26 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:30:18.901 01:31:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:18.902 01:31:26 -- common/autotest_common.sh@10 -- # set +x 00:30:18.902 [2024-11-20 01:31:26.889830] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:18.902 01:31:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:18.902 01:31:26 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:18.902 01:31:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:18.902 01:31:26 -- common/autotest_common.sh@10 -- # set +x 00:30:18.902 01:31:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:18.902 01:31:26 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:18.902 01:31:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:18.902 01:31:26 -- common/autotest_common.sh@10 -- # set +x 00:30:18.902 01:31:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:18.902 01:31:26 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:18.902 01:31:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:18.902 01:31:26 -- common/autotest_common.sh@10 -- # set +x 00:30:18.902 [2024-11-20 01:31:26.918103] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:18.902 01:31:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:18.902 01:31:26 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:30:18.902 01:31:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:18.902 01:31:26 -- common/autotest_common.sh@10 -- # set +x 00:30:18.902 01:31:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:18.902 01:31:26 -- host/target_disconnect.sh@50 -- # reconnectpid=1272520 00:30:18.902 01:31:26 -- host/target_disconnect.sh@52 -- # sleep 2 00:30:18.902 01:31:26 -- host/target_disconnect.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:30:18.902 EAL: No free 2048 kB hugepages reported on node 1 00:30:20.813 01:31:28 -- host/target_disconnect.sh@53 -- # kill -9 1272350 00:30:20.813 01:31:28 -- host/target_disconnect.sh@55 -- # sleep 2 00:30:20.813 Read completed with error (sct=0, sc=8) 00:30:20.813 starting I/O failed 00:30:20.813 Read completed with error (sct=0, sc=8) 00:30:20.813 starting I/O failed 00:30:20.813 Read completed with error (sct=0, sc=8) 00:30:20.813 starting I/O failed 00:30:20.813 Read completed with error (sct=0, sc=8) 00:30:20.813 starting I/O failed 00:30:20.813 Read completed with error (sct=0, sc=8) 00:30:20.813 starting I/O failed 00:30:20.813 Read completed with error (sct=0, sc=8) 00:30:20.813 starting I/O failed 00:30:20.813 Read completed with error (sct=0, sc=8) 00:30:20.813 starting I/O failed 00:30:20.813 Read completed with error (sct=0, sc=8) 00:30:20.813 starting I/O failed 00:30:20.813 Read completed with error (sct=0, sc=8) 00:30:20.813 starting I/O failed 00:30:20.813 Read completed with error (sct=0, sc=8) 00:30:20.813 starting I/O failed 00:30:20.813 Read completed with error (sct=0, sc=8) 00:30:20.813 starting I/O failed 00:30:20.813 Read completed with error (sct=0, sc=8) 00:30:20.813 starting I/O failed 00:30:20.813 Write completed with error (sct=0, sc=8) 00:30:20.813 starting I/O failed 00:30:20.813 Write completed with error (sct=0, sc=8) 00:30:20.813 starting I/O failed 00:30:20.813 Write completed with error (sct=0, sc=8) 00:30:20.813 starting I/O failed 00:30:20.813 Read completed with error (sct=0, sc=8) 00:30:20.813 starting I/O failed 00:30:20.813 Write completed with error (sct=0, sc=8) 00:30:20.813 starting I/O failed 00:30:20.813 Read completed with error (sct=0, sc=8) 00:30:20.813 starting I/O failed 00:30:20.813 Read completed with error (sct=0, sc=8) 00:30:20.813 starting I/O failed 00:30:20.813 Read completed with error (sct=0, sc=8) 00:30:20.813 starting I/O failed 00:30:20.813 Write completed with error (sct=0, sc=8) 00:30:20.813 starting I/O failed 00:30:20.813 Write completed with error (sct=0, sc=8) 00:30:20.813 starting I/O failed 00:30:20.813 Write completed with error (sct=0, sc=8) 00:30:20.813 starting I/O failed 00:30:20.813 Read completed with error (sct=0, sc=8) 00:30:20.813 starting I/O failed 00:30:20.813 Read completed with error (sct=0, sc=8) 00:30:20.813 starting I/O failed 00:30:20.813 Read completed with error (sct=0, sc=8) 00:30:20.813 starting I/O failed 00:30:20.813 Write completed with error (sct=0, sc=8) 00:30:20.813 starting I/O failed 00:30:20.813 Write completed with error (sct=0, sc=8) 00:30:20.813 starting I/O failed 00:30:20.813 Write completed with error (sct=0, sc=8) 00:30:20.813 starting I/O failed 00:30:20.813 Write completed with error (sct=0, sc=8) 00:30:20.813 starting I/O failed 00:30:20.813 Read completed with error (sct=0, sc=8) 00:30:20.813 starting I/O failed 00:30:20.813 Write completed with error (sct=0, sc=8) 00:30:20.813 starting I/O failed 00:30:20.813 Read completed with error (sct=0, sc=8) 00:30:20.813 [2024-11-20 01:31:28.941864] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:20.813 starting I/O failed 00:30:20.813 Read completed with error (sct=0, sc=8) 00:30:20.813 starting I/O failed 00:30:20.813 Read completed with error (sct=0, sc=8) 00:30:20.813 starting I/O failed 00:30:20.813 Read completed with error (sct=0, sc=8) 00:30:20.813 starting I/O failed 00:30:20.813 Read completed with error (sct=0, sc=8) 00:30:20.813 starting I/O failed 00:30:20.813 Read completed with error (sct=0, sc=8) 00:30:20.813 starting I/O failed 00:30:20.813 Read completed with error (sct=0, sc=8) 00:30:20.813 starting I/O failed 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Write completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Write completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Write completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Write completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Write completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Write completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Write completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Write completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Write completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Write completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 [2024-11-20 01:31:28.942186] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Write completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Write completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Write completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Write completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Write completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Write completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Write completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 [2024-11-20 01:31:28.942453] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Write completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Write completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Write completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Write completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Write completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Write completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Write completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Write completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Write completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Write completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Write completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Write completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 Read completed with error (sct=0, sc=8) 00:30:20.814 starting I/O failed 00:30:20.814 [2024-11-20 01:31:28.942735] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.814 [2024-11-20 01:31:28.942939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.814 [2024-11-20 01:31:28.943111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.814 [2024-11-20 01:31:28.943141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.814 qpair failed and we were unable to recover it. 00:30:20.814 [2024-11-20 01:31:28.943235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.814 [2024-11-20 01:31:28.943339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.814 [2024-11-20 01:31:28.943364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.814 qpair failed and we were unable to recover it. 00:30:20.814 [2024-11-20 01:31:28.943452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.814 [2024-11-20 01:31:28.943543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.814 [2024-11-20 01:31:28.943568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.814 qpair failed and we were unable to recover it. 00:30:20.814 [2024-11-20 01:31:28.943782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.814 [2024-11-20 01:31:28.943913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.814 [2024-11-20 01:31:28.943941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.814 qpair failed and we were unable to recover it. 00:30:20.814 [2024-11-20 01:31:28.944048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.814 [2024-11-20 01:31:28.944146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.814 [2024-11-20 01:31:28.944172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.814 qpair failed and we were unable to recover it. 00:30:20.814 [2024-11-20 01:31:28.944264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.814 [2024-11-20 01:31:28.944340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-20 01:31:28.944365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.815 qpair failed and we were unable to recover it. 00:30:20.815 [2024-11-20 01:31:28.944458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-20 01:31:28.944587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-20 01:31:28.944612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.815 qpair failed and we were unable to recover it. 00:30:20.815 [2024-11-20 01:31:28.944756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-20 01:31:28.944863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-20 01:31:28.944905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.815 qpair failed and we were unable to recover it. 00:30:20.815 [2024-11-20 01:31:28.945050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-20 01:31:28.945247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-20 01:31:28.945272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.815 qpair failed and we were unable to recover it. 00:30:20.815 [2024-11-20 01:31:28.945418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-20 01:31:28.945522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-20 01:31:28.945562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.815 qpair failed and we were unable to recover it. 00:30:20.815 [2024-11-20 01:31:28.945652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-20 01:31:28.945843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-20 01:31:28.945870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.815 qpair failed and we were unable to recover it. 00:30:20.815 [2024-11-20 01:31:28.945998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-20 01:31:28.946120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-20 01:31:28.946146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.815 qpair failed and we were unable to recover it. 00:30:20.815 [2024-11-20 01:31:28.946234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-20 01:31:28.946317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-20 01:31:28.946342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.815 qpair failed and we were unable to recover it. 00:30:20.815 [2024-11-20 01:31:28.946434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-20 01:31:28.946530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-20 01:31:28.946554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.815 qpair failed and we were unable to recover it. 00:30:20.815 [2024-11-20 01:31:28.946670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-20 01:31:28.946783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-20 01:31:28.946808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.815 qpair failed and we were unable to recover it. 00:30:20.815 [2024-11-20 01:31:28.946962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-20 01:31:28.947080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-20 01:31:28.947106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.815 qpair failed and we were unable to recover it. 00:30:20.815 [2024-11-20 01:31:28.947230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-20 01:31:28.947311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-20 01:31:28.947340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.815 qpair failed and we were unable to recover it. 00:30:20.815 [2024-11-20 01:31:28.947425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-20 01:31:28.947534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-20 01:31:28.947558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.815 qpair failed and we were unable to recover it. 00:30:20.815 [2024-11-20 01:31:28.947711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-20 01:31:28.947806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-20 01:31:28.947847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.815 qpair failed and we were unable to recover it. 00:30:20.815 [2024-11-20 01:31:28.947961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-20 01:31:28.948046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-20 01:31:28.948077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.815 qpair failed and we were unable to recover it. 00:30:20.815 [2024-11-20 01:31:28.948163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-20 01:31:28.948258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-20 01:31:28.948284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.815 qpair failed and we were unable to recover it. 00:30:20.815 [2024-11-20 01:31:28.948434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-20 01:31:28.948583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-20 01:31:28.948608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.815 qpair failed and we were unable to recover it. 00:30:20.815 [2024-11-20 01:31:28.948748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-20 01:31:28.948858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-20 01:31:28.948883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.815 qpair failed and we were unable to recover it. 00:30:20.815 [2024-11-20 01:31:28.948961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-20 01:31:28.949052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-20 01:31:28.949081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.815 qpair failed and we were unable to recover it. 00:30:20.815 [2024-11-20 01:31:28.949169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-20 01:31:28.949270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-20 01:31:28.949295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.815 qpair failed and we were unable to recover it. 00:30:20.815 [2024-11-20 01:31:28.949377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-20 01:31:28.949496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-20 01:31:28.949520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.815 qpair failed and we were unable to recover it. 00:30:20.815 [2024-11-20 01:31:28.949640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-20 01:31:28.949723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-20 01:31:28.949748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.815 qpair failed and we were unable to recover it. 00:30:20.815 [2024-11-20 01:31:28.949884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-20 01:31:28.949984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-20 01:31:28.950024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.815 qpair failed and we were unable to recover it. 00:30:20.815 [2024-11-20 01:31:28.950157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-20 01:31:28.950255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-20 01:31:28.950280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.815 qpair failed and we were unable to recover it. 00:30:20.815 [2024-11-20 01:31:28.950396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-20 01:31:28.950506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-20 01:31:28.950531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.815 qpair failed and we were unable to recover it. 00:30:20.815 [2024-11-20 01:31:28.950647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-20 01:31:28.950764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-20 01:31:28.950789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.815 qpair failed and we were unable to recover it. 00:30:20.815 [2024-11-20 01:31:28.950883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-20 01:31:28.950968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-20 01:31:28.950993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.815 qpair failed and we were unable to recover it. 00:30:20.815 [2024-11-20 01:31:28.951089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-20 01:31:28.951206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-20 01:31:28.951231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.815 qpair failed and we were unable to recover it. 00:30:20.815 [2024-11-20 01:31:28.951346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-20 01:31:28.951431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-20 01:31:28.951457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.815 qpair failed and we were unable to recover it. 00:30:20.815 [2024-11-20 01:31:28.951542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.816 [2024-11-20 01:31:28.951675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.816 [2024-11-20 01:31:28.951704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.816 qpair failed and we were unable to recover it. 00:30:20.816 [2024-11-20 01:31:28.951839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.816 [2024-11-20 01:31:28.951921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.816 [2024-11-20 01:31:28.951946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.816 qpair failed and we were unable to recover it. 00:30:20.816 [2024-11-20 01:31:28.952029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.816 [2024-11-20 01:31:28.952155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.816 [2024-11-20 01:31:28.952180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.816 qpair failed and we were unable to recover it. 00:30:20.816 [2024-11-20 01:31:28.952286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.816 [2024-11-20 01:31:28.952400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.816 [2024-11-20 01:31:28.952425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.816 qpair failed and we were unable to recover it. 00:30:20.816 [2024-11-20 01:31:28.952509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.816 [2024-11-20 01:31:28.952631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.816 [2024-11-20 01:31:28.952656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.816 qpair failed and we were unable to recover it. 00:30:20.816 [2024-11-20 01:31:28.952736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.816 [2024-11-20 01:31:28.952926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.816 [2024-11-20 01:31:28.952951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.816 qpair failed and we were unable to recover it. 00:30:20.816 [2024-11-20 01:31:28.953085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.816 [2024-11-20 01:31:28.953204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.816 [2024-11-20 01:31:28.953229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.816 qpair failed and we were unable to recover it. 00:30:20.816 [2024-11-20 01:31:28.953346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.816 [2024-11-20 01:31:28.953484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.816 [2024-11-20 01:31:28.953509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.816 qpair failed and we were unable to recover it. 00:30:20.816 [2024-11-20 01:31:28.953596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.816 [2024-11-20 01:31:28.953680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.816 [2024-11-20 01:31:28.953706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.816 qpair failed and we were unable to recover it. 00:30:20.816 [2024-11-20 01:31:28.953790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.816 [2024-11-20 01:31:28.953906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.816 [2024-11-20 01:31:28.953948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.816 qpair failed and we were unable to recover it. 00:30:20.816 [2024-11-20 01:31:28.954100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.816 [2024-11-20 01:31:28.954224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.816 [2024-11-20 01:31:28.954248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.816 qpair failed and we were unable to recover it. 00:30:20.816 [2024-11-20 01:31:28.954342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.816 [2024-11-20 01:31:28.954455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.816 [2024-11-20 01:31:28.954479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.816 qpair failed and we were unable to recover it. 00:30:20.816 [2024-11-20 01:31:28.954567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.816 [2024-11-20 01:31:28.954707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.816 [2024-11-20 01:31:28.954731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.816 qpair failed and we were unable to recover it. 00:30:20.816 [2024-11-20 01:31:28.954818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.816 [2024-11-20 01:31:28.954915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.816 [2024-11-20 01:31:28.954958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.816 qpair failed and we were unable to recover it. 00:30:20.816 [2024-11-20 01:31:28.955059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.816 [2024-11-20 01:31:28.955176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.816 [2024-11-20 01:31:28.955199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.816 qpair failed and we were unable to recover it. 00:30:20.816 [2024-11-20 01:31:28.955288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.816 [2024-11-20 01:31:28.955434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.816 [2024-11-20 01:31:28.955459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.816 qpair failed and we were unable to recover it. 00:30:20.816 [2024-11-20 01:31:28.956273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.816 [2024-11-20 01:31:28.956415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.816 [2024-11-20 01:31:28.956440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.816 qpair failed and we were unable to recover it. 00:30:20.816 [2024-11-20 01:31:28.956552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.816 [2024-11-20 01:31:28.956645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.816 [2024-11-20 01:31:28.956670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.816 qpair failed and we were unable to recover it. 00:30:20.816 [2024-11-20 01:31:28.956790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.816 [2024-11-20 01:31:28.956908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.816 [2024-11-20 01:31:28.956933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.816 qpair failed and we were unable to recover it. 00:30:20.816 [2024-11-20 01:31:28.957015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.816 [2024-11-20 01:31:28.957121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.816 [2024-11-20 01:31:28.957146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.816 qpair failed and we were unable to recover it. 00:30:20.816 [2024-11-20 01:31:28.957242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.816 [2024-11-20 01:31:28.957334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.816 [2024-11-20 01:31:28.957374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.816 qpair failed and we were unable to recover it. 00:30:20.816 [2024-11-20 01:31:28.957545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.816 [2024-11-20 01:31:28.957738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.816 [2024-11-20 01:31:28.957778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.816 qpair failed and we were unable to recover it. 00:30:20.816 [2024-11-20 01:31:28.957897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.816 [2024-11-20 01:31:28.958025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.816 [2024-11-20 01:31:28.958067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.816 qpair failed and we were unable to recover it. 00:30:20.816 [2024-11-20 01:31:28.958193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.816 [2024-11-20 01:31:28.958285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.816 [2024-11-20 01:31:28.958314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.816 qpair failed and we were unable to recover it. 00:30:20.816 [2024-11-20 01:31:28.958406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.816 [2024-11-20 01:31:28.958528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.816 [2024-11-20 01:31:28.958553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.816 qpair failed and we were unable to recover it. 00:30:20.816 [2024-11-20 01:31:28.958667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.816 [2024-11-20 01:31:28.958808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.816 [2024-11-20 01:31:28.958833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.816 qpair failed and we were unable to recover it. 00:30:20.816 [2024-11-20 01:31:28.958922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.816 [2024-11-20 01:31:28.959003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.816 [2024-11-20 01:31:28.959028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.816 qpair failed and we were unable to recover it. 00:30:20.816 [2024-11-20 01:31:28.959134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.816 [2024-11-20 01:31:28.959230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.816 [2024-11-20 01:31:28.959254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.816 qpair failed and we were unable to recover it. 00:30:20.816 [2024-11-20 01:31:28.959345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.816 [2024-11-20 01:31:28.959460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.816 [2024-11-20 01:31:28.959486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.817 qpair failed and we were unable to recover it. 00:30:20.817 [2024-11-20 01:31:28.959607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-20 01:31:28.959698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-20 01:31:28.959723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.817 qpair failed and we were unable to recover it. 00:30:20.817 [2024-11-20 01:31:28.959841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-20 01:31:28.959956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-20 01:31:28.959980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.817 qpair failed and we were unable to recover it. 00:30:20.817 [2024-11-20 01:31:28.960147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-20 01:31:28.960262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-20 01:31:28.960287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.817 qpair failed and we were unable to recover it. 00:30:20.817 [2024-11-20 01:31:28.960436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-20 01:31:28.960518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-20 01:31:28.960542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.817 qpair failed and we were unable to recover it. 00:30:20.817 [2024-11-20 01:31:28.960661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-20 01:31:28.960771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-20 01:31:28.960795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.817 qpair failed and we were unable to recover it. 00:30:20.817 [2024-11-20 01:31:28.960879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-20 01:31:28.961007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-20 01:31:28.961031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.817 qpair failed and we were unable to recover it. 00:30:20.817 [2024-11-20 01:31:28.961123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-20 01:31:28.961314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-20 01:31:28.961339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.817 qpair failed and we were unable to recover it. 00:30:20.817 [2024-11-20 01:31:28.961433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-20 01:31:28.961549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-20 01:31:28.961573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.817 qpair failed and we were unable to recover it. 00:30:20.817 [2024-11-20 01:31:28.961728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-20 01:31:28.961841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-20 01:31:28.961865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.817 qpair failed and we were unable to recover it. 00:30:20.817 [2024-11-20 01:31:28.961995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-20 01:31:28.962108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-20 01:31:28.962133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.817 qpair failed and we were unable to recover it. 00:30:20.817 [2024-11-20 01:31:28.962225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-20 01:31:28.962341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-20 01:31:28.962366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.817 qpair failed and we were unable to recover it. 00:30:20.817 [2024-11-20 01:31:28.962499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-20 01:31:28.962625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-20 01:31:28.962650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.817 qpair failed and we were unable to recover it. 00:30:20.817 [2024-11-20 01:31:28.962737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-20 01:31:28.962832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-20 01:31:28.962856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.817 qpair failed and we were unable to recover it. 00:30:20.817 [2024-11-20 01:31:28.962969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-20 01:31:28.963053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-20 01:31:28.963084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.817 qpair failed and we were unable to recover it. 00:30:20.817 [2024-11-20 01:31:28.963184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-20 01:31:28.963300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-20 01:31:28.963325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.817 qpair failed and we were unable to recover it. 00:30:20.817 [2024-11-20 01:31:28.963440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-20 01:31:28.963552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-20 01:31:28.963577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.817 qpair failed and we were unable to recover it. 00:30:20.817 [2024-11-20 01:31:28.963668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-20 01:31:28.963756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-20 01:31:28.963781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.817 qpair failed and we were unable to recover it. 00:30:20.817 [2024-11-20 01:31:28.963893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-20 01:31:28.964004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-20 01:31:28.964046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.817 qpair failed and we were unable to recover it. 00:30:20.817 [2024-11-20 01:31:28.964151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-20 01:31:28.964242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-20 01:31:28.964268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.817 qpair failed and we were unable to recover it. 00:30:20.817 [2024-11-20 01:31:28.964384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-20 01:31:28.964470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-20 01:31:28.964495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.817 qpair failed and we were unable to recover it. 00:30:20.817 [2024-11-20 01:31:28.964573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-20 01:31:28.964697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-20 01:31:28.964721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.817 qpair failed and we were unable to recover it. 00:30:20.817 [2024-11-20 01:31:28.964829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-20 01:31:28.964928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-20 01:31:28.964953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.817 qpair failed and we were unable to recover it. 00:30:20.817 [2024-11-20 01:31:28.965074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-20 01:31:28.965190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-20 01:31:28.965214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.817 qpair failed and we were unable to recover it. 00:30:20.817 [2024-11-20 01:31:28.965296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-20 01:31:28.965440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-20 01:31:28.965465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.817 qpair failed and we were unable to recover it. 00:30:20.817 [2024-11-20 01:31:28.965584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-20 01:31:28.965701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-20 01:31:28.965725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.817 qpair failed and we were unable to recover it. 00:30:20.817 [2024-11-20 01:31:28.965813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-20 01:31:28.965962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-20 01:31:28.965987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.817 qpair failed and we were unable to recover it. 00:30:20.817 [2024-11-20 01:31:28.966083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-20 01:31:28.966197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-20 01:31:28.966222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.817 qpair failed and we were unable to recover it. 00:30:20.817 [2024-11-20 01:31:28.966342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-20 01:31:28.966432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-20 01:31:28.966457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.817 qpair failed and we were unable to recover it. 00:30:20.817 [2024-11-20 01:31:28.966543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-20 01:31:28.966649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-20 01:31:28.966674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.818 qpair failed and we were unable to recover it. 00:30:20.818 [2024-11-20 01:31:28.966789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-20 01:31:28.966870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-20 01:31:28.966894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.818 qpair failed and we were unable to recover it. 00:30:20.818 [2024-11-20 01:31:28.967005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-20 01:31:28.967134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-20 01:31:28.967160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.818 qpair failed and we were unable to recover it. 00:30:20.818 [2024-11-20 01:31:28.967284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-20 01:31:28.967435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-20 01:31:28.967460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.818 qpair failed and we were unable to recover it. 00:30:20.818 [2024-11-20 01:31:28.967607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-20 01:31:28.967692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-20 01:31:28.967716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.818 qpair failed and we were unable to recover it. 00:30:20.818 [2024-11-20 01:31:28.967834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-20 01:31:28.967953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-20 01:31:28.967977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.818 qpair failed and we were unable to recover it. 00:30:20.818 [2024-11-20 01:31:28.968096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-20 01:31:28.968186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-20 01:31:28.968211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.818 qpair failed and we were unable to recover it. 00:30:20.818 [2024-11-20 01:31:28.968298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-20 01:31:28.968413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-20 01:31:28.968438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.818 qpair failed and we were unable to recover it. 00:30:20.818 [2024-11-20 01:31:28.968558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-20 01:31:28.968672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-20 01:31:28.968697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.818 qpair failed and we were unable to recover it. 00:30:20.818 [2024-11-20 01:31:28.968838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-20 01:31:28.968952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-20 01:31:28.968977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.818 qpair failed and we were unable to recover it. 00:30:20.818 [2024-11-20 01:31:28.969099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-20 01:31:28.969219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-20 01:31:28.969243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.818 qpair failed and we were unable to recover it. 00:30:20.818 [2024-11-20 01:31:28.969362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-20 01:31:28.969505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-20 01:31:28.969529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.818 qpair failed and we were unable to recover it. 00:30:20.818 [2024-11-20 01:31:28.969612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-20 01:31:28.969695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-20 01:31:28.969720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.818 qpair failed and we were unable to recover it. 00:30:20.818 [2024-11-20 01:31:28.969839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-20 01:31:28.969954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-20 01:31:28.969978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.818 qpair failed and we were unable to recover it. 00:30:20.818 [2024-11-20 01:31:28.970063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-20 01:31:28.970178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-20 01:31:28.970203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.818 qpair failed and we were unable to recover it. 00:30:20.818 [2024-11-20 01:31:28.970324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-20 01:31:28.970435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-20 01:31:28.970459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.818 qpair failed and we were unable to recover it. 00:30:20.818 [2024-11-20 01:31:28.970609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-20 01:31:28.970724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-20 01:31:28.970749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.818 qpair failed and we were unable to recover it. 00:30:20.818 [2024-11-20 01:31:28.970940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-20 01:31:28.971148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-20 01:31:28.971180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.818 qpair failed and we were unable to recover it. 00:30:20.818 [2024-11-20 01:31:28.971282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-20 01:31:28.971402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-20 01:31:28.971427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.818 qpair failed and we were unable to recover it. 00:30:20.818 [2024-11-20 01:31:28.971562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-20 01:31:28.971692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-20 01:31:28.971716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.818 qpair failed and we were unable to recover it. 00:30:20.818 [2024-11-20 01:31:28.971828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-20 01:31:28.971969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-20 01:31:28.971994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.818 qpair failed and we were unable to recover it. 00:30:20.818 [2024-11-20 01:31:28.972096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-20 01:31:28.972209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-20 01:31:28.972234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.818 qpair failed and we were unable to recover it. 00:30:20.818 [2024-11-20 01:31:28.972323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-20 01:31:28.972408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-20 01:31:28.972432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.818 qpair failed and we were unable to recover it. 00:30:20.818 [2024-11-20 01:31:28.972544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-20 01:31:28.972685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-20 01:31:28.972709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.818 qpair failed and we were unable to recover it. 00:30:20.818 [2024-11-20 01:31:28.972796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-20 01:31:28.972908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-20 01:31:28.972932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.819 qpair failed and we were unable to recover it. 00:30:20.819 [2024-11-20 01:31:28.973020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-20 01:31:28.973151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-20 01:31:28.973194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.819 qpair failed and we were unable to recover it. 00:30:20.819 [2024-11-20 01:31:28.973322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-20 01:31:28.973490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-20 01:31:28.973515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.819 qpair failed and we were unable to recover it. 00:30:20.819 [2024-11-20 01:31:28.973601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-20 01:31:28.973717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-20 01:31:28.973741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.819 qpair failed and we were unable to recover it. 00:30:20.819 [2024-11-20 01:31:28.973839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-20 01:31:28.973922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-20 01:31:28.973947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.819 qpair failed and we were unable to recover it. 00:30:20.819 [2024-11-20 01:31:28.974103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-20 01:31:28.974214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-20 01:31:28.974256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.819 qpair failed and we were unable to recover it. 00:30:20.819 [2024-11-20 01:31:28.974348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-20 01:31:28.974457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-20 01:31:28.974482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.819 qpair failed and we were unable to recover it. 00:30:20.819 [2024-11-20 01:31:28.974602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-20 01:31:28.974680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-20 01:31:28.974705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.819 qpair failed and we were unable to recover it. 00:30:20.819 [2024-11-20 01:31:28.974787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-20 01:31:28.974907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-20 01:31:28.974949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.819 qpair failed and we were unable to recover it. 00:30:20.819 [2024-11-20 01:31:28.975082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-20 01:31:28.975171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-20 01:31:28.975195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.819 qpair failed and we were unable to recover it. 00:30:20.819 [2024-11-20 01:31:28.975289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-20 01:31:28.975439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-20 01:31:28.975464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.819 qpair failed and we were unable to recover it. 00:30:20.819 [2024-11-20 01:31:28.975576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-20 01:31:28.975706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-20 01:31:28.975733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.819 qpair failed and we were unable to recover it. 00:30:20.819 [2024-11-20 01:31:28.975832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-20 01:31:28.975954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-20 01:31:28.975978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.819 qpair failed and we were unable to recover it. 00:30:20.819 [2024-11-20 01:31:28.976081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-20 01:31:28.976176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-20 01:31:28.976202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.819 qpair failed and we were unable to recover it. 00:30:20.819 [2024-11-20 01:31:28.976325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-20 01:31:28.976514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-20 01:31:28.976539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.819 qpair failed and we were unable to recover it. 00:30:20.819 [2024-11-20 01:31:28.976626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-20 01:31:28.976770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-20 01:31:28.976796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.819 qpair failed and we were unable to recover it. 00:30:20.819 [2024-11-20 01:31:28.976916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-20 01:31:28.977021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-20 01:31:28.977046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.819 qpair failed and we were unable to recover it. 00:30:20.819 [2024-11-20 01:31:28.977200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-20 01:31:28.977313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-20 01:31:28.977338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.819 qpair failed and we were unable to recover it. 00:30:20.819 [2024-11-20 01:31:28.977428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-20 01:31:28.977620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-20 01:31:28.977660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.819 qpair failed and we were unable to recover it. 00:30:20.819 [2024-11-20 01:31:28.977798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-20 01:31:28.977944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-20 01:31:28.977969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.819 qpair failed and we were unable to recover it. 00:30:20.819 [2024-11-20 01:31:28.978110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-20 01:31:28.978230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-20 01:31:28.978258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.819 qpair failed and we were unable to recover it. 00:30:20.819 [2024-11-20 01:31:28.978371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-20 01:31:28.978482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-20 01:31:28.978506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.819 qpair failed and we were unable to recover it. 00:30:20.819 [2024-11-20 01:31:28.978590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-20 01:31:28.978669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-20 01:31:28.978694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.819 qpair failed and we were unable to recover it. 00:30:20.819 [2024-11-20 01:31:28.978787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-20 01:31:28.978887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-20 01:31:28.978917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.819 qpair failed and we were unable to recover it. 00:30:20.819 [2024-11-20 01:31:28.979027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-20 01:31:28.979154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-20 01:31:28.979180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.819 qpair failed and we were unable to recover it. 00:30:20.819 [2024-11-20 01:31:28.979277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-20 01:31:28.979420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-20 01:31:28.979445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.819 qpair failed and we were unable to recover it. 00:30:20.819 [2024-11-20 01:31:28.979563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-20 01:31:28.979695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-20 01:31:28.979723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.819 qpair failed and we were unable to recover it. 00:30:20.819 [2024-11-20 01:31:28.979835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-20 01:31:28.979946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-20 01:31:28.979971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.819 qpair failed and we were unable to recover it. 00:30:20.819 [2024-11-20 01:31:28.980087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-20 01:31:28.980204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-20 01:31:28.980229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.819 qpair failed and we were unable to recover it. 00:30:20.820 [2024-11-20 01:31:28.980314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.820 [2024-11-20 01:31:28.980430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.820 [2024-11-20 01:31:28.980472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.820 qpair failed and we were unable to recover it. 00:30:20.820 [2024-11-20 01:31:28.980610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.820 [2024-11-20 01:31:28.980693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.820 [2024-11-20 01:31:28.980718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.820 qpair failed and we were unable to recover it. 00:30:20.820 [2024-11-20 01:31:28.980837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.820 [2024-11-20 01:31:28.980948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.820 [2024-11-20 01:31:28.980972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.820 qpair failed and we were unable to recover it. 00:30:20.820 [2024-11-20 01:31:28.981058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.820 [2024-11-20 01:31:28.981202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.820 [2024-11-20 01:31:28.981230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.820 qpair failed and we were unable to recover it. 00:30:20.820 [2024-11-20 01:31:28.981345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.820 [2024-11-20 01:31:28.981459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.820 [2024-11-20 01:31:28.981483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.820 qpair failed and we were unable to recover it. 00:30:20.820 [2024-11-20 01:31:28.981573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.820 [2024-11-20 01:31:28.981653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.820 [2024-11-20 01:31:28.981678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.820 qpair failed and we were unable to recover it. 00:30:20.820 [2024-11-20 01:31:28.981805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.820 [2024-11-20 01:31:28.981946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.820 [2024-11-20 01:31:28.981971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.820 qpair failed and we were unable to recover it. 00:30:20.820 [2024-11-20 01:31:28.982051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.820 [2024-11-20 01:31:28.982214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.820 [2024-11-20 01:31:28.982240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.820 qpair failed and we were unable to recover it. 00:30:20.820 [2024-11-20 01:31:28.982334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.820 [2024-11-20 01:31:28.982416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.820 [2024-11-20 01:31:28.982440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.820 qpair failed and we were unable to recover it. 00:30:20.820 [2024-11-20 01:31:28.982585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.820 [2024-11-20 01:31:28.982737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.820 [2024-11-20 01:31:28.982761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.820 qpair failed and we were unable to recover it. 00:30:20.820 [2024-11-20 01:31:28.982855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.820 [2024-11-20 01:31:28.982970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.820 [2024-11-20 01:31:28.982995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.820 qpair failed and we were unable to recover it. 00:30:20.820 [2024-11-20 01:31:28.983084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.820 [2024-11-20 01:31:28.983175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.820 [2024-11-20 01:31:28.983199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.820 qpair failed and we were unable to recover it. 00:30:20.820 [2024-11-20 01:31:28.983310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.820 [2024-11-20 01:31:28.983394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.820 [2024-11-20 01:31:28.983419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.820 qpair failed and we were unable to recover it. 00:30:20.820 [2024-11-20 01:31:28.983508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.820 [2024-11-20 01:31:28.983616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.820 [2024-11-20 01:31:28.983640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.820 qpair failed and we were unable to recover it. 00:30:20.820 [2024-11-20 01:31:28.983775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.820 [2024-11-20 01:31:28.983942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.820 [2024-11-20 01:31:28.983967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.820 qpair failed and we were unable to recover it. 00:30:20.820 [2024-11-20 01:31:28.984086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.820 [2024-11-20 01:31:28.984225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.820 [2024-11-20 01:31:28.984257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.820 qpair failed and we were unable to recover it. 00:30:20.820 [2024-11-20 01:31:28.984346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.820 [2024-11-20 01:31:28.984461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.820 [2024-11-20 01:31:28.984485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.820 qpair failed and we were unable to recover it. 00:30:20.820 [2024-11-20 01:31:28.984596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.820 [2024-11-20 01:31:28.984715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.820 [2024-11-20 01:31:28.984740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.820 qpair failed and we were unable to recover it. 00:30:20.820 [2024-11-20 01:31:28.984881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.820 [2024-11-20 01:31:28.984991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.820 [2024-11-20 01:31:28.985015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.820 qpair failed and we were unable to recover it. 00:30:20.820 [2024-11-20 01:31:28.985132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.820 [2024-11-20 01:31:28.985243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.820 [2024-11-20 01:31:28.985268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.820 qpair failed and we were unable to recover it. 00:30:20.820 [2024-11-20 01:31:28.985358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.820 [2024-11-20 01:31:28.985538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.820 [2024-11-20 01:31:28.985563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.820 qpair failed and we were unable to recover it. 00:30:20.820 [2024-11-20 01:31:28.985679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.820 [2024-11-20 01:31:28.985859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.820 [2024-11-20 01:31:28.985884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.820 qpair failed and we were unable to recover it. 00:30:20.820 [2024-11-20 01:31:28.986003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.820 [2024-11-20 01:31:28.986131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.820 [2024-11-20 01:31:28.986156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.820 qpair failed and we were unable to recover it. 00:30:20.820 [2024-11-20 01:31:28.986268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.820 [2024-11-20 01:31:28.986404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.820 [2024-11-20 01:31:28.986429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.820 qpair failed and we were unable to recover it. 00:30:20.820 [2024-11-20 01:31:28.986539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.820 [2024-11-20 01:31:28.986654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.820 [2024-11-20 01:31:28.986679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.820 qpair failed and we were unable to recover it. 00:30:20.820 [2024-11-20 01:31:28.986802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.820 [2024-11-20 01:31:28.986906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.820 [2024-11-20 01:31:28.986931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.820 qpair failed and we were unable to recover it. 00:30:20.820 [2024-11-20 01:31:28.987021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.820 [2024-11-20 01:31:28.987149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.820 [2024-11-20 01:31:28.987174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.820 qpair failed and we were unable to recover it. 00:30:20.820 [2024-11-20 01:31:28.987320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.820 [2024-11-20 01:31:28.987485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.820 [2024-11-20 01:31:28.987512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.820 qpair failed and we were unable to recover it. 00:30:20.820 [2024-11-20 01:31:28.987625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.820 [2024-11-20 01:31:28.987707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.820 [2024-11-20 01:31:28.987732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.821 qpair failed and we were unable to recover it. 00:30:20.821 [2024-11-20 01:31:28.987819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.821 [2024-11-20 01:31:28.987948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.821 [2024-11-20 01:31:28.987989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.821 qpair failed and we were unable to recover it. 00:30:20.821 [2024-11-20 01:31:28.988086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.821 [2024-11-20 01:31:28.988185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.821 [2024-11-20 01:31:28.988209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.821 qpair failed and we were unable to recover it. 00:30:20.821 [2024-11-20 01:31:28.988303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.821 [2024-11-20 01:31:28.988379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.821 [2024-11-20 01:31:28.988404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.821 qpair failed and we were unable to recover it. 00:30:20.821 [2024-11-20 01:31:28.988525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.821 [2024-11-20 01:31:28.988607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.821 [2024-11-20 01:31:28.988632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.821 qpair failed and we were unable to recover it. 00:30:20.821 [2024-11-20 01:31:28.988734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.821 [2024-11-20 01:31:28.988863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.821 [2024-11-20 01:31:28.988890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.821 qpair failed and we were unable to recover it. 00:30:20.821 [2024-11-20 01:31:28.989010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.821 [2024-11-20 01:31:28.989129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.821 [2024-11-20 01:31:28.989155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.821 qpair failed and we were unable to recover it. 00:30:20.821 [2024-11-20 01:31:28.989284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.821 [2024-11-20 01:31:28.989404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.821 [2024-11-20 01:31:28.989431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.821 qpair failed and we were unable to recover it. 00:30:20.821 [2024-11-20 01:31:28.989569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.821 [2024-11-20 01:31:28.989694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.821 [2024-11-20 01:31:28.989721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.821 qpair failed and we were unable to recover it. 00:30:20.821 [2024-11-20 01:31:28.989851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.821 [2024-11-20 01:31:28.989998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.821 [2024-11-20 01:31:28.990022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.821 qpair failed and we were unable to recover it. 00:30:20.821 [2024-11-20 01:31:28.990144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.821 [2024-11-20 01:31:28.990282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.821 [2024-11-20 01:31:28.990307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.821 qpair failed and we were unable to recover it. 00:30:20.821 [2024-11-20 01:31:28.990392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.821 [2024-11-20 01:31:28.990474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.821 [2024-11-20 01:31:28.990499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.821 qpair failed and we were unable to recover it. 00:30:20.821 [2024-11-20 01:31:28.990618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.821 [2024-11-20 01:31:28.990734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.821 [2024-11-20 01:31:28.990758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.821 qpair failed and we were unable to recover it. 00:30:20.821 [2024-11-20 01:31:28.990885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.821 [2024-11-20 01:31:28.991002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.821 [2024-11-20 01:31:28.991029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.821 qpair failed and we were unable to recover it. 00:30:20.821 [2024-11-20 01:31:28.991197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.821 [2024-11-20 01:31:28.991322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.821 [2024-11-20 01:31:28.991350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.821 qpair failed and we were unable to recover it. 00:30:20.821 [2024-11-20 01:31:28.991482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.821 [2024-11-20 01:31:28.991562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.821 [2024-11-20 01:31:28.991586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.821 qpair failed and we were unable to recover it. 00:30:20.821 [2024-11-20 01:31:28.991719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.821 [2024-11-20 01:31:28.991849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.821 [2024-11-20 01:31:28.991876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.821 qpair failed and we were unable to recover it. 00:30:20.821 [2024-11-20 01:31:28.991976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.821 [2024-11-20 01:31:28.992097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.821 [2024-11-20 01:31:28.992125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.821 qpair failed and we were unable to recover it. 00:30:20.821 [2024-11-20 01:31:28.992292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.821 [2024-11-20 01:31:28.992404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.821 [2024-11-20 01:31:28.992428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.821 qpair failed and we were unable to recover it. 00:30:20.821 [2024-11-20 01:31:28.992535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.821 [2024-11-20 01:31:28.992654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.821 [2024-11-20 01:31:28.992681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.821 qpair failed and we were unable to recover it. 00:30:20.821 [2024-11-20 01:31:28.992816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.821 [2024-11-20 01:31:28.992928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.821 [2024-11-20 01:31:28.992952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.821 qpair failed and we were unable to recover it. 00:30:20.821 [2024-11-20 01:31:28.993063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.821 [2024-11-20 01:31:28.993179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.821 [2024-11-20 01:31:28.993204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.821 qpair failed and we were unable to recover it. 00:30:20.821 [2024-11-20 01:31:28.993330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.821 [2024-11-20 01:31:28.993481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.821 [2024-11-20 01:31:28.993508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.821 qpair failed and we were unable to recover it. 00:30:20.821 [2024-11-20 01:31:28.993596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.821 [2024-11-20 01:31:28.993726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.821 [2024-11-20 01:31:28.993750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.821 qpair failed and we were unable to recover it. 00:30:20.821 [2024-11-20 01:31:28.993831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.821 [2024-11-20 01:31:28.993949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.821 [2024-11-20 01:31:28.993973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.821 qpair failed and we were unable to recover it. 00:30:20.821 [2024-11-20 01:31:28.994059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.821 [2024-11-20 01:31:28.994177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.821 [2024-11-20 01:31:28.994204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.821 qpair failed and we were unable to recover it. 00:30:20.821 [2024-11-20 01:31:28.994346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.821 [2024-11-20 01:31:28.994456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.821 [2024-11-20 01:31:28.994480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.821 qpair failed and we were unable to recover it. 00:30:20.821 [2024-11-20 01:31:28.994590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.821 [2024-11-20 01:31:28.994708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.821 [2024-11-20 01:31:28.994732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.821 qpair failed and we were unable to recover it. 00:30:20.821 [2024-11-20 01:31:28.994847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.821 [2024-11-20 01:31:28.994922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.821 [2024-11-20 01:31:28.994968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.821 qpair failed and we were unable to recover it. 00:30:20.821 [2024-11-20 01:31:28.995097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.821 [2024-11-20 01:31:28.995226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.822 [2024-11-20 01:31:28.995251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.822 qpair failed and we were unable to recover it. 00:30:20.822 [2024-11-20 01:31:28.995334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.822 [2024-11-20 01:31:28.995418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.822 [2024-11-20 01:31:28.995443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.822 qpair failed and we were unable to recover it. 00:30:20.822 [2024-11-20 01:31:28.995534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.822 [2024-11-20 01:31:28.995641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.822 [2024-11-20 01:31:28.995669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.822 qpair failed and we were unable to recover it. 00:30:20.822 [2024-11-20 01:31:28.995797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.822 [2024-11-20 01:31:28.995921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.822 [2024-11-20 01:31:28.995948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.822 qpair failed and we were unable to recover it. 00:30:20.822 [2024-11-20 01:31:28.996052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.822 [2024-11-20 01:31:28.996141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.822 [2024-11-20 01:31:28.996166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.822 qpair failed and we were unable to recover it. 00:30:20.822 [2024-11-20 01:31:28.996254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.822 [2024-11-20 01:31:28.996349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.822 [2024-11-20 01:31:28.996373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.822 qpair failed and we were unable to recover it. 00:30:20.822 [2024-11-20 01:31:28.996465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.822 [2024-11-20 01:31:28.996600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.822 [2024-11-20 01:31:28.996628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.822 qpair failed and we were unable to recover it. 00:30:20.822 [2024-11-20 01:31:28.996738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.822 [2024-11-20 01:31:28.996882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.822 [2024-11-20 01:31:28.996906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.822 qpair failed and we were unable to recover it. 00:30:20.822 [2024-11-20 01:31:28.997046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.822 [2024-11-20 01:31:28.997214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.822 [2024-11-20 01:31:28.997243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.822 qpair failed and we were unable to recover it. 00:30:20.822 [2024-11-20 01:31:28.997403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.822 [2024-11-20 01:31:28.997491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.822 [2024-11-20 01:31:28.997516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.822 qpair failed and we were unable to recover it. 00:30:20.822 [2024-11-20 01:31:28.997666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.822 [2024-11-20 01:31:28.997808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.822 [2024-11-20 01:31:28.997848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.822 qpair failed and we were unable to recover it. 00:30:20.822 [2024-11-20 01:31:28.997974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.822 [2024-11-20 01:31:28.998064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.822 [2024-11-20 01:31:28.998100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.822 qpair failed and we were unable to recover it. 00:30:20.822 [2024-11-20 01:31:28.998197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.822 [2024-11-20 01:31:28.998296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.822 [2024-11-20 01:31:28.998323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.822 qpair failed and we were unable to recover it. 00:30:20.822 [2024-11-20 01:31:28.998431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.822 [2024-11-20 01:31:28.998540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.822 [2024-11-20 01:31:28.998565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.822 qpair failed and we were unable to recover it. 00:30:20.822 [2024-11-20 01:31:28.998724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.822 [2024-11-20 01:31:28.998852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.822 [2024-11-20 01:31:28.998879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.822 qpair failed and we were unable to recover it. 00:30:20.822 [2024-11-20 01:31:28.998996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.822 [2024-11-20 01:31:28.999125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.822 [2024-11-20 01:31:28.999153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.822 qpair failed and we were unable to recover it. 00:30:20.822 [2024-11-20 01:31:28.999296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.822 [2024-11-20 01:31:28.999390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.822 [2024-11-20 01:31:28.999414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.822 qpair failed and we were unable to recover it. 00:30:20.822 [2024-11-20 01:31:28.999580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.822 [2024-11-20 01:31:28.999673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.822 [2024-11-20 01:31:28.999700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.822 qpair failed and we were unable to recover it. 00:30:20.822 [2024-11-20 01:31:28.999791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.822 [2024-11-20 01:31:28.999920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.822 [2024-11-20 01:31:28.999945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.822 qpair failed and we were unable to recover it. 00:30:20.822 [2024-11-20 01:31:29.000039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.822 [2024-11-20 01:31:29.000165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.822 [2024-11-20 01:31:29.000190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.822 qpair failed and we were unable to recover it. 00:30:20.822 [2024-11-20 01:31:29.000310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.822 [2024-11-20 01:31:29.000440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.822 [2024-11-20 01:31:29.000467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.822 qpair failed and we were unable to recover it. 00:30:20.822 [2024-11-20 01:31:29.000594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.822 [2024-11-20 01:31:29.000697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.822 [2024-11-20 01:31:29.000725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.822 qpair failed and we were unable to recover it. 00:30:20.822 [2024-11-20 01:31:29.000868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.822 [2024-11-20 01:31:29.001017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.822 [2024-11-20 01:31:29.001041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.822 qpair failed and we were unable to recover it. 00:30:20.822 [2024-11-20 01:31:29.001160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.822 [2024-11-20 01:31:29.001262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.822 [2024-11-20 01:31:29.001289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.822 qpair failed and we were unable to recover it. 00:30:20.822 [2024-11-20 01:31:29.001382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.822 [2024-11-20 01:31:29.001502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.822 [2024-11-20 01:31:29.001529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.822 qpair failed and we were unable to recover it. 00:30:20.822 [2024-11-20 01:31:29.001676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.822 [2024-11-20 01:31:29.001795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.822 [2024-11-20 01:31:29.001819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.823 qpair failed and we were unable to recover it. 00:30:20.823 [2024-11-20 01:31:29.001984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.823 [2024-11-20 01:31:29.002102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.823 [2024-11-20 01:31:29.002143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.823 qpair failed and we were unable to recover it. 00:30:20.823 [2024-11-20 01:31:29.002287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.823 [2024-11-20 01:31:29.002424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.823 [2024-11-20 01:31:29.002451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.823 qpair failed and we were unable to recover it. 00:30:20.823 [2024-11-20 01:31:29.002590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.823 [2024-11-20 01:31:29.002669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.823 [2024-11-20 01:31:29.002694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.823 qpair failed and we were unable to recover it. 00:30:20.823 [2024-11-20 01:31:29.002789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.823 [2024-11-20 01:31:29.002897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.823 [2024-11-20 01:31:29.002921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.823 qpair failed and we were unable to recover it. 00:30:20.823 [2024-11-20 01:31:29.003023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.823 [2024-11-20 01:31:29.003140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.823 [2024-11-20 01:31:29.003168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.823 qpair failed and we were unable to recover it. 00:30:20.823 [2024-11-20 01:31:29.003273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.823 [2024-11-20 01:31:29.003395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.823 [2024-11-20 01:31:29.003419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.823 qpair failed and we were unable to recover it. 00:30:20.823 [2024-11-20 01:31:29.003535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.823 [2024-11-20 01:31:29.003649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.823 [2024-11-20 01:31:29.003673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.823 qpair failed and we were unable to recover it. 00:30:20.823 [2024-11-20 01:31:29.003770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.823 [2024-11-20 01:31:29.003929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.823 [2024-11-20 01:31:29.003956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.823 qpair failed and we were unable to recover it. 00:30:20.823 [2024-11-20 01:31:29.004091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.823 [2024-11-20 01:31:29.004206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.823 [2024-11-20 01:31:29.004232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.823 qpair failed and we were unable to recover it. 00:30:20.823 [2024-11-20 01:31:29.004374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.823 [2024-11-20 01:31:29.004469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.823 [2024-11-20 01:31:29.004497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.823 qpair failed and we were unable to recover it. 00:30:20.823 [2024-11-20 01:31:29.004589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.823 [2024-11-20 01:31:29.004745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.823 [2024-11-20 01:31:29.004772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.823 qpair failed and we were unable to recover it. 00:30:20.823 [2024-11-20 01:31:29.004923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.823 [2024-11-20 01:31:29.005051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.823 [2024-11-20 01:31:29.005082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.823 qpair failed and we were unable to recover it. 00:30:20.823 [2024-11-20 01:31:29.005206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.823 [2024-11-20 01:31:29.005315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.823 [2024-11-20 01:31:29.005340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.823 qpair failed and we were unable to recover it. 00:30:20.823 [2024-11-20 01:31:29.005423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.823 [2024-11-20 01:31:29.005564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.823 [2024-11-20 01:31:29.005591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.823 qpair failed and we were unable to recover it. 00:30:20.823 [2024-11-20 01:31:29.005732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.823 [2024-11-20 01:31:29.005885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.823 [2024-11-20 01:31:29.005910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.823 qpair failed and we were unable to recover it. 00:30:20.823 [2024-11-20 01:31:29.006004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.823 [2024-11-20 01:31:29.006116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.823 [2024-11-20 01:31:29.006142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.823 qpair failed and we were unable to recover it. 00:30:20.823 [2024-11-20 01:31:29.006250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.823 [2024-11-20 01:31:29.006376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.823 [2024-11-20 01:31:29.006401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.823 qpair failed and we were unable to recover it. 00:30:20.823 [2024-11-20 01:31:29.006492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.823 [2024-11-20 01:31:29.006608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.823 [2024-11-20 01:31:29.006633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.823 qpair failed and we were unable to recover it. 00:30:20.823 [2024-11-20 01:31:29.006731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.823 [2024-11-20 01:31:29.006820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.823 [2024-11-20 01:31:29.006847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.823 qpair failed and we were unable to recover it. 00:30:20.823 [2024-11-20 01:31:29.006954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.823 [2024-11-20 01:31:29.007094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.823 [2024-11-20 01:31:29.007120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.823 qpair failed and we were unable to recover it. 00:30:20.823 [2024-11-20 01:31:29.007232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.823 [2024-11-20 01:31:29.007340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.823 [2024-11-20 01:31:29.007365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.823 qpair failed and we were unable to recover it. 00:30:20.823 [2024-11-20 01:31:29.007479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.823 [2024-11-20 01:31:29.007592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.823 [2024-11-20 01:31:29.007617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.823 qpair failed and we were unable to recover it. 00:30:20.823 [2024-11-20 01:31:29.007745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.823 [2024-11-20 01:31:29.007862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.823 [2024-11-20 01:31:29.007886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.823 qpair failed and we were unable to recover it. 00:30:20.823 [2024-11-20 01:31:29.008026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.823 [2024-11-20 01:31:29.008209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.823 [2024-11-20 01:31:29.008238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.823 qpair failed and we were unable to recover it. 00:30:20.823 [2024-11-20 01:31:29.008368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.823 [2024-11-20 01:31:29.008492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.823 [2024-11-20 01:31:29.008525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.823 qpair failed and we were unable to recover it. 00:30:20.823 [2024-11-20 01:31:29.008614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.823 [2024-11-20 01:31:29.008738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.823 [2024-11-20 01:31:29.008765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.823 qpair failed and we were unable to recover it. 00:30:20.823 [2024-11-20 01:31:29.008880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.823 [2024-11-20 01:31:29.008993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.823 [2024-11-20 01:31:29.009017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.823 qpair failed and we were unable to recover it. 00:30:20.823 [2024-11-20 01:31:29.009105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.823 [2024-11-20 01:31:29.009194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.823 [2024-11-20 01:31:29.009219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.823 qpair failed and we were unable to recover it. 00:30:20.823 [2024-11-20 01:31:29.009329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.824 [2024-11-20 01:31:29.009458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.824 [2024-11-20 01:31:29.009486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.824 qpair failed and we were unable to recover it. 00:30:20.824 [2024-11-20 01:31:29.009619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.824 [2024-11-20 01:31:29.009712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.824 [2024-11-20 01:31:29.009742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.824 qpair failed and we were unable to recover it. 00:30:20.824 [2024-11-20 01:31:29.009827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.824 [2024-11-20 01:31:29.009944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.824 [2024-11-20 01:31:29.009971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.824 qpair failed and we were unable to recover it. 00:30:20.824 [2024-11-20 01:31:29.010102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.824 [2024-11-20 01:31:29.010205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.824 [2024-11-20 01:31:29.010246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.824 qpair failed and we were unable to recover it. 00:30:20.824 [2024-11-20 01:31:29.010374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.824 [2024-11-20 01:31:29.010458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.824 [2024-11-20 01:31:29.010483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.824 qpair failed and we were unable to recover it. 00:30:20.824 [2024-11-20 01:31:29.010626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.824 [2024-11-20 01:31:29.010755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.824 [2024-11-20 01:31:29.010782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.824 qpair failed and we were unable to recover it. 00:30:20.824 [2024-11-20 01:31:29.010883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.824 [2024-11-20 01:31:29.011001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.824 [2024-11-20 01:31:29.011029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.824 qpair failed and we were unable to recover it. 00:30:20.824 [2024-11-20 01:31:29.011172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.824 [2024-11-20 01:31:29.011294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.824 [2024-11-20 01:31:29.011319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.824 qpair failed and we were unable to recover it. 00:30:20.824 [2024-11-20 01:31:29.011461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.824 [2024-11-20 01:31:29.011549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.824 [2024-11-20 01:31:29.011591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.824 qpair failed and we were unable to recover it. 00:30:20.824 [2024-11-20 01:31:29.011726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.824 [2024-11-20 01:31:29.011875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.824 [2024-11-20 01:31:29.011900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.824 qpair failed and we were unable to recover it. 00:30:20.824 [2024-11-20 01:31:29.012042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.824 [2024-11-20 01:31:29.012212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.824 [2024-11-20 01:31:29.012241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.824 qpair failed and we were unable to recover it. 00:30:20.824 [2024-11-20 01:31:29.012337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.824 [2024-11-20 01:31:29.012494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.824 [2024-11-20 01:31:29.012521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.824 qpair failed and we were unable to recover it. 00:30:20.824 [2024-11-20 01:31:29.012649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.824 [2024-11-20 01:31:29.012766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.824 [2024-11-20 01:31:29.012794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.824 qpair failed and we were unable to recover it. 00:30:20.824 [2024-11-20 01:31:29.012935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.824 [2024-11-20 01:31:29.013039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.824 [2024-11-20 01:31:29.013064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.824 qpair failed and we were unable to recover it. 00:30:20.824 [2024-11-20 01:31:29.013276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.824 [2024-11-20 01:31:29.013366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.824 [2024-11-20 01:31:29.013393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.824 qpair failed and we were unable to recover it. 00:30:20.824 [2024-11-20 01:31:29.013516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.824 [2024-11-20 01:31:29.013682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.824 [2024-11-20 01:31:29.013706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.824 qpair failed and we were unable to recover it. 00:30:20.824 [2024-11-20 01:31:29.013849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.824 [2024-11-20 01:31:29.013956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.824 [2024-11-20 01:31:29.013980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.824 qpair failed and we were unable to recover it. 00:30:20.824 [2024-11-20 01:31:29.014061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.824 [2024-11-20 01:31:29.014156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.824 [2024-11-20 01:31:29.014185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.824 qpair failed and we were unable to recover it. 00:30:20.824 [2024-11-20 01:31:29.014299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.824 [2024-11-20 01:31:29.014456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.824 [2024-11-20 01:31:29.014481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.824 qpair failed and we were unable to recover it. 00:30:20.824 [2024-11-20 01:31:29.014604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.824 [2024-11-20 01:31:29.014690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.824 [2024-11-20 01:31:29.014715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.824 qpair failed and we were unable to recover it. 00:30:20.824 [2024-11-20 01:31:29.014840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.824 [2024-11-20 01:31:29.014959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.824 [2024-11-20 01:31:29.014986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.824 qpair failed and we were unable to recover it. 00:30:20.824 [2024-11-20 01:31:29.015083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.824 [2024-11-20 01:31:29.015175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.824 [2024-11-20 01:31:29.015202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.824 qpair failed and we were unable to recover it. 00:30:20.824 [2024-11-20 01:31:29.015334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.824 [2024-11-20 01:31:29.015433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.824 [2024-11-20 01:31:29.015458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.824 qpair failed and we were unable to recover it. 00:30:20.824 [2024-11-20 01:31:29.015542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.824 [2024-11-20 01:31:29.015637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.824 [2024-11-20 01:31:29.015661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.824 qpair failed and we were unable to recover it. 00:30:20.824 [2024-11-20 01:31:29.015789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.824 [2024-11-20 01:31:29.015914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.824 [2024-11-20 01:31:29.015942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.824 qpair failed and we were unable to recover it. 00:30:20.824 [2024-11-20 01:31:29.016096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.824 [2024-11-20 01:31:29.016233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.824 [2024-11-20 01:31:29.016258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.824 qpair failed and we were unable to recover it. 00:30:20.824 [2024-11-20 01:31:29.016393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.824 [2024-11-20 01:31:29.016546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.824 [2024-11-20 01:31:29.016573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.824 qpair failed and we were unable to recover it. 00:30:20.824 [2024-11-20 01:31:29.016728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.824 [2024-11-20 01:31:29.016856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.824 [2024-11-20 01:31:29.016883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.824 qpair failed and we were unable to recover it. 00:30:20.824 [2024-11-20 01:31:29.017016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.824 [2024-11-20 01:31:29.017101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.824 [2024-11-20 01:31:29.017127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.824 qpair failed and we were unable to recover it. 00:30:20.825 [2024-11-20 01:31:29.017225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.825 [2024-11-20 01:31:29.017352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.825 [2024-11-20 01:31:29.017379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.825 qpair failed and we were unable to recover it. 00:30:20.825 [2024-11-20 01:31:29.017514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.825 [2024-11-20 01:31:29.017604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.825 [2024-11-20 01:31:29.017632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.825 qpair failed and we were unable to recover it. 00:30:20.825 [2024-11-20 01:31:29.017740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.825 [2024-11-20 01:31:29.017884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.825 [2024-11-20 01:31:29.017909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.825 qpair failed and we were unable to recover it. 00:30:20.825 [2024-11-20 01:31:29.018013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.825 [2024-11-20 01:31:29.018139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.825 [2024-11-20 01:31:29.018167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.825 qpair failed and we were unable to recover it. 00:30:20.825 [2024-11-20 01:31:29.018263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.825 [2024-11-20 01:31:29.018382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.825 [2024-11-20 01:31:29.018409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.825 qpair failed and we were unable to recover it. 00:30:20.825 [2024-11-20 01:31:29.018541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.825 [2024-11-20 01:31:29.018653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.825 [2024-11-20 01:31:29.018678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.825 qpair failed and we were unable to recover it. 00:30:20.825 [2024-11-20 01:31:29.018797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.825 [2024-11-20 01:31:29.018921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.825 [2024-11-20 01:31:29.018948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.825 qpair failed and we were unable to recover it. 00:30:20.825 [2024-11-20 01:31:29.019053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.825 [2024-11-20 01:31:29.019184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.825 [2024-11-20 01:31:29.019212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.825 qpair failed and we were unable to recover it. 00:30:20.825 [2024-11-20 01:31:29.019343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.825 [2024-11-20 01:31:29.019473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.825 [2024-11-20 01:31:29.019498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.825 qpair failed and we were unable to recover it. 00:30:20.825 [2024-11-20 01:31:29.019669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.825 [2024-11-20 01:31:29.019761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.825 [2024-11-20 01:31:29.019785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.825 qpair failed and we were unable to recover it. 00:30:20.825 [2024-11-20 01:31:29.019900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.825 [2024-11-20 01:31:29.020037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.825 [2024-11-20 01:31:29.020106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.825 qpair failed and we were unable to recover it. 00:30:20.825 [2024-11-20 01:31:29.020223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.825 [2024-11-20 01:31:29.020344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.825 [2024-11-20 01:31:29.020369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.825 qpair failed and we were unable to recover it. 00:30:20.825 [2024-11-20 01:31:29.020491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.825 [2024-11-20 01:31:29.020576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.825 [2024-11-20 01:31:29.020601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.825 qpair failed and we were unable to recover it. 00:30:20.825 [2024-11-20 01:31:29.020692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.825 [2024-11-20 01:31:29.020811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.825 [2024-11-20 01:31:29.020836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.825 qpair failed and we were unable to recover it. 00:30:20.825 [2024-11-20 01:31:29.020953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.825 [2024-11-20 01:31:29.021047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.825 [2024-11-20 01:31:29.021080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.825 qpair failed and we were unable to recover it. 00:30:20.825 [2024-11-20 01:31:29.021218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.825 [2024-11-20 01:31:29.021357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.825 [2024-11-20 01:31:29.021381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.825 qpair failed and we were unable to recover it. 00:30:20.825 [2024-11-20 01:31:29.021522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.825 [2024-11-20 01:31:29.021612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.825 [2024-11-20 01:31:29.021636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.825 qpair failed and we were unable to recover it. 00:30:20.825 [2024-11-20 01:31:29.021743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.825 [2024-11-20 01:31:29.021856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.825 [2024-11-20 01:31:29.021881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.825 qpair failed and we were unable to recover it. 00:30:20.825 [2024-11-20 01:31:29.021992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.825 [2024-11-20 01:31:29.022156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.825 [2024-11-20 01:31:29.022189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.825 qpair failed and we were unable to recover it. 00:30:20.825 [2024-11-20 01:31:29.022287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.825 [2024-11-20 01:31:29.022398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.825 [2024-11-20 01:31:29.022424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.825 qpair failed and we were unable to recover it. 00:30:20.825 [2024-11-20 01:31:29.022553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.825 [2024-11-20 01:31:29.022694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.825 [2024-11-20 01:31:29.022718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.825 qpair failed and we were unable to recover it. 00:30:20.825 [2024-11-20 01:31:29.022860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.825 [2024-11-20 01:31:29.022955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.825 [2024-11-20 01:31:29.022983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.825 qpair failed and we were unable to recover it. 00:30:20.825 [2024-11-20 01:31:29.023112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.825 [2024-11-20 01:31:29.023224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.825 [2024-11-20 01:31:29.023249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.825 qpair failed and we were unable to recover it. 00:30:20.825 [2024-11-20 01:31:29.023336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.825 [2024-11-20 01:31:29.023451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.825 [2024-11-20 01:31:29.023475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.825 qpair failed and we were unable to recover it. 00:30:20.825 [2024-11-20 01:31:29.023586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.825 [2024-11-20 01:31:29.023676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.825 [2024-11-20 01:31:29.023700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:20.825 qpair failed and we were unable to recover it. 00:30:20.825 [2024-11-20 01:31:29.023816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.138 [2024-11-20 01:31:29.023950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.138 [2024-11-20 01:31:29.023979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.138 qpair failed and we were unable to recover it. 00:30:21.138 [2024-11-20 01:31:29.024100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.138 [2024-11-20 01:31:29.024217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.138 [2024-11-20 01:31:29.024241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.138 qpair failed and we were unable to recover it. 00:30:21.138 [2024-11-20 01:31:29.024358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.138 [2024-11-20 01:31:29.024476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.138 [2024-11-20 01:31:29.024517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.138 qpair failed and we were unable to recover it. 00:30:21.138 [2024-11-20 01:31:29.024647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.138 [2024-11-20 01:31:29.024765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.138 [2024-11-20 01:31:29.024793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.138 qpair failed and we were unable to recover it. 00:30:21.138 [2024-11-20 01:31:29.024937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.138 [2024-11-20 01:31:29.025013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.138 [2024-11-20 01:31:29.025037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.138 qpair failed and we were unable to recover it. 00:30:21.138 [2024-11-20 01:31:29.025189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.138 [2024-11-20 01:31:29.025307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.138 [2024-11-20 01:31:29.025334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.138 qpair failed and we were unable to recover it. 00:30:21.138 [2024-11-20 01:31:29.025426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.138 [2024-11-20 01:31:29.025519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.138 [2024-11-20 01:31:29.025547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.138 qpair failed and we were unable to recover it. 00:30:21.138 [2024-11-20 01:31:29.025690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.139 [2024-11-20 01:31:29.025773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.139 [2024-11-20 01:31:29.025797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.139 qpair failed and we were unable to recover it. 00:30:21.139 [2024-11-20 01:31:29.025877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.139 [2024-11-20 01:31:29.026016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.139 [2024-11-20 01:31:29.026043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.139 qpair failed and we were unable to recover it. 00:30:21.139 [2024-11-20 01:31:29.026203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.139 [2024-11-20 01:31:29.026318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.139 [2024-11-20 01:31:29.026343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.139 qpair failed and we were unable to recover it. 00:30:21.139 [2024-11-20 01:31:29.026508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.139 [2024-11-20 01:31:29.026623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.139 [2024-11-20 01:31:29.026648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.139 qpair failed and we were unable to recover it. 00:30:21.139 [2024-11-20 01:31:29.026737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.139 [2024-11-20 01:31:29.026854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.139 [2024-11-20 01:31:29.026879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.139 qpair failed and we were unable to recover it. 00:30:21.139 [2024-11-20 01:31:29.026988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.139 [2024-11-20 01:31:29.027080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.139 [2024-11-20 01:31:29.027108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.139 qpair failed and we were unable to recover it. 00:30:21.139 [2024-11-20 01:31:29.027251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.139 [2024-11-20 01:31:29.027333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.139 [2024-11-20 01:31:29.027358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.139 qpair failed and we were unable to recover it. 00:30:21.139 [2024-11-20 01:31:29.027513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.139 [2024-11-20 01:31:29.027613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.139 [2024-11-20 01:31:29.027638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.139 qpair failed and we were unable to recover it. 00:30:21.139 [2024-11-20 01:31:29.027791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.139 [2024-11-20 01:31:29.027954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.139 [2024-11-20 01:31:29.027994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.139 qpair failed and we were unable to recover it. 00:30:21.139 [2024-11-20 01:31:29.028105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.139 [2024-11-20 01:31:29.028190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.139 [2024-11-20 01:31:29.028215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.139 qpair failed and we were unable to recover it. 00:30:21.139 [2024-11-20 01:31:29.028344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.139 [2024-11-20 01:31:29.028476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.139 [2024-11-20 01:31:29.028504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.139 qpair failed and we were unable to recover it. 00:30:21.139 [2024-11-20 01:31:29.028655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.139 [2024-11-20 01:31:29.028772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.139 [2024-11-20 01:31:29.028797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.139 qpair failed and we were unable to recover it. 00:30:21.139 [2024-11-20 01:31:29.028917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.139 [2024-11-20 01:31:29.029035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.139 [2024-11-20 01:31:29.029062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.139 qpair failed and we were unable to recover it. 00:30:21.139 [2024-11-20 01:31:29.029190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.139 [2024-11-20 01:31:29.029278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.139 [2024-11-20 01:31:29.029303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.139 qpair failed and we were unable to recover it. 00:30:21.139 [2024-11-20 01:31:29.029386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.139 [2024-11-20 01:31:29.029468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.139 [2024-11-20 01:31:29.029492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.139 qpair failed and we were unable to recover it. 00:30:21.139 [2024-11-20 01:31:29.029702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.139 [2024-11-20 01:31:29.029780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.139 [2024-11-20 01:31:29.029805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.139 qpair failed and we were unable to recover it. 00:30:21.139 [2024-11-20 01:31:29.029929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.139 [2024-11-20 01:31:29.030060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.139 [2024-11-20 01:31:29.030094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.139 qpair failed and we were unable to recover it. 00:30:21.139 [2024-11-20 01:31:29.030193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.139 [2024-11-20 01:31:29.030325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.139 [2024-11-20 01:31:29.030366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.139 qpair failed and we were unable to recover it. 00:30:21.139 [2024-11-20 01:31:29.030476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.139 [2024-11-20 01:31:29.030595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.139 [2024-11-20 01:31:29.030620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.139 qpair failed and we were unable to recover it. 00:30:21.139 [2024-11-20 01:31:29.030778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.139 [2024-11-20 01:31:29.030904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.139 [2024-11-20 01:31:29.030932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.139 qpair failed and we were unable to recover it. 00:30:21.139 [2024-11-20 01:31:29.031062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.139 [2024-11-20 01:31:29.031194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.139 [2024-11-20 01:31:29.031222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.139 qpair failed and we were unable to recover it. 00:30:21.139 [2024-11-20 01:31:29.031352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.139 [2024-11-20 01:31:29.031442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.139 [2024-11-20 01:31:29.031468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.139 qpair failed and we were unable to recover it. 00:30:21.139 [2024-11-20 01:31:29.031627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.139 [2024-11-20 01:31:29.031755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.139 [2024-11-20 01:31:29.031782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.139 qpair failed and we were unable to recover it. 00:30:21.139 [2024-11-20 01:31:29.031878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.139 [2024-11-20 01:31:29.032019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.139 [2024-11-20 01:31:29.032044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.139 qpair failed and we were unable to recover it. 00:30:21.139 [2024-11-20 01:31:29.032174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.139 [2024-11-20 01:31:29.032270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.139 [2024-11-20 01:31:29.032295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.139 qpair failed and we were unable to recover it. 00:30:21.139 [2024-11-20 01:31:29.032431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.139 [2024-11-20 01:31:29.032523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.139 [2024-11-20 01:31:29.032551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.139 qpair failed and we were unable to recover it. 00:30:21.139 [2024-11-20 01:31:29.032701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.139 [2024-11-20 01:31:29.032793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.140 [2024-11-20 01:31:29.032835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.140 qpair failed and we were unable to recover it. 00:30:21.140 [2024-11-20 01:31:29.032951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.140 [2024-11-20 01:31:29.033089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.140 [2024-11-20 01:31:29.033118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.140 qpair failed and we were unable to recover it. 00:30:21.140 [2024-11-20 01:31:29.033237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.140 [2024-11-20 01:31:29.033348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.140 [2024-11-20 01:31:29.033372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.140 qpair failed and we were unable to recover it. 00:30:21.140 [2024-11-20 01:31:29.033485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.140 [2024-11-20 01:31:29.033588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.140 [2024-11-20 01:31:29.033615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.140 qpair failed and we were unable to recover it. 00:30:21.140 [2024-11-20 01:31:29.033779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.140 [2024-11-20 01:31:29.033860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.140 [2024-11-20 01:31:29.033885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.140 qpair failed and we were unable to recover it. 00:30:21.140 [2024-11-20 01:31:29.033989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.140 [2024-11-20 01:31:29.034136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.140 [2024-11-20 01:31:29.034162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.140 qpair failed and we were unable to recover it. 00:30:21.140 [2024-11-20 01:31:29.034279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.140 [2024-11-20 01:31:29.034408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.140 [2024-11-20 01:31:29.034436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.140 qpair failed and we were unable to recover it. 00:30:21.140 [2024-11-20 01:31:29.034579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.140 [2024-11-20 01:31:29.034696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.140 [2024-11-20 01:31:29.034722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.140 qpair failed and we were unable to recover it. 00:30:21.140 [2024-11-20 01:31:29.034810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.140 [2024-11-20 01:31:29.034905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.140 [2024-11-20 01:31:29.034932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.140 qpair failed and we were unable to recover it. 00:30:21.140 [2024-11-20 01:31:29.035064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.140 [2024-11-20 01:31:29.035173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.140 [2024-11-20 01:31:29.035201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.140 qpair failed and we were unable to recover it. 00:30:21.140 [2024-11-20 01:31:29.035313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.140 [2024-11-20 01:31:29.035433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.140 [2024-11-20 01:31:29.035457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.140 qpair failed and we were unable to recover it. 00:30:21.140 [2024-11-20 01:31:29.035543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.140 [2024-11-20 01:31:29.035631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.140 [2024-11-20 01:31:29.035654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.140 qpair failed and we were unable to recover it. 00:30:21.140 [2024-11-20 01:31:29.035740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.140 [2024-11-20 01:31:29.035872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.140 [2024-11-20 01:31:29.035913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.140 qpair failed and we were unable to recover it. 00:30:21.140 [2024-11-20 01:31:29.036063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.140 [2024-11-20 01:31:29.036182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.140 [2024-11-20 01:31:29.036207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.140 qpair failed and we were unable to recover it. 00:30:21.140 [2024-11-20 01:31:29.036322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.140 [2024-11-20 01:31:29.036445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.140 [2024-11-20 01:31:29.036473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.140 qpair failed and we were unable to recover it. 00:30:21.140 [2024-11-20 01:31:29.036615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.140 [2024-11-20 01:31:29.036709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.140 [2024-11-20 01:31:29.036734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.140 qpair failed and we were unable to recover it. 00:30:21.140 [2024-11-20 01:31:29.036849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.140 [2024-11-20 01:31:29.036941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.140 [2024-11-20 01:31:29.036966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.140 qpair failed and we were unable to recover it. 00:30:21.140 [2024-11-20 01:31:29.037094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.140 [2024-11-20 01:31:29.037223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.140 [2024-11-20 01:31:29.037250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.140 qpair failed and we were unable to recover it. 00:30:21.140 [2024-11-20 01:31:29.037347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.140 [2024-11-20 01:31:29.037475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.140 [2024-11-20 01:31:29.037502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.140 qpair failed and we were unable to recover it. 00:30:21.140 [2024-11-20 01:31:29.037668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.140 [2024-11-20 01:31:29.037755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.140 [2024-11-20 01:31:29.037780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.140 qpair failed and we were unable to recover it. 00:30:21.140 [2024-11-20 01:31:29.037918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.140 [2024-11-20 01:31:29.038079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.140 [2024-11-20 01:31:29.038107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.140 qpair failed and we were unable to recover it. 00:30:21.140 [2024-11-20 01:31:29.038210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.140 [2024-11-20 01:31:29.038332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.140 [2024-11-20 01:31:29.038373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.140 qpair failed and we were unable to recover it. 00:30:21.140 [2024-11-20 01:31:29.038492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.140 [2024-11-20 01:31:29.038601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.140 [2024-11-20 01:31:29.038625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.140 qpair failed and we were unable to recover it. 00:30:21.140 [2024-11-20 01:31:29.038787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.140 [2024-11-20 01:31:29.038914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.140 [2024-11-20 01:31:29.038942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.140 qpair failed and we were unable to recover it. 00:30:21.140 [2024-11-20 01:31:29.039077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.140 [2024-11-20 01:31:29.039175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.140 [2024-11-20 01:31:29.039199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.140 qpair failed and we were unable to recover it. 00:30:21.140 [2024-11-20 01:31:29.039309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.140 [2024-11-20 01:31:29.039389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.140 [2024-11-20 01:31:29.039414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.140 qpair failed and we were unable to recover it. 00:30:21.140 [2024-11-20 01:31:29.039511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.140 [2024-11-20 01:31:29.039595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.140 [2024-11-20 01:31:29.039619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.140 qpair failed and we were unable to recover it. 00:30:21.140 [2024-11-20 01:31:29.039737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.140 [2024-11-20 01:31:29.039887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.140 [2024-11-20 01:31:29.039911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.140 qpair failed and we were unable to recover it. 00:30:21.140 [2024-11-20 01:31:29.039999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.140 [2024-11-20 01:31:29.040093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.140 [2024-11-20 01:31:29.040117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.140 qpair failed and we were unable to recover it. 00:30:21.140 [2024-11-20 01:31:29.040212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.140 [2024-11-20 01:31:29.040322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.140 [2024-11-20 01:31:29.040350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.140 qpair failed and we were unable to recover it. 00:30:21.140 [2024-11-20 01:31:29.040472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.141 [2024-11-20 01:31:29.040609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.141 [2024-11-20 01:31:29.040637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.141 qpair failed and we were unable to recover it. 00:30:21.141 [2024-11-20 01:31:29.040779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.141 [2024-11-20 01:31:29.040863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.141 [2024-11-20 01:31:29.040888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.141 qpair failed and we were unable to recover it. 00:30:21.141 [2024-11-20 01:31:29.041065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.141 [2024-11-20 01:31:29.041216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.141 [2024-11-20 01:31:29.041241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.141 qpair failed and we were unable to recover it. 00:30:21.141 [2024-11-20 01:31:29.041349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.141 [2024-11-20 01:31:29.041456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.141 [2024-11-20 01:31:29.041481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.141 qpair failed and we were unable to recover it. 00:30:21.141 [2024-11-20 01:31:29.041571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.141 [2024-11-20 01:31:29.041663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.141 [2024-11-20 01:31:29.041689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.141 qpair failed and we were unable to recover it. 00:30:21.141 [2024-11-20 01:31:29.041801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.141 [2024-11-20 01:31:29.041943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.141 [2024-11-20 01:31:29.041968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.141 qpair failed and we were unable to recover it. 00:30:21.141 [2024-11-20 01:31:29.042084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.141 [2024-11-20 01:31:29.042186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.141 [2024-11-20 01:31:29.042214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.141 qpair failed and we were unable to recover it. 00:30:21.141 [2024-11-20 01:31:29.042343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.141 [2024-11-20 01:31:29.042452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.141 [2024-11-20 01:31:29.042477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.141 qpair failed and we were unable to recover it. 00:30:21.141 [2024-11-20 01:31:29.042567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.141 [2024-11-20 01:31:29.042679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.141 [2024-11-20 01:31:29.042703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.141 qpair failed and we were unable to recover it. 00:30:21.141 [2024-11-20 01:31:29.042796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.141 [2024-11-20 01:31:29.042924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.141 [2024-11-20 01:31:29.042950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.141 qpair failed and we were unable to recover it. 00:30:21.141 [2024-11-20 01:31:29.043066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.141 [2024-11-20 01:31:29.043214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.141 [2024-11-20 01:31:29.043239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.141 qpair failed and we were unable to recover it. 00:30:21.141 [2024-11-20 01:31:29.043341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.141 [2024-11-20 01:31:29.043443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.141 [2024-11-20 01:31:29.043469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.141 qpair failed and we were unable to recover it. 00:30:21.141 [2024-11-20 01:31:29.043608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.141 [2024-11-20 01:31:29.043717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.141 [2024-11-20 01:31:29.043744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.141 qpair failed and we were unable to recover it. 00:30:21.141 [2024-11-20 01:31:29.043877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.141 [2024-11-20 01:31:29.043990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.141 [2024-11-20 01:31:29.044015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.141 qpair failed and we were unable to recover it. 00:30:21.141 [2024-11-20 01:31:29.044100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.141 [2024-11-20 01:31:29.044260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.141 [2024-11-20 01:31:29.044288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.141 qpair failed and we were unable to recover it. 00:30:21.141 [2024-11-20 01:31:29.044413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.141 [2024-11-20 01:31:29.044549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.141 [2024-11-20 01:31:29.044574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.141 qpair failed and we were unable to recover it. 00:30:21.141 [2024-11-20 01:31:29.044669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.141 [2024-11-20 01:31:29.044761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.141 [2024-11-20 01:31:29.044787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.141 qpair failed and we were unable to recover it. 00:30:21.141 [2024-11-20 01:31:29.044891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.141 [2024-11-20 01:31:29.044992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.141 [2024-11-20 01:31:29.045018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.141 qpair failed and we were unable to recover it. 00:30:21.141 [2024-11-20 01:31:29.045191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.141 [2024-11-20 01:31:29.045275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.141 [2024-11-20 01:31:29.045300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.141 qpair failed and we were unable to recover it. 00:30:21.141 [2024-11-20 01:31:29.045446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.141 [2024-11-20 01:31:29.045540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.141 [2024-11-20 01:31:29.045565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.141 qpair failed and we were unable to recover it. 00:30:21.141 [2024-11-20 01:31:29.045700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.141 [2024-11-20 01:31:29.045826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.141 [2024-11-20 01:31:29.045852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.141 qpair failed and we were unable to recover it. 00:30:21.141 [2024-11-20 01:31:29.045983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.141 [2024-11-20 01:31:29.046108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.141 [2024-11-20 01:31:29.046152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.141 qpair failed and we were unable to recover it. 00:30:21.141 [2024-11-20 01:31:29.046270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.141 [2024-11-20 01:31:29.046357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.141 [2024-11-20 01:31:29.046386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.141 qpair failed and we were unable to recover it. 00:30:21.141 [2024-11-20 01:31:29.046504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.141 [2024-11-20 01:31:29.046581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.141 [2024-11-20 01:31:29.046606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.141 qpair failed and we were unable to recover it. 00:30:21.141 [2024-11-20 01:31:29.046717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.141 [2024-11-20 01:31:29.046846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.141 [2024-11-20 01:31:29.046873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.141 qpair failed and we were unable to recover it. 00:30:21.141 [2024-11-20 01:31:29.047014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.141 [2024-11-20 01:31:29.047106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.141 [2024-11-20 01:31:29.047131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.141 qpair failed and we were unable to recover it. 00:30:21.141 [2024-11-20 01:31:29.047242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.141 [2024-11-20 01:31:29.047352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.141 [2024-11-20 01:31:29.047379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.141 qpair failed and we were unable to recover it. 00:30:21.141 [2024-11-20 01:31:29.047500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.141 [2024-11-20 01:31:29.047667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.141 [2024-11-20 01:31:29.047694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.141 qpair failed and we were unable to recover it. 00:30:21.141 [2024-11-20 01:31:29.047859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.141 [2024-11-20 01:31:29.047967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.141 [2024-11-20 01:31:29.047991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.141 qpair failed and we were unable to recover it. 00:30:21.142 [2024-11-20 01:31:29.048127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.048222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.048249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.142 qpair failed and we were unable to recover it. 00:30:21.142 [2024-11-20 01:31:29.048377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.048529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.048556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.142 qpair failed and we were unable to recover it. 00:30:21.142 [2024-11-20 01:31:29.048691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.048807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.048832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.142 qpair failed and we were unable to recover it. 00:30:21.142 [2024-11-20 01:31:29.048945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.049098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.049126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.142 qpair failed and we were unable to recover it. 00:30:21.142 [2024-11-20 01:31:29.049305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.049420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.049445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.142 qpair failed and we were unable to recover it. 00:30:21.142 [2024-11-20 01:31:29.049565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.049677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.049702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.142 qpair failed and we were unable to recover it. 00:30:21.142 [2024-11-20 01:31:29.049844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.049926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.049951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.142 qpair failed and we were unable to recover it. 00:30:21.142 [2024-11-20 01:31:29.050034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.050157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.050182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.142 qpair failed and we were unable to recover it. 00:30:21.142 [2024-11-20 01:31:29.050268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.050382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.050406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.142 qpair failed and we were unable to recover it. 00:30:21.142 [2024-11-20 01:31:29.050497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.050633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.050658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.142 qpair failed and we were unable to recover it. 00:30:21.142 [2024-11-20 01:31:29.050740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.050828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.050852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.142 qpair failed and we were unable to recover it. 00:30:21.142 [2024-11-20 01:31:29.050962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.051104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.051130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.142 qpair failed and we were unable to recover it. 00:30:21.142 [2024-11-20 01:31:29.051264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.051368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.051409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.142 qpair failed and we were unable to recover it. 00:30:21.142 [2024-11-20 01:31:29.051528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.051618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.051643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.142 qpair failed and we were unable to recover it. 00:30:21.142 [2024-11-20 01:31:29.051761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.051875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.051899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.142 qpair failed and we were unable to recover it. 00:30:21.142 [2024-11-20 01:31:29.051984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.052094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.052136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.142 qpair failed and we were unable to recover it. 00:30:21.142 [2024-11-20 01:31:29.052233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.052358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.052385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.142 qpair failed and we were unable to recover it. 00:30:21.142 [2024-11-20 01:31:29.052525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.052609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.052633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.142 qpair failed and we were unable to recover it. 00:30:21.142 [2024-11-20 01:31:29.052747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.052870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.052894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.142 qpair failed and we were unable to recover it. 00:30:21.142 [2024-11-20 01:31:29.053004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.053168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.053196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.142 qpair failed and we were unable to recover it. 00:30:21.142 [2024-11-20 01:31:29.053329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.053414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.053439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.142 qpair failed and we were unable to recover it. 00:30:21.142 [2024-11-20 01:31:29.053526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.053643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.053667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.142 qpair failed and we were unable to recover it. 00:30:21.142 [2024-11-20 01:31:29.053788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.053879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.053903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.142 qpair failed and we were unable to recover it. 00:30:21.142 [2024-11-20 01:31:29.053989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.054107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.054132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.142 qpair failed and we were unable to recover it. 00:30:21.142 [2024-11-20 01:31:29.054265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.054472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.054499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.142 qpair failed and we were unable to recover it. 00:30:21.142 [2024-11-20 01:31:29.054659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.054776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.054804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.142 qpair failed and we were unable to recover it. 00:30:21.142 [2024-11-20 01:31:29.054969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.055086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.055112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.142 qpair failed and we were unable to recover it. 00:30:21.142 [2024-11-20 01:31:29.055308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.055428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.055453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.142 qpair failed and we were unable to recover it. 00:30:21.142 [2024-11-20 01:31:29.055565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.055731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.055759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.142 qpair failed and we were unable to recover it. 00:30:21.142 [2024-11-20 01:31:29.055894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.055979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.056003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.142 qpair failed and we were unable to recover it. 00:30:21.142 [2024-11-20 01:31:29.056095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.056209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.056234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.142 qpair failed and we were unable to recover it. 00:30:21.142 [2024-11-20 01:31:29.056318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.056428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.142 [2024-11-20 01:31:29.056455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.142 qpair failed and we were unable to recover it. 00:30:21.143 [2024-11-20 01:31:29.056563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.143 [2024-11-20 01:31:29.056679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.143 [2024-11-20 01:31:29.056703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.143 qpair failed and we were unable to recover it. 00:30:21.143 [2024-11-20 01:31:29.056841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.143 [2024-11-20 01:31:29.056935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.143 [2024-11-20 01:31:29.056963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.143 qpair failed and we were unable to recover it. 00:30:21.143 [2024-11-20 01:31:29.057079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.143 [2024-11-20 01:31:29.057203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.143 [2024-11-20 01:31:29.057227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.143 qpair failed and we were unable to recover it. 00:30:21.143 [2024-11-20 01:31:29.057350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.143 [2024-11-20 01:31:29.057434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.143 [2024-11-20 01:31:29.057460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.143 qpair failed and we were unable to recover it. 00:30:21.143 [2024-11-20 01:31:29.057549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.143 [2024-11-20 01:31:29.057658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.143 [2024-11-20 01:31:29.057682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.143 qpair failed and we were unable to recover it. 00:30:21.143 [2024-11-20 01:31:29.057797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.143 [2024-11-20 01:31:29.057951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.143 [2024-11-20 01:31:29.057976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.143 qpair failed and we were unable to recover it. 00:30:21.143 [2024-11-20 01:31:29.058106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.143 [2024-11-20 01:31:29.058191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.143 [2024-11-20 01:31:29.058216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.143 qpair failed and we were unable to recover it. 00:30:21.143 [2024-11-20 01:31:29.058322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.143 [2024-11-20 01:31:29.058445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.143 [2024-11-20 01:31:29.058472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.143 qpair failed and we were unable to recover it. 00:30:21.143 [2024-11-20 01:31:29.058574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.143 [2024-11-20 01:31:29.058676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.143 [2024-11-20 01:31:29.058702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.143 qpair failed and we were unable to recover it. 00:30:21.143 [2024-11-20 01:31:29.058832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.143 [2024-11-20 01:31:29.058913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.143 [2024-11-20 01:31:29.058937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.143 qpair failed and we were unable to recover it. 00:30:21.143 [2024-11-20 01:31:29.059081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.143 [2024-11-20 01:31:29.059201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.143 [2024-11-20 01:31:29.059225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.143 qpair failed and we were unable to recover it. 00:30:21.143 [2024-11-20 01:31:29.059336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.143 [2024-11-20 01:31:29.059439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.143 [2024-11-20 01:31:29.059466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.143 qpair failed and we were unable to recover it. 00:30:21.143 [2024-11-20 01:31:29.059607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.143 [2024-11-20 01:31:29.059695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.143 [2024-11-20 01:31:29.059724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.143 qpair failed and we were unable to recover it. 00:30:21.143 [2024-11-20 01:31:29.059841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.143 [2024-11-20 01:31:29.059961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.143 [2024-11-20 01:31:29.059988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.143 qpair failed and we were unable to recover it. 00:30:21.143 [2024-11-20 01:31:29.060093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.143 [2024-11-20 01:31:29.060198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.143 [2024-11-20 01:31:29.060223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.143 qpair failed and we were unable to recover it. 00:30:21.143 [2024-11-20 01:31:29.060316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.143 [2024-11-20 01:31:29.060429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.143 [2024-11-20 01:31:29.060455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.143 qpair failed and we were unable to recover it. 00:30:21.143 [2024-11-20 01:31:29.060577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.143 [2024-11-20 01:31:29.060681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.143 [2024-11-20 01:31:29.060709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.143 qpair failed and we were unable to recover it. 00:30:21.143 [2024-11-20 01:31:29.060831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.143 [2024-11-20 01:31:29.060931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.143 [2024-11-20 01:31:29.060959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.143 qpair failed and we were unable to recover it. 00:30:21.143 [2024-11-20 01:31:29.061109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.143 [2024-11-20 01:31:29.061206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.143 [2024-11-20 01:31:29.061230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.143 qpair failed and we were unable to recover it. 00:30:21.143 [2024-11-20 01:31:29.061357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.143 [2024-11-20 01:31:29.061493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.143 [2024-11-20 01:31:29.061521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.143 qpair failed and we were unable to recover it. 00:30:21.143 [2024-11-20 01:31:29.061625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.143 [2024-11-20 01:31:29.061778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.143 [2024-11-20 01:31:29.061806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.143 qpair failed and we were unable to recover it. 00:30:21.143 [2024-11-20 01:31:29.061946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.143 [2024-11-20 01:31:29.062066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.143 [2024-11-20 01:31:29.062098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.143 qpair failed and we were unable to recover it. 00:30:21.143 [2024-11-20 01:31:29.062196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.143 [2024-11-20 01:31:29.062283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.143 [2024-11-20 01:31:29.062308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.143 qpair failed and we were unable to recover it. 00:30:21.143 [2024-11-20 01:31:29.062480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.143 [2024-11-20 01:31:29.062587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.143 [2024-11-20 01:31:29.062615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.143 qpair failed and we were unable to recover it. 00:30:21.143 [2024-11-20 01:31:29.062735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.143 [2024-11-20 01:31:29.062850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.143 [2024-11-20 01:31:29.062875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.143 qpair failed and we were unable to recover it. 00:30:21.143 [2024-11-20 01:31:29.063008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.143 [2024-11-20 01:31:29.063134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.143 [2024-11-20 01:31:29.063162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.143 qpair failed and we were unable to recover it. 00:30:21.143 [2024-11-20 01:31:29.063311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.143 [2024-11-20 01:31:29.063421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.143 [2024-11-20 01:31:29.063446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.144 qpair failed and we were unable to recover it. 00:30:21.144 [2024-11-20 01:31:29.063529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.063634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.063659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.144 qpair failed and we were unable to recover it. 00:30:21.144 [2024-11-20 01:31:29.063735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.063825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.063849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.144 qpair failed and we were unable to recover it. 00:30:21.144 [2024-11-20 01:31:29.063964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.064064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.064098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.144 qpair failed and we were unable to recover it. 00:30:21.144 [2024-11-20 01:31:29.064207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.064288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.064313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.144 qpair failed and we were unable to recover it. 00:30:21.144 [2024-11-20 01:31:29.064434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.064514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.064538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.144 qpair failed and we were unable to recover it. 00:30:21.144 [2024-11-20 01:31:29.064626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.064765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.064793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.144 qpair failed and we were unable to recover it. 00:30:21.144 [2024-11-20 01:31:29.064959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.065090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.065119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.144 qpair failed and we were unable to recover it. 00:30:21.144 [2024-11-20 01:31:29.065284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.065391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.065431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.144 qpair failed and we were unable to recover it. 00:30:21.144 [2024-11-20 01:31:29.065559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.065661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.065689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.144 qpair failed and we were unable to recover it. 00:30:21.144 [2024-11-20 01:31:29.065784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.065900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.065928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.144 qpair failed and we were unable to recover it. 00:30:21.144 [2024-11-20 01:31:29.066051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.066173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.066198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.144 qpair failed and we were unable to recover it. 00:30:21.144 [2024-11-20 01:31:29.066292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.066410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.066437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.144 qpair failed and we were unable to recover it. 00:30:21.144 [2024-11-20 01:31:29.066555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.066682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.066707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.144 qpair failed and we were unable to recover it. 00:30:21.144 [2024-11-20 01:31:29.066792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.066903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.066931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.144 qpair failed and we were unable to recover it. 00:30:21.144 [2024-11-20 01:31:29.067060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.067214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.067240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.144 qpair failed and we were unable to recover it. 00:30:21.144 [2024-11-20 01:31:29.067326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.067444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.067469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.144 qpair failed and we were unable to recover it. 00:30:21.144 [2024-11-20 01:31:29.067601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.067732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.067760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.144 qpair failed and we were unable to recover it. 00:30:21.144 [2024-11-20 01:31:29.067886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.068008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.068036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.144 qpair failed and we were unable to recover it. 00:30:21.144 [2024-11-20 01:31:29.068150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.068245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.068271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.144 qpair failed and we were unable to recover it. 00:30:21.144 [2024-11-20 01:31:29.068393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.068508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.068534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.144 qpair failed and we were unable to recover it. 00:30:21.144 [2024-11-20 01:31:29.068643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.068719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.068744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.144 qpair failed and we were unable to recover it. 00:30:21.144 [2024-11-20 01:31:29.068857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.068976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.069000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.144 qpair failed and we were unable to recover it. 00:30:21.144 [2024-11-20 01:31:29.069119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.069246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.069271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.144 qpair failed and we were unable to recover it. 00:30:21.144 [2024-11-20 01:31:29.069380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.069516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.069545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.144 qpair failed and we were unable to recover it. 00:30:21.144 [2024-11-20 01:31:29.069704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.069831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.069859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.144 qpair failed and we were unable to recover it. 00:30:21.144 [2024-11-20 01:31:29.069976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.070117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.070143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.144 qpair failed and we were unable to recover it. 00:30:21.144 [2024-11-20 01:31:29.070233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.070322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.070351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.144 qpair failed and we were unable to recover it. 00:30:21.144 [2024-11-20 01:31:29.070448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.070548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.070575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.144 qpair failed and we were unable to recover it. 00:30:21.144 [2024-11-20 01:31:29.070683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.070761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.070785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.144 qpair failed and we were unable to recover it. 00:30:21.144 [2024-11-20 01:31:29.070868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.070990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.144 [2024-11-20 01:31:29.071018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.144 qpair failed and we were unable to recover it. 00:30:21.145 [2024-11-20 01:31:29.071127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.145 [2024-11-20 01:31:29.071241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.145 [2024-11-20 01:31:29.071266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.145 qpair failed and we were unable to recover it. 00:30:21.145 [2024-11-20 01:31:29.071351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.145 [2024-11-20 01:31:29.071463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.145 [2024-11-20 01:31:29.071488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.145 qpair failed and we were unable to recover it. 00:30:21.145 [2024-11-20 01:31:29.071617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.145 [2024-11-20 01:31:29.071724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.145 [2024-11-20 01:31:29.071753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.145 qpair failed and we were unable to recover it. 00:30:21.145 [2024-11-20 01:31:29.071878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.145 [2024-11-20 01:31:29.071996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.145 [2024-11-20 01:31:29.072024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.145 qpair failed and we were unable to recover it. 00:30:21.145 [2024-11-20 01:31:29.072201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.145 [2024-11-20 01:31:29.072319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.145 [2024-11-20 01:31:29.072344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.145 qpair failed and we were unable to recover it. 00:30:21.145 [2024-11-20 01:31:29.072491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.145 [2024-11-20 01:31:29.072625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.145 [2024-11-20 01:31:29.072650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.145 qpair failed and we were unable to recover it. 00:30:21.145 [2024-11-20 01:31:29.072773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.145 [2024-11-20 01:31:29.072863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.145 [2024-11-20 01:31:29.072888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.145 qpair failed and we were unable to recover it. 00:30:21.145 [2024-11-20 01:31:29.073017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.145 [2024-11-20 01:31:29.073153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.145 [2024-11-20 01:31:29.073179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.145 qpair failed and we were unable to recover it. 00:30:21.145 [2024-11-20 01:31:29.073279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.145 [2024-11-20 01:31:29.073399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.145 [2024-11-20 01:31:29.073440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.145 qpair failed and we were unable to recover it. 00:30:21.145 [2024-11-20 01:31:29.073552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.145 [2024-11-20 01:31:29.073687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.145 [2024-11-20 01:31:29.073712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.145 qpair failed and we were unable to recover it. 00:30:21.145 [2024-11-20 01:31:29.073799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.145 [2024-11-20 01:31:29.073886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.145 [2024-11-20 01:31:29.073911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.145 qpair failed and we were unable to recover it. 00:30:21.145 [2024-11-20 01:31:29.074022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.145 [2024-11-20 01:31:29.074137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.145 [2024-11-20 01:31:29.074163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.145 qpair failed and we were unable to recover it. 00:30:21.145 [2024-11-20 01:31:29.074261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.145 [2024-11-20 01:31:29.074387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.145 [2024-11-20 01:31:29.074415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.145 qpair failed and we were unable to recover it. 00:30:21.145 [2024-11-20 01:31:29.074567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.145 [2024-11-20 01:31:29.074674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.145 [2024-11-20 01:31:29.074699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.145 qpair failed and we were unable to recover it. 00:30:21.145 [2024-11-20 01:31:29.074815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.145 [2024-11-20 01:31:29.074899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.145 [2024-11-20 01:31:29.074924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.145 qpair failed and we were unable to recover it. 00:30:21.145 [2024-11-20 01:31:29.075006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.145 [2024-11-20 01:31:29.075104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.145 [2024-11-20 01:31:29.075130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.145 qpair failed and we were unable to recover it. 00:30:21.145 [2024-11-20 01:31:29.075228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.145 [2024-11-20 01:31:29.075305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.145 [2024-11-20 01:31:29.075329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.145 qpair failed and we were unable to recover it. 00:30:21.145 [2024-11-20 01:31:29.075463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.145 [2024-11-20 01:31:29.075558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.145 [2024-11-20 01:31:29.075586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.145 qpair failed and we were unable to recover it. 00:30:21.145 [2024-11-20 01:31:29.075687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.145 [2024-11-20 01:31:29.075855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.145 [2024-11-20 01:31:29.075881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.145 qpair failed and we were unable to recover it. 00:30:21.145 [2024-11-20 01:31:29.075975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.145 [2024-11-20 01:31:29.076092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.145 [2024-11-20 01:31:29.076118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.145 qpair failed and we were unable to recover it. 00:30:21.145 [2024-11-20 01:31:29.076262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.145 [2024-11-20 01:31:29.076397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.145 [2024-11-20 01:31:29.076422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.145 qpair failed and we were unable to recover it. 00:30:21.145 [2024-11-20 01:31:29.076509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.145 [2024-11-20 01:31:29.076610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.145 [2024-11-20 01:31:29.076637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.145 qpair failed and we were unable to recover it. 00:30:21.145 [2024-11-20 01:31:29.076799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.145 [2024-11-20 01:31:29.076886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.145 [2024-11-20 01:31:29.076912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.145 qpair failed and we were unable to recover it. 00:30:21.145 [2024-11-20 01:31:29.077045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.145 [2024-11-20 01:31:29.077171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.145 [2024-11-20 01:31:29.077196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.145 qpair failed and we were unable to recover it. 00:30:21.145 [2024-11-20 01:31:29.077318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.145 [2024-11-20 01:31:29.077414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.145 [2024-11-20 01:31:29.077445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.145 qpair failed and we were unable to recover it. 00:30:21.145 [2024-11-20 01:31:29.077534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.145 [2024-11-20 01:31:29.077645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.145 [2024-11-20 01:31:29.077670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.145 qpair failed and we were unable to recover it. 00:30:21.145 [2024-11-20 01:31:29.077765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.145 [2024-11-20 01:31:29.077878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.145 [2024-11-20 01:31:29.077902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.145 qpair failed and we were unable to recover it. 00:30:21.145 [2024-11-20 01:31:29.078024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.145 [2024-11-20 01:31:29.078204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.145 [2024-11-20 01:31:29.078234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.145 qpair failed and we were unable to recover it. 00:30:21.146 [2024-11-20 01:31:29.078333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.078436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.078462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.146 qpair failed and we were unable to recover it. 00:30:21.146 [2024-11-20 01:31:29.078555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.078647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.078672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.146 qpair failed and we were unable to recover it. 00:30:21.146 [2024-11-20 01:31:29.078760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.078902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.078930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.146 qpair failed and we were unable to recover it. 00:30:21.146 [2024-11-20 01:31:29.079039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.079145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.079173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.146 qpair failed and we were unable to recover it. 00:30:21.146 [2024-11-20 01:31:29.079303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.079444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.079477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.146 qpair failed and we were unable to recover it. 00:30:21.146 [2024-11-20 01:31:29.079593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.079729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.079757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.146 qpair failed and we were unable to recover it. 00:30:21.146 [2024-11-20 01:31:29.079867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.079986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.080011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.146 qpair failed and we were unable to recover it. 00:30:21.146 [2024-11-20 01:31:29.080103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.080199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.080224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.146 qpair failed and we were unable to recover it. 00:30:21.146 [2024-11-20 01:31:29.080344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.080435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.080479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.146 qpair failed and we were unable to recover it. 00:30:21.146 [2024-11-20 01:31:29.080615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.080737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.080763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.146 qpair failed and we were unable to recover it. 00:30:21.146 [2024-11-20 01:31:29.080901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.080997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.081025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.146 qpair failed and we were unable to recover it. 00:30:21.146 [2024-11-20 01:31:29.081155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.081248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.081273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.146 qpair failed and we were unable to recover it. 00:30:21.146 [2024-11-20 01:31:29.081365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.081475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.081500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.146 qpair failed and we were unable to recover it. 00:30:21.146 [2024-11-20 01:31:29.081598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.081737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.081766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.146 qpair failed and we were unable to recover it. 00:30:21.146 [2024-11-20 01:31:29.081899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.082030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.082058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.146 qpair failed and we were unable to recover it. 00:30:21.146 [2024-11-20 01:31:29.082187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.082314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.082340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.146 qpair failed and we were unable to recover it. 00:30:21.146 [2024-11-20 01:31:29.082427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.082567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.082595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.146 qpair failed and we were unable to recover it. 00:30:21.146 [2024-11-20 01:31:29.082726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.082821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.082849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.146 qpair failed and we were unable to recover it. 00:30:21.146 [2024-11-20 01:31:29.082980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.083102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.083130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.146 qpair failed and we were unable to recover it. 00:30:21.146 [2024-11-20 01:31:29.083228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.083318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.083344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.146 qpair failed and we were unable to recover it. 00:30:21.146 [2024-11-20 01:31:29.083471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.083603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.083631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.146 qpair failed and we were unable to recover it. 00:30:21.146 [2024-11-20 01:31:29.083737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.083849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.083874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.146 qpair failed and we were unable to recover it. 00:30:21.146 [2024-11-20 01:31:29.083973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.084090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.084116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.146 qpair failed and we were unable to recover it. 00:30:21.146 [2024-11-20 01:31:29.084204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.084300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.084325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.146 qpair failed and we were unable to recover it. 00:30:21.146 [2024-11-20 01:31:29.084449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.084537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.084563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.146 qpair failed and we were unable to recover it. 00:30:21.146 [2024-11-20 01:31:29.084646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.084760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.084785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.146 qpair failed and we were unable to recover it. 00:30:21.146 [2024-11-20 01:31:29.084893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.084986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.085030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.146 qpair failed and we were unable to recover it. 00:30:21.146 [2024-11-20 01:31:29.085138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.085220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.085251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.146 qpair failed and we were unable to recover it. 00:30:21.146 [2024-11-20 01:31:29.085345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.085429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.085454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.146 qpair failed and we were unable to recover it. 00:30:21.146 [2024-11-20 01:31:29.085554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.085670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.085713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.146 qpair failed and we were unable to recover it. 00:30:21.146 [2024-11-20 01:31:29.085838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.085929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.085954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.146 qpair failed and we were unable to recover it. 00:30:21.146 [2024-11-20 01:31:29.086077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.086242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.086268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.146 qpair failed and we were unable to recover it. 00:30:21.146 [2024-11-20 01:31:29.086364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.086494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.086522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.146 qpair failed and we were unable to recover it. 00:30:21.146 [2024-11-20 01:31:29.086664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.086759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.086784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.146 qpair failed and we were unable to recover it. 00:30:21.146 [2024-11-20 01:31:29.086874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.086963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.086989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.146 qpair failed and we were unable to recover it. 00:30:21.146 [2024-11-20 01:31:29.087145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.087254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.087282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.146 qpair failed and we were unable to recover it. 00:30:21.146 [2024-11-20 01:31:29.087405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.087525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.087551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.146 qpair failed and we were unable to recover it. 00:30:21.146 [2024-11-20 01:31:29.087700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.087819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.087844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.146 qpair failed and we were unable to recover it. 00:30:21.146 [2024-11-20 01:31:29.087976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.088089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.088133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.146 qpair failed and we were unable to recover it. 00:30:21.146 [2024-11-20 01:31:29.088228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.088309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.088340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.146 qpair failed and we were unable to recover it. 00:30:21.146 [2024-11-20 01:31:29.088447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.088539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.088581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.146 qpair failed and we were unable to recover it. 00:30:21.146 [2024-11-20 01:31:29.088680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.088781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.088808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.146 qpair failed and we were unable to recover it. 00:30:21.146 [2024-11-20 01:31:29.088915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.089006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.089030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.146 qpair failed and we were unable to recover it. 00:30:21.146 [2024-11-20 01:31:29.089127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.089211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.089236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.146 qpair failed and we were unable to recover it. 00:30:21.146 [2024-11-20 01:31:29.089328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.089475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.146 [2024-11-20 01:31:29.089502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.146 qpair failed and we were unable to recover it. 00:30:21.146 [2024-11-20 01:31:29.089640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.089734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.089759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.147 qpair failed and we were unable to recover it. 00:30:21.147 [2024-11-20 01:31:29.089844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.089935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.089960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.147 qpair failed and we were unable to recover it. 00:30:21.147 [2024-11-20 01:31:29.090094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.090195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.090219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.147 qpair failed and we were unable to recover it. 00:30:21.147 [2024-11-20 01:31:29.090309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.090403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.090428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.147 qpair failed and we were unable to recover it. 00:30:21.147 [2024-11-20 01:31:29.090544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.090656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.090686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.147 qpair failed and we were unable to recover it. 00:30:21.147 [2024-11-20 01:31:29.090787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.090875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.090903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.147 qpair failed and we were unable to recover it. 00:30:21.147 [2024-11-20 01:31:29.091028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.091130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.091156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.147 qpair failed and we were unable to recover it. 00:30:21.147 [2024-11-20 01:31:29.091250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.091344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.091368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.147 qpair failed and we were unable to recover it. 00:30:21.147 [2024-11-20 01:31:29.091488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.091602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.091644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.147 qpair failed and we were unable to recover it. 00:30:21.147 [2024-11-20 01:31:29.091779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.091863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.091888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.147 qpair failed and we were unable to recover it. 00:30:21.147 [2024-11-20 01:31:29.092015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.092138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.092164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.147 qpair failed and we were unable to recover it. 00:30:21.147 [2024-11-20 01:31:29.092259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.092346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.092377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.147 qpair failed and we were unable to recover it. 00:30:21.147 [2024-11-20 01:31:29.092469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.092581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.092605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.147 qpair failed and we were unable to recover it. 00:30:21.147 [2024-11-20 01:31:29.092687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.092809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.092836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.147 qpair failed and we were unable to recover it. 00:30:21.147 [2024-11-20 01:31:29.092967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.093087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.093117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.147 qpair failed and we were unable to recover it. 00:30:21.147 [2024-11-20 01:31:29.093229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.093327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.093352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.147 qpair failed and we were unable to recover it. 00:30:21.147 [2024-11-20 01:31:29.093454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.093569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.093595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.147 qpair failed and we were unable to recover it. 00:30:21.147 [2024-11-20 01:31:29.093745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.093873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.093902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.147 qpair failed and we were unable to recover it. 00:30:21.147 [2024-11-20 01:31:29.094010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.094103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.094130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.147 qpair failed and we were unable to recover it. 00:30:21.147 [2024-11-20 01:31:29.094223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.094319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.094343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.147 qpair failed and we were unable to recover it. 00:30:21.147 [2024-11-20 01:31:29.094435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.094550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.094576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.147 qpair failed and we were unable to recover it. 00:30:21.147 [2024-11-20 01:31:29.094670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.094756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.094782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.147 qpair failed and we were unable to recover it. 00:30:21.147 [2024-11-20 01:31:29.094868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.094982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.095007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.147 qpair failed and we were unable to recover it. 00:30:21.147 [2024-11-20 01:31:29.095111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.095206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.095232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.147 qpair failed and we were unable to recover it. 00:30:21.147 [2024-11-20 01:31:29.095334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.095481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.095506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.147 qpair failed and we were unable to recover it. 00:30:21.147 [2024-11-20 01:31:29.095615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.095703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.095728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.147 qpair failed and we were unable to recover it. 00:30:21.147 [2024-11-20 01:31:29.095822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.095941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.095966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.147 qpair failed and we were unable to recover it. 00:30:21.147 [2024-11-20 01:31:29.096066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.096164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.096189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.147 qpair failed and we were unable to recover it. 00:30:21.147 [2024-11-20 01:31:29.096298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.096420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.096446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.147 qpair failed and we were unable to recover it. 00:30:21.147 [2024-11-20 01:31:29.096533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.096652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.096678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.147 qpair failed and we were unable to recover it. 00:30:21.147 [2024-11-20 01:31:29.096792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.096880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.096904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.147 qpair failed and we were unable to recover it. 00:30:21.147 [2024-11-20 01:31:29.097020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.097133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.097158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.147 qpair failed and we were unable to recover it. 00:30:21.147 [2024-11-20 01:31:29.097244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.097326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.097363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.147 qpair failed and we were unable to recover it. 00:30:21.147 [2024-11-20 01:31:29.097497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.097650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.097675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.147 qpair failed and we were unable to recover it. 00:30:21.147 [2024-11-20 01:31:29.097799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.097883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.097908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.147 qpair failed and we were unable to recover it. 00:30:21.147 [2024-11-20 01:31:29.098057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.098152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.098177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.147 qpair failed and we were unable to recover it. 00:30:21.147 [2024-11-20 01:31:29.098280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.098374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.098399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.147 qpair failed and we were unable to recover it. 00:30:21.147 [2024-11-20 01:31:29.098547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.098675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.098700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.147 qpair failed and we were unable to recover it. 00:30:21.147 [2024-11-20 01:31:29.098794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.098919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.098944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.147 qpair failed and we were unable to recover it. 00:30:21.147 [2024-11-20 01:31:29.099061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.099184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.099209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.147 qpair failed and we were unable to recover it. 00:30:21.147 [2024-11-20 01:31:29.099327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.099485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.099510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.147 qpair failed and we were unable to recover it. 00:30:21.147 [2024-11-20 01:31:29.099595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.099711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.099735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.147 qpair failed and we were unable to recover it. 00:30:21.147 [2024-11-20 01:31:29.099854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.099941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.099968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.147 qpair failed and we were unable to recover it. 00:30:21.147 [2024-11-20 01:31:29.100089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.100171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.100195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.147 qpair failed and we were unable to recover it. 00:30:21.147 [2024-11-20 01:31:29.100290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.100426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.100451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.147 qpair failed and we were unable to recover it. 00:30:21.147 [2024-11-20 01:31:29.100602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.100698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.100723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.147 qpair failed and we were unable to recover it. 00:30:21.147 [2024-11-20 01:31:29.100818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.100931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.100956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.147 qpair failed and we were unable to recover it. 00:30:21.147 [2024-11-20 01:31:29.101045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.101134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.101161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.147 qpair failed and we were unable to recover it. 00:30:21.147 [2024-11-20 01:31:29.101264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.101355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.101380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.147 qpair failed and we were unable to recover it. 00:30:21.147 [2024-11-20 01:31:29.101504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.101617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.147 [2024-11-20 01:31:29.101642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.147 qpair failed and we were unable to recover it. 00:30:21.148 [2024-11-20 01:31:29.101780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.101894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.101919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.148 qpair failed and we were unable to recover it. 00:30:21.148 [2024-11-20 01:31:29.102000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.102091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.102116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.148 qpair failed and we were unable to recover it. 00:30:21.148 [2024-11-20 01:31:29.102211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.102320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.102344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.148 qpair failed and we were unable to recover it. 00:30:21.148 [2024-11-20 01:31:29.102506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.102586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.102611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.148 qpair failed and we were unable to recover it. 00:30:21.148 [2024-11-20 01:31:29.102709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.102799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.102824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.148 qpair failed and we were unable to recover it. 00:30:21.148 [2024-11-20 01:31:29.102943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.103034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.103058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.148 qpair failed and we were unable to recover it. 00:30:21.148 [2024-11-20 01:31:29.103163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.103247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.103272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.148 qpair failed and we were unable to recover it. 00:30:21.148 [2024-11-20 01:31:29.103393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.103510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.103536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.148 qpair failed and we were unable to recover it. 00:30:21.148 [2024-11-20 01:31:29.103659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.103744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.103769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.148 qpair failed and we were unable to recover it. 00:30:21.148 [2024-11-20 01:31:29.103865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.103982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.104007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.148 qpair failed and we were unable to recover it. 00:30:21.148 [2024-11-20 01:31:29.104107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.104197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.104223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.148 qpair failed and we were unable to recover it. 00:30:21.148 [2024-11-20 01:31:29.104318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.104437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.104462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.148 qpair failed and we were unable to recover it. 00:30:21.148 [2024-11-20 01:31:29.104566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.104718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.104743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.148 qpair failed and we were unable to recover it. 00:30:21.148 [2024-11-20 01:31:29.104832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.104988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.105013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.148 qpair failed and we were unable to recover it. 00:30:21.148 [2024-11-20 01:31:29.105114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.105205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.105231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.148 qpair failed and we were unable to recover it. 00:30:21.148 [2024-11-20 01:31:29.105329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.105498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.105526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.148 qpair failed and we were unable to recover it. 00:30:21.148 [2024-11-20 01:31:29.105639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.105777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.105804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.148 qpair failed and we were unable to recover it. 00:30:21.148 [2024-11-20 01:31:29.105923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.106039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.106065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.148 qpair failed and we were unable to recover it. 00:30:21.148 [2024-11-20 01:31:29.106198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.106282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.106306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.148 qpair failed and we were unable to recover it. 00:30:21.148 [2024-11-20 01:31:29.106431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.106537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.106580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.148 qpair failed and we were unable to recover it. 00:30:21.148 [2024-11-20 01:31:29.106667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.106792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.106821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.148 qpair failed and we were unable to recover it. 00:30:21.148 [2024-11-20 01:31:29.106947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.107041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.107067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.148 qpair failed and we were unable to recover it. 00:30:21.148 [2024-11-20 01:31:29.107168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.107255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.107279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.148 qpair failed and we were unable to recover it. 00:30:21.148 [2024-11-20 01:31:29.107366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.107481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.107510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.148 qpair failed and we were unable to recover it. 00:30:21.148 [2024-11-20 01:31:29.107641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.107799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.107826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.148 qpair failed and we were unable to recover it. 00:30:21.148 [2024-11-20 01:31:29.107968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.108094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.108119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.148 qpair failed and we were unable to recover it. 00:30:21.148 [2024-11-20 01:31:29.108204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.108333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.108375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.148 qpair failed and we were unable to recover it. 00:30:21.148 [2024-11-20 01:31:29.108521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.108635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.108660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.148 qpair failed and we were unable to recover it. 00:30:21.148 [2024-11-20 01:31:29.108802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.108894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.108920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.148 qpair failed and we were unable to recover it. 00:30:21.148 [2024-11-20 01:31:29.109007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.109120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.109147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.148 qpair failed and we were unable to recover it. 00:30:21.148 [2024-11-20 01:31:29.109281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.109372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.109397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.148 qpair failed and we were unable to recover it. 00:30:21.148 [2024-11-20 01:31:29.109510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.109629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.109654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.148 qpair failed and we were unable to recover it. 00:30:21.148 [2024-11-20 01:31:29.109736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.109828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.109854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.148 qpair failed and we were unable to recover it. 00:30:21.148 [2024-11-20 01:31:29.109966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.110091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.110117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.148 qpair failed and we were unable to recover it. 00:30:21.148 [2024-11-20 01:31:29.110215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.110300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.110326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.148 qpair failed and we were unable to recover it. 00:30:21.148 [2024-11-20 01:31:29.110406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.110502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.110527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.148 qpair failed and we were unable to recover it. 00:30:21.148 [2024-11-20 01:31:29.110625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.110740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.110764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.148 qpair failed and we were unable to recover it. 00:30:21.148 [2024-11-20 01:31:29.110861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.110978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.111003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.148 qpair failed and we were unable to recover it. 00:30:21.148 [2024-11-20 01:31:29.111096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.111182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.111206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.148 qpair failed and we were unable to recover it. 00:30:21.148 [2024-11-20 01:31:29.111320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.111418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.111443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.148 qpair failed and we were unable to recover it. 00:30:21.148 [2024-11-20 01:31:29.111534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.111647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.111672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.148 qpair failed and we were unable to recover it. 00:30:21.148 [2024-11-20 01:31:29.111800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.111882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.111906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.148 qpair failed and we were unable to recover it. 00:30:21.148 [2024-11-20 01:31:29.111998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.112102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.112128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.148 qpair failed and we were unable to recover it. 00:30:21.148 [2024-11-20 01:31:29.112219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.112313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.112339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.148 qpair failed and we were unable to recover it. 00:30:21.148 [2024-11-20 01:31:29.112447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.112563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.112598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.148 qpair failed and we were unable to recover it. 00:30:21.148 [2024-11-20 01:31:29.112683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.112803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.112828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.148 qpair failed and we were unable to recover it. 00:30:21.148 [2024-11-20 01:31:29.112940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.113054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.113084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.148 qpair failed and we were unable to recover it. 00:30:21.148 [2024-11-20 01:31:29.113200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.113305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.113363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.148 qpair failed and we were unable to recover it. 00:30:21.148 [2024-11-20 01:31:29.113517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.113627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.113652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.148 qpair failed and we were unable to recover it. 00:30:21.148 [2024-11-20 01:31:29.113744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.113827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.113852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.148 qpair failed and we were unable to recover it. 00:30:21.148 [2024-11-20 01:31:29.113975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.114062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.114092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.148 qpair failed and we were unable to recover it. 00:30:21.148 [2024-11-20 01:31:29.114204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.114303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.114328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.148 qpair failed and we were unable to recover it. 00:30:21.148 [2024-11-20 01:31:29.114428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.114542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.148 [2024-11-20 01:31:29.114567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.148 qpair failed and we were unable to recover it. 00:30:21.148 [2024-11-20 01:31:29.114689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.114820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.114844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.149 qpair failed and we were unable to recover it. 00:30:21.149 [2024-11-20 01:31:29.114934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.115044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.115074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.149 qpair failed and we were unable to recover it. 00:30:21.149 [2024-11-20 01:31:29.115201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.115289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.115316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.149 qpair failed and we were unable to recover it. 00:30:21.149 [2024-11-20 01:31:29.115451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.115562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.115586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.149 qpair failed and we were unable to recover it. 00:30:21.149 [2024-11-20 01:31:29.115673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.115761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.115786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.149 qpair failed and we were unable to recover it. 00:30:21.149 [2024-11-20 01:31:29.115887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.115996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.116021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.149 qpair failed and we were unable to recover it. 00:30:21.149 [2024-11-20 01:31:29.116118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.116208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.116232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.149 qpair failed and we were unable to recover it. 00:30:21.149 [2024-11-20 01:31:29.116353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.116450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.116475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.149 qpair failed and we were unable to recover it. 00:30:21.149 [2024-11-20 01:31:29.116601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.116690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.116715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.149 qpair failed and we were unable to recover it. 00:30:21.149 [2024-11-20 01:31:29.116857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.116971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.116996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.149 qpair failed and we were unable to recover it. 00:30:21.149 [2024-11-20 01:31:29.117136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.117314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.117342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.149 qpair failed and we were unable to recover it. 00:30:21.149 [2024-11-20 01:31:29.117544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.117675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.117699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.149 qpair failed and we were unable to recover it. 00:30:21.149 [2024-11-20 01:31:29.117838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.117938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.117966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.149 qpair failed and we were unable to recover it. 00:30:21.149 [2024-11-20 01:31:29.118074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.118224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.118266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.149 qpair failed and we were unable to recover it. 00:30:21.149 [2024-11-20 01:31:29.118391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.118504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.118548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.149 qpair failed and we were unable to recover it. 00:30:21.149 [2024-11-20 01:31:29.118688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.118804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.118830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.149 qpair failed and we were unable to recover it. 00:30:21.149 [2024-11-20 01:31:29.118942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.119037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.119061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.149 qpair failed and we were unable to recover it. 00:30:21.149 [2024-11-20 01:31:29.119216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.119356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.119381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.149 qpair failed and we were unable to recover it. 00:30:21.149 [2024-11-20 01:31:29.119503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.119618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.119642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.149 qpair failed and we were unable to recover it. 00:30:21.149 [2024-11-20 01:31:29.119737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.119868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.119893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.149 qpair failed and we were unable to recover it. 00:30:21.149 [2024-11-20 01:31:29.120009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.120098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.120140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.149 qpair failed and we were unable to recover it. 00:30:21.149 [2024-11-20 01:31:29.120253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.120396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.120438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.149 qpair failed and we were unable to recover it. 00:30:21.149 [2024-11-20 01:31:29.120609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.120761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.120790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.149 qpair failed and we were unable to recover it. 00:30:21.149 [2024-11-20 01:31:29.120938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.121051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.121084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.149 qpair failed and we were unable to recover it. 00:30:21.149 [2024-11-20 01:31:29.121229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.121329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.121369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.149 qpair failed and we were unable to recover it. 00:30:21.149 [2024-11-20 01:31:29.121554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.121714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.121739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.149 qpair failed and we were unable to recover it. 00:30:21.149 [2024-11-20 01:31:29.121829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.121946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.121972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.149 qpair failed and we were unable to recover it. 00:30:21.149 [2024-11-20 01:31:29.122075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.122156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.122199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.149 qpair failed and we were unable to recover it. 00:30:21.149 [2024-11-20 01:31:29.122312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.122461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.122485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.149 qpair failed and we were unable to recover it. 00:30:21.149 [2024-11-20 01:31:29.122573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.122691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.122716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.149 qpair failed and we were unable to recover it. 00:30:21.149 [2024-11-20 01:31:29.122844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.122943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.122968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.149 qpair failed and we were unable to recover it. 00:30:21.149 [2024-11-20 01:31:29.123116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.123272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.123297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.149 qpair failed and we were unable to recover it. 00:30:21.149 [2024-11-20 01:31:29.123412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.123530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.123559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.149 qpair failed and we were unable to recover it. 00:30:21.149 [2024-11-20 01:31:29.123676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.123827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.123851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.149 qpair failed and we were unable to recover it. 00:30:21.149 [2024-11-20 01:31:29.123997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.124088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.124130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.149 qpair failed and we were unable to recover it. 00:30:21.149 [2024-11-20 01:31:29.124291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.124394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.124420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.149 qpair failed and we were unable to recover it. 00:30:21.149 [2024-11-20 01:31:29.124534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.124614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.124639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.149 qpair failed and we were unable to recover it. 00:30:21.149 [2024-11-20 01:31:29.124791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.124904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.124930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.149 qpair failed and we were unable to recover it. 00:30:21.149 [2024-11-20 01:31:29.125030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.125143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.125168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.149 qpair failed and we were unable to recover it. 00:30:21.149 [2024-11-20 01:31:29.125266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.125418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.125446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.149 qpair failed and we were unable to recover it. 00:30:21.149 [2024-11-20 01:31:29.125572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.125671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.125699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.149 qpair failed and we were unable to recover it. 00:30:21.149 [2024-11-20 01:31:29.125835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.125931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.125959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.149 qpair failed and we were unable to recover it. 00:30:21.149 [2024-11-20 01:31:29.126052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.126195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.149 [2024-11-20 01:31:29.126224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.149 qpair failed and we were unable to recover it. 00:30:21.149 [2024-11-20 01:31:29.126327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.126448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.126476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.150 qpair failed and we were unable to recover it. 00:30:21.150 [2024-11-20 01:31:29.126632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.126725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.126753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.150 qpair failed and we were unable to recover it. 00:30:21.150 [2024-11-20 01:31:29.126842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.126977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.127002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.150 qpair failed and we were unable to recover it. 00:30:21.150 [2024-11-20 01:31:29.127117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.127230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.127256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.150 qpair failed and we were unable to recover it. 00:30:21.150 [2024-11-20 01:31:29.127410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.127564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.127593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.150 qpair failed and we were unable to recover it. 00:30:21.150 [2024-11-20 01:31:29.127763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.127874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.127900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.150 qpair failed and we were unable to recover it. 00:30:21.150 [2024-11-20 01:31:29.128013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.128115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.128140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.150 qpair failed and we were unable to recover it. 00:30:21.150 [2024-11-20 01:31:29.128228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.128354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.128403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.150 qpair failed and we were unable to recover it. 00:30:21.150 [2024-11-20 01:31:29.128520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.128639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.128665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.150 qpair failed and we were unable to recover it. 00:30:21.150 [2024-11-20 01:31:29.128788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.128912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.128937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.150 qpair failed and we were unable to recover it. 00:30:21.150 [2024-11-20 01:31:29.129033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.129131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.129156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.150 qpair failed and we were unable to recover it. 00:30:21.150 [2024-11-20 01:31:29.129236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.129389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.129432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.150 qpair failed and we were unable to recover it. 00:30:21.150 [2024-11-20 01:31:29.129567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.129652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.129678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.150 qpair failed and we were unable to recover it. 00:30:21.150 [2024-11-20 01:31:29.129765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.129886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.129911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.150 qpair failed and we were unable to recover it. 00:30:21.150 [2024-11-20 01:31:29.130000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.130089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.130114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.150 qpair failed and we were unable to recover it. 00:30:21.150 [2024-11-20 01:31:29.130194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.130307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.130333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.150 qpair failed and we were unable to recover it. 00:30:21.150 [2024-11-20 01:31:29.130474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.130593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.130618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.150 qpair failed and we were unable to recover it. 00:30:21.150 [2024-11-20 01:31:29.130712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.130835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.130859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.150 qpair failed and we were unable to recover it. 00:30:21.150 [2024-11-20 01:31:29.130947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.131063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.131098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.150 qpair failed and we were unable to recover it. 00:30:21.150 [2024-11-20 01:31:29.131217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.131307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.131332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.150 qpair failed and we were unable to recover it. 00:30:21.150 [2024-11-20 01:31:29.131490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.131619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.131644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.150 qpair failed and we were unable to recover it. 00:30:21.150 [2024-11-20 01:31:29.131763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.131882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.131905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.150 qpair failed and we were unable to recover it. 00:30:21.150 [2024-11-20 01:31:29.131990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.132095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.132121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.150 qpair failed and we were unable to recover it. 00:30:21.150 [2024-11-20 01:31:29.132212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.132304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.132329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.150 qpair failed and we were unable to recover it. 00:30:21.150 [2024-11-20 01:31:29.132415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.132557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.132581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.150 qpair failed and we were unable to recover it. 00:30:21.150 [2024-11-20 01:31:29.132697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.132787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.132820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.150 qpair failed and we were unable to recover it. 00:30:21.150 [2024-11-20 01:31:29.132934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.133017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.133042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.150 qpair failed and we were unable to recover it. 00:30:21.150 [2024-11-20 01:31:29.133136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.133218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.133243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.150 qpair failed and we were unable to recover it. 00:30:21.150 [2024-11-20 01:31:29.133338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.133455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.133479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.150 qpair failed and we were unable to recover it. 00:30:21.150 [2024-11-20 01:31:29.133579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.133671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.133696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.150 qpair failed and we were unable to recover it. 00:30:21.150 [2024-11-20 01:31:29.133854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.133947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.133971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.150 qpair failed and we were unable to recover it. 00:30:21.150 [2024-11-20 01:31:29.134050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.134179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.134204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.150 qpair failed and we were unable to recover it. 00:30:21.150 [2024-11-20 01:31:29.134297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.134395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.134422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.150 qpair failed and we were unable to recover it. 00:30:21.150 [2024-11-20 01:31:29.134541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.134629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.134656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.150 qpair failed and we were unable to recover it. 00:30:21.150 [2024-11-20 01:31:29.134745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.134890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.134916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.150 qpair failed and we were unable to recover it. 00:30:21.150 [2024-11-20 01:31:29.135031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.135152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.135177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.150 qpair failed and we were unable to recover it. 00:30:21.150 [2024-11-20 01:31:29.135268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.135447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.135475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.150 qpair failed and we were unable to recover it. 00:30:21.150 [2024-11-20 01:31:29.135621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.135733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.135758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.150 qpair failed and we were unable to recover it. 00:30:21.150 [2024-11-20 01:31:29.135879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.135959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.135984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.150 qpair failed and we were unable to recover it. 00:30:21.150 [2024-11-20 01:31:29.136097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.136182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.136207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.150 qpair failed and we were unable to recover it. 00:30:21.150 [2024-11-20 01:31:29.136295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.136395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.136419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.150 qpair failed and we were unable to recover it. 00:30:21.150 [2024-11-20 01:31:29.136526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.136645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.136669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.150 qpair failed and we were unable to recover it. 00:30:21.150 [2024-11-20 01:31:29.136780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.136895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.136919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.150 qpair failed and we were unable to recover it. 00:30:21.150 [2024-11-20 01:31:29.137041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.137153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.137179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.150 qpair failed and we were unable to recover it. 00:30:21.150 [2024-11-20 01:31:29.137274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.137372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.137396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.150 qpair failed and we were unable to recover it. 00:30:21.150 [2024-11-20 01:31:29.137494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.137610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.137635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.150 qpair failed and we were unable to recover it. 00:30:21.150 [2024-11-20 01:31:29.137719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.150 [2024-11-20 01:31:29.137806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.137830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.151 qpair failed and we were unable to recover it. 00:30:21.151 [2024-11-20 01:31:29.137991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.138108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.138139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.151 qpair failed and we were unable to recover it. 00:30:21.151 [2024-11-20 01:31:29.138237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.138320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.138345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.151 qpair failed and we were unable to recover it. 00:30:21.151 [2024-11-20 01:31:29.138461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.138565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.138595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.151 qpair failed and we were unable to recover it. 00:30:21.151 [2024-11-20 01:31:29.138686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.138830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.138856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.151 qpair failed and we were unable to recover it. 00:30:21.151 [2024-11-20 01:31:29.138952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.139079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.139105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.151 qpair failed and we were unable to recover it. 00:30:21.151 [2024-11-20 01:31:29.139197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.139894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.139925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.151 qpair failed and we were unable to recover it. 00:30:21.151 [2024-11-20 01:31:29.140065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.140177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.140204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.151 qpair failed and we were unable to recover it. 00:30:21.151 [2024-11-20 01:31:29.140292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.140395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.140421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.151 qpair failed and we were unable to recover it. 00:30:21.151 [2024-11-20 01:31:29.140547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.140641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.140666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.151 qpair failed and we were unable to recover it. 00:30:21.151 [2024-11-20 01:31:29.140807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.140932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.140957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.151 qpair failed and we were unable to recover it. 00:30:21.151 [2024-11-20 01:31:29.141096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.141190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.141215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.151 qpair failed and we were unable to recover it. 00:30:21.151 [2024-11-20 01:31:29.141340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.141469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.141494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.151 qpair failed and we were unable to recover it. 00:30:21.151 [2024-11-20 01:31:29.141583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.141683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.141708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.151 qpair failed and we were unable to recover it. 00:30:21.151 [2024-11-20 01:31:29.141812] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x948e00 is same with the state(5) to be set 00:30:21.151 [2024-11-20 01:31:29.141984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.142113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.142143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.151 qpair failed and we were unable to recover it. 00:30:21.151 [2024-11-20 01:31:29.142235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.142369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.142397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.151 qpair failed and we were unable to recover it. 00:30:21.151 [2024-11-20 01:31:29.142554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.142696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.142724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.151 qpair failed and we were unable to recover it. 00:30:21.151 [2024-11-20 01:31:29.142824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.142946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.142971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.151 qpair failed and we were unable to recover it. 00:30:21.151 [2024-11-20 01:31:29.143059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.143167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.143195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.151 qpair failed and we were unable to recover it. 00:30:21.151 [2024-11-20 01:31:29.143284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.143398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.143421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.151 qpair failed and we were unable to recover it. 00:30:21.151 [2024-11-20 01:31:29.143540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.143645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.143672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.151 qpair failed and we were unable to recover it. 00:30:21.151 [2024-11-20 01:31:29.143795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.143911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.143935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.151 qpair failed and we were unable to recover it. 00:30:21.151 [2024-11-20 01:31:29.144015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.144107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.144134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.151 qpair failed and we were unable to recover it. 00:30:21.151 [2024-11-20 01:31:29.144220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.144297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.144322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.151 qpair failed and we were unable to recover it. 00:30:21.151 [2024-11-20 01:31:29.144434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.144596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.144623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.151 qpair failed and we were unable to recover it. 00:30:21.151 [2024-11-20 01:31:29.144711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.144808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.144839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.151 qpair failed and we were unable to recover it. 00:30:21.151 [2024-11-20 01:31:29.144972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.145063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.145094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.151 qpair failed and we were unable to recover it. 00:30:21.151 [2024-11-20 01:31:29.145180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.145276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.145300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.151 qpair failed and we were unable to recover it. 00:30:21.151 [2024-11-20 01:31:29.146656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.146839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.146870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.151 qpair failed and we were unable to recover it. 00:30:21.151 [2024-11-20 01:31:29.147018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.147131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.147157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.151 qpair failed and we were unable to recover it. 00:30:21.151 [2024-11-20 01:31:29.147252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.147347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.147375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.151 qpair failed and we were unable to recover it. 00:30:21.151 [2024-11-20 01:31:29.147456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.147545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.147569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.151 qpair failed and we were unable to recover it. 00:30:21.151 [2024-11-20 01:31:29.147666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.147779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.147806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.151 qpair failed and we were unable to recover it. 00:30:21.151 [2024-11-20 01:31:29.147913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.148012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.148040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.151 qpair failed and we were unable to recover it. 00:30:21.151 [2024-11-20 01:31:29.148149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.148238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.148262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.151 qpair failed and we were unable to recover it. 00:30:21.151 [2024-11-20 01:31:29.148351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.148435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.148459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.151 qpair failed and we were unable to recover it. 00:30:21.151 [2024-11-20 01:31:29.148596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.148726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.148753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.151 qpair failed and we were unable to recover it. 00:30:21.151 [2024-11-20 01:31:29.148918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.149025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.149075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.151 qpair failed and we were unable to recover it. 00:30:21.151 [2024-11-20 01:31:29.149174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.149287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.149312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.151 qpair failed and we were unable to recover it. 00:30:21.151 [2024-11-20 01:31:29.149444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.149569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.149611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.151 qpair failed and we were unable to recover it. 00:30:21.151 [2024-11-20 01:31:29.149725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.149820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.149847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.151 qpair failed and we were unable to recover it. 00:30:21.151 [2024-11-20 01:31:29.149979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.150095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.150121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.151 qpair failed and we were unable to recover it. 00:30:21.151 [2024-11-20 01:31:29.150213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.150301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.151 [2024-11-20 01:31:29.150326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.152 qpair failed and we were unable to recover it. 00:30:21.152 [2024-11-20 01:31:29.150443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.150566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.150594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.152 qpair failed and we were unable to recover it. 00:30:21.152 [2024-11-20 01:31:29.150703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.150852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.150881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.152 qpair failed and we were unable to recover it. 00:30:21.152 [2024-11-20 01:31:29.150980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.151111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.151137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.152 qpair failed and we were unable to recover it. 00:30:21.152 [2024-11-20 01:31:29.151255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.151346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.151371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.152 qpair failed and we were unable to recover it. 00:30:21.152 [2024-11-20 01:31:29.151497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.151586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.151610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.152 qpair failed and we were unable to recover it. 00:30:21.152 [2024-11-20 01:31:29.151727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.151841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.151868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.152 qpair failed and we were unable to recover it. 00:30:21.152 [2024-11-20 01:31:29.152009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.152138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.152164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.152 qpair failed and we were unable to recover it. 00:30:21.152 [2024-11-20 01:31:29.152257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.152388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.152413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.152 qpair failed and we were unable to recover it. 00:30:21.152 [2024-11-20 01:31:29.152569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.152699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.152726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.152 qpair failed and we were unable to recover it. 00:30:21.152 [2024-11-20 01:31:29.152853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.152962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.152987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.152 qpair failed and we were unable to recover it. 00:30:21.152 [2024-11-20 01:31:29.153099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.153196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.153221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.152 qpair failed and we were unable to recover it. 00:30:21.152 [2024-11-20 01:31:29.153313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.153466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.153499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.152 qpair failed and we were unable to recover it. 00:30:21.152 [2024-11-20 01:31:29.153641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.153738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.153766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.152 qpair failed and we were unable to recover it. 00:30:21.152 [2024-11-20 01:31:29.153954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.154044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.154092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.152 qpair failed and we were unable to recover it. 00:30:21.152 [2024-11-20 01:31:29.154206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.154294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.154318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.152 qpair failed and we were unable to recover it. 00:30:21.152 [2024-11-20 01:31:29.154435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.154521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.154571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.152 qpair failed and we were unable to recover it. 00:30:21.152 [2024-11-20 01:31:29.154658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.154759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.154786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.152 qpair failed and we were unable to recover it. 00:30:21.152 [2024-11-20 01:31:29.154912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.155043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.155067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.152 qpair failed and we were unable to recover it. 00:30:21.152 [2024-11-20 01:31:29.155193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.155309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.155334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.152 qpair failed and we were unable to recover it. 00:30:21.152 [2024-11-20 01:31:29.155521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.155622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.155650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.152 qpair failed and we were unable to recover it. 00:30:21.152 [2024-11-20 01:31:29.155744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.155842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.155871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.152 qpair failed and we were unable to recover it. 00:30:21.152 [2024-11-20 01:31:29.155991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.156081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.156116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.152 qpair failed and we were unable to recover it. 00:30:21.152 [2024-11-20 01:31:29.156217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.156328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.156353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.152 qpair failed and we were unable to recover it. 00:30:21.152 [2024-11-20 01:31:29.156461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.156617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.156645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.152 qpair failed and we were unable to recover it. 00:30:21.152 [2024-11-20 01:31:29.156839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.156937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.156965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.152 qpair failed and we were unable to recover it. 00:30:21.152 [2024-11-20 01:31:29.157105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.157997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.158030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.152 qpair failed and we were unable to recover it. 00:30:21.152 [2024-11-20 01:31:29.158164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.158265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.158290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.152 qpair failed and we were unable to recover it. 00:30:21.152 [2024-11-20 01:31:29.158450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.158545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.158573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.152 qpair failed and we were unable to recover it. 00:30:21.152 [2024-11-20 01:31:29.158732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.158859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.158887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.152 qpair failed and we were unable to recover it. 00:30:21.152 [2024-11-20 01:31:29.159053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.159160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.159186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.152 qpair failed and we were unable to recover it. 00:30:21.152 [2024-11-20 01:31:29.159263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.159403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.159443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.152 qpair failed and we were unable to recover it. 00:30:21.152 [2024-11-20 01:31:29.159577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.159692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.159719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.152 qpair failed and we were unable to recover it. 00:30:21.152 [2024-11-20 01:31:29.159855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.159992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.160016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.152 qpair failed and we were unable to recover it. 00:30:21.152 [2024-11-20 01:31:29.160145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.160263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.160288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.152 qpair failed and we were unable to recover it. 00:30:21.152 [2024-11-20 01:31:29.160412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.160488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.160513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.152 qpair failed and we were unable to recover it. 00:30:21.152 [2024-11-20 01:31:29.160663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.160743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.160768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.152 qpair failed and we were unable to recover it. 00:30:21.152 [2024-11-20 01:31:29.160913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.160996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.161020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.152 qpair failed and we were unable to recover it. 00:30:21.152 [2024-11-20 01:31:29.161109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.161199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.161223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.152 qpair failed and we were unable to recover it. 00:30:21.152 [2024-11-20 01:31:29.161317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.161447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.161470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.152 qpair failed and we were unable to recover it. 00:30:21.152 [2024-11-20 01:31:29.161565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.161648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.161672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.152 qpair failed and we were unable to recover it. 00:30:21.152 [2024-11-20 01:31:29.161797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.161890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.161916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.152 qpair failed and we were unable to recover it. 00:30:21.152 [2024-11-20 01:31:29.162008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.162098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.162122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.152 qpair failed and we were unable to recover it. 00:30:21.152 [2024-11-20 01:31:29.162206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.162300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.162324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.152 qpair failed and we were unable to recover it. 00:30:21.152 [2024-11-20 01:31:29.162450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.162537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.162562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.152 qpair failed and we were unable to recover it. 00:30:21.152 [2024-11-20 01:31:29.162681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.162797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.162821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.152 qpair failed and we were unable to recover it. 00:30:21.152 [2024-11-20 01:31:29.162907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.163024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.152 [2024-11-20 01:31:29.163048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.152 qpair failed and we were unable to recover it. 00:30:21.153 [2024-11-20 01:31:29.163156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.163264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.163292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.153 qpair failed and we were unable to recover it. 00:30:21.153 [2024-11-20 01:31:29.163451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.163564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.163589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.153 qpair failed and we were unable to recover it. 00:30:21.153 [2024-11-20 01:31:29.163685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.163809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.163835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.153 qpair failed and we were unable to recover it. 00:30:21.153 [2024-11-20 01:31:29.163926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.164021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.164046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.153 qpair failed and we were unable to recover it. 00:30:21.153 [2024-11-20 01:31:29.164147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.164242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.164268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.153 qpair failed and we were unable to recover it. 00:30:21.153 [2024-11-20 01:31:29.164354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.164472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.164497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.153 qpair failed and we were unable to recover it. 00:30:21.153 [2024-11-20 01:31:29.164585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.164682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.164709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.153 qpair failed and we were unable to recover it. 00:30:21.153 [2024-11-20 01:31:29.164806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.164918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.164943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.153 qpair failed and we were unable to recover it. 00:30:21.153 [2024-11-20 01:31:29.165028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.165153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.165179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.153 qpair failed and we were unable to recover it. 00:30:21.153 [2024-11-20 01:31:29.165276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.165394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.165426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.153 qpair failed and we were unable to recover it. 00:30:21.153 [2024-11-20 01:31:29.165528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.165642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.165666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.153 qpair failed and we were unable to recover it. 00:30:21.153 [2024-11-20 01:31:29.165762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.165852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.165876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.153 qpair failed and we were unable to recover it. 00:30:21.153 [2024-11-20 01:31:29.165967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.166048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.166081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.153 qpair failed and we were unable to recover it. 00:30:21.153 [2024-11-20 01:31:29.166180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.166263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.166288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.153 qpair failed and we were unable to recover it. 00:30:21.153 [2024-11-20 01:31:29.166375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.166473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.166498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.153 qpair failed and we were unable to recover it. 00:30:21.153 [2024-11-20 01:31:29.166595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.166707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.166731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.153 qpair failed and we were unable to recover it. 00:30:21.153 [2024-11-20 01:31:29.166851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.166982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.167008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.153 qpair failed and we were unable to recover it. 00:30:21.153 [2024-11-20 01:31:29.167103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.167195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.167219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.153 qpair failed and we were unable to recover it. 00:30:21.153 [2024-11-20 01:31:29.167303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.167451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.167476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.153 qpair failed and we were unable to recover it. 00:30:21.153 [2024-11-20 01:31:29.167591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.167703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.167728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.153 qpair failed and we were unable to recover it. 00:30:21.153 [2024-11-20 01:31:29.167844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.168005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.168030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.153 qpair failed and we were unable to recover it. 00:30:21.153 [2024-11-20 01:31:29.168130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.168218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.168244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.153 qpair failed and we were unable to recover it. 00:30:21.153 [2024-11-20 01:31:29.168386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.168479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.168506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.153 qpair failed and we were unable to recover it. 00:30:21.153 [2024-11-20 01:31:29.168609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.168751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.168776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.153 qpair failed and we were unable to recover it. 00:30:21.153 [2024-11-20 01:31:29.168930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.169080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.169105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.153 qpair failed and we were unable to recover it. 00:30:21.153 [2024-11-20 01:31:29.169197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.169285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.169310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.153 qpair failed and we were unable to recover it. 00:30:21.153 [2024-11-20 01:31:29.169420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.169518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.169547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.153 qpair failed and we were unable to recover it. 00:30:21.153 [2024-11-20 01:31:29.169665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.169776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.169800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.153 qpair failed and we were unable to recover it. 00:30:21.153 [2024-11-20 01:31:29.169914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.170008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.170034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.153 qpair failed and we were unable to recover it. 00:30:21.153 [2024-11-20 01:31:29.170159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.170255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.170280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.153 qpair failed and we were unable to recover it. 00:30:21.153 [2024-11-20 01:31:29.170374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.170503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.170541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.153 qpair failed and we were unable to recover it. 00:30:21.153 [2024-11-20 01:31:29.170663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.170751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.170776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.153 qpair failed and we were unable to recover it. 00:30:21.153 [2024-11-20 01:31:29.170900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.170993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.171019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.153 qpair failed and we were unable to recover it. 00:30:21.153 [2024-11-20 01:31:29.171147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.171230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.171255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.153 qpair failed and we were unable to recover it. 00:30:21.153 [2024-11-20 01:31:29.171356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.171497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.171523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.153 qpair failed and we were unable to recover it. 00:30:21.153 [2024-11-20 01:31:29.171672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.171813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.171838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.153 qpair failed and we were unable to recover it. 00:30:21.153 [2024-11-20 01:31:29.171952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.172086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.172124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.153 qpair failed and we were unable to recover it. 00:30:21.153 [2024-11-20 01:31:29.172218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.172311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.172336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.153 qpair failed and we were unable to recover it. 00:30:21.153 [2024-11-20 01:31:29.172433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.172516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.172542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.153 qpair failed and we were unable to recover it. 00:30:21.153 [2024-11-20 01:31:29.172632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.172711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.172736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.153 qpair failed and we were unable to recover it. 00:30:21.153 [2024-11-20 01:31:29.172883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.172995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.173019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.153 qpair failed and we were unable to recover it. 00:30:21.153 [2024-11-20 01:31:29.173162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.173247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.153 [2024-11-20 01:31:29.173272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.153 qpair failed and we were unable to recover it. 00:30:21.154 [2024-11-20 01:31:29.173416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.173563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.173589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.154 qpair failed and we were unable to recover it. 00:30:21.154 [2024-11-20 01:31:29.173706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.173838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.173863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.154 qpair failed and we were unable to recover it. 00:30:21.154 [2024-11-20 01:31:29.173950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.174043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.174074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.154 qpair failed and we were unable to recover it. 00:30:21.154 [2024-11-20 01:31:29.174167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.174281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.174306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.154 qpair failed and we were unable to recover it. 00:30:21.154 [2024-11-20 01:31:29.174461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.174544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.174574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.154 qpair failed and we were unable to recover it. 00:30:21.154 [2024-11-20 01:31:29.174688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.174790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.174814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.154 qpair failed and we were unable to recover it. 00:30:21.154 [2024-11-20 01:31:29.174927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.175043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.175067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.154 qpair failed and we were unable to recover it. 00:30:21.154 [2024-11-20 01:31:29.175169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.175256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.175281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.154 qpair failed and we were unable to recover it. 00:30:21.154 [2024-11-20 01:31:29.175392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.175486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.175512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.154 qpair failed and we were unable to recover it. 00:30:21.154 [2024-11-20 01:31:29.175593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.175679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.175703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.154 qpair failed and we were unable to recover it. 00:30:21.154 [2024-11-20 01:31:29.175813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.175904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.175929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.154 qpair failed and we were unable to recover it. 00:30:21.154 [2024-11-20 01:31:29.176041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.176146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.176172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.154 qpair failed and we were unable to recover it. 00:30:21.154 [2024-11-20 01:31:29.176258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.176370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.176394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.154 qpair failed and we were unable to recover it. 00:30:21.154 [2024-11-20 01:31:29.176543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.176656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.176681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.154 qpair failed and we were unable to recover it. 00:30:21.154 [2024-11-20 01:31:29.176789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.176906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.176931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.154 qpair failed and we were unable to recover it. 00:30:21.154 [2024-11-20 01:31:29.177017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.177146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.177171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.154 qpair failed and we were unable to recover it. 00:30:21.154 [2024-11-20 01:31:29.177257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.177346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.177384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.154 qpair failed and we were unable to recover it. 00:30:21.154 [2024-11-20 01:31:29.177499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.177589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.177614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.154 qpair failed and we were unable to recover it. 00:30:21.154 [2024-11-20 01:31:29.177726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.177809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.177835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.154 qpair failed and we were unable to recover it. 00:30:21.154 [2024-11-20 01:31:29.177924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.178044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.178076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.154 qpair failed and we were unable to recover it. 00:30:21.154 [2024-11-20 01:31:29.178174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.178263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.178287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.154 qpair failed and we were unable to recover it. 00:30:21.154 [2024-11-20 01:31:29.178413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.178536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.178560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.154 qpair failed and we were unable to recover it. 00:30:21.154 [2024-11-20 01:31:29.178679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.178795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.178819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.154 qpair failed and we were unable to recover it. 00:30:21.154 [2024-11-20 01:31:29.178905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.179002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.179027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.154 qpair failed and we were unable to recover it. 00:30:21.154 [2024-11-20 01:31:29.179126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.179212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.179237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.154 qpair failed and we were unable to recover it. 00:30:21.154 [2024-11-20 01:31:29.179333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.179449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.179474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.154 qpair failed and we were unable to recover it. 00:30:21.154 [2024-11-20 01:31:29.179595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.179680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.179705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.154 qpair failed and we were unable to recover it. 00:30:21.154 [2024-11-20 01:31:29.179790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.179878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.179903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.154 qpair failed and we were unable to recover it. 00:30:21.154 [2024-11-20 01:31:29.180016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.180118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.180144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.154 qpair failed and we were unable to recover it. 00:30:21.154 [2024-11-20 01:31:29.180238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.180322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.180346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.154 qpair failed and we were unable to recover it. 00:30:21.154 [2024-11-20 01:31:29.180449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.180595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.180620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.154 qpair failed and we were unable to recover it. 00:30:21.154 [2024-11-20 01:31:29.180738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.180846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.180872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.154 qpair failed and we were unable to recover it. 00:30:21.154 [2024-11-20 01:31:29.180989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.181104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.181140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.154 qpair failed and we were unable to recover it. 00:30:21.154 [2024-11-20 01:31:29.181284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.181370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.181397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.154 qpair failed and we were unable to recover it. 00:30:21.154 [2024-11-20 01:31:29.181511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.181617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.181642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.154 qpair failed and we were unable to recover it. 00:30:21.154 [2024-11-20 01:31:29.181769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.181861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.181886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.154 qpair failed and we were unable to recover it. 00:30:21.154 [2024-11-20 01:31:29.182005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.182148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.182174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.154 qpair failed and we were unable to recover it. 00:30:21.154 [2024-11-20 01:31:29.182260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.182377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.182403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.154 qpair failed and we were unable to recover it. 00:30:21.154 [2024-11-20 01:31:29.182526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.182641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.182665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.154 qpair failed and we were unable to recover it. 00:30:21.154 [2024-11-20 01:31:29.182778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.182875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.182900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.154 qpair failed and we were unable to recover it. 00:30:21.154 [2024-11-20 01:31:29.183021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.183121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.183145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.154 qpair failed and we were unable to recover it. 00:30:21.154 [2024-11-20 01:31:29.183233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.183313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.183337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.154 qpair failed and we were unable to recover it. 00:30:21.154 [2024-11-20 01:31:29.183431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.183546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.183571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.154 qpair failed and we were unable to recover it. 00:30:21.154 [2024-11-20 01:31:29.183660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.183801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.154 [2024-11-20 01:31:29.183825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.155 qpair failed and we were unable to recover it. 00:30:21.155 [2024-11-20 01:31:29.183911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.183991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.184015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.155 qpair failed and we were unable to recover it. 00:30:21.155 [2024-11-20 01:31:29.184121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.184238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.184262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.155 qpair failed and we were unable to recover it. 00:30:21.155 [2024-11-20 01:31:29.184348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.184464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.184488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.155 qpair failed and we were unable to recover it. 00:30:21.155 [2024-11-20 01:31:29.184578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.184665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.184690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.155 qpair failed and we were unable to recover it. 00:30:21.155 [2024-11-20 01:31:29.184780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.184895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.184920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.155 qpair failed and we were unable to recover it. 00:30:21.155 [2024-11-20 01:31:29.185001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.185098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.185122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.155 qpair failed and we were unable to recover it. 00:30:21.155 [2024-11-20 01:31:29.185207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.185291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.185316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.155 qpair failed and we were unable to recover it. 00:30:21.155 [2024-11-20 01:31:29.185427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.185543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.185570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.155 qpair failed and we were unable to recover it. 00:30:21.155 [2024-11-20 01:31:29.185688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.185830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.185855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.155 qpair failed and we were unable to recover it. 00:30:21.155 [2024-11-20 01:31:29.185942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.186032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.186056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.155 qpair failed and we were unable to recover it. 00:30:21.155 [2024-11-20 01:31:29.186162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.186260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.186284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.155 qpair failed and we were unable to recover it. 00:30:21.155 [2024-11-20 01:31:29.186430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.186539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.186563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.155 qpair failed and we were unable to recover it. 00:30:21.155 [2024-11-20 01:31:29.186684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.186763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.186787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.155 qpair failed and we were unable to recover it. 00:30:21.155 [2024-11-20 01:31:29.186869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.186984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.187009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.155 qpair failed and we were unable to recover it. 00:30:21.155 [2024-11-20 01:31:29.187160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.187266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.187295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.155 qpair failed and we were unable to recover it. 00:30:21.155 [2024-11-20 01:31:29.187419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.187566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.187591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.155 qpair failed and we were unable to recover it. 00:30:21.155 [2024-11-20 01:31:29.187706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.187849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.187874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.155 qpair failed and we were unable to recover it. 00:30:21.155 [2024-11-20 01:31:29.187956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.188041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.188066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.155 qpair failed and we were unable to recover it. 00:30:21.155 [2024-11-20 01:31:29.188159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.188245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.188272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.155 qpair failed and we were unable to recover it. 00:30:21.155 [2024-11-20 01:31:29.188451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.188590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.188615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.155 qpair failed and we were unable to recover it. 00:30:21.155 [2024-11-20 01:31:29.188730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.188819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.188844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.155 qpair failed and we were unable to recover it. 00:30:21.155 [2024-11-20 01:31:29.188994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.189145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.189172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.155 qpair failed and we were unable to recover it. 00:30:21.155 [2024-11-20 01:31:29.189263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.189443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.189468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.155 qpair failed and we were unable to recover it. 00:30:21.155 [2024-11-20 01:31:29.189613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.189710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.189738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.155 qpair failed and we were unable to recover it. 00:30:21.155 [2024-11-20 01:31:29.189904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.190020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.190045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.155 qpair failed and we were unable to recover it. 00:30:21.155 [2024-11-20 01:31:29.190144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.190236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.190261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.155 qpair failed and we were unable to recover it. 00:30:21.155 [2024-11-20 01:31:29.190364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.190498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.190526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.155 qpair failed and we were unable to recover it. 00:30:21.155 [2024-11-20 01:31:29.190654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.190739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.190768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.155 qpair failed and we were unable to recover it. 00:30:21.155 [2024-11-20 01:31:29.190870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.191011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.191036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.155 qpair failed and we were unable to recover it. 00:30:21.155 [2024-11-20 01:31:29.191168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.191263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.191288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.155 qpair failed and we were unable to recover it. 00:30:21.155 [2024-11-20 01:31:29.191384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.191511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.191539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.155 qpair failed and we were unable to recover it. 00:30:21.155 [2024-11-20 01:31:29.191700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.191824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.191852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.155 qpair failed and we were unable to recover it. 00:30:21.155 [2024-11-20 01:31:29.192000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.192117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.192142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.155 qpair failed and we were unable to recover it. 00:30:21.155 [2024-11-20 01:31:29.192260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.192411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.192439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.155 qpair failed and we were unable to recover it. 00:30:21.155 [2024-11-20 01:31:29.192595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.192744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.192770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.155 qpair failed and we were unable to recover it. 00:30:21.155 [2024-11-20 01:31:29.192896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.193023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.193049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.155 qpair failed and we were unable to recover it. 00:30:21.155 [2024-11-20 01:31:29.193143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.193260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.193285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.155 qpair failed and we were unable to recover it. 00:30:21.155 [2024-11-20 01:31:29.193394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.193495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.193523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.155 qpair failed and we were unable to recover it. 00:30:21.155 [2024-11-20 01:31:29.193627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.193727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.193768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.155 qpair failed and we were unable to recover it. 00:30:21.155 [2024-11-20 01:31:29.193873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.193988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.194015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.155 qpair failed and we were unable to recover it. 00:30:21.155 [2024-11-20 01:31:29.194172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.194290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.194315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.155 qpair failed and we were unable to recover it. 00:30:21.155 [2024-11-20 01:31:29.194471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.194629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.194658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.155 qpair failed and we were unable to recover it. 00:30:21.155 [2024-11-20 01:31:29.194779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.194895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.194924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.155 qpair failed and we were unable to recover it. 00:30:21.155 [2024-11-20 01:31:29.195053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.195181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.155 [2024-11-20 01:31:29.195206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.155 qpair failed and we were unable to recover it. 00:30:21.156 [2024-11-20 01:31:29.195297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.195410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.195435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.156 qpair failed and we were unable to recover it. 00:30:21.156 [2024-11-20 01:31:29.195564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.195724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.195752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.156 qpair failed and we were unable to recover it. 00:30:21.156 [2024-11-20 01:31:29.195878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.196006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.196034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.156 qpair failed and we were unable to recover it. 00:30:21.156 [2024-11-20 01:31:29.196163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.196270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.196298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.156 qpair failed and we were unable to recover it. 00:30:21.156 [2024-11-20 01:31:29.196423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.196559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.196587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.156 qpair failed and we were unable to recover it. 00:30:21.156 [2024-11-20 01:31:29.196677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.196765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.196794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.156 qpair failed and we were unable to recover it. 00:30:21.156 [2024-11-20 01:31:29.196969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.197064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.197096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.156 qpair failed and we were unable to recover it. 00:30:21.156 [2024-11-20 01:31:29.197209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.197306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.197349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.156 qpair failed and we were unable to recover it. 00:30:21.156 [2024-11-20 01:31:29.197506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.197635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.197664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.156 qpair failed and we were unable to recover it. 00:30:21.156 [2024-11-20 01:31:29.197762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.197916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.197944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.156 qpair failed and we were unable to recover it. 00:30:21.156 [2024-11-20 01:31:29.198079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.198192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.198216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.156 qpair failed and we were unable to recover it. 00:30:21.156 [2024-11-20 01:31:29.198307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.198497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.198540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.156 qpair failed and we were unable to recover it. 00:30:21.156 [2024-11-20 01:31:29.198727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.198848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.198883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.156 qpair failed and we were unable to recover it. 00:30:21.156 [2024-11-20 01:31:29.198988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.199125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.199151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.156 qpair failed and we were unable to recover it. 00:30:21.156 [2024-11-20 01:31:29.199271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.199363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.199407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.156 qpair failed and we were unable to recover it. 00:30:21.156 [2024-11-20 01:31:29.199536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.199655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.199682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.156 qpair failed and we were unable to recover it. 00:30:21.156 [2024-11-20 01:31:29.199770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.199944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.199972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.156 qpair failed and we were unable to recover it. 00:30:21.156 [2024-11-20 01:31:29.200095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.200193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.200222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.156 qpair failed and we were unable to recover it. 00:30:21.156 [2024-11-20 01:31:29.200324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.200445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.200471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.156 qpair failed and we were unable to recover it. 00:30:21.156 [2024-11-20 01:31:29.200628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.200736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.200761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.156 qpair failed and we were unable to recover it. 00:30:21.156 [2024-11-20 01:31:29.200925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.201047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.201093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.156 qpair failed and we were unable to recover it. 00:30:21.156 [2024-11-20 01:31:29.201214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.201295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.201321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.156 qpair failed and we were unable to recover it. 00:30:21.156 [2024-11-20 01:31:29.201454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.201553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.201579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.156 qpair failed and we were unable to recover it. 00:30:21.156 [2024-11-20 01:31:29.201667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.201749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.201775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.156 qpair failed and we were unable to recover it. 00:30:21.156 [2024-11-20 01:31:29.201898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.202010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.202035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.156 qpair failed and we were unable to recover it. 00:30:21.156 [2024-11-20 01:31:29.202168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.202262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.202288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.156 qpair failed and we were unable to recover it. 00:30:21.156 [2024-11-20 01:31:29.202376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.202498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.202524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.156 qpair failed and we were unable to recover it. 00:30:21.156 [2024-11-20 01:31:29.202639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.202753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.202778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.156 qpair failed and we were unable to recover it. 00:30:21.156 [2024-11-20 01:31:29.202891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.202984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.203012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.156 qpair failed and we were unable to recover it. 00:30:21.156 [2024-11-20 01:31:29.203164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.203260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.203285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.156 qpair failed and we were unable to recover it. 00:30:21.156 [2024-11-20 01:31:29.203369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.203489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.203514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.156 qpair failed and we were unable to recover it. 00:30:21.156 [2024-11-20 01:31:29.203624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.203722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.203764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.156 qpair failed and we were unable to recover it. 00:30:21.156 [2024-11-20 01:31:29.203882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.204010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.204038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.156 qpair failed and we were unable to recover it. 00:30:21.156 [2024-11-20 01:31:29.204167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.204294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.204320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.156 qpair failed and we were unable to recover it. 00:30:21.156 [2024-11-20 01:31:29.204434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.204563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.204593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.156 qpair failed and we were unable to recover it. 00:30:21.156 [2024-11-20 01:31:29.204718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.204816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.204845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.156 qpair failed and we were unable to recover it. 00:30:21.156 [2024-11-20 01:31:29.204957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.205067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.205100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.156 qpair failed and we were unable to recover it. 00:30:21.156 [2024-11-20 01:31:29.205193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.205328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.205356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.156 qpair failed and we were unable to recover it. 00:30:21.156 [2024-11-20 01:31:29.205460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.205590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.205618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.156 qpair failed and we were unable to recover it. 00:30:21.156 [2024-11-20 01:31:29.205710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.205816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.205842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.156 qpair failed and we were unable to recover it. 00:30:21.156 [2024-11-20 01:31:29.205961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.206134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.206163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.156 qpair failed and we were unable to recover it. 00:30:21.156 [2024-11-20 01:31:29.206295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.206413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.206441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.156 qpair failed and we were unable to recover it. 00:30:21.156 [2024-11-20 01:31:29.206582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.206676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.206701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.156 qpair failed and we were unable to recover it. 00:30:21.156 [2024-11-20 01:31:29.206836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.156 [2024-11-20 01:31:29.206993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.207019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.157 qpair failed and we were unable to recover it. 00:30:21.157 [2024-11-20 01:31:29.207123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.207208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.207251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.157 qpair failed and we were unable to recover it. 00:30:21.157 [2024-11-20 01:31:29.207364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.207478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.207504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.157 qpair failed and we were unable to recover it. 00:30:21.157 [2024-11-20 01:31:29.207630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.207716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.207742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.157 qpair failed and we were unable to recover it. 00:30:21.157 [2024-11-20 01:31:29.207862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.207996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.208028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.157 qpair failed and we were unable to recover it. 00:30:21.157 [2024-11-20 01:31:29.208182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.208265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.208290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.157 qpair failed and we were unable to recover it. 00:30:21.157 [2024-11-20 01:31:29.208399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.208483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.208508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.157 qpair failed and we were unable to recover it. 00:30:21.157 [2024-11-20 01:31:29.208599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.208684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.208710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.157 qpair failed and we were unable to recover it. 00:30:21.157 [2024-11-20 01:31:29.208864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.208956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.208981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.157 qpair failed and we were unable to recover it. 00:30:21.157 [2024-11-20 01:31:29.209144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.209263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.209291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.157 qpair failed and we were unable to recover it. 00:30:21.157 [2024-11-20 01:31:29.209468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.209583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.209608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.157 qpair failed and we were unable to recover it. 00:30:21.157 [2024-11-20 01:31:29.209720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.209836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.209861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.157 qpair failed and we were unable to recover it. 00:30:21.157 [2024-11-20 01:31:29.209952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.210061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.210093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.157 qpair failed and we were unable to recover it. 00:30:21.157 [2024-11-20 01:31:29.210209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.210381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.210409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.157 qpair failed and we were unable to recover it. 00:30:21.157 [2024-11-20 01:31:29.210554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.210667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.210697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.157 qpair failed and we were unable to recover it. 00:30:21.157 [2024-11-20 01:31:29.210825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.210937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.210966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.157 qpair failed and we were unable to recover it. 00:30:21.157 [2024-11-20 01:31:29.211065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.211200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.211229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.157 qpair failed and we were unable to recover it. 00:30:21.157 [2024-11-20 01:31:29.211338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.211433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.211458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.157 qpair failed and we were unable to recover it. 00:30:21.157 [2024-11-20 01:31:29.211549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.211665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.211691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.157 qpair failed and we were unable to recover it. 00:30:21.157 [2024-11-20 01:31:29.211809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.211924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.211950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.157 qpair failed and we were unable to recover it. 00:30:21.157 [2024-11-20 01:31:29.212037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.212184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.212211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.157 qpair failed and we were unable to recover it. 00:30:21.157 [2024-11-20 01:31:29.212297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.212413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.212439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.157 qpair failed and we were unable to recover it. 00:30:21.157 [2024-11-20 01:31:29.212531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.212618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.212644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.157 qpair failed and we were unable to recover it. 00:30:21.157 [2024-11-20 01:31:29.212762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.212850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.212875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.157 qpair failed and we were unable to recover it. 00:30:21.157 [2024-11-20 01:31:29.212996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.213103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.213138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.157 qpair failed and we were unable to recover it. 00:30:21.157 [2024-11-20 01:31:29.213265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.213409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.213434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.157 qpair failed and we were unable to recover it. 00:30:21.157 [2024-11-20 01:31:29.213521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.213649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.213674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.157 qpair failed and we were unable to recover it. 00:30:21.157 [2024-11-20 01:31:29.213803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.213948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.213974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.157 qpair failed and we were unable to recover it. 00:30:21.157 [2024-11-20 01:31:29.214120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.214251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.214278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.157 qpair failed and we were unable to recover it. 00:30:21.157 [2024-11-20 01:31:29.214395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.214524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.214550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.157 qpair failed and we were unable to recover it. 00:30:21.157 [2024-11-20 01:31:29.214646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.214730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.214756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.157 qpair failed and we were unable to recover it. 00:30:21.157 [2024-11-20 01:31:29.214849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.215010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.215038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.157 qpair failed and we were unable to recover it. 00:30:21.157 [2024-11-20 01:31:29.215158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.215279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.215306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.157 qpair failed and we were unable to recover it. 00:30:21.157 [2024-11-20 01:31:29.215420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.215513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.215541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.157 qpair failed and we were unable to recover it. 00:30:21.157 [2024-11-20 01:31:29.215663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.215801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.215831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.157 qpair failed and we were unable to recover it. 00:30:21.157 [2024-11-20 01:31:29.215975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.216062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.216096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.157 qpair failed and we were unable to recover it. 00:30:21.157 [2024-11-20 01:31:29.216241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.216400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.216427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.157 qpair failed and we were unable to recover it. 00:30:21.157 [2024-11-20 01:31:29.216564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.216650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.216676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.157 qpair failed and we were unable to recover it. 00:30:21.157 [2024-11-20 01:31:29.216771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.216858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.216884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.157 qpair failed and we were unable to recover it. 00:30:21.157 [2024-11-20 01:31:29.217008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.217157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.217187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.157 qpair failed and we were unable to recover it. 00:30:21.157 [2024-11-20 01:31:29.217314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.217407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.217437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.157 qpair failed and we were unable to recover it. 00:30:21.157 [2024-11-20 01:31:29.217571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.217700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.217726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.157 qpair failed and we were unable to recover it. 00:30:21.157 [2024-11-20 01:31:29.217859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.217977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.218005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.157 qpair failed and we were unable to recover it. 00:30:21.157 [2024-11-20 01:31:29.218137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.157 [2024-11-20 01:31:29.218263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.218293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.158 qpair failed and we were unable to recover it. 00:30:21.158 [2024-11-20 01:31:29.218408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.218523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.218549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.158 qpair failed and we were unable to recover it. 00:30:21.158 [2024-11-20 01:31:29.218697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.218788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.218818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.158 qpair failed and we were unable to recover it. 00:30:21.158 [2024-11-20 01:31:29.218952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.219052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.219100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.158 qpair failed and we were unable to recover it. 00:30:21.158 [2024-11-20 01:31:29.219237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.219328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.219355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.158 qpair failed and we were unable to recover it. 00:30:21.158 [2024-11-20 01:31:29.219488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.219575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.219603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.158 qpair failed and we were unable to recover it. 00:30:21.158 [2024-11-20 01:31:29.219745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.219832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.219860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.158 qpair failed and we were unable to recover it. 00:30:21.158 [2024-11-20 01:31:29.219973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.220056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.220091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.158 qpair failed and we were unable to recover it. 00:30:21.158 [2024-11-20 01:31:29.220184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.220304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.220329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.158 qpair failed and we were unable to recover it. 00:30:21.158 [2024-11-20 01:31:29.220415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.220502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.220530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.158 qpair failed and we were unable to recover it. 00:30:21.158 [2024-11-20 01:31:29.220673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.220772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.220801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.158 qpair failed and we were unable to recover it. 00:30:21.158 [2024-11-20 01:31:29.220931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.221055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.221099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.158 qpair failed and we were unable to recover it. 00:30:21.158 [2024-11-20 01:31:29.221244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.221332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.221377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.158 qpair failed and we were unable to recover it. 00:30:21.158 [2024-11-20 01:31:29.221491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.221609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.221635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.158 qpair failed and we were unable to recover it. 00:30:21.158 [2024-11-20 01:31:29.221769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.221904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.221930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.158 qpair failed and we were unable to recover it. 00:30:21.158 [2024-11-20 01:31:29.222046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.222138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.222182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.158 qpair failed and we were unable to recover it. 00:30:21.158 [2024-11-20 01:31:29.222311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.222432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.222458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.158 qpair failed and we were unable to recover it. 00:30:21.158 [2024-11-20 01:31:29.222588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.222758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.222784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.158 qpair failed and we were unable to recover it. 00:30:21.158 [2024-11-20 01:31:29.222878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.222959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.222984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.158 qpair failed and we were unable to recover it. 00:30:21.158 [2024-11-20 01:31:29.223085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.223208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.223233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.158 qpair failed and we were unable to recover it. 00:30:21.158 [2024-11-20 01:31:29.223317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.223433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.223458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.158 qpair failed and we were unable to recover it. 00:30:21.158 [2024-11-20 01:31:29.223542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.223621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.223646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.158 qpair failed and we were unable to recover it. 00:30:21.158 [2024-11-20 01:31:29.223766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.223843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.223869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.158 qpair failed and we were unable to recover it. 00:30:21.158 [2024-11-20 01:31:29.224011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.224157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.224186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.158 qpair failed and we were unable to recover it. 00:30:21.158 [2024-11-20 01:31:29.224285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.224419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.224449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.158 qpair failed and we were unable to recover it. 00:30:21.158 [2024-11-20 01:31:29.224570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.224689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.224715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.158 qpair failed and we were unable to recover it. 00:30:21.158 [2024-11-20 01:31:29.224807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.224943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.224971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.158 qpair failed and we were unable to recover it. 00:30:21.158 [2024-11-20 01:31:29.225067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.225195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.225223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.158 qpair failed and we were unable to recover it. 00:30:21.158 [2024-11-20 01:31:29.225325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.225442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.225466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.158 qpair failed and we were unable to recover it. 00:30:21.158 [2024-11-20 01:31:29.225603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.225759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.225787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.158 qpair failed and we were unable to recover it. 00:30:21.158 [2024-11-20 01:31:29.225959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.226042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.226067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.158 qpair failed and we were unable to recover it. 00:30:21.158 [2024-11-20 01:31:29.226193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.226282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.226308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.158 qpair failed and we were unable to recover it. 00:30:21.158 [2024-11-20 01:31:29.226418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.226575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.226603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.158 qpair failed and we were unable to recover it. 00:30:21.158 [2024-11-20 01:31:29.226697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.226839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.226864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.158 qpair failed and we were unable to recover it. 00:30:21.158 [2024-11-20 01:31:29.226982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.227105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.227131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.158 qpair failed and we were unable to recover it. 00:30:21.158 [2024-11-20 01:31:29.227252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.227382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.227408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.158 qpair failed and we were unable to recover it. 00:30:21.158 [2024-11-20 01:31:29.227490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.227606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.227636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.158 qpair failed and we were unable to recover it. 00:30:21.158 [2024-11-20 01:31:29.227769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.227854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.227880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.158 qpair failed and we were unable to recover it. 00:30:21.158 [2024-11-20 01:31:29.227972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.228061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.158 [2024-11-20 01:31:29.228095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.158 qpair failed and we were unable to recover it. 00:30:21.158 [2024-11-20 01:31:29.228216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.228353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.228378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.159 qpair failed and we were unable to recover it. 00:30:21.159 [2024-11-20 01:31:29.228475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.228583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.228607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.159 qpair failed and we were unable to recover it. 00:30:21.159 [2024-11-20 01:31:29.228724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.228860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.228888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.159 qpair failed and we were unable to recover it. 00:30:21.159 [2024-11-20 01:31:29.229020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.229115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.229145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.159 qpair failed and we were unable to recover it. 00:30:21.159 [2024-11-20 01:31:29.229287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.229373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.229398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.159 qpair failed and we were unable to recover it. 00:30:21.159 [2024-11-20 01:31:29.229515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.229663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.229691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.159 qpair failed and we were unable to recover it. 00:30:21.159 [2024-11-20 01:31:29.229815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.229973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.229999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.159 qpair failed and we were unable to recover it. 00:30:21.159 [2024-11-20 01:31:29.230124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.230218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.230245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.159 qpair failed and we were unable to recover it. 00:30:21.159 [2024-11-20 01:31:29.230337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.230454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.230480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.159 qpair failed and we were unable to recover it. 00:30:21.159 [2024-11-20 01:31:29.230565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.230705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.230731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.159 qpair failed and we were unable to recover it. 00:30:21.159 [2024-11-20 01:31:29.230846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.230958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.230983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.159 qpair failed and we were unable to recover it. 00:30:21.159 [2024-11-20 01:31:29.231155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.231284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.231312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.159 qpair failed and we were unable to recover it. 00:30:21.159 [2024-11-20 01:31:29.231481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.231593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.231618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.159 qpair failed and we were unable to recover it. 00:30:21.159 [2024-11-20 01:31:29.231741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.231828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.231855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.159 qpair failed and we were unable to recover it. 00:30:21.159 [2024-11-20 01:31:29.231992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.232120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.232150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.159 qpair failed and we were unable to recover it. 00:30:21.159 [2024-11-20 01:31:29.232255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.232363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.232391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.159 qpair failed and we were unable to recover it. 00:30:21.159 [2024-11-20 01:31:29.232517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.232632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.232658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.159 qpair failed and we were unable to recover it. 00:30:21.159 [2024-11-20 01:31:29.232793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.232935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.232960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.159 qpair failed and we were unable to recover it. 00:30:21.159 [2024-11-20 01:31:29.233104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.233251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.233279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.159 qpair failed and we were unable to recover it. 00:30:21.159 [2024-11-20 01:31:29.233385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.233463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.233488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.159 qpair failed and we were unable to recover it. 00:30:21.159 [2024-11-20 01:31:29.233605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.233692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.233718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.159 qpair failed and we were unable to recover it. 00:30:21.159 [2024-11-20 01:31:29.233828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.233928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.233956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.159 qpair failed and we were unable to recover it. 00:30:21.159 [2024-11-20 01:31:29.234078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.234161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.234186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.159 qpair failed and we were unable to recover it. 00:30:21.159 [2024-11-20 01:31:29.234356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.234515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.234547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.159 qpair failed and we were unable to recover it. 00:30:21.159 [2024-11-20 01:31:29.234681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.234770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.234797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.159 qpair failed and we were unable to recover it. 00:30:21.159 [2024-11-20 01:31:29.234908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.235015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.235040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.159 qpair failed and we were unable to recover it. 00:30:21.159 [2024-11-20 01:31:29.235140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.235252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.235279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.159 qpair failed and we were unable to recover it. 00:30:21.159 [2024-11-20 01:31:29.235384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.235502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.235529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.159 qpair failed and we were unable to recover it. 00:30:21.159 [2024-11-20 01:31:29.235639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.235736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.235760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.159 qpair failed and we were unable to recover it. 00:30:21.159 [2024-11-20 01:31:29.235880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.235996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.236020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.159 qpair failed and we were unable to recover it. 00:30:21.159 [2024-11-20 01:31:29.236120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.236213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.236238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.159 qpair failed and we were unable to recover it. 00:30:21.159 [2024-11-20 01:31:29.236323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.236438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.236462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.159 qpair failed and we were unable to recover it. 00:30:21.159 [2024-11-20 01:31:29.236628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.236782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.236809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.159 qpair failed and we were unable to recover it. 00:30:21.159 [2024-11-20 01:31:29.236918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.237044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.237077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.159 qpair failed and we were unable to recover it. 00:30:21.159 [2024-11-20 01:31:29.237190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.237282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.237308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.159 qpair failed and we were unable to recover it. 00:30:21.159 [2024-11-20 01:31:29.237443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.237536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.237563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.159 qpair failed and we were unable to recover it. 00:30:21.159 [2024-11-20 01:31:29.237705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.237827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.237851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.159 qpair failed and we were unable to recover it. 00:30:21.159 [2024-11-20 01:31:29.237934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.238019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.238044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.159 qpair failed and we were unable to recover it. 00:30:21.159 [2024-11-20 01:31:29.238176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.238293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.238335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.159 qpair failed and we were unable to recover it. 00:30:21.159 [2024-11-20 01:31:29.238467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.238645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.238669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.159 qpair failed and we were unable to recover it. 00:30:21.159 [2024-11-20 01:31:29.238784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.238905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.238930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.159 qpair failed and we were unable to recover it. 00:30:21.159 [2024-11-20 01:31:29.239026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.239199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.239226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.159 qpair failed and we were unable to recover it. 00:30:21.159 [2024-11-20 01:31:29.239397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.239491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.239516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.159 qpair failed and we were unable to recover it. 00:30:21.159 [2024-11-20 01:31:29.239618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.159 [2024-11-20 01:31:29.239764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.239789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.160 qpair failed and we were unable to recover it. 00:30:21.160 [2024-11-20 01:31:29.239902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.240017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.240041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.160 qpair failed and we were unable to recover it. 00:30:21.160 [2024-11-20 01:31:29.240178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.240266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.240289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.160 qpair failed and we were unable to recover it. 00:30:21.160 [2024-11-20 01:31:29.240418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.240534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.240559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.160 qpair failed and we were unable to recover it. 00:30:21.160 [2024-11-20 01:31:29.240650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.240760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.240787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.160 qpair failed and we were unable to recover it. 00:30:21.160 [2024-11-20 01:31:29.240900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.241040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.241065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.160 qpair failed and we were unable to recover it. 00:30:21.160 [2024-11-20 01:31:29.241195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.241310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.241334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.160 qpair failed and we were unable to recover it. 00:30:21.160 [2024-11-20 01:31:29.241426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.241564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.241591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.160 qpair failed and we were unable to recover it. 00:30:21.160 [2024-11-20 01:31:29.241692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.241795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.241823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.160 qpair failed and we were unable to recover it. 00:30:21.160 [2024-11-20 01:31:29.241965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.242116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.242142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.160 qpair failed and we were unable to recover it. 00:30:21.160 [2024-11-20 01:31:29.242244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.242342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.242371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.160 qpair failed and we were unable to recover it. 00:30:21.160 [2024-11-20 01:31:29.242479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.242583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.242610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.160 qpair failed and we were unable to recover it. 00:30:21.160 [2024-11-20 01:31:29.242716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.242850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.242876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.160 qpair failed and we were unable to recover it. 00:30:21.160 [2024-11-20 01:31:29.242992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.243123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.243150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.160 qpair failed and we were unable to recover it. 00:30:21.160 [2024-11-20 01:31:29.243262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.243381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.243405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.160 qpair failed and we were unable to recover it. 00:30:21.160 [2024-11-20 01:31:29.243493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.243616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.243641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.160 qpair failed and we were unable to recover it. 00:30:21.160 [2024-11-20 01:31:29.243766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.243909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.243932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.160 qpair failed and we were unable to recover it. 00:30:21.160 [2024-11-20 01:31:29.244023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.244146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.244171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.160 qpair failed and we were unable to recover it. 00:30:21.160 [2024-11-20 01:31:29.244283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.244390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.244415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.160 qpair failed and we were unable to recover it. 00:30:21.160 [2024-11-20 01:31:29.244552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.244716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.244740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.160 qpair failed and we were unable to recover it. 00:30:21.160 [2024-11-20 01:31:29.244865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.244972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.244998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.160 qpair failed and we were unable to recover it. 00:30:21.160 [2024-11-20 01:31:29.245135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.245222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.245247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.160 qpair failed and we were unable to recover it. 00:30:21.160 [2024-11-20 01:31:29.245368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.245453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.245480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.160 qpair failed and we were unable to recover it. 00:30:21.160 [2024-11-20 01:31:29.245565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.245676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.245721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.160 qpair failed and we were unable to recover it. 00:30:21.160 [2024-11-20 01:31:29.245832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.245946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.245970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.160 qpair failed and we were unable to recover it. 00:30:21.160 [2024-11-20 01:31:29.246090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.246236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.246260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.160 qpair failed and we were unable to recover it. 00:30:21.160 [2024-11-20 01:31:29.246343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.246507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.246533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.160 qpair failed and we were unable to recover it. 00:30:21.160 [2024-11-20 01:31:29.246666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.246779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.246803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.160 qpair failed and we were unable to recover it. 00:30:21.160 [2024-11-20 01:31:29.246947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.247055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.247095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.160 qpair failed and we were unable to recover it. 00:30:21.160 [2024-11-20 01:31:29.247233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.247320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.247345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.160 qpair failed and we were unable to recover it. 00:30:21.160 [2024-11-20 01:31:29.247432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.247553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.247577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.160 qpair failed and we were unable to recover it. 00:30:21.160 [2024-11-20 01:31:29.247720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.247825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.247852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.160 qpair failed and we were unable to recover it. 00:30:21.160 [2024-11-20 01:31:29.247952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.248085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.248112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.160 qpair failed and we were unable to recover it. 00:30:21.160 [2024-11-20 01:31:29.248228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.248340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.248365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.160 qpair failed and we were unable to recover it. 00:30:21.160 [2024-11-20 01:31:29.248473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.248563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.248589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.160 qpair failed and we were unable to recover it. 00:30:21.160 [2024-11-20 01:31:29.248710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.248834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.248861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.160 qpair failed and we were unable to recover it. 00:30:21.160 [2024-11-20 01:31:29.248974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.249103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.249127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.160 qpair failed and we were unable to recover it. 00:30:21.160 [2024-11-20 01:31:29.249232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.249333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.249359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.160 qpair failed and we were unable to recover it. 00:30:21.160 [2024-11-20 01:31:29.249449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.249585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.249609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.160 qpair failed and we were unable to recover it. 00:30:21.160 [2024-11-20 01:31:29.249698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.249804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.249830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.160 qpair failed and we were unable to recover it. 00:30:21.160 [2024-11-20 01:31:29.249939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.250026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.250058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.160 qpair failed and we were unable to recover it. 00:30:21.160 [2024-11-20 01:31:29.250188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.250325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.250351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.160 qpair failed and we were unable to recover it. 00:30:21.160 [2024-11-20 01:31:29.250436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.250551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.250575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.160 qpair failed and we were unable to recover it. 00:30:21.160 [2024-11-20 01:31:29.250692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.250811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.250853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.160 qpair failed and we were unable to recover it. 00:30:21.160 [2024-11-20 01:31:29.250955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.251112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.251141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.160 qpair failed and we were unable to recover it. 00:30:21.160 [2024-11-20 01:31:29.251254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.251375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.251400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.160 qpair failed and we were unable to recover it. 00:30:21.160 [2024-11-20 01:31:29.251489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.251611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.251635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.160 qpair failed and we were unable to recover it. 00:30:21.160 [2024-11-20 01:31:29.251752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.160 [2024-11-20 01:31:29.251871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.251895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.161 qpair failed and we were unable to recover it. 00:30:21.161 [2024-11-20 01:31:29.252010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.252139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.252165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.161 qpair failed and we were unable to recover it. 00:30:21.161 [2024-11-20 01:31:29.252276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.252404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.252441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.161 qpair failed and we were unable to recover it. 00:30:21.161 [2024-11-20 01:31:29.252570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.252660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.252691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.161 qpair failed and we were unable to recover it. 00:30:21.161 [2024-11-20 01:31:29.252830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.252948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.252972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.161 qpair failed and we were unable to recover it. 00:30:21.161 [2024-11-20 01:31:29.253082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.253211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.253240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.161 qpair failed and we were unable to recover it. 00:30:21.161 [2024-11-20 01:31:29.253371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.253501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.253535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.161 qpair failed and we were unable to recover it. 00:30:21.161 [2024-11-20 01:31:29.253677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.253787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.253812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.161 qpair failed and we were unable to recover it. 00:30:21.161 [2024-11-20 01:31:29.253935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.254082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.254107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.161 qpair failed and we were unable to recover it. 00:30:21.161 [2024-11-20 01:31:29.254246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.254383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.254418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.161 qpair failed and we were unable to recover it. 00:30:21.161 [2024-11-20 01:31:29.254517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.254675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.254703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.161 qpair failed and we were unable to recover it. 00:30:21.161 [2024-11-20 01:31:29.254845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.254938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.254962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.161 qpair failed and we were unable to recover it. 00:30:21.161 [2024-11-20 01:31:29.255061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.255226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.255253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.161 qpair failed and we were unable to recover it. 00:30:21.161 [2024-11-20 01:31:29.255385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.255502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.255531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.161 qpair failed and we were unable to recover it. 00:30:21.161 [2024-11-20 01:31:29.255616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.255727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.255751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.161 qpair failed and we were unable to recover it. 00:30:21.161 [2024-11-20 01:31:29.255889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.256007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.256033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.161 qpair failed and we were unable to recover it. 00:30:21.161 [2024-11-20 01:31:29.256178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.256287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.256312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.161 qpair failed and we were unable to recover it. 00:30:21.161 [2024-11-20 01:31:29.256415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.256564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.256589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.161 qpair failed and we were unable to recover it. 00:30:21.161 [2024-11-20 01:31:29.256720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.256843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.256886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.161 qpair failed and we were unable to recover it. 00:30:21.161 [2024-11-20 01:31:29.257004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.257149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.257175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.161 qpair failed and we were unable to recover it. 00:30:21.161 [2024-11-20 01:31:29.257299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.257466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.257491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.161 qpair failed and we were unable to recover it. 00:30:21.161 [2024-11-20 01:31:29.257579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.257723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.257747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.161 qpair failed and we were unable to recover it. 00:30:21.161 [2024-11-20 01:31:29.257833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.257980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.258004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.161 qpair failed and we were unable to recover it. 00:30:21.161 [2024-11-20 01:31:29.258170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.258254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.258282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.161 qpair failed and we were unable to recover it. 00:30:21.161 [2024-11-20 01:31:29.258381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.258516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.258543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.161 qpair failed and we were unable to recover it. 00:30:21.161 [2024-11-20 01:31:29.258659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.258773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.258797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.161 qpair failed and we were unable to recover it. 00:30:21.161 [2024-11-20 01:31:29.258929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.259035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.259063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.161 qpair failed and we were unable to recover it. 00:30:21.161 [2024-11-20 01:31:29.259160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.259260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.259289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.161 qpair failed and we were unable to recover it. 00:30:21.161 [2024-11-20 01:31:29.259433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.259551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.259576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.161 qpair failed and we were unable to recover it. 00:30:21.161 [2024-11-20 01:31:29.259706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.259820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.259848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.161 qpair failed and we were unable to recover it. 00:30:21.161 [2024-11-20 01:31:29.259944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.260043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.260076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.161 qpair failed and we were unable to recover it. 00:30:21.161 [2024-11-20 01:31:29.260220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.260304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.260329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.161 qpair failed and we were unable to recover it. 00:30:21.161 [2024-11-20 01:31:29.260459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.260581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.260608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.161 qpair failed and we were unable to recover it. 00:30:21.161 [2024-11-20 01:31:29.260746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.260860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.260884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.161 qpair failed and we were unable to recover it. 00:30:21.161 [2024-11-20 01:31:29.261033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.261164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.261190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.161 qpair failed and we were unable to recover it. 00:30:21.161 [2024-11-20 01:31:29.261316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.261442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.261472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.161 qpair failed and we were unable to recover it. 00:30:21.161 [2024-11-20 01:31:29.261611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.261752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.261776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.161 qpair failed and we were unable to recover it. 00:30:21.161 [2024-11-20 01:31:29.261892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.262008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.262033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.161 qpair failed and we were unable to recover it. 00:30:21.161 [2024-11-20 01:31:29.262221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.262311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.262335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.161 qpair failed and we were unable to recover it. 00:30:21.161 [2024-11-20 01:31:29.262457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.262560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.262603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.161 qpair failed and we were unable to recover it. 00:30:21.161 [2024-11-20 01:31:29.262722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.262808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.262834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.161 qpair failed and we were unable to recover it. 00:30:21.161 [2024-11-20 01:31:29.262948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.263097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.161 [2024-11-20 01:31:29.263125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.162 qpair failed and we were unable to recover it. 00:30:21.162 [2024-11-20 01:31:29.263238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.263334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.263360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.162 qpair failed and we were unable to recover it. 00:30:21.162 [2024-11-20 01:31:29.263503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.263620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.263644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.162 qpair failed and we were unable to recover it. 00:30:21.162 [2024-11-20 01:31:29.263769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.263886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.263927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.162 qpair failed and we were unable to recover it. 00:30:21.162 [2024-11-20 01:31:29.264056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.264193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.264220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.162 qpair failed and we were unable to recover it. 00:30:21.162 [2024-11-20 01:31:29.264327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.264454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.264478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.162 qpair failed and we were unable to recover it. 00:30:21.162 [2024-11-20 01:31:29.264609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.264771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.264798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.162 qpair failed and we were unable to recover it. 00:30:21.162 [2024-11-20 01:31:29.264890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.264990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.265019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.162 qpair failed and we were unable to recover it. 00:30:21.162 [2024-11-20 01:31:29.265165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.265253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.265278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.162 qpair failed and we were unable to recover it. 00:30:21.162 [2024-11-20 01:31:29.265434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.265535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.265564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.162 qpair failed and we were unable to recover it. 00:30:21.162 [2024-11-20 01:31:29.265672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.265770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.265795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.162 qpair failed and we were unable to recover it. 00:30:21.162 [2024-11-20 01:31:29.265915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.266002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.266025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.162 qpair failed and we were unable to recover it. 00:30:21.162 [2024-11-20 01:31:29.266140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.266237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.266264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.162 qpair failed and we were unable to recover it. 00:30:21.162 [2024-11-20 01:31:29.266363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.266490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.266516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.162 qpair failed and we were unable to recover it. 00:30:21.162 [2024-11-20 01:31:29.266628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.266719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.266744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.162 qpair failed and we were unable to recover it. 00:30:21.162 [2024-11-20 01:31:29.266837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.266947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.266971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.162 qpair failed and we were unable to recover it. 00:30:21.162 [2024-11-20 01:31:29.267061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.267196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.267223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.162 qpair failed and we were unable to recover it. 00:30:21.162 [2024-11-20 01:31:29.267387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.267474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.267498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.162 qpair failed and we were unable to recover it. 00:30:21.162 [2024-11-20 01:31:29.267604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.267697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.267724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.162 qpair failed and we were unable to recover it. 00:30:21.162 [2024-11-20 01:31:29.267847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.267973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.268000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.162 qpair failed and we were unable to recover it. 00:30:21.162 [2024-11-20 01:31:29.268131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.268217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.268241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.162 qpair failed and we were unable to recover it. 00:30:21.162 [2024-11-20 01:31:29.268355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.268439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.268466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.162 qpair failed and we were unable to recover it. 00:30:21.162 [2024-11-20 01:31:29.268633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.268753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.268777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.162 qpair failed and we were unable to recover it. 00:30:21.162 [2024-11-20 01:31:29.268898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.269007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.269032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.162 qpair failed and we were unable to recover it. 00:30:21.162 [2024-11-20 01:31:29.269203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.269345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.269370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.162 qpair failed and we were unable to recover it. 00:30:21.162 [2024-11-20 01:31:29.269530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.269709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.269733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.162 qpair failed and we were unable to recover it. 00:30:21.162 [2024-11-20 01:31:29.269888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.270001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.270027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.162 qpair failed and we were unable to recover it. 00:30:21.162 [2024-11-20 01:31:29.270153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.270261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.270302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.162 qpair failed and we were unable to recover it. 00:30:21.162 [2024-11-20 01:31:29.270387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.270503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.270544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.162 qpair failed and we were unable to recover it. 00:30:21.162 [2024-11-20 01:31:29.270696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.270810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.270835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.162 qpair failed and we were unable to recover it. 00:30:21.162 [2024-11-20 01:31:29.270920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.271002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.271028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.162 qpair failed and we were unable to recover it. 00:30:21.162 [2024-11-20 01:31:29.271243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.271378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.271404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.162 qpair failed and we were unable to recover it. 00:30:21.162 [2024-11-20 01:31:29.271520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.271629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.271653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.162 qpair failed and we were unable to recover it. 00:30:21.162 [2024-11-20 01:31:29.271750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.271837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.271861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.162 qpair failed and we were unable to recover it. 00:30:21.162 [2024-11-20 01:31:29.271980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.272076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.272118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.162 qpair failed and we were unable to recover it. 00:30:21.162 [2024-11-20 01:31:29.272284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.272373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.272397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.162 qpair failed and we were unable to recover it. 00:30:21.162 [2024-11-20 01:31:29.272553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.272640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.272665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.162 qpair failed and we were unable to recover it. 00:30:21.162 [2024-11-20 01:31:29.272773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.272866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.272892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.162 qpair failed and we were unable to recover it. 00:30:21.162 [2024-11-20 01:31:29.273005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.273088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.273114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.162 qpair failed and we were unable to recover it. 00:30:21.162 [2024-11-20 01:31:29.273230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.273364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.273390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.162 qpair failed and we were unable to recover it. 00:30:21.162 [2024-11-20 01:31:29.273512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.273598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.273625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.162 qpair failed and we were unable to recover it. 00:30:21.162 [2024-11-20 01:31:29.273729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.273838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.273864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.162 qpair failed and we were unable to recover it. 00:30:21.162 [2024-11-20 01:31:29.273942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.274032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.162 [2024-11-20 01:31:29.274056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.162 qpair failed and we were unable to recover it. 00:30:21.162 [2024-11-20 01:31:29.274179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.274310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.274337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.163 qpair failed and we were unable to recover it. 00:30:21.163 [2024-11-20 01:31:29.274472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.274613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.274637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.163 qpair failed and we were unable to recover it. 00:30:21.163 [2024-11-20 01:31:29.274766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.274893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.274919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.163 qpair failed and we were unable to recover it. 00:30:21.163 [2024-11-20 01:31:29.275018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.275120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.275162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.163 qpair failed and we were unable to recover it. 00:30:21.163 [2024-11-20 01:31:29.275246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.275362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.275386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.163 qpair failed and we were unable to recover it. 00:30:21.163 [2024-11-20 01:31:29.275474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.275589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.275613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.163 qpair failed and we were unable to recover it. 00:30:21.163 [2024-11-20 01:31:29.275722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.275865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.275892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.163 qpair failed and we were unable to recover it. 00:30:21.163 [2024-11-20 01:31:29.275994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.276081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.276105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.163 qpair failed and we were unable to recover it. 00:30:21.163 [2024-11-20 01:31:29.276207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.276309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.276335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.163 qpair failed and we were unable to recover it. 00:30:21.163 [2024-11-20 01:31:29.276453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.276544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.276570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.163 qpair failed and we were unable to recover it. 00:30:21.163 [2024-11-20 01:31:29.276699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.276818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.276843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.163 qpair failed and we were unable to recover it. 00:30:21.163 [2024-11-20 01:31:29.276927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.277039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.277066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.163 qpair failed and we were unable to recover it. 00:30:21.163 [2024-11-20 01:31:29.277202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.277344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.277369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.163 qpair failed and we were unable to recover it. 00:30:21.163 [2024-11-20 01:31:29.277460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.277578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.277603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.163 qpair failed and we were unable to recover it. 00:30:21.163 [2024-11-20 01:31:29.277721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.277856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.277880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.163 qpair failed and we were unable to recover it. 00:30:21.163 [2024-11-20 01:31:29.277966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.278082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.278108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.163 qpair failed and we were unable to recover it. 00:30:21.163 [2024-11-20 01:31:29.278226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.278345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.278380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.163 qpair failed and we were unable to recover it. 00:30:21.163 [2024-11-20 01:31:29.278473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.278587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.278614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.163 qpair failed and we were unable to recover it. 00:30:21.163 [2024-11-20 01:31:29.278745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.278827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.278854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.163 qpair failed and we were unable to recover it. 00:30:21.163 [2024-11-20 01:31:29.279014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.279106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.279132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.163 qpair failed and we were unable to recover it. 00:30:21.163 [2024-11-20 01:31:29.279243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.279370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.279397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.163 qpair failed and we were unable to recover it. 00:30:21.163 [2024-11-20 01:31:29.279487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.279660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.279685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.163 qpair failed and we were unable to recover it. 00:30:21.163 [2024-11-20 01:31:29.279779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.279920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.279944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.163 qpair failed and we were unable to recover it. 00:30:21.163 [2024-11-20 01:31:29.280081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.280185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.280212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.163 qpair failed and we were unable to recover it. 00:30:21.163 [2024-11-20 01:31:29.280309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.280411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.280438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.163 qpair failed and we were unable to recover it. 00:30:21.163 [2024-11-20 01:31:29.280544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.280623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.280647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.163 qpair failed and we were unable to recover it. 00:30:21.163 [2024-11-20 01:31:29.280766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.280882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.280911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.163 qpair failed and we were unable to recover it. 00:30:21.163 [2024-11-20 01:31:29.281044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.281150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.281178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.163 qpair failed and we were unable to recover it. 00:30:21.163 [2024-11-20 01:31:29.281299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.281381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.281406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.163 qpair failed and we were unable to recover it. 00:30:21.163 [2024-11-20 01:31:29.281525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.281633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.281674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.163 qpair failed and we were unable to recover it. 00:30:21.163 [2024-11-20 01:31:29.281806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.281897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.281924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.163 qpair failed and we were unable to recover it. 00:30:21.163 [2024-11-20 01:31:29.282065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.282168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.282193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.163 qpair failed and we were unable to recover it. 00:30:21.163 [2024-11-20 01:31:29.282337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.282480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.282505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.163 qpair failed and we were unable to recover it. 00:30:21.163 [2024-11-20 01:31:29.282638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.282767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.282794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.163 qpair failed and we were unable to recover it. 00:30:21.163 [2024-11-20 01:31:29.282930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.283023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.283048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.163 qpair failed and we were unable to recover it. 00:30:21.163 [2024-11-20 01:31:29.283220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.283334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.283378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.163 qpair failed and we were unable to recover it. 00:30:21.163 [2024-11-20 01:31:29.283494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.283579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.283618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.163 qpair failed and we were unable to recover it. 00:30:21.163 [2024-11-20 01:31:29.283728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.283819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.283843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.163 qpair failed and we were unable to recover it. 00:30:21.163 [2024-11-20 01:31:29.283931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.284045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.284078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.163 qpair failed and we were unable to recover it. 00:30:21.163 [2024-11-20 01:31:29.284191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.284312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.284340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.163 qpair failed and we were unable to recover it. 00:30:21.163 [2024-11-20 01:31:29.284473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.284564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.163 [2024-11-20 01:31:29.284589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.163 qpair failed and we were unable to recover it. 00:30:21.163 [2024-11-20 01:31:29.284698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.284814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.284840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.164 qpair failed and we were unable to recover it. 00:30:21.164 [2024-11-20 01:31:29.284983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.285114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.285167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.164 qpair failed and we were unable to recover it. 00:30:21.164 [2024-11-20 01:31:29.285280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.285399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.285424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.164 qpair failed and we were unable to recover it. 00:30:21.164 [2024-11-20 01:31:29.285526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.285620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.285649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.164 qpair failed and we were unable to recover it. 00:30:21.164 [2024-11-20 01:31:29.285775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.285865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.285893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.164 qpair failed and we were unable to recover it. 00:30:21.164 [2024-11-20 01:31:29.285999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.286096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.286122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.164 qpair failed and we were unable to recover it. 00:30:21.164 [2024-11-20 01:31:29.286230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.286327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.286369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.164 qpair failed and we were unable to recover it. 00:30:21.164 [2024-11-20 01:31:29.286474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.286596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.286622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.164 qpair failed and we were unable to recover it. 00:30:21.164 [2024-11-20 01:31:29.286739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.286856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.286881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.164 qpair failed and we were unable to recover it. 00:30:21.164 [2024-11-20 01:31:29.287009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.287138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.287166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.164 qpair failed and we were unable to recover it. 00:30:21.164 [2024-11-20 01:31:29.287273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.287400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.287425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.164 qpair failed and we were unable to recover it. 00:30:21.164 [2024-11-20 01:31:29.287535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.287627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.287651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.164 qpair failed and we were unable to recover it. 00:30:21.164 [2024-11-20 01:31:29.287767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.287884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.287928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.164 qpair failed and we were unable to recover it. 00:30:21.164 [2024-11-20 01:31:29.288028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.288200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.288224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.164 qpair failed and we were unable to recover it. 00:30:21.164 [2024-11-20 01:31:29.288346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.288465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.288489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.164 qpair failed and we were unable to recover it. 00:30:21.164 [2024-11-20 01:31:29.288590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.288717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.288744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.164 qpair failed and we were unable to recover it. 00:30:21.164 [2024-11-20 01:31:29.288868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.288990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.289017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.164 qpair failed and we were unable to recover it. 00:30:21.164 [2024-11-20 01:31:29.289127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.289218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.289242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.164 qpair failed and we were unable to recover it. 00:30:21.164 [2024-11-20 01:31:29.289384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.289492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.289516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.164 qpair failed and we were unable to recover it. 00:30:21.164 [2024-11-20 01:31:29.289606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.289698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.289740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.164 qpair failed and we were unable to recover it. 00:30:21.164 [2024-11-20 01:31:29.289869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.289949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.289973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.164 qpair failed and we were unable to recover it. 00:30:21.164 [2024-11-20 01:31:29.290066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.290180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.290222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.164 qpair failed and we were unable to recover it. 00:30:21.164 [2024-11-20 01:31:29.290340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.290507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.290533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.164 qpair failed and we were unable to recover it. 00:30:21.164 [2024-11-20 01:31:29.290707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.290822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.290846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.164 qpair failed and we were unable to recover it. 00:30:21.164 [2024-11-20 01:31:29.290939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.291016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.291039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.164 qpair failed and we were unable to recover it. 00:30:21.164 [2024-11-20 01:31:29.291142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.291263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.291288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.164 qpair failed and we were unable to recover it. 00:30:21.164 [2024-11-20 01:31:29.291373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.291460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.291484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.164 qpair failed and we were unable to recover it. 00:30:21.164 [2024-11-20 01:31:29.291574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.291701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.291728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.164 qpair failed and we were unable to recover it. 00:30:21.164 [2024-11-20 01:31:29.291858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.291965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.291994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.164 qpair failed and we were unable to recover it. 00:30:21.164 [2024-11-20 01:31:29.292105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.292240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.292279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.164 qpair failed and we were unable to recover it. 00:30:21.164 [2024-11-20 01:31:29.292400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.292494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.292519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.164 qpair failed and we were unable to recover it. 00:30:21.164 [2024-11-20 01:31:29.292610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.292705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.292731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.164 qpair failed and we were unable to recover it. 00:30:21.164 [2024-11-20 01:31:29.292888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.293033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.293062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.164 qpair failed and we were unable to recover it. 00:30:21.164 [2024-11-20 01:31:29.293180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.293299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.293323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.164 qpair failed and we were unable to recover it. 00:30:21.164 [2024-11-20 01:31:29.293435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.293557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.293584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.164 qpair failed and we were unable to recover it. 00:30:21.164 [2024-11-20 01:31:29.293686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.293847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.164 [2024-11-20 01:31:29.293871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.164 qpair failed and we were unable to recover it. 00:30:21.164 [2024-11-20 01:31:29.293988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.294112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.294138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.165 qpair failed and we were unable to recover it. 00:30:21.165 [2024-11-20 01:31:29.294227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.294329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.294365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.165 qpair failed and we were unable to recover it. 00:30:21.165 [2024-11-20 01:31:29.294465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.294550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.294575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.165 qpair failed and we were unable to recover it. 00:30:21.165 [2024-11-20 01:31:29.294693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.294803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.294836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.165 qpair failed and we were unable to recover it. 00:30:21.165 [2024-11-20 01:31:29.294964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.295135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.295160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.165 qpair failed and we were unable to recover it. 00:30:21.165 [2024-11-20 01:31:29.295251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.295388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.295413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.165 qpair failed and we were unable to recover it. 00:30:21.165 [2024-11-20 01:31:29.295534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.295664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.295692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.165 qpair failed and we were unable to recover it. 00:30:21.165 [2024-11-20 01:31:29.295800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.295921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.295948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.165 qpair failed and we were unable to recover it. 00:30:21.165 [2024-11-20 01:31:29.296062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.296177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.296202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.165 qpair failed and we were unable to recover it. 00:30:21.165 [2024-11-20 01:31:29.296290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.296443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.296470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.165 qpair failed and we were unable to recover it. 00:30:21.165 [2024-11-20 01:31:29.296571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.296687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.296712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.165 qpair failed and we were unable to recover it. 00:30:21.165 [2024-11-20 01:31:29.296801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.296887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.296911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.165 qpair failed and we were unable to recover it. 00:30:21.165 [2024-11-20 01:31:29.297022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.297147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.297172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.165 qpair failed and we were unable to recover it. 00:30:21.165 [2024-11-20 01:31:29.297260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.297361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.297398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.165 qpair failed and we were unable to recover it. 00:30:21.165 [2024-11-20 01:31:29.297518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.297634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.297658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.165 qpair failed and we were unable to recover it. 00:30:21.165 [2024-11-20 01:31:29.297766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.297853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.297877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.165 qpair failed and we were unable to recover it. 00:30:21.165 [2024-11-20 01:31:29.297970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.298075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.298110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.165 qpair failed and we were unable to recover it. 00:30:21.165 [2024-11-20 01:31:29.298203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.298347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.298372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.165 qpair failed and we were unable to recover it. 00:30:21.165 [2024-11-20 01:31:29.298470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.298566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.298592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.165 qpair failed and we were unable to recover it. 00:30:21.165 [2024-11-20 01:31:29.298681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.298798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.298835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.165 qpair failed and we were unable to recover it. 00:30:21.165 [2024-11-20 01:31:29.298924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.299041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.299066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.165 qpair failed and we were unable to recover it. 00:30:21.165 [2024-11-20 01:31:29.299188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.299306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.299333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.165 qpair failed and we were unable to recover it. 00:30:21.165 [2024-11-20 01:31:29.299460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.299574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.299599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.165 qpair failed and we were unable to recover it. 00:30:21.165 [2024-11-20 01:31:29.299693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.299784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.299809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.165 qpair failed and we were unable to recover it. 00:30:21.165 [2024-11-20 01:31:29.299961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.300075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.300101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.165 qpair failed and we were unable to recover it. 00:30:21.165 [2024-11-20 01:31:29.300195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.300311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.300336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.165 qpair failed and we were unable to recover it. 00:30:21.165 [2024-11-20 01:31:29.300429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.300527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.300555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.165 qpair failed and we were unable to recover it. 00:30:21.165 [2024-11-20 01:31:29.300674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.300817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.300845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.165 qpair failed and we were unable to recover it. 00:30:21.165 [2024-11-20 01:31:29.300949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.301050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.301087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.165 qpair failed and we were unable to recover it. 00:30:21.165 [2024-11-20 01:31:29.301228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.301320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.301345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.165 qpair failed and we were unable to recover it. 00:30:21.165 [2024-11-20 01:31:29.301451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.301568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.301594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.165 qpair failed and we were unable to recover it. 00:30:21.165 [2024-11-20 01:31:29.301719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.301830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.301857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.165 qpair failed and we were unable to recover it. 00:30:21.165 [2024-11-20 01:31:29.301998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.302111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.302136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.165 qpair failed and we were unable to recover it. 00:30:21.165 [2024-11-20 01:31:29.302214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.302305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.302329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.165 qpair failed and we were unable to recover it. 00:30:21.165 [2024-11-20 01:31:29.302474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.302566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.302610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.165 qpair failed and we were unable to recover it. 00:30:21.165 [2024-11-20 01:31:29.302746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.302912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.302939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.165 qpair failed and we were unable to recover it. 00:30:21.165 [2024-11-20 01:31:29.303043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.303171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.303196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.165 qpair failed and we were unable to recover it. 00:30:21.165 [2024-11-20 01:31:29.303279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.303373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.303397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.165 qpair failed and we were unable to recover it. 00:30:21.165 [2024-11-20 01:31:29.303493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.303596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.303623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.165 qpair failed and we were unable to recover it. 00:30:21.165 [2024-11-20 01:31:29.303719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.303841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-20 01:31:29.303867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.165 qpair failed and we were unable to recover it. 00:30:21.165 [2024-11-20 01:31:29.304006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-20 01:31:29.304140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-20 01:31:29.304167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.166 qpair failed and we were unable to recover it. 00:30:21.166 [2024-11-20 01:31:29.304269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-20 01:31:29.304393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-20 01:31:29.304419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.166 qpair failed and we were unable to recover it. 00:30:21.166 [2024-11-20 01:31:29.304617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-20 01:31:29.304747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-20 01:31:29.304774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.166 qpair failed and we were unable to recover it. 00:30:21.166 [2024-11-20 01:31:29.304901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-20 01:31:29.305025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-20 01:31:29.305053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.166 qpair failed and we were unable to recover it. 00:30:21.166 [2024-11-20 01:31:29.305167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-20 01:31:29.305250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-20 01:31:29.305290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.166 qpair failed and we were unable to recover it. 00:30:21.166 [2024-11-20 01:31:29.305419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-20 01:31:29.305510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-20 01:31:29.305538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.166 qpair failed and we were unable to recover it. 00:30:21.166 [2024-11-20 01:31:29.305630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-20 01:31:29.305750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-20 01:31:29.305778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.166 qpair failed and we were unable to recover it. 00:30:21.166 [2024-11-20 01:31:29.305863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-20 01:31:29.305958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-20 01:31:29.305999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.166 qpair failed and we were unable to recover it. 00:30:21.166 [2024-11-20 01:31:29.306092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-20 01:31:29.306182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-20 01:31:29.306206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.166 qpair failed and we were unable to recover it. 00:30:21.166 [2024-11-20 01:31:29.306298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-20 01:31:29.306446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-20 01:31:29.306473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.166 qpair failed and we were unable to recover it. 00:30:21.166 [2024-11-20 01:31:29.306583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-20 01:31:29.306757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-20 01:31:29.306784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.166 qpair failed and we were unable to recover it. 00:30:21.166 [2024-11-20 01:31:29.306916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-20 01:31:29.307047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-20 01:31:29.307117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.166 qpair failed and we were unable to recover it. 00:30:21.166 [2024-11-20 01:31:29.307235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-20 01:31:29.307331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-20 01:31:29.307373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.166 qpair failed and we were unable to recover it. 00:30:21.166 [2024-11-20 01:31:29.307592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-20 01:31:29.307720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-20 01:31:29.307747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.166 qpair failed and we were unable to recover it. 00:30:21.166 [2024-11-20 01:31:29.307887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-20 01:31:29.308001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-20 01:31:29.308042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.166 qpair failed and we were unable to recover it. 00:30:21.166 [2024-11-20 01:31:29.308166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.451 [2024-11-20 01:31:29.308248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.451 [2024-11-20 01:31:29.308274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.451 qpair failed and we were unable to recover it. 00:30:21.451 [2024-11-20 01:31:29.308412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.451 [2024-11-20 01:31:29.308567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.451 [2024-11-20 01:31:29.308595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.451 qpair failed and we were unable to recover it. 00:30:21.451 [2024-11-20 01:31:29.308701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.451 [2024-11-20 01:31:29.308794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.451 [2024-11-20 01:31:29.308821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.451 qpair failed and we were unable to recover it. 00:30:21.451 [2024-11-20 01:31:29.308945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.451 [2024-11-20 01:31:29.309094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.451 [2024-11-20 01:31:29.309138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.451 qpair failed and we were unable to recover it. 00:30:21.451 [2024-11-20 01:31:29.309273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.451 [2024-11-20 01:31:29.309371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.451 [2024-11-20 01:31:29.309399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.451 qpair failed and we were unable to recover it. 00:30:21.451 [2024-11-20 01:31:29.309506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.451 [2024-11-20 01:31:29.309604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.451 [2024-11-20 01:31:29.309632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.451 qpair failed and we were unable to recover it. 00:30:21.451 [2024-11-20 01:31:29.309725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.451 [2024-11-20 01:31:29.309850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.451 [2024-11-20 01:31:29.309877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.451 qpair failed and we were unable to recover it. 00:30:21.451 [2024-11-20 01:31:29.309990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.451 [2024-11-20 01:31:29.310144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.451 [2024-11-20 01:31:29.310171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.451 qpair failed and we were unable to recover it. 00:30:21.451 [2024-11-20 01:31:29.310263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.451 [2024-11-20 01:31:29.310389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.451 [2024-11-20 01:31:29.310415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.451 qpair failed and we were unable to recover it. 00:30:21.451 [2024-11-20 01:31:29.310519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.451 [2024-11-20 01:31:29.310608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.451 [2024-11-20 01:31:29.310651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.451 qpair failed and we were unable to recover it. 00:30:21.451 [2024-11-20 01:31:29.310771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.451 [2024-11-20 01:31:29.310876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.451 [2024-11-20 01:31:29.310903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.451 qpair failed and we were unable to recover it. 00:30:21.451 [2024-11-20 01:31:29.310995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.451 [2024-11-20 01:31:29.311121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.451 [2024-11-20 01:31:29.311146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.451 qpair failed and we were unable to recover it. 00:30:21.451 [2024-11-20 01:31:29.311268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.451 [2024-11-20 01:31:29.311348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.451 [2024-11-20 01:31:29.311392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.451 qpair failed and we were unable to recover it. 00:30:21.451 [2024-11-20 01:31:29.311504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.451 [2024-11-20 01:31:29.311617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.451 [2024-11-20 01:31:29.311643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.451 qpair failed and we were unable to recover it. 00:30:21.451 [2024-11-20 01:31:29.311743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.451 [2024-11-20 01:31:29.311871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.451 [2024-11-20 01:31:29.311899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.451 qpair failed and we were unable to recover it. 00:30:21.451 [2024-11-20 01:31:29.312000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.451 [2024-11-20 01:31:29.312155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.451 [2024-11-20 01:31:29.312180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.452 qpair failed and we were unable to recover it. 00:30:21.452 [2024-11-20 01:31:29.312273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.452 [2024-11-20 01:31:29.312402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.452 [2024-11-20 01:31:29.312426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.452 qpair failed and we were unable to recover it. 00:30:21.452 [2024-11-20 01:31:29.312526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.452 [2024-11-20 01:31:29.312647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.452 [2024-11-20 01:31:29.312673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.452 qpair failed and we were unable to recover it. 00:30:21.452 [2024-11-20 01:31:29.312766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.452 [2024-11-20 01:31:29.312882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.452 [2024-11-20 01:31:29.312909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.452 qpair failed and we were unable to recover it. 00:30:21.452 [2024-11-20 01:31:29.313045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.452 [2024-11-20 01:31:29.313154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.452 [2024-11-20 01:31:29.313179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.452 qpair failed and we were unable to recover it. 00:30:21.452 [2024-11-20 01:31:29.313270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.452 [2024-11-20 01:31:29.313431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.452 [2024-11-20 01:31:29.313460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.452 qpair failed and we were unable to recover it. 00:30:21.452 [2024-11-20 01:31:29.313549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.452 [2024-11-20 01:31:29.313640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.452 [2024-11-20 01:31:29.313668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.452 qpair failed and we were unable to recover it. 00:30:21.452 [2024-11-20 01:31:29.313854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.452 [2024-11-20 01:31:29.313978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.452 [2024-11-20 01:31:29.314007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.452 qpair failed and we were unable to recover it. 00:30:21.452 [2024-11-20 01:31:29.314122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.452 [2024-11-20 01:31:29.314242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.452 [2024-11-20 01:31:29.314267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.452 qpair failed and we were unable to recover it. 00:30:21.452 [2024-11-20 01:31:29.314422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.452 [2024-11-20 01:31:29.314564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.452 [2024-11-20 01:31:29.314589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.452 qpair failed and we were unable to recover it. 00:30:21.452 [2024-11-20 01:31:29.314712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.452 [2024-11-20 01:31:29.314821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.452 [2024-11-20 01:31:29.314849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.452 qpair failed and we were unable to recover it. 00:30:21.452 [2024-11-20 01:31:29.314977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.452 [2024-11-20 01:31:29.315110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.452 [2024-11-20 01:31:29.315135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.452 qpair failed and we were unable to recover it. 00:30:21.452 [2024-11-20 01:31:29.315235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.452 [2024-11-20 01:31:29.315323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.452 [2024-11-20 01:31:29.315347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.452 qpair failed and we were unable to recover it. 00:30:21.452 [2024-11-20 01:31:29.315519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.452 [2024-11-20 01:31:29.315611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.452 [2024-11-20 01:31:29.315638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.452 qpair failed and we were unable to recover it. 00:30:21.452 [2024-11-20 01:31:29.315801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.452 [2024-11-20 01:31:29.315897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.452 [2024-11-20 01:31:29.315924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.452 qpair failed and we were unable to recover it. 00:30:21.452 [2024-11-20 01:31:29.316047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.452 [2024-11-20 01:31:29.316164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.452 [2024-11-20 01:31:29.316189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.452 qpair failed and we were unable to recover it. 00:30:21.452 [2024-11-20 01:31:29.316284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.452 [2024-11-20 01:31:29.316406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.452 [2024-11-20 01:31:29.316429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.452 qpair failed and we were unable to recover it. 00:30:21.452 [2024-11-20 01:31:29.316539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.452 [2024-11-20 01:31:29.316667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.452 [2024-11-20 01:31:29.316695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.452 qpair failed and we were unable to recover it. 00:30:21.452 [2024-11-20 01:31:29.316852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.452 [2024-11-20 01:31:29.316951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.452 [2024-11-20 01:31:29.316980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.452 qpair failed and we were unable to recover it. 00:30:21.452 [2024-11-20 01:31:29.317095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.452 [2024-11-20 01:31:29.317193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.452 [2024-11-20 01:31:29.317218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.452 qpair failed and we were unable to recover it. 00:30:21.452 [2024-11-20 01:31:29.317341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.452 [2024-11-20 01:31:29.317457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.452 [2024-11-20 01:31:29.317482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.452 qpair failed and we were unable to recover it. 00:30:21.452 [2024-11-20 01:31:29.317603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.452 [2024-11-20 01:31:29.317698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.452 [2024-11-20 01:31:29.317723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.452 qpair failed and we were unable to recover it. 00:30:21.452 [2024-11-20 01:31:29.317886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.452 [2024-11-20 01:31:29.317999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.452 [2024-11-20 01:31:29.318023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.452 qpair failed and we were unable to recover it. 00:30:21.452 [2024-11-20 01:31:29.318173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.452 [2024-11-20 01:31:29.318309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.452 [2024-11-20 01:31:29.318336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.452 qpair failed and we were unable to recover it. 00:30:21.452 [2024-11-20 01:31:29.318450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.452 [2024-11-20 01:31:29.318590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.452 [2024-11-20 01:31:29.318614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.452 qpair failed and we were unable to recover it. 00:30:21.452 [2024-11-20 01:31:29.318746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.452 [2024-11-20 01:31:29.318863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.452 [2024-11-20 01:31:29.318887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.452 qpair failed and we were unable to recover it. 00:30:21.452 [2024-11-20 01:31:29.319001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.452 [2024-11-20 01:31:29.319107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.452 [2024-11-20 01:31:29.319148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.452 qpair failed and we were unable to recover it. 00:30:21.452 [2024-11-20 01:31:29.319294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.452 [2024-11-20 01:31:29.319393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.452 [2024-11-20 01:31:29.319419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.452 qpair failed and we were unable to recover it. 00:30:21.452 [2024-11-20 01:31:29.319538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.452 [2024-11-20 01:31:29.319635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.452 [2024-11-20 01:31:29.319659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.452 qpair failed and we were unable to recover it. 00:30:21.452 [2024-11-20 01:31:29.319764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.453 [2024-11-20 01:31:29.319897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.453 [2024-11-20 01:31:29.319925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.453 qpair failed and we were unable to recover it. 00:30:21.453 [2024-11-20 01:31:29.320019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.453 [2024-11-20 01:31:29.320125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.453 [2024-11-20 01:31:29.320154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.453 qpair failed and we were unable to recover it. 00:30:21.453 [2024-11-20 01:31:29.320274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.453 [2024-11-20 01:31:29.320358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.453 [2024-11-20 01:31:29.320383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.453 qpair failed and we were unable to recover it. 00:30:21.453 [2024-11-20 01:31:29.320500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.453 [2024-11-20 01:31:29.320653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.453 [2024-11-20 01:31:29.320677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.453 qpair failed and we were unable to recover it. 00:30:21.453 [2024-11-20 01:31:29.320769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.453 [2024-11-20 01:31:29.320888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.453 [2024-11-20 01:31:29.320927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.453 qpair failed and we were unable to recover it. 00:30:21.453 [2024-11-20 01:31:29.321092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.453 [2024-11-20 01:31:29.321189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.453 [2024-11-20 01:31:29.321216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.453 qpair failed and we were unable to recover it. 00:30:21.453 [2024-11-20 01:31:29.321363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.453 [2024-11-20 01:31:29.321500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.453 [2024-11-20 01:31:29.321526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.453 qpair failed and we were unable to recover it. 00:30:21.453 [2024-11-20 01:31:29.321662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.453 [2024-11-20 01:31:29.321788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.453 [2024-11-20 01:31:29.321817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.453 qpair failed and we were unable to recover it. 00:30:21.453 [2024-11-20 01:31:29.321930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.453 [2024-11-20 01:31:29.322021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.453 [2024-11-20 01:31:29.322045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.453 qpair failed and we were unable to recover it. 00:30:21.453 [2024-11-20 01:31:29.322163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.453 [2024-11-20 01:31:29.322256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.453 [2024-11-20 01:31:29.322280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.453 qpair failed and we were unable to recover it. 00:30:21.453 [2024-11-20 01:31:29.322433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.453 [2024-11-20 01:31:29.322555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.453 [2024-11-20 01:31:29.322599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.453 qpair failed and we were unable to recover it. 00:30:21.453 [2024-11-20 01:31:29.322687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.453 [2024-11-20 01:31:29.322830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.453 [2024-11-20 01:31:29.322854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.453 qpair failed and we were unable to recover it. 00:30:21.453 [2024-11-20 01:31:29.322943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.453 [2024-11-20 01:31:29.323027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.453 [2024-11-20 01:31:29.323051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.453 qpair failed and we were unable to recover it. 00:30:21.453 [2024-11-20 01:31:29.323168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.453 [2024-11-20 01:31:29.323333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.453 [2024-11-20 01:31:29.323361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.453 qpair failed and we were unable to recover it. 00:30:21.453 [2024-11-20 01:31:29.323527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.453 [2024-11-20 01:31:29.323639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.453 [2024-11-20 01:31:29.323664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.453 qpair failed and we were unable to recover it. 00:30:21.453 [2024-11-20 01:31:29.323779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.453 [2024-11-20 01:31:29.323875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.453 [2024-11-20 01:31:29.323903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.453 qpair failed and we were unable to recover it. 00:30:21.453 [2024-11-20 01:31:29.324003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.453 [2024-11-20 01:31:29.324147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.453 [2024-11-20 01:31:29.324175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.453 qpair failed and we were unable to recover it. 00:30:21.453 [2024-11-20 01:31:29.324322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.453 [2024-11-20 01:31:29.324449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.453 [2024-11-20 01:31:29.324473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.453 qpair failed and we were unable to recover it. 00:30:21.453 [2024-11-20 01:31:29.324652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.453 [2024-11-20 01:31:29.324769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.453 [2024-11-20 01:31:29.324796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.453 qpair failed and we were unable to recover it. 00:30:21.453 [2024-11-20 01:31:29.324878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.453 [2024-11-20 01:31:29.324999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.453 [2024-11-20 01:31:29.325024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.453 qpair failed and we were unable to recover it. 00:30:21.453 [2024-11-20 01:31:29.325125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.453 [2024-11-20 01:31:29.325215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.453 [2024-11-20 01:31:29.325241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.453 qpair failed and we were unable to recover it. 00:30:21.453 [2024-11-20 01:31:29.325359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.453 [2024-11-20 01:31:29.325505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.453 [2024-11-20 01:31:29.325533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.453 qpair failed and we were unable to recover it. 00:30:21.453 [2024-11-20 01:31:29.325635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.453 [2024-11-20 01:31:29.325770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.453 [2024-11-20 01:31:29.325797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.453 qpair failed and we were unable to recover it. 00:30:21.453 [2024-11-20 01:31:29.325944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.453 [2024-11-20 01:31:29.326056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.453 [2024-11-20 01:31:29.326091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.453 qpair failed and we were unable to recover it. 00:30:21.453 [2024-11-20 01:31:29.326177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.453 [2024-11-20 01:31:29.326298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.453 [2024-11-20 01:31:29.326322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.453 qpair failed and we were unable to recover it. 00:30:21.453 [2024-11-20 01:31:29.326415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.453 [2024-11-20 01:31:29.326542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.453 [2024-11-20 01:31:29.326567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.453 qpair failed and we were unable to recover it. 00:30:21.453 [2024-11-20 01:31:29.326710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.453 [2024-11-20 01:31:29.326825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.453 [2024-11-20 01:31:29.326865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.453 qpair failed and we were unable to recover it. 00:30:21.453 [2024-11-20 01:31:29.327013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.453 [2024-11-20 01:31:29.327116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.453 [2024-11-20 01:31:29.327141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.453 qpair failed and we were unable to recover it. 00:30:21.453 [2024-11-20 01:31:29.327233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.453 [2024-11-20 01:31:29.327349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.454 [2024-11-20 01:31:29.327377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.454 qpair failed and we were unable to recover it. 00:30:21.454 [2024-11-20 01:31:29.327467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.454 [2024-11-20 01:31:29.327577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.454 [2024-11-20 01:31:29.327600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.454 qpair failed and we were unable to recover it. 00:30:21.454 [2024-11-20 01:31:29.327736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.454 [2024-11-20 01:31:29.327830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.454 [2024-11-20 01:31:29.327858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.454 qpair failed and we were unable to recover it. 00:30:21.454 [2024-11-20 01:31:29.327956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.454 [2024-11-20 01:31:29.328090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.454 [2024-11-20 01:31:29.328115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.454 qpair failed and we were unable to recover it. 00:30:21.454 [2024-11-20 01:31:29.328235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.454 [2024-11-20 01:31:29.328332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.454 [2024-11-20 01:31:29.328366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.454 qpair failed and we were unable to recover it. 00:30:21.454 [2024-11-20 01:31:29.328532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.454 [2024-11-20 01:31:29.328657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.454 [2024-11-20 01:31:29.328683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.454 qpair failed and we were unable to recover it. 00:30:21.454 [2024-11-20 01:31:29.328824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.454 [2024-11-20 01:31:29.328968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.454 [2024-11-20 01:31:29.328994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.454 qpair failed and we were unable to recover it. 00:30:21.454 [2024-11-20 01:31:29.329094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.454 [2024-11-20 01:31:29.329180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.454 [2024-11-20 01:31:29.329205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.454 qpair failed and we were unable to recover it. 00:30:21.454 [2024-11-20 01:31:29.329318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.454 [2024-11-20 01:31:29.329417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.454 [2024-11-20 01:31:29.329442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.454 qpair failed and we were unable to recover it. 00:30:21.454 [2024-11-20 01:31:29.329621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.454 [2024-11-20 01:31:29.329695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.454 [2024-11-20 01:31:29.329718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.454 qpair failed and we were unable to recover it. 00:30:21.454 [2024-11-20 01:31:29.329798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.454 [2024-11-20 01:31:29.329882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.454 [2024-11-20 01:31:29.329907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.454 qpair failed and we were unable to recover it. 00:30:21.454 [2024-11-20 01:31:29.330024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.454 [2024-11-20 01:31:29.330115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.454 [2024-11-20 01:31:29.330140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.454 qpair failed and we were unable to recover it. 00:30:21.454 [2024-11-20 01:31:29.330257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.454 [2024-11-20 01:31:29.330423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.454 [2024-11-20 01:31:29.330451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.454 qpair failed and we were unable to recover it. 00:30:21.454 [2024-11-20 01:31:29.330589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.454 [2024-11-20 01:31:29.330733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.454 [2024-11-20 01:31:29.330758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.454 qpair failed and we were unable to recover it. 00:30:21.454 [2024-11-20 01:31:29.330903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.454 [2024-11-20 01:31:29.331058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.454 [2024-11-20 01:31:29.331119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.454 qpair failed and we were unable to recover it. 00:30:21.454 [2024-11-20 01:31:29.331251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.454 [2024-11-20 01:31:29.331378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.454 [2024-11-20 01:31:29.331405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.454 qpair failed and we were unable to recover it. 00:30:21.454 [2024-11-20 01:31:29.331552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.454 [2024-11-20 01:31:29.331639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.454 [2024-11-20 01:31:29.331666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.454 qpair failed and we were unable to recover it. 00:30:21.454 [2024-11-20 01:31:29.331803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.454 [2024-11-20 01:31:29.331895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.454 [2024-11-20 01:31:29.331941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.454 qpair failed and we were unable to recover it. 00:30:21.454 [2024-11-20 01:31:29.332080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.454 [2024-11-20 01:31:29.332217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.454 [2024-11-20 01:31:29.332241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.454 qpair failed and we were unable to recover it. 00:30:21.454 [2024-11-20 01:31:29.332331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.454 [2024-11-20 01:31:29.332437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.454 [2024-11-20 01:31:29.332460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.454 qpair failed and we were unable to recover it. 00:30:21.454 [2024-11-20 01:31:29.332557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.454 [2024-11-20 01:31:29.332710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.454 [2024-11-20 01:31:29.332735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.454 qpair failed and we were unable to recover it. 00:30:21.454 [2024-11-20 01:31:29.332857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.454 [2024-11-20 01:31:29.333018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.454 [2024-11-20 01:31:29.333046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.454 qpair failed and we were unable to recover it. 00:30:21.454 [2024-11-20 01:31:29.333194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.454 [2024-11-20 01:31:29.333291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.454 [2024-11-20 01:31:29.333316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.454 qpair failed and we were unable to recover it. 00:30:21.454 [2024-11-20 01:31:29.333484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.454 [2024-11-20 01:31:29.333623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.454 [2024-11-20 01:31:29.333647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.454 qpair failed and we were unable to recover it. 00:30:21.454 [2024-11-20 01:31:29.333789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.454 [2024-11-20 01:31:29.333887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.454 [2024-11-20 01:31:29.333914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.454 qpair failed and we were unable to recover it. 00:30:21.454 [2024-11-20 01:31:29.334061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.454 [2024-11-20 01:31:29.334156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.454 [2024-11-20 01:31:29.334180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.454 qpair failed and we were unable to recover it. 00:30:21.454 [2024-11-20 01:31:29.334298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.454 [2024-11-20 01:31:29.334446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.454 [2024-11-20 01:31:29.334470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.454 qpair failed and we were unable to recover it. 00:30:21.454 [2024-11-20 01:31:29.334552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.454 [2024-11-20 01:31:29.334636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.454 [2024-11-20 01:31:29.334665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.454 qpair failed and we were unable to recover it. 00:30:21.454 [2024-11-20 01:31:29.334787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.454 [2024-11-20 01:31:29.334878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.455 [2024-11-20 01:31:29.334902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.455 qpair failed and we were unable to recover it. 00:30:21.455 [2024-11-20 01:31:29.335093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.455 [2024-11-20 01:31:29.335221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.455 [2024-11-20 01:31:29.335248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.455 qpair failed and we were unable to recover it. 00:30:21.455 [2024-11-20 01:31:29.335379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.455 [2024-11-20 01:31:29.335476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.455 [2024-11-20 01:31:29.335518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.455 qpair failed and we were unable to recover it. 00:30:21.455 [2024-11-20 01:31:29.335634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.455 [2024-11-20 01:31:29.335748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.455 [2024-11-20 01:31:29.335773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.455 qpair failed and we were unable to recover it. 00:30:21.455 [2024-11-20 01:31:29.335931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.455 [2024-11-20 01:31:29.336050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.455 [2024-11-20 01:31:29.336088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.455 qpair failed and we were unable to recover it. 00:30:21.455 [2024-11-20 01:31:29.336177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.455 [2024-11-20 01:31:29.336309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.455 [2024-11-20 01:31:29.336334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.455 qpair failed and we were unable to recover it. 00:30:21.455 [2024-11-20 01:31:29.336436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.455 [2024-11-20 01:31:29.336524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.455 [2024-11-20 01:31:29.336549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.455 qpair failed and we were unable to recover it. 00:30:21.455 [2024-11-20 01:31:29.336632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.455 [2024-11-20 01:31:29.336716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.455 [2024-11-20 01:31:29.336741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.455 qpair failed and we were unable to recover it. 00:30:21.455 [2024-11-20 01:31:29.336895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.455 [2024-11-20 01:31:29.336990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.455 [2024-11-20 01:31:29.337014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.455 qpair failed and we were unable to recover it. 00:30:21.455 [2024-11-20 01:31:29.337130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.455 [2024-11-20 01:31:29.337213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.455 [2024-11-20 01:31:29.337241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.455 qpair failed and we were unable to recover it. 00:30:21.455 [2024-11-20 01:31:29.337332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.455 [2024-11-20 01:31:29.337447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.455 [2024-11-20 01:31:29.337491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.455 qpair failed and we were unable to recover it. 00:30:21.455 [2024-11-20 01:31:29.337667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.455 [2024-11-20 01:31:29.337784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.455 [2024-11-20 01:31:29.337808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.455 qpair failed and we were unable to recover it. 00:30:21.455 [2024-11-20 01:31:29.337946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.455 [2024-11-20 01:31:29.338076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.455 [2024-11-20 01:31:29.338101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.455 qpair failed and we were unable to recover it. 00:30:21.455 [2024-11-20 01:31:29.338220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.455 [2024-11-20 01:31:29.338320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.455 [2024-11-20 01:31:29.338347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.455 qpair failed and we were unable to recover it. 00:30:21.455 [2024-11-20 01:31:29.338475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.455 [2024-11-20 01:31:29.338600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.455 [2024-11-20 01:31:29.338626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.455 qpair failed and we were unable to recover it. 00:30:21.455 [2024-11-20 01:31:29.338756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.455 [2024-11-20 01:31:29.338911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.455 [2024-11-20 01:31:29.338952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.455 qpair failed and we were unable to recover it. 00:30:21.455 [2024-11-20 01:31:29.339128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.455 [2024-11-20 01:31:29.339216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.455 [2024-11-20 01:31:29.339240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.455 qpair failed and we were unable to recover it. 00:30:21.455 [2024-11-20 01:31:29.339361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.455 [2024-11-20 01:31:29.339448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.455 [2024-11-20 01:31:29.339472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.455 qpair failed and we were unable to recover it. 00:30:21.455 [2024-11-20 01:31:29.339571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.455 [2024-11-20 01:31:29.339658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.455 [2024-11-20 01:31:29.339684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.455 qpair failed and we were unable to recover it. 00:30:21.455 [2024-11-20 01:31:29.339799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.455 [2024-11-20 01:31:29.339934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.455 [2024-11-20 01:31:29.339967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.455 qpair failed and we were unable to recover it. 00:30:21.455 [2024-11-20 01:31:29.340065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.455 [2024-11-20 01:31:29.340205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.455 [2024-11-20 01:31:29.340231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.455 qpair failed and we were unable to recover it. 00:30:21.455 [2024-11-20 01:31:29.340324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.455 [2024-11-20 01:31:29.340421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.455 [2024-11-20 01:31:29.340445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.455 qpair failed and we were unable to recover it. 00:30:21.455 [2024-11-20 01:31:29.340534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.455 [2024-11-20 01:31:29.340673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.455 [2024-11-20 01:31:29.340702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.455 qpair failed and we were unable to recover it. 00:30:21.455 [2024-11-20 01:31:29.340807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.455 [2024-11-20 01:31:29.340902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.455 [2024-11-20 01:31:29.340929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.455 qpair failed and we were unable to recover it. 00:30:21.455 [2024-11-20 01:31:29.341038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.455 [2024-11-20 01:31:29.341176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.455 [2024-11-20 01:31:29.341201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.455 qpair failed and we were unable to recover it. 00:30:21.455 [2024-11-20 01:31:29.341287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.455 [2024-11-20 01:31:29.341420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.455 [2024-11-20 01:31:29.341448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.455 qpair failed and we were unable to recover it. 00:30:21.455 [2024-11-20 01:31:29.341541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.455 [2024-11-20 01:31:29.341642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.455 [2024-11-20 01:31:29.341670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.455 qpair failed and we were unable to recover it. 00:30:21.455 [2024-11-20 01:31:29.341775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.455 [2024-11-20 01:31:29.341905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.455 [2024-11-20 01:31:29.341928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.456 qpair failed and we were unable to recover it. 00:30:21.456 [2024-11-20 01:31:29.342049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.456 [2024-11-20 01:31:29.342206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.456 [2024-11-20 01:31:29.342234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.456 qpair failed and we were unable to recover it. 00:30:21.456 [2024-11-20 01:31:29.342329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.456 [2024-11-20 01:31:29.342422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.456 [2024-11-20 01:31:29.342449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.456 qpair failed and we were unable to recover it. 00:30:21.456 [2024-11-20 01:31:29.342564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.456 [2024-11-20 01:31:29.342711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.456 [2024-11-20 01:31:29.342736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.456 qpair failed and we were unable to recover it. 00:30:21.456 [2024-11-20 01:31:29.342848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.456 [2024-11-20 01:31:29.342978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.456 [2024-11-20 01:31:29.343006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.456 qpair failed and we were unable to recover it. 00:30:21.456 [2024-11-20 01:31:29.343137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.456 [2024-11-20 01:31:29.343272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.456 [2024-11-20 01:31:29.343300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.456 qpair failed and we were unable to recover it. 00:30:21.456 [2024-11-20 01:31:29.343424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.456 [2024-11-20 01:31:29.343521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.456 [2024-11-20 01:31:29.343546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.456 qpair failed and we were unable to recover it. 00:30:21.456 [2024-11-20 01:31:29.343666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.456 [2024-11-20 01:31:29.343757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.456 [2024-11-20 01:31:29.343782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.456 qpair failed and we were unable to recover it. 00:30:21.456 [2024-11-20 01:31:29.343898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.456 [2024-11-20 01:31:29.343981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.456 [2024-11-20 01:31:29.344007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.456 qpair failed and we were unable to recover it. 00:30:21.456 [2024-11-20 01:31:29.344125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.456 [2024-11-20 01:31:29.344210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.456 [2024-11-20 01:31:29.344236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.456 qpair failed and we were unable to recover it. 00:30:21.456 [2024-11-20 01:31:29.344326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.456 [2024-11-20 01:31:29.344434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.456 [2024-11-20 01:31:29.344459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.456 qpair failed and we were unable to recover it. 00:30:21.456 [2024-11-20 01:31:29.344548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.456 [2024-11-20 01:31:29.344663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.456 [2024-11-20 01:31:29.344688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.456 qpair failed and we were unable to recover it. 00:30:21.456 [2024-11-20 01:31:29.344783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.456 [2024-11-20 01:31:29.344929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.456 [2024-11-20 01:31:29.344953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.456 qpair failed and we were unable to recover it. 00:30:21.456 [2024-11-20 01:31:29.345044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.456 [2024-11-20 01:31:29.345161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.456 [2024-11-20 01:31:29.345188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.456 qpair failed and we were unable to recover it. 00:30:21.456 [2024-11-20 01:31:29.345276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.456 [2024-11-20 01:31:29.345379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.456 [2024-11-20 01:31:29.345406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.456 qpair failed and we were unable to recover it. 00:30:21.456 [2024-11-20 01:31:29.345542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.456 [2024-11-20 01:31:29.345681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.456 [2024-11-20 01:31:29.345722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.456 qpair failed and we were unable to recover it. 00:30:21.456 [2024-11-20 01:31:29.345841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.456 [2024-11-20 01:31:29.345982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.456 [2024-11-20 01:31:29.346007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.456 qpair failed and we were unable to recover it. 00:30:21.456 [2024-11-20 01:31:29.346124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.456 [2024-11-20 01:31:29.346240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.456 [2024-11-20 01:31:29.346264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.456 qpair failed and we were unable to recover it. 00:30:21.456 [2024-11-20 01:31:29.346356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.456 [2024-11-20 01:31:29.346442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.456 [2024-11-20 01:31:29.346466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.456 qpair failed and we were unable to recover it. 00:30:21.456 [2024-11-20 01:31:29.346562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.456 [2024-11-20 01:31:29.346674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.456 [2024-11-20 01:31:29.346717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.456 qpair failed and we were unable to recover it. 00:30:21.456 [2024-11-20 01:31:29.346848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.456 [2024-11-20 01:31:29.346977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.456 [2024-11-20 01:31:29.347004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.456 qpair failed and we were unable to recover it. 00:30:21.456 [2024-11-20 01:31:29.347118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.456 [2024-11-20 01:31:29.347202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.456 [2024-11-20 01:31:29.347227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.456 qpair failed and we were unable to recover it. 00:30:21.456 [2024-11-20 01:31:29.347321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.456 [2024-11-20 01:31:29.347466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.456 [2024-11-20 01:31:29.347493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.456 qpair failed and we were unable to recover it. 00:30:21.456 [2024-11-20 01:31:29.347617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.456 [2024-11-20 01:31:29.347752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.456 [2024-11-20 01:31:29.347780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.456 qpair failed and we were unable to recover it. 00:30:21.456 [2024-11-20 01:31:29.347918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.456 [2024-11-20 01:31:29.348028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.456 [2024-11-20 01:31:29.348053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.456 qpair failed and we were unable to recover it. 00:30:21.456 [2024-11-20 01:31:29.348180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.456 [2024-11-20 01:31:29.348336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.456 [2024-11-20 01:31:29.348364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.456 qpair failed and we were unable to recover it. 00:30:21.456 [2024-11-20 01:31:29.348491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.457 [2024-11-20 01:31:29.348618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.457 [2024-11-20 01:31:29.348644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.457 qpair failed and we were unable to recover it. 00:30:21.457 [2024-11-20 01:31:29.348778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.457 [2024-11-20 01:31:29.348892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.457 [2024-11-20 01:31:29.348917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.457 qpair failed and we were unable to recover it. 00:30:21.457 [2024-11-20 01:31:29.349029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.457 [2024-11-20 01:31:29.349176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.457 [2024-11-20 01:31:29.349204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.457 qpair failed and we were unable to recover it. 00:30:21.457 [2024-11-20 01:31:29.349360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.457 [2024-11-20 01:31:29.349491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.457 [2024-11-20 01:31:29.349519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.457 qpair failed and we were unable to recover it. 00:30:21.457 [2024-11-20 01:31:29.349642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.457 [2024-11-20 01:31:29.349779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.457 [2024-11-20 01:31:29.349803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.457 qpair failed and we were unable to recover it. 00:30:21.457 [2024-11-20 01:31:29.349911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.457 [2024-11-20 01:31:29.350003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.457 [2024-11-20 01:31:29.350030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.457 qpair failed and we were unable to recover it. 00:30:21.457 [2024-11-20 01:31:29.350172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.457 [2024-11-20 01:31:29.350259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.457 [2024-11-20 01:31:29.350284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.457 qpair failed and we were unable to recover it. 00:30:21.457 [2024-11-20 01:31:29.350418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.457 [2024-11-20 01:31:29.350535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.457 [2024-11-20 01:31:29.350559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.457 qpair failed and we were unable to recover it. 00:30:21.457 [2024-11-20 01:31:29.350652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.457 [2024-11-20 01:31:29.350817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.457 [2024-11-20 01:31:29.350856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.457 qpair failed and we were unable to recover it. 00:30:21.457 [2024-11-20 01:31:29.350976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.457 [2024-11-20 01:31:29.351114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.457 [2024-11-20 01:31:29.351143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.457 qpair failed and we were unable to recover it. 00:30:21.457 [2024-11-20 01:31:29.351290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.457 [2024-11-20 01:31:29.351430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.457 [2024-11-20 01:31:29.351455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.457 qpair failed and we were unable to recover it. 00:30:21.457 [2024-11-20 01:31:29.351564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.457 [2024-11-20 01:31:29.351704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.457 [2024-11-20 01:31:29.351729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.457 qpair failed and we were unable to recover it. 00:30:21.457 [2024-11-20 01:31:29.351849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.457 [2024-11-20 01:31:29.351926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.457 [2024-11-20 01:31:29.351969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.457 qpair failed and we were unable to recover it. 00:30:21.457 [2024-11-20 01:31:29.352090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.457 [2024-11-20 01:31:29.352234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.457 [2024-11-20 01:31:29.352259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.457 qpair failed and we were unable to recover it. 00:30:21.457 [2024-11-20 01:31:29.352394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.457 [2024-11-20 01:31:29.352531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.457 [2024-11-20 01:31:29.352554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.457 qpair failed and we were unable to recover it. 00:30:21.457 [2024-11-20 01:31:29.352649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.457 [2024-11-20 01:31:29.352783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.457 [2024-11-20 01:31:29.352810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.457 qpair failed and we were unable to recover it. 00:30:21.457 [2024-11-20 01:31:29.352953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.457 [2024-11-20 01:31:29.353067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.457 [2024-11-20 01:31:29.353097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.457 qpair failed and we were unable to recover it. 00:30:21.457 [2024-11-20 01:31:29.353212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.457 [2024-11-20 01:31:29.353303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.457 [2024-11-20 01:31:29.353347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.457 qpair failed and we were unable to recover it. 00:30:21.457 [2024-11-20 01:31:29.353447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.457 [2024-11-20 01:31:29.353578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.457 [2024-11-20 01:31:29.353605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.457 qpair failed and we were unable to recover it. 00:30:21.457 [2024-11-20 01:31:29.353729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.457 [2024-11-20 01:31:29.353811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.457 [2024-11-20 01:31:29.353835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.457 qpair failed and we were unable to recover it. 00:30:21.457 [2024-11-20 01:31:29.353948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.457 [2024-11-20 01:31:29.354094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.457 [2024-11-20 01:31:29.354122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.457 qpair failed and we were unable to recover it. 00:30:21.457 [2024-11-20 01:31:29.354257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.457 [2024-11-20 01:31:29.354371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.457 [2024-11-20 01:31:29.354395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.457 qpair failed and we were unable to recover it. 00:30:21.457 [2024-11-20 01:31:29.354493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.457 [2024-11-20 01:31:29.354606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.457 [2024-11-20 01:31:29.354631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.457 qpair failed and we were unable to recover it. 00:30:21.457 [2024-11-20 01:31:29.354742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.457 [2024-11-20 01:31:29.354863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.457 [2024-11-20 01:31:29.354890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.457 qpair failed and we were unable to recover it. 00:30:21.457 [2024-11-20 01:31:29.354995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.457 [2024-11-20 01:31:29.355122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.457 [2024-11-20 01:31:29.355152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.457 qpair failed and we were unable to recover it. 00:30:21.457 [2024-11-20 01:31:29.355294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.457 [2024-11-20 01:31:29.355432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.457 [2024-11-20 01:31:29.355458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.457 qpair failed and we were unable to recover it. 00:30:21.457 [2024-11-20 01:31:29.355570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.457 [2024-11-20 01:31:29.355689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.457 [2024-11-20 01:31:29.355716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.457 qpair failed and we were unable to recover it. 00:30:21.457 [2024-11-20 01:31:29.355848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.457 [2024-11-20 01:31:29.355980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.457 [2024-11-20 01:31:29.356007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.457 qpair failed and we were unable to recover it. 00:30:21.457 [2024-11-20 01:31:29.356121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.457 [2024-11-20 01:31:29.356203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.458 [2024-11-20 01:31:29.356228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.458 qpair failed and we were unable to recover it. 00:30:21.458 [2024-11-20 01:31:29.356321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.458 [2024-11-20 01:31:29.356448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.458 [2024-11-20 01:31:29.356476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.458 qpair failed and we were unable to recover it. 00:30:21.458 [2024-11-20 01:31:29.356601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.458 [2024-11-20 01:31:29.356723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.458 [2024-11-20 01:31:29.356751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.458 qpair failed and we were unable to recover it. 00:30:21.458 [2024-11-20 01:31:29.356898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.458 [2024-11-20 01:31:29.356984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.458 [2024-11-20 01:31:29.357009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.458 qpair failed and we were unable to recover it. 00:30:21.458 [2024-11-20 01:31:29.357098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.458 [2024-11-20 01:31:29.357195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.458 [2024-11-20 01:31:29.357219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.458 qpair failed and we were unable to recover it. 00:30:21.458 [2024-11-20 01:31:29.357337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.458 [2024-11-20 01:31:29.357471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.458 [2024-11-20 01:31:29.357500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.458 qpair failed and we were unable to recover it. 00:30:21.458 [2024-11-20 01:31:29.357632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.458 [2024-11-20 01:31:29.357723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.458 [2024-11-20 01:31:29.357748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.458 qpair failed and we were unable to recover it. 00:30:21.458 [2024-11-20 01:31:29.357888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.458 [2024-11-20 01:31:29.358042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.458 [2024-11-20 01:31:29.358081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.458 qpair failed and we were unable to recover it. 00:30:21.458 [2024-11-20 01:31:29.358209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.458 [2024-11-20 01:31:29.358336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.458 [2024-11-20 01:31:29.358364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.458 qpair failed and we were unable to recover it. 00:30:21.458 [2024-11-20 01:31:29.358479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.458 [2024-11-20 01:31:29.358574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.458 [2024-11-20 01:31:29.358599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.458 qpair failed and we were unable to recover it. 00:30:21.458 [2024-11-20 01:31:29.358741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.458 [2024-11-20 01:31:29.358882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.458 [2024-11-20 01:31:29.358906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.458 qpair failed and we were unable to recover it. 00:30:21.458 [2024-11-20 01:31:29.359026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.458 [2024-11-20 01:31:29.359190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.458 [2024-11-20 01:31:29.359218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.458 qpair failed and we were unable to recover it. 00:30:21.458 [2024-11-20 01:31:29.359333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.458 [2024-11-20 01:31:29.359443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.458 [2024-11-20 01:31:29.359467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.458 qpair failed and we were unable to recover it. 00:30:21.458 [2024-11-20 01:31:29.359615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.458 [2024-11-20 01:31:29.359738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.458 [2024-11-20 01:31:29.359764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.458 qpair failed and we were unable to recover it. 00:30:21.458 [2024-11-20 01:31:29.359917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.458 [2024-11-20 01:31:29.360037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.458 [2024-11-20 01:31:29.360062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.458 qpair failed and we were unable to recover it. 00:30:21.458 [2024-11-20 01:31:29.360161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.458 [2024-11-20 01:31:29.360277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.458 [2024-11-20 01:31:29.360301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.458 qpair failed and we were unable to recover it. 00:30:21.458 [2024-11-20 01:31:29.360431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.458 [2024-11-20 01:31:29.360516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.458 [2024-11-20 01:31:29.360543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.458 qpair failed and we were unable to recover it. 00:30:21.458 [2024-11-20 01:31:29.360667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.458 [2024-11-20 01:31:29.360796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.458 [2024-11-20 01:31:29.360823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.458 qpair failed and we were unable to recover it. 00:30:21.458 [2024-11-20 01:31:29.360958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.458 [2024-11-20 01:31:29.361088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.458 [2024-11-20 01:31:29.361114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.458 qpair failed and we were unable to recover it. 00:30:21.458 [2024-11-20 01:31:29.361225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.458 [2024-11-20 01:31:29.361378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.458 [2024-11-20 01:31:29.361407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.458 qpair failed and we were unable to recover it. 00:30:21.458 [2024-11-20 01:31:29.361543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.458 [2024-11-20 01:31:29.361694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.458 [2024-11-20 01:31:29.361722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.458 qpair failed and we were unable to recover it. 00:30:21.458 [2024-11-20 01:31:29.361864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.458 [2024-11-20 01:31:29.362007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.458 [2024-11-20 01:31:29.362032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.458 qpair failed and we were unable to recover it. 00:30:21.458 [2024-11-20 01:31:29.362176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.458 [2024-11-20 01:31:29.362300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.458 [2024-11-20 01:31:29.362328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.458 qpair failed and we were unable to recover it. 00:30:21.458 [2024-11-20 01:31:29.362461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.458 [2024-11-20 01:31:29.362609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.458 [2024-11-20 01:31:29.362636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.458 qpair failed and we were unable to recover it. 00:30:21.458 [2024-11-20 01:31:29.362753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.458 [2024-11-20 01:31:29.362868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.458 [2024-11-20 01:31:29.362892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.458 qpair failed and we were unable to recover it. 00:30:21.458 [2024-11-20 01:31:29.362999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.458 [2024-11-20 01:31:29.363141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.458 [2024-11-20 01:31:29.363166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.458 qpair failed and we were unable to recover it. 00:30:21.458 [2024-11-20 01:31:29.363302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.458 [2024-11-20 01:31:29.363428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.458 [2024-11-20 01:31:29.363456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.458 qpair failed and we were unable to recover it. 00:30:21.458 [2024-11-20 01:31:29.363566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.458 [2024-11-20 01:31:29.363708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.458 [2024-11-20 01:31:29.363733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.458 qpair failed and we were unable to recover it. 00:30:21.458 [2024-11-20 01:31:29.363872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.459 [2024-11-20 01:31:29.364023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.459 [2024-11-20 01:31:29.364050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.459 qpair failed and we were unable to recover it. 00:30:21.459 [2024-11-20 01:31:29.364219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.459 [2024-11-20 01:31:29.364379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.459 [2024-11-20 01:31:29.364407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.459 qpair failed and we were unable to recover it. 00:30:21.459 [2024-11-20 01:31:29.364543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.459 [2024-11-20 01:31:29.364630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.459 [2024-11-20 01:31:29.364654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.459 qpair failed and we were unable to recover it. 00:30:21.459 [2024-11-20 01:31:29.364769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.459 [2024-11-20 01:31:29.364864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.459 [2024-11-20 01:31:29.364891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.459 qpair failed and we were unable to recover it. 00:30:21.459 [2024-11-20 01:31:29.365063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.459 [2024-11-20 01:31:29.365184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.459 [2024-11-20 01:31:29.365208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.459 qpair failed and we were unable to recover it. 00:30:21.459 [2024-11-20 01:31:29.365296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.459 [2024-11-20 01:31:29.365387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.459 [2024-11-20 01:31:29.365411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.459 qpair failed and we were unable to recover it. 00:30:21.459 [2024-11-20 01:31:29.365507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.459 [2024-11-20 01:31:29.365659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.459 [2024-11-20 01:31:29.365693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.459 qpair failed and we were unable to recover it. 00:30:21.459 [2024-11-20 01:31:29.365783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.459 [2024-11-20 01:31:29.365922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.459 [2024-11-20 01:31:29.365946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.459 qpair failed and we were unable to recover it. 00:30:21.459 [2024-11-20 01:31:29.366066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.459 [2024-11-20 01:31:29.366189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.459 [2024-11-20 01:31:29.366215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.459 qpair failed and we were unable to recover it. 00:30:21.459 [2024-11-20 01:31:29.366334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.459 [2024-11-20 01:31:29.366463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.459 [2024-11-20 01:31:29.366490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.459 qpair failed and we were unable to recover it. 00:30:21.459 [2024-11-20 01:31:29.366592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.459 [2024-11-20 01:31:29.366707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.459 [2024-11-20 01:31:29.366734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.459 qpair failed and we were unable to recover it. 00:30:21.459 [2024-11-20 01:31:29.366872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.459 [2024-11-20 01:31:29.367017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.459 [2024-11-20 01:31:29.367042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.459 qpair failed and we were unable to recover it. 00:30:21.459 [2024-11-20 01:31:29.367170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.459 [2024-11-20 01:31:29.367305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.459 [2024-11-20 01:31:29.367330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.459 qpair failed and we were unable to recover it. 00:30:21.459 [2024-11-20 01:31:29.367417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.459 [2024-11-20 01:31:29.367504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.459 [2024-11-20 01:31:29.367530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.459 qpair failed and we were unable to recover it. 00:30:21.459 [2024-11-20 01:31:29.367660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.459 [2024-11-20 01:31:29.367750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.459 [2024-11-20 01:31:29.367776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.459 qpair failed and we were unable to recover it. 00:30:21.459 [2024-11-20 01:31:29.367870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.459 [2024-11-20 01:31:29.368040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.459 [2024-11-20 01:31:29.368065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.459 qpair failed and we were unable to recover it. 00:30:21.459 [2024-11-20 01:31:29.368166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.459 [2024-11-20 01:31:29.368289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.459 [2024-11-20 01:31:29.368317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.459 qpair failed and we were unable to recover it. 00:30:21.459 [2024-11-20 01:31:29.368426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.459 [2024-11-20 01:31:29.368513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.459 [2024-11-20 01:31:29.368537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.459 qpair failed and we were unable to recover it. 00:30:21.459 [2024-11-20 01:31:29.368628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.459 [2024-11-20 01:31:29.368750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.459 [2024-11-20 01:31:29.368777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.459 qpair failed and we were unable to recover it. 00:30:21.459 [2024-11-20 01:31:29.368904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.459 [2024-11-20 01:31:29.369023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.459 [2024-11-20 01:31:29.369049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.459 qpair failed and we were unable to recover it. 00:30:21.459 [2024-11-20 01:31:29.369190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.459 [2024-11-20 01:31:29.369278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.459 [2024-11-20 01:31:29.369303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.459 qpair failed and we were unable to recover it. 00:30:21.459 [2024-11-20 01:31:29.369411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.459 [2024-11-20 01:31:29.369587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.459 [2024-11-20 01:31:29.369613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.459 qpair failed and we were unable to recover it. 00:30:21.459 [2024-11-20 01:31:29.369760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.459 [2024-11-20 01:31:29.369893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.459 [2024-11-20 01:31:29.369920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.459 qpair failed and we were unable to recover it. 00:30:21.459 [2024-11-20 01:31:29.370142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.459 [2024-11-20 01:31:29.370239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.459 [2024-11-20 01:31:29.370264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.459 qpair failed and we were unable to recover it. 00:30:21.459 [2024-11-20 01:31:29.370378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.459 [2024-11-20 01:31:29.370500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.459 [2024-11-20 01:31:29.370526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.459 qpair failed and we were unable to recover it. 00:30:21.459 [2024-11-20 01:31:29.370622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.459 [2024-11-20 01:31:29.370754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.459 [2024-11-20 01:31:29.370778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.459 qpair failed and we were unable to recover it. 00:30:21.459 [2024-11-20 01:31:29.370872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.459 [2024-11-20 01:31:29.370985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.459 [2024-11-20 01:31:29.371010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.459 qpair failed and we were unable to recover it. 00:30:21.459 [2024-11-20 01:31:29.371147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.459 [2024-11-20 01:31:29.371238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.459 [2024-11-20 01:31:29.371266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.459 qpair failed and we were unable to recover it. 00:30:21.459 [2024-11-20 01:31:29.371361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.459 [2024-11-20 01:31:29.371494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.460 [2024-11-20 01:31:29.371519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.460 qpair failed and we were unable to recover it. 00:30:21.460 [2024-11-20 01:31:29.371609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.460 [2024-11-20 01:31:29.371688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.460 [2024-11-20 01:31:29.371712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.460 qpair failed and we were unable to recover it. 00:30:21.460 [2024-11-20 01:31:29.371829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.460 [2024-11-20 01:31:29.371942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.460 [2024-11-20 01:31:29.371986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.460 qpair failed and we were unable to recover it. 00:30:21.460 [2024-11-20 01:31:29.372117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.460 [2024-11-20 01:31:29.372250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.460 [2024-11-20 01:31:29.372278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.460 qpair failed and we were unable to recover it. 00:30:21.460 [2024-11-20 01:31:29.372417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.460 [2024-11-20 01:31:29.372501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.460 [2024-11-20 01:31:29.372526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.460 qpair failed and we were unable to recover it. 00:30:21.460 [2024-11-20 01:31:29.372623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.460 [2024-11-20 01:31:29.372715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.460 [2024-11-20 01:31:29.372757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.460 qpair failed and we were unable to recover it. 00:30:21.460 [2024-11-20 01:31:29.372908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.460 [2024-11-20 01:31:29.373000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.460 [2024-11-20 01:31:29.373025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.460 qpair failed and we were unable to recover it. 00:30:21.460 [2024-11-20 01:31:29.373111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.460 [2024-11-20 01:31:29.373225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.460 [2024-11-20 01:31:29.373249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.460 qpair failed and we were unable to recover it. 00:30:21.460 [2024-11-20 01:31:29.373339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.460 [2024-11-20 01:31:29.373458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.460 [2024-11-20 01:31:29.373483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.460 qpair failed and we were unable to recover it. 00:30:21.460 [2024-11-20 01:31:29.373568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.460 [2024-11-20 01:31:29.373711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.460 [2024-11-20 01:31:29.373738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.460 qpair failed and we were unable to recover it. 00:30:21.460 [2024-11-20 01:31:29.373836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.460 [2024-11-20 01:31:29.373947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.460 [2024-11-20 01:31:29.373972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.460 qpair failed and we were unable to recover it. 00:30:21.460 [2024-11-20 01:31:29.374065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.460 [2024-11-20 01:31:29.374186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.460 [2024-11-20 01:31:29.374229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.460 qpair failed and we were unable to recover it. 00:30:21.460 [2024-11-20 01:31:29.374330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.460 [2024-11-20 01:31:29.374453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.460 [2024-11-20 01:31:29.374495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.460 qpair failed and we were unable to recover it. 00:30:21.460 [2024-11-20 01:31:29.374612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.460 [2024-11-20 01:31:29.374702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.460 [2024-11-20 01:31:29.374732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.460 qpair failed and we were unable to recover it. 00:30:21.460 [2024-11-20 01:31:29.374872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.460 [2024-11-20 01:31:29.375008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.460 [2024-11-20 01:31:29.375033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.460 qpair failed and we were unable to recover it. 00:30:21.460 [2024-11-20 01:31:29.375208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.460 [2024-11-20 01:31:29.375296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.460 [2024-11-20 01:31:29.375321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.460 qpair failed and we were unable to recover it. 00:30:21.460 [2024-11-20 01:31:29.375508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.460 [2024-11-20 01:31:29.375604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.460 [2024-11-20 01:31:29.375628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.460 qpair failed and we were unable to recover it. 00:30:21.460 [2024-11-20 01:31:29.375741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.460 [2024-11-20 01:31:29.375837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.460 [2024-11-20 01:31:29.375862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.460 qpair failed and we were unable to recover it. 00:30:21.460 [2024-11-20 01:31:29.375960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.460 [2024-11-20 01:31:29.376138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.460 [2024-11-20 01:31:29.376167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.460 qpair failed and we were unable to recover it. 00:30:21.460 [2024-11-20 01:31:29.376308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.460 [2024-11-20 01:31:29.376421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.460 [2024-11-20 01:31:29.376446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.460 qpair failed and we were unable to recover it. 00:30:21.460 [2024-11-20 01:31:29.376617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.460 [2024-11-20 01:31:29.376784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.460 [2024-11-20 01:31:29.376808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.460 qpair failed and we were unable to recover it. 00:30:21.460 [2024-11-20 01:31:29.376894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.460 [2024-11-20 01:31:29.377011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.460 [2024-11-20 01:31:29.377036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.460 qpair failed and we were unable to recover it. 00:30:21.460 [2024-11-20 01:31:29.377125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.460 [2024-11-20 01:31:29.377242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.460 [2024-11-20 01:31:29.377266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.460 qpair failed and we were unable to recover it. 00:30:21.460 [2024-11-20 01:31:29.377358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.460 [2024-11-20 01:31:29.377503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.460 [2024-11-20 01:31:29.377534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.460 qpair failed and we were unable to recover it. 00:30:21.460 [2024-11-20 01:31:29.377629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.460 [2024-11-20 01:31:29.377717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.460 [2024-11-20 01:31:29.377744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.460 qpair failed and we were unable to recover it. 00:30:21.460 [2024-11-20 01:31:29.377882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.460 [2024-11-20 01:31:29.378020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.460 [2024-11-20 01:31:29.378043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.461 qpair failed and we were unable to recover it. 00:30:21.461 [2024-11-20 01:31:29.378160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-20 01:31:29.378295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-20 01:31:29.378320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.461 qpair failed and we were unable to recover it. 00:30:21.461 [2024-11-20 01:31:29.378462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-20 01:31:29.378560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-20 01:31:29.378589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.461 qpair failed and we were unable to recover it. 00:30:21.461 [2024-11-20 01:31:29.378731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-20 01:31:29.378816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-20 01:31:29.378842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.461 qpair failed and we were unable to recover it. 00:30:21.461 [2024-11-20 01:31:29.378921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-20 01:31:29.379034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-20 01:31:29.379060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.461 qpair failed and we were unable to recover it. 00:30:21.461 [2024-11-20 01:31:29.379176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-20 01:31:29.379309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-20 01:31:29.379337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.461 qpair failed and we were unable to recover it. 00:30:21.461 [2024-11-20 01:31:29.379450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-20 01:31:29.379566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-20 01:31:29.379590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.461 qpair failed and we were unable to recover it. 00:30:21.461 [2024-11-20 01:31:29.379687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-20 01:31:29.379775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-20 01:31:29.379800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.461 qpair failed and we were unable to recover it. 00:30:21.461 [2024-11-20 01:31:29.379888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-20 01:31:29.379997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-20 01:31:29.380027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.461 qpair failed and we were unable to recover it. 00:30:21.461 [2024-11-20 01:31:29.380122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-20 01:31:29.380242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-20 01:31:29.380267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.461 qpair failed and we were unable to recover it. 00:30:21.461 [2024-11-20 01:31:29.380375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-20 01:31:29.380529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-20 01:31:29.380560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.461 qpair failed and we were unable to recover it. 00:30:21.461 [2024-11-20 01:31:29.380718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-20 01:31:29.380815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-20 01:31:29.380842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.461 qpair failed and we were unable to recover it. 00:30:21.461 [2024-11-20 01:31:29.380988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-20 01:31:29.381109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-20 01:31:29.381133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.461 qpair failed and we were unable to recover it. 00:30:21.461 [2024-11-20 01:31:29.381297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-20 01:31:29.381425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-20 01:31:29.381453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.461 qpair failed and we were unable to recover it. 00:30:21.461 [2024-11-20 01:31:29.381589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-20 01:31:29.381688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-20 01:31:29.381714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.461 qpair failed and we were unable to recover it. 00:30:21.461 [2024-11-20 01:31:29.381832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-20 01:31:29.381943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-20 01:31:29.381968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.461 qpair failed and we were unable to recover it. 00:30:21.461 [2024-11-20 01:31:29.382111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-20 01:31:29.382217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-20 01:31:29.382241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.461 qpair failed and we were unable to recover it. 00:30:21.461 [2024-11-20 01:31:29.382395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-20 01:31:29.382495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-20 01:31:29.382524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.461 qpair failed and we were unable to recover it. 00:30:21.461 [2024-11-20 01:31:29.382653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-20 01:31:29.382745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-20 01:31:29.382774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.461 qpair failed and we were unable to recover it. 00:30:21.461 [2024-11-20 01:31:29.382905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-20 01:31:29.383059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-20 01:31:29.383103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.461 qpair failed and we were unable to recover it. 00:30:21.461 [2024-11-20 01:31:29.383245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-20 01:31:29.383358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-20 01:31:29.383382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.461 qpair failed and we were unable to recover it. 00:30:21.461 [2024-11-20 01:31:29.383508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-20 01:31:29.383593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-20 01:31:29.383619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.461 qpair failed and we were unable to recover it. 00:30:21.461 [2024-11-20 01:31:29.383758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-20 01:31:29.383890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-20 01:31:29.383916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.461 qpair failed and we were unable to recover it. 00:30:21.461 [2024-11-20 01:31:29.384016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-20 01:31:29.384136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-20 01:31:29.384161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.461 qpair failed and we were unable to recover it. 00:30:21.461 [2024-11-20 01:31:29.384249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-20 01:31:29.384363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-20 01:31:29.384387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.461 qpair failed and we were unable to recover it. 00:30:21.461 [2024-11-20 01:31:29.384472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-20 01:31:29.384589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-20 01:31:29.384617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.461 qpair failed and we were unable to recover it. 00:30:21.461 [2024-11-20 01:31:29.384728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-20 01:31:29.384867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-20 01:31:29.384892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.461 qpair failed and we were unable to recover it. 00:30:21.461 [2024-11-20 01:31:29.384986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-20 01:31:29.385106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-20 01:31:29.385134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.461 qpair failed and we were unable to recover it. 00:30:21.461 [2024-11-20 01:31:29.385250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-20 01:31:29.385332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-20 01:31:29.385358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.461 qpair failed and we were unable to recover it. 00:30:21.461 [2024-11-20 01:31:29.385483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-20 01:31:29.385597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-20 01:31:29.385623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.462 qpair failed and we were unable to recover it. 00:30:21.462 [2024-11-20 01:31:29.385764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-20 01:31:29.385847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-20 01:31:29.385873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.462 qpair failed and we were unable to recover it. 00:30:21.462 [2024-11-20 01:31:29.385991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-20 01:31:29.386083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-20 01:31:29.386109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.462 qpair failed and we were unable to recover it. 00:30:21.462 [2024-11-20 01:31:29.386270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-20 01:31:29.386446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-20 01:31:29.386471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.462 qpair failed and we were unable to recover it. 00:30:21.462 [2024-11-20 01:31:29.386594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-20 01:31:29.386737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-20 01:31:29.386761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.462 qpair failed and we were unable to recover it. 00:30:21.462 [2024-11-20 01:31:29.386875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-20 01:31:29.386997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-20 01:31:29.387024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.462 qpair failed and we were unable to recover it. 00:30:21.462 [2024-11-20 01:31:29.387162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-20 01:31:29.387257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-20 01:31:29.387282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.462 qpair failed and we were unable to recover it. 00:30:21.462 [2024-11-20 01:31:29.387393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-20 01:31:29.387476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-20 01:31:29.387500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.462 qpair failed and we were unable to recover it. 00:30:21.462 [2024-11-20 01:31:29.387604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-20 01:31:29.387768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-20 01:31:29.387794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.462 qpair failed and we were unable to recover it. 00:30:21.462 [2024-11-20 01:31:29.387916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-20 01:31:29.388017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-20 01:31:29.388044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.462 qpair failed and we were unable to recover it. 00:30:21.462 [2024-11-20 01:31:29.388191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-20 01:31:29.388284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-20 01:31:29.388309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.462 qpair failed and we were unable to recover it. 00:30:21.462 [2024-11-20 01:31:29.388429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-20 01:31:29.388513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-20 01:31:29.388553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.462 qpair failed and we were unable to recover it. 00:30:21.462 [2024-11-20 01:31:29.388686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-20 01:31:29.388777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-20 01:31:29.388804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.462 qpair failed and we were unable to recover it. 00:30:21.462 [2024-11-20 01:31:29.388958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-20 01:31:29.389101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-20 01:31:29.389143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.462 qpair failed and we were unable to recover it. 00:30:21.462 [2024-11-20 01:31:29.389249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-20 01:31:29.389349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-20 01:31:29.389376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.462 qpair failed and we were unable to recover it. 00:30:21.462 [2024-11-20 01:31:29.389488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-20 01:31:29.389584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-20 01:31:29.389612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.462 qpair failed and we were unable to recover it. 00:30:21.462 [2024-11-20 01:31:29.389732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-20 01:31:29.389818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-20 01:31:29.389844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.462 qpair failed and we were unable to recover it. 00:30:21.462 [2024-11-20 01:31:29.389930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-20 01:31:29.390029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-20 01:31:29.390057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.462 qpair failed and we were unable to recover it. 00:30:21.462 [2024-11-20 01:31:29.390152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-20 01:31:29.390248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-20 01:31:29.390275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.462 qpair failed and we were unable to recover it. 00:30:21.462 [2024-11-20 01:31:29.390410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-20 01:31:29.390530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-20 01:31:29.390554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.462 qpair failed and we were unable to recover it. 00:30:21.462 [2024-11-20 01:31:29.390645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-20 01:31:29.390769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-20 01:31:29.390793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.462 qpair failed and we were unable to recover it. 00:30:21.462 [2024-11-20 01:31:29.390998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-20 01:31:29.391102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-20 01:31:29.391144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.462 qpair failed and we were unable to recover it. 00:30:21.462 [2024-11-20 01:31:29.391276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-20 01:31:29.391419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-20 01:31:29.391444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.462 qpair failed and we were unable to recover it. 00:30:21.462 [2024-11-20 01:31:29.391548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-20 01:31:29.391650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-20 01:31:29.391677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.462 qpair failed and we were unable to recover it. 00:30:21.462 [2024-11-20 01:31:29.391781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-20 01:31:29.391902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-20 01:31:29.391929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.462 qpair failed and we were unable to recover it. 00:30:21.462 [2024-11-20 01:31:29.392162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-20 01:31:29.392296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-20 01:31:29.392324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.462 qpair failed and we were unable to recover it. 00:30:21.462 [2024-11-20 01:31:29.392536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-20 01:31:29.392665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-20 01:31:29.392692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.462 qpair failed and we were unable to recover it. 00:30:21.462 [2024-11-20 01:31:29.392814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-20 01:31:29.392953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-20 01:31:29.392979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.462 qpair failed and we were unable to recover it. 00:30:21.462 [2024-11-20 01:31:29.393099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-20 01:31:29.393182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-20 01:31:29.393207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.463 qpair failed and we were unable to recover it. 00:30:21.463 [2024-11-20 01:31:29.393317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-20 01:31:29.393448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-20 01:31:29.393475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.463 qpair failed and we were unable to recover it. 00:30:21.463 [2024-11-20 01:31:29.393603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-20 01:31:29.393723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-20 01:31:29.393751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.463 qpair failed and we were unable to recover it. 00:30:21.463 [2024-11-20 01:31:29.393916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-20 01:31:29.394011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-20 01:31:29.394037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.463 qpair failed and we were unable to recover it. 00:30:21.463 [2024-11-20 01:31:29.394190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-20 01:31:29.394323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-20 01:31:29.394366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.463 qpair failed and we were unable to recover it. 00:30:21.463 [2024-11-20 01:31:29.394488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-20 01:31:29.394599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-20 01:31:29.394627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.463 qpair failed and we were unable to recover it. 00:30:21.463 [2024-11-20 01:31:29.394745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-20 01:31:29.394865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-20 01:31:29.394891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.463 qpair failed and we were unable to recover it. 00:30:21.463 [2024-11-20 01:31:29.395042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-20 01:31:29.395198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-20 01:31:29.395225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.463 qpair failed and we were unable to recover it. 00:30:21.463 [2024-11-20 01:31:29.395322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-20 01:31:29.395432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-20 01:31:29.395458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.463 qpair failed and we were unable to recover it. 00:30:21.463 [2024-11-20 01:31:29.395575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-20 01:31:29.395686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-20 01:31:29.395710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.463 qpair failed and we were unable to recover it. 00:30:21.463 [2024-11-20 01:31:29.395826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-20 01:31:29.395951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-20 01:31:29.395979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.463 qpair failed and we were unable to recover it. 00:30:21.463 [2024-11-20 01:31:29.396111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-20 01:31:29.396255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-20 01:31:29.396280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.463 qpair failed and we were unable to recover it. 00:30:21.463 [2024-11-20 01:31:29.396404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-20 01:31:29.396486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-20 01:31:29.396512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.463 qpair failed and we were unable to recover it. 00:30:21.463 [2024-11-20 01:31:29.396596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-20 01:31:29.396685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-20 01:31:29.396711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.463 qpair failed and we were unable to recover it. 00:30:21.463 [2024-11-20 01:31:29.396860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-20 01:31:29.397009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-20 01:31:29.397037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.463 qpair failed and we were unable to recover it. 00:30:21.463 [2024-11-20 01:31:29.397180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-20 01:31:29.397301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-20 01:31:29.397326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.463 qpair failed and we were unable to recover it. 00:30:21.463 [2024-11-20 01:31:29.397541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-20 01:31:29.397663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-20 01:31:29.397692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.463 qpair failed and we were unable to recover it. 00:30:21.463 [2024-11-20 01:31:29.397821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-20 01:31:29.397944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-20 01:31:29.397979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.463 qpair failed and we were unable to recover it. 00:30:21.463 [2024-11-20 01:31:29.398126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-20 01:31:29.398266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-20 01:31:29.398298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.463 qpair failed and we were unable to recover it. 00:30:21.463 [2024-11-20 01:31:29.398377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-20 01:31:29.398516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-20 01:31:29.398543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.463 qpair failed and we were unable to recover it. 00:30:21.463 [2024-11-20 01:31:29.398665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-20 01:31:29.398759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-20 01:31:29.398787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.463 qpair failed and we were unable to recover it. 00:30:21.463 [2024-11-20 01:31:29.398927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-20 01:31:29.399004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-20 01:31:29.399030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.463 qpair failed and we were unable to recover it. 00:30:21.463 [2024-11-20 01:31:29.399159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-20 01:31:29.399248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-20 01:31:29.399276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.463 qpair failed and we were unable to recover it. 00:30:21.463 [2024-11-20 01:31:29.399394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-20 01:31:29.399557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-20 01:31:29.399585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.463 qpair failed and we were unable to recover it. 00:30:21.463 [2024-11-20 01:31:29.399714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-20 01:31:29.399812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-20 01:31:29.399836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.463 qpair failed and we were unable to recover it. 00:30:21.463 [2024-11-20 01:31:29.399929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-20 01:31:29.400024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-20 01:31:29.400049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.463 qpair failed and we were unable to recover it. 00:30:21.463 [2024-11-20 01:31:29.400174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-20 01:31:29.400293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-20 01:31:29.400322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.463 qpair failed and we were unable to recover it. 00:30:21.463 [2024-11-20 01:31:29.400456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-20 01:31:29.400578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-20 01:31:29.400603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.463 qpair failed and we were unable to recover it. 00:30:21.463 [2024-11-20 01:31:29.400715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-20 01:31:29.400878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-20 01:31:29.400915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.463 qpair failed and we were unable to recover it. 00:30:21.463 [2024-11-20 01:31:29.401043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.464 [2024-11-20 01:31:29.401187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.464 [2024-11-20 01:31:29.401214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.464 qpair failed and we were unable to recover it. 00:30:21.464 [2024-11-20 01:31:29.401359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.464 [2024-11-20 01:31:29.401448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.464 [2024-11-20 01:31:29.401474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.464 qpair failed and we were unable to recover it. 00:30:21.464 [2024-11-20 01:31:29.401632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.464 [2024-11-20 01:31:29.401722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.464 [2024-11-20 01:31:29.401766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.464 qpair failed and we were unable to recover it. 00:30:21.464 [2024-11-20 01:31:29.401900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.464 [2024-11-20 01:31:29.401983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.464 [2024-11-20 01:31:29.402009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.464 qpair failed and we were unable to recover it. 00:30:21.464 [2024-11-20 01:31:29.402109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.464 [2024-11-20 01:31:29.402197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.464 [2024-11-20 01:31:29.402221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.464 qpair failed and we were unable to recover it. 00:30:21.464 [2024-11-20 01:31:29.402384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.464 [2024-11-20 01:31:29.402509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.464 [2024-11-20 01:31:29.402537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.464 qpair failed and we were unable to recover it. 00:30:21.464 [2024-11-20 01:31:29.402664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.464 [2024-11-20 01:31:29.402808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.464 [2024-11-20 01:31:29.402835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.464 qpair failed and we were unable to recover it. 00:30:21.464 [2024-11-20 01:31:29.402955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.464 [2024-11-20 01:31:29.403061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.464 [2024-11-20 01:31:29.403091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.464 qpair failed and we were unable to recover it. 00:30:21.464 [2024-11-20 01:31:29.403184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.464 [2024-11-20 01:31:29.403268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.464 [2024-11-20 01:31:29.403293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.464 qpair failed and we were unable to recover it. 00:30:21.464 [2024-11-20 01:31:29.403409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.464 [2024-11-20 01:31:29.403547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.464 [2024-11-20 01:31:29.403575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.464 qpair failed and we were unable to recover it. 00:30:21.464 [2024-11-20 01:31:29.403714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.464 [2024-11-20 01:31:29.403809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.464 [2024-11-20 01:31:29.403834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.464 qpair failed and we were unable to recover it. 00:30:21.464 [2024-11-20 01:31:29.403926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.464 [2024-11-20 01:31:29.404043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.464 [2024-11-20 01:31:29.404090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.464 qpair failed and we were unable to recover it. 00:30:21.464 [2024-11-20 01:31:29.404197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.464 [2024-11-20 01:31:29.404322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.464 [2024-11-20 01:31:29.404348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.464 qpair failed and we were unable to recover it. 00:30:21.464 [2024-11-20 01:31:29.404465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.464 [2024-11-20 01:31:29.404588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.464 [2024-11-20 01:31:29.404613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.464 qpair failed and we were unable to recover it. 00:30:21.464 [2024-11-20 01:31:29.404725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.464 [2024-11-20 01:31:29.404859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.464 [2024-11-20 01:31:29.404884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.464 qpair failed and we were unable to recover it. 00:30:21.464 [2024-11-20 01:31:29.405019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.464 [2024-11-20 01:31:29.405124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.464 [2024-11-20 01:31:29.405152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.464 qpair failed and we were unable to recover it. 00:30:21.464 [2024-11-20 01:31:29.405268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.464 [2024-11-20 01:31:29.405384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.464 [2024-11-20 01:31:29.405409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.464 qpair failed and we were unable to recover it. 00:30:21.464 [2024-11-20 01:31:29.405498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.464 [2024-11-20 01:31:29.405622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.464 [2024-11-20 01:31:29.405664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.464 qpair failed and we were unable to recover it. 00:30:21.464 [2024-11-20 01:31:29.405755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.464 [2024-11-20 01:31:29.405872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.464 [2024-11-20 01:31:29.405898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.464 qpair failed and we were unable to recover it. 00:30:21.464 [2024-11-20 01:31:29.405984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.464 [2024-11-20 01:31:29.406107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.464 [2024-11-20 01:31:29.406132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.464 qpair failed and we were unable to recover it. 00:30:21.464 [2024-11-20 01:31:29.406307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.464 [2024-11-20 01:31:29.406438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.464 [2024-11-20 01:31:29.406479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.464 qpair failed and we were unable to recover it. 00:30:21.464 [2024-11-20 01:31:29.406570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.464 [2024-11-20 01:31:29.406664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.464 [2024-11-20 01:31:29.406690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.464 qpair failed and we were unable to recover it. 00:30:21.464 [2024-11-20 01:31:29.406783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.464 [2024-11-20 01:31:29.406898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.464 [2024-11-20 01:31:29.406924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.464 qpair failed and we were unable to recover it. 00:30:21.464 [2024-11-20 01:31:29.407014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.464 [2024-11-20 01:31:29.407146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.464 [2024-11-20 01:31:29.407174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.464 qpair failed and we were unable to recover it. 00:30:21.464 [2024-11-20 01:31:29.407304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.464 [2024-11-20 01:31:29.407397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.464 [2024-11-20 01:31:29.407424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.464 qpair failed and we were unable to recover it. 00:30:21.464 [2024-11-20 01:31:29.407563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.464 [2024-11-20 01:31:29.407652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.464 [2024-11-20 01:31:29.407678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.464 qpair failed and we were unable to recover it. 00:30:21.464 [2024-11-20 01:31:29.407809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.464 [2024-11-20 01:31:29.407965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.464 [2024-11-20 01:31:29.407992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.464 qpair failed and we were unable to recover it. 00:30:21.464 [2024-11-20 01:31:29.408119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.464 [2024-11-20 01:31:29.408272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.464 [2024-11-20 01:31:29.408300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.464 qpair failed and we were unable to recover it. 00:30:21.464 [2024-11-20 01:31:29.408458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.465 [2024-11-20 01:31:29.408548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.465 [2024-11-20 01:31:29.408572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.465 qpair failed and we were unable to recover it. 00:30:21.465 [2024-11-20 01:31:29.408684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.465 [2024-11-20 01:31:29.408771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.465 [2024-11-20 01:31:29.408795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.465 qpair failed and we were unable to recover it. 00:30:21.465 [2024-11-20 01:31:29.408880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.465 [2024-11-20 01:31:29.408988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.465 [2024-11-20 01:31:29.409012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.465 qpair failed and we were unable to recover it. 00:30:21.465 [2024-11-20 01:31:29.409146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.465 [2024-11-20 01:31:29.409264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.465 [2024-11-20 01:31:29.409289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.465 qpair failed and we were unable to recover it. 00:30:21.465 [2024-11-20 01:31:29.409397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.465 [2024-11-20 01:31:29.409507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.465 [2024-11-20 01:31:29.409533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.465 qpair failed and we were unable to recover it. 00:30:21.465 [2024-11-20 01:31:29.409644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.465 [2024-11-20 01:31:29.409738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.465 [2024-11-20 01:31:29.409763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.465 qpair failed and we were unable to recover it. 00:30:21.465 [2024-11-20 01:31:29.409854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.465 [2024-11-20 01:31:29.409935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.465 [2024-11-20 01:31:29.409961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.465 qpair failed and we were unable to recover it. 00:30:21.465 [2024-11-20 01:31:29.410099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.465 [2024-11-20 01:31:29.410231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.465 [2024-11-20 01:31:29.410258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.465 qpair failed and we were unable to recover it. 00:30:21.465 [2024-11-20 01:31:29.410381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.465 [2024-11-20 01:31:29.410521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.465 [2024-11-20 01:31:29.410546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.465 qpair failed and we were unable to recover it. 00:30:21.465 [2024-11-20 01:31:29.410665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.465 [2024-11-20 01:31:29.410747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.465 [2024-11-20 01:31:29.410771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.465 qpair failed and we were unable to recover it. 00:30:21.465 [2024-11-20 01:31:29.410913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.465 [2024-11-20 01:31:29.411025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.465 [2024-11-20 01:31:29.411052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.465 qpair failed and we were unable to recover it. 00:30:21.465 [2024-11-20 01:31:29.411204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.465 [2024-11-20 01:31:29.411339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.465 [2024-11-20 01:31:29.411367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.465 qpair failed and we were unable to recover it. 00:30:21.465 [2024-11-20 01:31:29.411505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.465 [2024-11-20 01:31:29.411623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.465 [2024-11-20 01:31:29.411647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.465 qpair failed and we were unable to recover it. 00:30:21.465 [2024-11-20 01:31:29.411780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.465 [2024-11-20 01:31:29.411880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.465 [2024-11-20 01:31:29.411907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.465 qpair failed and we were unable to recover it. 00:30:21.465 [2024-11-20 01:31:29.412035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.465 [2024-11-20 01:31:29.412136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.465 [2024-11-20 01:31:29.412165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.465 qpair failed and we were unable to recover it. 00:30:21.465 [2024-11-20 01:31:29.412275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.465 [2024-11-20 01:31:29.412368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.465 [2024-11-20 01:31:29.412394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.465 qpair failed and we were unable to recover it. 00:30:21.465 [2024-11-20 01:31:29.412515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.465 [2024-11-20 01:31:29.412602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.465 [2024-11-20 01:31:29.412627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.465 qpair failed and we were unable to recover it. 00:30:21.465 [2024-11-20 01:31:29.412712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.465 [2024-11-20 01:31:29.412793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.465 [2024-11-20 01:31:29.412818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.465 qpair failed and we were unable to recover it. 00:30:21.465 [2024-11-20 01:31:29.412935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.465 [2024-11-20 01:31:29.413046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.465 [2024-11-20 01:31:29.413076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.465 qpair failed and we were unable to recover it. 00:30:21.465 [2024-11-20 01:31:29.413221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.465 [2024-11-20 01:31:29.413334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.465 [2024-11-20 01:31:29.413359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.465 qpair failed and we were unable to recover it. 00:30:21.465 [2024-11-20 01:31:29.413479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.465 [2024-11-20 01:31:29.413634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.465 [2024-11-20 01:31:29.413661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.465 qpair failed and we were unable to recover it. 00:30:21.465 [2024-11-20 01:31:29.413766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.465 [2024-11-20 01:31:29.413878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.465 [2024-11-20 01:31:29.413902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.465 qpair failed and we were unable to recover it. 00:30:21.465 [2024-11-20 01:31:29.413990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.465 [2024-11-20 01:31:29.414090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.465 [2024-11-20 01:31:29.414115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.465 qpair failed and we were unable to recover it. 00:30:21.465 [2024-11-20 01:31:29.414202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.465 [2024-11-20 01:31:29.414369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.465 [2024-11-20 01:31:29.414398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.465 qpair failed and we were unable to recover it. 00:30:21.465 [2024-11-20 01:31:29.414510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.465 [2024-11-20 01:31:29.414604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.466 [2024-11-20 01:31:29.414628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.466 qpair failed and we were unable to recover it. 00:30:21.466 [2024-11-20 01:31:29.414716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.466 [2024-11-20 01:31:29.414857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.466 [2024-11-20 01:31:29.414888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.466 qpair failed and we were unable to recover it. 00:30:21.466 [2024-11-20 01:31:29.415019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.466 [2024-11-20 01:31:29.415149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.466 [2024-11-20 01:31:29.415175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.466 qpair failed and we were unable to recover it. 00:30:21.466 [2024-11-20 01:31:29.415264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.466 [2024-11-20 01:31:29.415375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.466 [2024-11-20 01:31:29.415399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.466 qpair failed and we were unable to recover it. 00:30:21.466 [2024-11-20 01:31:29.415537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.466 [2024-11-20 01:31:29.415626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.466 [2024-11-20 01:31:29.415653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.466 qpair failed and we were unable to recover it. 00:30:21.466 [2024-11-20 01:31:29.415754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.466 [2024-11-20 01:31:29.415872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.466 [2024-11-20 01:31:29.415898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.466 qpair failed and we were unable to recover it. 00:30:21.466 [2024-11-20 01:31:29.416039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.466 [2024-11-20 01:31:29.416188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.466 [2024-11-20 01:31:29.416213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.466 qpair failed and we were unable to recover it. 00:30:21.466 [2024-11-20 01:31:29.416352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.466 [2024-11-20 01:31:29.416492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.466 [2024-11-20 01:31:29.416516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.466 qpair failed and we were unable to recover it. 00:30:21.466 [2024-11-20 01:31:29.416669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.466 [2024-11-20 01:31:29.416792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.466 [2024-11-20 01:31:29.416837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.466 qpair failed and we were unable to recover it. 00:30:21.466 [2024-11-20 01:31:29.416927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.466 [2024-11-20 01:31:29.417046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.466 [2024-11-20 01:31:29.417076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.466 qpair failed and we were unable to recover it. 00:30:21.466 [2024-11-20 01:31:29.417167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.466 [2024-11-20 01:31:29.417280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.466 [2024-11-20 01:31:29.417306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.466 qpair failed and we were unable to recover it. 00:30:21.466 [2024-11-20 01:31:29.417396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.466 [2024-11-20 01:31:29.417495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.466 [2024-11-20 01:31:29.417542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.466 qpair failed and we were unable to recover it. 00:30:21.466 [2024-11-20 01:31:29.417690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.466 [2024-11-20 01:31:29.417782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.466 [2024-11-20 01:31:29.417806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.466 qpair failed and we were unable to recover it. 00:30:21.466 [2024-11-20 01:31:29.417894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.466 [2024-11-20 01:31:29.418043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.466 [2024-11-20 01:31:29.418067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.466 qpair failed and we were unable to recover it. 00:30:21.466 [2024-11-20 01:31:29.418192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.466 [2024-11-20 01:31:29.418354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.466 [2024-11-20 01:31:29.418378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.466 qpair failed and we were unable to recover it. 00:30:21.466 [2024-11-20 01:31:29.418487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.466 [2024-11-20 01:31:29.418632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.466 [2024-11-20 01:31:29.418657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.466 qpair failed and we were unable to recover it. 00:30:21.466 [2024-11-20 01:31:29.418778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.466 [2024-11-20 01:31:29.418905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.466 [2024-11-20 01:31:29.418932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.466 qpair failed and we were unable to recover it. 00:30:21.466 [2024-11-20 01:31:29.419052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.466 [2024-11-20 01:31:29.419184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.466 [2024-11-20 01:31:29.419211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.466 qpair failed and we were unable to recover it. 00:30:21.466 [2024-11-20 01:31:29.419355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.466 [2024-11-20 01:31:29.419472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.466 [2024-11-20 01:31:29.419496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.466 qpair failed and we were unable to recover it. 00:30:21.466 [2024-11-20 01:31:29.419614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.466 [2024-11-20 01:31:29.419732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.466 [2024-11-20 01:31:29.419757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.466 qpair failed and we were unable to recover it. 00:30:21.466 [2024-11-20 01:31:29.419895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.466 [2024-11-20 01:31:29.420000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.466 [2024-11-20 01:31:29.420027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.466 qpair failed and we were unable to recover it. 00:30:21.466 [2024-11-20 01:31:29.420147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.466 [2024-11-20 01:31:29.420238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.466 [2024-11-20 01:31:29.420268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.466 qpair failed and we were unable to recover it. 00:30:21.466 [2024-11-20 01:31:29.420428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.466 [2024-11-20 01:31:29.420529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.466 [2024-11-20 01:31:29.420556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.466 qpair failed and we were unable to recover it. 00:30:21.466 [2024-11-20 01:31:29.420647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.466 [2024-11-20 01:31:29.420735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.466 [2024-11-20 01:31:29.420762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.466 qpair failed and we were unable to recover it. 00:30:21.466 [2024-11-20 01:31:29.420903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.466 [2024-11-20 01:31:29.421030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.466 [2024-11-20 01:31:29.421054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.466 qpair failed and we were unable to recover it. 00:30:21.466 [2024-11-20 01:31:29.421202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.466 [2024-11-20 01:31:29.421337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.466 [2024-11-20 01:31:29.421375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.466 qpair failed and we were unable to recover it. 00:30:21.466 [2024-11-20 01:31:29.421475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.466 [2024-11-20 01:31:29.421583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.466 [2024-11-20 01:31:29.421609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.466 qpair failed and we were unable to recover it. 00:30:21.466 [2024-11-20 01:31:29.421752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.466 [2024-11-20 01:31:29.421864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.466 [2024-11-20 01:31:29.421888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.466 qpair failed and we were unable to recover it. 00:30:21.466 [2024-11-20 01:31:29.422003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.466 [2024-11-20 01:31:29.422141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.466 [2024-11-20 01:31:29.422182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.466 qpair failed and we were unable to recover it. 00:30:21.467 [2024-11-20 01:31:29.422271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.467 [2024-11-20 01:31:29.422394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.467 [2024-11-20 01:31:29.422420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.467 qpair failed and we were unable to recover it. 00:30:21.467 [2024-11-20 01:31:29.422533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.467 [2024-11-20 01:31:29.422673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.467 [2024-11-20 01:31:29.422698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.467 qpair failed and we were unable to recover it. 00:30:21.467 [2024-11-20 01:31:29.422845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.467 [2024-11-20 01:31:29.422972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.467 [2024-11-20 01:31:29.423005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.467 qpair failed and we were unable to recover it. 00:30:21.467 [2024-11-20 01:31:29.423135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.467 [2024-11-20 01:31:29.423232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.467 [2024-11-20 01:31:29.423259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.467 qpair failed and we were unable to recover it. 00:30:21.467 [2024-11-20 01:31:29.423372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.467 [2024-11-20 01:31:29.423514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.467 [2024-11-20 01:31:29.423539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.467 qpair failed and we were unable to recover it. 00:30:21.467 [2024-11-20 01:31:29.423703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.467 [2024-11-20 01:31:29.423797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.467 [2024-11-20 01:31:29.423842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.467 qpair failed and we were unable to recover it. 00:30:21.467 [2024-11-20 01:31:29.423968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.467 [2024-11-20 01:31:29.424043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.467 [2024-11-20 01:31:29.424067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.467 qpair failed and we were unable to recover it. 00:30:21.467 [2024-11-20 01:31:29.424179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.467 [2024-11-20 01:31:29.424266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.467 [2024-11-20 01:31:29.424290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.467 qpair failed and we were unable to recover it. 00:30:21.467 [2024-11-20 01:31:29.424375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.467 [2024-11-20 01:31:29.424457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.467 [2024-11-20 01:31:29.424481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.467 qpair failed and we were unable to recover it. 00:30:21.467 [2024-11-20 01:31:29.424637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.467 [2024-11-20 01:31:29.424765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.467 [2024-11-20 01:31:29.424789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.467 qpair failed and we were unable to recover it. 00:30:21.467 [2024-11-20 01:31:29.424884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.467 [2024-11-20 01:31:29.424969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.467 [2024-11-20 01:31:29.424995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.467 qpair failed and we were unable to recover it. 00:30:21.467 [2024-11-20 01:31:29.425110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.467 [2024-11-20 01:31:29.425205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.467 [2024-11-20 01:31:29.425229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.467 qpair failed and we were unable to recover it. 00:30:21.467 [2024-11-20 01:31:29.425347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.467 [2024-11-20 01:31:29.425507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.467 [2024-11-20 01:31:29.425535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.467 qpair failed and we were unable to recover it. 00:30:21.467 [2024-11-20 01:31:29.425685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.467 [2024-11-20 01:31:29.425796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.467 [2024-11-20 01:31:29.425820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.467 qpair failed and we were unable to recover it. 00:30:21.467 [2024-11-20 01:31:29.425926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.467 [2024-11-20 01:31:29.426032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.467 [2024-11-20 01:31:29.426056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.467 qpair failed and we were unable to recover it. 00:30:21.467 [2024-11-20 01:31:29.426179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.467 [2024-11-20 01:31:29.426281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.467 [2024-11-20 01:31:29.426308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.467 qpair failed and we were unable to recover it. 00:30:21.467 [2024-11-20 01:31:29.426438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.467 [2024-11-20 01:31:29.426521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.467 [2024-11-20 01:31:29.426546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.467 qpair failed and we were unable to recover it. 00:30:21.467 [2024-11-20 01:31:29.426652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.467 [2024-11-20 01:31:29.426795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.467 [2024-11-20 01:31:29.426822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.467 qpair failed and we were unable to recover it. 00:30:21.467 [2024-11-20 01:31:29.426949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.467 [2024-11-20 01:31:29.427081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.467 [2024-11-20 01:31:29.427108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.467 qpair failed and we were unable to recover it. 00:30:21.467 [2024-11-20 01:31:29.427248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.467 [2024-11-20 01:31:29.427344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.467 [2024-11-20 01:31:29.427368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.467 qpair failed and we were unable to recover it. 00:30:21.467 [2024-11-20 01:31:29.427452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.467 [2024-11-20 01:31:29.427568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.467 [2024-11-20 01:31:29.427593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.467 qpair failed and we were unable to recover it. 00:30:21.467 [2024-11-20 01:31:29.427741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.467 [2024-11-20 01:31:29.427830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.467 [2024-11-20 01:31:29.427857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.467 qpair failed and we were unable to recover it. 00:30:21.467 [2024-11-20 01:31:29.427957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.467 [2024-11-20 01:31:29.428066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.467 [2024-11-20 01:31:29.428097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.467 qpair failed and we were unable to recover it. 00:30:21.467 [2024-11-20 01:31:29.428233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.467 [2024-11-20 01:31:29.428374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.467 [2024-11-20 01:31:29.428398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.467 qpair failed and we were unable to recover it. 00:30:21.467 [2024-11-20 01:31:29.428490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.467 [2024-11-20 01:31:29.428612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.467 [2024-11-20 01:31:29.428636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.467 qpair failed and we were unable to recover it. 00:30:21.467 [2024-11-20 01:31:29.428750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.467 [2024-11-20 01:31:29.428835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.467 [2024-11-20 01:31:29.428859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.467 qpair failed and we were unable to recover it. 00:30:21.467 [2024-11-20 01:31:29.428941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.467 [2024-11-20 01:31:29.429055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.467 [2024-11-20 01:31:29.429087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.467 qpair failed and we were unable to recover it. 00:30:21.467 [2024-11-20 01:31:29.429177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.467 [2024-11-20 01:31:29.429328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.467 [2024-11-20 01:31:29.429354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.467 qpair failed and we were unable to recover it. 00:30:21.467 [2024-11-20 01:31:29.429475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.467 [2024-11-20 01:31:29.429557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.468 [2024-11-20 01:31:29.429582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.468 qpair failed and we were unable to recover it. 00:30:21.468 [2024-11-20 01:31:29.429684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.468 [2024-11-20 01:31:29.429823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.468 [2024-11-20 01:31:29.429848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.468 qpair failed and we were unable to recover it. 00:30:21.468 [2024-11-20 01:31:29.429969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.468 [2024-11-20 01:31:29.430102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.468 [2024-11-20 01:31:29.430129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.468 qpair failed and we were unable to recover it. 00:30:21.468 [2024-11-20 01:31:29.430248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.468 [2024-11-20 01:31:29.430357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.468 [2024-11-20 01:31:29.430381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.468 qpair failed and we were unable to recover it. 00:30:21.468 [2024-11-20 01:31:29.430497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.468 [2024-11-20 01:31:29.430605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.468 [2024-11-20 01:31:29.430633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.468 qpair failed and we were unable to recover it. 00:30:21.468 [2024-11-20 01:31:29.430737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.468 [2024-11-20 01:31:29.430824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.468 [2024-11-20 01:31:29.430853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.468 qpair failed and we were unable to recover it. 00:30:21.468 [2024-11-20 01:31:29.430966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.468 [2024-11-20 01:31:29.431099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.468 [2024-11-20 01:31:29.431125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.468 qpair failed and we were unable to recover it. 00:30:21.468 [2024-11-20 01:31:29.431263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.468 [2024-11-20 01:31:29.431390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.468 [2024-11-20 01:31:29.431418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.468 qpair failed and we were unable to recover it. 00:30:21.468 [2024-11-20 01:31:29.431518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.468 [2024-11-20 01:31:29.431649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.468 [2024-11-20 01:31:29.431676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.468 qpair failed and we were unable to recover it. 00:30:21.468 [2024-11-20 01:31:29.431788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.468 [2024-11-20 01:31:29.431904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.468 [2024-11-20 01:31:29.431929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.468 qpair failed and we were unable to recover it. 00:30:21.468 [2024-11-20 01:31:29.432034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.468 [2024-11-20 01:31:29.432128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.468 [2024-11-20 01:31:29.432156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.468 qpair failed and we were unable to recover it. 00:30:21.468 [2024-11-20 01:31:29.432310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.468 [2024-11-20 01:31:29.432468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.468 [2024-11-20 01:31:29.432495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.468 qpair failed and we were unable to recover it. 00:30:21.468 [2024-11-20 01:31:29.432668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.468 [2024-11-20 01:31:29.432806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.468 [2024-11-20 01:31:29.432847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.468 qpair failed and we were unable to recover it. 00:30:21.468 [2024-11-20 01:31:29.432985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.468 [2024-11-20 01:31:29.433076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.468 [2024-11-20 01:31:29.433102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.468 qpair failed and we were unable to recover it. 00:30:21.468 [2024-11-20 01:31:29.433221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.468 [2024-11-20 01:31:29.433307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.468 [2024-11-20 01:31:29.433331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.468 qpair failed and we were unable to recover it. 00:30:21.468 [2024-11-20 01:31:29.433452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.468 [2024-11-20 01:31:29.433536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.468 [2024-11-20 01:31:29.433570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.468 qpair failed and we were unable to recover it. 00:30:21.468 [2024-11-20 01:31:29.433688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.468 [2024-11-20 01:31:29.433811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.468 [2024-11-20 01:31:29.433837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.468 qpair failed and we were unable to recover it. 00:30:21.468 [2024-11-20 01:31:29.433956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.468 [2024-11-20 01:31:29.434052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.468 [2024-11-20 01:31:29.434110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.468 qpair failed and we were unable to recover it. 00:30:21.468 [2024-11-20 01:31:29.434230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.468 [2024-11-20 01:31:29.434313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.468 [2024-11-20 01:31:29.434337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.468 qpair failed and we were unable to recover it. 00:30:21.468 [2024-11-20 01:31:29.434509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.468 [2024-11-20 01:31:29.434640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.468 [2024-11-20 01:31:29.434668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.468 qpair failed and we were unable to recover it. 00:30:21.468 [2024-11-20 01:31:29.434791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.468 [2024-11-20 01:31:29.434950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.468 [2024-11-20 01:31:29.434975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.468 qpair failed and we were unable to recover it. 00:30:21.468 [2024-11-20 01:31:29.435075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.468 [2024-11-20 01:31:29.435174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.468 [2024-11-20 01:31:29.435200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.468 qpair failed and we were unable to recover it. 00:30:21.468 [2024-11-20 01:31:29.435312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.468 [2024-11-20 01:31:29.435400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.468 [2024-11-20 01:31:29.435425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.468 qpair failed and we were unable to recover it. 00:30:21.468 [2024-11-20 01:31:29.435516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.468 [2024-11-20 01:31:29.435681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.468 [2024-11-20 01:31:29.435708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.468 qpair failed and we were unable to recover it. 00:30:21.468 [2024-11-20 01:31:29.435851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.468 [2024-11-20 01:31:29.435993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.468 [2024-11-20 01:31:29.436018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.468 qpair failed and we were unable to recover it. 00:30:21.468 [2024-11-20 01:31:29.436130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.468 [2024-11-20 01:31:29.436247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.468 [2024-11-20 01:31:29.436275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.468 qpair failed and we were unable to recover it. 00:30:21.468 [2024-11-20 01:31:29.436420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.468 [2024-11-20 01:31:29.436517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.468 [2024-11-20 01:31:29.436545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.468 qpair failed and we were unable to recover it. 00:30:21.468 [2024-11-20 01:31:29.436683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.468 [2024-11-20 01:31:29.436775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.468 [2024-11-20 01:31:29.436800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.468 qpair failed and we were unable to recover it. 00:30:21.468 [2024-11-20 01:31:29.436912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.468 [2024-11-20 01:31:29.437001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.468 [2024-11-20 01:31:29.437026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.468 qpair failed and we were unable to recover it. 00:30:21.469 [2024-11-20 01:31:29.437140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.469 [2024-11-20 01:31:29.437232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.469 [2024-11-20 01:31:29.437257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.469 qpair failed and we were unable to recover it. 00:30:21.469 [2024-11-20 01:31:29.437351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.469 [2024-11-20 01:31:29.437493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.469 [2024-11-20 01:31:29.437518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.469 qpair failed and we were unable to recover it. 00:30:21.469 [2024-11-20 01:31:29.437644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.469 [2024-11-20 01:31:29.437809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.469 [2024-11-20 01:31:29.437837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.469 qpair failed and we were unable to recover it. 00:30:21.469 [2024-11-20 01:31:29.437959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.469 [2024-11-20 01:31:29.438128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.469 [2024-11-20 01:31:29.438154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.469 qpair failed and we were unable to recover it. 00:30:21.469 [2024-11-20 01:31:29.438272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.469 [2024-11-20 01:31:29.438388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.469 [2024-11-20 01:31:29.438413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.469 qpair failed and we were unable to recover it. 00:30:21.469 [2024-11-20 01:31:29.438520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.469 [2024-11-20 01:31:29.438631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.469 [2024-11-20 01:31:29.438657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.469 qpair failed and we were unable to recover it. 00:30:21.469 [2024-11-20 01:31:29.438772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.469 [2024-11-20 01:31:29.438885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.469 [2024-11-20 01:31:29.438910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.469 qpair failed and we were unable to recover it. 00:30:21.469 [2024-11-20 01:31:29.439034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.469 [2024-11-20 01:31:29.439128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.469 [2024-11-20 01:31:29.439153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.469 qpair failed and we were unable to recover it. 00:30:21.469 [2024-11-20 01:31:29.439262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.469 [2024-11-20 01:31:29.439366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.469 [2024-11-20 01:31:29.439391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.469 qpair failed and we were unable to recover it. 00:30:21.469 [2024-11-20 01:31:29.439502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.469 [2024-11-20 01:31:29.439637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.469 [2024-11-20 01:31:29.439665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.469 qpair failed and we were unable to recover it. 00:30:21.469 [2024-11-20 01:31:29.439772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.469 [2024-11-20 01:31:29.439890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.469 [2024-11-20 01:31:29.439915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.469 qpair failed and we were unable to recover it. 00:30:21.469 [2024-11-20 01:31:29.440053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.469 [2024-11-20 01:31:29.440213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.469 [2024-11-20 01:31:29.440241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.469 qpair failed and we were unable to recover it. 00:30:21.469 [2024-11-20 01:31:29.440336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.469 [2024-11-20 01:31:29.440440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.469 [2024-11-20 01:31:29.440468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.469 qpair failed and we were unable to recover it. 00:30:21.469 [2024-11-20 01:31:29.440615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.469 [2024-11-20 01:31:29.440708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.469 [2024-11-20 01:31:29.440733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.469 qpair failed and we were unable to recover it. 00:30:21.469 [2024-11-20 01:31:29.440852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.469 [2024-11-20 01:31:29.440963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.469 [2024-11-20 01:31:29.441005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.469 qpair failed and we were unable to recover it. 00:30:21.469 [2024-11-20 01:31:29.441142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.469 [2024-11-20 01:31:29.441271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.469 [2024-11-20 01:31:29.441299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.469 qpair failed and we were unable to recover it. 00:30:21.469 [2024-11-20 01:31:29.441452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.469 [2024-11-20 01:31:29.441564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.469 [2024-11-20 01:31:29.441590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.469 qpair failed and we were unable to recover it. 00:30:21.469 [2024-11-20 01:31:29.441681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.469 [2024-11-20 01:31:29.441793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.469 [2024-11-20 01:31:29.441821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.469 qpair failed and we were unable to recover it. 00:30:21.469 [2024-11-20 01:31:29.441966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.469 [2024-11-20 01:31:29.442061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.469 [2024-11-20 01:31:29.442104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.469 qpair failed and we were unable to recover it. 00:30:21.469 [2024-11-20 01:31:29.442195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.469 [2024-11-20 01:31:29.442300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.469 [2024-11-20 01:31:29.442325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.469 qpair failed and we were unable to recover it. 00:30:21.469 [2024-11-20 01:31:29.442426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.469 [2024-11-20 01:31:29.442586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.469 [2024-11-20 01:31:29.442613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.469 qpair failed and we were unable to recover it. 00:30:21.469 [2024-11-20 01:31:29.442752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.469 [2024-11-20 01:31:29.442914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.469 [2024-11-20 01:31:29.442957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.469 qpair failed and we were unable to recover it. 00:30:21.469 [2024-11-20 01:31:29.443081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.469 [2024-11-20 01:31:29.443212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.469 [2024-11-20 01:31:29.443237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.469 qpair failed and we were unable to recover it. 00:30:21.469 [2024-11-20 01:31:29.443373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.469 [2024-11-20 01:31:29.443500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.469 [2024-11-20 01:31:29.443529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.469 qpair failed and we were unable to recover it. 00:30:21.469 [2024-11-20 01:31:29.443686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.469 [2024-11-20 01:31:29.443786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.469 [2024-11-20 01:31:29.443814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.469 qpair failed and we were unable to recover it. 00:30:21.470 [2024-11-20 01:31:29.443974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.470 [2024-11-20 01:31:29.444114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.470 [2024-11-20 01:31:29.444140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.470 qpair failed and we were unable to recover it. 00:30:21.470 [2024-11-20 01:31:29.444290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.470 [2024-11-20 01:31:29.444456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.470 [2024-11-20 01:31:29.444481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.470 qpair failed and we were unable to recover it. 00:30:21.470 [2024-11-20 01:31:29.444575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.470 [2024-11-20 01:31:29.444708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.470 [2024-11-20 01:31:29.444738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.470 qpair failed and we were unable to recover it. 00:30:21.470 [2024-11-20 01:31:29.444874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.470 [2024-11-20 01:31:29.444953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.470 [2024-11-20 01:31:29.444977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.470 qpair failed and we were unable to recover it. 00:30:21.470 [2024-11-20 01:31:29.445112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.470 [2024-11-20 01:31:29.445201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.470 [2024-11-20 01:31:29.445228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.470 qpair failed and we were unable to recover it. 00:30:21.470 [2024-11-20 01:31:29.445310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.470 [2024-11-20 01:31:29.445464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.470 [2024-11-20 01:31:29.445491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.470 qpair failed and we were unable to recover it. 00:30:21.470 [2024-11-20 01:31:29.445631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.470 [2024-11-20 01:31:29.445773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.470 [2024-11-20 01:31:29.445798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.470 qpair failed and we were unable to recover it. 00:30:21.470 [2024-11-20 01:31:29.445898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.470 [2024-11-20 01:31:29.445987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.470 [2024-11-20 01:31:29.446015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.470 qpair failed and we were unable to recover it. 00:30:21.470 [2024-11-20 01:31:29.446164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.470 [2024-11-20 01:31:29.446305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.470 [2024-11-20 01:31:29.446329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.470 qpair failed and we were unable to recover it. 00:30:21.470 [2024-11-20 01:31:29.446432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.470 [2024-11-20 01:31:29.446545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.470 [2024-11-20 01:31:29.446568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.470 qpair failed and we were unable to recover it. 00:30:21.470 [2024-11-20 01:31:29.446677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.470 [2024-11-20 01:31:29.446801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.470 [2024-11-20 01:31:29.446828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.470 qpair failed and we were unable to recover it. 00:30:21.470 [2024-11-20 01:31:29.446915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.470 [2024-11-20 01:31:29.447060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.470 [2024-11-20 01:31:29.447109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.470 qpair failed and we were unable to recover it. 00:30:21.470 [2024-11-20 01:31:29.447260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.470 [2024-11-20 01:31:29.447382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.470 [2024-11-20 01:31:29.447407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.470 qpair failed and we were unable to recover it. 00:30:21.470 [2024-11-20 01:31:29.447525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.470 [2024-11-20 01:31:29.447644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.470 [2024-11-20 01:31:29.447671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.470 qpair failed and we were unable to recover it. 00:30:21.470 [2024-11-20 01:31:29.447786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.470 [2024-11-20 01:31:29.447929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.470 [2024-11-20 01:31:29.447952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.470 qpair failed and we were unable to recover it. 00:30:21.470 [2024-11-20 01:31:29.448078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.470 [2024-11-20 01:31:29.448171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.470 [2024-11-20 01:31:29.448196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.470 qpair failed and we were unable to recover it. 00:30:21.470 [2024-11-20 01:31:29.448291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.470 [2024-11-20 01:31:29.448378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.470 [2024-11-20 01:31:29.448403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.470 qpair failed and we were unable to recover it. 00:30:21.470 [2024-11-20 01:31:29.448591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.470 [2024-11-20 01:31:29.448707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.470 [2024-11-20 01:31:29.448732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.470 qpair failed and we were unable to recover it. 00:30:21.470 [2024-11-20 01:31:29.448817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.470 [2024-11-20 01:31:29.448933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.470 [2024-11-20 01:31:29.448958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.470 qpair failed and we were unable to recover it. 00:30:21.470 [2024-11-20 01:31:29.449082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.470 [2024-11-20 01:31:29.449206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.470 [2024-11-20 01:31:29.449231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.470 qpair failed and we were unable to recover it. 00:30:21.470 [2024-11-20 01:31:29.449337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.470 [2024-11-20 01:31:29.449478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.470 [2024-11-20 01:31:29.449502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.470 qpair failed and we were unable to recover it. 00:30:21.470 [2024-11-20 01:31:29.449621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.470 [2024-11-20 01:31:29.449743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.470 [2024-11-20 01:31:29.449779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.470 qpair failed and we were unable to recover it. 00:30:21.470 [2024-11-20 01:31:29.449946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.470 [2024-11-20 01:31:29.450034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.470 [2024-11-20 01:31:29.450062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.470 qpair failed and we were unable to recover it. 00:30:21.470 [2024-11-20 01:31:29.450168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.470 [2024-11-20 01:31:29.450270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.470 [2024-11-20 01:31:29.450298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.470 qpair failed and we were unable to recover it. 00:30:21.470 [2024-11-20 01:31:29.450407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.470 [2024-11-20 01:31:29.450527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.470 [2024-11-20 01:31:29.450552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.470 qpair failed and we were unable to recover it. 00:30:21.470 [2024-11-20 01:31:29.450648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.470 [2024-11-20 01:31:29.450740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.470 [2024-11-20 01:31:29.450767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.470 qpair failed and we were unable to recover it. 00:30:21.470 [2024-11-20 01:31:29.450860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.470 [2024-11-20 01:31:29.450949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.470 [2024-11-20 01:31:29.450974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.470 qpair failed and we were unable to recover it. 00:30:21.470 [2024-11-20 01:31:29.451094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.470 [2024-11-20 01:31:29.451186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.470 [2024-11-20 01:31:29.451210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.470 qpair failed and we were unable to recover it. 00:30:21.470 [2024-11-20 01:31:29.451357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.471 [2024-11-20 01:31:29.451452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.471 [2024-11-20 01:31:29.451477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.471 qpair failed and we were unable to recover it. 00:30:21.471 [2024-11-20 01:31:29.451610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.471 [2024-11-20 01:31:29.451747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.471 [2024-11-20 01:31:29.451770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.471 qpair failed and we were unable to recover it. 00:30:21.471 [2024-11-20 01:31:29.451885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.471 [2024-11-20 01:31:29.452002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.471 [2024-11-20 01:31:29.452026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.471 qpair failed and we were unable to recover it. 00:30:21.471 [2024-11-20 01:31:29.452180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.471 [2024-11-20 01:31:29.452297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.471 [2024-11-20 01:31:29.452322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.471 qpair failed and we were unable to recover it. 00:30:21.471 [2024-11-20 01:31:29.452439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.471 [2024-11-20 01:31:29.452550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.471 [2024-11-20 01:31:29.452578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.471 qpair failed and we were unable to recover it. 00:30:21.471 [2024-11-20 01:31:29.452712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.471 [2024-11-20 01:31:29.452832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.471 [2024-11-20 01:31:29.452857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.471 qpair failed and we were unable to recover it. 00:30:21.471 [2024-11-20 01:31:29.453024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.471 [2024-11-20 01:31:29.453126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.471 [2024-11-20 01:31:29.453153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.471 qpair failed and we were unable to recover it. 00:30:21.471 [2024-11-20 01:31:29.453305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.471 [2024-11-20 01:31:29.453402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.471 [2024-11-20 01:31:29.453446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.471 qpair failed and we were unable to recover it. 00:30:21.471 [2024-11-20 01:31:29.453562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.471 [2024-11-20 01:31:29.453650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.471 [2024-11-20 01:31:29.453674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.471 qpair failed and we were unable to recover it. 00:30:21.471 [2024-11-20 01:31:29.453793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.471 [2024-11-20 01:31:29.453925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.471 [2024-11-20 01:31:29.453953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.471 qpair failed and we were unable to recover it. 00:30:21.471 [2024-11-20 01:31:29.454040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.471 [2024-11-20 01:31:29.454164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.471 [2024-11-20 01:31:29.454192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.471 qpair failed and we were unable to recover it. 00:30:21.471 [2024-11-20 01:31:29.454326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.471 [2024-11-20 01:31:29.454450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.471 [2024-11-20 01:31:29.454475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.471 qpair failed and we were unable to recover it. 00:30:21.471 [2024-11-20 01:31:29.454581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.471 [2024-11-20 01:31:29.454734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.471 [2024-11-20 01:31:29.454758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.471 qpair failed and we were unable to recover it. 00:30:21.471 [2024-11-20 01:31:29.454848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.471 [2024-11-20 01:31:29.454939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.471 [2024-11-20 01:31:29.454963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.471 qpair failed and we were unable to recover it. 00:30:21.471 [2024-11-20 01:31:29.455051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.471 [2024-11-20 01:31:29.455180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.471 [2024-11-20 01:31:29.455205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.471 qpair failed and we were unable to recover it. 00:30:21.471 [2024-11-20 01:31:29.455347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.471 [2024-11-20 01:31:29.455484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.471 [2024-11-20 01:31:29.455512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.471 qpair failed and we were unable to recover it. 00:30:21.471 [2024-11-20 01:31:29.455642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.471 [2024-11-20 01:31:29.455780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.471 [2024-11-20 01:31:29.455804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.471 qpair failed and we were unable to recover it. 00:30:21.471 [2024-11-20 01:31:29.455889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.471 [2024-11-20 01:31:29.456031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.471 [2024-11-20 01:31:29.456056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.471 qpair failed and we were unable to recover it. 00:30:21.471 [2024-11-20 01:31:29.456208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.471 [2024-11-20 01:31:29.456339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.471 [2024-11-20 01:31:29.456366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.471 qpair failed and we were unable to recover it. 00:30:21.471 [2024-11-20 01:31:29.456470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.471 [2024-11-20 01:31:29.456562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.471 [2024-11-20 01:31:29.456589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.471 qpair failed and we were unable to recover it. 00:30:21.471 [2024-11-20 01:31:29.456694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.471 [2024-11-20 01:31:29.456815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.471 [2024-11-20 01:31:29.456840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.471 qpair failed and we were unable to recover it. 00:30:21.471 [2024-11-20 01:31:29.456954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.471 [2024-11-20 01:31:29.457086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.471 [2024-11-20 01:31:29.457113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.471 qpair failed and we were unable to recover it. 00:30:21.471 [2024-11-20 01:31:29.457209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.471 [2024-11-20 01:31:29.457333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.471 [2024-11-20 01:31:29.457361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.471 qpair failed and we were unable to recover it. 00:30:21.471 [2024-11-20 01:31:29.457501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.471 [2024-11-20 01:31:29.457592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.471 [2024-11-20 01:31:29.457621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.471 qpair failed and we were unable to recover it. 00:30:21.471 [2024-11-20 01:31:29.457724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.471 [2024-11-20 01:31:29.457852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.471 [2024-11-20 01:31:29.457876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.471 qpair failed and we were unable to recover it. 00:30:21.471 [2024-11-20 01:31:29.458039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.471 [2024-11-20 01:31:29.458209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.471 [2024-11-20 01:31:29.458237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.471 qpair failed and we were unable to recover it. 00:30:21.471 [2024-11-20 01:31:29.458342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.471 [2024-11-20 01:31:29.458435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.471 [2024-11-20 01:31:29.458463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.471 qpair failed and we were unable to recover it. 00:30:21.471 [2024-11-20 01:31:29.458611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.471 [2024-11-20 01:31:29.458739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.471 [2024-11-20 01:31:29.458763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.471 qpair failed and we were unable to recover it. 00:30:21.471 [2024-11-20 01:31:29.458881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.471 [2024-11-20 01:31:29.458996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.471 [2024-11-20 01:31:29.459020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.472 qpair failed and we were unable to recover it. 00:30:21.472 [2024-11-20 01:31:29.459140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.472 [2024-11-20 01:31:29.459225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.472 [2024-11-20 01:31:29.459250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.472 qpair failed and we were unable to recover it. 00:30:21.472 [2024-11-20 01:31:29.459360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.472 [2024-11-20 01:31:29.459491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.472 [2024-11-20 01:31:29.459515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.472 qpair failed and we were unable to recover it. 00:30:21.472 [2024-11-20 01:31:29.459601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.472 [2024-11-20 01:31:29.459711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.472 [2024-11-20 01:31:29.459736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.472 qpair failed and we were unable to recover it. 00:30:21.472 [2024-11-20 01:31:29.459848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.472 [2024-11-20 01:31:29.459936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.472 [2024-11-20 01:31:29.459962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.472 qpair failed and we were unable to recover it. 00:30:21.472 [2024-11-20 01:31:29.460081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.472 [2024-11-20 01:31:29.460170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.472 [2024-11-20 01:31:29.460204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.472 qpair failed and we were unable to recover it. 00:30:21.472 [2024-11-20 01:31:29.460300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.472 [2024-11-20 01:31:29.460438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.472 [2024-11-20 01:31:29.460463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.472 qpair failed and we were unable to recover it. 00:30:21.472 [2024-11-20 01:31:29.460579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.472 [2024-11-20 01:31:29.460669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.472 [2024-11-20 01:31:29.460693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.472 qpair failed and we were unable to recover it. 00:30:21.472 [2024-11-20 01:31:29.460810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.472 [2024-11-20 01:31:29.460919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.472 [2024-11-20 01:31:29.460943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.472 qpair failed and we were unable to recover it. 00:30:21.472 [2024-11-20 01:31:29.461080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.472 [2024-11-20 01:31:29.461212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.472 [2024-11-20 01:31:29.461239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.472 qpair failed and we were unable to recover it. 00:30:21.472 [2024-11-20 01:31:29.461381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.472 [2024-11-20 01:31:29.461502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.472 [2024-11-20 01:31:29.461526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.472 qpair failed and we were unable to recover it. 00:30:21.472 [2024-11-20 01:31:29.461660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.472 [2024-11-20 01:31:29.461799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.472 [2024-11-20 01:31:29.461826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.472 qpair failed and we were unable to recover it. 00:30:21.472 [2024-11-20 01:31:29.461966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.472 [2024-11-20 01:31:29.462078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.472 [2024-11-20 01:31:29.462107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.472 qpair failed and we were unable to recover it. 00:30:21.472 [2024-11-20 01:31:29.462272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.472 [2024-11-20 01:31:29.462367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.472 [2024-11-20 01:31:29.462401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.472 qpair failed and we were unable to recover it. 00:30:21.472 [2024-11-20 01:31:29.462505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.472 [2024-11-20 01:31:29.462606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.472 [2024-11-20 01:31:29.462645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.472 qpair failed and we were unable to recover it. 00:30:21.472 [2024-11-20 01:31:29.462773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.472 [2024-11-20 01:31:29.462906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.472 [2024-11-20 01:31:29.462935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.472 qpair failed and we were unable to recover it. 00:30:21.472 [2024-11-20 01:31:29.463019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.472 [2024-11-20 01:31:29.463144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.472 [2024-11-20 01:31:29.463170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.472 qpair failed and we were unable to recover it. 00:30:21.472 [2024-11-20 01:31:29.463276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.472 [2024-11-20 01:31:29.463397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.472 [2024-11-20 01:31:29.463425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.472 qpair failed and we were unable to recover it. 00:30:21.472 [2024-11-20 01:31:29.463554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.472 [2024-11-20 01:31:29.463638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.472 [2024-11-20 01:31:29.463666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.472 qpair failed and we were unable to recover it. 00:30:21.472 [2024-11-20 01:31:29.463822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.472 [2024-11-20 01:31:29.463913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.472 [2024-11-20 01:31:29.463938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.472 qpair failed and we were unable to recover it. 00:30:21.472 [2024-11-20 01:31:29.464033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.472 [2024-11-20 01:31:29.464158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.472 [2024-11-20 01:31:29.464186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.472 qpair failed and we were unable to recover it. 00:30:21.472 [2024-11-20 01:31:29.464348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.472 [2024-11-20 01:31:29.464444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.472 [2024-11-20 01:31:29.464470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.472 qpair failed and we were unable to recover it. 00:30:21.472 [2024-11-20 01:31:29.464582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.472 [2024-11-20 01:31:29.464694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.472 [2024-11-20 01:31:29.464718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.472 qpair failed and we were unable to recover it. 00:30:21.472 [2024-11-20 01:31:29.464795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.472 [2024-11-20 01:31:29.464947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.472 [2024-11-20 01:31:29.464971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.472 qpair failed and we were unable to recover it. 00:30:21.472 [2024-11-20 01:31:29.465072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.472 [2024-11-20 01:31:29.465191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.472 [2024-11-20 01:31:29.465216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.472 qpair failed and we were unable to recover it. 00:30:21.472 [2024-11-20 01:31:29.465356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.472 [2024-11-20 01:31:29.465447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.472 [2024-11-20 01:31:29.465476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.472 qpair failed and we were unable to recover it. 00:30:21.472 [2024-11-20 01:31:29.465605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.472 [2024-11-20 01:31:29.465735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.472 [2024-11-20 01:31:29.465761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.472 qpair failed and we were unable to recover it. 00:30:21.472 [2024-11-20 01:31:29.465863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.472 [2024-11-20 01:31:29.465960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.472 [2024-11-20 01:31:29.465989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.472 qpair failed and we were unable to recover it. 00:30:21.472 [2024-11-20 01:31:29.466127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.472 [2024-11-20 01:31:29.466242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.472 [2024-11-20 01:31:29.466266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.472 qpair failed and we were unable to recover it. 00:30:21.472 [2024-11-20 01:31:29.466399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.473 [2024-11-20 01:31:29.466529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.473 [2024-11-20 01:31:29.466556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.473 qpair failed and we were unable to recover it. 00:30:21.473 [2024-11-20 01:31:29.466714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.473 [2024-11-20 01:31:29.466814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.473 [2024-11-20 01:31:29.466841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.473 qpair failed and we were unable to recover it. 00:30:21.473 [2024-11-20 01:31:29.466979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.473 [2024-11-20 01:31:29.467052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.473 [2024-11-20 01:31:29.467083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.473 qpair failed and we were unable to recover it. 00:30:21.473 [2024-11-20 01:31:29.467194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.473 [2024-11-20 01:31:29.467294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.473 [2024-11-20 01:31:29.467337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.473 qpair failed and we were unable to recover it. 00:30:21.473 [2024-11-20 01:31:29.467428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.473 [2024-11-20 01:31:29.467517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.473 [2024-11-20 01:31:29.467541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.473 qpair failed and we were unable to recover it. 00:30:21.473 [2024-11-20 01:31:29.467624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.473 [2024-11-20 01:31:29.467725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.473 [2024-11-20 01:31:29.467749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.473 qpair failed and we were unable to recover it. 00:30:21.473 [2024-11-20 01:31:29.467847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.473 [2024-11-20 01:31:29.467988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.473 [2024-11-20 01:31:29.468012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.473 qpair failed and we were unable to recover it. 00:30:21.473 [2024-11-20 01:31:29.468105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.473 [2024-11-20 01:31:29.468246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.473 [2024-11-20 01:31:29.468274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.473 qpair failed and we were unable to recover it. 00:30:21.473 [2024-11-20 01:31:29.468438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.473 [2024-11-20 01:31:29.468522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.473 [2024-11-20 01:31:29.468546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.473 qpair failed and we were unable to recover it. 00:30:21.473 [2024-11-20 01:31:29.468667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.473 [2024-11-20 01:31:29.468787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.473 [2024-11-20 01:31:29.468815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.473 qpair failed and we were unable to recover it. 00:30:21.473 [2024-11-20 01:31:29.468915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.473 [2024-11-20 01:31:29.469082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.473 [2024-11-20 01:31:29.469109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.473 qpair failed and we were unable to recover it. 00:30:21.473 [2024-11-20 01:31:29.469233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.473 [2024-11-20 01:31:29.469351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.473 [2024-11-20 01:31:29.469376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.473 qpair failed and we were unable to recover it. 00:30:21.473 [2024-11-20 01:31:29.469488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.473 [2024-11-20 01:31:29.469583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.473 [2024-11-20 01:31:29.469610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.473 qpair failed and we were unable to recover it. 00:30:21.473 [2024-11-20 01:31:29.469740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.473 [2024-11-20 01:31:29.469840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.473 [2024-11-20 01:31:29.469884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.473 qpair failed and we were unable to recover it. 00:30:21.473 [2024-11-20 01:31:29.470002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.473 [2024-11-20 01:31:29.470106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.473 [2024-11-20 01:31:29.470133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.473 qpair failed and we were unable to recover it. 00:30:21.473 [2024-11-20 01:31:29.470216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.473 [2024-11-20 01:31:29.470350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.473 [2024-11-20 01:31:29.470378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.473 qpair failed and we were unable to recover it. 00:30:21.473 [2024-11-20 01:31:29.470511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.473 [2024-11-20 01:31:29.470634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.473 [2024-11-20 01:31:29.470662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.473 qpair failed and we were unable to recover it. 00:30:21.473 [2024-11-20 01:31:29.470811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.473 [2024-11-20 01:31:29.470925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.473 [2024-11-20 01:31:29.470961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.473 qpair failed and we were unable to recover it. 00:30:21.473 [2024-11-20 01:31:29.471093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.473 [2024-11-20 01:31:29.471225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.473 [2024-11-20 01:31:29.471253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.473 qpair failed and we were unable to recover it. 00:30:21.473 [2024-11-20 01:31:29.471356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.473 [2024-11-20 01:31:29.471446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.473 [2024-11-20 01:31:29.471473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.473 qpair failed and we were unable to recover it. 00:30:21.473 [2024-11-20 01:31:29.471616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.473 [2024-11-20 01:31:29.471719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.473 [2024-11-20 01:31:29.471743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.473 qpair failed and we were unable to recover it. 00:30:21.473 [2024-11-20 01:31:29.471866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.473 [2024-11-20 01:31:29.472010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.473 [2024-11-20 01:31:29.472035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.473 qpair failed and we were unable to recover it. 00:30:21.473 [2024-11-20 01:31:29.472134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.473 [2024-11-20 01:31:29.472248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.473 [2024-11-20 01:31:29.472274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.473 qpair failed and we were unable to recover it. 00:30:21.473 [2024-11-20 01:31:29.472390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.473 [2024-11-20 01:31:29.472501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.473 [2024-11-20 01:31:29.472525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.473 qpair failed and we were unable to recover it. 00:30:21.473 [2024-11-20 01:31:29.472618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.473 [2024-11-20 01:31:29.472772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.473 [2024-11-20 01:31:29.472797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.473 qpair failed and we were unable to recover it. 00:30:21.473 [2024-11-20 01:31:29.472942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.473 [2024-11-20 01:31:29.473049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.473 [2024-11-20 01:31:29.473083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.473 qpair failed and we were unable to recover it. 00:30:21.473 [2024-11-20 01:31:29.473229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.473 [2024-11-20 01:31:29.473311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.473 [2024-11-20 01:31:29.473337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.473 qpair failed and we were unable to recover it. 00:30:21.473 [2024-11-20 01:31:29.473464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.473 [2024-11-20 01:31:29.473556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.473 [2024-11-20 01:31:29.473600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.473 qpair failed and we were unable to recover it. 00:30:21.473 [2024-11-20 01:31:29.473732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.473 [2024-11-20 01:31:29.473854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.474 [2024-11-20 01:31:29.473881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.474 qpair failed and we were unable to recover it. 00:30:21.474 [2024-11-20 01:31:29.474024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.474 [2024-11-20 01:31:29.474144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.474 [2024-11-20 01:31:29.474169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.474 qpair failed and we were unable to recover it. 00:30:21.474 [2024-11-20 01:31:29.474263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.474 [2024-11-20 01:31:29.474417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.474 [2024-11-20 01:31:29.474444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.474 qpair failed and we were unable to recover it. 00:30:21.474 [2024-11-20 01:31:29.474615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.474 [2024-11-20 01:31:29.474740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.474 [2024-11-20 01:31:29.474765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.474 qpair failed and we were unable to recover it. 00:30:21.474 [2024-11-20 01:31:29.474852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.474 [2024-11-20 01:31:29.474949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.474 [2024-11-20 01:31:29.474976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.474 qpair failed and we were unable to recover it. 00:30:21.474 [2024-11-20 01:31:29.475080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.474 [2024-11-20 01:31:29.475242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.474 [2024-11-20 01:31:29.475270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.474 qpair failed and we were unable to recover it. 00:30:21.474 [2024-11-20 01:31:29.475393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.474 [2024-11-20 01:31:29.475525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.474 [2024-11-20 01:31:29.475554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.474 qpair failed and we were unable to recover it. 00:30:21.474 [2024-11-20 01:31:29.475692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.474 [2024-11-20 01:31:29.475813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.474 [2024-11-20 01:31:29.475837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.474 qpair failed and we were unable to recover it. 00:30:21.474 [2024-11-20 01:31:29.475966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.474 [2024-11-20 01:31:29.476061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.474 [2024-11-20 01:31:29.476106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.474 qpair failed and we were unable to recover it. 00:30:21.474 [2024-11-20 01:31:29.476212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.474 [2024-11-20 01:31:29.476363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.474 [2024-11-20 01:31:29.476390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.474 qpair failed and we were unable to recover it. 00:30:21.474 [2024-11-20 01:31:29.476505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.474 [2024-11-20 01:31:29.476620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.474 [2024-11-20 01:31:29.476645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.474 qpair failed and we were unable to recover it. 00:30:21.474 [2024-11-20 01:31:29.476757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.474 [2024-11-20 01:31:29.476839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.474 [2024-11-20 01:31:29.476865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.474 qpair failed and we were unable to recover it. 00:30:21.474 [2024-11-20 01:31:29.476985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.474 [2024-11-20 01:31:29.477121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.474 [2024-11-20 01:31:29.477151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.474 qpair failed and we were unable to recover it. 00:30:21.474 [2024-11-20 01:31:29.477260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.474 [2024-11-20 01:31:29.477382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.474 [2024-11-20 01:31:29.477407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.474 qpair failed and we were unable to recover it. 00:30:21.474 [2024-11-20 01:31:29.477487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.474 [2024-11-20 01:31:29.477598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.474 [2024-11-20 01:31:29.477627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.474 qpair failed and we were unable to recover it. 00:30:21.474 [2024-11-20 01:31:29.477715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.474 [2024-11-20 01:31:29.477841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.474 [2024-11-20 01:31:29.477870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.474 qpair failed and we were unable to recover it. 00:30:21.474 [2024-11-20 01:31:29.478001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.474 [2024-11-20 01:31:29.478125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.474 [2024-11-20 01:31:29.478151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.474 qpair failed and we were unable to recover it. 00:30:21.474 [2024-11-20 01:31:29.478285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.474 [2024-11-20 01:31:29.478406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.474 [2024-11-20 01:31:29.478434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.474 qpair failed and we were unable to recover it. 00:30:21.474 [2024-11-20 01:31:29.478586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.474 [2024-11-20 01:31:29.478716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.474 [2024-11-20 01:31:29.478743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.474 qpair failed and we were unable to recover it. 00:30:21.474 [2024-11-20 01:31:29.478855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.474 [2024-11-20 01:31:29.478934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.474 [2024-11-20 01:31:29.478958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.474 qpair failed and we were unable to recover it. 00:30:21.474 [2024-11-20 01:31:29.479044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.474 [2024-11-20 01:31:29.479164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.474 [2024-11-20 01:31:29.479192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.474 qpair failed and we were unable to recover it. 00:30:21.474 [2024-11-20 01:31:29.479295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.474 [2024-11-20 01:31:29.479388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.474 [2024-11-20 01:31:29.479431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.474 qpair failed and we were unable to recover it. 00:30:21.474 [2024-11-20 01:31:29.479553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.474 [2024-11-20 01:31:29.479701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.474 [2024-11-20 01:31:29.479726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.474 qpair failed and we were unable to recover it. 00:30:21.474 [2024-11-20 01:31:29.479862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.474 [2024-11-20 01:31:29.479950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.474 [2024-11-20 01:31:29.479978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.474 qpair failed and we were unable to recover it. 00:30:21.474 [2024-11-20 01:31:29.480131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.474 [2024-11-20 01:31:29.480255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.474 [2024-11-20 01:31:29.480283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.474 qpair failed and we were unable to recover it. 00:30:21.474 [2024-11-20 01:31:29.480396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.474 [2024-11-20 01:31:29.480489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.474 [2024-11-20 01:31:29.480515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.474 qpair failed and we were unable to recover it. 00:30:21.475 [2024-11-20 01:31:29.480626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.475 [2024-11-20 01:31:29.480722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.475 [2024-11-20 01:31:29.480747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.475 qpair failed and we were unable to recover it. 00:30:21.475 [2024-11-20 01:31:29.480885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.475 [2024-11-20 01:31:29.481010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.475 [2024-11-20 01:31:29.481051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.475 qpair failed and we were unable to recover it. 00:30:21.475 [2024-11-20 01:31:29.481142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.475 [2024-11-20 01:31:29.481262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.475 [2024-11-20 01:31:29.481287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.475 qpair failed and we were unable to recover it. 00:30:21.475 [2024-11-20 01:31:29.481377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.475 [2024-11-20 01:31:29.481548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.475 [2024-11-20 01:31:29.481576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.475 qpair failed and we were unable to recover it. 00:30:21.475 [2024-11-20 01:31:29.481668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.475 [2024-11-20 01:31:29.481817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.475 [2024-11-20 01:31:29.481845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.475 qpair failed and we were unable to recover it. 00:30:21.475 [2024-11-20 01:31:29.481959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.475 [2024-11-20 01:31:29.482085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.475 [2024-11-20 01:31:29.482111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.475 qpair failed and we were unable to recover it. 00:30:21.475 [2024-11-20 01:31:29.482208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.475 [2024-11-20 01:31:29.482296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.475 [2024-11-20 01:31:29.482321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.475 qpair failed and we were unable to recover it. 00:30:21.475 [2024-11-20 01:31:29.482481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.475 [2024-11-20 01:31:29.482637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.475 [2024-11-20 01:31:29.482664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.475 qpair failed and we were unable to recover it. 00:30:21.475 [2024-11-20 01:31:29.482794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.475 [2024-11-20 01:31:29.482880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.475 [2024-11-20 01:31:29.482905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.475 qpair failed and we were unable to recover it. 00:30:21.475 [2024-11-20 01:31:29.483023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.475 [2024-11-20 01:31:29.483117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.475 [2024-11-20 01:31:29.483143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.475 qpair failed and we were unable to recover it. 00:30:21.475 [2024-11-20 01:31:29.483239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.475 [2024-11-20 01:31:29.483401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.475 [2024-11-20 01:31:29.483427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.475 qpair failed and we were unable to recover it. 00:30:21.475 [2024-11-20 01:31:29.483514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.475 [2024-11-20 01:31:29.483630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.475 [2024-11-20 01:31:29.483656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.475 qpair failed and we were unable to recover it. 00:30:21.475 [2024-11-20 01:31:29.483764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.475 [2024-11-20 01:31:29.483929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.475 [2024-11-20 01:31:29.483954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.475 qpair failed and we were unable to recover it. 00:30:21.475 [2024-11-20 01:31:29.484105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.475 [2024-11-20 01:31:29.484242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.475 [2024-11-20 01:31:29.484267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.475 qpair failed and we were unable to recover it. 00:30:21.475 [2024-11-20 01:31:29.484381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.475 [2024-11-20 01:31:29.484500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.475 [2024-11-20 01:31:29.484524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.475 qpair failed and we were unable to recover it. 00:30:21.475 [2024-11-20 01:31:29.484612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.475 [2024-11-20 01:31:29.484705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.475 [2024-11-20 01:31:29.484730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.475 qpair failed and we were unable to recover it. 00:30:21.475 [2024-11-20 01:31:29.484822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.475 [2024-11-20 01:31:29.484948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.475 [2024-11-20 01:31:29.484975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.475 qpair failed and we were unable to recover it. 00:30:21.475 [2024-11-20 01:31:29.485085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.475 [2024-11-20 01:31:29.485187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.475 [2024-11-20 01:31:29.485212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.475 qpair failed and we were unable to recover it. 00:30:21.475 [2024-11-20 01:31:29.485310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.475 [2024-11-20 01:31:29.485449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.475 [2024-11-20 01:31:29.485476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.475 qpair failed and we were unable to recover it. 00:30:21.475 [2024-11-20 01:31:29.485609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.475 [2024-11-20 01:31:29.485709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.475 [2024-11-20 01:31:29.485736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.475 qpair failed and we were unable to recover it. 00:30:21.475 [2024-11-20 01:31:29.485854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.475 [2024-11-20 01:31:29.485937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.475 [2024-11-20 01:31:29.485962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.475 qpair failed and we were unable to recover it. 00:30:21.475 [2024-11-20 01:31:29.486059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.475 [2024-11-20 01:31:29.486187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.475 [2024-11-20 01:31:29.486211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.475 qpair failed and we were unable to recover it. 00:30:21.475 [2024-11-20 01:31:29.486307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.475 [2024-11-20 01:31:29.486401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.475 [2024-11-20 01:31:29.486426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.475 qpair failed and we were unable to recover it. 00:30:21.475 [2024-11-20 01:31:29.486618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.475 [2024-11-20 01:31:29.486710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.475 [2024-11-20 01:31:29.486735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.475 qpair failed and we were unable to recover it. 00:30:21.475 [2024-11-20 01:31:29.486834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.475 [2024-11-20 01:31:29.486973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.475 [2024-11-20 01:31:29.486998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.475 qpair failed and we were unable to recover it. 00:30:21.475 [2024-11-20 01:31:29.487143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.475 [2024-11-20 01:31:29.487238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.475 [2024-11-20 01:31:29.487282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.475 qpair failed and we were unable to recover it. 00:30:21.475 [2024-11-20 01:31:29.487398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.475 [2024-11-20 01:31:29.487539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.475 [2024-11-20 01:31:29.487564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.475 qpair failed and we were unable to recover it. 00:30:21.475 [2024-11-20 01:31:29.487665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.475 [2024-11-20 01:31:29.487792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.475 [2024-11-20 01:31:29.487819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.475 qpair failed and we were unable to recover it. 00:30:21.475 [2024-11-20 01:31:29.487942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.475 [2024-11-20 01:31:29.488076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.476 [2024-11-20 01:31:29.488104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.476 qpair failed and we were unable to recover it. 00:30:21.476 [2024-11-20 01:31:29.488216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.476 [2024-11-20 01:31:29.488323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.476 [2024-11-20 01:31:29.488346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.476 qpair failed and we were unable to recover it. 00:30:21.476 [2024-11-20 01:31:29.488445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.476 [2024-11-20 01:31:29.488533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.476 [2024-11-20 01:31:29.488559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.476 qpair failed and we were unable to recover it. 00:30:21.476 [2024-11-20 01:31:29.488722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.476 [2024-11-20 01:31:29.488820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.476 [2024-11-20 01:31:29.488847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.476 qpair failed and we were unable to recover it. 00:30:21.476 [2024-11-20 01:31:29.488950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.476 [2024-11-20 01:31:29.489057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.476 [2024-11-20 01:31:29.489087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.476 qpair failed and we were unable to recover it. 00:30:21.476 [2024-11-20 01:31:29.489184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.476 [2024-11-20 01:31:29.489344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.476 [2024-11-20 01:31:29.489371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.476 qpair failed and we were unable to recover it. 00:30:21.476 [2024-11-20 01:31:29.489512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.476 [2024-11-20 01:31:29.489628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.476 [2024-11-20 01:31:29.489653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.476 qpair failed and we were unable to recover it. 00:30:21.476 [2024-11-20 01:31:29.489734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.476 [2024-11-20 01:31:29.489861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.476 [2024-11-20 01:31:29.489884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.476 qpair failed and we were unable to recover it. 00:30:21.476 [2024-11-20 01:31:29.490044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.476 [2024-11-20 01:31:29.490143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.476 [2024-11-20 01:31:29.490188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.476 qpair failed and we were unable to recover it. 00:30:21.476 [2024-11-20 01:31:29.490314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.476 [2024-11-20 01:31:29.490464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.476 [2024-11-20 01:31:29.490491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.476 qpair failed and we were unable to recover it. 00:30:21.476 [2024-11-20 01:31:29.490622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.476 [2024-11-20 01:31:29.490746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.476 [2024-11-20 01:31:29.490770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.476 qpair failed and we were unable to recover it. 00:30:21.476 [2024-11-20 01:31:29.490864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.476 [2024-11-20 01:31:29.490949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.476 [2024-11-20 01:31:29.490974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.476 qpair failed and we were unable to recover it. 00:30:21.476 [2024-11-20 01:31:29.491095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.476 [2024-11-20 01:31:29.491238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.476 [2024-11-20 01:31:29.491262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.476 qpair failed and we were unable to recover it. 00:30:21.476 [2024-11-20 01:31:29.491339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.476 [2024-11-20 01:31:29.491428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.476 [2024-11-20 01:31:29.491452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.476 qpair failed and we were unable to recover it. 00:30:21.476 [2024-11-20 01:31:29.491572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.476 [2024-11-20 01:31:29.491707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.476 [2024-11-20 01:31:29.491735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.476 qpair failed and we were unable to recover it. 00:30:21.476 [2024-11-20 01:31:29.491875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.476 [2024-11-20 01:31:29.492021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.476 [2024-11-20 01:31:29.492046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.476 qpair failed and we were unable to recover it. 00:30:21.476 [2024-11-20 01:31:29.492149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.476 [2024-11-20 01:31:29.492232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.476 [2024-11-20 01:31:29.492257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.476 qpair failed and we were unable to recover it. 00:30:21.476 [2024-11-20 01:31:29.492373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.476 [2024-11-20 01:31:29.492498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.476 [2024-11-20 01:31:29.492523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.476 qpair failed and we were unable to recover it. 00:30:21.476 [2024-11-20 01:31:29.492617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.476 [2024-11-20 01:31:29.492750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.476 [2024-11-20 01:31:29.492778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.476 qpair failed and we were unable to recover it. 00:30:21.476 [2024-11-20 01:31:29.492907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.476 [2024-11-20 01:31:29.493022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.476 [2024-11-20 01:31:29.493047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.476 qpair failed and we were unable to recover it. 00:30:21.476 [2024-11-20 01:31:29.493188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.476 [2024-11-20 01:31:29.493290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.476 [2024-11-20 01:31:29.493318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.476 qpair failed and we were unable to recover it. 00:30:21.476 [2024-11-20 01:31:29.493424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.476 [2024-11-20 01:31:29.493567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.476 [2024-11-20 01:31:29.493594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.476 qpair failed and we were unable to recover it. 00:30:21.476 [2024-11-20 01:31:29.493716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.476 [2024-11-20 01:31:29.493809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.476 [2024-11-20 01:31:29.493833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.476 qpair failed and we were unable to recover it. 00:30:21.476 [2024-11-20 01:31:29.493946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.476 [2024-11-20 01:31:29.494061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.476 [2024-11-20 01:31:29.494093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.476 qpair failed and we were unable to recover it. 00:30:21.476 [2024-11-20 01:31:29.494210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.476 [2024-11-20 01:31:29.494294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.476 [2024-11-20 01:31:29.494320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.476 qpair failed and we were unable to recover it. 00:30:21.476 [2024-11-20 01:31:29.494417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.476 [2024-11-20 01:31:29.494539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.476 [2024-11-20 01:31:29.494564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.476 qpair failed and we were unable to recover it. 00:30:21.476 [2024-11-20 01:31:29.494669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.476 [2024-11-20 01:31:29.494794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.476 [2024-11-20 01:31:29.494822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.476 qpair failed and we were unable to recover it. 00:30:21.476 [2024-11-20 01:31:29.494927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.476 [2024-11-20 01:31:29.495036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.476 [2024-11-20 01:31:29.495061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.476 qpair failed and we were unable to recover it. 00:30:21.476 [2024-11-20 01:31:29.495165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.476 [2024-11-20 01:31:29.495251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.476 [2024-11-20 01:31:29.495276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.476 qpair failed and we were unable to recover it. 00:30:21.477 [2024-11-20 01:31:29.495395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.477 [2024-11-20 01:31:29.495523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.477 [2024-11-20 01:31:29.495551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.477 qpair failed and we were unable to recover it. 00:30:21.477 [2024-11-20 01:31:29.495680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.477 [2024-11-20 01:31:29.495808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.477 [2024-11-20 01:31:29.495836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.477 qpair failed and we were unable to recover it. 00:30:21.477 [2024-11-20 01:31:29.495966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.477 [2024-11-20 01:31:29.496114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.477 [2024-11-20 01:31:29.496139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.477 qpair failed and we were unable to recover it. 00:30:21.477 [2024-11-20 01:31:29.496231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.477 [2024-11-20 01:31:29.496329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.477 [2024-11-20 01:31:29.496353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.477 qpair failed and we were unable to recover it. 00:30:21.477 [2024-11-20 01:31:29.496463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.477 [2024-11-20 01:31:29.496544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.477 [2024-11-20 01:31:29.496569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.477 qpair failed and we were unable to recover it. 00:30:21.477 [2024-11-20 01:31:29.496650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.477 [2024-11-20 01:31:29.496797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.477 [2024-11-20 01:31:29.496822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.477 qpair failed and we were unable to recover it. 00:30:21.477 [2024-11-20 01:31:29.496933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.477 [2024-11-20 01:31:29.497037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.477 [2024-11-20 01:31:29.497064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.477 qpair failed and we were unable to recover it. 00:30:21.477 [2024-11-20 01:31:29.497163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.477 [2024-11-20 01:31:29.497268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.477 [2024-11-20 01:31:29.497295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.477 qpair failed and we were unable to recover it. 00:30:21.477 [2024-11-20 01:31:29.497427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.477 [2024-11-20 01:31:29.497521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.477 [2024-11-20 01:31:29.497546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.477 qpair failed and we were unable to recover it. 00:30:21.477 [2024-11-20 01:31:29.497638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.477 [2024-11-20 01:31:29.497755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.477 [2024-11-20 01:31:29.497780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.477 qpair failed and we were unable to recover it. 00:30:21.477 [2024-11-20 01:31:29.497867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.477 [2024-11-20 01:31:29.497984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.477 [2024-11-20 01:31:29.498009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.477 qpair failed and we were unable to recover it. 00:30:21.477 [2024-11-20 01:31:29.498172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.477 [2024-11-20 01:31:29.498316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.477 [2024-11-20 01:31:29.498341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.477 qpair failed and we were unable to recover it. 00:30:21.477 [2024-11-20 01:31:29.498478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.477 [2024-11-20 01:31:29.498596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.477 [2024-11-20 01:31:29.498623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.477 qpair failed and we were unable to recover it. 00:30:21.477 [2024-11-20 01:31:29.498777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.477 [2024-11-20 01:31:29.498887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.477 [2024-11-20 01:31:29.498911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.477 qpair failed and we were unable to recover it. 00:30:21.477 [2024-11-20 01:31:29.499003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.477 [2024-11-20 01:31:29.499097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.477 [2024-11-20 01:31:29.499124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.477 qpair failed and we were unable to recover it. 00:30:21.477 [2024-11-20 01:31:29.499266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.477 [2024-11-20 01:31:29.499390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.477 [2024-11-20 01:31:29.499418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.477 qpair failed and we were unable to recover it. 00:30:21.477 [2024-11-20 01:31:29.499512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.477 [2024-11-20 01:31:29.499630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.477 [2024-11-20 01:31:29.499662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.477 qpair failed and we were unable to recover it. 00:30:21.477 [2024-11-20 01:31:29.499813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.477 [2024-11-20 01:31:29.499929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.477 [2024-11-20 01:31:29.499955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.477 qpair failed and we were unable to recover it. 00:30:21.477 [2024-11-20 01:31:29.500060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.477 [2024-11-20 01:31:29.500235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.477 [2024-11-20 01:31:29.500262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.477 qpair failed and we were unable to recover it. 00:30:21.477 [2024-11-20 01:31:29.500437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.477 [2024-11-20 01:31:29.500538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.477 [2024-11-20 01:31:29.500567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.477 qpair failed and we were unable to recover it. 00:30:21.477 [2024-11-20 01:31:29.500707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.477 [2024-11-20 01:31:29.500793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.477 [2024-11-20 01:31:29.500817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.477 qpair failed and we were unable to recover it. 00:30:21.477 [2024-11-20 01:31:29.500922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.477 [2024-11-20 01:31:29.501017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.477 [2024-11-20 01:31:29.501063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.477 qpair failed and we were unable to recover it. 00:30:21.477 [2024-11-20 01:31:29.501193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.477 [2024-11-20 01:31:29.501282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.477 [2024-11-20 01:31:29.501307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.477 qpair failed and we were unable to recover it. 00:30:21.477 [2024-11-20 01:31:29.501402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.477 [2024-11-20 01:31:29.501530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.477 [2024-11-20 01:31:29.501556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.477 qpair failed and we were unable to recover it. 00:30:21.477 [2024-11-20 01:31:29.501667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.477 [2024-11-20 01:31:29.501806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.477 [2024-11-20 01:31:29.501831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.477 qpair failed and we were unable to recover it. 00:30:21.477 [2024-11-20 01:31:29.501937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.477 [2024-11-20 01:31:29.502054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.477 [2024-11-20 01:31:29.502092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.477 qpair failed and we were unable to recover it. 00:30:21.477 [2024-11-20 01:31:29.502190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.477 [2024-11-20 01:31:29.502306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.477 [2024-11-20 01:31:29.502334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.477 qpair failed and we were unable to recover it. 00:30:21.477 [2024-11-20 01:31:29.502446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.477 [2024-11-20 01:31:29.502525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.478 [2024-11-20 01:31:29.502549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.478 qpair failed and we were unable to recover it. 00:30:21.478 [2024-11-20 01:31:29.502671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.478 [2024-11-20 01:31:29.502759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.478 [2024-11-20 01:31:29.502784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.478 qpair failed and we were unable to recover it. 00:30:21.478 [2024-11-20 01:31:29.502889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.478 [2024-11-20 01:31:29.503025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.478 [2024-11-20 01:31:29.503054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:21.478 qpair failed and we were unable to recover it. 00:30:21.478 [2024-11-20 01:31:29.503165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.478 [2024-11-20 01:31:29.503311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.478 [2024-11-20 01:31:29.503339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.478 qpair failed and we were unable to recover it. 00:30:21.478 [2024-11-20 01:31:29.503444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.478 [2024-11-20 01:31:29.503541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.478 [2024-11-20 01:31:29.503571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.478 qpair failed and we were unable to recover it. 00:30:21.478 [2024-11-20 01:31:29.503700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.478 [2024-11-20 01:31:29.503823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.478 [2024-11-20 01:31:29.503852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.478 qpair failed and we were unable to recover it. 00:30:21.478 [2024-11-20 01:31:29.503961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.478 [2024-11-20 01:31:29.504046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.478 [2024-11-20 01:31:29.504081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.478 qpair failed and we were unable to recover it. 00:30:21.478 [2024-11-20 01:31:29.504201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.478 [2024-11-20 01:31:29.504296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.478 [2024-11-20 01:31:29.504322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.478 qpair failed and we were unable to recover it. 00:30:21.478 [2024-11-20 01:31:29.504471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.478 [2024-11-20 01:31:29.504584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.478 [2024-11-20 01:31:29.504610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.478 qpair failed and we were unable to recover it. 00:30:21.478 [2024-11-20 01:31:29.504759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.478 [2024-11-20 01:31:29.504873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.478 [2024-11-20 01:31:29.504907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.478 qpair failed and we were unable to recover it. 00:30:21.478 [2024-11-20 01:31:29.505040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.478 [2024-11-20 01:31:29.505180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.478 [2024-11-20 01:31:29.505206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.478 qpair failed and we were unable to recover it. 00:30:21.478 [2024-11-20 01:31:29.505292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.478 [2024-11-20 01:31:29.505452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.478 [2024-11-20 01:31:29.505480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.478 qpair failed and we were unable to recover it. 00:30:21.478 [2024-11-20 01:31:29.505605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.478 [2024-11-20 01:31:29.505756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.478 [2024-11-20 01:31:29.505784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.478 qpair failed and we were unable to recover it. 00:30:21.478 [2024-11-20 01:31:29.505913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.478 [2024-11-20 01:31:29.506015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.478 [2024-11-20 01:31:29.506043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.478 qpair failed and we were unable to recover it. 00:30:21.478 [2024-11-20 01:31:29.506174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.478 [2024-11-20 01:31:29.506291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.478 [2024-11-20 01:31:29.506316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.478 qpair failed and we were unable to recover it. 00:30:21.478 [2024-11-20 01:31:29.506452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.478 [2024-11-20 01:31:29.506612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.478 [2024-11-20 01:31:29.506660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.478 qpair failed and we were unable to recover it. 00:30:21.478 [2024-11-20 01:31:29.506754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.478 [2024-11-20 01:31:29.506847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.478 [2024-11-20 01:31:29.506876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.478 qpair failed and we were unable to recover it. 00:30:21.478 [2024-11-20 01:31:29.506987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.478 [2024-11-20 01:31:29.507131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.478 [2024-11-20 01:31:29.507156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.478 qpair failed and we were unable to recover it. 00:30:21.478 [2024-11-20 01:31:29.507242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.478 [2024-11-20 01:31:29.507355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.478 [2024-11-20 01:31:29.507388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.478 qpair failed and we were unable to recover it. 00:30:21.478 [2024-11-20 01:31:29.507472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.478 [2024-11-20 01:31:29.507617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.478 [2024-11-20 01:31:29.507649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.478 qpair failed and we were unable to recover it. 00:30:21.478 [2024-11-20 01:31:29.507806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.478 [2024-11-20 01:31:29.507911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.478 [2024-11-20 01:31:29.507937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.478 qpair failed and we were unable to recover it. 00:30:21.478 [2024-11-20 01:31:29.508046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.478 [2024-11-20 01:31:29.508153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.478 [2024-11-20 01:31:29.508177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.478 qpair failed and we were unable to recover it. 00:30:21.478 [2024-11-20 01:31:29.508269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.478 [2024-11-20 01:31:29.508383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.478 [2024-11-20 01:31:29.508409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.478 qpair failed and we were unable to recover it. 00:30:21.478 [2024-11-20 01:31:29.508576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.478 [2024-11-20 01:31:29.508674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.478 [2024-11-20 01:31:29.508701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.478 qpair failed and we were unable to recover it. 00:30:21.478 [2024-11-20 01:31:29.508851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.478 [2024-11-20 01:31:29.508949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.478 [2024-11-20 01:31:29.508977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.478 qpair failed and we were unable to recover it. 00:30:21.478 [2024-11-20 01:31:29.509132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.478 [2024-11-20 01:31:29.509241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.478 [2024-11-20 01:31:29.509266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.478 qpair failed and we were unable to recover it. 00:30:21.478 [2024-11-20 01:31:29.509408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.478 [2024-11-20 01:31:29.509562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.478 [2024-11-20 01:31:29.509589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.478 qpair failed and we were unable to recover it. 00:30:21.478 [2024-11-20 01:31:29.509785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.478 [2024-11-20 01:31:29.509906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.478 [2024-11-20 01:31:29.509933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.478 qpair failed and we were unable to recover it. 00:30:21.478 [2024-11-20 01:31:29.510029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.478 [2024-11-20 01:31:29.510154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.478 [2024-11-20 01:31:29.510179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.479 qpair failed and we were unable to recover it. 00:30:21.479 [2024-11-20 01:31:29.510270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.479 [2024-11-20 01:31:29.510412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.479 [2024-11-20 01:31:29.510446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.479 qpair failed and we were unable to recover it. 00:30:21.479 [2024-11-20 01:31:29.510583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.479 [2024-11-20 01:31:29.510708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.479 [2024-11-20 01:31:29.510732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.479 qpair failed and we were unable to recover it. 00:30:21.479 [2024-11-20 01:31:29.510850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.479 [2024-11-20 01:31:29.510954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.479 [2024-11-20 01:31:29.510982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.479 qpair failed and we were unable to recover it. 00:30:21.479 [2024-11-20 01:31:29.511088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.479 [2024-11-20 01:31:29.511194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.479 [2024-11-20 01:31:29.511219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.479 qpair failed and we were unable to recover it. 00:30:21.479 [2024-11-20 01:31:29.511311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.479 [2024-11-20 01:31:29.511417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.479 [2024-11-20 01:31:29.511443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.479 qpair failed and we were unable to recover it. 00:30:21.479 [2024-11-20 01:31:29.511531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.479 [2024-11-20 01:31:29.511638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.479 [2024-11-20 01:31:29.511665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.479 qpair failed and we were unable to recover it. 00:30:21.479 [2024-11-20 01:31:29.511762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.479 [2024-11-20 01:31:29.511860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.479 [2024-11-20 01:31:29.511887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.479 qpair failed and we were unable to recover it. 00:30:21.479 [2024-11-20 01:31:29.512054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.479 [2024-11-20 01:31:29.512142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.479 [2024-11-20 01:31:29.512168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.479 qpair failed and we were unable to recover it. 00:30:21.479 [2024-11-20 01:31:29.512248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.479 [2024-11-20 01:31:29.512338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.479 [2024-11-20 01:31:29.512382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.479 qpair failed and we were unable to recover it. 00:30:21.479 [2024-11-20 01:31:29.512498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.479 [2024-11-20 01:31:29.512598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.479 [2024-11-20 01:31:29.512626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.479 qpair failed and we were unable to recover it. 00:30:21.479 [2024-11-20 01:31:29.512728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.479 [2024-11-20 01:31:29.512834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.479 [2024-11-20 01:31:29.512876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.479 qpair failed and we were unable to recover it. 00:30:21.479 [2024-11-20 01:31:29.513025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.479 [2024-11-20 01:31:29.513109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.479 [2024-11-20 01:31:29.513151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.479 qpair failed and we were unable to recover it. 00:30:21.479 [2024-11-20 01:31:29.513287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.479 [2024-11-20 01:31:29.513396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.479 [2024-11-20 01:31:29.513423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.479 qpair failed and we were unable to recover it. 00:30:21.479 [2024-11-20 01:31:29.513600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.479 [2024-11-20 01:31:29.513724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.479 [2024-11-20 01:31:29.513751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.479 qpair failed and we were unable to recover it. 00:30:21.479 [2024-11-20 01:31:29.513846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.479 [2024-11-20 01:31:29.513944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.479 [2024-11-20 01:31:29.513971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.479 qpair failed and we were unable to recover it. 00:30:21.479 [2024-11-20 01:31:29.514117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.479 [2024-11-20 01:31:29.514239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.479 [2024-11-20 01:31:29.514263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.479 qpair failed and we were unable to recover it. 00:30:21.479 [2024-11-20 01:31:29.514378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.479 [2024-11-20 01:31:29.514502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.479 [2024-11-20 01:31:29.514530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.479 qpair failed and we were unable to recover it. 00:30:21.479 [2024-11-20 01:31:29.514691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.479 [2024-11-20 01:31:29.514849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.479 [2024-11-20 01:31:29.514876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.479 qpair failed and we were unable to recover it. 00:30:21.479 [2024-11-20 01:31:29.514983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.479 [2024-11-20 01:31:29.515139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.479 [2024-11-20 01:31:29.515166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.479 qpair failed and we were unable to recover it. 00:30:21.479 [2024-11-20 01:31:29.515258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.479 [2024-11-20 01:31:29.515346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.479 [2024-11-20 01:31:29.515395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.479 qpair failed and we were unable to recover it. 00:30:21.479 [2024-11-20 01:31:29.515518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.479 [2024-11-20 01:31:29.515611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.479 [2024-11-20 01:31:29.515640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.479 qpair failed and we were unable to recover it. 00:30:21.479 [2024-11-20 01:31:29.515743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.479 [2024-11-20 01:31:29.515857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.479 [2024-11-20 01:31:29.515885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.479 qpair failed and we were unable to recover it. 00:30:21.479 [2024-11-20 01:31:29.515982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.479 [2024-11-20 01:31:29.516073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.479 [2024-11-20 01:31:29.516100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.479 qpair failed and we were unable to recover it. 00:30:21.479 [2024-11-20 01:31:29.516209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.479 [2024-11-20 01:31:29.516315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.479 [2024-11-20 01:31:29.516355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.479 qpair failed and we were unable to recover it. 00:30:21.479 [2024-11-20 01:31:29.516490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.479 [2024-11-20 01:31:29.516608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.479 [2024-11-20 01:31:29.516635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.479 qpair failed and we were unable to recover it. 00:30:21.480 [2024-11-20 01:31:29.516763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.480 [2024-11-20 01:31:29.516864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.480 [2024-11-20 01:31:29.516891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.480 qpair failed and we were unable to recover it. 00:30:21.480 [2024-11-20 01:31:29.516989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.480 [2024-11-20 01:31:29.517084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.480 [2024-11-20 01:31:29.517126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.480 qpair failed and we were unable to recover it. 00:30:21.480 [2024-11-20 01:31:29.517267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.480 [2024-11-20 01:31:29.517409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.480 [2024-11-20 01:31:29.517436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.480 qpair failed and we were unable to recover it. 00:30:21.480 [2024-11-20 01:31:29.517617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.480 [2024-11-20 01:31:29.517710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.480 [2024-11-20 01:31:29.517737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.480 qpair failed and we were unable to recover it. 00:30:21.480 [2024-11-20 01:31:29.517896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.480 [2024-11-20 01:31:29.518048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.480 [2024-11-20 01:31:29.518092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.480 qpair failed and we were unable to recover it. 00:30:21.480 [2024-11-20 01:31:29.518227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.480 [2024-11-20 01:31:29.518339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.480 [2024-11-20 01:31:29.518374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.480 qpair failed and we were unable to recover it. 00:30:21.480 [2024-11-20 01:31:29.518471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.480 [2024-11-20 01:31:29.518634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.480 [2024-11-20 01:31:29.518682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.480 qpair failed and we were unable to recover it. 00:30:21.480 [2024-11-20 01:31:29.518814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.480 [2024-11-20 01:31:29.518964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.480 [2024-11-20 01:31:29.518991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.480 qpair failed and we were unable to recover it. 00:30:21.480 [2024-11-20 01:31:29.519143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.480 [2024-11-20 01:31:29.519295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.480 [2024-11-20 01:31:29.519319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.480 qpair failed and we were unable to recover it. 00:30:21.480 [2024-11-20 01:31:29.519411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.480 [2024-11-20 01:31:29.519505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.480 [2024-11-20 01:31:29.519532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.480 qpair failed and we were unable to recover it. 00:30:21.480 [2024-11-20 01:31:29.519656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.480 [2024-11-20 01:31:29.519746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.480 [2024-11-20 01:31:29.519788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.480 qpair failed and we were unable to recover it. 00:30:21.480 [2024-11-20 01:31:29.519915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.480 [2024-11-20 01:31:29.520042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.480 [2024-11-20 01:31:29.520078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.480 qpair failed and we were unable to recover it. 00:30:21.480 [2024-11-20 01:31:29.520195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.480 [2024-11-20 01:31:29.520282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.480 [2024-11-20 01:31:29.520308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.480 qpair failed and we were unable to recover it. 00:30:21.480 [2024-11-20 01:31:29.520447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.480 [2024-11-20 01:31:29.520577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.480 [2024-11-20 01:31:29.520604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.480 qpair failed and we were unable to recover it. 00:30:21.480 [2024-11-20 01:31:29.520700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.480 [2024-11-20 01:31:29.520801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.480 [2024-11-20 01:31:29.520828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.480 qpair failed and we were unable to recover it. 00:30:21.480 [2024-11-20 01:31:29.520941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.480 [2024-11-20 01:31:29.521041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.480 [2024-11-20 01:31:29.521082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.480 qpair failed and we were unable to recover it. 00:30:21.480 [2024-11-20 01:31:29.521229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.480 [2024-11-20 01:31:29.521396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.480 [2024-11-20 01:31:29.521436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.480 qpair failed and we were unable to recover it. 00:30:21.480 [2024-11-20 01:31:29.521526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.480 [2024-11-20 01:31:29.521666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.480 [2024-11-20 01:31:29.521693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.480 qpair failed and we were unable to recover it. 00:30:21.480 [2024-11-20 01:31:29.521805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.480 [2024-11-20 01:31:29.521954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.480 [2024-11-20 01:31:29.521980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.480 qpair failed and we were unable to recover it. 00:30:21.480 [2024-11-20 01:31:29.522101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.480 [2024-11-20 01:31:29.522282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.480 [2024-11-20 01:31:29.522307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.480 qpair failed and we were unable to recover it. 00:30:21.480 [2024-11-20 01:31:29.522439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.480 [2024-11-20 01:31:29.522575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.480 [2024-11-20 01:31:29.522604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.480 qpair failed and we were unable to recover it. 00:30:21.480 [2024-11-20 01:31:29.522709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.480 [2024-11-20 01:31:29.522797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.480 [2024-11-20 01:31:29.522823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.480 qpair failed and we were unable to recover it. 00:30:21.480 [2024-11-20 01:31:29.522912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.480 [2024-11-20 01:31:29.523027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.480 [2024-11-20 01:31:29.523051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.480 qpair failed and we were unable to recover it. 00:30:21.480 [2024-11-20 01:31:29.523150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.480 [2024-11-20 01:31:29.523259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.480 [2024-11-20 01:31:29.523286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.480 qpair failed and we were unable to recover it. 00:30:21.480 [2024-11-20 01:31:29.523405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.480 [2024-11-20 01:31:29.523501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.480 [2024-11-20 01:31:29.523525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.480 qpair failed and we were unable to recover it. 00:30:21.480 [2024-11-20 01:31:29.523642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.480 [2024-11-20 01:31:29.523736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.480 [2024-11-20 01:31:29.523761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.480 qpair failed and we were unable to recover it. 00:30:21.480 [2024-11-20 01:31:29.523856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.480 [2024-11-20 01:31:29.523939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.480 [2024-11-20 01:31:29.523964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.480 qpair failed and we were unable to recover it. 00:30:21.480 [2024-11-20 01:31:29.524054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.480 [2024-11-20 01:31:29.524180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.480 [2024-11-20 01:31:29.524205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.480 qpair failed and we were unable to recover it. 00:30:21.480 [2024-11-20 01:31:29.524339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.480 [2024-11-20 01:31:29.524466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.481 [2024-11-20 01:31:29.524494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.481 qpair failed and we were unable to recover it. 00:30:21.481 [2024-11-20 01:31:29.524619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.481 [2024-11-20 01:31:29.524743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.481 [2024-11-20 01:31:29.524771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.481 qpair failed and we were unable to recover it. 00:30:21.481 [2024-11-20 01:31:29.524886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.481 [2024-11-20 01:31:29.524995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.481 [2024-11-20 01:31:29.525021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.481 qpair failed and we were unable to recover it. 00:30:21.481 [2024-11-20 01:31:29.525145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.481 [2024-11-20 01:31:29.525230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.481 [2024-11-20 01:31:29.525255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.481 qpair failed and we were unable to recover it. 00:30:21.481 [2024-11-20 01:31:29.525353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.481 [2024-11-20 01:31:29.525468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.481 [2024-11-20 01:31:29.525492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.481 qpair failed and we were unable to recover it. 00:30:21.481 [2024-11-20 01:31:29.525609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.481 [2024-11-20 01:31:29.525694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.481 [2024-11-20 01:31:29.525719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.481 qpair failed and we were unable to recover it. 00:30:21.481 [2024-11-20 01:31:29.525804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.481 [2024-11-20 01:31:29.525950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.481 [2024-11-20 01:31:29.525978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.481 qpair failed and we were unable to recover it. 00:30:21.481 [2024-11-20 01:31:29.526100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.481 [2024-11-20 01:31:29.526200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.481 [2024-11-20 01:31:29.526225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.481 qpair failed and we were unable to recover it. 00:30:21.481 [2024-11-20 01:31:29.526310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.481 [2024-11-20 01:31:29.526445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.481 [2024-11-20 01:31:29.526472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.481 qpair failed and we were unable to recover it. 00:30:21.481 [2024-11-20 01:31:29.526575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.481 [2024-11-20 01:31:29.526668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.481 [2024-11-20 01:31:29.526697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.481 qpair failed and we were unable to recover it. 00:30:21.481 [2024-11-20 01:31:29.526788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.481 [2024-11-20 01:31:29.526919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.481 [2024-11-20 01:31:29.526947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.481 qpair failed and we were unable to recover it. 00:30:21.481 [2024-11-20 01:31:29.527059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.481 [2024-11-20 01:31:29.527186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.481 [2024-11-20 01:31:29.527212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.481 qpair failed and we were unable to recover it. 00:30:21.481 [2024-11-20 01:31:29.527327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.481 [2024-11-20 01:31:29.527461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.481 [2024-11-20 01:31:29.527489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.481 qpair failed and we were unable to recover it. 00:30:21.481 [2024-11-20 01:31:29.527588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.481 [2024-11-20 01:31:29.527719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.481 [2024-11-20 01:31:29.527744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.481 qpair failed and we were unable to recover it. 00:30:21.481 [2024-11-20 01:31:29.527858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.481 [2024-11-20 01:31:29.527973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.481 [2024-11-20 01:31:29.527998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.481 qpair failed and we were unable to recover it. 00:30:21.481 [2024-11-20 01:31:29.528148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.481 [2024-11-20 01:31:29.528251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.481 [2024-11-20 01:31:29.528293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.481 qpair failed and we were unable to recover it. 00:30:21.481 [2024-11-20 01:31:29.528436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.481 [2024-11-20 01:31:29.528536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.481 [2024-11-20 01:31:29.528564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.481 qpair failed and we were unable to recover it. 00:30:21.481 [2024-11-20 01:31:29.528676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.481 [2024-11-20 01:31:29.528815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.481 [2024-11-20 01:31:29.528840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.481 qpair failed and we were unable to recover it. 00:30:21.481 [2024-11-20 01:31:29.528952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.481 [2024-11-20 01:31:29.529048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.481 [2024-11-20 01:31:29.529085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.481 qpair failed and we were unable to recover it. 00:30:21.481 [2024-11-20 01:31:29.529179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.481 [2024-11-20 01:31:29.529307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.481 [2024-11-20 01:31:29.529334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.481 qpair failed and we were unable to recover it. 00:30:21.481 [2024-11-20 01:31:29.529453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.481 [2024-11-20 01:31:29.529570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.481 [2024-11-20 01:31:29.529596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.481 qpair failed and we were unable to recover it. 00:30:21.481 [2024-11-20 01:31:29.529683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.481 [2024-11-20 01:31:29.529799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.481 [2024-11-20 01:31:29.529824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.481 qpair failed and we were unable to recover it. 00:30:21.481 [2024-11-20 01:31:29.529958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.481 [2024-11-20 01:31:29.530046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.481 [2024-11-20 01:31:29.530091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.481 qpair failed and we were unable to recover it. 00:30:21.481 [2024-11-20 01:31:29.530225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.481 [2024-11-20 01:31:29.530373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.481 [2024-11-20 01:31:29.530398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.481 qpair failed and we were unable to recover it. 00:30:21.481 [2024-11-20 01:31:29.530514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.481 [2024-11-20 01:31:29.530651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.481 [2024-11-20 01:31:29.530676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.481 qpair failed and we were unable to recover it. 00:30:21.481 [2024-11-20 01:31:29.530809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.481 [2024-11-20 01:31:29.530902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.481 [2024-11-20 01:31:29.530929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.481 qpair failed and we were unable to recover it. 00:30:21.481 [2024-11-20 01:31:29.531020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.481 [2024-11-20 01:31:29.531154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.481 [2024-11-20 01:31:29.531180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.481 qpair failed and we were unable to recover it. 00:30:21.481 [2024-11-20 01:31:29.531291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.481 [2024-11-20 01:31:29.531430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.481 [2024-11-20 01:31:29.531458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.481 qpair failed and we were unable to recover it. 00:30:21.481 [2024-11-20 01:31:29.531585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.481 [2024-11-20 01:31:29.531681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.482 [2024-11-20 01:31:29.531709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.482 qpair failed and we were unable to recover it. 00:30:21.482 [2024-11-20 01:31:29.531826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.482 [2024-11-20 01:31:29.531918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.482 [2024-11-20 01:31:29.531944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.482 qpair failed and we were unable to recover it. 00:30:21.482 [2024-11-20 01:31:29.532091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.482 [2024-11-20 01:31:29.532190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.482 [2024-11-20 01:31:29.532218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.482 qpair failed and we were unable to recover it. 00:30:21.482 [2024-11-20 01:31:29.532321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.482 [2024-11-20 01:31:29.532439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.482 [2024-11-20 01:31:29.532466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.482 qpair failed and we were unable to recover it. 00:30:21.482 [2024-11-20 01:31:29.532585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.482 [2024-11-20 01:31:29.532731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.482 [2024-11-20 01:31:29.532757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.482 qpair failed and we were unable to recover it. 00:30:21.482 [2024-11-20 01:31:29.532859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.482 [2024-11-20 01:31:29.532983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.482 [2024-11-20 01:31:29.533011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.482 qpair failed and we were unable to recover it. 00:30:21.482 [2024-11-20 01:31:29.533161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.482 [2024-11-20 01:31:29.533291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.482 [2024-11-20 01:31:29.533319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.482 qpair failed and we were unable to recover it. 00:30:21.482 [2024-11-20 01:31:29.533464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.482 [2024-11-20 01:31:29.533576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.482 [2024-11-20 01:31:29.533602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.482 qpair failed and we were unable to recover it. 00:30:21.482 [2024-11-20 01:31:29.533719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.482 [2024-11-20 01:31:29.533795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.482 [2024-11-20 01:31:29.533820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.482 qpair failed and we were unable to recover it. 00:30:21.482 [2024-11-20 01:31:29.533901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.482 [2024-11-20 01:31:29.534032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.482 [2024-11-20 01:31:29.534060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.482 qpair failed and we were unable to recover it. 00:30:21.482 [2024-11-20 01:31:29.534213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.482 [2024-11-20 01:31:29.534305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.482 [2024-11-20 01:31:29.534330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.482 qpair failed and we were unable to recover it. 00:30:21.482 [2024-11-20 01:31:29.534440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.482 [2024-11-20 01:31:29.534576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.482 [2024-11-20 01:31:29.534604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.482 qpair failed and we were unable to recover it. 00:30:21.482 [2024-11-20 01:31:29.534752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.482 [2024-11-20 01:31:29.534840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.482 [2024-11-20 01:31:29.534864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.482 qpair failed and we were unable to recover it. 00:30:21.482 [2024-11-20 01:31:29.534954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.482 [2024-11-20 01:31:29.535043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.482 [2024-11-20 01:31:29.535074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.482 qpair failed and we were unable to recover it. 00:30:21.482 [2024-11-20 01:31:29.535168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.482 [2024-11-20 01:31:29.535251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.482 [2024-11-20 01:31:29.535275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.482 qpair failed and we were unable to recover it. 00:30:21.482 [2024-11-20 01:31:29.535393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.482 [2024-11-20 01:31:29.535480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.482 [2024-11-20 01:31:29.535506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.482 qpair failed and we were unable to recover it. 00:30:21.482 [2024-11-20 01:31:29.535622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.482 [2024-11-20 01:31:29.535765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.482 [2024-11-20 01:31:29.535791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.482 qpair failed and we were unable to recover it. 00:30:21.482 [2024-11-20 01:31:29.535931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.482 [2024-11-20 01:31:29.536017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.482 [2024-11-20 01:31:29.536045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.482 qpair failed and we were unable to recover it. 00:30:21.482 [2024-11-20 01:31:29.536200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.482 [2024-11-20 01:31:29.536344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.482 [2024-11-20 01:31:29.536375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.482 qpair failed and we were unable to recover it. 00:30:21.482 [2024-11-20 01:31:29.536495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.482 [2024-11-20 01:31:29.536588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.482 [2024-11-20 01:31:29.536614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.482 qpair failed and we were unable to recover it. 00:30:21.482 [2024-11-20 01:31:29.536728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.482 [2024-11-20 01:31:29.536839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.482 [2024-11-20 01:31:29.536867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.482 qpair failed and we were unable to recover it. 00:30:21.482 [2024-11-20 01:31:29.536995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.482 [2024-11-20 01:31:29.537106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.482 [2024-11-20 01:31:29.537134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.482 qpair failed and we were unable to recover it. 00:30:21.482 [2024-11-20 01:31:29.537250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.482 [2024-11-20 01:31:29.537337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.482 [2024-11-20 01:31:29.537362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.482 qpair failed and we were unable to recover it. 00:30:21.482 [2024-11-20 01:31:29.537471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.482 [2024-11-20 01:31:29.537566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.482 [2024-11-20 01:31:29.537595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.482 qpair failed and we were unable to recover it. 00:30:21.482 [2024-11-20 01:31:29.537691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.482 [2024-11-20 01:31:29.537837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.482 [2024-11-20 01:31:29.537863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.482 qpair failed and we were unable to recover it. 00:30:21.482 [2024-11-20 01:31:29.537960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.482 [2024-11-20 01:31:29.538040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.482 [2024-11-20 01:31:29.538065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.482 qpair failed and we were unable to recover it. 00:30:21.482 [2024-11-20 01:31:29.538176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.482 [2024-11-20 01:31:29.538264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.482 [2024-11-20 01:31:29.538289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.482 qpair failed and we were unable to recover it. 00:30:21.482 [2024-11-20 01:31:29.538387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.482 [2024-11-20 01:31:29.538506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.482 [2024-11-20 01:31:29.538546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.482 qpair failed and we were unable to recover it. 00:30:21.482 [2024-11-20 01:31:29.538679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.482 [2024-11-20 01:31:29.538795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.482 [2024-11-20 01:31:29.538820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.482 qpair failed and we were unable to recover it. 00:30:21.482 [2024-11-20 01:31:29.538977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.483 [2024-11-20 01:31:29.539105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.483 [2024-11-20 01:31:29.539134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.483 qpair failed and we were unable to recover it. 00:30:21.483 [2024-11-20 01:31:29.539266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.483 [2024-11-20 01:31:29.539388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.483 [2024-11-20 01:31:29.539433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.483 qpair failed and we were unable to recover it. 00:30:21.483 [2024-11-20 01:31:29.539553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.483 [2024-11-20 01:31:29.539641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.483 [2024-11-20 01:31:29.539665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.483 qpair failed and we were unable to recover it. 00:30:21.483 [2024-11-20 01:31:29.539750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.483 [2024-11-20 01:31:29.539898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.483 [2024-11-20 01:31:29.539925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.483 qpair failed and we were unable to recover it. 00:30:21.483 [2024-11-20 01:31:29.540014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.483 [2024-11-20 01:31:29.540126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.483 [2024-11-20 01:31:29.540151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.483 qpair failed and we were unable to recover it. 00:30:21.483 [2024-11-20 01:31:29.540233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.483 [2024-11-20 01:31:29.540323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.483 [2024-11-20 01:31:29.540351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.483 qpair failed and we were unable to recover it. 00:30:21.483 [2024-11-20 01:31:29.540461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.483 [2024-11-20 01:31:29.540597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.483 [2024-11-20 01:31:29.540624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.483 qpair failed and we were unable to recover it. 00:30:21.483 [2024-11-20 01:31:29.540734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.483 [2024-11-20 01:31:29.540831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.483 [2024-11-20 01:31:29.540858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.483 qpair failed and we were unable to recover it. 00:30:21.483 [2024-11-20 01:31:29.541002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.483 [2024-11-20 01:31:29.541113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.483 [2024-11-20 01:31:29.541138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.483 qpair failed and we were unable to recover it. 00:30:21.483 [2024-11-20 01:31:29.541283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.483 [2024-11-20 01:31:29.541431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.483 [2024-11-20 01:31:29.541456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.483 qpair failed and we were unable to recover it. 00:30:21.483 [2024-11-20 01:31:29.541574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.483 [2024-11-20 01:31:29.541740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.483 [2024-11-20 01:31:29.541767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.483 qpair failed and we were unable to recover it. 00:30:21.483 [2024-11-20 01:31:29.541878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.483 [2024-11-20 01:31:29.542007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.483 [2024-11-20 01:31:29.542036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.483 qpair failed and we were unable to recover it. 00:30:21.483 [2024-11-20 01:31:29.542129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.483 [2024-11-20 01:31:29.542216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.483 [2024-11-20 01:31:29.542241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.483 qpair failed and we were unable to recover it. 00:30:21.483 [2024-11-20 01:31:29.542328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.483 [2024-11-20 01:31:29.542445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.483 [2024-11-20 01:31:29.542472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.483 qpair failed and we were unable to recover it. 00:30:21.483 [2024-11-20 01:31:29.542583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.483 [2024-11-20 01:31:29.542672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.483 [2024-11-20 01:31:29.542696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.483 qpair failed and we were unable to recover it. 00:30:21.483 [2024-11-20 01:31:29.542781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.483 [2024-11-20 01:31:29.542897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.483 [2024-11-20 01:31:29.542922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.483 qpair failed and we were unable to recover it. 00:30:21.483 [2024-11-20 01:31:29.543087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.483 [2024-11-20 01:31:29.543201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.483 [2024-11-20 01:31:29.543228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.483 qpair failed and we were unable to recover it. 00:30:21.483 [2024-11-20 01:31:29.543322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.483 [2024-11-20 01:31:29.543417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.483 [2024-11-20 01:31:29.543441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.483 qpair failed and we were unable to recover it. 00:30:21.483 [2024-11-20 01:31:29.543548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.483 [2024-11-20 01:31:29.543673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.483 [2024-11-20 01:31:29.543700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.483 qpair failed and we were unable to recover it. 00:30:21.483 [2024-11-20 01:31:29.543799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.483 [2024-11-20 01:31:29.543921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.483 [2024-11-20 01:31:29.543950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.483 qpair failed and we were unable to recover it. 00:30:21.483 [2024-11-20 01:31:29.544056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.483 [2024-11-20 01:31:29.544213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.483 [2024-11-20 01:31:29.544238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.483 qpair failed and we were unable to recover it. 00:30:21.483 [2024-11-20 01:31:29.544382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.483 [2024-11-20 01:31:29.544506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.483 [2024-11-20 01:31:29.544538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.483 qpair failed and we were unable to recover it. 00:30:21.483 [2024-11-20 01:31:29.544675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.483 [2024-11-20 01:31:29.544789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.483 [2024-11-20 01:31:29.544814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.483 qpair failed and we were unable to recover it. 00:30:21.483 [2024-11-20 01:31:29.544958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.483 [2024-11-20 01:31:29.545042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.483 [2024-11-20 01:31:29.545067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.483 qpair failed and we were unable to recover it. 00:30:21.483 [2024-11-20 01:31:29.545163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.483 [2024-11-20 01:31:29.545254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.483 [2024-11-20 01:31:29.545281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.483 qpair failed and we were unable to recover it. 00:30:21.483 [2024-11-20 01:31:29.545401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.483 [2024-11-20 01:31:29.545517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.484 [2024-11-20 01:31:29.545542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.484 qpair failed and we were unable to recover it. 00:30:21.484 [2024-11-20 01:31:29.545682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.484 [2024-11-20 01:31:29.545821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.484 [2024-11-20 01:31:29.545862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.484 qpair failed and we were unable to recover it. 00:30:21.484 [2024-11-20 01:31:29.545964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.484 [2024-11-20 01:31:29.546050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.484 [2024-11-20 01:31:29.546091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.484 qpair failed and we were unable to recover it. 00:30:21.484 [2024-11-20 01:31:29.546212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.484 [2024-11-20 01:31:29.546339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.484 [2024-11-20 01:31:29.546378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.484 qpair failed and we were unable to recover it. 00:30:21.484 [2024-11-20 01:31:29.546485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.484 [2024-11-20 01:31:29.546597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.484 [2024-11-20 01:31:29.546621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.484 qpair failed and we were unable to recover it. 00:30:21.484 [2024-11-20 01:31:29.546746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.484 [2024-11-20 01:31:29.546866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.484 [2024-11-20 01:31:29.546893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.484 qpair failed and we were unable to recover it. 00:30:21.484 [2024-11-20 01:31:29.546992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.484 [2024-11-20 01:31:29.547089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.484 [2024-11-20 01:31:29.547123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.484 qpair failed and we were unable to recover it. 00:30:21.484 [2024-11-20 01:31:29.547232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.484 [2024-11-20 01:31:29.547319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.484 [2024-11-20 01:31:29.547345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.484 qpair failed and we were unable to recover it. 00:30:21.484 [2024-11-20 01:31:29.547429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.484 [2024-11-20 01:31:29.547544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.484 [2024-11-20 01:31:29.547568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.484 qpair failed and we were unable to recover it. 00:30:21.484 [2024-11-20 01:31:29.547686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.484 [2024-11-20 01:31:29.547794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.484 [2024-11-20 01:31:29.547836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.484 qpair failed and we were unable to recover it. 00:30:21.484 [2024-11-20 01:31:29.547965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.484 [2024-11-20 01:31:29.548082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.484 [2024-11-20 01:31:29.548107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.484 qpair failed and we were unable to recover it. 00:30:21.484 [2024-11-20 01:31:29.548240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.484 [2024-11-20 01:31:29.548368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.484 [2024-11-20 01:31:29.548398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.484 qpair failed and we were unable to recover it. 00:30:21.484 [2024-11-20 01:31:29.548537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.484 [2024-11-20 01:31:29.548631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.484 [2024-11-20 01:31:29.548656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.484 qpair failed and we were unable to recover it. 00:30:21.484 [2024-11-20 01:31:29.548744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.484 [2024-11-20 01:31:29.548861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.484 [2024-11-20 01:31:29.548885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.484 qpair failed and we were unable to recover it. 00:30:21.484 [2024-11-20 01:31:29.548976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.484 [2024-11-20 01:31:29.549084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.484 [2024-11-20 01:31:29.549110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.484 qpair failed and we were unable to recover it. 00:30:21.484 [2024-11-20 01:31:29.549228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.484 [2024-11-20 01:31:29.549322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.484 [2024-11-20 01:31:29.549349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.484 qpair failed and we were unable to recover it. 00:30:21.484 [2024-11-20 01:31:29.549452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.484 [2024-11-20 01:31:29.549579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.484 [2024-11-20 01:31:29.549606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.484 qpair failed and we were unable to recover it. 00:30:21.484 [2024-11-20 01:31:29.549745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.484 [2024-11-20 01:31:29.549848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.484 [2024-11-20 01:31:29.549876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.484 qpair failed and we were unable to recover it. 00:30:21.484 [2024-11-20 01:31:29.550005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.484 [2024-11-20 01:31:29.550105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.484 [2024-11-20 01:31:29.550133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.484 qpair failed and we were unable to recover it. 00:30:21.484 [2024-11-20 01:31:29.550257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.484 [2024-11-20 01:31:29.550342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.484 [2024-11-20 01:31:29.550367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.484 qpair failed and we were unable to recover it. 00:30:21.484 [2024-11-20 01:31:29.550458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.484 [2024-11-20 01:31:29.550598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.484 [2024-11-20 01:31:29.550626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.484 qpair failed and we were unable to recover it. 00:30:21.484 [2024-11-20 01:31:29.550760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.484 [2024-11-20 01:31:29.550851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.484 [2024-11-20 01:31:29.550878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.484 qpair failed and we were unable to recover it. 00:30:21.484 [2024-11-20 01:31:29.550993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.484 [2024-11-20 01:31:29.551099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.484 [2024-11-20 01:31:29.551126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.484 qpair failed and we were unable to recover it. 00:30:21.484 [2024-11-20 01:31:29.551239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.484 [2024-11-20 01:31:29.551397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.484 [2024-11-20 01:31:29.551423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.484 qpair failed and we were unable to recover it. 00:30:21.484 [2024-11-20 01:31:29.551522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.484 [2024-11-20 01:31:29.551651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.484 [2024-11-20 01:31:29.551679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.484 qpair failed and we were unable to recover it. 00:30:21.484 [2024-11-20 01:31:29.551789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.484 [2024-11-20 01:31:29.551905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.484 [2024-11-20 01:31:29.551930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.484 qpair failed and we were unable to recover it. 00:30:21.484 [2024-11-20 01:31:29.552080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.484 [2024-11-20 01:31:29.552206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.484 [2024-11-20 01:31:29.552233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.484 qpair failed and we were unable to recover it. 00:30:21.484 [2024-11-20 01:31:29.552339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.484 [2024-11-20 01:31:29.552475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.484 [2024-11-20 01:31:29.552509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.484 qpair failed and we were unable to recover it. 00:30:21.484 [2024-11-20 01:31:29.552595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.484 [2024-11-20 01:31:29.552681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.484 [2024-11-20 01:31:29.552706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.485 qpair failed and we were unable to recover it. 00:30:21.485 [2024-11-20 01:31:29.552877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.485 [2024-11-20 01:31:29.552971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.485 [2024-11-20 01:31:29.553014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.485 qpair failed and we were unable to recover it. 00:30:21.485 [2024-11-20 01:31:29.553101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.485 [2024-11-20 01:31:29.553252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.485 [2024-11-20 01:31:29.553277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.485 qpair failed and we were unable to recover it. 00:30:21.485 [2024-11-20 01:31:29.553360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.485 [2024-11-20 01:31:29.553475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.485 [2024-11-20 01:31:29.553500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.485 qpair failed and we were unable to recover it. 00:30:21.485 [2024-11-20 01:31:29.553641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.485 [2024-11-20 01:31:29.553732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.485 [2024-11-20 01:31:29.553760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.485 qpair failed and we were unable to recover it. 00:30:21.485 [2024-11-20 01:31:29.553851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.485 [2024-11-20 01:31:29.553942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.485 [2024-11-20 01:31:29.553970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.485 qpair failed and we were unable to recover it. 00:30:21.485 [2024-11-20 01:31:29.554108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.485 [2024-11-20 01:31:29.554202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.485 [2024-11-20 01:31:29.554228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.485 qpair failed and we were unable to recover it. 00:30:21.485 [2024-11-20 01:31:29.554340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.485 [2024-11-20 01:31:29.554474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.485 [2024-11-20 01:31:29.554502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.485 qpair failed and we were unable to recover it. 00:30:21.485 [2024-11-20 01:31:29.554594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.485 [2024-11-20 01:31:29.554703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.485 [2024-11-20 01:31:29.554727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.485 qpair failed and we were unable to recover it. 00:30:21.485 [2024-11-20 01:31:29.554851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.485 [2024-11-20 01:31:29.554978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.485 [2024-11-20 01:31:29.555003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.485 qpair failed and we were unable to recover it. 00:30:21.485 [2024-11-20 01:31:29.555112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.485 [2024-11-20 01:31:29.555245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.485 [2024-11-20 01:31:29.555274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.485 qpair failed and we were unable to recover it. 00:30:21.485 [2024-11-20 01:31:29.555406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.485 [2024-11-20 01:31:29.555547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.485 [2024-11-20 01:31:29.555571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.485 qpair failed and we were unable to recover it. 00:30:21.485 [2024-11-20 01:31:29.555690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.485 [2024-11-20 01:31:29.555781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.485 [2024-11-20 01:31:29.555807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.485 qpair failed and we were unable to recover it. 00:30:21.485 [2024-11-20 01:31:29.555936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.485 [2024-11-20 01:31:29.556050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.485 [2024-11-20 01:31:29.556082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.485 qpair failed and we were unable to recover it. 00:30:21.485 [2024-11-20 01:31:29.556216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.485 [2024-11-20 01:31:29.556319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.485 [2024-11-20 01:31:29.556347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.485 qpair failed and we were unable to recover it. 00:30:21.485 [2024-11-20 01:31:29.556521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.485 [2024-11-20 01:31:29.556606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.485 [2024-11-20 01:31:29.556631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.485 qpair failed and we were unable to recover it. 00:30:21.485 [2024-11-20 01:31:29.556768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.485 [2024-11-20 01:31:29.556895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.485 [2024-11-20 01:31:29.556922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.485 qpair failed and we were unable to recover it. 00:30:21.485 [2024-11-20 01:31:29.557019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.485 [2024-11-20 01:31:29.557116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.485 [2024-11-20 01:31:29.557145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.485 qpair failed and we were unable to recover it. 00:30:21.485 [2024-11-20 01:31:29.557275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.485 [2024-11-20 01:31:29.557362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.485 [2024-11-20 01:31:29.557386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.485 qpair failed and we were unable to recover it. 00:30:21.485 [2024-11-20 01:31:29.557477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.485 [2024-11-20 01:31:29.557561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.485 [2024-11-20 01:31:29.557586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.485 qpair failed and we were unable to recover it. 00:30:21.485 [2024-11-20 01:31:29.557676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.485 [2024-11-20 01:31:29.557779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.485 [2024-11-20 01:31:29.557807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.485 qpair failed and we were unable to recover it. 00:30:21.485 [2024-11-20 01:31:29.557971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.485 [2024-11-20 01:31:29.558058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.485 [2024-11-20 01:31:29.558096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.485 qpair failed and we were unable to recover it. 00:30:21.485 [2024-11-20 01:31:29.558186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.485 [2024-11-20 01:31:29.558334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.485 [2024-11-20 01:31:29.558359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.485 qpair failed and we were unable to recover it. 00:30:21.485 [2024-11-20 01:31:29.558469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.485 [2024-11-20 01:31:29.558622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.485 [2024-11-20 01:31:29.558650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.485 qpair failed and we were unable to recover it. 00:30:21.485 [2024-11-20 01:31:29.558765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.485 [2024-11-20 01:31:29.558908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.485 [2024-11-20 01:31:29.558934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.485 qpair failed and we were unable to recover it. 00:30:21.485 [2024-11-20 01:31:29.559061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.485 [2024-11-20 01:31:29.559243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.485 [2024-11-20 01:31:29.559271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.485 qpair failed and we were unable to recover it. 00:30:21.485 [2024-11-20 01:31:29.559442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.485 [2024-11-20 01:31:29.559550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.485 [2024-11-20 01:31:29.559578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.485 qpair failed and we were unable to recover it. 00:30:21.485 [2024-11-20 01:31:29.559687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.485 [2024-11-20 01:31:29.559803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.485 [2024-11-20 01:31:29.559830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.485 qpair failed and we were unable to recover it. 00:30:21.485 [2024-11-20 01:31:29.559923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.485 [2024-11-20 01:31:29.560025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.485 [2024-11-20 01:31:29.560053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.485 qpair failed and we were unable to recover it. 00:30:21.486 [2024-11-20 01:31:29.560207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.486 [2024-11-20 01:31:29.560293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.486 [2024-11-20 01:31:29.560319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.486 qpair failed and we were unable to recover it. 00:30:21.486 [2024-11-20 01:31:29.560463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.486 [2024-11-20 01:31:29.560592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.486 [2024-11-20 01:31:29.560617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.486 qpair failed and we were unable to recover it. 00:30:21.486 [2024-11-20 01:31:29.560728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.486 [2024-11-20 01:31:29.560829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.486 [2024-11-20 01:31:29.560857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.486 qpair failed and we were unable to recover it. 00:30:21.486 [2024-11-20 01:31:29.560982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.486 [2024-11-20 01:31:29.561077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.486 [2024-11-20 01:31:29.561106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.486 qpair failed and we were unable to recover it. 00:30:21.486 [2024-11-20 01:31:29.561245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.486 [2024-11-20 01:31:29.561332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.486 [2024-11-20 01:31:29.561358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.486 qpair failed and we were unable to recover it. 00:30:21.486 [2024-11-20 01:31:29.561489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.486 [2024-11-20 01:31:29.561621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.486 [2024-11-20 01:31:29.561650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.486 qpair failed and we were unable to recover it. 00:30:21.486 [2024-11-20 01:31:29.561750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.486 [2024-11-20 01:31:29.561863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.486 [2024-11-20 01:31:29.561890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.486 qpair failed and we were unable to recover it. 00:30:21.486 [2024-11-20 01:31:29.561974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.486 [2024-11-20 01:31:29.562126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.486 [2024-11-20 01:31:29.562152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.486 qpair failed and we were unable to recover it. 00:30:21.486 [2024-11-20 01:31:29.562255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.486 [2024-11-20 01:31:29.562415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.486 [2024-11-20 01:31:29.562440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.486 qpair failed and we were unable to recover it. 00:30:21.486 [2024-11-20 01:31:29.562532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.486 [2024-11-20 01:31:29.562615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.486 [2024-11-20 01:31:29.562640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.486 qpair failed and we were unable to recover it. 00:30:21.486 [2024-11-20 01:31:29.562812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.486 [2024-11-20 01:31:29.562902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.486 [2024-11-20 01:31:29.562929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.486 qpair failed and we were unable to recover it. 00:30:21.486 [2024-11-20 01:31:29.563016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.486 [2024-11-20 01:31:29.563142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.486 [2024-11-20 01:31:29.563168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.486 qpair failed and we were unable to recover it. 00:30:21.486 [2024-11-20 01:31:29.563254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.486 [2024-11-20 01:31:29.563403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.486 [2024-11-20 01:31:29.563428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.486 qpair failed and we were unable to recover it. 00:30:21.486 [2024-11-20 01:31:29.563509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.486 [2024-11-20 01:31:29.563616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.486 [2024-11-20 01:31:29.563641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.486 qpair failed and we were unable to recover it. 00:30:21.486 [2024-11-20 01:31:29.563732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.486 [2024-11-20 01:31:29.563886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.486 [2024-11-20 01:31:29.563915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.486 qpair failed and we were unable to recover it. 00:30:21.486 [2024-11-20 01:31:29.564044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.486 [2024-11-20 01:31:29.564148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.486 [2024-11-20 01:31:29.564176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.486 qpair failed and we were unable to recover it. 00:30:21.486 [2024-11-20 01:31:29.564285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.486 [2024-11-20 01:31:29.564373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.486 [2024-11-20 01:31:29.564398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.486 qpair failed and we were unable to recover it. 00:30:21.486 [2024-11-20 01:31:29.564475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.486 [2024-11-20 01:31:29.564572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.486 [2024-11-20 01:31:29.564599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.486 qpair failed and we were unable to recover it. 00:30:21.486 [2024-11-20 01:31:29.564732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.486 [2024-11-20 01:31:29.564853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.486 [2024-11-20 01:31:29.564881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.486 qpair failed and we were unable to recover it. 00:30:21.486 [2024-11-20 01:31:29.565014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.486 [2024-11-20 01:31:29.565137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.486 [2024-11-20 01:31:29.565163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.486 qpair failed and we were unable to recover it. 00:30:21.486 [2024-11-20 01:31:29.565281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.486 [2024-11-20 01:31:29.565388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.486 [2024-11-20 01:31:29.565431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.486 qpair failed and we were unable to recover it. 00:30:21.486 [2024-11-20 01:31:29.565549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.486 [2024-11-20 01:31:29.565681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.486 [2024-11-20 01:31:29.565708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.486 qpair failed and we were unable to recover it. 00:30:21.486 [2024-11-20 01:31:29.565816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.486 [2024-11-20 01:31:29.565960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.486 [2024-11-20 01:31:29.565985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.486 qpair failed and we were unable to recover it. 00:30:21.486 [2024-11-20 01:31:29.566116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.486 [2024-11-20 01:31:29.566257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.486 [2024-11-20 01:31:29.566281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.486 qpair failed and we were unable to recover it. 00:30:21.486 [2024-11-20 01:31:29.566380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.486 [2024-11-20 01:31:29.566515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.486 [2024-11-20 01:31:29.566543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.486 qpair failed and we were unable to recover it. 00:30:21.486 [2024-11-20 01:31:29.566659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.486 [2024-11-20 01:31:29.566745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.486 [2024-11-20 01:31:29.566778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.486 qpair failed and we were unable to recover it. 00:30:21.486 [2024-11-20 01:31:29.566917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.486 [2024-11-20 01:31:29.567010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.486 [2024-11-20 01:31:29.567040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.486 qpair failed and we were unable to recover it. 00:30:21.486 [2024-11-20 01:31:29.567159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.486 [2024-11-20 01:31:29.567251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.486 [2024-11-20 01:31:29.567296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.486 qpair failed and we were unable to recover it. 00:30:21.486 [2024-11-20 01:31:29.567388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.486 [2024-11-20 01:31:29.567530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.487 [2024-11-20 01:31:29.567554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.487 qpair failed and we were unable to recover it. 00:30:21.487 [2024-11-20 01:31:29.567688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.487 [2024-11-20 01:31:29.567810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.487 [2024-11-20 01:31:29.567839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.487 qpair failed and we were unable to recover it. 00:30:21.487 [2024-11-20 01:31:29.567943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.487 [2024-11-20 01:31:29.568036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.487 [2024-11-20 01:31:29.568064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.487 qpair failed and we were unable to recover it. 00:30:21.487 [2024-11-20 01:31:29.568193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.487 [2024-11-20 01:31:29.568321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.487 [2024-11-20 01:31:29.568345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.487 qpair failed and we were unable to recover it. 00:30:21.487 [2024-11-20 01:31:29.568427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.487 [2024-11-20 01:31:29.568516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.487 [2024-11-20 01:31:29.568540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.487 qpair failed and we were unable to recover it. 00:30:21.487 [2024-11-20 01:31:29.568638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.487 [2024-11-20 01:31:29.568805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.487 [2024-11-20 01:31:29.568833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.487 qpair failed and we were unable to recover it. 00:30:21.487 [2024-11-20 01:31:29.568950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.487 [2024-11-20 01:31:29.569110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.487 [2024-11-20 01:31:29.569135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.487 qpair failed and we were unable to recover it. 00:30:21.487 [2024-11-20 01:31:29.569240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.487 [2024-11-20 01:31:29.569341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.487 [2024-11-20 01:31:29.569369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.487 qpair failed and we were unable to recover it. 00:30:21.487 [2024-11-20 01:31:29.569498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.487 [2024-11-20 01:31:29.569625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.487 [2024-11-20 01:31:29.569654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.487 qpair failed and we were unable to recover it. 00:30:21.487 [2024-11-20 01:31:29.569785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.487 [2024-11-20 01:31:29.569928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.487 [2024-11-20 01:31:29.569953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.487 qpair failed and we were unable to recover it. 00:30:21.487 [2024-11-20 01:31:29.570052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.487 [2024-11-20 01:31:29.570220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.487 [2024-11-20 01:31:29.570248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.487 qpair failed and we were unable to recover it. 00:30:21.487 [2024-11-20 01:31:29.570363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.487 [2024-11-20 01:31:29.570488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.487 [2024-11-20 01:31:29.570514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.487 qpair failed and we were unable to recover it. 00:30:21.487 [2024-11-20 01:31:29.570655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.487 [2024-11-20 01:31:29.570745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.487 [2024-11-20 01:31:29.570771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.487 qpair failed and we were unable to recover it. 00:30:21.487 [2024-11-20 01:31:29.570893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.487 [2024-11-20 01:31:29.570981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.487 [2024-11-20 01:31:29.571006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.487 qpair failed and we were unable to recover it. 00:30:21.487 [2024-11-20 01:31:29.571145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.487 [2024-11-20 01:31:29.571270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.487 [2024-11-20 01:31:29.571298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.487 qpair failed and we were unable to recover it. 00:30:21.487 [2024-11-20 01:31:29.571432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.487 [2024-11-20 01:31:29.571539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.487 [2024-11-20 01:31:29.571564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.487 qpair failed and we were unable to recover it. 00:30:21.487 [2024-11-20 01:31:29.571684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.487 [2024-11-20 01:31:29.571855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.487 [2024-11-20 01:31:29.571881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.487 qpair failed and we were unable to recover it. 00:30:21.487 [2024-11-20 01:31:29.572000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.487 [2024-11-20 01:31:29.572124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.487 [2024-11-20 01:31:29.572152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.487 qpair failed and we were unable to recover it. 00:30:21.487 [2024-11-20 01:31:29.572256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.487 [2024-11-20 01:31:29.572342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.487 [2024-11-20 01:31:29.572367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.487 qpair failed and we were unable to recover it. 00:30:21.487 [2024-11-20 01:31:29.572507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.487 [2024-11-20 01:31:29.572643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.487 [2024-11-20 01:31:29.572671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.487 qpair failed and we were unable to recover it. 00:30:21.487 [2024-11-20 01:31:29.572772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.487 [2024-11-20 01:31:29.572895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.487 [2024-11-20 01:31:29.572922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.487 qpair failed and we were unable to recover it. 00:30:21.487 [2024-11-20 01:31:29.573025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.487 [2024-11-20 01:31:29.573107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.487 [2024-11-20 01:31:29.573132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.487 qpair failed and we were unable to recover it. 00:30:21.487 [2024-11-20 01:31:29.573246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.487 [2024-11-20 01:31:29.573354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.487 [2024-11-20 01:31:29.573381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.487 qpair failed and we were unable to recover it. 00:30:21.487 [2024-11-20 01:31:29.573483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.487 [2024-11-20 01:31:29.573575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.487 [2024-11-20 01:31:29.573602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.487 qpair failed and we were unable to recover it. 00:30:21.487 [2024-11-20 01:31:29.573740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.487 [2024-11-20 01:31:29.573821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.487 [2024-11-20 01:31:29.573846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.487 qpair failed and we were unable to recover it. 00:30:21.487 [2024-11-20 01:31:29.573955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.487 [2024-11-20 01:31:29.574077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.487 [2024-11-20 01:31:29.574105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.487 qpair failed and we were unable to recover it. 00:30:21.487 [2024-11-20 01:31:29.574215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.487 [2024-11-20 01:31:29.574370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.487 [2024-11-20 01:31:29.574397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.487 qpair failed and we were unable to recover it. 00:30:21.487 [2024-11-20 01:31:29.574552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.487 [2024-11-20 01:31:29.574669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.487 [2024-11-20 01:31:29.574694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.487 qpair failed and we were unable to recover it. 00:30:21.487 [2024-11-20 01:31:29.574833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.487 [2024-11-20 01:31:29.574941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.487 [2024-11-20 01:31:29.574970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.487 qpair failed and we were unable to recover it. 00:30:21.488 [2024-11-20 01:31:29.575097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.488 [2024-11-20 01:31:29.575198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.488 [2024-11-20 01:31:29.575226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.488 qpair failed and we were unable to recover it. 00:30:21.488 [2024-11-20 01:31:29.575347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.488 [2024-11-20 01:31:29.575468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.488 [2024-11-20 01:31:29.575492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.488 qpair failed and we were unable to recover it. 00:30:21.488 [2024-11-20 01:31:29.575574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.488 [2024-11-20 01:31:29.575660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.488 [2024-11-20 01:31:29.575686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.488 qpair failed and we were unable to recover it. 00:30:21.488 [2024-11-20 01:31:29.575788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.488 [2024-11-20 01:31:29.575905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.488 [2024-11-20 01:31:29.575933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.488 qpair failed and we were unable to recover it. 00:30:21.488 [2024-11-20 01:31:29.576050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.488 [2024-11-20 01:31:29.576165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.488 [2024-11-20 01:31:29.576190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.488 qpair failed and we were unable to recover it. 00:30:21.488 [2024-11-20 01:31:29.576311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.488 [2024-11-20 01:31:29.576396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.488 [2024-11-20 01:31:29.576439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.488 qpair failed and we were unable to recover it. 00:30:21.488 [2024-11-20 01:31:29.576541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.488 [2024-11-20 01:31:29.576662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.488 [2024-11-20 01:31:29.576690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.488 qpair failed and we were unable to recover it. 00:30:21.488 [2024-11-20 01:31:29.576823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.488 [2024-11-20 01:31:29.576941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.488 [2024-11-20 01:31:29.576966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.488 qpair failed and we were unable to recover it. 00:30:21.488 [2024-11-20 01:31:29.577108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.488 [2024-11-20 01:31:29.577204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.488 [2024-11-20 01:31:29.577231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.488 qpair failed and we were unable to recover it. 00:30:21.488 [2024-11-20 01:31:29.577357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.488 [2024-11-20 01:31:29.577442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.488 [2024-11-20 01:31:29.577470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.488 qpair failed and we were unable to recover it. 00:30:21.488 [2024-11-20 01:31:29.577580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.488 [2024-11-20 01:31:29.577721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.488 [2024-11-20 01:31:29.577745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.488 qpair failed and we were unable to recover it. 00:30:21.488 [2024-11-20 01:31:29.577874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.488 [2024-11-20 01:31:29.578032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.488 [2024-11-20 01:31:29.578060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.488 qpair failed and we were unable to recover it. 00:30:21.488 [2024-11-20 01:31:29.578162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.488 [2024-11-20 01:31:29.578255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.488 [2024-11-20 01:31:29.578282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.488 qpair failed and we were unable to recover it. 00:30:21.488 [2024-11-20 01:31:29.578406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.488 [2024-11-20 01:31:29.578552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.488 [2024-11-20 01:31:29.578577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.488 qpair failed and we were unable to recover it. 00:30:21.488 [2024-11-20 01:31:29.578669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.488 [2024-11-20 01:31:29.578784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.488 [2024-11-20 01:31:29.578809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.488 qpair failed and we were unable to recover it. 00:30:21.488 [2024-11-20 01:31:29.578897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.488 [2024-11-20 01:31:29.579017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.488 [2024-11-20 01:31:29.579042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.488 qpair failed and we were unable to recover it. 00:30:21.488 [2024-11-20 01:31:29.579168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.488 [2024-11-20 01:31:29.579298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.488 [2024-11-20 01:31:29.579323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.488 qpair failed and we were unable to recover it. 00:30:21.488 [2024-11-20 01:31:29.579478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.488 [2024-11-20 01:31:29.579593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.488 [2024-11-20 01:31:29.579618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.488 qpair failed and we were unable to recover it. 00:30:21.488 [2024-11-20 01:31:29.579743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.488 [2024-11-20 01:31:29.579868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.488 [2024-11-20 01:31:29.579895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.488 qpair failed and we were unable to recover it. 00:30:21.488 [2024-11-20 01:31:29.580026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.488 [2024-11-20 01:31:29.580141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.488 [2024-11-20 01:31:29.580166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.488 qpair failed and we were unable to recover it. 00:30:21.488 [2024-11-20 01:31:29.580325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.488 [2024-11-20 01:31:29.580449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.488 [2024-11-20 01:31:29.580474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.488 qpair failed and we were unable to recover it. 00:30:21.488 [2024-11-20 01:31:29.580560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.488 [2024-11-20 01:31:29.580698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.488 [2024-11-20 01:31:29.580726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.488 qpair failed and we were unable to recover it. 00:30:21.488 [2024-11-20 01:31:29.580831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.488 [2024-11-20 01:31:29.580948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.488 [2024-11-20 01:31:29.580974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.488 qpair failed and we were unable to recover it. 00:30:21.488 [2024-11-20 01:31:29.581132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.488 [2024-11-20 01:31:29.581291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.488 [2024-11-20 01:31:29.581323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.488 qpair failed and we were unable to recover it. 00:30:21.488 [2024-11-20 01:31:29.581456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.488 [2024-11-20 01:31:29.581563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.488 [2024-11-20 01:31:29.581588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.488 qpair failed and we were unable to recover it. 00:30:21.489 [2024-11-20 01:31:29.581699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.489 [2024-11-20 01:31:29.581842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.489 [2024-11-20 01:31:29.581867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.489 qpair failed and we were unable to recover it. 00:30:21.489 [2024-11-20 01:31:29.582004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.489 [2024-11-20 01:31:29.582131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.489 [2024-11-20 01:31:29.582159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.489 qpair failed and we were unable to recover it. 00:30:21.489 [2024-11-20 01:31:29.582249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.489 [2024-11-20 01:31:29.582340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.489 [2024-11-20 01:31:29.582368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.489 qpair failed and we were unable to recover it. 00:30:21.489 [2024-11-20 01:31:29.582471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.489 [2024-11-20 01:31:29.582591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.489 [2024-11-20 01:31:29.582616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.489 qpair failed and we were unable to recover it. 00:30:21.489 [2024-11-20 01:31:29.582699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.489 [2024-11-20 01:31:29.582811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.489 [2024-11-20 01:31:29.582836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.489 qpair failed and we were unable to recover it. 00:30:21.489 [2024-11-20 01:31:29.582967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.489 [2024-11-20 01:31:29.583124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.489 [2024-11-20 01:31:29.583150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.489 qpair failed and we were unable to recover it. 00:30:21.489 [2024-11-20 01:31:29.583236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.489 [2024-11-20 01:31:29.583381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.489 [2024-11-20 01:31:29.583406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.489 qpair failed and we were unable to recover it. 00:30:21.489 [2024-11-20 01:31:29.583544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.489 [2024-11-20 01:31:29.583668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.489 [2024-11-20 01:31:29.583696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.489 qpair failed and we were unable to recover it. 00:30:21.489 [2024-11-20 01:31:29.583827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.489 [2024-11-20 01:31:29.583995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.489 [2024-11-20 01:31:29.584024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.489 qpair failed and we were unable to recover it. 00:30:21.489 [2024-11-20 01:31:29.584159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.489 [2024-11-20 01:31:29.584245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.489 [2024-11-20 01:31:29.584271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.489 qpair failed and we were unable to recover it. 00:30:21.489 [2024-11-20 01:31:29.584388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.489 [2024-11-20 01:31:29.584521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.489 [2024-11-20 01:31:29.584548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.489 qpair failed and we were unable to recover it. 00:30:21.489 [2024-11-20 01:31:29.584694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.489 [2024-11-20 01:31:29.584808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.489 [2024-11-20 01:31:29.584834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.489 qpair failed and we were unable to recover it. 00:30:21.489 [2024-11-20 01:31:29.584981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.489 [2024-11-20 01:31:29.585091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.489 [2024-11-20 01:31:29.585117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.489 qpair failed and we were unable to recover it. 00:30:21.489 [2024-11-20 01:31:29.585236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.489 [2024-11-20 01:31:29.585406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.489 [2024-11-20 01:31:29.585430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.489 qpair failed and we were unable to recover it. 00:30:21.489 [2024-11-20 01:31:29.585541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.489 [2024-11-20 01:31:29.585674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.489 [2024-11-20 01:31:29.585699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.489 qpair failed and we were unable to recover it. 00:30:21.489 [2024-11-20 01:31:29.585789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.489 [2024-11-20 01:31:29.585881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.489 [2024-11-20 01:31:29.585906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.489 qpair failed and we were unable to recover it. 00:30:21.489 [2024-11-20 01:31:29.586020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.489 [2024-11-20 01:31:29.586132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.489 [2024-11-20 01:31:29.586161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.489 qpair failed and we were unable to recover it. 00:30:21.489 [2024-11-20 01:31:29.586292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.489 [2024-11-20 01:31:29.586415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.489 [2024-11-20 01:31:29.586443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.489 qpair failed and we were unable to recover it. 00:30:21.489 [2024-11-20 01:31:29.586549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.489 [2024-11-20 01:31:29.586661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.489 [2024-11-20 01:31:29.586692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.489 qpair failed and we were unable to recover it. 00:30:21.489 [2024-11-20 01:31:29.586813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.489 [2024-11-20 01:31:29.586963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.489 [2024-11-20 01:31:29.586988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.489 qpair failed and we were unable to recover it. 00:30:21.489 [2024-11-20 01:31:29.587128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.489 [2024-11-20 01:31:29.587269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.489 [2024-11-20 01:31:29.587296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.489 qpair failed and we were unable to recover it. 00:30:21.489 [2024-11-20 01:31:29.587403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.489 [2024-11-20 01:31:29.587514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.489 [2024-11-20 01:31:29.587539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.489 qpair failed and we were unable to recover it. 00:30:21.489 [2024-11-20 01:31:29.587697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.489 [2024-11-20 01:31:29.587797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.489 [2024-11-20 01:31:29.587824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.489 qpair failed and we were unable to recover it. 00:30:21.489 [2024-11-20 01:31:29.587948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.489 [2024-11-20 01:31:29.588080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.489 [2024-11-20 01:31:29.588109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.489 qpair failed and we were unable to recover it. 00:30:21.489 [2024-11-20 01:31:29.588246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.489 [2024-11-20 01:31:29.588361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.489 [2024-11-20 01:31:29.588387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.489 qpair failed and we were unable to recover it. 00:30:21.489 [2024-11-20 01:31:29.588501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.489 [2024-11-20 01:31:29.588631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.489 [2024-11-20 01:31:29.588659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.489 qpair failed and we were unable to recover it. 00:30:21.489 [2024-11-20 01:31:29.588794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.489 [2024-11-20 01:31:29.588965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.489 [2024-11-20 01:31:29.588990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.489 qpair failed and we were unable to recover it. 00:30:21.489 [2024-11-20 01:31:29.589078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.489 [2024-11-20 01:31:29.589208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.489 [2024-11-20 01:31:29.589233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.489 qpair failed and we were unable to recover it. 00:30:21.489 [2024-11-20 01:31:29.589389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.489 [2024-11-20 01:31:29.589540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.490 [2024-11-20 01:31:29.589570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.490 qpair failed and we were unable to recover it. 00:30:21.490 [2024-11-20 01:31:29.589688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.490 [2024-11-20 01:31:29.589812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.490 [2024-11-20 01:31:29.589838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.490 qpair failed and we were unable to recover it. 00:30:21.490 [2024-11-20 01:31:29.589980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.490 [2024-11-20 01:31:29.590063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.490 [2024-11-20 01:31:29.590093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.490 qpair failed and we were unable to recover it. 00:30:21.490 [2024-11-20 01:31:29.590203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.490 [2024-11-20 01:31:29.590324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.490 [2024-11-20 01:31:29.590352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.490 qpair failed and we were unable to recover it. 00:30:21.490 [2024-11-20 01:31:29.590481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.490 [2024-11-20 01:31:29.590648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.490 [2024-11-20 01:31:29.590672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.490 qpair failed and we were unable to recover it. 00:30:21.490 [2024-11-20 01:31:29.590787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.490 [2024-11-20 01:31:29.590897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.490 [2024-11-20 01:31:29.590922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.490 qpair failed and we were unable to recover it. 00:30:21.490 [2024-11-20 01:31:29.591062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.490 [2024-11-20 01:31:29.591227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.490 [2024-11-20 01:31:29.591257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.490 qpair failed and we were unable to recover it. 00:30:21.490 [2024-11-20 01:31:29.591353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.490 [2024-11-20 01:31:29.591463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.490 [2024-11-20 01:31:29.591489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.490 qpair failed and we were unable to recover it. 00:30:21.490 [2024-11-20 01:31:29.591576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.490 [2024-11-20 01:31:29.591669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.490 [2024-11-20 01:31:29.591695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.490 qpair failed and we were unable to recover it. 00:30:21.490 [2024-11-20 01:31:29.591851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.490 [2024-11-20 01:31:29.591979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.490 [2024-11-20 01:31:29.592006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.490 qpair failed and we were unable to recover it. 00:30:21.490 [2024-11-20 01:31:29.592172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.490 [2024-11-20 01:31:29.592275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.490 [2024-11-20 01:31:29.592303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.490 qpair failed and we were unable to recover it. 00:30:21.490 [2024-11-20 01:31:29.592432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.490 [2024-11-20 01:31:29.592515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.490 [2024-11-20 01:31:29.592539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.490 qpair failed and we were unable to recover it. 00:30:21.490 [2024-11-20 01:31:29.592626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.490 [2024-11-20 01:31:29.592740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.490 [2024-11-20 01:31:29.592782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.490 qpair failed and we were unable to recover it. 00:30:21.490 [2024-11-20 01:31:29.592879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.490 [2024-11-20 01:31:29.592969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.490 [2024-11-20 01:31:29.592994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.490 qpair failed and we were unable to recover it. 00:30:21.490 [2024-11-20 01:31:29.593112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.490 [2024-11-20 01:31:29.593222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.490 [2024-11-20 01:31:29.593246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.490 qpair failed and we were unable to recover it. 00:30:21.490 [2024-11-20 01:31:29.593384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.490 [2024-11-20 01:31:29.593502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.490 [2024-11-20 01:31:29.593529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.490 qpair failed and we were unable to recover it. 00:30:21.490 [2024-11-20 01:31:29.593694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.490 [2024-11-20 01:31:29.593800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.490 [2024-11-20 01:31:29.593827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.490 qpair failed and we were unable to recover it. 00:30:21.490 [2024-11-20 01:31:29.593933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.490 [2024-11-20 01:31:29.594049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.490 [2024-11-20 01:31:29.594079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.490 qpair failed and we were unable to recover it. 00:30:21.490 [2024-11-20 01:31:29.594201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.490 [2024-11-20 01:31:29.594314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.490 [2024-11-20 01:31:29.594338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.490 qpair failed and we were unable to recover it. 00:30:21.490 [2024-11-20 01:31:29.594450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.490 [2024-11-20 01:31:29.594589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.490 [2024-11-20 01:31:29.594614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.490 qpair failed and we were unable to recover it. 00:30:21.490 [2024-11-20 01:31:29.594728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.490 [2024-11-20 01:31:29.594818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.490 [2024-11-20 01:31:29.594842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.490 qpair failed and we were unable to recover it. 00:30:21.490 [2024-11-20 01:31:29.594962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.490 [2024-11-20 01:31:29.595051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.490 [2024-11-20 01:31:29.595082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.490 qpair failed and we were unable to recover it. 00:30:21.490 [2024-11-20 01:31:29.595214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.490 [2024-11-20 01:31:29.595310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.490 [2024-11-20 01:31:29.595337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.490 qpair failed and we were unable to recover it. 00:30:21.490 [2024-11-20 01:31:29.595450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.490 [2024-11-20 01:31:29.595566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.490 [2024-11-20 01:31:29.595591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.490 qpair failed and we were unable to recover it. 00:30:21.490 [2024-11-20 01:31:29.595723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.490 [2024-11-20 01:31:29.595880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.490 [2024-11-20 01:31:29.595908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.490 qpair failed and we were unable to recover it. 00:30:21.490 [2024-11-20 01:31:29.596048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.490 [2024-11-20 01:31:29.596174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.490 [2024-11-20 01:31:29.596200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.490 qpair failed and we were unable to recover it. 00:30:21.490 [2024-11-20 01:31:29.596322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.490 [2024-11-20 01:31:29.596432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.490 [2024-11-20 01:31:29.596457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.490 qpair failed and we were unable to recover it. 00:30:21.490 [2024-11-20 01:31:29.596550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.490 [2024-11-20 01:31:29.596646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.490 [2024-11-20 01:31:29.596674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.490 qpair failed and we were unable to recover it. 00:30:21.490 [2024-11-20 01:31:29.596760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.490 [2024-11-20 01:31:29.596848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.490 [2024-11-20 01:31:29.596876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.490 qpair failed and we were unable to recover it. 00:30:21.491 [2024-11-20 01:31:29.597003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.491 [2024-11-20 01:31:29.597113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.491 [2024-11-20 01:31:29.597138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.491 qpair failed and we were unable to recover it. 00:30:21.491 [2024-11-20 01:31:29.597263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.491 [2024-11-20 01:31:29.597359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.491 [2024-11-20 01:31:29.597387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.491 qpair failed and we were unable to recover it. 00:30:21.491 [2024-11-20 01:31:29.597492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.491 [2024-11-20 01:31:29.597582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.491 [2024-11-20 01:31:29.597610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.491 qpair failed and we were unable to recover it. 00:30:21.491 [2024-11-20 01:31:29.597711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.491 [2024-11-20 01:31:29.597800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.491 [2024-11-20 01:31:29.597824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.491 qpair failed and we were unable to recover it. 00:30:21.491 [2024-11-20 01:31:29.597938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.491 [2024-11-20 01:31:29.598050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.491 [2024-11-20 01:31:29.598080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.491 qpair failed and we were unable to recover it. 00:30:21.491 [2024-11-20 01:31:29.598262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.491 [2024-11-20 01:31:29.598376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.491 [2024-11-20 01:31:29.598401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.491 qpair failed and we were unable to recover it. 00:30:21.491 [2024-11-20 01:31:29.598483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.491 [2024-11-20 01:31:29.598622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.491 [2024-11-20 01:31:29.598646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.491 qpair failed and we were unable to recover it. 00:30:21.491 [2024-11-20 01:31:29.598781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.491 [2024-11-20 01:31:29.598904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.491 [2024-11-20 01:31:29.598932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.491 qpair failed and we were unable to recover it. 00:30:21.491 [2024-11-20 01:31:29.599093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.491 [2024-11-20 01:31:29.599215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.491 [2024-11-20 01:31:29.599241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.491 qpair failed and we were unable to recover it. 00:30:21.491 [2024-11-20 01:31:29.599348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.491 [2024-11-20 01:31:29.599458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.491 [2024-11-20 01:31:29.599483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.491 qpair failed and we were unable to recover it. 00:30:21.491 [2024-11-20 01:31:29.599628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.491 [2024-11-20 01:31:29.599744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.491 [2024-11-20 01:31:29.599771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.491 qpair failed and we were unable to recover it. 00:30:21.491 [2024-11-20 01:31:29.599869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.491 [2024-11-20 01:31:29.599969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.491 [2024-11-20 01:31:29.599996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.491 qpair failed and we were unable to recover it. 00:30:21.491 [2024-11-20 01:31:29.600120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.491 [2024-11-20 01:31:29.600265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.491 [2024-11-20 01:31:29.600290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.491 qpair failed and we were unable to recover it. 00:30:21.491 [2024-11-20 01:31:29.600390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.491 [2024-11-20 01:31:29.600556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.491 [2024-11-20 01:31:29.600581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.491 qpair failed and we were unable to recover it. 00:30:21.491 [2024-11-20 01:31:29.600725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.491 [2024-11-20 01:31:29.600841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.491 [2024-11-20 01:31:29.600867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.491 qpair failed and we were unable to recover it. 00:30:21.491 [2024-11-20 01:31:29.600986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.491 [2024-11-20 01:31:29.601102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.491 [2024-11-20 01:31:29.601128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.491 qpair failed and we were unable to recover it. 00:30:21.491 [2024-11-20 01:31:29.601229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.491 [2024-11-20 01:31:29.601359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.491 [2024-11-20 01:31:29.601384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.491 qpair failed and we were unable to recover it. 00:30:21.491 [2024-11-20 01:31:29.601474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.491 [2024-11-20 01:31:29.601567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.491 [2024-11-20 01:31:29.601592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.491 qpair failed and we were unable to recover it. 00:30:21.491 [2024-11-20 01:31:29.601711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.491 [2024-11-20 01:31:29.601830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.491 [2024-11-20 01:31:29.601855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.491 qpair failed and we were unable to recover it. 00:30:21.491 [2024-11-20 01:31:29.601955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.491 [2024-11-20 01:31:29.602110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.491 [2024-11-20 01:31:29.602138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.491 qpair failed and we were unable to recover it. 00:30:21.491 [2024-11-20 01:31:29.602311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.491 [2024-11-20 01:31:29.602429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.491 [2024-11-20 01:31:29.602453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.491 qpair failed and we were unable to recover it. 00:30:21.491 [2024-11-20 01:31:29.602570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.491 [2024-11-20 01:31:29.602658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.491 [2024-11-20 01:31:29.602683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.491 qpair failed and we were unable to recover it. 00:30:21.491 [2024-11-20 01:31:29.602831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.491 [2024-11-20 01:31:29.602960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.491 [2024-11-20 01:31:29.602988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.491 qpair failed and we were unable to recover it. 00:30:21.491 [2024-11-20 01:31:29.603128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.491 [2024-11-20 01:31:29.603274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.491 [2024-11-20 01:31:29.603300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.491 qpair failed and we were unable to recover it. 00:30:21.491 [2024-11-20 01:31:29.603392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.491 [2024-11-20 01:31:29.603510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.491 [2024-11-20 01:31:29.603534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.491 qpair failed and we were unable to recover it. 00:30:21.491 [2024-11-20 01:31:29.603706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.491 [2024-11-20 01:31:29.603822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.491 [2024-11-20 01:31:29.603849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.491 qpair failed and we were unable to recover it. 00:30:21.491 [2024-11-20 01:31:29.603977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.491 [2024-11-20 01:31:29.604081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.491 [2024-11-20 01:31:29.604125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.491 qpair failed and we were unable to recover it. 00:30:21.491 [2024-11-20 01:31:29.604265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.491 [2024-11-20 01:31:29.604406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.491 [2024-11-20 01:31:29.604446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.491 qpair failed and we were unable to recover it. 00:30:21.491 [2024-11-20 01:31:29.604540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.491 [2024-11-20 01:31:29.604623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.492 [2024-11-20 01:31:29.604650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.492 qpair failed and we were unable to recover it. 00:30:21.492 [2024-11-20 01:31:29.604745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.492 [2024-11-20 01:31:29.604884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.492 [2024-11-20 01:31:29.604910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.492 qpair failed and we were unable to recover it. 00:30:21.492 [2024-11-20 01:31:29.605029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.492 [2024-11-20 01:31:29.605124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.492 [2024-11-20 01:31:29.605151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.492 qpair failed and we were unable to recover it. 00:30:21.492 [2024-11-20 01:31:29.605269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.492 [2024-11-20 01:31:29.605403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.492 [2024-11-20 01:31:29.605431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.492 qpair failed and we were unable to recover it. 00:30:21.492 [2024-11-20 01:31:29.605574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.492 [2024-11-20 01:31:29.605716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.492 [2024-11-20 01:31:29.605740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.492 qpair failed and we were unable to recover it. 00:30:21.492 [2024-11-20 01:31:29.605826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.492 [2024-11-20 01:31:29.605910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.492 [2024-11-20 01:31:29.605935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.492 qpair failed and we were unable to recover it. 00:30:21.492 [2024-11-20 01:31:29.606020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.492 [2024-11-20 01:31:29.606163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.492 [2024-11-20 01:31:29.606192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.492 qpair failed and we were unable to recover it. 00:30:21.492 [2024-11-20 01:31:29.606352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.492 [2024-11-20 01:31:29.606458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.492 [2024-11-20 01:31:29.606485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.492 qpair failed and we were unable to recover it. 00:30:21.492 [2024-11-20 01:31:29.606597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.492 [2024-11-20 01:31:29.606683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.492 [2024-11-20 01:31:29.606707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.492 qpair failed and we were unable to recover it. 00:30:21.492 [2024-11-20 01:31:29.606796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.492 [2024-11-20 01:31:29.606910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.492 [2024-11-20 01:31:29.606953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.492 qpair failed and we were unable to recover it. 00:30:21.492 [2024-11-20 01:31:29.607064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.492 [2024-11-20 01:31:29.607239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.492 [2024-11-20 01:31:29.607267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.492 qpair failed and we were unable to recover it. 00:30:21.492 [2024-11-20 01:31:29.607403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.492 [2024-11-20 01:31:29.607487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.492 [2024-11-20 01:31:29.607512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.492 qpair failed and we were unable to recover it. 00:30:21.492 [2024-11-20 01:31:29.607594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.492 [2024-11-20 01:31:29.607682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.492 [2024-11-20 01:31:29.607707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.492 qpair failed and we were unable to recover it. 00:30:21.492 [2024-11-20 01:31:29.607803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.492 [2024-11-20 01:31:29.607978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.492 [2024-11-20 01:31:29.608003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.492 qpair failed and we were unable to recover it. 00:30:21.492 [2024-11-20 01:31:29.608125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.492 [2024-11-20 01:31:29.608244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.492 [2024-11-20 01:31:29.608270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.492 qpair failed and we were unable to recover it. 00:30:21.492 [2024-11-20 01:31:29.608355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.492 [2024-11-20 01:31:29.608434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.492 [2024-11-20 01:31:29.608458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.492 qpair failed and we were unable to recover it. 00:30:21.492 [2024-11-20 01:31:29.608553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.492 [2024-11-20 01:31:29.608662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.492 [2024-11-20 01:31:29.608686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.492 qpair failed and we were unable to recover it. 00:30:21.492 [2024-11-20 01:31:29.608769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.492 [2024-11-20 01:31:29.608883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.492 [2024-11-20 01:31:29.608909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.492 qpair failed and we were unable to recover it. 00:30:21.492 [2024-11-20 01:31:29.608997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.492 [2024-11-20 01:31:29.609140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.492 [2024-11-20 01:31:29.609165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.492 qpair failed and we were unable to recover it. 00:30:21.492 [2024-11-20 01:31:29.609251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.492 [2024-11-20 01:31:29.609357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.492 [2024-11-20 01:31:29.609381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.492 qpair failed and we were unable to recover it. 00:30:21.492 [2024-11-20 01:31:29.609494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.492 [2024-11-20 01:31:29.609581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.492 [2024-11-20 01:31:29.609605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.492 qpair failed and we were unable to recover it. 00:30:21.492 [2024-11-20 01:31:29.609697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.492 [2024-11-20 01:31:29.609803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.492 [2024-11-20 01:31:29.609831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.492 qpair failed and we were unable to recover it. 00:30:21.492 [2024-11-20 01:31:29.609963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.492 [2024-11-20 01:31:29.610056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.492 [2024-11-20 01:31:29.610108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.492 qpair failed and we were unable to recover it. 00:30:21.492 [2024-11-20 01:31:29.610248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.492 [2024-11-20 01:31:29.610385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.492 [2024-11-20 01:31:29.610409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.492 qpair failed and we were unable to recover it. 00:30:21.492 [2024-11-20 01:31:29.610581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.492 [2024-11-20 01:31:29.610727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.492 [2024-11-20 01:31:29.610753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.493 qpair failed and we were unable to recover it. 00:30:21.493 [2024-11-20 01:31:29.610845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.493 [2024-11-20 01:31:29.610998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.493 [2024-11-20 01:31:29.611038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.493 qpair failed and we were unable to recover it. 00:30:21.493 [2024-11-20 01:31:29.611176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.493 [2024-11-20 01:31:29.611272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.493 [2024-11-20 01:31:29.611296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.493 qpair failed and we were unable to recover it. 00:30:21.493 [2024-11-20 01:31:29.611425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.493 [2024-11-20 01:31:29.611600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.493 [2024-11-20 01:31:29.611625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.493 qpair failed and we were unable to recover it. 00:30:21.493 [2024-11-20 01:31:29.611717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.493 [2024-11-20 01:31:29.611835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.493 [2024-11-20 01:31:29.611860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.493 qpair failed and we were unable to recover it. 00:30:21.493 [2024-11-20 01:31:29.612006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.493 [2024-11-20 01:31:29.612120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.493 [2024-11-20 01:31:29.612145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.493 qpair failed and we were unable to recover it. 00:30:21.493 [2024-11-20 01:31:29.612270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.493 [2024-11-20 01:31:29.612370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.493 [2024-11-20 01:31:29.612395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.493 qpair failed and we were unable to recover it. 00:30:21.493 [2024-11-20 01:31:29.612483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.493 [2024-11-20 01:31:29.612628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.493 [2024-11-20 01:31:29.612653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.493 qpair failed and we were unable to recover it. 00:30:21.493 [2024-11-20 01:31:29.612769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.493 [2024-11-20 01:31:29.612881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.493 [2024-11-20 01:31:29.612906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.493 qpair failed and we were unable to recover it. 00:30:21.493 [2024-11-20 01:31:29.612993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.493 [2024-11-20 01:31:29.613123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.493 [2024-11-20 01:31:29.613150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.493 qpair failed and we were unable to recover it. 00:30:21.493 [2024-11-20 01:31:29.613254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.493 [2024-11-20 01:31:29.613382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.493 [2024-11-20 01:31:29.613409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.493 qpair failed and we were unable to recover it. 00:30:21.493 [2024-11-20 01:31:29.613550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.493 [2024-11-20 01:31:29.613669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.493 [2024-11-20 01:31:29.613694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.493 qpair failed and we were unable to recover it. 00:30:21.493 [2024-11-20 01:31:29.613784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.493 [2024-11-20 01:31:29.613903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.493 [2024-11-20 01:31:29.613927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.493 qpair failed and we were unable to recover it. 00:30:21.493 [2024-11-20 01:31:29.614015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.493 [2024-11-20 01:31:29.614151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.493 [2024-11-20 01:31:29.614192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.493 qpair failed and we were unable to recover it. 00:30:21.493 [2024-11-20 01:31:29.614283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.493 [2024-11-20 01:31:29.614368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.493 [2024-11-20 01:31:29.614392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.493 qpair failed and we were unable to recover it. 00:30:21.493 [2024-11-20 01:31:29.614511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.493 [2024-11-20 01:31:29.614602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.493 [2024-11-20 01:31:29.614643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.493 qpair failed and we were unable to recover it. 00:30:21.493 [2024-11-20 01:31:29.614772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.493 [2024-11-20 01:31:29.614930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.493 [2024-11-20 01:31:29.614957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.493 qpair failed and we were unable to recover it. 00:30:21.493 [2024-11-20 01:31:29.615065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.493 [2024-11-20 01:31:29.615179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.493 [2024-11-20 01:31:29.615204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.493 qpair failed and we were unable to recover it. 00:30:21.493 [2024-11-20 01:31:29.615339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.493 [2024-11-20 01:31:29.615467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.493 [2024-11-20 01:31:29.615494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.493 qpair failed and we were unable to recover it. 00:30:21.493 [2024-11-20 01:31:29.615614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.493 [2024-11-20 01:31:29.615755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.493 [2024-11-20 01:31:29.615779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.493 qpair failed and we were unable to recover it. 00:30:21.493 [2024-11-20 01:31:29.615860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.493 [2024-11-20 01:31:29.615980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.493 [2024-11-20 01:31:29.616006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.493 qpair failed and we were unable to recover it. 00:30:21.493 [2024-11-20 01:31:29.616120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.493 [2024-11-20 01:31:29.616215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.493 [2024-11-20 01:31:29.616242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.493 qpair failed and we were unable to recover it. 00:30:21.493 [2024-11-20 01:31:29.616333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.493 [2024-11-20 01:31:29.616458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.493 [2024-11-20 01:31:29.616500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.493 qpair failed and we were unable to recover it. 00:30:21.493 [2024-11-20 01:31:29.616625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.493 [2024-11-20 01:31:29.616704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.493 [2024-11-20 01:31:29.616728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.493 qpair failed and we were unable to recover it. 00:30:21.493 [2024-11-20 01:31:29.616839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.493 [2024-11-20 01:31:29.616946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.493 [2024-11-20 01:31:29.616974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.493 qpair failed and we were unable to recover it. 00:30:21.493 [2024-11-20 01:31:29.617081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.493 [2024-11-20 01:31:29.617173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.493 [2024-11-20 01:31:29.617216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.493 qpair failed and we were unable to recover it. 00:30:21.493 [2024-11-20 01:31:29.617326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.493 [2024-11-20 01:31:29.617444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.493 [2024-11-20 01:31:29.617469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.493 qpair failed and we were unable to recover it. 00:30:21.493 [2024-11-20 01:31:29.617626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.493 [2024-11-20 01:31:29.617778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.493 [2024-11-20 01:31:29.617803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.493 qpair failed and we were unable to recover it. 00:30:21.493 [2024-11-20 01:31:29.617937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.493 [2024-11-20 01:31:29.618074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.493 [2024-11-20 01:31:29.618104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.493 qpair failed and we were unable to recover it. 00:30:21.493 [2024-11-20 01:31:29.618244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.494 [2024-11-20 01:31:29.618331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.494 [2024-11-20 01:31:29.618355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.494 qpair failed and we were unable to recover it. 00:30:21.494 [2024-11-20 01:31:29.618488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.494 [2024-11-20 01:31:29.618613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.494 [2024-11-20 01:31:29.618641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.494 qpair failed and we were unable to recover it. 00:30:21.494 [2024-11-20 01:31:29.618726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.494 [2024-11-20 01:31:29.618825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.494 [2024-11-20 01:31:29.618854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.494 qpair failed and we were unable to recover it. 00:30:21.494 [2024-11-20 01:31:29.618983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.494 [2024-11-20 01:31:29.619075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.494 [2024-11-20 01:31:29.619101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.494 qpair failed and we were unable to recover it. 00:30:21.494 [2024-11-20 01:31:29.619183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.494 [2024-11-20 01:31:29.619297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.494 [2024-11-20 01:31:29.619339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.494 qpair failed and we were unable to recover it. 00:30:21.494 [2024-11-20 01:31:29.619466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.494 [2024-11-20 01:31:29.619599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.494 [2024-11-20 01:31:29.619626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.494 qpair failed and we were unable to recover it. 00:30:21.494 [2024-11-20 01:31:29.619783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.494 [2024-11-20 01:31:29.619902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.494 [2024-11-20 01:31:29.619928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.494 qpair failed and we were unable to recover it. 00:30:21.494 [2024-11-20 01:31:29.620040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.494 [2024-11-20 01:31:29.620185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.494 [2024-11-20 01:31:29.620210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.494 qpair failed and we were unable to recover it. 00:30:21.494 [2024-11-20 01:31:29.620340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.494 [2024-11-20 01:31:29.620429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.494 [2024-11-20 01:31:29.620456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.494 qpair failed and we were unable to recover it. 00:30:21.494 [2024-11-20 01:31:29.620623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.494 [2024-11-20 01:31:29.620703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.494 [2024-11-20 01:31:29.620728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.494 qpair failed and we were unable to recover it. 00:30:21.494 [2024-11-20 01:31:29.620846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.494 [2024-11-20 01:31:29.620998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.494 [2024-11-20 01:31:29.621026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.494 qpair failed and we were unable to recover it. 00:30:21.494 [2024-11-20 01:31:29.621169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.494 [2024-11-20 01:31:29.621306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.494 [2024-11-20 01:31:29.621333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.494 qpair failed and we were unable to recover it. 00:30:21.494 [2024-11-20 01:31:29.621455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.494 [2024-11-20 01:31:29.621549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.494 [2024-11-20 01:31:29.621574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.494 qpair failed and we were unable to recover it. 00:30:21.494 [2024-11-20 01:31:29.621692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.494 [2024-11-20 01:31:29.621843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.494 [2024-11-20 01:31:29.621868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.494 qpair failed and we were unable to recover it. 00:30:21.494 [2024-11-20 01:31:29.621972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.494 [2024-11-20 01:31:29.622080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.494 [2024-11-20 01:31:29.622123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.494 qpair failed and we were unable to recover it. 00:30:21.494 [2024-11-20 01:31:29.622220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.494 [2024-11-20 01:31:29.622335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.494 [2024-11-20 01:31:29.622361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.494 qpair failed and we were unable to recover it. 00:30:21.494 [2024-11-20 01:31:29.622488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.494 [2024-11-20 01:31:29.622588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.494 [2024-11-20 01:31:29.622615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.494 qpair failed and we were unable to recover it. 00:30:21.494 [2024-11-20 01:31:29.622777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.494 [2024-11-20 01:31:29.622892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.494 [2024-11-20 01:31:29.622918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.494 qpair failed and we were unable to recover it. 00:30:21.494 [2024-11-20 01:31:29.622998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.494 [2024-11-20 01:31:29.623109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.494 [2024-11-20 01:31:29.623135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.494 qpair failed and we were unable to recover it. 00:30:21.494 [2024-11-20 01:31:29.623223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.494 [2024-11-20 01:31:29.623370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.494 [2024-11-20 01:31:29.623395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.494 qpair failed and we were unable to recover it. 00:30:21.494 [2024-11-20 01:31:29.623503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.494 [2024-11-20 01:31:29.623610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.494 [2024-11-20 01:31:29.623635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.494 qpair failed and we were unable to recover it. 00:30:21.494 [2024-11-20 01:31:29.623750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.494 [2024-11-20 01:31:29.623866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.494 [2024-11-20 01:31:29.623895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.494 qpair failed and we were unable to recover it. 00:30:21.494 [2024-11-20 01:31:29.623982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.494 [2024-11-20 01:31:29.624099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.494 [2024-11-20 01:31:29.624124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.494 qpair failed and we were unable to recover it. 00:30:21.494 [2024-11-20 01:31:29.624258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.494 [2024-11-20 01:31:29.624387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.494 [2024-11-20 01:31:29.624414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.494 qpair failed and we were unable to recover it. 00:30:21.494 [2024-11-20 01:31:29.624517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.494 [2024-11-20 01:31:29.624642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.494 [2024-11-20 01:31:29.624666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.494 qpair failed and we were unable to recover it. 00:30:21.494 [2024-11-20 01:31:29.624759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.494 [2024-11-20 01:31:29.624902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.494 [2024-11-20 01:31:29.624930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.494 qpair failed and we were unable to recover it. 00:30:21.494 [2024-11-20 01:31:29.625074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.494 [2024-11-20 01:31:29.625162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.494 [2024-11-20 01:31:29.625187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.494 qpair failed and we were unable to recover it. 00:30:21.494 [2024-11-20 01:31:29.625307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.494 [2024-11-20 01:31:29.625400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.494 [2024-11-20 01:31:29.625424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.494 qpair failed and we were unable to recover it. 00:30:21.494 [2024-11-20 01:31:29.625586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.494 [2024-11-20 01:31:29.625741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.494 [2024-11-20 01:31:29.625768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.495 qpair failed and we were unable to recover it. 00:30:21.495 [2024-11-20 01:31:29.625859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.495 [2024-11-20 01:31:29.625978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.495 [2024-11-20 01:31:29.626005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.495 qpair failed and we were unable to recover it. 00:30:21.495 [2024-11-20 01:31:29.626175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.495 [2024-11-20 01:31:29.626289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.495 [2024-11-20 01:31:29.626313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.495 qpair failed and we were unable to recover it. 00:30:21.495 [2024-11-20 01:31:29.626479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.495 [2024-11-20 01:31:29.626568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.495 [2024-11-20 01:31:29.626616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.495 qpair failed and we were unable to recover it. 00:30:21.495 [2024-11-20 01:31:29.626741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.495 [2024-11-20 01:31:29.626867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.495 [2024-11-20 01:31:29.626894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.495 qpair failed and we were unable to recover it. 00:30:21.495 [2024-11-20 01:31:29.627034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.495 [2024-11-20 01:31:29.627164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.495 [2024-11-20 01:31:29.627190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.495 qpair failed and we were unable to recover it. 00:30:21.495 [2024-11-20 01:31:29.627325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.495 [2024-11-20 01:31:29.627487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.495 [2024-11-20 01:31:29.627514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.495 qpair failed and we were unable to recover it. 00:30:21.495 [2024-11-20 01:31:29.627648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.495 [2024-11-20 01:31:29.627763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.495 [2024-11-20 01:31:29.627788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.495 qpair failed and we were unable to recover it. 00:30:21.495 [2024-11-20 01:31:29.627903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.495 [2024-11-20 01:31:29.627989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.495 [2024-11-20 01:31:29.628014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.495 qpair failed and we were unable to recover it. 00:30:21.495 [2024-11-20 01:31:29.628106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.495 [2024-11-20 01:31:29.628220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.495 [2024-11-20 01:31:29.628245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.495 qpair failed and we were unable to recover it. 00:30:21.495 [2024-11-20 01:31:29.628356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.495 [2024-11-20 01:31:29.628448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.495 [2024-11-20 01:31:29.628475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.495 qpair failed and we were unable to recover it. 00:30:21.495 [2024-11-20 01:31:29.628584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.495 [2024-11-20 01:31:29.628699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.495 [2024-11-20 01:31:29.628723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.495 qpair failed and we were unable to recover it. 00:30:21.495 [2024-11-20 01:31:29.628859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.495 [2024-11-20 01:31:29.629014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.495 [2024-11-20 01:31:29.629042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.495 qpair failed and we were unable to recover it. 00:30:21.495 [2024-11-20 01:31:29.629148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.495 [2024-11-20 01:31:29.629315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.495 [2024-11-20 01:31:29.629357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.495 qpair failed and we were unable to recover it. 00:30:21.495 [2024-11-20 01:31:29.629504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.495 [2024-11-20 01:31:29.629619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.495 [2024-11-20 01:31:29.629644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.495 qpair failed and we were unable to recover it. 00:30:21.495 [2024-11-20 01:31:29.629748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.495 [2024-11-20 01:31:29.629876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.495 [2024-11-20 01:31:29.629903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.495 qpair failed and we were unable to recover it. 00:30:21.495 [2024-11-20 01:31:29.630064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.495 [2024-11-20 01:31:29.630214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.495 [2024-11-20 01:31:29.630239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.495 qpair failed and we were unable to recover it. 00:30:21.495 [2024-11-20 01:31:29.630364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.495 [2024-11-20 01:31:29.630480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.495 [2024-11-20 01:31:29.630504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.495 qpair failed and we were unable to recover it. 00:30:21.495 [2024-11-20 01:31:29.630620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.495 [2024-11-20 01:31:29.630750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.495 [2024-11-20 01:31:29.630777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.495 qpair failed and we were unable to recover it. 00:30:21.495 [2024-11-20 01:31:29.630871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.495 [2024-11-20 01:31:29.631000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.495 [2024-11-20 01:31:29.631028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.495 qpair failed and we were unable to recover it. 00:30:21.495 [2024-11-20 01:31:29.631189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.495 [2024-11-20 01:31:29.631284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.495 [2024-11-20 01:31:29.631310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.495 qpair failed and we were unable to recover it. 00:30:21.495 [2024-11-20 01:31:29.631455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.495 [2024-11-20 01:31:29.631573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.495 [2024-11-20 01:31:29.631597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.495 qpair failed and we were unable to recover it. 00:30:21.495 [2024-11-20 01:31:29.631696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.495 [2024-11-20 01:31:29.631839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.495 [2024-11-20 01:31:29.631865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.495 qpair failed and we were unable to recover it. 00:30:21.495 [2024-11-20 01:31:29.631950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.495 [2024-11-20 01:31:29.632064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.495 [2024-11-20 01:31:29.632106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.495 qpair failed and we were unable to recover it. 00:30:21.495 [2024-11-20 01:31:29.632250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.495 [2024-11-20 01:31:29.632379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.495 [2024-11-20 01:31:29.632403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.495 qpair failed and we were unable to recover it. 00:30:21.495 [2024-11-20 01:31:29.632497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.495 [2024-11-20 01:31:29.632606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.495 [2024-11-20 01:31:29.632630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.495 qpair failed and we were unable to recover it. 00:30:21.495 [2024-11-20 01:31:29.632710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.495 [2024-11-20 01:31:29.632851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.495 [2024-11-20 01:31:29.632876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.495 qpair failed and we were unable to recover it. 00:30:21.495 [2024-11-20 01:31:29.632977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.495 [2024-11-20 01:31:29.633127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.495 [2024-11-20 01:31:29.633155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.495 qpair failed and we were unable to recover it. 00:30:21.495 [2024-11-20 01:31:29.633283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.495 [2024-11-20 01:31:29.633375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.495 [2024-11-20 01:31:29.633402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.496 qpair failed and we were unable to recover it. 00:30:21.496 [2024-11-20 01:31:29.633537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.633630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.633656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.496 qpair failed and we were unable to recover it. 00:30:21.496 [2024-11-20 01:31:29.633747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.633858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.633882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.496 qpair failed and we were unable to recover it. 00:30:21.496 [2024-11-20 01:31:29.633970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.634080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.634108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.496 qpair failed and we were unable to recover it. 00:30:21.496 [2024-11-20 01:31:29.634220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.634305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.634330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.496 qpair failed and we were unable to recover it. 00:30:21.496 [2024-11-20 01:31:29.634445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.634566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.634591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.496 qpair failed and we were unable to recover it. 00:30:21.496 [2024-11-20 01:31:29.634773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.634901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.634930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.496 qpair failed and we were unable to recover it. 00:30:21.496 [2024-11-20 01:31:29.635043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.635208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.635234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.496 qpair failed and we were unable to recover it. 00:30:21.496 [2024-11-20 01:31:29.635376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.635500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.635528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.496 qpair failed and we were unable to recover it. 00:30:21.496 [2024-11-20 01:31:29.635679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.635801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.635828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.496 qpair failed and we were unable to recover it. 00:30:21.496 [2024-11-20 01:31:29.635940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.636059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.636093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.496 qpair failed and we were unable to recover it. 00:30:21.496 [2024-11-20 01:31:29.636196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.636304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.636329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.496 qpair failed and we were unable to recover it. 00:30:21.496 [2024-11-20 01:31:29.636422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.636538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.636563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.496 qpair failed and we were unable to recover it. 00:30:21.496 [2024-11-20 01:31:29.636687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.636773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.636798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.496 qpair failed and we were unable to recover it. 00:30:21.496 [2024-11-20 01:31:29.636922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.637038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.637066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.496 qpair failed and we were unable to recover it. 00:30:21.496 [2024-11-20 01:31:29.637181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.637276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.637302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.496 qpair failed and we were unable to recover it. 00:30:21.496 [2024-11-20 01:31:29.637415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.637509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.637533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.496 qpair failed and we were unable to recover it. 00:30:21.496 [2024-11-20 01:31:29.637628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.637742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.637768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.496 qpair failed and we were unable to recover it. 00:30:21.496 [2024-11-20 01:31:29.637904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.638028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.638056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.496 qpair failed and we were unable to recover it. 00:30:21.496 [2024-11-20 01:31:29.638202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.638324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.638349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.496 qpair failed and we were unable to recover it. 00:30:21.496 [2024-11-20 01:31:29.638491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.638627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.638669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.496 qpair failed and we were unable to recover it. 00:30:21.496 [2024-11-20 01:31:29.638783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.638876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.638901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.496 qpair failed and we were unable to recover it. 00:30:21.496 [2024-11-20 01:31:29.638987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.639084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.639110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.496 qpair failed and we were unable to recover it. 00:30:21.496 [2024-11-20 01:31:29.639196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.639336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.639360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.496 qpair failed and we were unable to recover it. 00:30:21.496 [2024-11-20 01:31:29.639440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.639547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.639591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.496 qpair failed and we were unable to recover it. 00:30:21.496 [2024-11-20 01:31:29.639685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.639828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.639853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.496 qpair failed and we were unable to recover it. 00:30:21.496 [2024-11-20 01:31:29.639969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.640090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.640118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.496 qpair failed and we were unable to recover it. 00:30:21.496 [2024-11-20 01:31:29.640287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.640366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.640390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.496 qpair failed and we were unable to recover it. 00:30:21.496 [2024-11-20 01:31:29.640510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.640625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.640651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.496 qpair failed and we were unable to recover it. 00:30:21.496 [2024-11-20 01:31:29.640747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.640834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.640877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.496 qpair failed and we were unable to recover it. 00:30:21.496 [2024-11-20 01:31:29.640982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.641101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.496 [2024-11-20 01:31:29.641130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.496 qpair failed and we were unable to recover it. 00:30:21.496 [2024-11-20 01:31:29.641309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.497 [2024-11-20 01:31:29.641394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.497 [2024-11-20 01:31:29.641420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.497 qpair failed and we were unable to recover it. 00:30:21.497 [2024-11-20 01:31:29.641589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.782 [2024-11-20 01:31:29.641706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.782 [2024-11-20 01:31:29.641735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.782 qpair failed and we were unable to recover it. 00:30:21.782 [2024-11-20 01:31:29.641868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.782 [2024-11-20 01:31:29.641954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.782 [2024-11-20 01:31:29.641982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.782 qpair failed and we were unable to recover it. 00:30:21.782 [2024-11-20 01:31:29.642104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.782 [2024-11-20 01:31:29.642196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.782 [2024-11-20 01:31:29.642222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.782 qpair failed and we were unable to recover it. 00:30:21.782 [2024-11-20 01:31:29.642337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.782 [2024-11-20 01:31:29.642465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.782 [2024-11-20 01:31:29.642489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.782 qpair failed and we were unable to recover it. 00:30:21.782 [2024-11-20 01:31:29.642653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.782 [2024-11-20 01:31:29.642797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.782 [2024-11-20 01:31:29.642822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.782 qpair failed and we were unable to recover it. 00:30:21.782 [2024-11-20 01:31:29.642942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.782 [2024-11-20 01:31:29.643095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.782 [2024-11-20 01:31:29.643121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.782 qpair failed and we were unable to recover it. 00:30:21.782 [2024-11-20 01:31:29.643276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.782 [2024-11-20 01:31:29.643391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.782 [2024-11-20 01:31:29.643415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.782 qpair failed and we were unable to recover it. 00:30:21.782 [2024-11-20 01:31:29.643533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.782 [2024-11-20 01:31:29.643706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.782 [2024-11-20 01:31:29.643733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.782 qpair failed and we were unable to recover it. 00:30:21.782 [2024-11-20 01:31:29.643866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.782 [2024-11-20 01:31:29.643958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.782 [2024-11-20 01:31:29.643983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.782 qpair failed and we were unable to recover it. 00:30:21.782 [2024-11-20 01:31:29.644094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.782 [2024-11-20 01:31:29.644263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.782 [2024-11-20 01:31:29.644287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.782 qpair failed and we were unable to recover it. 00:30:21.782 [2024-11-20 01:31:29.644377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.782 [2024-11-20 01:31:29.644493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.782 [2024-11-20 01:31:29.644519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.782 qpair failed and we were unable to recover it. 00:30:21.782 [2024-11-20 01:31:29.644611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.782 [2024-11-20 01:31:29.644753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.782 [2024-11-20 01:31:29.644778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.782 qpair failed and we were unable to recover it. 00:30:21.782 [2024-11-20 01:31:29.644864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.782 [2024-11-20 01:31:29.644970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.782 [2024-11-20 01:31:29.644999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.782 qpair failed and we were unable to recover it. 00:30:21.782 [2024-11-20 01:31:29.645109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.782 [2024-11-20 01:31:29.645203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.782 [2024-11-20 01:31:29.645246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.782 qpair failed and we were unable to recover it. 00:30:21.782 [2024-11-20 01:31:29.645344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.782 [2024-11-20 01:31:29.645457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.782 [2024-11-20 01:31:29.645482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.782 qpair failed and we were unable to recover it. 00:30:21.782 [2024-11-20 01:31:29.645595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.782 [2024-11-20 01:31:29.645708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.782 [2024-11-20 01:31:29.645732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.782 qpair failed and we were unable to recover it. 00:30:21.782 [2024-11-20 01:31:29.645834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.782 [2024-11-20 01:31:29.645977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.782 [2024-11-20 01:31:29.646002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.782 qpair failed and we were unable to recover it. 00:30:21.782 [2024-11-20 01:31:29.646117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.782 [2024-11-20 01:31:29.646205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.782 [2024-11-20 01:31:29.646229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.782 qpair failed and we were unable to recover it. 00:30:21.782 [2024-11-20 01:31:29.646373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.782 [2024-11-20 01:31:29.646472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.782 [2024-11-20 01:31:29.646500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.782 qpair failed and we were unable to recover it. 00:30:21.782 [2024-11-20 01:31:29.646586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.782 [2024-11-20 01:31:29.646712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.782 [2024-11-20 01:31:29.646739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.782 qpair failed and we were unable to recover it. 00:30:21.782 [2024-11-20 01:31:29.646864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.782 [2024-11-20 01:31:29.646952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.782 [2024-11-20 01:31:29.646977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.782 qpair failed and we were unable to recover it. 00:30:21.782 [2024-11-20 01:31:29.647102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.782 [2024-11-20 01:31:29.647285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.782 [2024-11-20 01:31:29.647310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.782 qpair failed and we were unable to recover it. 00:30:21.782 [2024-11-20 01:31:29.647430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.782 [2024-11-20 01:31:29.647559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.782 [2024-11-20 01:31:29.647587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.782 qpair failed and we were unable to recover it. 00:30:21.782 [2024-11-20 01:31:29.647715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.782 [2024-11-20 01:31:29.647797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.783 [2024-11-20 01:31:29.647822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.783 qpair failed and we were unable to recover it. 00:30:21.783 [2024-11-20 01:31:29.647983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.783 [2024-11-20 01:31:29.648142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.783 [2024-11-20 01:31:29.648170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.783 qpair failed and we were unable to recover it. 00:30:21.783 [2024-11-20 01:31:29.648261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.783 [2024-11-20 01:31:29.648404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.783 [2024-11-20 01:31:29.648432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.783 qpair failed and we were unable to recover it. 00:30:21.783 [2024-11-20 01:31:29.648601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.783 [2024-11-20 01:31:29.648687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.783 [2024-11-20 01:31:29.648712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.783 qpair failed and we were unable to recover it. 00:30:21.783 [2024-11-20 01:31:29.648814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.783 [2024-11-20 01:31:29.648927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.783 [2024-11-20 01:31:29.648952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.783 qpair failed and we were unable to recover it. 00:30:21.783 [2024-11-20 01:31:29.649038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.783 [2024-11-20 01:31:29.649157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.783 [2024-11-20 01:31:29.649182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.783 qpair failed and we were unable to recover it. 00:30:21.783 [2024-11-20 01:31:29.649280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.783 [2024-11-20 01:31:29.649397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.783 [2024-11-20 01:31:29.649422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.783 qpair failed and we were unable to recover it. 00:30:21.783 [2024-11-20 01:31:29.649533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.783 [2024-11-20 01:31:29.649656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.783 [2024-11-20 01:31:29.649680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.783 qpair failed and we were unable to recover it. 00:30:21.783 [2024-11-20 01:31:29.649787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.783 [2024-11-20 01:31:29.649875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.783 [2024-11-20 01:31:29.649901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.783 qpair failed and we were unable to recover it. 00:30:21.783 [2024-11-20 01:31:29.649997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.783 [2024-11-20 01:31:29.650087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.783 [2024-11-20 01:31:29.650114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.783 qpair failed and we were unable to recover it. 00:30:21.783 [2024-11-20 01:31:29.650238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.783 [2024-11-20 01:31:29.650352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.783 [2024-11-20 01:31:29.650376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.783 qpair failed and we were unable to recover it. 00:30:21.783 [2024-11-20 01:31:29.650531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.783 [2024-11-20 01:31:29.650712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.783 [2024-11-20 01:31:29.650741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.783 qpair failed and we were unable to recover it. 00:30:21.783 [2024-11-20 01:31:29.650890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.783 [2024-11-20 01:31:29.651032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.783 [2024-11-20 01:31:29.651084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.783 qpair failed and we were unable to recover it. 00:30:21.783 [2024-11-20 01:31:29.651223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.783 [2024-11-20 01:31:29.651350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.783 [2024-11-20 01:31:29.651378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.783 qpair failed and we were unable to recover it. 00:30:21.783 [2024-11-20 01:31:29.651472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.783 [2024-11-20 01:31:29.651568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.783 [2024-11-20 01:31:29.651596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.783 qpair failed and we were unable to recover it. 00:30:21.783 [2024-11-20 01:31:29.651704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.783 [2024-11-20 01:31:29.651849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.783 [2024-11-20 01:31:29.651875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.783 qpair failed and we were unable to recover it. 00:30:21.783 [2024-11-20 01:31:29.652046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.783 [2024-11-20 01:31:29.652209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.783 [2024-11-20 01:31:29.652237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.783 qpair failed and we were unable to recover it. 00:30:21.783 [2024-11-20 01:31:29.652366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.783 [2024-11-20 01:31:29.652525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.783 [2024-11-20 01:31:29.652553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.783 qpair failed and we were unable to recover it. 00:30:21.783 [2024-11-20 01:31:29.652690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.783 [2024-11-20 01:31:29.652802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.783 [2024-11-20 01:31:29.652828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.783 qpair failed and we were unable to recover it. 00:30:21.783 [2024-11-20 01:31:29.652946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.783 [2024-11-20 01:31:29.653045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.783 [2024-11-20 01:31:29.653082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.783 qpair failed and we were unable to recover it. 00:30:21.783 [2024-11-20 01:31:29.653229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.783 [2024-11-20 01:31:29.653320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.783 [2024-11-20 01:31:29.653346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.783 qpair failed and we were unable to recover it. 00:30:21.783 [2024-11-20 01:31:29.653438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.783 [2024-11-20 01:31:29.653557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.783 [2024-11-20 01:31:29.653583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.783 qpair failed and we were unable to recover it. 00:30:21.783 [2024-11-20 01:31:29.653683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.783 [2024-11-20 01:31:29.653809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.783 [2024-11-20 01:31:29.653837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.783 qpair failed and we were unable to recover it. 00:30:21.783 [2024-11-20 01:31:29.653994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.783 [2024-11-20 01:31:29.654124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.783 [2024-11-20 01:31:29.654153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.783 qpair failed and we were unable to recover it. 00:30:21.783 [2024-11-20 01:31:29.654287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.783 [2024-11-20 01:31:29.654382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.783 [2024-11-20 01:31:29.654407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.783 qpair failed and we were unable to recover it. 00:30:21.783 [2024-11-20 01:31:29.654518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.783 [2024-11-20 01:31:29.654609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.783 [2024-11-20 01:31:29.654633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.783 qpair failed and we were unable to recover it. 00:30:21.783 [2024-11-20 01:31:29.654743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.783 [2024-11-20 01:31:29.654838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.783 [2024-11-20 01:31:29.654866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.783 qpair failed and we were unable to recover it. 00:30:21.783 [2024-11-20 01:31:29.655001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.783 [2024-11-20 01:31:29.655122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.783 [2024-11-20 01:31:29.655148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.783 qpair failed and we were unable to recover it. 00:30:21.783 [2024-11-20 01:31:29.655261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.783 [2024-11-20 01:31:29.655427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.783 [2024-11-20 01:31:29.655455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.784 qpair failed and we were unable to recover it. 00:30:21.784 [2024-11-20 01:31:29.655554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.784 [2024-11-20 01:31:29.655653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.784 [2024-11-20 01:31:29.655682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.784 qpair failed and we were unable to recover it. 00:30:21.784 [2024-11-20 01:31:29.655848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.784 [2024-11-20 01:31:29.655961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.784 [2024-11-20 01:31:29.655986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.784 qpair failed and we were unable to recover it. 00:30:21.784 [2024-11-20 01:31:29.656112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.784 [2024-11-20 01:31:29.656242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.784 [2024-11-20 01:31:29.656270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.784 qpair failed and we were unable to recover it. 00:30:21.784 [2024-11-20 01:31:29.656363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.784 [2024-11-20 01:31:29.656543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.784 [2024-11-20 01:31:29.656568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.784 qpair failed and we were unable to recover it. 00:30:21.784 [2024-11-20 01:31:29.656686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.784 [2024-11-20 01:31:29.656780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.784 [2024-11-20 01:31:29.656806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.784 qpair failed and we were unable to recover it. 00:30:21.784 [2024-11-20 01:31:29.656923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.784 [2024-11-20 01:31:29.657039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.784 [2024-11-20 01:31:29.657064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.784 qpair failed and we were unable to recover it. 00:30:21.784 [2024-11-20 01:31:29.657171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.784 [2024-11-20 01:31:29.657304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.784 [2024-11-20 01:31:29.657332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.784 qpair failed and we were unable to recover it. 00:30:21.784 [2024-11-20 01:31:29.657464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.784 [2024-11-20 01:31:29.657584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.784 [2024-11-20 01:31:29.657610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.784 qpair failed and we were unable to recover it. 00:30:21.784 [2024-11-20 01:31:29.657806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.784 [2024-11-20 01:31:29.657921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.784 [2024-11-20 01:31:29.657946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.784 qpair failed and we were unable to recover it. 00:30:21.784 [2024-11-20 01:31:29.658110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.784 [2024-11-20 01:31:29.658238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.784 [2024-11-20 01:31:29.658267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.784 qpair failed and we were unable to recover it. 00:30:21.784 [2024-11-20 01:31:29.658430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.784 [2024-11-20 01:31:29.658550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.784 [2024-11-20 01:31:29.658575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.784 qpair failed and we were unable to recover it. 00:30:21.784 [2024-11-20 01:31:29.658688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.784 [2024-11-20 01:31:29.658805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.784 [2024-11-20 01:31:29.658849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.784 qpair failed and we were unable to recover it. 00:30:21.784 [2024-11-20 01:31:29.658948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.784 [2024-11-20 01:31:29.659050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.784 [2024-11-20 01:31:29.659090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.784 qpair failed and we were unable to recover it. 00:30:21.784 [2024-11-20 01:31:29.659201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.784 [2024-11-20 01:31:29.659299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.784 [2024-11-20 01:31:29.659324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.784 qpair failed and we were unable to recover it. 00:30:21.784 [2024-11-20 01:31:29.659464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.784 [2024-11-20 01:31:29.659549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.784 [2024-11-20 01:31:29.659592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.784 qpair failed and we were unable to recover it. 00:30:21.784 [2024-11-20 01:31:29.659720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.784 [2024-11-20 01:31:29.659874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.784 [2024-11-20 01:31:29.659901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.784 qpair failed and we were unable to recover it. 00:30:21.784 [2024-11-20 01:31:29.660042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.784 [2024-11-20 01:31:29.660187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.784 [2024-11-20 01:31:29.660213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.784 qpair failed and we were unable to recover it. 00:30:21.784 [2024-11-20 01:31:29.660354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.784 [2024-11-20 01:31:29.660480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.784 [2024-11-20 01:31:29.660505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.784 qpair failed and we were unable to recover it. 00:30:21.784 [2024-11-20 01:31:29.660616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.784 [2024-11-20 01:31:29.660764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.784 [2024-11-20 01:31:29.660789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.784 qpair failed and we were unable to recover it. 00:30:21.784 [2024-11-20 01:31:29.660872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.784 [2024-11-20 01:31:29.660985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.784 [2024-11-20 01:31:29.661010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.784 qpair failed and we were unable to recover it. 00:30:21.784 [2024-11-20 01:31:29.661131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.784 [2024-11-20 01:31:29.661275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.784 [2024-11-20 01:31:29.661300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.784 qpair failed and we were unable to recover it. 00:30:21.784 [2024-11-20 01:31:29.661431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.784 [2024-11-20 01:31:29.661532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.784 [2024-11-20 01:31:29.661559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.784 qpair failed and we were unable to recover it. 00:30:21.784 [2024-11-20 01:31:29.661668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.784 [2024-11-20 01:31:29.661765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.784 [2024-11-20 01:31:29.661791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.784 qpair failed and we were unable to recover it. 00:30:21.784 [2024-11-20 01:31:29.661951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.784 [2024-11-20 01:31:29.662115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.784 [2024-11-20 01:31:29.662141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.784 qpair failed and we were unable to recover it. 00:30:21.784 [2024-11-20 01:31:29.662263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.784 [2024-11-20 01:31:29.662347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.784 [2024-11-20 01:31:29.662390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.784 qpair failed and we were unable to recover it. 00:30:21.784 [2024-11-20 01:31:29.662505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.784 [2024-11-20 01:31:29.662597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.784 [2024-11-20 01:31:29.662623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.784 qpair failed and we were unable to recover it. 00:30:21.784 [2024-11-20 01:31:29.662702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.784 [2024-11-20 01:31:29.662846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.784 [2024-11-20 01:31:29.662871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:21.784 qpair failed and we were unable to recover it. 00:30:21.784 [2024-11-20 01:31:29.662994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.784 [2024-11-20 01:31:29.663115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.784 [2024-11-20 01:31:29.663142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.784 qpair failed and we were unable to recover it. 00:30:21.785 [2024-11-20 01:31:29.663287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.785 [2024-11-20 01:31:29.663379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.785 [2024-11-20 01:31:29.663404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.785 qpair failed and we were unable to recover it. 00:30:21.785 [2024-11-20 01:31:29.663502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.785 [2024-11-20 01:31:29.663639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.785 [2024-11-20 01:31:29.663664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.785 qpair failed and we were unable to recover it. 00:30:21.785 [2024-11-20 01:31:29.663778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.785 [2024-11-20 01:31:29.663862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.785 [2024-11-20 01:31:29.663905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.785 qpair failed and we were unable to recover it. 00:30:21.785 [2024-11-20 01:31:29.664039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.785 [2024-11-20 01:31:29.664187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.785 [2024-11-20 01:31:29.664213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.785 qpair failed and we were unable to recover it. 00:30:21.785 [2024-11-20 01:31:29.664321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.785 [2024-11-20 01:31:29.664417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.785 [2024-11-20 01:31:29.664450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.785 qpair failed and we were unable to recover it. 00:30:21.785 [2024-11-20 01:31:29.664543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.785 [2024-11-20 01:31:29.664638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.785 [2024-11-20 01:31:29.664682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.785 qpair failed and we were unable to recover it. 00:30:21.785 [2024-11-20 01:31:29.664830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.785 [2024-11-20 01:31:29.664922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.785 [2024-11-20 01:31:29.664947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.785 qpair failed and we were unable to recover it. 00:30:21.785 [2024-11-20 01:31:29.665049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.785 [2024-11-20 01:31:29.665149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.785 [2024-11-20 01:31:29.665176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.785 qpair failed and we were unable to recover it. 00:30:21.785 [2024-11-20 01:31:29.665271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.785 [2024-11-20 01:31:29.665400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.785 [2024-11-20 01:31:29.665427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.785 qpair failed and we were unable to recover it. 00:30:21.785 [2024-11-20 01:31:29.665538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.785 [2024-11-20 01:31:29.665656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.785 [2024-11-20 01:31:29.665682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.785 qpair failed and we were unable to recover it. 00:30:21.785 [2024-11-20 01:31:29.665780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.785 [2024-11-20 01:31:29.665934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.785 [2024-11-20 01:31:29.665961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.785 qpair failed and we were unable to recover it. 00:30:21.785 [2024-11-20 01:31:29.666092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.785 [2024-11-20 01:31:29.666199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.785 [2024-11-20 01:31:29.666227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.785 qpair failed and we were unable to recover it. 00:30:21.785 [2024-11-20 01:31:29.666346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.785 [2024-11-20 01:31:29.666491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.785 [2024-11-20 01:31:29.666516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.785 qpair failed and we were unable to recover it. 00:30:21.785 [2024-11-20 01:31:29.666651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.785 [2024-11-20 01:31:29.666743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.785 [2024-11-20 01:31:29.666787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.785 qpair failed and we were unable to recover it. 00:30:21.785 [2024-11-20 01:31:29.666873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.785 [2024-11-20 01:31:29.666987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.785 [2024-11-20 01:31:29.667016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.785 qpair failed and we were unable to recover it. 00:30:21.785 [2024-11-20 01:31:29.667199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.785 [2024-11-20 01:31:29.667320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.785 [2024-11-20 01:31:29.667345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.785 qpair failed and we were unable to recover it. 00:30:21.785 [2024-11-20 01:31:29.667432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.785 [2024-11-20 01:31:29.667520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.785 [2024-11-20 01:31:29.667565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.785 qpair failed and we were unable to recover it. 00:30:21.785 [2024-11-20 01:31:29.667695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.785 [2024-11-20 01:31:29.667848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.785 [2024-11-20 01:31:29.667875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.785 qpair failed and we were unable to recover it. 00:30:21.785 [2024-11-20 01:31:29.667992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.785 [2024-11-20 01:31:29.668131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.785 [2024-11-20 01:31:29.668157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.785 qpair failed and we were unable to recover it. 00:30:21.785 [2024-11-20 01:31:29.668240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.785 [2024-11-20 01:31:29.668358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.785 [2024-11-20 01:31:29.668386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.785 qpair failed and we were unable to recover it. 00:30:21.785 [2024-11-20 01:31:29.668488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.785 [2024-11-20 01:31:29.668624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.785 [2024-11-20 01:31:29.668650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.785 qpair failed and we were unable to recover it. 00:30:21.785 [2024-11-20 01:31:29.668795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.785 [2024-11-20 01:31:29.668910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.785 [2024-11-20 01:31:29.668936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.785 qpair failed and we were unable to recover it. 00:30:21.785 [2024-11-20 01:31:29.669048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.785 [2024-11-20 01:31:29.669141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.785 [2024-11-20 01:31:29.669185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.785 qpair failed and we were unable to recover it. 00:30:21.785 [2024-11-20 01:31:29.669310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.785 [2024-11-20 01:31:29.669416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.785 [2024-11-20 01:31:29.669442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.785 qpair failed and we were unable to recover it. 00:30:21.785 [2024-11-20 01:31:29.669553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.785 [2024-11-20 01:31:29.669669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.785 [2024-11-20 01:31:29.669699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.785 qpair failed and we were unable to recover it. 00:30:21.785 [2024-11-20 01:31:29.669782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.785 [2024-11-20 01:31:29.669868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.785 [2024-11-20 01:31:29.669894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.785 qpair failed and we were unable to recover it. 00:30:21.785 [2024-11-20 01:31:29.669978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.785 [2024-11-20 01:31:29.670093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.785 [2024-11-20 01:31:29.670137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.785 qpair failed and we were unable to recover it. 00:30:21.785 [2024-11-20 01:31:29.670301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.785 [2024-11-20 01:31:29.670398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.785 [2024-11-20 01:31:29.670424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.785 qpair failed and we were unable to recover it. 00:30:21.785 [2024-11-20 01:31:29.670577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.786 [2024-11-20 01:31:29.670660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.786 [2024-11-20 01:31:29.670703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.786 qpair failed and we were unable to recover it. 00:30:21.786 [2024-11-20 01:31:29.670872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.786 [2024-11-20 01:31:29.670990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.786 [2024-11-20 01:31:29.671014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.786 qpair failed and we were unable to recover it. 00:30:21.786 [2024-11-20 01:31:29.671159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.786 [2024-11-20 01:31:29.671253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.786 [2024-11-20 01:31:29.671279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.786 qpair failed and we were unable to recover it. 00:30:21.786 [2024-11-20 01:31:29.671393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.786 [2024-11-20 01:31:29.671480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.786 [2024-11-20 01:31:29.671508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.786 qpair failed and we were unable to recover it. 00:30:21.786 [2024-11-20 01:31:29.671635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.786 [2024-11-20 01:31:29.671761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.786 [2024-11-20 01:31:29.671788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.786 qpair failed and we were unable to recover it. 00:30:21.786 [2024-11-20 01:31:29.671914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.786 [2024-11-20 01:31:29.672027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.786 [2024-11-20 01:31:29.672053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.786 qpair failed and we were unable to recover it. 00:30:21.786 [2024-11-20 01:31:29.672152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.786 [2024-11-20 01:31:29.672298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.786 [2024-11-20 01:31:29.672331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.786 qpair failed and we were unable to recover it. 00:30:21.786 [2024-11-20 01:31:29.672429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.786 [2024-11-20 01:31:29.672531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.786 [2024-11-20 01:31:29.672575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.786 qpair failed and we were unable to recover it. 00:30:21.786 [2024-11-20 01:31:29.672664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.786 [2024-11-20 01:31:29.672786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.786 [2024-11-20 01:31:29.672811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.786 qpair failed and we were unable to recover it. 00:30:21.786 [2024-11-20 01:31:29.672909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.786 [2024-11-20 01:31:29.673030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.786 [2024-11-20 01:31:29.673057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.786 qpair failed and we were unable to recover it. 00:30:21.786 [2024-11-20 01:31:29.673162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.786 [2024-11-20 01:31:29.673297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.786 [2024-11-20 01:31:29.673322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.786 qpair failed and we were unable to recover it. 00:30:21.786 [2024-11-20 01:31:29.673437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.786 [2024-11-20 01:31:29.673555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.786 [2024-11-20 01:31:29.673580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.786 qpair failed and we were unable to recover it. 00:30:21.786 [2024-11-20 01:31:29.673703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.786 [2024-11-20 01:31:29.673822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.786 [2024-11-20 01:31:29.673846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.786 qpair failed and we were unable to recover it. 00:30:21.786 [2024-11-20 01:31:29.673980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.786 [2024-11-20 01:31:29.674136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.786 [2024-11-20 01:31:29.674164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.786 qpair failed and we were unable to recover it. 00:30:21.786 [2024-11-20 01:31:29.674271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.786 [2024-11-20 01:31:29.674394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.786 [2024-11-20 01:31:29.674420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.786 qpair failed and we were unable to recover it. 00:30:21.786 [2024-11-20 01:31:29.674507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.786 [2024-11-20 01:31:29.674668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.786 [2024-11-20 01:31:29.674696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.786 qpair failed and we were unable to recover it. 00:30:21.786 [2024-11-20 01:31:29.674826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.786 [2024-11-20 01:31:29.674919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.786 [2024-11-20 01:31:29.674946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.786 qpair failed and we were unable to recover it. 00:30:21.786 [2024-11-20 01:31:29.675092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.786 [2024-11-20 01:31:29.675180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.786 [2024-11-20 01:31:29.675205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.786 qpair failed and we were unable to recover it. 00:30:21.786 [2024-11-20 01:31:29.675314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.786 [2024-11-20 01:31:29.675471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.786 [2024-11-20 01:31:29.675498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.786 qpair failed and we were unable to recover it. 00:30:21.786 [2024-11-20 01:31:29.675641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.786 [2024-11-20 01:31:29.675757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.786 [2024-11-20 01:31:29.675782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.786 qpair failed and we were unable to recover it. 00:30:21.786 [2024-11-20 01:31:29.675900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.786 [2024-11-20 01:31:29.676018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.786 [2024-11-20 01:31:29.676043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.786 qpair failed and we were unable to recover it. 00:30:21.786 [2024-11-20 01:31:29.676167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.786 [2024-11-20 01:31:29.676250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.786 [2024-11-20 01:31:29.676275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.786 qpair failed and we were unable to recover it. 00:30:21.786 [2024-11-20 01:31:29.676392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.786 [2024-11-20 01:31:29.676509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.786 [2024-11-20 01:31:29.676537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.786 qpair failed and we were unable to recover it. 00:30:21.786 [2024-11-20 01:31:29.676653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.786 [2024-11-20 01:31:29.676764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.786 [2024-11-20 01:31:29.676789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.786 qpair failed and we were unable to recover it. 00:30:21.787 [2024-11-20 01:31:29.676939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.787 [2024-11-20 01:31:29.677051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.787 [2024-11-20 01:31:29.677084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.787 qpair failed and we were unable to recover it. 00:30:21.787 [2024-11-20 01:31:29.677230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.787 [2024-11-20 01:31:29.677351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.787 [2024-11-20 01:31:29.677376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.787 qpair failed and we were unable to recover it. 00:30:21.787 [2024-11-20 01:31:29.677495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.787 [2024-11-20 01:31:29.677612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.787 [2024-11-20 01:31:29.677637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.787 qpair failed and we were unable to recover it. 00:30:21.787 [2024-11-20 01:31:29.677789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.787 [2024-11-20 01:31:29.677917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.787 [2024-11-20 01:31:29.677946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.787 qpair failed and we were unable to recover it. 00:30:21.787 [2024-11-20 01:31:29.678051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.787 [2024-11-20 01:31:29.678185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.787 [2024-11-20 01:31:29.678226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.787 qpair failed and we were unable to recover it. 00:30:21.787 [2024-11-20 01:31:29.678340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.787 [2024-11-20 01:31:29.678478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.787 [2024-11-20 01:31:29.678503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.787 qpair failed and we were unable to recover it. 00:30:21.787 [2024-11-20 01:31:29.678642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.787 [2024-11-20 01:31:29.678771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.787 [2024-11-20 01:31:29.678798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.787 qpair failed and we were unable to recover it. 00:30:21.787 [2024-11-20 01:31:29.678919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.787 [2024-11-20 01:31:29.679045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.787 [2024-11-20 01:31:29.679095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.787 qpair failed and we were unable to recover it. 00:30:21.787 [2024-11-20 01:31:29.679215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.787 [2024-11-20 01:31:29.679326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.787 [2024-11-20 01:31:29.679350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.787 qpair failed and we were unable to recover it. 00:30:21.787 [2024-11-20 01:31:29.679490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.787 [2024-11-20 01:31:29.679592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.787 [2024-11-20 01:31:29.679616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.787 qpair failed and we were unable to recover it. 00:30:21.787 [2024-11-20 01:31:29.679742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.787 [2024-11-20 01:31:29.679832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.787 [2024-11-20 01:31:29.679873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.787 qpair failed and we were unable to recover it. 00:30:21.787 [2024-11-20 01:31:29.679977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.787 [2024-11-20 01:31:29.680128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.787 [2024-11-20 01:31:29.680154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.787 qpair failed and we were unable to recover it. 00:30:21.787 [2024-11-20 01:31:29.680303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.787 [2024-11-20 01:31:29.680416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.787 [2024-11-20 01:31:29.680441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.787 qpair failed and we were unable to recover it. 00:30:21.787 [2024-11-20 01:31:29.680535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.787 [2024-11-20 01:31:29.680655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.787 [2024-11-20 01:31:29.680681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.787 qpair failed and we were unable to recover it. 00:30:21.787 [2024-11-20 01:31:29.680822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.787 [2024-11-20 01:31:29.680943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.787 [2024-11-20 01:31:29.680967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.787 qpair failed and we were unable to recover it. 00:30:21.787 [2024-11-20 01:31:29.681148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.787 [2024-11-20 01:31:29.681268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.787 [2024-11-20 01:31:29.681295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.787 qpair failed and we were unable to recover it. 00:30:21.787 [2024-11-20 01:31:29.681432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.787 [2024-11-20 01:31:29.681585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.787 [2024-11-20 01:31:29.681613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.787 qpair failed and we were unable to recover it. 00:30:21.787 [2024-11-20 01:31:29.681759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.787 [2024-11-20 01:31:29.681906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.787 [2024-11-20 01:31:29.681931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.787 qpair failed and we were unable to recover it. 00:30:21.787 [2024-11-20 01:31:29.682057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.787 [2024-11-20 01:31:29.682182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.787 [2024-11-20 01:31:29.682207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.787 qpair failed and we were unable to recover it. 00:30:21.787 [2024-11-20 01:31:29.682352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.787 [2024-11-20 01:31:29.682445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.787 [2024-11-20 01:31:29.682489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.787 qpair failed and we were unable to recover it. 00:30:21.787 [2024-11-20 01:31:29.682602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.787 [2024-11-20 01:31:29.682720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.787 [2024-11-20 01:31:29.682746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.787 qpair failed and we were unable to recover it. 00:30:21.787 [2024-11-20 01:31:29.682893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.787 [2024-11-20 01:31:29.682992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.787 [2024-11-20 01:31:29.683035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.787 qpair failed and we were unable to recover it. 00:30:21.787 [2024-11-20 01:31:29.683161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.787 [2024-11-20 01:31:29.683277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.787 [2024-11-20 01:31:29.683301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.787 qpair failed and we were unable to recover it. 00:30:21.787 [2024-11-20 01:31:29.683453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.787 [2024-11-20 01:31:29.683562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.787 [2024-11-20 01:31:29.683587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.787 qpair failed and we were unable to recover it. 00:30:21.787 [2024-11-20 01:31:29.683745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.787 [2024-11-20 01:31:29.683840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.787 [2024-11-20 01:31:29.683866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.787 qpair failed and we were unable to recover it. 00:30:21.787 [2024-11-20 01:31:29.683996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.787 [2024-11-20 01:31:29.684125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.787 [2024-11-20 01:31:29.684154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.787 qpair failed and we were unable to recover it. 00:30:21.787 [2024-11-20 01:31:29.684264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.787 [2024-11-20 01:31:29.684346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.787 [2024-11-20 01:31:29.684371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.787 qpair failed and we were unable to recover it. 00:30:21.787 [2024-11-20 01:31:29.684531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.787 [2024-11-20 01:31:29.684663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.787 [2024-11-20 01:31:29.684691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.787 qpair failed and we were unable to recover it. 00:30:21.787 [2024-11-20 01:31:29.684843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.788 [2024-11-20 01:31:29.684967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.788 [2024-11-20 01:31:29.684995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.788 qpair failed and we were unable to recover it. 00:30:21.788 [2024-11-20 01:31:29.685104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.788 [2024-11-20 01:31:29.685199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.788 [2024-11-20 01:31:29.685225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.788 qpair failed and we were unable to recover it. 00:30:21.788 [2024-11-20 01:31:29.685386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.788 [2024-11-20 01:31:29.685484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.788 [2024-11-20 01:31:29.685511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.788 qpair failed and we were unable to recover it. 00:30:21.788 [2024-11-20 01:31:29.685652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.788 [2024-11-20 01:31:29.685781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.788 [2024-11-20 01:31:29.685806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.788 qpair failed and we were unable to recover it. 00:30:21.788 [2024-11-20 01:31:29.685894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.788 [2024-11-20 01:31:29.686007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.788 [2024-11-20 01:31:29.686031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.788 qpair failed and we were unable to recover it. 00:30:21.788 [2024-11-20 01:31:29.686235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.788 [2024-11-20 01:31:29.686401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.788 [2024-11-20 01:31:29.686429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.788 qpair failed and we were unable to recover it. 00:30:21.788 [2024-11-20 01:31:29.686529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.788 [2024-11-20 01:31:29.686662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.788 [2024-11-20 01:31:29.686690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.788 qpair failed and we were unable to recover it. 00:30:21.788 [2024-11-20 01:31:29.686809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.788 [2024-11-20 01:31:29.686930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.788 [2024-11-20 01:31:29.686954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.788 qpair failed and we were unable to recover it. 00:30:21.788 [2024-11-20 01:31:29.687048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.788 [2024-11-20 01:31:29.687155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.788 [2024-11-20 01:31:29.687180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.788 qpair failed and we were unable to recover it. 00:30:21.788 [2024-11-20 01:31:29.687348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.788 [2024-11-20 01:31:29.687469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.788 [2024-11-20 01:31:29.687497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.788 qpair failed and we were unable to recover it. 00:30:21.788 [2024-11-20 01:31:29.687633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.788 [2024-11-20 01:31:29.687825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.788 [2024-11-20 01:31:29.687867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.788 qpair failed and we were unable to recover it. 00:30:21.788 [2024-11-20 01:31:29.688018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.788 [2024-11-20 01:31:29.688158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.788 [2024-11-20 01:31:29.688184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.788 qpair failed and we were unable to recover it. 00:30:21.788 [2024-11-20 01:31:29.688300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.788 [2024-11-20 01:31:29.688435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.788 [2024-11-20 01:31:29.688463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.788 qpair failed and we were unable to recover it. 00:30:21.788 [2024-11-20 01:31:29.688606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.788 [2024-11-20 01:31:29.688731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.788 [2024-11-20 01:31:29.688755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.788 qpair failed and we were unable to recover it. 00:30:21.788 [2024-11-20 01:31:29.688872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.788 [2024-11-20 01:31:29.689007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.788 [2024-11-20 01:31:29.689034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.788 qpair failed and we were unable to recover it. 00:30:21.788 [2024-11-20 01:31:29.689182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.788 [2024-11-20 01:31:29.689328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.788 [2024-11-20 01:31:29.689353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.788 qpair failed and we were unable to recover it. 00:30:21.788 [2024-11-20 01:31:29.689438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.788 [2024-11-20 01:31:29.689556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.788 [2024-11-20 01:31:29.689582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.788 qpair failed and we were unable to recover it. 00:30:21.788 [2024-11-20 01:31:29.689702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.788 [2024-11-20 01:31:29.689831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.788 [2024-11-20 01:31:29.689860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.788 qpair failed and we were unable to recover it. 00:30:21.788 [2024-11-20 01:31:29.689965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.788 [2024-11-20 01:31:29.690059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.788 [2024-11-20 01:31:29.690095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.788 qpair failed and we were unable to recover it. 00:30:21.788 [2024-11-20 01:31:29.690228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.788 [2024-11-20 01:31:29.690320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.788 [2024-11-20 01:31:29.690345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.788 qpair failed and we were unable to recover it. 00:30:21.788 [2024-11-20 01:31:29.690433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.788 [2024-11-20 01:31:29.690549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.788 [2024-11-20 01:31:29.690574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.788 qpair failed and we were unable to recover it. 00:30:21.788 [2024-11-20 01:31:29.690667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.788 [2024-11-20 01:31:29.690751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.788 [2024-11-20 01:31:29.690775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.788 qpair failed and we were unable to recover it. 00:30:21.788 [2024-11-20 01:31:29.690871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.788 [2024-11-20 01:31:29.690963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.788 [2024-11-20 01:31:29.690988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.788 qpair failed and we were unable to recover it. 00:30:21.788 [2024-11-20 01:31:29.691133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.788 [2024-11-20 01:31:29.691266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.788 [2024-11-20 01:31:29.691295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.788 qpair failed and we were unable to recover it. 00:30:21.788 [2024-11-20 01:31:29.691466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.788 [2024-11-20 01:31:29.691551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.788 [2024-11-20 01:31:29.691575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.788 qpair failed and we were unable to recover it. 00:30:21.788 [2024-11-20 01:31:29.691674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.788 [2024-11-20 01:31:29.691791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.788 [2024-11-20 01:31:29.691816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.788 qpair failed and we were unable to recover it. 00:30:21.788 [2024-11-20 01:31:29.691949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.788 [2024-11-20 01:31:29.692166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.788 [2024-11-20 01:31:29.692224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.788 qpair failed and we were unable to recover it. 00:30:21.788 [2024-11-20 01:31:29.692383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.788 [2024-11-20 01:31:29.692580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.789 [2024-11-20 01:31:29.692608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.789 qpair failed and we were unable to recover it. 00:30:21.789 [2024-11-20 01:31:29.692743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.789 [2024-11-20 01:31:29.692885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.789 [2024-11-20 01:31:29.692911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.789 qpair failed and we were unable to recover it. 00:30:21.789 [2024-11-20 01:31:29.693020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.789 [2024-11-20 01:31:29.693191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.789 [2024-11-20 01:31:29.693217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.789 qpair failed and we were unable to recover it. 00:30:21.789 [2024-11-20 01:31:29.693332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.789 [2024-11-20 01:31:29.693455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.789 [2024-11-20 01:31:29.693483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.789 qpair failed and we were unable to recover it. 00:30:21.789 [2024-11-20 01:31:29.693626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.789 [2024-11-20 01:31:29.693734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.789 [2024-11-20 01:31:29.693758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.789 qpair failed and we were unable to recover it. 00:30:21.789 [2024-11-20 01:31:29.693874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.789 [2024-11-20 01:31:29.694001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.789 [2024-11-20 01:31:29.694028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.789 qpair failed and we were unable to recover it. 00:30:21.789 [2024-11-20 01:31:29.694141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.789 [2024-11-20 01:31:29.694228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.789 [2024-11-20 01:31:29.694253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.789 qpair failed and we were unable to recover it. 00:30:21.789 [2024-11-20 01:31:29.694341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.789 [2024-11-20 01:31:29.694464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.789 [2024-11-20 01:31:29.694490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.789 qpair failed and we were unable to recover it. 00:30:21.789 [2024-11-20 01:31:29.694673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.789 [2024-11-20 01:31:29.694790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.789 [2024-11-20 01:31:29.694816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.789 qpair failed and we were unable to recover it. 00:30:21.789 [2024-11-20 01:31:29.694943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.789 [2024-11-20 01:31:29.695034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.789 [2024-11-20 01:31:29.695059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.789 qpair failed and we were unable to recover it. 00:30:21.789 [2024-11-20 01:31:29.695146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.789 [2024-11-20 01:31:29.695236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.789 [2024-11-20 01:31:29.695260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.789 qpair failed and we were unable to recover it. 00:30:21.789 [2024-11-20 01:31:29.695355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.789 [2024-11-20 01:31:29.695462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.789 [2024-11-20 01:31:29.695503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.789 qpair failed and we were unable to recover it. 00:30:21.789 [2024-11-20 01:31:29.695634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.789 [2024-11-20 01:31:29.695734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.789 [2024-11-20 01:31:29.695776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.789 qpair failed and we were unable to recover it. 00:30:21.789 [2024-11-20 01:31:29.695898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.789 [2024-11-20 01:31:29.696012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.789 [2024-11-20 01:31:29.696038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.789 qpair failed and we were unable to recover it. 00:30:21.789 [2024-11-20 01:31:29.696132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.789 [2024-11-20 01:31:29.696218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.789 [2024-11-20 01:31:29.696244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.789 qpair failed and we were unable to recover it. 00:30:21.789 [2024-11-20 01:31:29.696356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.789 [2024-11-20 01:31:29.696510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.789 [2024-11-20 01:31:29.696538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.789 qpair failed and we were unable to recover it. 00:30:21.789 [2024-11-20 01:31:29.696653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.789 [2024-11-20 01:31:29.696739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.789 [2024-11-20 01:31:29.696763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.789 qpair failed and we were unable to recover it. 00:30:21.789 [2024-11-20 01:31:29.696856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.789 [2024-11-20 01:31:29.696940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.789 [2024-11-20 01:31:29.696966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.789 qpair failed and we were unable to recover it. 00:30:21.789 [2024-11-20 01:31:29.697080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.789 [2024-11-20 01:31:29.697194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.789 [2024-11-20 01:31:29.697223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.789 qpair failed and we were unable to recover it. 00:30:21.789 [2024-11-20 01:31:29.697386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.789 [2024-11-20 01:31:29.697475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.789 [2024-11-20 01:31:29.697501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.789 qpair failed and we were unable to recover it. 00:30:21.789 [2024-11-20 01:31:29.697614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.789 [2024-11-20 01:31:29.697740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.789 [2024-11-20 01:31:29.697768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.789 qpair failed and we were unable to recover it. 00:30:21.789 [2024-11-20 01:31:29.697912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.789 [2024-11-20 01:31:29.698025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.789 [2024-11-20 01:31:29.698052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.789 qpair failed and we were unable to recover it. 00:30:21.789 [2024-11-20 01:31:29.698146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.789 [2024-11-20 01:31:29.698270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.789 [2024-11-20 01:31:29.698295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.789 qpair failed and we were unable to recover it. 00:30:21.789 [2024-11-20 01:31:29.698437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.789 [2024-11-20 01:31:29.698573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.789 [2024-11-20 01:31:29.698600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.789 qpair failed and we were unable to recover it. 00:30:21.789 [2024-11-20 01:31:29.698724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.789 [2024-11-20 01:31:29.698844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.789 [2024-11-20 01:31:29.698871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.789 qpair failed and we were unable to recover it. 00:30:21.789 [2024-11-20 01:31:29.698992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.789 [2024-11-20 01:31:29.699103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.789 [2024-11-20 01:31:29.699145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.789 qpair failed and we were unable to recover it. 00:30:21.789 [2024-11-20 01:31:29.699257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.789 [2024-11-20 01:31:29.699410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.789 [2024-11-20 01:31:29.699438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.789 qpair failed and we were unable to recover it. 00:30:21.789 [2024-11-20 01:31:29.699579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.789 [2024-11-20 01:31:29.699674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.790 [2024-11-20 01:31:29.699699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.790 qpair failed and we were unable to recover it. 00:30:21.790 [2024-11-20 01:31:29.699790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.790 [2024-11-20 01:31:29.699883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.790 [2024-11-20 01:31:29.699908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.790 qpair failed and we were unable to recover it. 00:30:21.790 [2024-11-20 01:31:29.700077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.790 [2024-11-20 01:31:29.700214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.790 [2024-11-20 01:31:29.700239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.790 qpair failed and we were unable to recover it. 00:30:21.790 [2024-11-20 01:31:29.700355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.790 [2024-11-20 01:31:29.700483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.790 [2024-11-20 01:31:29.700508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.790 qpair failed and we were unable to recover it. 00:30:21.790 [2024-11-20 01:31:29.700599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.790 [2024-11-20 01:31:29.700716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.790 [2024-11-20 01:31:29.700741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.790 qpair failed and we were unable to recover it. 00:30:21.790 [2024-11-20 01:31:29.700823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.790 [2024-11-20 01:31:29.700943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.790 [2024-11-20 01:31:29.700968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.790 qpair failed and we were unable to recover it. 00:30:21.790 [2024-11-20 01:31:29.701080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.790 [2024-11-20 01:31:29.701190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.790 [2024-11-20 01:31:29.701222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.790 qpair failed and we were unable to recover it. 00:30:21.790 [2024-11-20 01:31:29.701338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.790 [2024-11-20 01:31:29.701433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.790 [2024-11-20 01:31:29.701458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.790 qpair failed and we were unable to recover it. 00:30:21.790 [2024-11-20 01:31:29.701555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.790 [2024-11-20 01:31:29.701643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.790 [2024-11-20 01:31:29.701669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.790 qpair failed and we were unable to recover it. 00:30:21.790 [2024-11-20 01:31:29.701793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.790 [2024-11-20 01:31:29.701881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.790 [2024-11-20 01:31:29.701906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.790 qpair failed and we were unable to recover it. 00:30:21.790 [2024-11-20 01:31:29.701985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.790 [2024-11-20 01:31:29.702093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.790 [2024-11-20 01:31:29.702119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.790 qpair failed and we were unable to recover it. 00:30:21.790 [2024-11-20 01:31:29.702261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.790 [2024-11-20 01:31:29.702398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.790 [2024-11-20 01:31:29.702423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.790 qpair failed and we were unable to recover it. 00:30:21.790 [2024-11-20 01:31:29.702538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.790 [2024-11-20 01:31:29.702682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.790 [2024-11-20 01:31:29.702710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.790 qpair failed and we were unable to recover it. 00:30:21.790 [2024-11-20 01:31:29.702820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.790 [2024-11-20 01:31:29.702909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.790 [2024-11-20 01:31:29.702935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.790 qpair failed and we were unable to recover it. 00:30:21.790 [2024-11-20 01:31:29.703055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.790 [2024-11-20 01:31:29.703216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.790 [2024-11-20 01:31:29.703245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.790 qpair failed and we were unable to recover it. 00:30:21.790 [2024-11-20 01:31:29.703370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.790 [2024-11-20 01:31:29.703520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.790 [2024-11-20 01:31:29.703545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.790 qpair failed and we were unable to recover it. 00:30:21.790 [2024-11-20 01:31:29.703660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.790 [2024-11-20 01:31:29.703776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.790 [2024-11-20 01:31:29.703801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.790 qpair failed and we were unable to recover it. 00:30:21.790 [2024-11-20 01:31:29.703948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.790 [2024-11-20 01:31:29.704048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.790 [2024-11-20 01:31:29.704087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.790 qpair failed and we were unable to recover it. 00:30:21.790 [2024-11-20 01:31:29.704261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.790 [2024-11-20 01:31:29.704384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.790 [2024-11-20 01:31:29.704409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.790 qpair failed and we were unable to recover it. 00:30:21.790 [2024-11-20 01:31:29.704528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.790 [2024-11-20 01:31:29.704641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.790 [2024-11-20 01:31:29.704666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.790 qpair failed and we were unable to recover it. 00:30:21.790 [2024-11-20 01:31:29.704792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.790 [2024-11-20 01:31:29.704922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.790 [2024-11-20 01:31:29.704950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.790 qpair failed and we were unable to recover it. 00:30:21.790 [2024-11-20 01:31:29.705078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.790 [2024-11-20 01:31:29.705239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.790 [2024-11-20 01:31:29.705268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.790 qpair failed and we were unable to recover it. 00:30:21.790 [2024-11-20 01:31:29.705405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.790 [2024-11-20 01:31:29.705539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.790 [2024-11-20 01:31:29.705565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.790 qpair failed and we were unable to recover it. 00:30:21.790 [2024-11-20 01:31:29.705742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.790 [2024-11-20 01:31:29.705895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.790 [2024-11-20 01:31:29.705923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.790 qpair failed and we were unable to recover it. 00:30:21.790 [2024-11-20 01:31:29.706030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.790 [2024-11-20 01:31:29.706152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.790 [2024-11-20 01:31:29.706178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.790 qpair failed and we were unable to recover it. 00:30:21.790 [2024-11-20 01:31:29.706265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.790 [2024-11-20 01:31:29.706350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.790 [2024-11-20 01:31:29.706375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.790 qpair failed and we were unable to recover it. 00:30:21.790 [2024-11-20 01:31:29.706506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.790 [2024-11-20 01:31:29.706632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.790 [2024-11-20 01:31:29.706661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.790 qpair failed and we were unable to recover it. 00:30:21.790 [2024-11-20 01:31:29.706760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.790 [2024-11-20 01:31:29.706890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.791 [2024-11-20 01:31:29.706918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.791 qpair failed and we were unable to recover it. 00:30:21.791 [2024-11-20 01:31:29.707056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.791 [2024-11-20 01:31:29.707187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.791 [2024-11-20 01:31:29.707213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.791 qpair failed and we were unable to recover it. 00:30:21.791 [2024-11-20 01:31:29.707367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.791 [2024-11-20 01:31:29.707486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.791 [2024-11-20 01:31:29.707511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.791 qpair failed and we were unable to recover it. 00:30:21.791 [2024-11-20 01:31:29.707675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.791 [2024-11-20 01:31:29.707806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.791 [2024-11-20 01:31:29.707833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.791 qpair failed and we were unable to recover it. 00:30:21.791 [2024-11-20 01:31:29.707983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.791 [2024-11-20 01:31:29.708099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.791 [2024-11-20 01:31:29.708130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.791 qpair failed and we were unable to recover it. 00:30:21.791 [2024-11-20 01:31:29.708293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.791 [2024-11-20 01:31:29.708379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.791 [2024-11-20 01:31:29.708407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.791 qpair failed and we were unable to recover it. 00:30:21.791 [2024-11-20 01:31:29.708531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.791 [2024-11-20 01:31:29.708634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.791 [2024-11-20 01:31:29.708662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.791 qpair failed and we were unable to recover it. 00:30:21.791 [2024-11-20 01:31:29.708794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.791 [2024-11-20 01:31:29.708880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.791 [2024-11-20 01:31:29.708906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.791 qpair failed and we were unable to recover it. 00:30:21.791 [2024-11-20 01:31:29.709036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.791 [2024-11-20 01:31:29.709183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.791 [2024-11-20 01:31:29.709208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.791 qpair failed and we were unable to recover it. 00:30:21.791 [2024-11-20 01:31:29.709304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.791 [2024-11-20 01:31:29.709419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.791 [2024-11-20 01:31:29.709445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.791 qpair failed and we were unable to recover it. 00:30:21.791 [2024-11-20 01:31:29.709611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.791 [2024-11-20 01:31:29.709727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.791 [2024-11-20 01:31:29.709753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.791 qpair failed and we were unable to recover it. 00:30:21.791 [2024-11-20 01:31:29.709847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.791 [2024-11-20 01:31:29.709970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.791 [2024-11-20 01:31:29.709995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.791 qpair failed and we were unable to recover it. 00:30:21.791 [2024-11-20 01:31:29.710136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.791 [2024-11-20 01:31:29.710242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.791 [2024-11-20 01:31:29.710272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.791 qpair failed and we were unable to recover it. 00:30:21.791 [2024-11-20 01:31:29.710411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.791 [2024-11-20 01:31:29.710506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.791 [2024-11-20 01:31:29.710533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.791 qpair failed and we were unable to recover it. 00:30:21.791 [2024-11-20 01:31:29.710621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.791 [2024-11-20 01:31:29.710743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.791 [2024-11-20 01:31:29.710772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.791 qpair failed and we were unable to recover it. 00:30:21.791 [2024-11-20 01:31:29.710908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.791 [2024-11-20 01:31:29.711034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.791 [2024-11-20 01:31:29.711062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.791 qpair failed and we were unable to recover it. 00:30:21.791 [2024-11-20 01:31:29.711232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.791 [2024-11-20 01:31:29.711349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.791 [2024-11-20 01:31:29.711375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.791 qpair failed and we were unable to recover it. 00:30:21.791 [2024-11-20 01:31:29.711491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.791 [2024-11-20 01:31:29.711590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.791 [2024-11-20 01:31:29.711619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.791 qpair failed and we were unable to recover it. 00:30:21.791 [2024-11-20 01:31:29.711718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.791 [2024-11-20 01:31:29.711815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.791 [2024-11-20 01:31:29.711843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.791 qpair failed and we were unable to recover it. 00:30:21.791 [2024-11-20 01:31:29.711980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.791 [2024-11-20 01:31:29.712096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.791 [2024-11-20 01:31:29.712122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.791 qpair failed and we were unable to recover it. 00:30:21.791 [2024-11-20 01:31:29.712268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.791 [2024-11-20 01:31:29.712364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.791 [2024-11-20 01:31:29.712390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.791 qpair failed and we were unable to recover it. 00:30:21.791 [2024-11-20 01:31:29.712483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.791 [2024-11-20 01:31:29.712570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.791 [2024-11-20 01:31:29.712596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.791 qpair failed and we were unable to recover it. 00:30:21.791 [2024-11-20 01:31:29.712726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.791 [2024-11-20 01:31:29.712872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.791 [2024-11-20 01:31:29.712897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.791 qpair failed and we were unable to recover it. 00:30:21.791 [2024-11-20 01:31:29.713007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.791 [2024-11-20 01:31:29.713126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.791 [2024-11-20 01:31:29.713151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.791 qpair failed and we were unable to recover it. 00:30:21.791 [2024-11-20 01:31:29.713247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.792 [2024-11-20 01:31:29.713364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.792 [2024-11-20 01:31:29.713393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.792 qpair failed and we were unable to recover it. 00:30:21.792 [2024-11-20 01:31:29.713476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.792 [2024-11-20 01:31:29.713596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.792 [2024-11-20 01:31:29.713622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.792 qpair failed and we were unable to recover it. 00:30:21.792 [2024-11-20 01:31:29.713755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.792 [2024-11-20 01:31:29.713837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.792 [2024-11-20 01:31:29.713866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.792 qpair failed and we were unable to recover it. 00:30:21.792 [2024-11-20 01:31:29.713961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.792 [2024-11-20 01:31:29.714061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.792 [2024-11-20 01:31:29.714098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.792 qpair failed and we were unable to recover it. 00:30:21.792 [2024-11-20 01:31:29.714237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.792 [2024-11-20 01:31:29.714333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.792 [2024-11-20 01:31:29.714360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.792 qpair failed and we were unable to recover it. 00:30:21.792 [2024-11-20 01:31:29.714490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.792 [2024-11-20 01:31:29.714612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.792 [2024-11-20 01:31:29.714641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.792 qpair failed and we were unable to recover it. 00:30:21.792 [2024-11-20 01:31:29.714776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.792 [2024-11-20 01:31:29.714903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.792 [2024-11-20 01:31:29.714930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.792 qpair failed and we were unable to recover it. 00:30:21.792 [2024-11-20 01:31:29.715081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.792 [2024-11-20 01:31:29.715192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.792 [2024-11-20 01:31:29.715217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.792 qpair failed and we were unable to recover it. 00:30:21.792 [2024-11-20 01:31:29.715312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.792 [2024-11-20 01:31:29.715467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.792 [2024-11-20 01:31:29.715492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.792 qpair failed and we were unable to recover it. 00:30:21.792 [2024-11-20 01:31:29.715608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.792 [2024-11-20 01:31:29.715717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.792 [2024-11-20 01:31:29.715742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.792 qpair failed and we were unable to recover it. 00:30:21.792 [2024-11-20 01:31:29.715855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.792 [2024-11-20 01:31:29.715941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.792 [2024-11-20 01:31:29.715971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.792 qpair failed and we were unable to recover it. 00:30:21.792 [2024-11-20 01:31:29.716137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.792 [2024-11-20 01:31:29.716235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.792 [2024-11-20 01:31:29.716263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.792 qpair failed and we were unable to recover it. 00:30:21.792 [2024-11-20 01:31:29.716354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.792 [2024-11-20 01:31:29.716485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.792 [2024-11-20 01:31:29.716513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.792 qpair failed and we were unable to recover it. 00:30:21.792 [2024-11-20 01:31:29.716665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.792 [2024-11-20 01:31:29.716750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.792 [2024-11-20 01:31:29.716775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.792 qpair failed and we were unable to recover it. 00:30:21.792 [2024-11-20 01:31:29.716860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.792 [2024-11-20 01:31:29.716952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.792 [2024-11-20 01:31:29.716979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.792 qpair failed and we were unable to recover it. 00:30:21.792 [2024-11-20 01:31:29.717082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.792 [2024-11-20 01:31:29.717188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.792 [2024-11-20 01:31:29.717217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.792 qpair failed and we were unable to recover it. 00:30:21.792 [2024-11-20 01:31:29.717329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.792 [2024-11-20 01:31:29.717449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.792 [2024-11-20 01:31:29.717474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.792 qpair failed and we were unable to recover it. 00:30:21.792 [2024-11-20 01:31:29.717595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.792 [2024-11-20 01:31:29.717724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.792 [2024-11-20 01:31:29.717752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.792 qpair failed and we were unable to recover it. 00:30:21.792 [2024-11-20 01:31:29.717878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.792 [2024-11-20 01:31:29.718000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.792 [2024-11-20 01:31:29.718027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.792 qpair failed and we were unable to recover it. 00:30:21.792 [2024-11-20 01:31:29.718170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.792 [2024-11-20 01:31:29.718252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.792 [2024-11-20 01:31:29.718277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.792 qpair failed and we were unable to recover it. 00:30:21.792 [2024-11-20 01:31:29.718365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.792 [2024-11-20 01:31:29.718481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.792 [2024-11-20 01:31:29.718507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.792 qpair failed and we were unable to recover it. 00:30:21.792 [2024-11-20 01:31:29.718610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.792 [2024-11-20 01:31:29.718764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.792 [2024-11-20 01:31:29.718790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.792 qpair failed and we were unable to recover it. 00:30:21.792 [2024-11-20 01:31:29.718952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.792 [2024-11-20 01:31:29.719107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.792 [2024-11-20 01:31:29.719150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.792 qpair failed and we were unable to recover it. 00:30:21.792 [2024-11-20 01:31:29.719269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.792 [2024-11-20 01:31:29.719385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.792 [2024-11-20 01:31:29.719410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.792 qpair failed and we were unable to recover it. 00:30:21.792 [2024-11-20 01:31:29.719538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.792 [2024-11-20 01:31:29.719676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.792 [2024-11-20 01:31:29.719703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.792 qpair failed and we were unable to recover it. 00:30:21.792 [2024-11-20 01:31:29.719840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.792 [2024-11-20 01:31:29.719960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.792 [2024-11-20 01:31:29.719984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.792 qpair failed and we were unable to recover it. 00:30:21.792 [2024-11-20 01:31:29.720142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.792 [2024-11-20 01:31:29.720227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.793 [2024-11-20 01:31:29.720252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.793 qpair failed and we were unable to recover it. 00:30:21.793 [2024-11-20 01:31:29.720377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.793 [2024-11-20 01:31:29.720531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.793 [2024-11-20 01:31:29.720559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.793 qpair failed and we were unable to recover it. 00:30:21.793 [2024-11-20 01:31:29.720672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.793 [2024-11-20 01:31:29.720800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.793 [2024-11-20 01:31:29.720825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.793 qpair failed and we were unable to recover it. 00:30:21.793 [2024-11-20 01:31:29.720914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.793 [2024-11-20 01:31:29.721001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.793 [2024-11-20 01:31:29.721025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.793 qpair failed and we were unable to recover it. 00:30:21.793 [2024-11-20 01:31:29.721117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.793 [2024-11-20 01:31:29.721251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.793 [2024-11-20 01:31:29.721281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.793 qpair failed and we were unable to recover it. 00:30:21.793 [2024-11-20 01:31:29.721454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.793 [2024-11-20 01:31:29.721596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.793 [2024-11-20 01:31:29.721637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.793 qpair failed and we were unable to recover it. 00:30:21.793 [2024-11-20 01:31:29.721739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.793 [2024-11-20 01:31:29.721910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.793 [2024-11-20 01:31:29.721936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.793 qpair failed and we were unable to recover it. 00:30:21.793 [2024-11-20 01:31:29.722026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.793 [2024-11-20 01:31:29.722158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.793 [2024-11-20 01:31:29.722186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.793 qpair failed and we were unable to recover it. 00:30:21.793 [2024-11-20 01:31:29.722303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.793 [2024-11-20 01:31:29.722420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.793 [2024-11-20 01:31:29.722445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.793 qpair failed and we were unable to recover it. 00:30:21.793 [2024-11-20 01:31:29.722557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.793 [2024-11-20 01:31:29.722675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.793 [2024-11-20 01:31:29.722701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.793 qpair failed and we were unable to recover it. 00:30:21.793 [2024-11-20 01:31:29.722827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.793 [2024-11-20 01:31:29.722981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.793 [2024-11-20 01:31:29.723009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.793 qpair failed and we were unable to recover it. 00:30:21.793 [2024-11-20 01:31:29.723125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.793 [2024-11-20 01:31:29.723213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.793 [2024-11-20 01:31:29.723240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.793 qpair failed and we were unable to recover it. 00:30:21.793 [2024-11-20 01:31:29.723388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.793 [2024-11-20 01:31:29.723468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.793 [2024-11-20 01:31:29.723510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.793 qpair failed and we were unable to recover it. 00:30:21.793 [2024-11-20 01:31:29.723611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.793 [2024-11-20 01:31:29.723750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.793 [2024-11-20 01:31:29.723774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.793 qpair failed and we were unable to recover it. 00:30:21.793 [2024-11-20 01:31:29.723889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.793 [2024-11-20 01:31:29.724028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.793 [2024-11-20 01:31:29.724053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.793 qpair failed and we were unable to recover it. 00:30:21.793 [2024-11-20 01:31:29.724173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.793 [2024-11-20 01:31:29.724331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.793 [2024-11-20 01:31:29.724358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.793 qpair failed and we were unable to recover it. 00:30:21.793 [2024-11-20 01:31:29.724443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.793 [2024-11-20 01:31:29.724572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.793 [2024-11-20 01:31:29.724599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.793 qpair failed and we were unable to recover it. 00:30:21.793 [2024-11-20 01:31:29.724720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.793 [2024-11-20 01:31:29.724834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.793 [2024-11-20 01:31:29.724860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.793 qpair failed and we were unable to recover it. 00:30:21.793 [2024-11-20 01:31:29.724963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.793 [2024-11-20 01:31:29.725094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.793 [2024-11-20 01:31:29.725124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.793 qpair failed and we were unable to recover it. 00:30:21.793 [2024-11-20 01:31:29.725288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.793 [2024-11-20 01:31:29.725405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.793 [2024-11-20 01:31:29.725431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.793 qpair failed and we were unable to recover it. 00:30:21.793 [2024-11-20 01:31:29.725520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.793 [2024-11-20 01:31:29.725648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.793 [2024-11-20 01:31:29.725672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.793 qpair failed and we were unable to recover it. 00:30:21.793 [2024-11-20 01:31:29.725795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.793 [2024-11-20 01:31:29.725919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.793 [2024-11-20 01:31:29.725946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.793 qpair failed and we were unable to recover it. 00:30:21.793 [2024-11-20 01:31:29.726083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.793 [2024-11-20 01:31:29.726176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.793 [2024-11-20 01:31:29.726202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.793 qpair failed and we were unable to recover it. 00:30:21.793 [2024-11-20 01:31:29.726287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.793 [2024-11-20 01:31:29.726376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.793 [2024-11-20 01:31:29.726401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.793 qpair failed and we were unable to recover it. 00:30:21.793 [2024-11-20 01:31:29.726486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.793 [2024-11-20 01:31:29.726602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.793 [2024-11-20 01:31:29.726628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.793 qpair failed and we were unable to recover it. 00:30:21.793 [2024-11-20 01:31:29.726747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.793 [2024-11-20 01:31:29.726828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.794 [2024-11-20 01:31:29.726854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.794 qpair failed and we were unable to recover it. 00:30:21.794 [2024-11-20 01:31:29.726974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.794 [2024-11-20 01:31:29.727057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.794 [2024-11-20 01:31:29.727111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.794 qpair failed and we were unable to recover it. 00:30:21.794 [2024-11-20 01:31:29.727200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.794 [2024-11-20 01:31:29.727310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.794 [2024-11-20 01:31:29.727335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.794 qpair failed and we were unable to recover it. 00:30:21.794 [2024-11-20 01:31:29.727431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.794 [2024-11-20 01:31:29.727521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.794 [2024-11-20 01:31:29.727546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.794 qpair failed and we were unable to recover it. 00:30:21.794 [2024-11-20 01:31:29.727627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.794 [2024-11-20 01:31:29.727733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.794 [2024-11-20 01:31:29.727759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.794 qpair failed and we were unable to recover it. 00:30:21.794 [2024-11-20 01:31:29.727846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.794 [2024-11-20 01:31:29.727952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.794 [2024-11-20 01:31:29.727980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.794 qpair failed and we were unable to recover it. 00:30:21.794 [2024-11-20 01:31:29.728154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.794 [2024-11-20 01:31:29.728279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.794 [2024-11-20 01:31:29.728304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.794 qpair failed and we were unable to recover it. 00:30:21.794 [2024-11-20 01:31:29.728425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.794 [2024-11-20 01:31:29.728519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.794 [2024-11-20 01:31:29.728544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.794 qpair failed and we were unable to recover it. 00:30:21.794 [2024-11-20 01:31:29.728707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.794 [2024-11-20 01:31:29.728829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.794 [2024-11-20 01:31:29.728858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.794 qpair failed and we were unable to recover it. 00:30:21.794 [2024-11-20 01:31:29.728989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.794 [2024-11-20 01:31:29.729162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.794 [2024-11-20 01:31:29.729188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.794 qpair failed and we were unable to recover it. 00:30:21.794 [2024-11-20 01:31:29.729287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.794 [2024-11-20 01:31:29.729375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.794 [2024-11-20 01:31:29.729401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.794 qpair failed and we were unable to recover it. 00:30:21.794 [2024-11-20 01:31:29.729488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.794 [2024-11-20 01:31:29.729603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.794 [2024-11-20 01:31:29.729628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.794 qpair failed and we were unable to recover it. 00:30:21.794 [2024-11-20 01:31:29.729718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.794 [2024-11-20 01:31:29.729850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.794 [2024-11-20 01:31:29.729876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.794 qpair failed and we were unable to recover it. 00:30:21.794 [2024-11-20 01:31:29.729980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.794 [2024-11-20 01:31:29.730107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.794 [2024-11-20 01:31:29.730131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.794 qpair failed and we were unable to recover it. 00:30:21.794 [2024-11-20 01:31:29.730214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.794 [2024-11-20 01:31:29.730304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.794 [2024-11-20 01:31:29.730329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.794 qpair failed and we were unable to recover it. 00:30:21.794 [2024-11-20 01:31:29.730448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.794 [2024-11-20 01:31:29.730581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.794 [2024-11-20 01:31:29.730608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.794 qpair failed and we were unable to recover it. 00:30:21.794 [2024-11-20 01:31:29.730718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.794 [2024-11-20 01:31:29.730831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.794 [2024-11-20 01:31:29.730857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.794 qpair failed and we were unable to recover it. 00:30:21.794 [2024-11-20 01:31:29.731021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.794 [2024-11-20 01:31:29.731180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.794 [2024-11-20 01:31:29.731210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.794 qpair failed and we were unable to recover it. 00:30:21.794 [2024-11-20 01:31:29.731315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.794 [2024-11-20 01:31:29.731403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.794 [2024-11-20 01:31:29.731446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.794 qpair failed and we were unable to recover it. 00:30:21.794 [2024-11-20 01:31:29.731541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.794 [2024-11-20 01:31:29.731653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.794 [2024-11-20 01:31:29.731678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.794 qpair failed and we were unable to recover it. 00:30:21.794 [2024-11-20 01:31:29.731789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.794 [2024-11-20 01:31:29.731908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.794 [2024-11-20 01:31:29.731936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.794 qpair failed and we were unable to recover it. 00:30:21.794 [2024-11-20 01:31:29.732093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.794 [2024-11-20 01:31:29.732246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.794 [2024-11-20 01:31:29.732272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.794 qpair failed and we were unable to recover it. 00:30:21.794 [2024-11-20 01:31:29.732360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.794 [2024-11-20 01:31:29.732444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.794 [2024-11-20 01:31:29.732468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.794 qpair failed and we were unable to recover it. 00:30:21.794 [2024-11-20 01:31:29.732597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.794 [2024-11-20 01:31:29.732685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.794 [2024-11-20 01:31:29.732712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.794 qpair failed and we were unable to recover it. 00:30:21.794 [2024-11-20 01:31:29.732807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.794 [2024-11-20 01:31:29.732926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.794 [2024-11-20 01:31:29.732953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.794 qpair failed and we were unable to recover it. 00:30:21.794 [2024-11-20 01:31:29.733118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.794 [2024-11-20 01:31:29.733214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.794 [2024-11-20 01:31:29.733239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.794 qpair failed and we were unable to recover it. 00:30:21.794 [2024-11-20 01:31:29.733331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.794 [2024-11-20 01:31:29.733475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.794 [2024-11-20 01:31:29.733500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.794 qpair failed and we were unable to recover it. 00:30:21.794 [2024-11-20 01:31:29.733607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.794 [2024-11-20 01:31:29.733743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.795 [2024-11-20 01:31:29.733770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.795 qpair failed and we were unable to recover it. 00:30:21.795 [2024-11-20 01:31:29.733883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.795 [2024-11-20 01:31:29.733978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.795 [2024-11-20 01:31:29.734007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.795 qpair failed and we were unable to recover it. 00:30:21.795 [2024-11-20 01:31:29.734095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.795 [2024-11-20 01:31:29.734226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.795 [2024-11-20 01:31:29.734251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.795 qpair failed and we were unable to recover it. 00:30:21.795 [2024-11-20 01:31:29.734387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.795 [2024-11-20 01:31:29.734479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.795 [2024-11-20 01:31:29.734504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.795 qpair failed and we were unable to recover it. 00:30:21.795 [2024-11-20 01:31:29.734594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.795 [2024-11-20 01:31:29.734735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.795 [2024-11-20 01:31:29.734760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.795 qpair failed and we were unable to recover it. 00:30:21.795 [2024-11-20 01:31:29.734844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.795 [2024-11-20 01:31:29.734936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.795 [2024-11-20 01:31:29.734960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.795 qpair failed and we were unable to recover it. 00:30:21.795 [2024-11-20 01:31:29.735048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.795 [2024-11-20 01:31:29.735162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.795 [2024-11-20 01:31:29.735188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.795 qpair failed and we were unable to recover it. 00:30:21.795 [2024-11-20 01:31:29.735286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.795 [2024-11-20 01:31:29.735405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.795 [2024-11-20 01:31:29.735431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.795 qpair failed and we were unable to recover it. 00:30:21.795 [2024-11-20 01:31:29.735520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.795 [2024-11-20 01:31:29.735614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.795 [2024-11-20 01:31:29.735641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.795 qpair failed and we were unable to recover it. 00:30:21.795 [2024-11-20 01:31:29.735762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.795 [2024-11-20 01:31:29.735925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.795 [2024-11-20 01:31:29.735952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.795 qpair failed and we were unable to recover it. 00:30:21.795 [2024-11-20 01:31:29.736103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.795 [2024-11-20 01:31:29.736220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.795 [2024-11-20 01:31:29.736245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.795 qpair failed and we were unable to recover it. 00:30:21.795 [2024-11-20 01:31:29.736380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.795 [2024-11-20 01:31:29.736511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.795 [2024-11-20 01:31:29.736538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.795 qpair failed and we were unable to recover it. 00:30:21.795 [2024-11-20 01:31:29.736677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.795 [2024-11-20 01:31:29.736819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.795 [2024-11-20 01:31:29.736845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.795 qpair failed and we were unable to recover it. 00:30:21.795 [2024-11-20 01:31:29.736993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.795 [2024-11-20 01:31:29.737086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.795 [2024-11-20 01:31:29.737114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.795 qpair failed and we were unable to recover it. 00:30:21.795 [2024-11-20 01:31:29.737258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.795 [2024-11-20 01:31:29.737416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.795 [2024-11-20 01:31:29.737441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.795 qpair failed and we were unable to recover it. 00:30:21.795 [2024-11-20 01:31:29.737533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.795 [2024-11-20 01:31:29.737618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.795 [2024-11-20 01:31:29.737659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.795 qpair failed and we were unable to recover it. 00:30:21.795 [2024-11-20 01:31:29.737807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.795 [2024-11-20 01:31:29.737921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.795 [2024-11-20 01:31:29.737946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.795 qpair failed and we were unable to recover it. 00:30:21.795 [2024-11-20 01:31:29.738049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.795 [2024-11-20 01:31:29.738185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.795 [2024-11-20 01:31:29.738214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.795 qpair failed and we were unable to recover it. 00:30:21.795 [2024-11-20 01:31:29.738377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.795 [2024-11-20 01:31:29.738482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.795 [2024-11-20 01:31:29.738511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.795 qpair failed and we were unable to recover it. 00:30:21.795 [2024-11-20 01:31:29.738622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.795 [2024-11-20 01:31:29.738744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.795 [2024-11-20 01:31:29.738769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.795 qpair failed and we were unable to recover it. 00:30:21.795 [2024-11-20 01:31:29.738912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.795 [2024-11-20 01:31:29.739013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.795 [2024-11-20 01:31:29.739041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.795 qpair failed and we were unable to recover it. 00:30:21.795 [2024-11-20 01:31:29.739180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.795 [2024-11-20 01:31:29.739267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.795 [2024-11-20 01:31:29.739292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.795 qpair failed and we were unable to recover it. 00:30:21.795 [2024-11-20 01:31:29.739375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.795 [2024-11-20 01:31:29.739494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.795 [2024-11-20 01:31:29.739519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.795 qpair failed and we were unable to recover it. 00:30:21.795 [2024-11-20 01:31:29.739620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.795 [2024-11-20 01:31:29.739787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.795 [2024-11-20 01:31:29.739812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.795 qpair failed and we were unable to recover it. 00:30:21.795 [2024-11-20 01:31:29.739914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.795 [2024-11-20 01:31:29.740033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.795 [2024-11-20 01:31:29.740062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.795 qpair failed and we were unable to recover it. 00:30:21.795 [2024-11-20 01:31:29.740208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.795 [2024-11-20 01:31:29.740292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.795 [2024-11-20 01:31:29.740319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.795 qpair failed and we were unable to recover it. 00:30:21.795 [2024-11-20 01:31:29.740417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.795 [2024-11-20 01:31:29.740538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.795 [2024-11-20 01:31:29.740564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.795 qpair failed and we were unable to recover it. 00:30:21.795 [2024-11-20 01:31:29.740654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.795 [2024-11-20 01:31:29.740773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.796 [2024-11-20 01:31:29.740798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.796 qpair failed and we were unable to recover it. 00:30:21.796 [2024-11-20 01:31:29.740887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.796 [2024-11-20 01:31:29.740973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.796 [2024-11-20 01:31:29.740999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.796 qpair failed and we were unable to recover it. 00:30:21.796 [2024-11-20 01:31:29.741093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.796 [2024-11-20 01:31:29.741182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.796 [2024-11-20 01:31:29.741208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.796 qpair failed and we were unable to recover it. 00:30:21.796 [2024-11-20 01:31:29.741300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.796 [2024-11-20 01:31:29.741440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.796 [2024-11-20 01:31:29.741469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.796 qpair failed and we were unable to recover it. 00:30:21.796 [2024-11-20 01:31:29.741585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.796 [2024-11-20 01:31:29.741699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.796 [2024-11-20 01:31:29.741725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.796 qpair failed and we were unable to recover it. 00:30:21.796 [2024-11-20 01:31:29.741854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.796 [2024-11-20 01:31:29.741974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.796 [2024-11-20 01:31:29.742002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.796 qpair failed and we were unable to recover it. 00:30:21.796 [2024-11-20 01:31:29.742158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.796 [2024-11-20 01:31:29.742256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.796 [2024-11-20 01:31:29.742285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.796 qpair failed and we were unable to recover it. 00:30:21.796 [2024-11-20 01:31:29.742437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.796 [2024-11-20 01:31:29.742533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.796 [2024-11-20 01:31:29.742558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.796 qpair failed and we were unable to recover it. 00:30:21.796 [2024-11-20 01:31:29.742660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.796 [2024-11-20 01:31:29.742794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.796 [2024-11-20 01:31:29.742822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.796 qpair failed and we were unable to recover it. 00:30:21.796 [2024-11-20 01:31:29.742967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.796 [2024-11-20 01:31:29.743057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.796 [2024-11-20 01:31:29.743111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.796 qpair failed and we were unable to recover it. 00:30:21.796 [2024-11-20 01:31:29.743207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.796 [2024-11-20 01:31:29.743290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.796 [2024-11-20 01:31:29.743315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.796 qpair failed and we were unable to recover it. 00:30:21.796 [2024-11-20 01:31:29.743451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.796 [2024-11-20 01:31:29.743582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.796 [2024-11-20 01:31:29.743609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.796 qpair failed and we were unable to recover it. 00:30:21.796 [2024-11-20 01:31:29.743697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.796 [2024-11-20 01:31:29.743827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.796 [2024-11-20 01:31:29.743855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.796 qpair failed and we were unable to recover it. 00:30:21.796 [2024-11-20 01:31:29.743993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.796 [2024-11-20 01:31:29.744106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.796 [2024-11-20 01:31:29.744132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.796 qpair failed and we were unable to recover it. 00:30:21.796 [2024-11-20 01:31:29.744266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.796 [2024-11-20 01:31:29.744392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.796 [2024-11-20 01:31:29.744421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.796 qpair failed and we were unable to recover it. 00:30:21.796 [2024-11-20 01:31:29.744517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.796 [2024-11-20 01:31:29.744671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.796 [2024-11-20 01:31:29.744698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.796 qpair failed and we were unable to recover it. 00:30:21.796 [2024-11-20 01:31:29.744841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.796 [2024-11-20 01:31:29.744954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.796 [2024-11-20 01:31:29.744980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.796 qpair failed and we were unable to recover it. 00:30:21.796 [2024-11-20 01:31:29.745086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.796 [2024-11-20 01:31:29.745238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.796 [2024-11-20 01:31:29.745264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.796 qpair failed and we were unable to recover it. 00:30:21.796 [2024-11-20 01:31:29.745409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.796 [2024-11-20 01:31:29.745582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.796 [2024-11-20 01:31:29.745607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.796 qpair failed and we were unable to recover it. 00:30:21.796 [2024-11-20 01:31:29.745725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.796 [2024-11-20 01:31:29.745845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.796 [2024-11-20 01:31:29.745870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.796 qpair failed and we were unable to recover it. 00:30:21.796 [2024-11-20 01:31:29.745971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.796 [2024-11-20 01:31:29.746052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.796 [2024-11-20 01:31:29.746084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.796 qpair failed and we were unable to recover it. 00:30:21.796 [2024-11-20 01:31:29.746185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.796 [2024-11-20 01:31:29.746276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.796 [2024-11-20 01:31:29.746300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.796 qpair failed and we were unable to recover it. 00:30:21.796 [2024-11-20 01:31:29.746443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.796 [2024-11-20 01:31:29.746585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.796 [2024-11-20 01:31:29.746626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.796 qpair failed and we were unable to recover it. 00:30:21.796 [2024-11-20 01:31:29.746745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.796 [2024-11-20 01:31:29.746845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.796 [2024-11-20 01:31:29.746869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.796 qpair failed and we were unable to recover it. 00:30:21.796 [2024-11-20 01:31:29.746952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.796 [2024-11-20 01:31:29.747085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.796 [2024-11-20 01:31:29.747113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.796 qpair failed and we were unable to recover it. 00:30:21.796 [2024-11-20 01:31:29.747232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.797 [2024-11-20 01:31:29.747357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.797 [2024-11-20 01:31:29.747382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.797 qpair failed and we were unable to recover it. 00:30:21.797 [2024-11-20 01:31:29.747471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.797 [2024-11-20 01:31:29.747620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.797 [2024-11-20 01:31:29.747663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.797 qpair failed and we were unable to recover it. 00:30:21.797 [2024-11-20 01:31:29.747820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.797 [2024-11-20 01:31:29.747952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.797 [2024-11-20 01:31:29.747980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.797 qpair failed and we were unable to recover it. 00:30:21.797 [2024-11-20 01:31:29.748125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.797 [2024-11-20 01:31:29.748213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.797 [2024-11-20 01:31:29.748238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.797 qpair failed and we were unable to recover it. 00:30:21.797 [2024-11-20 01:31:29.748358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.797 [2024-11-20 01:31:29.748443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.797 [2024-11-20 01:31:29.748468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.797 qpair failed and we were unable to recover it. 00:30:21.797 [2024-11-20 01:31:29.748594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.797 [2024-11-20 01:31:29.748729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.797 [2024-11-20 01:31:29.748756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.797 qpair failed and we were unable to recover it. 00:30:21.797 [2024-11-20 01:31:29.748867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.797 [2024-11-20 01:31:29.749003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.797 [2024-11-20 01:31:29.749028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.797 qpair failed and we were unable to recover it. 00:30:21.797 [2024-11-20 01:31:29.749189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.797 [2024-11-20 01:31:29.749277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.797 [2024-11-20 01:31:29.749302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.797 qpair failed and we were unable to recover it. 00:30:21.797 [2024-11-20 01:31:29.749414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.797 [2024-11-20 01:31:29.749532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.797 [2024-11-20 01:31:29.749576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.797 qpair failed and we were unable to recover it. 00:30:21.797 [2024-11-20 01:31:29.749665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.797 [2024-11-20 01:31:29.749784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.797 [2024-11-20 01:31:29.749810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.797 qpair failed and we were unable to recover it. 00:30:21.797 [2024-11-20 01:31:29.749978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.797 [2024-11-20 01:31:29.750107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.797 [2024-11-20 01:31:29.750136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.797 qpair failed and we were unable to recover it. 00:30:21.797 [2024-11-20 01:31:29.750234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.797 [2024-11-20 01:31:29.750368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.797 [2024-11-20 01:31:29.750401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.797 qpair failed and we were unable to recover it. 00:30:21.797 [2024-11-20 01:31:29.750550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.797 [2024-11-20 01:31:29.750636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.797 [2024-11-20 01:31:29.750661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.797 qpair failed and we were unable to recover it. 00:30:21.797 [2024-11-20 01:31:29.750753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.797 [2024-11-20 01:31:29.750872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.797 [2024-11-20 01:31:29.750896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.797 qpair failed and we were unable to recover it. 00:30:21.797 [2024-11-20 01:31:29.751088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.797 [2024-11-20 01:31:29.751236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.797 [2024-11-20 01:31:29.751261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.797 qpair failed and we were unable to recover it. 00:30:21.797 [2024-11-20 01:31:29.751354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.797 [2024-11-20 01:31:29.751443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.797 [2024-11-20 01:31:29.751468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.797 qpair failed and we were unable to recover it. 00:30:21.797 [2024-11-20 01:31:29.751627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.797 [2024-11-20 01:31:29.751758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.797 [2024-11-20 01:31:29.751787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.797 qpair failed and we were unable to recover it. 00:30:21.797 [2024-11-20 01:31:29.751885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.797 [2024-11-20 01:31:29.752045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.797 [2024-11-20 01:31:29.752076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.797 qpair failed and we were unable to recover it. 00:30:21.797 [2024-11-20 01:31:29.752199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.797 [2024-11-20 01:31:29.752280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.797 [2024-11-20 01:31:29.752304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.797 qpair failed and we were unable to recover it. 00:30:21.797 [2024-11-20 01:31:29.752423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.797 [2024-11-20 01:31:29.752572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.797 [2024-11-20 01:31:29.752597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.797 qpair failed and we were unable to recover it. 00:30:21.797 [2024-11-20 01:31:29.752694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.797 [2024-11-20 01:31:29.752811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.797 [2024-11-20 01:31:29.752839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.797 qpair failed and we were unable to recover it. 00:30:21.797 [2024-11-20 01:31:29.752968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.797 [2024-11-20 01:31:29.753124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.797 [2024-11-20 01:31:29.753154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.797 qpair failed and we were unable to recover it. 00:30:21.797 [2024-11-20 01:31:29.753288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.797 [2024-11-20 01:31:29.753387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.797 [2024-11-20 01:31:29.753415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.797 qpair failed and we were unable to recover it. 00:30:21.797 [2024-11-20 01:31:29.753517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.797 [2024-11-20 01:31:29.753622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.797 [2024-11-20 01:31:29.753652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.797 qpair failed and we were unable to recover it. 00:30:21.797 [2024-11-20 01:31:29.753789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.797 [2024-11-20 01:31:29.753904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.798 [2024-11-20 01:31:29.753929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.798 qpair failed and we were unable to recover it. 00:30:21.798 [2024-11-20 01:31:29.754024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.798 [2024-11-20 01:31:29.754145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.798 [2024-11-20 01:31:29.754173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.798 qpair failed and we were unable to recover it. 00:30:21.798 [2024-11-20 01:31:29.754302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.798 [2024-11-20 01:31:29.754403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.798 [2024-11-20 01:31:29.754431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.798 qpair failed and we were unable to recover it. 00:30:21.798 [2024-11-20 01:31:29.754539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.798 [2024-11-20 01:31:29.754651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.798 [2024-11-20 01:31:29.754676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.798 qpair failed and we were unable to recover it. 00:30:21.798 [2024-11-20 01:31:29.754839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.798 [2024-11-20 01:31:29.754965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.798 [2024-11-20 01:31:29.754994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.798 qpair failed and we were unable to recover it. 00:30:21.798 [2024-11-20 01:31:29.755132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.798 [2024-11-20 01:31:29.755253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.798 [2024-11-20 01:31:29.755280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.798 qpair failed and we were unable to recover it. 00:30:21.798 [2024-11-20 01:31:29.755416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.798 [2024-11-20 01:31:29.755503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.798 [2024-11-20 01:31:29.755528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.798 qpair failed and we were unable to recover it. 00:30:21.798 [2024-11-20 01:31:29.755643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.798 [2024-11-20 01:31:29.755733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.798 [2024-11-20 01:31:29.755761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.798 qpair failed and we were unable to recover it. 00:30:21.798 [2024-11-20 01:31:29.755849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.798 [2024-11-20 01:31:29.755997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.798 [2024-11-20 01:31:29.756025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.798 qpair failed and we were unable to recover it. 00:30:21.798 [2024-11-20 01:31:29.756199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.798 [2024-11-20 01:31:29.756291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.798 [2024-11-20 01:31:29.756317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.798 qpair failed and we were unable to recover it. 00:30:21.798 [2024-11-20 01:31:29.756426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.798 [2024-11-20 01:31:29.756546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.798 [2024-11-20 01:31:29.756575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.798 qpair failed and we were unable to recover it. 00:30:21.798 [2024-11-20 01:31:29.756702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.798 [2024-11-20 01:31:29.756828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.798 [2024-11-20 01:31:29.756855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.798 qpair failed and we were unable to recover it. 00:30:21.798 [2024-11-20 01:31:29.756971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.798 [2024-11-20 01:31:29.757090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.798 [2024-11-20 01:31:29.757115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.798 qpair failed and we were unable to recover it. 00:30:21.798 [2024-11-20 01:31:29.757249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.798 [2024-11-20 01:31:29.757330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.798 [2024-11-20 01:31:29.757355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.798 qpair failed and we were unable to recover it. 00:30:21.798 [2024-11-20 01:31:29.757471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.798 [2024-11-20 01:31:29.757581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.798 [2024-11-20 01:31:29.757606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.798 qpair failed and we were unable to recover it. 00:30:21.798 [2024-11-20 01:31:29.757749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.798 [2024-11-20 01:31:29.757833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.798 [2024-11-20 01:31:29.757859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.798 qpair failed and we were unable to recover it. 00:30:21.798 [2024-11-20 01:31:29.757975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.798 [2024-11-20 01:31:29.758112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.798 [2024-11-20 01:31:29.758141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.798 qpair failed and we were unable to recover it. 00:30:21.798 [2024-11-20 01:31:29.758241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.798 [2024-11-20 01:31:29.758403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.798 [2024-11-20 01:31:29.758432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.798 qpair failed and we were unable to recover it. 00:30:21.798 [2024-11-20 01:31:29.758551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.798 [2024-11-20 01:31:29.758639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.798 [2024-11-20 01:31:29.758664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.798 qpair failed and we were unable to recover it. 00:30:21.798 [2024-11-20 01:31:29.758795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.798 [2024-11-20 01:31:29.758899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.798 [2024-11-20 01:31:29.758942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.798 qpair failed and we were unable to recover it. 00:30:21.798 [2024-11-20 01:31:29.759038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.798 [2024-11-20 01:31:29.759151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.798 [2024-11-20 01:31:29.759177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.798 qpair failed and we were unable to recover it. 00:30:21.798 [2024-11-20 01:31:29.759271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.798 [2024-11-20 01:31:29.759359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.798 [2024-11-20 01:31:29.759384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.798 qpair failed and we were unable to recover it. 00:30:21.798 [2024-11-20 01:31:29.759499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.798 [2024-11-20 01:31:29.759646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.798 [2024-11-20 01:31:29.759672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.798 qpair failed and we were unable to recover it. 00:30:21.798 [2024-11-20 01:31:29.759806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.798 [2024-11-20 01:31:29.759976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.798 [2024-11-20 01:31:29.760001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.798 qpair failed and we were unable to recover it. 00:30:21.798 [2024-11-20 01:31:29.760156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.798 [2024-11-20 01:31:29.760250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.798 [2024-11-20 01:31:29.760275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.798 qpair failed and we were unable to recover it. 00:30:21.798 [2024-11-20 01:31:29.760455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.798 [2024-11-20 01:31:29.760547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.798 [2024-11-20 01:31:29.760574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.798 qpair failed and we were unable to recover it. 00:30:21.798 [2024-11-20 01:31:29.760668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.798 [2024-11-20 01:31:29.760760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.798 [2024-11-20 01:31:29.760788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.798 qpair failed and we were unable to recover it. 00:30:21.798 [2024-11-20 01:31:29.760896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.798 [2024-11-20 01:31:29.760971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.798 [2024-11-20 01:31:29.760995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.799 qpair failed and we were unable to recover it. 00:30:21.799 [2024-11-20 01:31:29.761083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.799 [2024-11-20 01:31:29.761227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.799 [2024-11-20 01:31:29.761255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.799 qpair failed and we were unable to recover it. 00:30:21.799 [2024-11-20 01:31:29.761385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.799 [2024-11-20 01:31:29.761478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.799 [2024-11-20 01:31:29.761506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.799 qpair failed and we were unable to recover it. 00:30:21.799 [2024-11-20 01:31:29.761643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.799 [2024-11-20 01:31:29.761762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.799 [2024-11-20 01:31:29.761787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.799 qpair failed and we were unable to recover it. 00:30:21.799 [2024-11-20 01:31:29.761971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.799 [2024-11-20 01:31:29.762113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.799 [2024-11-20 01:31:29.762139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.799 qpair failed and we were unable to recover it. 00:30:21.799 [2024-11-20 01:31:29.762229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.799 [2024-11-20 01:31:29.762317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.799 [2024-11-20 01:31:29.762345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.799 qpair failed and we were unable to recover it. 00:30:21.799 [2024-11-20 01:31:29.762465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.799 [2024-11-20 01:31:29.762575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.799 [2024-11-20 01:31:29.762600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.799 qpair failed and we were unable to recover it. 00:30:21.799 [2024-11-20 01:31:29.762711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.799 [2024-11-20 01:31:29.762806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.799 [2024-11-20 01:31:29.762830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.799 qpair failed and we were unable to recover it. 00:30:21.799 [2024-11-20 01:31:29.762924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.799 [2024-11-20 01:31:29.763021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.799 [2024-11-20 01:31:29.763045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.799 qpair failed and we were unable to recover it. 00:30:21.799 [2024-11-20 01:31:29.763168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.799 [2024-11-20 01:31:29.763260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.799 [2024-11-20 01:31:29.763286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.799 qpair failed and we were unable to recover it. 00:30:21.799 [2024-11-20 01:31:29.763419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.799 [2024-11-20 01:31:29.763579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.799 [2024-11-20 01:31:29.763604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.799 qpair failed and we were unable to recover it. 00:30:21.799 [2024-11-20 01:31:29.763736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.799 [2024-11-20 01:31:29.763864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.799 [2024-11-20 01:31:29.763892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.799 qpair failed and we were unable to recover it. 00:30:21.799 [2024-11-20 01:31:29.764076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.799 [2024-11-20 01:31:29.764187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.799 [2024-11-20 01:31:29.764212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.799 qpair failed and we were unable to recover it. 00:30:21.799 [2024-11-20 01:31:29.764326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.799 [2024-11-20 01:31:29.764450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.799 [2024-11-20 01:31:29.764479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.799 qpair failed and we were unable to recover it. 00:30:21.799 [2024-11-20 01:31:29.764579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.799 [2024-11-20 01:31:29.764674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.799 [2024-11-20 01:31:29.764703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.799 qpair failed and we were unable to recover it. 00:30:21.799 [2024-11-20 01:31:29.764812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.799 [2024-11-20 01:31:29.764903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.799 [2024-11-20 01:31:29.764928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.799 qpair failed and we were unable to recover it. 00:30:21.799 [2024-11-20 01:31:29.765008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.799 [2024-11-20 01:31:29.765130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.799 [2024-11-20 01:31:29.765171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.799 qpair failed and we were unable to recover it. 00:30:21.799 [2024-11-20 01:31:29.765258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.799 [2024-11-20 01:31:29.765386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.799 [2024-11-20 01:31:29.765410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.799 qpair failed and we were unable to recover it. 00:30:21.799 [2024-11-20 01:31:29.765529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.799 [2024-11-20 01:31:29.765619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.799 [2024-11-20 01:31:29.765644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.799 qpair failed and we were unable to recover it. 00:30:21.799 [2024-11-20 01:31:29.765771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.799 [2024-11-20 01:31:29.765893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.799 [2024-11-20 01:31:29.765922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.799 qpair failed and we were unable to recover it. 00:30:21.799 [2024-11-20 01:31:29.766025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.799 [2024-11-20 01:31:29.766205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.799 [2024-11-20 01:31:29.766234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.799 qpair failed and we were unable to recover it. 00:30:21.799 [2024-11-20 01:31:29.766382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.799 [2024-11-20 01:31:29.766506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.799 [2024-11-20 01:31:29.766533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.799 qpair failed and we were unable to recover it. 00:30:21.799 [2024-11-20 01:31:29.766632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.799 [2024-11-20 01:31:29.766721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.799 [2024-11-20 01:31:29.766749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.799 qpair failed and we were unable to recover it. 00:30:21.799 [2024-11-20 01:31:29.766907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.799 [2024-11-20 01:31:29.767066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.799 [2024-11-20 01:31:29.767101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.799 qpair failed and we were unable to recover it. 00:30:21.799 [2024-11-20 01:31:29.767247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.799 [2024-11-20 01:31:29.767338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.799 [2024-11-20 01:31:29.767365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.799 qpair failed and we were unable to recover it. 00:30:21.799 [2024-11-20 01:31:29.767492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.799 [2024-11-20 01:31:29.767618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.799 [2024-11-20 01:31:29.767648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.799 qpair failed and we were unable to recover it. 00:30:21.799 [2024-11-20 01:31:29.767779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.799 [2024-11-20 01:31:29.767908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.799 [2024-11-20 01:31:29.767936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.799 qpair failed and we were unable to recover it. 00:30:21.799 [2024-11-20 01:31:29.768042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.799 [2024-11-20 01:31:29.768140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.799 [2024-11-20 01:31:29.768165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.799 qpair failed and we were unable to recover it. 00:30:21.800 [2024-11-20 01:31:29.768280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.800 [2024-11-20 01:31:29.768377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.800 [2024-11-20 01:31:29.768417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.800 qpair failed and we were unable to recover it. 00:30:21.800 [2024-11-20 01:31:29.768549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.800 [2024-11-20 01:31:29.768644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.800 [2024-11-20 01:31:29.768688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.800 qpair failed and we were unable to recover it. 00:30:21.800 [2024-11-20 01:31:29.768806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.800 [2024-11-20 01:31:29.768901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.800 [2024-11-20 01:31:29.768926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.800 qpair failed and we were unable to recover it. 00:30:21.800 [2024-11-20 01:31:29.769035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.800 [2024-11-20 01:31:29.769173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.800 [2024-11-20 01:31:29.769201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.800 qpair failed and we were unable to recover it. 00:30:21.800 [2024-11-20 01:31:29.769301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.800 [2024-11-20 01:31:29.769427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.800 [2024-11-20 01:31:29.769469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.800 qpair failed and we were unable to recover it. 00:30:21.800 [2024-11-20 01:31:29.769583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.800 [2024-11-20 01:31:29.769695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.800 [2024-11-20 01:31:29.769720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.800 qpair failed and we were unable to recover it. 00:30:21.800 [2024-11-20 01:31:29.769847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.800 [2024-11-20 01:31:29.770008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.800 [2024-11-20 01:31:29.770033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.800 qpair failed and we were unable to recover it. 00:30:21.800 [2024-11-20 01:31:29.770194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.800 [2024-11-20 01:31:29.770317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.800 [2024-11-20 01:31:29.770345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.800 qpair failed and we were unable to recover it. 00:30:21.800 [2024-11-20 01:31:29.770455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.800 [2024-11-20 01:31:29.770549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.800 [2024-11-20 01:31:29.770574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.800 qpair failed and we were unable to recover it. 00:30:21.800 [2024-11-20 01:31:29.770662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.800 [2024-11-20 01:31:29.770748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.800 [2024-11-20 01:31:29.770775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.800 qpair failed and we were unable to recover it. 00:30:21.800 [2024-11-20 01:31:29.770898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.800 [2024-11-20 01:31:29.770986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.800 [2024-11-20 01:31:29.771027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.800 qpair failed and we were unable to recover it. 00:30:21.800 [2024-11-20 01:31:29.771199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.800 [2024-11-20 01:31:29.771319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.800 [2024-11-20 01:31:29.771346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.800 qpair failed and we were unable to recover it. 00:30:21.800 [2024-11-20 01:31:29.771503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.800 [2024-11-20 01:31:29.771595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.800 [2024-11-20 01:31:29.771621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.800 qpair failed and we were unable to recover it. 00:30:21.800 [2024-11-20 01:31:29.771720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.800 [2024-11-20 01:31:29.771806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.800 [2024-11-20 01:31:29.771832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.800 qpair failed and we were unable to recover it. 00:30:21.800 [2024-11-20 01:31:29.771961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.800 [2024-11-20 01:31:29.772092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.800 [2024-11-20 01:31:29.772118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.800 qpair failed and we were unable to recover it. 00:30:21.800 [2024-11-20 01:31:29.772236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.800 [2024-11-20 01:31:29.772322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.800 [2024-11-20 01:31:29.772347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.800 qpair failed and we were unable to recover it. 00:30:21.800 [2024-11-20 01:31:29.772439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.800 [2024-11-20 01:31:29.772557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.800 [2024-11-20 01:31:29.772601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.800 qpair failed and we were unable to recover it. 00:30:21.800 [2024-11-20 01:31:29.772714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.800 [2024-11-20 01:31:29.772827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.800 [2024-11-20 01:31:29.772853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.800 qpair failed and we were unable to recover it. 00:30:21.800 [2024-11-20 01:31:29.772947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.800 [2024-11-20 01:31:29.773088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.800 [2024-11-20 01:31:29.773117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.800 qpair failed and we were unable to recover it. 00:30:21.800 [2024-11-20 01:31:29.773270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.800 [2024-11-20 01:31:29.773365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.800 [2024-11-20 01:31:29.773394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.800 qpair failed and we were unable to recover it. 00:30:21.800 [2024-11-20 01:31:29.773531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.800 [2024-11-20 01:31:29.773617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.800 [2024-11-20 01:31:29.773642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.800 qpair failed and we were unable to recover it. 00:30:21.800 [2024-11-20 01:31:29.773776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.800 [2024-11-20 01:31:29.773875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.800 [2024-11-20 01:31:29.773903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.800 qpair failed and we were unable to recover it. 00:30:21.800 [2024-11-20 01:31:29.773992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.800 [2024-11-20 01:31:29.774110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.800 [2024-11-20 01:31:29.774139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.800 qpair failed and we were unable to recover it. 00:30:21.800 [2024-11-20 01:31:29.774262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.800 [2024-11-20 01:31:29.774382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.800 [2024-11-20 01:31:29.774407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.800 qpair failed and we were unable to recover it. 00:30:21.800 [2024-11-20 01:31:29.774520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.800 [2024-11-20 01:31:29.774638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.800 [2024-11-20 01:31:29.774663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.800 qpair failed and we were unable to recover it. 00:30:21.800 [2024-11-20 01:31:29.774750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.800 [2024-11-20 01:31:29.774833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.800 [2024-11-20 01:31:29.774858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.800 qpair failed and we were unable to recover it. 00:30:21.800 [2024-11-20 01:31:29.774961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.800 [2024-11-20 01:31:29.775086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.800 [2024-11-20 01:31:29.775129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.800 qpair failed and we were unable to recover it. 00:30:21.800 [2024-11-20 01:31:29.775252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.800 [2024-11-20 01:31:29.775380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.800 [2024-11-20 01:31:29.775407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.800 qpair failed and we were unable to recover it. 00:30:21.800 [2024-11-20 01:31:29.775538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.800 [2024-11-20 01:31:29.775680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.801 [2024-11-20 01:31:29.775704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.801 qpair failed and we were unable to recover it. 00:30:21.801 [2024-11-20 01:31:29.775851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.801 [2024-11-20 01:31:29.775969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.801 [2024-11-20 01:31:29.775994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.801 qpair failed and we were unable to recover it. 00:30:21.801 [2024-11-20 01:31:29.776113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.801 [2024-11-20 01:31:29.776214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.801 [2024-11-20 01:31:29.776242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.801 qpair failed and we were unable to recover it. 00:30:21.801 [2024-11-20 01:31:29.776403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.801 [2024-11-20 01:31:29.776530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.801 [2024-11-20 01:31:29.776557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.801 qpair failed and we were unable to recover it. 00:30:21.801 [2024-11-20 01:31:29.776689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.801 [2024-11-20 01:31:29.776774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.801 [2024-11-20 01:31:29.776801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.801 qpair failed and we were unable to recover it. 00:30:21.801 [2024-11-20 01:31:29.776892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.801 [2024-11-20 01:31:29.777040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.801 [2024-11-20 01:31:29.777065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.801 qpair failed and we were unable to recover it. 00:30:21.801 [2024-11-20 01:31:29.777167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.801 [2024-11-20 01:31:29.777254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.801 [2024-11-20 01:31:29.777296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.801 qpair failed and we were unable to recover it. 00:30:21.801 [2024-11-20 01:31:29.777432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.801 [2024-11-20 01:31:29.777519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.801 [2024-11-20 01:31:29.777543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.801 qpair failed and we were unable to recover it. 00:30:21.801 [2024-11-20 01:31:29.777635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.801 [2024-11-20 01:31:29.777769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.801 [2024-11-20 01:31:29.777797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.801 qpair failed and we were unable to recover it. 00:30:21.801 [2024-11-20 01:31:29.777933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.801 [2024-11-20 01:31:29.778094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.801 [2024-11-20 01:31:29.778119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.801 qpair failed and we were unable to recover it. 00:30:21.801 [2024-11-20 01:31:29.778207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.801 [2024-11-20 01:31:29.778325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.801 [2024-11-20 01:31:29.778350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.801 qpair failed and we were unable to recover it. 00:30:21.801 [2024-11-20 01:31:29.778438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.801 [2024-11-20 01:31:29.778522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.801 [2024-11-20 01:31:29.778547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.801 qpair failed and we were unable to recover it. 00:30:21.801 [2024-11-20 01:31:29.778675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.801 [2024-11-20 01:31:29.778835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.801 [2024-11-20 01:31:29.778859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.801 qpair failed and we were unable to recover it. 00:30:21.801 [2024-11-20 01:31:29.779012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.801 [2024-11-20 01:31:29.779092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.801 [2024-11-20 01:31:29.779118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.801 qpair failed and we were unable to recover it. 00:30:21.801 [2024-11-20 01:31:29.779286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.801 [2024-11-20 01:31:29.779476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.801 [2024-11-20 01:31:29.779525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.801 qpair failed and we were unable to recover it. 00:30:21.801 [2024-11-20 01:31:29.779676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.801 [2024-11-20 01:31:29.779827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.801 [2024-11-20 01:31:29.779852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.801 qpair failed and we were unable to recover it. 00:30:21.801 [2024-11-20 01:31:29.779950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.801 [2024-11-20 01:31:29.780065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.801 [2024-11-20 01:31:29.780100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.801 qpair failed and we were unable to recover it. 00:30:21.801 [2024-11-20 01:31:29.780268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.801 [2024-11-20 01:31:29.780399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.801 [2024-11-20 01:31:29.780427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.801 qpair failed and we were unable to recover it. 00:30:21.801 [2024-11-20 01:31:29.780563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.801 [2024-11-20 01:31:29.780704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.801 [2024-11-20 01:31:29.780729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.801 qpair failed and we were unable to recover it. 00:30:21.801 [2024-11-20 01:31:29.780852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.801 [2024-11-20 01:31:29.780965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.801 [2024-11-20 01:31:29.780990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.801 qpair failed and we were unable to recover it. 00:30:21.801 [2024-11-20 01:31:29.781142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.801 [2024-11-20 01:31:29.781285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.801 [2024-11-20 01:31:29.781311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.801 qpair failed and we were unable to recover it. 00:30:21.801 [2024-11-20 01:31:29.781403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.802 [2024-11-20 01:31:29.781524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.802 [2024-11-20 01:31:29.781552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.802 qpair failed and we were unable to recover it. 00:30:21.802 [2024-11-20 01:31:29.781691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.802 [2024-11-20 01:31:29.781790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.802 [2024-11-20 01:31:29.781818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.802 qpair failed and we were unable to recover it. 00:30:21.802 [2024-11-20 01:31:29.781904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.802 [2024-11-20 01:31:29.782019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.802 [2024-11-20 01:31:29.782044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.802 qpair failed and we were unable to recover it. 00:30:21.802 [2024-11-20 01:31:29.782172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.802 [2024-11-20 01:31:29.782318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.802 [2024-11-20 01:31:29.782346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.802 qpair failed and we were unable to recover it. 00:30:21.802 [2024-11-20 01:31:29.782457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.802 [2024-11-20 01:31:29.782551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.802 [2024-11-20 01:31:29.782577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.802 qpair failed and we were unable to recover it. 00:30:21.802 [2024-11-20 01:31:29.782695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.802 [2024-11-20 01:31:29.782853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.802 [2024-11-20 01:31:29.782881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.802 qpair failed and we were unable to recover it. 00:30:21.802 [2024-11-20 01:31:29.783056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.802 [2024-11-20 01:31:29.783152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.802 [2024-11-20 01:31:29.783178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.802 qpair failed and we were unable to recover it. 00:30:21.802 [2024-11-20 01:31:29.783274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.802 [2024-11-20 01:31:29.783363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.802 [2024-11-20 01:31:29.783388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.802 qpair failed and we were unable to recover it. 00:30:21.802 [2024-11-20 01:31:29.783503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.802 [2024-11-20 01:31:29.783657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.802 [2024-11-20 01:31:29.783684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.802 qpair failed and we were unable to recover it. 00:30:21.802 [2024-11-20 01:31:29.783789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.802 [2024-11-20 01:31:29.783880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.802 [2024-11-20 01:31:29.783907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.802 qpair failed and we were unable to recover it. 00:30:21.802 [2024-11-20 01:31:29.784041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.802 [2024-11-20 01:31:29.784161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.802 [2024-11-20 01:31:29.784186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.802 qpair failed and we were unable to recover it. 00:30:21.802 [2024-11-20 01:31:29.784341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.802 [2024-11-20 01:31:29.784461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.802 [2024-11-20 01:31:29.784486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.802 qpair failed and we were unable to recover it. 00:30:21.802 [2024-11-20 01:31:29.784614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.802 [2024-11-20 01:31:29.784701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.802 [2024-11-20 01:31:29.784742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.802 qpair failed and we were unable to recover it. 00:30:21.802 [2024-11-20 01:31:29.784876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.802 [2024-11-20 01:31:29.784957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.802 [2024-11-20 01:31:29.784982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.802 qpair failed and we were unable to recover it. 00:30:21.802 [2024-11-20 01:31:29.785121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.802 [2024-11-20 01:31:29.785230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.802 [2024-11-20 01:31:29.785258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.802 qpair failed and we were unable to recover it. 00:30:21.802 [2024-11-20 01:31:29.785394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.802 [2024-11-20 01:31:29.785511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.802 [2024-11-20 01:31:29.785536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.802 qpair failed and we were unable to recover it. 00:30:21.802 [2024-11-20 01:31:29.785680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.802 [2024-11-20 01:31:29.785773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.802 [2024-11-20 01:31:29.785798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.802 qpair failed and we were unable to recover it. 00:30:21.802 [2024-11-20 01:31:29.785907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.802 [2024-11-20 01:31:29.786038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.802 [2024-11-20 01:31:29.786066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.802 qpair failed and we were unable to recover it. 00:30:21.802 [2024-11-20 01:31:29.786180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.802 [2024-11-20 01:31:29.786307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.802 [2024-11-20 01:31:29.786335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.802 qpair failed and we were unable to recover it. 00:30:21.802 [2024-11-20 01:31:29.786439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.802 [2024-11-20 01:31:29.786584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.802 [2024-11-20 01:31:29.786609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.802 qpair failed and we were unable to recover it. 00:30:21.802 [2024-11-20 01:31:29.786750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.802 [2024-11-20 01:31:29.786870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.802 [2024-11-20 01:31:29.786897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.802 qpair failed and we were unable to recover it. 00:30:21.802 [2024-11-20 01:31:29.787036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.802 [2024-11-20 01:31:29.787188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.802 [2024-11-20 01:31:29.787215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.802 qpair failed and we were unable to recover it. 00:30:21.802 [2024-11-20 01:31:29.787332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.802 [2024-11-20 01:31:29.787448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.802 [2024-11-20 01:31:29.787475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.802 qpair failed and we were unable to recover it. 00:30:21.802 [2024-11-20 01:31:29.787623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.802 [2024-11-20 01:31:29.787762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.802 [2024-11-20 01:31:29.787789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.802 qpair failed and we were unable to recover it. 00:30:21.802 [2024-11-20 01:31:29.787887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.802 [2024-11-20 01:31:29.787988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.802 [2024-11-20 01:31:29.788017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.802 qpair failed and we were unable to recover it. 00:30:21.802 [2024-11-20 01:31:29.788160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.802 [2024-11-20 01:31:29.788255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.802 [2024-11-20 01:31:29.788280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.802 qpair failed and we were unable to recover it. 00:30:21.802 [2024-11-20 01:31:29.788397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.803 [2024-11-20 01:31:29.788479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.803 [2024-11-20 01:31:29.788505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.803 qpair failed and we were unable to recover it. 00:30:21.803 [2024-11-20 01:31:29.788661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.803 [2024-11-20 01:31:29.788794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.803 [2024-11-20 01:31:29.788821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.803 qpair failed and we were unable to recover it. 00:30:21.803 [2024-11-20 01:31:29.788985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.803 [2024-11-20 01:31:29.789083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.803 [2024-11-20 01:31:29.789126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.803 qpair failed and we were unable to recover it. 00:30:21.803 [2024-11-20 01:31:29.789250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.803 [2024-11-20 01:31:29.789348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.803 [2024-11-20 01:31:29.789374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.803 qpair failed and we were unable to recover it. 00:30:21.803 [2024-11-20 01:31:29.789459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.803 [2024-11-20 01:31:29.789597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.803 [2024-11-20 01:31:29.789624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.803 qpair failed and we were unable to recover it. 00:30:21.803 [2024-11-20 01:31:29.789744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.803 [2024-11-20 01:31:29.789864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.803 [2024-11-20 01:31:29.789888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.803 qpair failed and we were unable to recover it. 00:30:21.803 [2024-11-20 01:31:29.789971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.803 [2024-11-20 01:31:29.790088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.803 [2024-11-20 01:31:29.790114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.803 qpair failed and we were unable to recover it. 00:30:21.803 [2024-11-20 01:31:29.790209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.803 [2024-11-20 01:31:29.790290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.803 [2024-11-20 01:31:29.790314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.803 qpair failed and we were unable to recover it. 00:30:21.803 [2024-11-20 01:31:29.790401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.803 [2024-11-20 01:31:29.790519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.803 [2024-11-20 01:31:29.790547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.803 qpair failed and we were unable to recover it. 00:30:21.803 [2024-11-20 01:31:29.790718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.803 [2024-11-20 01:31:29.790851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.803 [2024-11-20 01:31:29.790895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.803 qpair failed and we were unable to recover it. 00:30:21.803 [2024-11-20 01:31:29.791048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.803 [2024-11-20 01:31:29.791176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.803 [2024-11-20 01:31:29.791202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.803 qpair failed and we were unable to recover it. 00:30:21.803 [2024-11-20 01:31:29.791345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.803 [2024-11-20 01:31:29.791466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.803 [2024-11-20 01:31:29.791492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.803 qpair failed and we were unable to recover it. 00:30:21.803 [2024-11-20 01:31:29.791597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.803 [2024-11-20 01:31:29.791721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.803 [2024-11-20 01:31:29.791749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.803 qpair failed and we were unable to recover it. 00:30:21.803 [2024-11-20 01:31:29.791890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.803 [2024-11-20 01:31:29.792007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.803 [2024-11-20 01:31:29.792032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.803 qpair failed and we were unable to recover it. 00:30:21.803 [2024-11-20 01:31:29.792130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.803 [2024-11-20 01:31:29.792246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.803 [2024-11-20 01:31:29.792271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.803 qpair failed and we were unable to recover it. 00:30:21.803 [2024-11-20 01:31:29.792418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.803 [2024-11-20 01:31:29.792519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.803 [2024-11-20 01:31:29.792546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.803 qpair failed and we were unable to recover it. 00:30:21.803 [2024-11-20 01:31:29.792710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.803 [2024-11-20 01:31:29.792854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.803 [2024-11-20 01:31:29.792879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.803 qpair failed and we were unable to recover it. 00:30:21.803 [2024-11-20 01:31:29.792976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.803 [2024-11-20 01:31:29.793082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.803 [2024-11-20 01:31:29.793118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.803 qpair failed and we were unable to recover it. 00:30:21.803 [2024-11-20 01:31:29.793219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.803 [2024-11-20 01:31:29.793328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.803 [2024-11-20 01:31:29.793357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.803 qpair failed and we were unable to recover it. 00:30:21.803 [2024-11-20 01:31:29.793469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.803 [2024-11-20 01:31:29.793604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.803 [2024-11-20 01:31:29.793628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.803 qpair failed and we were unable to recover it. 00:30:21.803 [2024-11-20 01:31:29.793737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.803 [2024-11-20 01:31:29.793861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.803 [2024-11-20 01:31:29.793886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.803 qpair failed and we were unable to recover it. 00:30:21.803 [2024-11-20 01:31:29.793980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.803 [2024-11-20 01:31:29.794093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.803 [2024-11-20 01:31:29.794130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.803 qpair failed and we were unable to recover it. 00:30:21.803 [2024-11-20 01:31:29.794216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.803 [2024-11-20 01:31:29.794323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.803 [2024-11-20 01:31:29.794347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.803 qpair failed and we were unable to recover it. 00:30:21.803 [2024-11-20 01:31:29.794469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.803 [2024-11-20 01:31:29.794580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.803 [2024-11-20 01:31:29.794605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.803 qpair failed and we were unable to recover it. 00:30:21.803 [2024-11-20 01:31:29.794760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.803 [2024-11-20 01:31:29.794876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.803 [2024-11-20 01:31:29.794901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.803 qpair failed and we were unable to recover it. 00:30:21.803 [2024-11-20 01:31:29.794998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.803 [2024-11-20 01:31:29.795120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.803 [2024-11-20 01:31:29.795164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.803 qpair failed and we were unable to recover it. 00:30:21.803 [2024-11-20 01:31:29.795254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.803 [2024-11-20 01:31:29.795331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.803 [2024-11-20 01:31:29.795355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.803 qpair failed and we were unable to recover it. 00:30:21.803 [2024-11-20 01:31:29.795471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.803 [2024-11-20 01:31:29.795630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.803 [2024-11-20 01:31:29.795656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.803 qpair failed and we were unable to recover it. 00:30:21.803 [2024-11-20 01:31:29.795800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.803 [2024-11-20 01:31:29.795936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.804 [2024-11-20 01:31:29.795969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.804 qpair failed and we were unable to recover it. 00:30:21.804 [2024-11-20 01:31:29.796110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.804 [2024-11-20 01:31:29.796207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.804 [2024-11-20 01:31:29.796232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.804 qpair failed and we were unable to recover it. 00:30:21.804 [2024-11-20 01:31:29.796375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.804 [2024-11-20 01:31:29.796515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.804 [2024-11-20 01:31:29.796541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.804 qpair failed and we were unable to recover it. 00:30:21.804 [2024-11-20 01:31:29.796628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.804 [2024-11-20 01:31:29.796747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.804 [2024-11-20 01:31:29.796774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.804 qpair failed and we were unable to recover it. 00:30:21.804 [2024-11-20 01:31:29.796919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.804 [2024-11-20 01:31:29.797013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.804 [2024-11-20 01:31:29.797040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.804 qpair failed and we were unable to recover it. 00:30:21.804 [2024-11-20 01:31:29.797178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.804 [2024-11-20 01:31:29.797269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.804 [2024-11-20 01:31:29.797295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.804 qpair failed and we were unable to recover it. 00:30:21.804 [2024-11-20 01:31:29.797390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.804 [2024-11-20 01:31:29.797539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.804 [2024-11-20 01:31:29.797565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.804 qpair failed and we were unable to recover it. 00:30:21.804 [2024-11-20 01:31:29.797702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.804 [2024-11-20 01:31:29.797819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.804 [2024-11-20 01:31:29.797843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.804 qpair failed and we were unable to recover it. 00:30:21.804 [2024-11-20 01:31:29.797984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.804 [2024-11-20 01:31:29.798104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.804 [2024-11-20 01:31:29.798157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.804 qpair failed and we were unable to recover it. 00:30:21.804 [2024-11-20 01:31:29.798271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.804 [2024-11-20 01:31:29.798388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.804 [2024-11-20 01:31:29.798432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.804 qpair failed and we were unable to recover it. 00:30:21.804 [2024-11-20 01:31:29.798596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.804 [2024-11-20 01:31:29.798690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.804 [2024-11-20 01:31:29.798719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.804 qpair failed and we were unable to recover it. 00:30:21.804 [2024-11-20 01:31:29.798882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.804 [2024-11-20 01:31:29.798972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.804 [2024-11-20 01:31:29.798999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.804 qpair failed and we were unable to recover it. 00:30:21.804 [2024-11-20 01:31:29.799091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.804 [2024-11-20 01:31:29.799235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.804 [2024-11-20 01:31:29.799260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.804 qpair failed and we were unable to recover it. 00:30:21.804 [2024-11-20 01:31:29.799384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.804 [2024-11-20 01:31:29.799472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.804 [2024-11-20 01:31:29.799497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.804 qpair failed and we were unable to recover it. 00:30:21.804 [2024-11-20 01:31:29.799600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.804 [2024-11-20 01:31:29.799698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.804 [2024-11-20 01:31:29.799726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.804 qpair failed and we were unable to recover it. 00:30:21.804 [2024-11-20 01:31:29.799858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.804 [2024-11-20 01:31:29.799992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.804 [2024-11-20 01:31:29.800020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.804 qpair failed and we were unable to recover it. 00:30:21.804 [2024-11-20 01:31:29.800171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.804 [2024-11-20 01:31:29.800290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.804 [2024-11-20 01:31:29.800314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.804 qpair failed and we were unable to recover it. 00:30:21.804 [2024-11-20 01:31:29.800463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.804 [2024-11-20 01:31:29.800628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.804 [2024-11-20 01:31:29.800656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.804 qpair failed and we were unable to recover it. 00:30:21.804 [2024-11-20 01:31:29.800786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.804 [2024-11-20 01:31:29.800874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.804 [2024-11-20 01:31:29.800902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.804 qpair failed and we were unable to recover it. 00:30:21.804 [2024-11-20 01:31:29.801011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.804 [2024-11-20 01:31:29.801119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.804 [2024-11-20 01:31:29.801145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.804 qpair failed and we were unable to recover it. 00:30:21.804 [2024-11-20 01:31:29.801234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.804 [2024-11-20 01:31:29.801349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.804 [2024-11-20 01:31:29.801381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.804 qpair failed and we were unable to recover it. 00:30:21.804 [2024-11-20 01:31:29.801522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.804 [2024-11-20 01:31:29.801692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.804 [2024-11-20 01:31:29.801717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.804 qpair failed and we were unable to recover it. 00:30:21.804 [2024-11-20 01:31:29.801865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.804 [2024-11-20 01:31:29.801957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.804 [2024-11-20 01:31:29.801981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.804 qpair failed and we were unable to recover it. 00:30:21.804 [2024-11-20 01:31:29.802123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.804 [2024-11-20 01:31:29.802225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.804 [2024-11-20 01:31:29.802250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.804 qpair failed and we were unable to recover it. 00:30:21.804 [2024-11-20 01:31:29.802333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.804 [2024-11-20 01:31:29.802478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.804 [2024-11-20 01:31:29.802507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.804 qpair failed and we were unable to recover it. 00:30:21.804 [2024-11-20 01:31:29.802648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.804 [2024-11-20 01:31:29.802745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.804 [2024-11-20 01:31:29.802770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.804 qpair failed and we were unable to recover it. 00:30:21.804 [2024-11-20 01:31:29.802858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.804 [2024-11-20 01:31:29.802970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.804 [2024-11-20 01:31:29.802995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.804 qpair failed and we were unable to recover it. 00:30:21.804 [2024-11-20 01:31:29.803089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.804 [2024-11-20 01:31:29.803206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.804 [2024-11-20 01:31:29.803232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.804 qpair failed and we were unable to recover it. 00:30:21.804 [2024-11-20 01:31:29.803347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.805 [2024-11-20 01:31:29.803438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.805 [2024-11-20 01:31:29.803463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.805 qpair failed and we were unable to recover it. 00:30:21.805 [2024-11-20 01:31:29.803568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.805 [2024-11-20 01:31:29.803702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.805 [2024-11-20 01:31:29.803726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.805 qpair failed and we were unable to recover it. 00:30:21.805 [2024-11-20 01:31:29.803843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.805 [2024-11-20 01:31:29.803997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.805 [2024-11-20 01:31:29.804025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.805 qpair failed and we were unable to recover it. 00:30:21.805 [2024-11-20 01:31:29.804164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.805 [2024-11-20 01:31:29.804281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.805 [2024-11-20 01:31:29.804306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:21.805 qpair failed and we were unable to recover it. 00:30:21.805 [2024-11-20 01:31:29.804496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.805 [2024-11-20 01:31:29.804637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.805 [2024-11-20 01:31:29.804667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.805 qpair failed and we were unable to recover it. 00:30:21.805 [2024-11-20 01:31:29.804764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.805 [2024-11-20 01:31:29.804868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.805 [2024-11-20 01:31:29.804896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.805 qpair failed and we were unable to recover it. 00:30:21.805 [2024-11-20 01:31:29.805038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.805 [2024-11-20 01:31:29.805142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.805 [2024-11-20 01:31:29.805177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.805 qpair failed and we were unable to recover it. 00:30:21.805 [2024-11-20 01:31:29.805298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.805 [2024-11-20 01:31:29.805388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.805 [2024-11-20 01:31:29.805413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.805 qpair failed and we were unable to recover it. 00:30:21.805 [2024-11-20 01:31:29.805574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.805 [2024-11-20 01:31:29.805704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.805 [2024-11-20 01:31:29.805732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.805 qpair failed and we were unable to recover it. 00:30:21.805 [2024-11-20 01:31:29.805841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.805 [2024-11-20 01:31:29.805951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.805 [2024-11-20 01:31:29.805976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.805 qpair failed and we were unable to recover it. 00:30:21.805 [2024-11-20 01:31:29.806115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.805 [2024-11-20 01:31:29.806223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.805 [2024-11-20 01:31:29.806249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.805 qpair failed and we were unable to recover it. 00:30:21.805 [2024-11-20 01:31:29.806338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.805 [2024-11-20 01:31:29.806449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.805 [2024-11-20 01:31:29.806490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.805 qpair failed and we were unable to recover it. 00:30:21.805 [2024-11-20 01:31:29.806609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.805 [2024-11-20 01:31:29.806751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.805 [2024-11-20 01:31:29.806776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.805 qpair failed and we were unable to recover it. 00:30:21.805 [2024-11-20 01:31:29.806937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.805 [2024-11-20 01:31:29.807120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.805 [2024-11-20 01:31:29.807146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.805 qpair failed and we were unable to recover it. 00:30:21.805 [2024-11-20 01:31:29.807266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.805 [2024-11-20 01:31:29.807412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.805 [2024-11-20 01:31:29.807438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.805 qpair failed and we were unable to recover it. 00:30:21.805 [2024-11-20 01:31:29.807554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.805 [2024-11-20 01:31:29.807669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.805 [2024-11-20 01:31:29.807694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.805 qpair failed and we were unable to recover it. 00:30:21.805 [2024-11-20 01:31:29.807830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.805 [2024-11-20 01:31:29.807985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.805 [2024-11-20 01:31:29.808013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.805 qpair failed and we were unable to recover it. 00:30:21.805 [2024-11-20 01:31:29.808149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.805 [2024-11-20 01:31:29.808269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.805 [2024-11-20 01:31:29.808295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.805 qpair failed and we were unable to recover it. 00:30:21.805 [2024-11-20 01:31:29.808444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.805 [2024-11-20 01:31:29.808567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.805 [2024-11-20 01:31:29.808592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.805 qpair failed and we were unable to recover it. 00:30:21.805 [2024-11-20 01:31:29.808733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.805 [2024-11-20 01:31:29.808859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.805 [2024-11-20 01:31:29.808887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.805 qpair failed and we were unable to recover it. 00:30:21.805 [2024-11-20 01:31:29.808984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.805 [2024-11-20 01:31:29.809141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.805 [2024-11-20 01:31:29.809166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.805 qpair failed and we were unable to recover it. 00:30:21.805 [2024-11-20 01:31:29.809286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.805 [2024-11-20 01:31:29.809433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.805 [2024-11-20 01:31:29.809457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.805 qpair failed and we were unable to recover it. 00:30:21.805 [2024-11-20 01:31:29.809598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.805 [2024-11-20 01:31:29.809727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.805 [2024-11-20 01:31:29.809754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.805 qpair failed and we were unable to recover it. 00:30:21.805 [2024-11-20 01:31:29.809884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.805 [2024-11-20 01:31:29.809987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.806 [2024-11-20 01:31:29.810016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.806 qpair failed and we were unable to recover it. 00:30:21.806 [2024-11-20 01:31:29.810175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.806 [2024-11-20 01:31:29.810293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.806 [2024-11-20 01:31:29.810318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.806 qpair failed and we were unable to recover it. 00:30:21.806 [2024-11-20 01:31:29.810458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.806 [2024-11-20 01:31:29.810583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.806 [2024-11-20 01:31:29.810611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.806 qpair failed and we were unable to recover it. 00:30:21.806 [2024-11-20 01:31:29.810761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.806 [2024-11-20 01:31:29.810855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.806 [2024-11-20 01:31:29.810883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.806 qpair failed and we were unable to recover it. 00:30:21.806 [2024-11-20 01:31:29.811031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.806 [2024-11-20 01:31:29.811153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.806 [2024-11-20 01:31:29.811179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.806 qpair failed and we were unable to recover it. 00:30:21.806 [2024-11-20 01:31:29.811321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.806 [2024-11-20 01:31:29.811470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.806 [2024-11-20 01:31:29.811498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.806 qpair failed and we were unable to recover it. 00:30:21.806 [2024-11-20 01:31:29.811670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.806 [2024-11-20 01:31:29.811789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.806 [2024-11-20 01:31:29.811814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.806 qpair failed and we were unable to recover it. 00:30:21.806 [2024-11-20 01:31:29.811935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.806 [2024-11-20 01:31:29.812053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.806 [2024-11-20 01:31:29.812083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.806 qpair failed and we were unable to recover it. 00:30:21.806 [2024-11-20 01:31:29.812199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.806 [2024-11-20 01:31:29.812280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.806 [2024-11-20 01:31:29.812305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.806 qpair failed and we were unable to recover it. 00:30:21.806 [2024-11-20 01:31:29.812478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.806 [2024-11-20 01:31:29.812591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.806 [2024-11-20 01:31:29.812616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.806 qpair failed and we were unable to recover it. 00:30:21.806 [2024-11-20 01:31:29.812734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.806 [2024-11-20 01:31:29.812822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.806 [2024-11-20 01:31:29.812847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.806 qpair failed and we were unable to recover it. 00:30:21.806 [2024-11-20 01:31:29.812983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.806 [2024-11-20 01:31:29.813125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.806 [2024-11-20 01:31:29.813152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.806 qpair failed and we were unable to recover it. 00:30:21.806 [2024-11-20 01:31:29.813275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.806 [2024-11-20 01:31:29.813388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.806 [2024-11-20 01:31:29.813429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.806 qpair failed and we were unable to recover it. 00:30:21.806 [2024-11-20 01:31:29.813564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.806 [2024-11-20 01:31:29.813692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.806 [2024-11-20 01:31:29.813718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.806 qpair failed and we were unable to recover it. 00:30:21.806 [2024-11-20 01:31:29.813879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.806 [2024-11-20 01:31:29.813977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.806 [2024-11-20 01:31:29.814005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.806 qpair failed and we were unable to recover it. 00:30:21.806 [2024-11-20 01:31:29.814096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.806 [2024-11-20 01:31:29.814206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.806 [2024-11-20 01:31:29.814231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.806 qpair failed and we were unable to recover it. 00:30:21.806 [2024-11-20 01:31:29.814349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.806 [2024-11-20 01:31:29.814439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.806 [2024-11-20 01:31:29.814464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.806 qpair failed and we were unable to recover it. 00:30:21.806 [2024-11-20 01:31:29.814551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.806 [2024-11-20 01:31:29.814668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.806 [2024-11-20 01:31:29.814694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.806 qpair failed and we were unable to recover it. 00:30:21.806 [2024-11-20 01:31:29.814782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.806 [2024-11-20 01:31:29.814925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.806 [2024-11-20 01:31:29.814950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.806 qpair failed and we were unable to recover it. 00:30:21.806 [2024-11-20 01:31:29.815077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.806 [2024-11-20 01:31:29.815167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.806 [2024-11-20 01:31:29.815192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.806 qpair failed and we were unable to recover it. 00:30:21.806 [2024-11-20 01:31:29.815308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.806 [2024-11-20 01:31:29.815474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.806 [2024-11-20 01:31:29.815507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.806 qpair failed and we were unable to recover it. 00:30:21.806 [2024-11-20 01:31:29.815672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.806 [2024-11-20 01:31:29.815788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.806 [2024-11-20 01:31:29.815828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.806 qpair failed and we were unable to recover it. 00:30:21.806 [2024-11-20 01:31:29.816005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.806 [2024-11-20 01:31:29.816154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.806 [2024-11-20 01:31:29.816180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.807 qpair failed and we were unable to recover it. 00:30:21.807 [2024-11-20 01:31:29.816262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.807 [2024-11-20 01:31:29.816382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.807 [2024-11-20 01:31:29.816423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.807 qpair failed and we were unable to recover it. 00:30:21.807 [2024-11-20 01:31:29.816518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.807 [2024-11-20 01:31:29.816662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.807 [2024-11-20 01:31:29.816687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.807 qpair failed and we were unable to recover it. 00:30:21.807 [2024-11-20 01:31:29.816797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.807 [2024-11-20 01:31:29.816911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.807 [2024-11-20 01:31:29.816936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.807 qpair failed and we were unable to recover it. 00:30:21.807 [2024-11-20 01:31:29.817052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.807 [2024-11-20 01:31:29.817186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.807 [2024-11-20 01:31:29.817212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.807 qpair failed and we were unable to recover it. 00:30:21.807 [2024-11-20 01:31:29.817300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.807 [2024-11-20 01:31:29.817406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.807 [2024-11-20 01:31:29.817434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.807 qpair failed and we were unable to recover it. 00:30:21.807 [2024-11-20 01:31:29.817538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.807 [2024-11-20 01:31:29.817679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.807 [2024-11-20 01:31:29.817704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.807 qpair failed and we were unable to recover it. 00:30:21.807 [2024-11-20 01:31:29.817830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.807 [2024-11-20 01:31:29.817916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.807 [2024-11-20 01:31:29.817941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.807 qpair failed and we were unable to recover it. 00:30:21.807 [2024-11-20 01:31:29.818025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.807 [2024-11-20 01:31:29.818181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.807 [2024-11-20 01:31:29.818207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.807 qpair failed and we were unable to recover it. 00:30:21.807 [2024-11-20 01:31:29.818334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.807 [2024-11-20 01:31:29.818452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.807 [2024-11-20 01:31:29.818478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.807 qpair failed and we were unable to recover it. 00:30:21.807 [2024-11-20 01:31:29.818619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.807 [2024-11-20 01:31:29.818704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.807 [2024-11-20 01:31:29.818732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.807 qpair failed and we were unable to recover it. 00:30:21.807 [2024-11-20 01:31:29.818863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.807 [2024-11-20 01:31:29.818956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.807 [2024-11-20 01:31:29.818984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.807 qpair failed and we were unable to recover it. 00:30:21.807 [2024-11-20 01:31:29.819099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.807 [2024-11-20 01:31:29.819223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.807 [2024-11-20 01:31:29.819248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.807 qpair failed and we were unable to recover it. 00:30:21.807 [2024-11-20 01:31:29.819366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.807 [2024-11-20 01:31:29.819481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.807 [2024-11-20 01:31:29.819506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.807 qpair failed and we were unable to recover it. 00:30:21.807 [2024-11-20 01:31:29.819588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.807 [2024-11-20 01:31:29.819695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.807 [2024-11-20 01:31:29.819723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.807 qpair failed and we were unable to recover it. 00:30:21.807 [2024-11-20 01:31:29.819828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.807 [2024-11-20 01:31:29.819961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.807 [2024-11-20 01:31:29.819989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.807 qpair failed and we were unable to recover it. 00:30:21.807 [2024-11-20 01:31:29.820124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.807 [2024-11-20 01:31:29.820235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.807 [2024-11-20 01:31:29.820260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.807 qpair failed and we were unable to recover it. 00:30:21.807 [2024-11-20 01:31:29.820353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.807 [2024-11-20 01:31:29.820464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.807 [2024-11-20 01:31:29.820491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.807 qpair failed and we were unable to recover it. 00:30:21.807 [2024-11-20 01:31:29.820634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.807 [2024-11-20 01:31:29.820717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.807 [2024-11-20 01:31:29.820742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.807 qpair failed and we were unable to recover it. 00:30:21.807 [2024-11-20 01:31:29.820878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.807 [2024-11-20 01:31:29.820968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.807 [2024-11-20 01:31:29.820997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.807 qpair failed and we were unable to recover it. 00:30:21.807 [2024-11-20 01:31:29.821149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.807 [2024-11-20 01:31:29.821269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.807 [2024-11-20 01:31:29.821294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.807 qpair failed and we were unable to recover it. 00:30:21.807 [2024-11-20 01:31:29.821412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.807 [2024-11-20 01:31:29.821519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.807 [2024-11-20 01:31:29.821544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.807 qpair failed and we were unable to recover it. 00:30:21.807 [2024-11-20 01:31:29.821681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.807 [2024-11-20 01:31:29.821778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.807 [2024-11-20 01:31:29.821820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.807 qpair failed and we were unable to recover it. 00:30:21.807 [2024-11-20 01:31:29.821961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.807 [2024-11-20 01:31:29.822044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.807 [2024-11-20 01:31:29.822088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.807 qpair failed and we were unable to recover it. 00:30:21.807 [2024-11-20 01:31:29.822222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.807 [2024-11-20 01:31:29.822336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.807 [2024-11-20 01:31:29.822361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.807 qpair failed and we were unable to recover it. 00:30:21.807 [2024-11-20 01:31:29.822454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.807 [2024-11-20 01:31:29.822572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.807 [2024-11-20 01:31:29.822597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.807 qpair failed and we were unable to recover it. 00:30:21.807 [2024-11-20 01:31:29.822688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.807 [2024-11-20 01:31:29.822780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.808 [2024-11-20 01:31:29.822806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.808 qpair failed and we were unable to recover it. 00:30:21.808 [2024-11-20 01:31:29.822897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.808 [2024-11-20 01:31:29.823016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.808 [2024-11-20 01:31:29.823042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.808 qpair failed and we were unable to recover it. 00:30:21.808 [2024-11-20 01:31:29.823167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.808 [2024-11-20 01:31:29.823252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.808 [2024-11-20 01:31:29.823277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.808 qpair failed and we were unable to recover it. 00:30:21.808 [2024-11-20 01:31:29.823411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.808 [2024-11-20 01:31:29.823560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.808 [2024-11-20 01:31:29.823585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.808 qpair failed and we were unable to recover it. 00:30:21.808 [2024-11-20 01:31:29.823668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.808 [2024-11-20 01:31:29.823782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.808 [2024-11-20 01:31:29.823807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.808 qpair failed and we were unable to recover it. 00:30:21.808 [2024-11-20 01:31:29.823977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.808 [2024-11-20 01:31:29.824103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.808 [2024-11-20 01:31:29.824132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.808 qpair failed and we were unable to recover it. 00:30:21.808 [2024-11-20 01:31:29.824274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.808 [2024-11-20 01:31:29.824354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.808 [2024-11-20 01:31:29.824378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.808 qpair failed and we were unable to recover it. 00:30:21.808 [2024-11-20 01:31:29.824491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.808 [2024-11-20 01:31:29.824610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.808 [2024-11-20 01:31:29.824635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.808 qpair failed and we were unable to recover it. 00:30:21.808 [2024-11-20 01:31:29.824729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.808 [2024-11-20 01:31:29.824846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.808 [2024-11-20 01:31:29.824887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.808 qpair failed and we were unable to recover it. 00:30:21.808 [2024-11-20 01:31:29.824986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.808 [2024-11-20 01:31:29.825113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.808 [2024-11-20 01:31:29.825156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.808 qpair failed and we were unable to recover it. 00:30:21.808 [2024-11-20 01:31:29.825276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.808 [2024-11-20 01:31:29.825371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.808 [2024-11-20 01:31:29.825397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.808 qpair failed and we were unable to recover it. 00:30:21.808 [2024-11-20 01:31:29.825491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.808 [2024-11-20 01:31:29.825607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.808 [2024-11-20 01:31:29.825652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.808 qpair failed and we were unable to recover it. 00:30:21.808 [2024-11-20 01:31:29.825793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.808 [2024-11-20 01:31:29.825887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.808 [2024-11-20 01:31:29.825914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.808 qpair failed and we were unable to recover it. 00:30:21.808 [2024-11-20 01:31:29.826092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.808 [2024-11-20 01:31:29.826236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.808 [2024-11-20 01:31:29.826283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.808 qpair failed and we were unable to recover it. 00:30:21.808 [2024-11-20 01:31:29.826411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.808 [2024-11-20 01:31:29.826509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.808 [2024-11-20 01:31:29.826539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.808 qpair failed and we were unable to recover it. 00:30:21.808 [2024-11-20 01:31:29.826674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.808 [2024-11-20 01:31:29.826800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.808 [2024-11-20 01:31:29.826827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.808 qpair failed and we were unable to recover it. 00:30:21.808 [2024-11-20 01:31:29.826971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.808 [2024-11-20 01:31:29.827115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.808 [2024-11-20 01:31:29.827140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.808 qpair failed and we were unable to recover it. 00:30:21.808 [2024-11-20 01:31:29.827310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.808 [2024-11-20 01:31:29.827438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.808 [2024-11-20 01:31:29.827466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.808 qpair failed and we were unable to recover it. 00:30:21.808 [2024-11-20 01:31:29.827590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.808 [2024-11-20 01:31:29.827732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.808 [2024-11-20 01:31:29.827757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.808 qpair failed and we were unable to recover it. 00:30:21.808 [2024-11-20 01:31:29.827885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.808 [2024-11-20 01:31:29.827973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.808 [2024-11-20 01:31:29.827998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.808 qpair failed and we were unable to recover it. 00:30:21.808 [2024-11-20 01:31:29.828139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.808 [2024-11-20 01:31:29.828316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.808 [2024-11-20 01:31:29.828340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.808 qpair failed and we were unable to recover it. 00:30:21.808 [2024-11-20 01:31:29.828424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.808 [2024-11-20 01:31:29.828577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.808 [2024-11-20 01:31:29.828601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.808 qpair failed and we were unable to recover it. 00:30:21.808 [2024-11-20 01:31:29.828692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.808 [2024-11-20 01:31:29.828779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.808 [2024-11-20 01:31:29.828804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.808 qpair failed and we were unable to recover it. 00:30:21.808 [2024-11-20 01:31:29.828927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.808 [2024-11-20 01:31:29.829044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.808 [2024-11-20 01:31:29.829080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.808 qpair failed and we were unable to recover it. 00:30:21.808 [2024-11-20 01:31:29.829227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.808 [2024-11-20 01:31:29.829312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.808 [2024-11-20 01:31:29.829355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.808 qpair failed and we were unable to recover it. 00:30:21.808 [2024-11-20 01:31:29.829439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.808 [2024-11-20 01:31:29.829547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.808 [2024-11-20 01:31:29.829572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.808 qpair failed and we were unable to recover it. 00:30:21.808 [2024-11-20 01:31:29.829690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.808 [2024-11-20 01:31:29.829850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.808 [2024-11-20 01:31:29.829878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.808 qpair failed and we were unable to recover it. 00:30:21.808 [2024-11-20 01:31:29.830006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.808 [2024-11-20 01:31:29.830204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.808 [2024-11-20 01:31:29.830233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.808 qpair failed and we were unable to recover it. 00:30:21.809 [2024-11-20 01:31:29.830336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.809 [2024-11-20 01:31:29.830484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.809 [2024-11-20 01:31:29.830508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.809 qpair failed and we were unable to recover it. 00:30:21.809 [2024-11-20 01:31:29.830701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.809 [2024-11-20 01:31:29.830801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.809 [2024-11-20 01:31:29.830829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.809 qpair failed and we were unable to recover it. 00:30:21.809 [2024-11-20 01:31:29.830952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.809 [2024-11-20 01:31:29.831087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.809 [2024-11-20 01:31:29.831114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.809 qpair failed and we were unable to recover it. 00:30:21.809 [2024-11-20 01:31:29.831199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.809 [2024-11-20 01:31:29.831315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.809 [2024-11-20 01:31:29.831340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.809 qpair failed and we were unable to recover it. 00:30:21.809 [2024-11-20 01:31:29.831527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.809 [2024-11-20 01:31:29.831637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.809 [2024-11-20 01:31:29.831663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.809 qpair failed and we were unable to recover it. 00:30:21.809 [2024-11-20 01:31:29.831792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.809 [2024-11-20 01:31:29.831957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.809 [2024-11-20 01:31:29.831982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.809 qpair failed and we were unable to recover it. 00:30:21.809 [2024-11-20 01:31:29.832100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.809 [2024-11-20 01:31:29.832191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.809 [2024-11-20 01:31:29.832216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.809 qpair failed and we were unable to recover it. 00:30:21.809 [2024-11-20 01:31:29.832337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.809 [2024-11-20 01:31:29.832445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.809 [2024-11-20 01:31:29.832470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.809 qpair failed and we were unable to recover it. 00:30:21.809 [2024-11-20 01:31:29.832550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.809 [2024-11-20 01:31:29.832644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.809 [2024-11-20 01:31:29.832668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.809 qpair failed and we were unable to recover it. 00:30:21.809 [2024-11-20 01:31:29.832782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.809 [2024-11-20 01:31:29.832893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.809 [2024-11-20 01:31:29.832918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.809 qpair failed and we were unable to recover it. 00:30:21.809 [2024-11-20 01:31:29.833038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.809 [2024-11-20 01:31:29.833162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.809 [2024-11-20 01:31:29.833188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.809 qpair failed and we were unable to recover it. 00:30:21.809 [2024-11-20 01:31:29.833317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.809 [2024-11-20 01:31:29.833515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.809 [2024-11-20 01:31:29.833543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.809 qpair failed and we were unable to recover it. 00:30:21.809 [2024-11-20 01:31:29.833704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.809 [2024-11-20 01:31:29.833823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.809 [2024-11-20 01:31:29.833847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.809 qpair failed and we were unable to recover it. 00:30:21.809 [2024-11-20 01:31:29.833963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.809 [2024-11-20 01:31:29.834098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.809 [2024-11-20 01:31:29.834126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.809 qpair failed and we were unable to recover it. 00:30:21.809 [2024-11-20 01:31:29.834247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.809 [2024-11-20 01:31:29.834409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.809 [2024-11-20 01:31:29.834437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.809 qpair failed and we were unable to recover it. 00:30:21.809 [2024-11-20 01:31:29.834580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.809 [2024-11-20 01:31:29.834693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.809 [2024-11-20 01:31:29.834718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.809 qpair failed and we were unable to recover it. 00:30:21.809 [2024-11-20 01:31:29.834860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.809 [2024-11-20 01:31:29.834984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.809 [2024-11-20 01:31:29.835011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.809 qpair failed and we were unable to recover it. 00:30:21.809 [2024-11-20 01:31:29.835138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.809 [2024-11-20 01:31:29.835274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.809 [2024-11-20 01:31:29.835300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.809 qpair failed and we were unable to recover it. 00:30:21.809 [2024-11-20 01:31:29.835445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.809 [2024-11-20 01:31:29.835564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.809 [2024-11-20 01:31:29.835589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.809 qpair failed and we were unable to recover it. 00:30:21.809 [2024-11-20 01:31:29.835695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.809 [2024-11-20 01:31:29.835782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.809 [2024-11-20 01:31:29.835809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.809 qpair failed and we were unable to recover it. 00:30:21.809 [2024-11-20 01:31:29.835956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.809 [2024-11-20 01:31:29.836032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.809 [2024-11-20 01:31:29.836058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.809 qpair failed and we were unable to recover it. 00:30:21.809 [2024-11-20 01:31:29.836175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.809 [2024-11-20 01:31:29.836272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.809 [2024-11-20 01:31:29.836297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.809 qpair failed and we were unable to recover it. 00:30:21.809 [2024-11-20 01:31:29.836382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.809 [2024-11-20 01:31:29.836473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.809 [2024-11-20 01:31:29.836499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.809 qpair failed and we were unable to recover it. 00:30:21.809 [2024-11-20 01:31:29.836605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.809 [2024-11-20 01:31:29.836730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.809 [2024-11-20 01:31:29.836758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.809 qpair failed and we were unable to recover it. 00:30:21.809 [2024-11-20 01:31:29.836919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.809 [2024-11-20 01:31:29.837110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.809 [2024-11-20 01:31:29.837136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.809 qpair failed and we were unable to recover it. 00:30:21.809 [2024-11-20 01:31:29.837254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.809 [2024-11-20 01:31:29.837343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.809 [2024-11-20 01:31:29.837368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.809 qpair failed and we were unable to recover it. 00:30:21.809 [2024-11-20 01:31:29.837512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.809 [2024-11-20 01:31:29.837624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.809 [2024-11-20 01:31:29.837651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.809 qpair failed and we were unable to recover it. 00:30:21.809 [2024-11-20 01:31:29.837763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.809 [2024-11-20 01:31:29.837881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.809 [2024-11-20 01:31:29.837906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.809 qpair failed and we were unable to recover it. 00:30:21.809 [2024-11-20 01:31:29.838034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.809 [2024-11-20 01:31:29.838197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.810 [2024-11-20 01:31:29.838223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.810 qpair failed and we were unable to recover it. 00:30:21.810 [2024-11-20 01:31:29.838312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.810 [2024-11-20 01:31:29.838442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.810 [2024-11-20 01:31:29.838470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.810 qpair failed and we were unable to recover it. 00:30:21.810 [2024-11-20 01:31:29.838643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.810 [2024-11-20 01:31:29.838761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.810 [2024-11-20 01:31:29.838801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.810 qpair failed and we were unable to recover it. 00:30:21.810 [2024-11-20 01:31:29.838951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.810 [2024-11-20 01:31:29.839036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.810 [2024-11-20 01:31:29.839061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.810 qpair failed and we were unable to recover it. 00:30:21.810 [2024-11-20 01:31:29.839206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.810 [2024-11-20 01:31:29.839305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.810 [2024-11-20 01:31:29.839333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.810 qpair failed and we were unable to recover it. 00:30:21.810 [2024-11-20 01:31:29.839490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.810 [2024-11-20 01:31:29.839604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.810 [2024-11-20 01:31:29.839629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.810 qpair failed and we were unable to recover it. 00:30:21.810 [2024-11-20 01:31:29.839812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.810 [2024-11-20 01:31:29.839925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.810 [2024-11-20 01:31:29.839950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.810 qpair failed and we were unable to recover it. 00:30:21.810 [2024-11-20 01:31:29.840075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.810 [2024-11-20 01:31:29.840215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.810 [2024-11-20 01:31:29.840243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.810 qpair failed and we were unable to recover it. 00:30:21.810 [2024-11-20 01:31:29.840375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.810 [2024-11-20 01:31:29.840495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.810 [2024-11-20 01:31:29.840525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.810 qpair failed and we were unable to recover it. 00:30:21.810 [2024-11-20 01:31:29.840687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.810 [2024-11-20 01:31:29.840780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.810 [2024-11-20 01:31:29.840809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.810 qpair failed and we were unable to recover it. 00:30:21.810 [2024-11-20 01:31:29.840928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.810 [2024-11-20 01:31:29.841082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.810 [2024-11-20 01:31:29.841109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.810 qpair failed and we were unable to recover it. 00:30:21.810 [2024-11-20 01:31:29.841208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.810 [2024-11-20 01:31:29.841293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.810 [2024-11-20 01:31:29.841318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.810 qpair failed and we were unable to recover it. 00:30:21.810 [2024-11-20 01:31:29.841433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.810 [2024-11-20 01:31:29.841556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.810 [2024-11-20 01:31:29.841581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.810 qpair failed and we were unable to recover it. 00:30:21.810 [2024-11-20 01:31:29.841694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.810 [2024-11-20 01:31:29.841821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.810 [2024-11-20 01:31:29.841845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.810 qpair failed and we were unable to recover it. 00:30:21.810 [2024-11-20 01:31:29.841987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.810 [2024-11-20 01:31:29.842100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.810 [2024-11-20 01:31:29.842128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.810 qpair failed and we were unable to recover it. 00:30:21.810 [2024-11-20 01:31:29.842279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.810 [2024-11-20 01:31:29.842392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.810 [2024-11-20 01:31:29.842417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.810 qpair failed and we were unable to recover it. 00:30:21.810 [2024-11-20 01:31:29.842545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.810 [2024-11-20 01:31:29.842645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.810 [2024-11-20 01:31:29.842673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.810 qpair failed and we were unable to recover it. 00:30:21.810 [2024-11-20 01:31:29.842819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.810 [2024-11-20 01:31:29.842900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.810 [2024-11-20 01:31:29.842924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.810 qpair failed and we were unable to recover it. 00:30:21.810 [2024-11-20 01:31:29.843056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.810 [2024-11-20 01:31:29.843192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.810 [2024-11-20 01:31:29.843220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.810 qpair failed and we were unable to recover it. 00:30:21.810 [2024-11-20 01:31:29.843336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.810 [2024-11-20 01:31:29.843470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.810 [2024-11-20 01:31:29.843495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.810 qpair failed and we were unable to recover it. 00:30:21.810 [2024-11-20 01:31:29.843616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.810 [2024-11-20 01:31:29.843727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.810 [2024-11-20 01:31:29.843752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.810 qpair failed and we were unable to recover it. 00:30:21.810 [2024-11-20 01:31:29.843871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.810 [2024-11-20 01:31:29.843993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.810 [2024-11-20 01:31:29.844021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.810 qpair failed and we were unable to recover it. 00:30:21.810 [2024-11-20 01:31:29.844142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.810 [2024-11-20 01:31:29.844256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.810 [2024-11-20 01:31:29.844281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.810 qpair failed and we were unable to recover it. 00:30:21.810 [2024-11-20 01:31:29.844396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.810 [2024-11-20 01:31:29.844509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.810 [2024-11-20 01:31:29.844533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.810 qpair failed and we were unable to recover it. 00:30:21.810 [2024-11-20 01:31:29.844641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.810 [2024-11-20 01:31:29.844730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.810 [2024-11-20 01:31:29.844757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.810 qpair failed and we were unable to recover it. 00:30:21.810 [2024-11-20 01:31:29.844857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.810 [2024-11-20 01:31:29.845012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.810 [2024-11-20 01:31:29.845039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.810 qpair failed and we were unable to recover it. 00:30:21.810 [2024-11-20 01:31:29.845217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.810 [2024-11-20 01:31:29.845298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.810 [2024-11-20 01:31:29.845324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.810 qpair failed and we were unable to recover it. 00:30:21.810 [2024-11-20 01:31:29.845487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.810 [2024-11-20 01:31:29.845613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.810 [2024-11-20 01:31:29.845641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.810 qpair failed and we were unable to recover it. 00:30:21.810 [2024-11-20 01:31:29.845764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.810 [2024-11-20 01:31:29.845915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.810 [2024-11-20 01:31:29.845943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.810 qpair failed and we were unable to recover it. 00:30:21.810 [2024-11-20 01:31:29.846062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.811 [2024-11-20 01:31:29.846202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.811 [2024-11-20 01:31:29.846227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.811 qpair failed and we were unable to recover it. 00:30:21.811 [2024-11-20 01:31:29.846356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.811 [2024-11-20 01:31:29.846474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.811 [2024-11-20 01:31:29.846502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.811 qpair failed and we were unable to recover it. 00:30:21.811 [2024-11-20 01:31:29.846594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.811 [2024-11-20 01:31:29.846716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.811 [2024-11-20 01:31:29.846744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.811 qpair failed and we were unable to recover it. 00:30:21.811 [2024-11-20 01:31:29.846877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.811 [2024-11-20 01:31:29.846987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.811 [2024-11-20 01:31:29.847011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.811 qpair failed and we were unable to recover it. 00:30:21.811 [2024-11-20 01:31:29.847151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.811 [2024-11-20 01:31:29.847284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.811 [2024-11-20 01:31:29.847313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.811 qpair failed and we were unable to recover it. 00:30:21.811 [2024-11-20 01:31:29.847438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.811 [2024-11-20 01:31:29.847606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.811 [2024-11-20 01:31:29.847631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.811 qpair failed and we were unable to recover it. 00:30:21.811 [2024-11-20 01:31:29.847715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.811 [2024-11-20 01:31:29.847828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.811 [2024-11-20 01:31:29.847852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.811 qpair failed and we were unable to recover it. 00:30:21.811 [2024-11-20 01:31:29.847993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.811 [2024-11-20 01:31:29.848127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.811 [2024-11-20 01:31:29.848155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.811 qpair failed and we were unable to recover it. 00:30:21.811 [2024-11-20 01:31:29.848287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.811 [2024-11-20 01:31:29.848413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.811 [2024-11-20 01:31:29.848440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.811 qpair failed and we were unable to recover it. 00:30:21.811 [2024-11-20 01:31:29.848550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.811 [2024-11-20 01:31:29.848705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.811 [2024-11-20 01:31:29.848730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.811 qpair failed and we were unable to recover it. 00:30:21.811 [2024-11-20 01:31:29.848865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.811 [2024-11-20 01:31:29.848959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.811 [2024-11-20 01:31:29.849001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.811 qpair failed and we were unable to recover it. 00:30:21.811 [2024-11-20 01:31:29.849197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.811 [2024-11-20 01:31:29.849338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.811 [2024-11-20 01:31:29.849367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.811 qpair failed and we were unable to recover it. 00:30:21.811 [2024-11-20 01:31:29.849517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.811 [2024-11-20 01:31:29.849658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.811 [2024-11-20 01:31:29.849683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.811 qpair failed and we were unable to recover it. 00:30:21.811 [2024-11-20 01:31:29.849820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.811 [2024-11-20 01:31:29.849942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.811 [2024-11-20 01:31:29.849970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.811 qpair failed and we were unable to recover it. 00:30:21.811 [2024-11-20 01:31:29.850111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.811 [2024-11-20 01:31:29.850222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.811 [2024-11-20 01:31:29.850247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.811 qpair failed and we were unable to recover it. 00:30:21.811 [2024-11-20 01:31:29.850338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.811 [2024-11-20 01:31:29.850479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.811 [2024-11-20 01:31:29.850504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.811 qpair failed and we were unable to recover it. 00:30:21.811 [2024-11-20 01:31:29.850650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.811 [2024-11-20 01:31:29.850790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.811 [2024-11-20 01:31:29.850815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.811 qpair failed and we were unable to recover it. 00:30:21.811 [2024-11-20 01:31:29.851008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.811 [2024-11-20 01:31:29.851169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.811 [2024-11-20 01:31:29.851198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.811 qpair failed and we were unable to recover it. 00:30:21.811 [2024-11-20 01:31:29.851311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.811 [2024-11-20 01:31:29.851423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.811 [2024-11-20 01:31:29.851448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.811 qpair failed and we were unable to recover it. 00:30:21.811 [2024-11-20 01:31:29.851549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.811 [2024-11-20 01:31:29.851670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.811 [2024-11-20 01:31:29.851698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.811 qpair failed and we were unable to recover it. 00:30:21.811 [2024-11-20 01:31:29.851825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.811 [2024-11-20 01:31:29.851928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.811 [2024-11-20 01:31:29.851956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.811 qpair failed and we were unable to recover it. 00:30:21.811 [2024-11-20 01:31:29.852101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.811 [2024-11-20 01:31:29.852192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.811 [2024-11-20 01:31:29.852217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.811 qpair failed and we were unable to recover it. 00:30:21.811 [2024-11-20 01:31:29.852302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.811 [2024-11-20 01:31:29.852427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.811 [2024-11-20 01:31:29.852455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.811 qpair failed and we were unable to recover it. 00:30:21.811 [2024-11-20 01:31:29.852585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.811 [2024-11-20 01:31:29.852722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.811 [2024-11-20 01:31:29.852748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.811 qpair failed and we were unable to recover it. 00:30:21.811 [2024-11-20 01:31:29.852899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.811 [2024-11-20 01:31:29.852991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.811 [2024-11-20 01:31:29.853016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.811 qpair failed and we were unable to recover it. 00:30:21.811 [2024-11-20 01:31:29.853118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.811 [2024-11-20 01:31:29.853203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.812 [2024-11-20 01:31:29.853229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.812 qpair failed and we were unable to recover it. 00:30:21.812 [2024-11-20 01:31:29.853353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.812 [2024-11-20 01:31:29.853454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.812 [2024-11-20 01:31:29.853482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.812 qpair failed and we were unable to recover it. 00:30:21.812 [2024-11-20 01:31:29.853595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.812 [2024-11-20 01:31:29.853685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.812 [2024-11-20 01:31:29.853709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.812 qpair failed and we were unable to recover it. 00:30:21.812 [2024-11-20 01:31:29.853824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.812 [2024-11-20 01:31:29.853958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.812 [2024-11-20 01:31:29.853985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.812 qpair failed and we were unable to recover it. 00:30:21.812 [2024-11-20 01:31:29.854108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.812 [2024-11-20 01:31:29.854270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.812 [2024-11-20 01:31:29.854295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.812 qpair failed and we were unable to recover it. 00:30:21.812 [2024-11-20 01:31:29.854376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.812 [2024-11-20 01:31:29.854464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.812 [2024-11-20 01:31:29.854493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.812 qpair failed and we were unable to recover it. 00:30:21.812 [2024-11-20 01:31:29.854611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.812 [2024-11-20 01:31:29.854755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.812 [2024-11-20 01:31:29.854783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.812 qpair failed and we were unable to recover it. 00:30:21.812 [2024-11-20 01:31:29.854884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.812 [2024-11-20 01:31:29.855010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.812 [2024-11-20 01:31:29.855037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.812 qpair failed and we were unable to recover it. 00:30:21.812 [2024-11-20 01:31:29.855188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.812 [2024-11-20 01:31:29.855282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.812 [2024-11-20 01:31:29.855307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.812 qpair failed and we were unable to recover it. 00:30:21.812 [2024-11-20 01:31:29.855451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.812 [2024-11-20 01:31:29.855530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.812 [2024-11-20 01:31:29.855556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.812 qpair failed and we were unable to recover it. 00:30:21.812 [2024-11-20 01:31:29.855675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.812 [2024-11-20 01:31:29.855808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.812 [2024-11-20 01:31:29.855836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.812 qpair failed and we were unable to recover it. 00:30:21.812 [2024-11-20 01:31:29.855936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.812 [2024-11-20 01:31:29.856061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.812 [2024-11-20 01:31:29.856094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.812 qpair failed and we were unable to recover it. 00:30:21.812 [2024-11-20 01:31:29.856204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.812 [2024-11-20 01:31:29.856335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.812 [2024-11-20 01:31:29.856360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.812 qpair failed and we were unable to recover it. 00:30:21.812 [2024-11-20 01:31:29.856523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.812 [2024-11-20 01:31:29.856625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.812 [2024-11-20 01:31:29.856652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.812 qpair failed and we were unable to recover it. 00:30:21.812 [2024-11-20 01:31:29.856788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.812 [2024-11-20 01:31:29.856908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.812 [2024-11-20 01:31:29.856933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.812 qpair failed and we were unable to recover it. 00:30:21.812 [2024-11-20 01:31:29.857025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.812 [2024-11-20 01:31:29.857129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.812 [2024-11-20 01:31:29.857154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.812 qpair failed and we were unable to recover it. 00:30:21.812 [2024-11-20 01:31:29.857242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.812 [2024-11-20 01:31:29.857369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.812 [2024-11-20 01:31:29.857398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.812 qpair failed and we were unable to recover it. 00:30:21.812 [2024-11-20 01:31:29.857510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.812 [2024-11-20 01:31:29.857620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.812 [2024-11-20 01:31:29.857645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.812 qpair failed and we were unable to recover it. 00:30:21.812 [2024-11-20 01:31:29.857760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.812 [2024-11-20 01:31:29.857899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.812 [2024-11-20 01:31:29.857927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.812 qpair failed and we were unable to recover it. 00:30:21.812 [2024-11-20 01:31:29.858053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.812 [2024-11-20 01:31:29.858214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.812 [2024-11-20 01:31:29.858239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.812 qpair failed and we were unable to recover it. 00:30:21.812 [2024-11-20 01:31:29.858358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.812 [2024-11-20 01:31:29.858503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.812 [2024-11-20 01:31:29.858528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.812 qpair failed and we were unable to recover it. 00:30:21.812 [2024-11-20 01:31:29.858613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.812 [2024-11-20 01:31:29.858728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.812 [2024-11-20 01:31:29.858753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.812 qpair failed and we were unable to recover it. 00:30:21.812 [2024-11-20 01:31:29.858840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.812 [2024-11-20 01:31:29.859006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.812 [2024-11-20 01:31:29.859034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.812 qpair failed and we were unable to recover it. 00:30:21.812 [2024-11-20 01:31:29.859180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.812 [2024-11-20 01:31:29.859263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.812 [2024-11-20 01:31:29.859290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.812 qpair failed and we were unable to recover it. 00:30:21.812 [2024-11-20 01:31:29.859429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.812 [2024-11-20 01:31:29.859548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.812 [2024-11-20 01:31:29.859576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.812 qpair failed and we were unable to recover it. 00:30:21.812 [2024-11-20 01:31:29.859732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.812 [2024-11-20 01:31:29.859832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.812 [2024-11-20 01:31:29.859859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.812 qpair failed and we were unable to recover it. 00:30:21.812 [2024-11-20 01:31:29.859968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.812 [2024-11-20 01:31:29.860085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.812 [2024-11-20 01:31:29.860111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.812 qpair failed and we were unable to recover it. 00:30:21.812 [2024-11-20 01:31:29.860211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.812 [2024-11-20 01:31:29.860346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.812 [2024-11-20 01:31:29.860374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.812 qpair failed and we were unable to recover it. 00:30:21.812 [2024-11-20 01:31:29.860535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.812 [2024-11-20 01:31:29.860644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.812 [2024-11-20 01:31:29.860668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.812 qpair failed and we were unable to recover it. 00:30:21.813 [2024-11-20 01:31:29.860785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.813 [2024-11-20 01:31:29.860871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.813 [2024-11-20 01:31:29.860895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.813 qpair failed and we were unable to recover it. 00:30:21.813 [2024-11-20 01:31:29.860986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.813 [2024-11-20 01:31:29.861146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.813 [2024-11-20 01:31:29.861172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.813 qpair failed and we were unable to recover it. 00:30:21.813 [2024-11-20 01:31:29.861293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.813 [2024-11-20 01:31:29.861436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.813 [2024-11-20 01:31:29.861478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.813 qpair failed and we were unable to recover it. 00:30:21.813 [2024-11-20 01:31:29.861624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.813 [2024-11-20 01:31:29.861769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.813 [2024-11-20 01:31:29.861811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.813 qpair failed and we were unable to recover it. 00:30:21.813 [2024-11-20 01:31:29.861906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.813 [2024-11-20 01:31:29.862039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.813 [2024-11-20 01:31:29.862067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.813 qpair failed and we were unable to recover it. 00:30:21.813 [2024-11-20 01:31:29.862209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.813 [2024-11-20 01:31:29.862328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.813 [2024-11-20 01:31:29.862355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.813 qpair failed and we were unable to recover it. 00:30:21.813 [2024-11-20 01:31:29.862462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.813 [2024-11-20 01:31:29.862577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.813 [2024-11-20 01:31:29.862602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.813 qpair failed and we were unable to recover it. 00:30:21.813 [2024-11-20 01:31:29.862764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.813 [2024-11-20 01:31:29.862870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.813 [2024-11-20 01:31:29.862898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.813 qpair failed and we were unable to recover it. 00:30:21.813 [2024-11-20 01:31:29.863030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.813 [2024-11-20 01:31:29.863130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.813 [2024-11-20 01:31:29.863172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.813 qpair failed and we were unable to recover it. 00:30:21.813 [2024-11-20 01:31:29.863300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.813 [2024-11-20 01:31:29.863415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.813 [2024-11-20 01:31:29.863440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.813 qpair failed and we were unable to recover it. 00:30:21.813 [2024-11-20 01:31:29.863575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.813 [2024-11-20 01:31:29.863715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.813 [2024-11-20 01:31:29.863740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.813 qpair failed and we were unable to recover it. 00:30:21.813 [2024-11-20 01:31:29.863854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.813 [2024-11-20 01:31:29.863986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.813 [2024-11-20 01:31:29.864014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.813 qpair failed and we were unable to recover it. 00:30:21.813 [2024-11-20 01:31:29.864146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.813 [2024-11-20 01:31:29.864259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.813 [2024-11-20 01:31:29.864285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.813 qpair failed and we were unable to recover it. 00:30:21.813 [2024-11-20 01:31:29.864376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.813 [2024-11-20 01:31:29.864483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.813 [2024-11-20 01:31:29.864508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.813 qpair failed and we were unable to recover it. 00:30:21.813 [2024-11-20 01:31:29.864624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.813 [2024-11-20 01:31:29.864734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.813 [2024-11-20 01:31:29.864761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.813 qpair failed and we were unable to recover it. 00:30:21.813 [2024-11-20 01:31:29.864883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.813 [2024-11-20 01:31:29.864977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.813 [2024-11-20 01:31:29.865005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.813 qpair failed and we were unable to recover it. 00:30:21.813 [2024-11-20 01:31:29.865152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.813 [2024-11-20 01:31:29.865235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.813 [2024-11-20 01:31:29.865260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.813 qpair failed and we were unable to recover it. 00:30:21.813 [2024-11-20 01:31:29.865373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.813 [2024-11-20 01:31:29.865533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.813 [2024-11-20 01:31:29.865566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.813 qpair failed and we were unable to recover it. 00:30:21.813 [2024-11-20 01:31:29.865699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.813 [2024-11-20 01:31:29.865890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.813 [2024-11-20 01:31:29.865932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.813 qpair failed and we were unable to recover it. 00:30:21.813 [2024-11-20 01:31:29.866023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.813 [2024-11-20 01:31:29.866166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.813 [2024-11-20 01:31:29.866195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.813 qpair failed and we were unable to recover it. 00:30:21.813 [2024-11-20 01:31:29.866317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.813 [2024-11-20 01:31:29.866435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.813 [2024-11-20 01:31:29.866463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.813 qpair failed and we were unable to recover it. 00:30:21.813 [2024-11-20 01:31:29.866609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.813 [2024-11-20 01:31:29.866700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.813 [2024-11-20 01:31:29.866725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.813 qpair failed and we were unable to recover it. 00:30:21.813 [2024-11-20 01:31:29.866811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.813 [2024-11-20 01:31:29.866899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.813 [2024-11-20 01:31:29.866926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.813 qpair failed and we were unable to recover it. 00:30:21.813 [2024-11-20 01:31:29.867048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.813 [2024-11-20 01:31:29.867209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.813 [2024-11-20 01:31:29.867235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.813 qpair failed and we were unable to recover it. 00:30:21.813 [2024-11-20 01:31:29.867349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.813 [2024-11-20 01:31:29.867457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.813 [2024-11-20 01:31:29.867481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.813 qpair failed and we were unable to recover it. 00:30:21.813 [2024-11-20 01:31:29.867617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.813 [2024-11-20 01:31:29.867741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.813 [2024-11-20 01:31:29.867769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.813 qpair failed and we were unable to recover it. 00:30:21.813 [2024-11-20 01:31:29.867920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.813 [2024-11-20 01:31:29.868011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.813 [2024-11-20 01:31:29.868035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.813 qpair failed and we were unable to recover it. 00:30:21.813 [2024-11-20 01:31:29.868137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.813 [2024-11-20 01:31:29.868226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.813 [2024-11-20 01:31:29.868255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.813 qpair failed and we were unable to recover it. 00:30:21.813 [2024-11-20 01:31:29.868356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.813 [2024-11-20 01:31:29.868446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.814 [2024-11-20 01:31:29.868472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.814 qpair failed and we were unable to recover it. 00:30:21.814 [2024-11-20 01:31:29.868577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.814 [2024-11-20 01:31:29.868707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.814 [2024-11-20 01:31:29.868735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.814 qpair failed and we were unable to recover it. 00:30:21.814 [2024-11-20 01:31:29.868866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.814 [2024-11-20 01:31:29.869005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.814 [2024-11-20 01:31:29.869030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.814 qpair failed and we were unable to recover it. 00:30:21.814 [2024-11-20 01:31:29.869170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.814 [2024-11-20 01:31:29.869281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.814 [2024-11-20 01:31:29.869306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.814 qpair failed and we were unable to recover it. 00:30:21.814 [2024-11-20 01:31:29.869421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.814 [2024-11-20 01:31:29.869516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.814 [2024-11-20 01:31:29.869544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.814 qpair failed and we were unable to recover it. 00:30:21.814 [2024-11-20 01:31:29.869680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.814 [2024-11-20 01:31:29.869766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.814 [2024-11-20 01:31:29.869791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.814 qpair failed and we were unable to recover it. 00:30:21.814 [2024-11-20 01:31:29.869875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.814 [2024-11-20 01:31:29.870092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.814 [2024-11-20 01:31:29.870120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.814 qpair failed and we were unable to recover it. 00:30:21.814 [2024-11-20 01:31:29.870255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.814 [2024-11-20 01:31:29.870372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.814 [2024-11-20 01:31:29.870399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.814 qpair failed and we were unable to recover it. 00:30:21.814 [2024-11-20 01:31:29.870560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.814 [2024-11-20 01:31:29.870682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.814 [2024-11-20 01:31:29.870708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.814 qpair failed and we were unable to recover it. 00:30:21.814 [2024-11-20 01:31:29.870822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.814 [2024-11-20 01:31:29.870929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.814 [2024-11-20 01:31:29.870972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.814 qpair failed and we were unable to recover it. 00:30:21.814 [2024-11-20 01:31:29.871134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.814 [2024-11-20 01:31:29.871259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.814 [2024-11-20 01:31:29.871287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.814 qpair failed and we were unable to recover it. 00:30:21.814 [2024-11-20 01:31:29.871421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.814 [2024-11-20 01:31:29.871514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.814 [2024-11-20 01:31:29.871540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.814 qpair failed and we were unable to recover it. 00:30:21.814 [2024-11-20 01:31:29.871633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.814 [2024-11-20 01:31:29.871826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.814 [2024-11-20 01:31:29.871854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.814 qpair failed and we were unable to recover it. 00:30:21.814 [2024-11-20 01:31:29.871959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.814 [2024-11-20 01:31:29.872081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.814 [2024-11-20 01:31:29.872109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.814 qpair failed and we were unable to recover it. 00:30:21.814 [2024-11-20 01:31:29.872252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.814 [2024-11-20 01:31:29.872336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.814 [2024-11-20 01:31:29.872360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.814 qpair failed and we were unable to recover it. 00:30:21.814 [2024-11-20 01:31:29.872486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.814 [2024-11-20 01:31:29.872573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.814 [2024-11-20 01:31:29.872600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.814 qpair failed and we were unable to recover it. 00:30:21.814 [2024-11-20 01:31:29.872704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.814 [2024-11-20 01:31:29.872828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.814 [2024-11-20 01:31:29.872856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.814 qpair failed and we were unable to recover it. 00:30:21.814 [2024-11-20 01:31:29.873057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.814 [2024-11-20 01:31:29.873230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.814 [2024-11-20 01:31:29.873256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.814 qpair failed and we were unable to recover it. 00:30:21.814 [2024-11-20 01:31:29.873395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.814 [2024-11-20 01:31:29.873521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.814 [2024-11-20 01:31:29.873549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.814 qpair failed and we were unable to recover it. 00:30:21.814 [2024-11-20 01:31:29.873650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.814 [2024-11-20 01:31:29.873781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.814 [2024-11-20 01:31:29.873822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.814 qpair failed and we were unable to recover it. 00:30:21.814 [2024-11-20 01:31:29.873917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.814 [2024-11-20 01:31:29.874033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.814 [2024-11-20 01:31:29.874059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.814 qpair failed and we were unable to recover it. 00:30:21.814 [2024-11-20 01:31:29.874235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.814 [2024-11-20 01:31:29.874350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.814 [2024-11-20 01:31:29.874378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.814 qpair failed and we were unable to recover it. 00:30:21.814 [2024-11-20 01:31:29.874532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.814 [2024-11-20 01:31:29.874662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.814 [2024-11-20 01:31:29.874690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.814 qpair failed and we were unable to recover it. 00:30:21.814 [2024-11-20 01:31:29.874794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.814 [2024-11-20 01:31:29.874872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.814 [2024-11-20 01:31:29.874897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.814 qpair failed and we were unable to recover it. 00:30:21.814 [2024-11-20 01:31:29.874997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.814 [2024-11-20 01:31:29.875135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.814 [2024-11-20 01:31:29.875164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.814 qpair failed and we were unable to recover it. 00:30:21.814 [2024-11-20 01:31:29.875275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.814 [2024-11-20 01:31:29.875422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.814 [2024-11-20 01:31:29.875447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.814 qpair failed and we were unable to recover it. 00:30:21.814 [2024-11-20 01:31:29.875557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.814 [2024-11-20 01:31:29.875748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.814 [2024-11-20 01:31:29.875795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.814 qpair failed and we were unable to recover it. 00:30:21.814 [2024-11-20 01:31:29.875939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.814 [2024-11-20 01:31:29.876058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.814 [2024-11-20 01:31:29.876091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.814 qpair failed and we were unable to recover it. 00:30:21.814 [2024-11-20 01:31:29.876210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.814 [2024-11-20 01:31:29.876288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.814 [2024-11-20 01:31:29.876312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.814 qpair failed and we were unable to recover it. 00:30:21.814 [2024-11-20 01:31:29.876427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.814 [2024-11-20 01:31:29.876541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.815 [2024-11-20 01:31:29.876566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.815 qpair failed and we were unable to recover it. 00:30:21.815 [2024-11-20 01:31:29.876653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.815 [2024-11-20 01:31:29.876750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.815 [2024-11-20 01:31:29.876775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.815 qpair failed and we were unable to recover it. 00:30:21.815 [2024-11-20 01:31:29.876884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.815 [2024-11-20 01:31:29.877019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.815 [2024-11-20 01:31:29.877046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.815 qpair failed and we were unable to recover it. 00:30:21.815 [2024-11-20 01:31:29.877209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.815 [2024-11-20 01:31:29.877304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.815 [2024-11-20 01:31:29.877330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.815 qpair failed and we were unable to recover it. 00:30:21.815 [2024-11-20 01:31:29.877453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.815 [2024-11-20 01:31:29.877645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.815 [2024-11-20 01:31:29.877673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.815 qpair failed and we were unable to recover it. 00:30:21.815 [2024-11-20 01:31:29.877766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.815 [2024-11-20 01:31:29.877920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.815 [2024-11-20 01:31:29.877949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.815 qpair failed and we were unable to recover it. 00:30:21.815 [2024-11-20 01:31:29.878100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.815 [2024-11-20 01:31:29.878195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.815 [2024-11-20 01:31:29.878219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.815 qpair failed and we were unable to recover it. 00:30:21.815 [2024-11-20 01:31:29.878313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.815 [2024-11-20 01:31:29.878474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.815 [2024-11-20 01:31:29.878499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.815 qpair failed and we were unable to recover it. 00:30:21.815 [2024-11-20 01:31:29.878622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.815 [2024-11-20 01:31:29.878737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.815 [2024-11-20 01:31:29.878762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.815 qpair failed and we were unable to recover it. 00:30:21.815 [2024-11-20 01:31:29.878886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.815 [2024-11-20 01:31:29.879011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.815 [2024-11-20 01:31:29.879039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.815 qpair failed and we were unable to recover it. 00:30:21.815 [2024-11-20 01:31:29.879215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.815 [2024-11-20 01:31:29.879337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.815 [2024-11-20 01:31:29.879361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.815 qpair failed and we were unable to recover it. 00:30:21.815 [2024-11-20 01:31:29.879463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.815 [2024-11-20 01:31:29.879605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.815 [2024-11-20 01:31:29.879634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.815 qpair failed and we were unable to recover it. 00:30:21.815 [2024-11-20 01:31:29.879731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.815 [2024-11-20 01:31:29.879875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.815 [2024-11-20 01:31:29.879900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.815 qpair failed and we were unable to recover it. 00:30:21.815 [2024-11-20 01:31:29.880064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.815 [2024-11-20 01:31:29.880208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.815 [2024-11-20 01:31:29.880235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.815 qpair failed and we were unable to recover it. 00:30:21.815 [2024-11-20 01:31:29.880368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.815 [2024-11-20 01:31:29.880565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.815 [2024-11-20 01:31:29.880593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.815 qpair failed and we were unable to recover it. 00:30:21.815 [2024-11-20 01:31:29.880705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.815 [2024-11-20 01:31:29.880818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.815 [2024-11-20 01:31:29.880842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.815 qpair failed and we were unable to recover it. 00:30:21.815 [2024-11-20 01:31:29.880933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.815 [2024-11-20 01:31:29.881080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.815 [2024-11-20 01:31:29.881109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.815 qpair failed and we were unable to recover it. 00:30:21.815 [2024-11-20 01:31:29.881212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.815 [2024-11-20 01:31:29.881302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.815 [2024-11-20 01:31:29.881329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.815 qpair failed and we were unable to recover it. 00:30:21.815 [2024-11-20 01:31:29.881445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.815 [2024-11-20 01:31:29.881594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.815 [2024-11-20 01:31:29.881618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.815 qpair failed and we were unable to recover it. 00:30:21.815 [2024-11-20 01:31:29.881720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.815 [2024-11-20 01:31:29.881851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.815 [2024-11-20 01:31:29.881878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.815 qpair failed and we were unable to recover it. 00:30:21.815 [2024-11-20 01:31:29.882006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.815 [2024-11-20 01:31:29.882126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.815 [2024-11-20 01:31:29.882154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.815 qpair failed and we were unable to recover it. 00:30:21.815 [2024-11-20 01:31:29.882266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.815 [2024-11-20 01:31:29.882357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.815 [2024-11-20 01:31:29.882382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.815 qpair failed and we were unable to recover it. 00:30:21.815 [2024-11-20 01:31:29.882473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.815 [2024-11-20 01:31:29.882681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.815 [2024-11-20 01:31:29.882709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.815 qpair failed and we were unable to recover it. 00:30:21.815 [2024-11-20 01:31:29.882866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.815 [2024-11-20 01:31:29.882999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.815 [2024-11-20 01:31:29.883027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.815 qpair failed and we were unable to recover it. 00:30:21.815 [2024-11-20 01:31:29.883165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.815 [2024-11-20 01:31:29.883306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.815 [2024-11-20 01:31:29.883332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.815 qpair failed and we were unable to recover it. 00:30:21.815 [2024-11-20 01:31:29.883470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.815 [2024-11-20 01:31:29.883590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.816 [2024-11-20 01:31:29.883617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.816 qpair failed and we were unable to recover it. 00:30:21.816 [2024-11-20 01:31:29.883711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.816 [2024-11-20 01:31:29.883838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.816 [2024-11-20 01:31:29.883866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.816 qpair failed and we were unable to recover it. 00:30:21.816 [2024-11-20 01:31:29.884027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.816 [2024-11-20 01:31:29.884145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.816 [2024-11-20 01:31:29.884170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.816 qpair failed and we were unable to recover it. 00:30:21.816 [2024-11-20 01:31:29.884279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.816 [2024-11-20 01:31:29.884404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.816 [2024-11-20 01:31:29.884432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.816 qpair failed and we were unable to recover it. 00:30:21.816 [2024-11-20 01:31:29.884566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.816 [2024-11-20 01:31:29.884687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.816 [2024-11-20 01:31:29.884715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.816 qpair failed and we were unable to recover it. 00:30:21.816 [2024-11-20 01:31:29.884844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.816 [2024-11-20 01:31:29.884962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.816 [2024-11-20 01:31:29.884987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.816 qpair failed and we were unable to recover it. 00:30:21.816 [2024-11-20 01:31:29.885133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.816 [2024-11-20 01:31:29.885244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.816 [2024-11-20 01:31:29.885269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.816 qpair failed and we were unable to recover it. 00:30:21.816 [2024-11-20 01:31:29.885370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.816 [2024-11-20 01:31:29.885507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.816 [2024-11-20 01:31:29.885535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.816 qpair failed and we were unable to recover it. 00:30:21.816 [2024-11-20 01:31:29.885649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.816 [2024-11-20 01:31:29.885737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.816 [2024-11-20 01:31:29.885762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.816 qpair failed and we were unable to recover it. 00:30:21.816 [2024-11-20 01:31:29.885903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.816 [2024-11-20 01:31:29.886011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.816 [2024-11-20 01:31:29.886053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.816 qpair failed and we were unable to recover it. 00:30:21.816 [2024-11-20 01:31:29.886243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.816 [2024-11-20 01:31:29.886387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.816 [2024-11-20 01:31:29.886412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.816 qpair failed and we were unable to recover it. 00:30:21.816 [2024-11-20 01:31:29.886509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.816 [2024-11-20 01:31:29.886593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.816 [2024-11-20 01:31:29.886618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.816 qpair failed and we were unable to recover it. 00:30:21.816 [2024-11-20 01:31:29.886753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.816 [2024-11-20 01:31:29.886872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.816 [2024-11-20 01:31:29.886900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.816 qpair failed and we were unable to recover it. 00:30:21.816 [2024-11-20 01:31:29.887002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.816 [2024-11-20 01:31:29.887120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.816 [2024-11-20 01:31:29.887149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.816 qpair failed and we were unable to recover it. 00:30:21.816 [2024-11-20 01:31:29.887283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.816 [2024-11-20 01:31:29.887402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.816 [2024-11-20 01:31:29.887428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.816 qpair failed and we were unable to recover it. 00:30:21.816 [2024-11-20 01:31:29.887535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.816 [2024-11-20 01:31:29.887621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.816 [2024-11-20 01:31:29.887649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.816 qpair failed and we were unable to recover it. 00:30:21.816 [2024-11-20 01:31:29.887769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.816 [2024-11-20 01:31:29.887923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.816 [2024-11-20 01:31:29.887951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.816 qpair failed and we were unable to recover it. 00:30:21.816 [2024-11-20 01:31:29.888105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.816 [2024-11-20 01:31:29.888247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.816 [2024-11-20 01:31:29.888272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.816 qpair failed and we were unable to recover it. 00:30:21.816 [2024-11-20 01:31:29.888380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.816 [2024-11-20 01:31:29.888474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.816 [2024-11-20 01:31:29.888501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.816 qpair failed and we were unable to recover it. 00:30:21.816 [2024-11-20 01:31:29.888602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.816 [2024-11-20 01:31:29.888724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.816 [2024-11-20 01:31:29.888752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.816 qpair failed and we were unable to recover it. 00:30:21.816 [2024-11-20 01:31:29.888852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.816 [2024-11-20 01:31:29.889024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.816 [2024-11-20 01:31:29.889052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.816 qpair failed and we were unable to recover it. 00:30:21.816 [2024-11-20 01:31:29.889222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.816 [2024-11-20 01:31:29.889415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.816 [2024-11-20 01:31:29.889443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.816 qpair failed and we were unable to recover it. 00:30:21.816 [2024-11-20 01:31:29.889552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.816 [2024-11-20 01:31:29.889680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.816 [2024-11-20 01:31:29.889708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.816 qpair failed and we were unable to recover it. 00:30:21.816 [2024-11-20 01:31:29.889816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.816 [2024-11-20 01:31:29.889927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.816 [2024-11-20 01:31:29.889953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.816 qpair failed and we were unable to recover it. 00:30:21.816 [2024-11-20 01:31:29.890074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.816 [2024-11-20 01:31:29.890162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.816 [2024-11-20 01:31:29.890187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.816 qpair failed and we were unable to recover it. 00:30:21.816 [2024-11-20 01:31:29.890302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.816 [2024-11-20 01:31:29.890412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.816 [2024-11-20 01:31:29.890455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.816 qpair failed and we were unable to recover it. 00:30:21.816 [2024-11-20 01:31:29.890572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.816 [2024-11-20 01:31:29.890657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.816 [2024-11-20 01:31:29.890681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.816 qpair failed and we were unable to recover it. 00:30:21.816 [2024-11-20 01:31:29.890797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.816 [2024-11-20 01:31:29.890910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.816 [2024-11-20 01:31:29.890935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.816 qpair failed and we were unable to recover it. 00:30:21.816 [2024-11-20 01:31:29.891023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.817 [2024-11-20 01:31:29.891162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.817 [2024-11-20 01:31:29.891191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.817 qpair failed and we were unable to recover it. 00:30:21.817 [2024-11-20 01:31:29.891324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.817 [2024-11-20 01:31:29.891431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.817 [2024-11-20 01:31:29.891456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.817 qpair failed and we were unable to recover it. 00:30:21.817 [2024-11-20 01:31:29.891551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.817 [2024-11-20 01:31:29.891741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.817 [2024-11-20 01:31:29.891766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.817 qpair failed and we were unable to recover it. 00:30:21.817 [2024-11-20 01:31:29.891935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.817 [2024-11-20 01:31:29.892066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.817 [2024-11-20 01:31:29.892117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.817 qpair failed and we were unable to recover it. 00:30:21.817 [2024-11-20 01:31:29.892259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.817 [2024-11-20 01:31:29.892372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.817 [2024-11-20 01:31:29.892396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.817 qpair failed and we were unable to recover it. 00:30:21.817 [2024-11-20 01:31:29.892527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.817 [2024-11-20 01:31:29.892662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.817 [2024-11-20 01:31:29.892689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.817 qpair failed and we were unable to recover it. 00:30:21.817 [2024-11-20 01:31:29.892812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.817 [2024-11-20 01:31:29.892951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.817 [2024-11-20 01:31:29.892975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.817 qpair failed and we were unable to recover it. 00:30:21.817 [2024-11-20 01:31:29.893129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.817 [2024-11-20 01:31:29.893246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.817 [2024-11-20 01:31:29.893271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.817 qpair failed and we were unable to recover it. 00:30:21.817 [2024-11-20 01:31:29.893415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.817 [2024-11-20 01:31:29.893515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.817 [2024-11-20 01:31:29.893557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.817 qpair failed and we were unable to recover it. 00:30:21.817 [2024-11-20 01:31:29.893653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.817 [2024-11-20 01:31:29.893731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.817 [2024-11-20 01:31:29.893760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.817 qpair failed and we were unable to recover it. 00:30:21.817 [2024-11-20 01:31:29.893892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.817 [2024-11-20 01:31:29.894030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.817 [2024-11-20 01:31:29.894058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.817 qpair failed and we were unable to recover it. 00:30:21.817 [2024-11-20 01:31:29.894190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.817 [2024-11-20 01:31:29.894280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.817 [2024-11-20 01:31:29.894306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.817 qpair failed and we were unable to recover it. 00:30:21.817 [2024-11-20 01:31:29.894412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.817 [2024-11-20 01:31:29.894552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.817 [2024-11-20 01:31:29.894580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.817 qpair failed and we were unable to recover it. 00:30:21.817 [2024-11-20 01:31:29.894777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.817 [2024-11-20 01:31:29.894890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.817 [2024-11-20 01:31:29.894931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.817 qpair failed and we were unable to recover it. 00:30:21.817 [2024-11-20 01:31:29.895031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.817 [2024-11-20 01:31:29.895174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.817 [2024-11-20 01:31:29.895203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.817 qpair failed and we were unable to recover it. 00:30:21.817 [2024-11-20 01:31:29.895340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.817 [2024-11-20 01:31:29.895459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.817 [2024-11-20 01:31:29.895484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.817 qpair failed and we were unable to recover it. 00:30:21.817 [2024-11-20 01:31:29.895594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.817 [2024-11-20 01:31:29.895679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.817 [2024-11-20 01:31:29.895704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.817 qpair failed and we were unable to recover it. 00:30:21.817 [2024-11-20 01:31:29.895823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.817 [2024-11-20 01:31:29.895925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.817 [2024-11-20 01:31:29.895966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.817 qpair failed and we were unable to recover it. 00:30:21.817 [2024-11-20 01:31:29.896086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.817 [2024-11-20 01:31:29.896212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.817 [2024-11-20 01:31:29.896239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.817 qpair failed and we were unable to recover it. 00:30:21.817 [2024-11-20 01:31:29.896377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.817 [2024-11-20 01:31:29.896466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.817 [2024-11-20 01:31:29.896491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.817 qpair failed and we were unable to recover it. 00:30:21.817 [2024-11-20 01:31:29.896607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.817 [2024-11-20 01:31:29.896684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.817 [2024-11-20 01:31:29.896709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.817 qpair failed and we were unable to recover it. 00:30:21.817 [2024-11-20 01:31:29.896803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.817 [2024-11-20 01:31:29.896973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.817 [2024-11-20 01:31:29.896998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.817 qpair failed and we were unable to recover it. 00:30:21.817 [2024-11-20 01:31:29.897147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.817 [2024-11-20 01:31:29.897256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.817 [2024-11-20 01:31:29.897281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.817 qpair failed and we were unable to recover it. 00:30:21.817 [2024-11-20 01:31:29.897363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.817 [2024-11-20 01:31:29.897494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.817 [2024-11-20 01:31:29.897521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.817 qpair failed and we were unable to recover it. 00:30:21.817 [2024-11-20 01:31:29.897720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.817 [2024-11-20 01:31:29.897859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.817 [2024-11-20 01:31:29.897888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.817 qpair failed and we were unable to recover it. 00:30:21.817 [2024-11-20 01:31:29.898004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.817 [2024-11-20 01:31:29.898141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.817 [2024-11-20 01:31:29.898167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.817 qpair failed and we were unable to recover it. 00:30:21.817 [2024-11-20 01:31:29.898272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.817 [2024-11-20 01:31:29.898403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.817 [2024-11-20 01:31:29.898443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.817 qpair failed and we were unable to recover it. 00:30:21.817 [2024-11-20 01:31:29.898538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.817 [2024-11-20 01:31:29.898631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.817 [2024-11-20 01:31:29.898672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.817 qpair failed and we were unable to recover it. 00:30:21.817 [2024-11-20 01:31:29.898803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.817 [2024-11-20 01:31:29.898914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.817 [2024-11-20 01:31:29.898939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.817 qpair failed and we were unable to recover it. 00:30:21.818 [2024-11-20 01:31:29.899084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.818 [2024-11-20 01:31:29.899206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.818 [2024-11-20 01:31:29.899234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.818 qpair failed and we were unable to recover it. 00:30:21.818 [2024-11-20 01:31:29.899358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.818 [2024-11-20 01:31:29.899446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.818 [2024-11-20 01:31:29.899473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.818 qpair failed and we were unable to recover it. 00:30:21.818 [2024-11-20 01:31:29.899611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.818 [2024-11-20 01:31:29.899724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.818 [2024-11-20 01:31:29.899748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.818 qpair failed and we were unable to recover it. 00:30:21.818 [2024-11-20 01:31:29.899860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.818 [2024-11-20 01:31:29.899993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.818 [2024-11-20 01:31:29.900019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.818 qpair failed and we were unable to recover it. 00:30:21.818 [2024-11-20 01:31:29.900157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.818 [2024-11-20 01:31:29.900300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.818 [2024-11-20 01:31:29.900325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.818 qpair failed and we were unable to recover it. 00:30:21.818 [2024-11-20 01:31:29.900437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.818 [2024-11-20 01:31:29.900643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.818 [2024-11-20 01:31:29.900671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.818 qpair failed and we were unable to recover it. 00:30:21.818 [2024-11-20 01:31:29.900803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.818 [2024-11-20 01:31:29.901000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.818 [2024-11-20 01:31:29.901027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.818 qpair failed and we were unable to recover it. 00:30:21.818 [2024-11-20 01:31:29.901204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.818 [2024-11-20 01:31:29.901288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.818 [2024-11-20 01:31:29.901314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.818 qpair failed and we were unable to recover it. 00:30:21.818 [2024-11-20 01:31:29.901412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.818 [2024-11-20 01:31:29.901532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.818 [2024-11-20 01:31:29.901556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.818 qpair failed and we were unable to recover it. 00:30:21.818 [2024-11-20 01:31:29.901638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.818 [2024-11-20 01:31:29.901723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.818 [2024-11-20 01:31:29.901748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.818 qpair failed and we were unable to recover it. 00:30:21.818 [2024-11-20 01:31:29.901897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.818 [2024-11-20 01:31:29.902017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.818 [2024-11-20 01:31:29.902041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.818 qpair failed and we were unable to recover it. 00:30:21.818 [2024-11-20 01:31:29.902163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.818 [2024-11-20 01:31:29.902257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.818 [2024-11-20 01:31:29.902282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.818 qpair failed and we were unable to recover it. 00:30:21.818 [2024-11-20 01:31:29.902439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.818 [2024-11-20 01:31:29.902521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.818 [2024-11-20 01:31:29.902546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.818 qpair failed and we were unable to recover it. 00:30:21.818 [2024-11-20 01:31:29.902648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.818 [2024-11-20 01:31:29.902818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.818 [2024-11-20 01:31:29.902846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.818 qpair failed and we were unable to recover it. 00:30:21.818 [2024-11-20 01:31:29.903009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.818 [2024-11-20 01:31:29.903144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.818 [2024-11-20 01:31:29.903170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.818 qpair failed and we were unable to recover it. 00:30:21.818 [2024-11-20 01:31:29.903313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.818 [2024-11-20 01:31:29.903451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.818 [2024-11-20 01:31:29.903478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.818 qpair failed and we were unable to recover it. 00:30:21.818 [2024-11-20 01:31:29.903611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.818 [2024-11-20 01:31:29.903705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.818 [2024-11-20 01:31:29.903733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.818 qpair failed and we were unable to recover it. 00:30:21.818 [2024-11-20 01:31:29.903843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.818 [2024-11-20 01:31:29.903964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.818 [2024-11-20 01:31:29.903989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.818 qpair failed and we were unable to recover it. 00:30:21.818 [2024-11-20 01:31:29.904081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.818 [2024-11-20 01:31:29.904195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.818 [2024-11-20 01:31:29.904220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.818 qpair failed and we were unable to recover it. 00:30:21.818 [2024-11-20 01:31:29.904316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.818 [2024-11-20 01:31:29.904410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.818 [2024-11-20 01:31:29.904436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.818 qpair failed and we were unable to recover it. 00:30:21.818 [2024-11-20 01:31:29.904558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.818 [2024-11-20 01:31:29.904645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.818 [2024-11-20 01:31:29.904670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.818 qpair failed and we were unable to recover it. 00:30:21.818 [2024-11-20 01:31:29.904806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.818 [2024-11-20 01:31:29.904924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.818 [2024-11-20 01:31:29.904957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.818 qpair failed and we were unable to recover it. 00:30:21.818 [2024-11-20 01:31:29.905060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.818 [2024-11-20 01:31:29.905177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.818 [2024-11-20 01:31:29.905203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.818 qpair failed and we were unable to recover it. 00:30:21.818 [2024-11-20 01:31:29.905397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.818 [2024-11-20 01:31:29.905479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.818 [2024-11-20 01:31:29.905505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.818 qpair failed and we were unable to recover it. 00:30:21.818 [2024-11-20 01:31:29.905589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.818 [2024-11-20 01:31:29.905665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.818 [2024-11-20 01:31:29.905689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.818 qpair failed and we were unable to recover it. 00:30:21.818 [2024-11-20 01:31:29.905830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.818 [2024-11-20 01:31:29.905958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.818 [2024-11-20 01:31:29.905986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.818 qpair failed and we were unable to recover it. 00:30:21.818 [2024-11-20 01:31:29.906153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.818 [2024-11-20 01:31:29.906271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.818 [2024-11-20 01:31:29.906295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.818 qpair failed and we were unable to recover it. 00:30:21.818 [2024-11-20 01:31:29.906409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.818 [2024-11-20 01:31:29.906550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.818 [2024-11-20 01:31:29.906578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.818 qpair failed and we were unable to recover it. 00:30:21.818 [2024-11-20 01:31:29.906704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.818 [2024-11-20 01:31:29.906842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.819 [2024-11-20 01:31:29.906868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.819 qpair failed and we were unable to recover it. 00:30:21.819 [2024-11-20 01:31:29.907009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.819 [2024-11-20 01:31:29.907107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.819 [2024-11-20 01:31:29.907151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.819 qpair failed and we were unable to recover it. 00:30:21.819 [2024-11-20 01:31:29.907266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.819 [2024-11-20 01:31:29.907393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.819 [2024-11-20 01:31:29.907420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.819 qpair failed and we were unable to recover it. 00:30:21.819 [2024-11-20 01:31:29.907526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.819 [2024-11-20 01:31:29.907653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.819 [2024-11-20 01:31:29.907685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.819 qpair failed and we were unable to recover it. 00:30:21.819 [2024-11-20 01:31:29.907829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.819 [2024-11-20 01:31:29.907911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.819 [2024-11-20 01:31:29.907936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.819 qpair failed and we were unable to recover it. 00:30:21.819 [2024-11-20 01:31:29.908086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.819 [2024-11-20 01:31:29.908174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.819 [2024-11-20 01:31:29.908217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.819 qpair failed and we were unable to recover it. 00:30:21.819 [2024-11-20 01:31:29.908362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.819 [2024-11-20 01:31:29.908473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.819 [2024-11-20 01:31:29.908497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.819 qpair failed and we were unable to recover it. 00:30:21.819 [2024-11-20 01:31:29.908639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.819 [2024-11-20 01:31:29.908720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.819 [2024-11-20 01:31:29.908745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.819 qpair failed and we were unable to recover it. 00:30:21.819 [2024-11-20 01:31:29.908839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.819 [2024-11-20 01:31:29.908932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.819 [2024-11-20 01:31:29.908957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.819 qpair failed and we were unable to recover it. 00:30:21.819 [2024-11-20 01:31:29.909100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.819 [2024-11-20 01:31:29.909236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.819 [2024-11-20 01:31:29.909265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.819 qpair failed and we were unable to recover it. 00:30:21.819 [2024-11-20 01:31:29.909370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.819 [2024-11-20 01:31:29.909511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.819 [2024-11-20 01:31:29.909535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.819 qpair failed and we were unable to recover it. 00:30:21.819 [2024-11-20 01:31:29.909622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.819 [2024-11-20 01:31:29.909731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.819 [2024-11-20 01:31:29.909756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.819 qpair failed and we were unable to recover it. 00:30:21.819 [2024-11-20 01:31:29.909916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.819 [2024-11-20 01:31:29.910015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.819 [2024-11-20 01:31:29.910042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.819 qpair failed and we were unable to recover it. 00:30:21.819 [2024-11-20 01:31:29.910190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.819 [2024-11-20 01:31:29.910278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.819 [2024-11-20 01:31:29.910303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.819 qpair failed and we were unable to recover it. 00:30:21.819 [2024-11-20 01:31:29.910501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.819 [2024-11-20 01:31:29.910595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.819 [2024-11-20 01:31:29.910622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.819 qpair failed and we were unable to recover it. 00:30:21.819 [2024-11-20 01:31:29.910747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.819 [2024-11-20 01:31:29.910877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.819 [2024-11-20 01:31:29.910902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.819 qpair failed and we were unable to recover it. 00:30:21.819 [2024-11-20 01:31:29.911023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.819 [2024-11-20 01:31:29.911129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.819 [2024-11-20 01:31:29.911155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.819 qpair failed and we were unable to recover it. 00:30:21.819 [2024-11-20 01:31:29.911274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.819 [2024-11-20 01:31:29.911365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.819 [2024-11-20 01:31:29.911393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.819 qpair failed and we were unable to recover it. 00:30:21.819 [2024-11-20 01:31:29.911515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.819 [2024-11-20 01:31:29.911637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.819 [2024-11-20 01:31:29.911664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.819 qpair failed and we were unable to recover it. 00:30:21.819 [2024-11-20 01:31:29.911774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.819 [2024-11-20 01:31:29.911919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.819 [2024-11-20 01:31:29.911944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.819 qpair failed and we were unable to recover it. 00:30:21.819 [2024-11-20 01:31:29.912047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.819 [2024-11-20 01:31:29.912148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.819 [2024-11-20 01:31:29.912175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.819 qpair failed and we were unable to recover it. 00:30:21.819 [2024-11-20 01:31:29.912302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.819 [2024-11-20 01:31:29.912393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.819 [2024-11-20 01:31:29.912420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.819 qpair failed and we were unable to recover it. 00:30:21.819 [2024-11-20 01:31:29.912521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.819 [2024-11-20 01:31:29.912660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.819 [2024-11-20 01:31:29.912685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.819 qpair failed and we were unable to recover it. 00:30:21.819 [2024-11-20 01:31:29.912770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.819 [2024-11-20 01:31:29.912941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.819 [2024-11-20 01:31:29.912968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.819 qpair failed and we were unable to recover it. 00:30:21.819 [2024-11-20 01:31:29.913145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.819 [2024-11-20 01:31:29.913262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.819 [2024-11-20 01:31:29.913287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.819 qpair failed and we were unable to recover it. 00:30:21.819 [2024-11-20 01:31:29.913373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.819 [2024-11-20 01:31:29.913453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.819 [2024-11-20 01:31:29.913478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.819 qpair failed and we were unable to recover it. 00:30:21.819 [2024-11-20 01:31:29.913607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.819 [2024-11-20 01:31:29.913776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.819 [2024-11-20 01:31:29.913801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.819 qpair failed and we were unable to recover it. 00:30:21.819 [2024-11-20 01:31:29.913984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.819 [2024-11-20 01:31:29.914122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.819 [2024-11-20 01:31:29.914148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.819 qpair failed and we were unable to recover it. 00:30:21.819 [2024-11-20 01:31:29.914270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.819 [2024-11-20 01:31:29.914382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.819 [2024-11-20 01:31:29.914407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.819 qpair failed and we were unable to recover it. 00:30:21.820 [2024-11-20 01:31:29.914538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.820 [2024-11-20 01:31:29.914686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.820 [2024-11-20 01:31:29.914713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.820 qpair failed and we were unable to recover it. 00:30:21.820 [2024-11-20 01:31:29.914835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.820 [2024-11-20 01:31:29.914955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.820 [2024-11-20 01:31:29.914983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.820 qpair failed and we were unable to recover it. 00:30:21.820 [2024-11-20 01:31:29.915122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.820 [2024-11-20 01:31:29.915264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.820 [2024-11-20 01:31:29.915288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.820 qpair failed and we were unable to recover it. 00:30:21.820 [2024-11-20 01:31:29.915498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.820 [2024-11-20 01:31:29.915580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.820 [2024-11-20 01:31:29.915605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.820 qpair failed and we were unable to recover it. 00:30:21.820 [2024-11-20 01:31:29.915775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.820 [2024-11-20 01:31:29.915954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.820 [2024-11-20 01:31:29.915980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.820 qpair failed and we were unable to recover it. 00:30:21.820 [2024-11-20 01:31:29.916095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.820 [2024-11-20 01:31:29.916213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.820 [2024-11-20 01:31:29.916238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.820 qpair failed and we were unable to recover it. 00:30:21.820 [2024-11-20 01:31:29.916340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.820 [2024-11-20 01:31:29.916469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.820 [2024-11-20 01:31:29.916494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.820 qpair failed and we were unable to recover it. 00:30:21.820 [2024-11-20 01:31:29.916582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.820 [2024-11-20 01:31:29.916713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.820 [2024-11-20 01:31:29.916741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.820 qpair failed and we were unable to recover it. 00:30:21.820 [2024-11-20 01:31:29.916883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.820 [2024-11-20 01:31:29.917009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.820 [2024-11-20 01:31:29.917034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.820 qpair failed and we were unable to recover it. 00:30:21.820 [2024-11-20 01:31:29.917145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.820 [2024-11-20 01:31:29.917244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.820 [2024-11-20 01:31:29.917272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.820 qpair failed and we were unable to recover it. 00:30:21.820 [2024-11-20 01:31:29.917423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.820 [2024-11-20 01:31:29.917551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.820 [2024-11-20 01:31:29.917593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.820 qpair failed and we were unable to recover it. 00:30:21.820 [2024-11-20 01:31:29.917705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.820 [2024-11-20 01:31:29.917821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.820 [2024-11-20 01:31:29.917847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.820 qpair failed and we were unable to recover it. 00:30:21.820 [2024-11-20 01:31:29.917977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.820 [2024-11-20 01:31:29.918136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.820 [2024-11-20 01:31:29.918161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.820 qpair failed and we were unable to recover it. 00:30:21.820 [2024-11-20 01:31:29.918253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.820 [2024-11-20 01:31:29.918357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.820 [2024-11-20 01:31:29.918401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.820 qpair failed and we were unable to recover it. 00:30:21.820 [2024-11-20 01:31:29.918547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.820 [2024-11-20 01:31:29.918666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.820 [2024-11-20 01:31:29.918691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.820 qpair failed and we were unable to recover it. 00:30:21.820 [2024-11-20 01:31:29.918805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.820 [2024-11-20 01:31:29.918944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.820 [2024-11-20 01:31:29.918973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.820 qpair failed and we were unable to recover it. 00:30:21.820 [2024-11-20 01:31:29.919117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.820 [2024-11-20 01:31:29.919252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.820 [2024-11-20 01:31:29.919281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.820 qpair failed and we were unable to recover it. 00:30:21.820 [2024-11-20 01:31:29.919410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.820 [2024-11-20 01:31:29.919528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.820 [2024-11-20 01:31:29.919553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.820 qpair failed and we were unable to recover it. 00:30:21.820 [2024-11-20 01:31:29.919665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.820 [2024-11-20 01:31:29.919823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.820 [2024-11-20 01:31:29.919850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.820 qpair failed and we were unable to recover it. 00:30:21.820 [2024-11-20 01:31:29.919956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.820 [2024-11-20 01:31:29.920082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.820 [2024-11-20 01:31:29.920110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.820 qpair failed and we were unable to recover it. 00:30:21.820 [2024-11-20 01:31:29.920223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.820 [2024-11-20 01:31:29.920344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.820 [2024-11-20 01:31:29.920368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.820 qpair failed and we were unable to recover it. 00:30:21.820 [2024-11-20 01:31:29.920484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.820 [2024-11-20 01:31:29.920642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.820 [2024-11-20 01:31:29.920670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.820 qpair failed and we were unable to recover it. 00:30:21.820 [2024-11-20 01:31:29.920770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.820 [2024-11-20 01:31:29.920885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.820 [2024-11-20 01:31:29.920913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.820 qpair failed and we were unable to recover it. 00:30:21.820 [2024-11-20 01:31:29.921111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.820 [2024-11-20 01:31:29.921303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.820 [2024-11-20 01:31:29.921330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.820 qpair failed and we were unable to recover it. 00:30:21.821 [2024-11-20 01:31:29.921488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.921605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.921630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.821 qpair failed and we were unable to recover it. 00:30:21.821 [2024-11-20 01:31:29.921745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.921831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.921855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.821 qpair failed and we were unable to recover it. 00:30:21.821 [2024-11-20 01:31:29.922022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.922168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.922193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.821 qpair failed and we were unable to recover it. 00:30:21.821 [2024-11-20 01:31:29.922277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.922384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.922427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.821 qpair failed and we were unable to recover it. 00:30:21.821 [2024-11-20 01:31:29.922546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.922633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.922658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.821 qpair failed and we were unable to recover it. 00:30:21.821 [2024-11-20 01:31:29.922778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.922859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.922884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.821 qpair failed and we were unable to recover it. 00:30:21.821 [2024-11-20 01:31:29.923026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.923116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.923142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.821 qpair failed and we were unable to recover it. 00:30:21.821 [2024-11-20 01:31:29.923228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.923344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.923385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.821 qpair failed and we were unable to recover it. 00:30:21.821 [2024-11-20 01:31:29.923529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.923615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.923640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.821 qpair failed and we were unable to recover it. 00:30:21.821 [2024-11-20 01:31:29.923756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.923864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.923906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.821 qpair failed and we were unable to recover it. 00:30:21.821 [2024-11-20 01:31:29.924015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.924146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.924179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.821 qpair failed and we were unable to recover it. 00:30:21.821 [2024-11-20 01:31:29.924288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.924439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.924466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.821 qpair failed and we were unable to recover it. 00:30:21.821 [2024-11-20 01:31:29.924575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.924746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.924771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.821 qpair failed and we were unable to recover it. 00:30:21.821 [2024-11-20 01:31:29.924856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.924947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.924972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.821 qpair failed and we were unable to recover it. 00:30:21.821 [2024-11-20 01:31:29.925065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.925185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.925211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.821 qpair failed and we were unable to recover it. 00:30:21.821 [2024-11-20 01:31:29.925307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.925461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.925486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.821 qpair failed and we were unable to recover it. 00:30:21.821 [2024-11-20 01:31:29.925606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.925745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.925773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.821 qpair failed and we were unable to recover it. 00:30:21.821 [2024-11-20 01:31:29.925926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.926097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.926128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.821 qpair failed and we were unable to recover it. 00:30:21.821 [2024-11-20 01:31:29.926234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.926432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.926457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.821 qpair failed and we were unable to recover it. 00:30:21.821 [2024-11-20 01:31:29.926572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.926678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.926705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.821 qpair failed and we were unable to recover it. 00:30:21.821 [2024-11-20 01:31:29.926848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.926992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.927017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.821 qpair failed and we were unable to recover it. 00:30:21.821 [2024-11-20 01:31:29.927109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.927194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.927219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.821 qpair failed and we were unable to recover it. 00:30:21.821 [2024-11-20 01:31:29.927335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.927443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.927469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.821 qpair failed and we were unable to recover it. 00:30:21.821 [2024-11-20 01:31:29.927571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.927762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.927787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.821 qpair failed and we were unable to recover it. 00:30:21.821 [2024-11-20 01:31:29.927907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.928048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.928082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.821 qpair failed and we were unable to recover it. 00:30:21.821 [2024-11-20 01:31:29.928178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.928276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.928301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.821 qpair failed and we were unable to recover it. 00:30:21.821 [2024-11-20 01:31:29.928392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.928478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.928503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.821 qpair failed and we were unable to recover it. 00:30:21.821 [2024-11-20 01:31:29.928697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.928860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.928888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.821 qpair failed and we were unable to recover it. 00:30:21.821 [2024-11-20 01:31:29.929046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.929178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.929206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.821 qpair failed and we were unable to recover it. 00:30:21.821 [2024-11-20 01:31:29.929322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.929460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.929485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.821 qpair failed and we were unable to recover it. 00:30:21.821 [2024-11-20 01:31:29.929575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.821 [2024-11-20 01:31:29.929709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.822 [2024-11-20 01:31:29.929736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.822 qpair failed and we were unable to recover it. 00:30:21.822 [2024-11-20 01:31:29.929857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.822 [2024-11-20 01:31:29.929956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.822 [2024-11-20 01:31:29.929983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.822 qpair failed and we were unable to recover it. 00:30:21.822 [2024-11-20 01:31:29.930125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.822 [2024-11-20 01:31:29.930222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.822 [2024-11-20 01:31:29.930248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.822 qpair failed and we were unable to recover it. 00:30:21.822 [2024-11-20 01:31:29.930348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.822 [2024-11-20 01:31:29.930463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.822 [2024-11-20 01:31:29.930491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.822 qpair failed and we were unable to recover it. 00:30:21.822 [2024-11-20 01:31:29.930618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.822 [2024-11-20 01:31:29.930743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.822 [2024-11-20 01:31:29.930771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.822 qpair failed and we were unable to recover it. 00:30:21.822 [2024-11-20 01:31:29.930872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.822 [2024-11-20 01:31:29.931014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.822 [2024-11-20 01:31:29.931038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.822 qpair failed and we were unable to recover it. 00:30:21.822 [2024-11-20 01:31:29.931171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.822 [2024-11-20 01:31:29.931311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.822 [2024-11-20 01:31:29.931335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.822 qpair failed and we were unable to recover it. 00:30:21.822 [2024-11-20 01:31:29.931478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.822 [2024-11-20 01:31:29.931647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.822 [2024-11-20 01:31:29.931672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.822 qpair failed and we were unable to recover it. 00:30:21.822 [2024-11-20 01:31:29.931819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.822 [2024-11-20 01:31:29.931899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.822 [2024-11-20 01:31:29.931924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.822 qpair failed and we were unable to recover it. 00:30:21.822 [2024-11-20 01:31:29.932041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.822 [2024-11-20 01:31:29.932180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.822 [2024-11-20 01:31:29.932208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.822 qpair failed and we were unable to recover it. 00:30:21.822 [2024-11-20 01:31:29.932333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.822 [2024-11-20 01:31:29.932460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.822 [2024-11-20 01:31:29.932488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.822 qpair failed and we were unable to recover it. 00:30:21.822 [2024-11-20 01:31:29.932633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.822 [2024-11-20 01:31:29.932748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.822 [2024-11-20 01:31:29.932773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.822 qpair failed and we were unable to recover it. 00:30:21.822 [2024-11-20 01:31:29.932893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.822 [2024-11-20 01:31:29.932994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.822 [2024-11-20 01:31:29.933026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.822 qpair failed and we were unable to recover it. 00:30:21.822 [2024-11-20 01:31:29.933164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.822 [2024-11-20 01:31:29.933361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.822 [2024-11-20 01:31:29.933386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.822 qpair failed and we were unable to recover it. 00:30:21.822 [2024-11-20 01:31:29.933531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.822 [2024-11-20 01:31:29.933671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.822 [2024-11-20 01:31:29.933696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.822 qpair failed and we were unable to recover it. 00:30:21.822 [2024-11-20 01:31:29.933842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.822 [2024-11-20 01:31:29.934003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.822 [2024-11-20 01:31:29.934044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.822 qpair failed and we were unable to recover it. 00:30:21.822 [2024-11-20 01:31:29.934169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.822 [2024-11-20 01:31:29.934314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.822 [2024-11-20 01:31:29.934341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.822 qpair failed and we were unable to recover it. 00:30:21.822 [2024-11-20 01:31:29.934478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.822 [2024-11-20 01:31:29.934575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.822 [2024-11-20 01:31:29.934601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.822 qpair failed and we were unable to recover it. 00:30:21.822 [2024-11-20 01:31:29.934709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.822 [2024-11-20 01:31:29.934796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.822 [2024-11-20 01:31:29.934822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.822 qpair failed and we were unable to recover it. 00:30:21.822 [2024-11-20 01:31:29.934940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.822 [2024-11-20 01:31:29.935066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.822 [2024-11-20 01:31:29.935118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.822 qpair failed and we were unable to recover it. 00:30:21.822 [2024-11-20 01:31:29.935240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.822 [2024-11-20 01:31:29.935385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.822 [2024-11-20 01:31:29.935411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.822 qpair failed and we were unable to recover it. 00:30:21.822 [2024-11-20 01:31:29.935518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.822 [2024-11-20 01:31:29.935651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.822 [2024-11-20 01:31:29.935678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.822 qpair failed and we were unable to recover it. 00:30:21.822 [2024-11-20 01:31:29.935801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.822 [2024-11-20 01:31:29.935892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.822 [2024-11-20 01:31:29.935919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.822 qpair failed and we were unable to recover it. 00:30:21.822 [2024-11-20 01:31:29.936031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.822 [2024-11-20 01:31:29.936136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.822 [2024-11-20 01:31:29.936161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.822 qpair failed and we were unable to recover it. 00:30:21.822 [2024-11-20 01:31:29.936316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.822 [2024-11-20 01:31:29.936402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.936430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.823 qpair failed and we were unable to recover it. 00:30:21.823 [2024-11-20 01:31:29.936517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.936679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.936704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.823 qpair failed and we were unable to recover it. 00:30:21.823 [2024-11-20 01:31:29.936852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.937045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.937083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.823 qpair failed and we were unable to recover it. 00:30:21.823 [2024-11-20 01:31:29.937283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.937429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.937474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.823 qpair failed and we were unable to recover it. 00:30:21.823 [2024-11-20 01:31:29.937594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.937712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.937740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.823 qpair failed and we were unable to recover it. 00:30:21.823 [2024-11-20 01:31:29.937882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.937996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.938021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.823 qpair failed and we were unable to recover it. 00:30:21.823 [2024-11-20 01:31:29.938161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.938305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.938331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.823 qpair failed and we were unable to recover it. 00:30:21.823 [2024-11-20 01:31:29.938414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.938500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.938525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.823 qpair failed and we were unable to recover it. 00:30:21.823 [2024-11-20 01:31:29.938609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.938724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.938749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.823 qpair failed and we were unable to recover it. 00:30:21.823 [2024-11-20 01:31:29.938903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.938995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.939037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.823 qpair failed and we were unable to recover it. 00:30:21.823 [2024-11-20 01:31:29.939142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.939235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.939260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.823 qpair failed and we were unable to recover it. 00:30:21.823 [2024-11-20 01:31:29.939381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.939489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.939515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.823 qpair failed and we were unable to recover it. 00:30:21.823 [2024-11-20 01:31:29.939671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.939834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.939860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.823 qpair failed and we were unable to recover it. 00:30:21.823 [2024-11-20 01:31:29.939976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.940119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.940145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.823 qpair failed and we were unable to recover it. 00:30:21.823 [2024-11-20 01:31:29.940265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.940403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.940428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.823 qpair failed and we were unable to recover it. 00:30:21.823 [2024-11-20 01:31:29.940606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.940724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.940749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.823 qpair failed and we were unable to recover it. 00:30:21.823 [2024-11-20 01:31:29.940887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.941012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.941039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.823 qpair failed and we were unable to recover it. 00:30:21.823 [2024-11-20 01:31:29.941212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.941291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.941316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.823 qpair failed and we were unable to recover it. 00:30:21.823 [2024-11-20 01:31:29.941448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.941547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.941574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.823 qpair failed and we were unable to recover it. 00:30:21.823 [2024-11-20 01:31:29.941770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.941917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.941942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.823 qpair failed and we were unable to recover it. 00:30:21.823 [2024-11-20 01:31:29.942101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.942223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.942247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.823 qpair failed and we were unable to recover it. 00:30:21.823 [2024-11-20 01:31:29.942354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.942461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.942489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.823 qpair failed and we were unable to recover it. 00:30:21.823 [2024-11-20 01:31:29.942584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.942712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.942741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.823 qpair failed and we were unable to recover it. 00:30:21.823 [2024-11-20 01:31:29.942845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.942928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.942953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.823 qpair failed and we were unable to recover it. 00:30:21.823 [2024-11-20 01:31:29.943035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.943164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.943205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.823 qpair failed and we were unable to recover it. 00:30:21.823 [2024-11-20 01:31:29.943298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.943424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.943451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.823 qpair failed and we were unable to recover it. 00:30:21.823 [2024-11-20 01:31:29.943585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.943678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.943704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.823 qpair failed and we were unable to recover it. 00:30:21.823 [2024-11-20 01:31:29.943808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.943944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.943969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.823 qpair failed and we were unable to recover it. 00:30:21.823 [2024-11-20 01:31:29.944082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.944202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.944230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.823 qpair failed and we were unable to recover it. 00:30:21.823 [2024-11-20 01:31:29.944366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.944460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.944490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.823 qpair failed and we were unable to recover it. 00:30:21.823 [2024-11-20 01:31:29.944620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.944717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.823 [2024-11-20 01:31:29.944745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.823 qpair failed and we were unable to recover it. 00:30:21.823 [2024-11-20 01:31:29.944855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.944974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.945002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.824 qpair failed and we were unable to recover it. 00:30:21.824 [2024-11-20 01:31:29.945143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.945259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.945284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.824 qpair failed and we were unable to recover it. 00:30:21.824 [2024-11-20 01:31:29.945429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.945573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.945599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.824 qpair failed and we were unable to recover it. 00:30:21.824 [2024-11-20 01:31:29.945730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.945851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.945879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.824 qpair failed and we were unable to recover it. 00:30:21.824 [2024-11-20 01:31:29.946038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.946162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.946188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.824 qpair failed and we were unable to recover it. 00:30:21.824 [2024-11-20 01:31:29.946299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.946556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.946581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.824 qpair failed and we were unable to recover it. 00:30:21.824 [2024-11-20 01:31:29.946693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.946781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.946806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.824 qpair failed and we were unable to recover it. 00:30:21.824 [2024-11-20 01:31:29.946918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.947025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.947050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.824 qpair failed and we were unable to recover it. 00:30:21.824 [2024-11-20 01:31:29.947200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.947298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.947330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.824 qpair failed and we were unable to recover it. 00:30:21.824 [2024-11-20 01:31:29.947436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.947559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.947586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.824 qpair failed and we were unable to recover it. 00:30:21.824 [2024-11-20 01:31:29.947692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.947790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.947815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.824 qpair failed and we were unable to recover it. 00:30:21.824 [2024-11-20 01:31:29.947930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.948015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.948040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.824 qpair failed and we were unable to recover it. 00:30:21.824 [2024-11-20 01:31:29.948140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.948264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.948306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.824 qpair failed and we were unable to recover it. 00:30:21.824 [2024-11-20 01:31:29.948434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.948589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.948614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.824 qpair failed and we were unable to recover it. 00:30:21.824 [2024-11-20 01:31:29.948782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.948909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.948938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.824 qpair failed and we were unable to recover it. 00:30:21.824 [2024-11-20 01:31:29.949039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.949182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.949207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.824 qpair failed and we were unable to recover it. 00:30:21.824 [2024-11-20 01:31:29.949323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.949431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.949456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.824 qpair failed and we were unable to recover it. 00:30:21.824 [2024-11-20 01:31:29.949570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.949660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.949701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.824 qpair failed and we were unable to recover it. 00:30:21.824 [2024-11-20 01:31:29.949829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.949957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.949985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.824 qpair failed and we were unable to recover it. 00:30:21.824 [2024-11-20 01:31:29.950132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.950245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.950270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.824 qpair failed and we were unable to recover it. 00:30:21.824 [2024-11-20 01:31:29.950397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.950523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.950564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.824 qpair failed and we were unable to recover it. 00:30:21.824 [2024-11-20 01:31:29.950684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.950798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.950823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.824 qpair failed and we were unable to recover it. 00:30:21.824 [2024-11-20 01:31:29.950967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.951114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.951158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.824 qpair failed and we were unable to recover it. 00:30:21.824 [2024-11-20 01:31:29.951297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.951400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.951443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.824 qpair failed and we were unable to recover it. 00:30:21.824 [2024-11-20 01:31:29.951556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.951645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.951687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.824 qpair failed and we were unable to recover it. 00:30:21.824 [2024-11-20 01:31:29.951795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.951985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.952010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.824 qpair failed and we were unable to recover it. 00:30:21.824 [2024-11-20 01:31:29.952165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.952245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.952270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.824 qpair failed and we were unable to recover it. 00:30:21.824 [2024-11-20 01:31:29.952411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.952540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.952568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.824 qpair failed and we were unable to recover it. 00:30:21.824 [2024-11-20 01:31:29.952705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.952895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.952938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.824 qpair failed and we were unable to recover it. 00:30:21.824 [2024-11-20 01:31:29.953080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.953211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.953239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.824 qpair failed and we were unable to recover it. 00:30:21.824 [2024-11-20 01:31:29.953372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.953473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.824 [2024-11-20 01:31:29.953501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.825 qpair failed and we were unable to recover it. 00:30:21.825 [2024-11-20 01:31:29.953592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.825 [2024-11-20 01:31:29.953706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.825 [2024-11-20 01:31:29.953732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.825 qpair failed and we were unable to recover it. 00:30:21.825 [2024-11-20 01:31:29.953815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.825 [2024-11-20 01:31:29.953901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.825 [2024-11-20 01:31:29.953926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.825 qpair failed and we were unable to recover it. 00:30:21.825 [2024-11-20 01:31:29.954031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.825 [2024-11-20 01:31:29.954161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.825 [2024-11-20 01:31:29.954187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.825 qpair failed and we were unable to recover it. 00:30:21.825 [2024-11-20 01:31:29.954306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.825 [2024-11-20 01:31:29.954391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.825 [2024-11-20 01:31:29.954417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.825 qpair failed and we were unable to recover it. 00:30:21.825 [2024-11-20 01:31:29.954545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.825 [2024-11-20 01:31:29.954677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.825 [2024-11-20 01:31:29.954705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.825 qpair failed and we were unable to recover it. 00:30:21.825 [2024-11-20 01:31:29.954862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.825 [2024-11-20 01:31:29.955006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.825 [2024-11-20 01:31:29.955031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.825 qpair failed and we were unable to recover it. 00:30:21.825 [2024-11-20 01:31:29.955128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.825 [2024-11-20 01:31:29.955217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.825 [2024-11-20 01:31:29.955242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.825 qpair failed and we were unable to recover it. 00:30:21.825 [2024-11-20 01:31:29.955359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.825 [2024-11-20 01:31:29.955518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.825 [2024-11-20 01:31:29.955546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.825 qpair failed and we were unable to recover it. 00:30:21.825 [2024-11-20 01:31:29.955676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.825 [2024-11-20 01:31:29.955811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.825 [2024-11-20 01:31:29.955836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.825 qpair failed and we were unable to recover it. 00:30:21.825 [2024-11-20 01:31:29.955988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.825 [2024-11-20 01:31:29.956105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.825 [2024-11-20 01:31:29.956149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.825 qpair failed and we were unable to recover it. 00:30:21.825 [2024-11-20 01:31:29.956280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.825 [2024-11-20 01:31:29.956414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.825 [2024-11-20 01:31:29.956442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.825 qpair failed and we were unable to recover it. 00:30:21.825 [2024-11-20 01:31:29.956542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.825 [2024-11-20 01:31:29.956695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.825 [2024-11-20 01:31:29.956723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.825 qpair failed and we were unable to recover it. 00:30:21.825 [2024-11-20 01:31:29.956841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.825 [2024-11-20 01:31:29.956959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.825 [2024-11-20 01:31:29.956984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.825 qpair failed and we were unable to recover it. 00:30:21.825 [2024-11-20 01:31:29.957109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.825 [2024-11-20 01:31:29.957220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.825 [2024-11-20 01:31:29.957246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.825 qpair failed and we were unable to recover it. 00:30:21.825 [2024-11-20 01:31:29.957364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.825 [2024-11-20 01:31:29.957480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.825 [2024-11-20 01:31:29.957504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.825 qpair failed and we were unable to recover it. 00:30:21.825 [2024-11-20 01:31:29.957590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.825 [2024-11-20 01:31:29.957678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.825 [2024-11-20 01:31:29.957703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.825 qpair failed and we were unable to recover it. 00:30:21.825 [2024-11-20 01:31:29.957785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.825 [2024-11-20 01:31:29.957901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.825 [2024-11-20 01:31:29.957926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.825 qpair failed and we were unable to recover it. 00:30:21.825 [2024-11-20 01:31:29.958077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.825 [2024-11-20 01:31:29.958214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.825 [2024-11-20 01:31:29.958242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.825 qpair failed and we were unable to recover it. 00:30:21.825 [2024-11-20 01:31:29.958381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.825 [2024-11-20 01:31:29.958465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.825 [2024-11-20 01:31:29.958493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.825 qpair failed and we were unable to recover it. 00:30:21.825 [2024-11-20 01:31:29.958587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.825 [2024-11-20 01:31:29.958704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.825 [2024-11-20 01:31:29.958733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.825 qpair failed and we were unable to recover it. 00:30:21.825 [2024-11-20 01:31:29.958857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.825 [2024-11-20 01:31:29.959010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.825 [2024-11-20 01:31:29.959035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.825 qpair failed and we were unable to recover it. 00:30:21.825 [2024-11-20 01:31:29.959166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.825 [2024-11-20 01:31:29.959251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.825 [2024-11-20 01:31:29.959276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.825 qpair failed and we were unable to recover it. 00:30:21.825 [2024-11-20 01:31:29.959382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.825 [2024-11-20 01:31:29.959500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.825 [2024-11-20 01:31:29.959527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.825 qpair failed and we were unable to recover it. 00:30:21.825 [2024-11-20 01:31:29.959625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.825 [2024-11-20 01:31:29.959753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.825 [2024-11-20 01:31:29.959781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.825 qpair failed and we were unable to recover it. 00:30:21.825 [2024-11-20 01:31:29.959917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.825 [2024-11-20 01:31:29.960026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.825 [2024-11-20 01:31:29.960051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.825 qpair failed and we were unable to recover it. 00:30:21.825 [2024-11-20 01:31:29.960191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.825 [2024-11-20 01:31:29.960290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.825 [2024-11-20 01:31:29.960317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.826 qpair failed and we were unable to recover it. 00:30:21.826 [2024-11-20 01:31:29.960457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.960550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.960576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.826 qpair failed and we were unable to recover it. 00:30:21.826 [2024-11-20 01:31:29.960695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.960780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.960805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.826 qpair failed and we were unable to recover it. 00:30:21.826 [2024-11-20 01:31:29.960922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.961028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.961054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.826 qpair failed and we were unable to recover it. 00:30:21.826 [2024-11-20 01:31:29.961181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.961299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.961327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.826 qpair failed and we were unable to recover it. 00:30:21.826 [2024-11-20 01:31:29.961441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.961556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.961582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.826 qpair failed and we were unable to recover it. 00:30:21.826 [2024-11-20 01:31:29.961681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.961814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.961842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.826 qpair failed and we were unable to recover it. 00:30:21.826 [2024-11-20 01:31:29.961935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.962091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.962119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.826 qpair failed and we were unable to recover it. 00:30:21.826 [2024-11-20 01:31:29.962257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.962370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.962396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.826 qpair failed and we were unable to recover it. 00:30:21.826 [2024-11-20 01:31:29.962527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.962621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.962662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.826 qpair failed and we were unable to recover it. 00:30:21.826 [2024-11-20 01:31:29.962781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.962948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.962975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.826 qpair failed and we were unable to recover it. 00:30:21.826 [2024-11-20 01:31:29.963110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.963225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.963250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.826 qpair failed and we were unable to recover it. 00:30:21.826 [2024-11-20 01:31:29.963349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.963470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.963512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.826 qpair failed and we were unable to recover it. 00:30:21.826 [2024-11-20 01:31:29.963608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.963726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.963769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.826 qpair failed and we were unable to recover it. 00:30:21.826 [2024-11-20 01:31:29.963909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.964030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.964055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.826 qpair failed and we were unable to recover it. 00:30:21.826 [2024-11-20 01:31:29.964161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.964288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.964313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.826 qpair failed and we were unable to recover it. 00:30:21.826 [2024-11-20 01:31:29.964408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.964553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.964581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.826 qpair failed and we were unable to recover it. 00:30:21.826 [2024-11-20 01:31:29.964741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.964831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.964858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.826 qpair failed and we were unable to recover it. 00:30:21.826 [2024-11-20 01:31:29.964989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.965088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.965116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.826 qpair failed and we were unable to recover it. 00:30:21.826 [2024-11-20 01:31:29.965210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.965361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.965388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.826 qpair failed and we were unable to recover it. 00:30:21.826 [2024-11-20 01:31:29.965518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.965727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.965754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.826 qpair failed and we were unable to recover it. 00:30:21.826 [2024-11-20 01:31:29.965876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.966030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.966058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.826 qpair failed and we were unable to recover it. 00:30:21.826 [2024-11-20 01:31:29.966200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.966345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.966370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.826 qpair failed and we were unable to recover it. 00:30:21.826 [2024-11-20 01:31:29.966487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.966677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.966702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.826 qpair failed and we were unable to recover it. 00:30:21.826 [2024-11-20 01:31:29.966844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.966998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.967026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.826 qpair failed and we were unable to recover it. 00:30:21.826 [2024-11-20 01:31:29.967158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.967279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.967306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.826 qpair failed and we were unable to recover it. 00:30:21.826 [2024-11-20 01:31:29.967417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.967531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.967557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.826 qpair failed and we were unable to recover it. 00:30:21.826 [2024-11-20 01:31:29.967700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.967821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.967849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.826 qpair failed and we were unable to recover it. 00:30:21.826 [2024-11-20 01:31:29.967943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.968041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.968078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.826 qpair failed and we were unable to recover it. 00:30:21.826 [2024-11-20 01:31:29.968188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.968293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.968318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.826 qpair failed and we were unable to recover it. 00:30:21.826 [2024-11-20 01:31:29.968511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.968634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.968661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.826 qpair failed and we were unable to recover it. 00:30:21.826 [2024-11-20 01:31:29.968819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.968945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.968973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.826 qpair failed and we were unable to recover it. 00:30:21.826 [2024-11-20 01:31:29.969116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.969204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.826 [2024-11-20 01:31:29.969229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.826 qpair failed and we were unable to recover it. 00:30:21.826 [2024-11-20 01:31:29.969420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.827 [2024-11-20 01:31:29.969605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.827 [2024-11-20 01:31:29.969654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.827 qpair failed and we were unable to recover it. 00:30:21.827 [2024-11-20 01:31:29.969787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.827 [2024-11-20 01:31:29.969889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.827 [2024-11-20 01:31:29.969917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.827 qpair failed and we were unable to recover it. 00:30:21.827 [2024-11-20 01:31:29.970081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.827 [2024-11-20 01:31:29.970175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.827 [2024-11-20 01:31:29.970201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.827 qpair failed and we were unable to recover it. 00:30:21.827 [2024-11-20 01:31:29.970314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.827 [2024-11-20 01:31:29.970405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.827 [2024-11-20 01:31:29.970434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.827 qpair failed and we were unable to recover it. 00:30:21.827 [2024-11-20 01:31:29.970538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.827 [2024-11-20 01:31:29.970706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.827 [2024-11-20 01:31:29.970730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.827 qpair failed and we were unable to recover it. 00:30:21.827 [2024-11-20 01:31:29.970842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.827 [2024-11-20 01:31:29.970950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.827 [2024-11-20 01:31:29.970978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.827 qpair failed and we were unable to recover it. 00:30:21.827 [2024-11-20 01:31:29.971113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.827 [2024-11-20 01:31:29.971260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.827 [2024-11-20 01:31:29.971285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.827 qpair failed and we were unable to recover it. 00:30:21.827 [2024-11-20 01:31:29.971394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.827 [2024-11-20 01:31:29.971549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.827 [2024-11-20 01:31:29.971576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.827 qpair failed and we were unable to recover it. 00:30:21.827 [2024-11-20 01:31:29.971748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.827 [2024-11-20 01:31:29.971857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.827 [2024-11-20 01:31:29.971881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.827 qpair failed and we were unable to recover it. 00:30:21.827 [2024-11-20 01:31:29.972093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.827 [2024-11-20 01:31:29.972241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.827 [2024-11-20 01:31:29.972280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.827 qpair failed and we were unable to recover it. 00:30:21.827 [2024-11-20 01:31:29.972417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.827 [2024-11-20 01:31:29.972540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.827 [2024-11-20 01:31:29.972567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.827 qpair failed and we were unable to recover it. 00:30:21.827 [2024-11-20 01:31:29.972733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.827 [2024-11-20 01:31:29.972853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.827 [2024-11-20 01:31:29.972884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.827 qpair failed and we were unable to recover it. 00:30:21.827 [2024-11-20 01:31:29.973003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.827 [2024-11-20 01:31:29.973142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.827 [2024-11-20 01:31:29.973171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.827 qpair failed and we were unable to recover it. 00:30:21.827 [2024-11-20 01:31:29.973321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.827 [2024-11-20 01:31:29.973460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.827 [2024-11-20 01:31:29.973485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.827 qpair failed and we were unable to recover it. 00:30:21.827 [2024-11-20 01:31:29.973632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.827 [2024-11-20 01:31:29.973747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.827 [2024-11-20 01:31:29.973772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.827 qpair failed and we were unable to recover it. 00:30:21.827 [2024-11-20 01:31:29.973932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.827 [2024-11-20 01:31:29.974114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.827 [2024-11-20 01:31:29.974140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.827 qpair failed and we were unable to recover it. 00:30:21.827 [2024-11-20 01:31:29.974257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.827 [2024-11-20 01:31:29.974374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.827 [2024-11-20 01:31:29.974417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.827 qpair failed and we were unable to recover it. 00:30:21.827 [2024-11-20 01:31:29.974585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.827 [2024-11-20 01:31:29.974692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.827 [2024-11-20 01:31:29.974717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:21.827 qpair failed and we were unable to recover it. 00:30:21.827 [2024-11-20 01:31:29.974842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.109 [2024-11-20 01:31:29.974965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.109 [2024-11-20 01:31:29.974993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.109 qpair failed and we were unable to recover it. 00:30:22.109 [2024-11-20 01:31:29.975150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.109 [2024-11-20 01:31:29.975272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.109 [2024-11-20 01:31:29.975301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.109 qpair failed and we were unable to recover it. 00:30:22.109 [2024-11-20 01:31:29.975412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.109 [2024-11-20 01:31:29.975525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.109 [2024-11-20 01:31:29.975551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.109 qpair failed and we were unable to recover it. 00:30:22.109 [2024-11-20 01:31:29.975685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.109 [2024-11-20 01:31:29.975838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.109 [2024-11-20 01:31:29.975866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.109 qpair failed and we were unable to recover it. 00:30:22.109 [2024-11-20 01:31:29.975964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.109 [2024-11-20 01:31:29.976089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.109 [2024-11-20 01:31:29.976118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.109 qpair failed and we were unable to recover it. 00:30:22.109 [2024-11-20 01:31:29.976237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.109 [2024-11-20 01:31:29.976352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.109 [2024-11-20 01:31:29.976377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.109 qpair failed and we were unable to recover it. 00:30:22.110 [2024-11-20 01:31:29.976512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.110 [2024-11-20 01:31:29.976709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.110 [2024-11-20 01:31:29.976734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.110 qpair failed and we were unable to recover it. 00:30:22.110 [2024-11-20 01:31:29.976853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.110 [2024-11-20 01:31:29.976982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.110 [2024-11-20 01:31:29.977009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.110 qpair failed and we were unable to recover it. 00:30:22.110 [2024-11-20 01:31:29.977144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.110 [2024-11-20 01:31:29.977231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.110 [2024-11-20 01:31:29.977255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.110 qpair failed and we were unable to recover it. 00:30:22.110 [2024-11-20 01:31:29.977364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.110 [2024-11-20 01:31:29.977455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.110 [2024-11-20 01:31:29.977483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.110 qpair failed and we were unable to recover it. 00:30:22.110 [2024-11-20 01:31:29.977568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.110 [2024-11-20 01:31:29.977683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.110 [2024-11-20 01:31:29.977711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.110 qpair failed and we were unable to recover it. 00:30:22.110 [2024-11-20 01:31:29.977827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.110 [2024-11-20 01:31:29.977938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.110 [2024-11-20 01:31:29.977964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.110 qpair failed and we were unable to recover it. 00:30:22.110 [2024-11-20 01:31:29.978115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.110 [2024-11-20 01:31:29.978240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.110 [2024-11-20 01:31:29.978268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.110 qpair failed and we were unable to recover it. 00:30:22.110 [2024-11-20 01:31:29.978390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.110 [2024-11-20 01:31:29.978483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.110 [2024-11-20 01:31:29.978526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.110 qpair failed and we were unable to recover it. 00:30:22.110 [2024-11-20 01:31:29.978660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.110 [2024-11-20 01:31:29.978778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.110 [2024-11-20 01:31:29.978803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.110 qpair failed and we were unable to recover it. 00:30:22.110 [2024-11-20 01:31:29.978914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.110 [2024-11-20 01:31:29.979013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.110 [2024-11-20 01:31:29.979041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.110 qpair failed and we were unable to recover it. 00:30:22.110 [2024-11-20 01:31:29.979185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.110 [2024-11-20 01:31:29.979336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.110 [2024-11-20 01:31:29.979364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.110 qpair failed and we were unable to recover it. 00:30:22.110 [2024-11-20 01:31:29.979491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.110 [2024-11-20 01:31:29.979635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.110 [2024-11-20 01:31:29.979660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.110 qpair failed and we were unable to recover it. 00:30:22.110 [2024-11-20 01:31:29.979789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.110 [2024-11-20 01:31:29.979985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.110 [2024-11-20 01:31:29.980013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.110 qpair failed and we were unable to recover it. 00:30:22.110 [2024-11-20 01:31:29.980173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.110 [2024-11-20 01:31:29.980251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.110 [2024-11-20 01:31:29.980275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.110 qpair failed and we were unable to recover it. 00:30:22.110 [2024-11-20 01:31:29.980369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.110 [2024-11-20 01:31:29.980452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.110 [2024-11-20 01:31:29.980477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.110 qpair failed and we were unable to recover it. 00:30:22.110 [2024-11-20 01:31:29.980562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.110 [2024-11-20 01:31:29.980688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.110 [2024-11-20 01:31:29.980716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.110 qpair failed and we were unable to recover it. 00:30:22.110 [2024-11-20 01:31:29.980846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.110 [2024-11-20 01:31:29.980941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.110 [2024-11-20 01:31:29.980969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.110 qpair failed and we were unable to recover it. 00:30:22.110 [2024-11-20 01:31:29.981166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.110 [2024-11-20 01:31:29.981266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.110 [2024-11-20 01:31:29.981291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.110 qpair failed and we were unable to recover it. 00:30:22.110 [2024-11-20 01:31:29.981370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.110 [2024-11-20 01:31:29.981486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.110 [2024-11-20 01:31:29.981511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.110 qpair failed and we were unable to recover it. 00:30:22.110 [2024-11-20 01:31:29.981627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.110 [2024-11-20 01:31:29.981714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.110 [2024-11-20 01:31:29.981740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.110 qpair failed and we were unable to recover it. 00:30:22.110 [2024-11-20 01:31:29.981827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.110 [2024-11-20 01:31:29.981942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.110 [2024-11-20 01:31:29.981968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.110 qpair failed and we were unable to recover it. 00:30:22.110 [2024-11-20 01:31:29.982115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.110 [2024-11-20 01:31:29.982248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.110 [2024-11-20 01:31:29.982275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.110 qpair failed and we were unable to recover it. 00:30:22.110 [2024-11-20 01:31:29.982430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.110 [2024-11-20 01:31:29.982547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.110 [2024-11-20 01:31:29.982575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.110 qpair failed and we were unable to recover it. 00:30:22.110 [2024-11-20 01:31:29.982732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.110 [2024-11-20 01:31:29.982847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.110 [2024-11-20 01:31:29.982872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.110 qpair failed and we were unable to recover it. 00:30:22.110 [2024-11-20 01:31:29.983034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.110 [2024-11-20 01:31:29.983190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.110 [2024-11-20 01:31:29.983215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.110 qpair failed and we were unable to recover it. 00:30:22.110 [2024-11-20 01:31:29.983358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.110 [2024-11-20 01:31:29.983489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.110 [2024-11-20 01:31:29.983517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.110 qpair failed and we were unable to recover it. 00:30:22.110 [2024-11-20 01:31:29.983691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.110 [2024-11-20 01:31:29.983805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.110 [2024-11-20 01:31:29.983831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.110 qpair failed and we were unable to recover it. 00:30:22.110 [2024-11-20 01:31:29.983973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.110 [2024-11-20 01:31:29.984111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.110 [2024-11-20 01:31:29.984137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.110 qpair failed and we were unable to recover it. 00:30:22.110 [2024-11-20 01:31:29.984267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.110 [2024-11-20 01:31:29.984395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.111 [2024-11-20 01:31:29.984439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.111 qpair failed and we were unable to recover it. 00:30:22.111 [2024-11-20 01:31:29.984558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.111 [2024-11-20 01:31:29.984655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.111 [2024-11-20 01:31:29.984680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.111 qpair failed and we were unable to recover it. 00:30:22.111 [2024-11-20 01:31:29.984826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.111 [2024-11-20 01:31:29.984921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.111 [2024-11-20 01:31:29.984946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.111 qpair failed and we were unable to recover it. 00:30:22.111 [2024-11-20 01:31:29.985086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.111 [2024-11-20 01:31:29.985205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.111 [2024-11-20 01:31:29.985233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.111 qpair failed and we were unable to recover it. 00:30:22.111 [2024-11-20 01:31:29.985356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.111 [2024-11-20 01:31:29.985469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.111 [2024-11-20 01:31:29.985494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.111 qpair failed and we were unable to recover it. 00:30:22.111 [2024-11-20 01:31:29.985643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.111 [2024-11-20 01:31:29.985786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.111 [2024-11-20 01:31:29.985811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.111 qpair failed and we were unable to recover it. 00:30:22.111 [2024-11-20 01:31:29.985925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.111 [2024-11-20 01:31:29.986059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.111 [2024-11-20 01:31:29.986098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.111 qpair failed and we were unable to recover it. 00:30:22.111 [2024-11-20 01:31:29.986265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.111 [2024-11-20 01:31:29.986341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.111 [2024-11-20 01:31:29.986366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.111 qpair failed and we were unable to recover it. 00:30:22.111 [2024-11-20 01:31:29.986533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.111 [2024-11-20 01:31:29.986626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.111 [2024-11-20 01:31:29.986654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.111 qpair failed and we were unable to recover it. 00:30:22.111 [2024-11-20 01:31:29.986775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.111 [2024-11-20 01:31:29.986906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.111 [2024-11-20 01:31:29.986934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.111 qpair failed and we were unable to recover it. 00:30:22.111 [2024-11-20 01:31:29.987060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.111 [2024-11-20 01:31:29.987181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.111 [2024-11-20 01:31:29.987210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.111 qpair failed and we were unable to recover it. 00:30:22.111 [2024-11-20 01:31:29.987323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.111 [2024-11-20 01:31:29.987430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.111 [2024-11-20 01:31:29.987459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.111 qpair failed and we were unable to recover it. 00:30:22.111 [2024-11-20 01:31:29.987621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.111 [2024-11-20 01:31:29.987716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.111 [2024-11-20 01:31:29.987741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.111 qpair failed and we were unable to recover it. 00:30:22.111 [2024-11-20 01:31:29.987827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.111 [2024-11-20 01:31:29.987972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.111 [2024-11-20 01:31:29.987997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.111 qpair failed and we were unable to recover it. 00:30:22.111 [2024-11-20 01:31:29.988125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.111 [2024-11-20 01:31:29.988224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.111 [2024-11-20 01:31:29.988252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.111 qpair failed and we were unable to recover it. 00:30:22.111 [2024-11-20 01:31:29.988346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.111 [2024-11-20 01:31:29.988465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.111 [2024-11-20 01:31:29.988493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.111 qpair failed and we were unable to recover it. 00:30:22.111 [2024-11-20 01:31:29.988605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.111 [2024-11-20 01:31:29.988691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.111 [2024-11-20 01:31:29.988716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.111 qpair failed and we were unable to recover it. 00:30:22.111 [2024-11-20 01:31:29.988835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.111 [2024-11-20 01:31:29.988974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.111 [2024-11-20 01:31:29.989002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.111 qpair failed and we were unable to recover it. 00:30:22.111 [2024-11-20 01:31:29.989102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.111 [2024-11-20 01:31:29.989206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.111 [2024-11-20 01:31:29.989234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.111 qpair failed and we were unable to recover it. 00:30:22.111 [2024-11-20 01:31:29.989350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.111 [2024-11-20 01:31:29.989433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.111 [2024-11-20 01:31:29.989458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.111 qpair failed and we were unable to recover it. 00:30:22.111 [2024-11-20 01:31:29.989552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.111 [2024-11-20 01:31:29.989639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.111 [2024-11-20 01:31:29.989664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.111 qpair failed and we were unable to recover it. 00:30:22.111 [2024-11-20 01:31:29.989780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.111 [2024-11-20 01:31:29.989920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.111 [2024-11-20 01:31:29.989947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.111 qpair failed and we were unable to recover it. 00:30:22.111 [2024-11-20 01:31:29.990047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.111 [2024-11-20 01:31:29.990137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.111 [2024-11-20 01:31:29.990162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.111 qpair failed and we were unable to recover it. 00:30:22.111 [2024-11-20 01:31:29.990246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.111 [2024-11-20 01:31:29.990386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.111 [2024-11-20 01:31:29.990413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.111 qpair failed and we were unable to recover it. 00:30:22.111 [2024-11-20 01:31:29.990551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.111 [2024-11-20 01:31:29.990630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.111 [2024-11-20 01:31:29.990655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.111 qpair failed and we were unable to recover it. 00:30:22.111 [2024-11-20 01:31:29.990797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.111 [2024-11-20 01:31:29.990907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.111 [2024-11-20 01:31:29.990932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.111 qpair failed and we were unable to recover it. 00:30:22.111 [2024-11-20 01:31:29.991104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.111 [2024-11-20 01:31:29.991222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.111 [2024-11-20 01:31:29.991250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.111 qpair failed and we were unable to recover it. 00:30:22.111 [2024-11-20 01:31:29.991377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.111 [2024-11-20 01:31:29.991480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.111 [2024-11-20 01:31:29.991508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.111 qpair failed and we were unable to recover it. 00:30:22.111 [2024-11-20 01:31:29.991624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.111 [2024-11-20 01:31:29.991741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.112 [2024-11-20 01:31:29.991765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.112 qpair failed and we were unable to recover it. 00:30:22.112 [2024-11-20 01:31:29.991902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.112 [2024-11-20 01:31:29.992050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.112 [2024-11-20 01:31:29.992085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.112 qpair failed and we were unable to recover it. 00:30:22.112 [2024-11-20 01:31:29.992181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.112 [2024-11-20 01:31:29.992287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.112 [2024-11-20 01:31:29.992312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.112 qpair failed and we were unable to recover it. 00:30:22.112 [2024-11-20 01:31:29.992433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.112 [2024-11-20 01:31:29.992523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.112 [2024-11-20 01:31:29.992549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.112 qpair failed and we were unable to recover it. 00:30:22.112 [2024-11-20 01:31:29.992648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.112 [2024-11-20 01:31:29.992779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.112 [2024-11-20 01:31:29.992806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.112 qpair failed and we were unable to recover it. 00:30:22.112 [2024-11-20 01:31:29.992901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.112 [2024-11-20 01:31:29.993079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.112 [2024-11-20 01:31:29.993104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.112 qpair failed and we were unable to recover it. 00:30:22.112 [2024-11-20 01:31:29.993188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.112 [2024-11-20 01:31:29.993328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.112 [2024-11-20 01:31:29.993353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.112 qpair failed and we were unable to recover it. 00:30:22.112 [2024-11-20 01:31:29.993502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.112 [2024-11-20 01:31:29.993639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.112 [2024-11-20 01:31:29.993667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.112 qpair failed and we were unable to recover it. 00:30:22.112 [2024-11-20 01:31:29.993795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.112 [2024-11-20 01:31:29.993893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.112 [2024-11-20 01:31:29.993921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.112 qpair failed and we were unable to recover it. 00:30:22.112 [2024-11-20 01:31:29.994035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.112 [2024-11-20 01:31:29.994206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.112 [2024-11-20 01:31:29.994231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.112 qpair failed and we were unable to recover it. 00:30:22.112 [2024-11-20 01:31:29.994350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.112 [2024-11-20 01:31:29.994460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.112 [2024-11-20 01:31:29.994485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.112 qpair failed and we were unable to recover it. 00:30:22.112 [2024-11-20 01:31:29.994598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.112 [2024-11-20 01:31:29.994718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.112 [2024-11-20 01:31:29.994743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.112 qpair failed and we were unable to recover it. 00:30:22.112 [2024-11-20 01:31:29.994854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.112 [2024-11-20 01:31:29.994935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.112 [2024-11-20 01:31:29.994960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.112 qpair failed and we were unable to recover it. 00:30:22.112 [2024-11-20 01:31:29.995083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.112 [2024-11-20 01:31:29.995171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.112 [2024-11-20 01:31:29.995211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.112 qpair failed and we were unable to recover it. 00:30:22.112 [2024-11-20 01:31:29.995365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.112 [2024-11-20 01:31:29.995493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.112 [2024-11-20 01:31:29.995537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.112 qpair failed and we were unable to recover it. 00:30:22.112 [2024-11-20 01:31:29.995684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.112 [2024-11-20 01:31:29.995770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.112 [2024-11-20 01:31:29.995795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.112 qpair failed and we were unable to recover it. 00:30:22.112 [2024-11-20 01:31:29.995876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.112 [2024-11-20 01:31:29.996016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.112 [2024-11-20 01:31:29.996058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.112 qpair failed and we were unable to recover it. 00:30:22.112 [2024-11-20 01:31:29.996157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.112 [2024-11-20 01:31:29.996247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.112 [2024-11-20 01:31:29.996291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.112 qpair failed and we were unable to recover it. 00:30:22.112 [2024-11-20 01:31:29.996411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.112 [2024-11-20 01:31:29.996552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.112 [2024-11-20 01:31:29.996578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.112 qpair failed and we were unable to recover it. 00:30:22.112 [2024-11-20 01:31:29.996679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.112 [2024-11-20 01:31:29.996780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.112 [2024-11-20 01:31:29.996807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.112 qpair failed and we were unable to recover it. 00:30:22.112 [2024-11-20 01:31:29.996899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.112 [2024-11-20 01:31:29.996987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.112 [2024-11-20 01:31:29.997014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.112 qpair failed and we were unable to recover it. 00:30:22.112 [2024-11-20 01:31:29.997131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.112 [2024-11-20 01:31:29.997323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.112 [2024-11-20 01:31:29.997347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.112 qpair failed and we were unable to recover it. 00:30:22.112 [2024-11-20 01:31:29.997511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.112 [2024-11-20 01:31:29.997610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.112 [2024-11-20 01:31:29.997637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.112 qpair failed and we were unable to recover it. 00:30:22.112 [2024-11-20 01:31:29.997770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.112 [2024-11-20 01:31:29.997904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.112 [2024-11-20 01:31:29.997936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.112 qpair failed and we were unable to recover it. 00:30:22.112 [2024-11-20 01:31:29.998082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.112 [2024-11-20 01:31:29.998191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.112 [2024-11-20 01:31:29.998216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.112 qpair failed and we were unable to recover it. 00:30:22.112 [2024-11-20 01:31:29.998316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.112 [2024-11-20 01:31:29.998437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.112 [2024-11-20 01:31:29.998477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.112 qpair failed and we were unable to recover it. 00:30:22.112 [2024-11-20 01:31:29.998564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.112 [2024-11-20 01:31:29.998674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.112 [2024-11-20 01:31:29.998717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.112 qpair failed and we were unable to recover it. 00:30:22.112 [2024-11-20 01:31:29.998857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.112 [2024-11-20 01:31:29.999001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.112 [2024-11-20 01:31:29.999026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.112 qpair failed and we were unable to recover it. 00:30:22.112 [2024-11-20 01:31:29.999163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.112 [2024-11-20 01:31:29.999256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.112 [2024-11-20 01:31:29.999280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.112 qpair failed and we were unable to recover it. 00:30:22.113 [2024-11-20 01:31:29.999386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.113 [2024-11-20 01:31:29.999481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.113 [2024-11-20 01:31:29.999508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.113 qpair failed and we were unable to recover it. 00:30:22.113 [2024-11-20 01:31:29.999641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.113 [2024-11-20 01:31:29.999759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.113 [2024-11-20 01:31:29.999784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.113 qpair failed and we were unable to recover it. 00:30:22.113 [2024-11-20 01:31:29.999886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.113 [2024-11-20 01:31:30.000037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.113 [2024-11-20 01:31:30.000065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.113 qpair failed and we were unable to recover it. 00:30:22.113 [2024-11-20 01:31:30.000186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.113 [2024-11-20 01:31:30.000307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.113 [2024-11-20 01:31:30.000332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.113 qpair failed and we were unable to recover it. 00:30:22.113 [2024-11-20 01:31:30.000481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.113 [2024-11-20 01:31:30.000571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.113 [2024-11-20 01:31:30.000597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.113 qpair failed and we were unable to recover it. 00:30:22.113 [2024-11-20 01:31:30.000715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.113 [2024-11-20 01:31:30.000824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.113 [2024-11-20 01:31:30.000859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.113 qpair failed and we were unable to recover it. 00:30:22.113 [2024-11-20 01:31:30.000997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.113 [2024-11-20 01:31:30.001159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.113 [2024-11-20 01:31:30.001200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.113 qpair failed and we were unable to recover it. 00:30:22.113 [2024-11-20 01:31:30.001344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.113 [2024-11-20 01:31:30.001454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.113 [2024-11-20 01:31:30.001486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.113 qpair failed and we were unable to recover it. 00:30:22.113 [2024-11-20 01:31:30.001635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.113 [2024-11-20 01:31:30.001776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.113 [2024-11-20 01:31:30.001812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.113 qpair failed and we were unable to recover it. 00:30:22.113 [2024-11-20 01:31:30.001958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.113 [2024-11-20 01:31:30.002102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.113 [2024-11-20 01:31:30.002143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.113 qpair failed and we were unable to recover it. 00:30:22.113 [2024-11-20 01:31:30.002300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.113 [2024-11-20 01:31:30.002446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.113 [2024-11-20 01:31:30.002489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.113 qpair failed and we were unable to recover it. 00:30:22.113 [2024-11-20 01:31:30.002605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.113 [2024-11-20 01:31:30.002738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.113 [2024-11-20 01:31:30.002764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.113 qpair failed and we were unable to recover it. 00:30:22.113 [2024-11-20 01:31:30.002925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.113 [2024-11-20 01:31:30.003024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.113 [2024-11-20 01:31:30.003052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.113 qpair failed and we were unable to recover it. 00:30:22.113 [2024-11-20 01:31:30.003170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.113 [2024-11-20 01:31:30.003280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.113 [2024-11-20 01:31:30.003306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.113 qpair failed and we were unable to recover it. 00:30:22.113 [2024-11-20 01:31:30.003421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.113 [2024-11-20 01:31:30.003534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.113 [2024-11-20 01:31:30.003562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.113 qpair failed and we were unable to recover it. 00:30:22.113 [2024-11-20 01:31:30.003667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.113 [2024-11-20 01:31:30.003776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.113 [2024-11-20 01:31:30.003814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.113 qpair failed and we were unable to recover it. 00:30:22.113 [2024-11-20 01:31:30.003980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.113 [2024-11-20 01:31:30.004113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.113 [2024-11-20 01:31:30.004156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.113 qpair failed and we were unable to recover it. 00:30:22.113 [2024-11-20 01:31:30.004322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.113 [2024-11-20 01:31:30.004446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.113 [2024-11-20 01:31:30.004505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.113 qpair failed and we were unable to recover it. 00:30:22.113 [2024-11-20 01:31:30.004636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.113 [2024-11-20 01:31:30.004783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.113 [2024-11-20 01:31:30.004820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.113 qpair failed and we were unable to recover it. 00:30:22.113 [2024-11-20 01:31:30.004996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.113 [2024-11-20 01:31:30.005114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.113 [2024-11-20 01:31:30.005161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.113 qpair failed and we were unable to recover it. 00:30:22.113 [2024-11-20 01:31:30.005315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.113 [2024-11-20 01:31:30.005445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.113 [2024-11-20 01:31:30.005502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.113 qpair failed and we were unable to recover it. 00:30:22.113 [2024-11-20 01:31:30.005635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.113 [2024-11-20 01:31:30.005768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.113 [2024-11-20 01:31:30.005818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.113 qpair failed and we were unable to recover it. 00:30:22.113 [2024-11-20 01:31:30.005976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.113 [2024-11-20 01:31:30.006162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.113 [2024-11-20 01:31:30.006205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.113 qpair failed and we were unable to recover it. 00:30:22.113 [2024-11-20 01:31:30.006368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.113 [2024-11-20 01:31:30.006536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.113 [2024-11-20 01:31:30.006571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.113 qpair failed and we were unable to recover it. 00:30:22.113 [2024-11-20 01:31:30.006721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.113 [2024-11-20 01:31:30.006814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.113 [2024-11-20 01:31:30.006856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.113 qpair failed and we were unable to recover it. 00:30:22.113 [2024-11-20 01:31:30.007081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.113 [2024-11-20 01:31:30.007205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.113 [2024-11-20 01:31:30.007234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.113 qpair failed and we were unable to recover it. 00:30:22.113 [2024-11-20 01:31:30.007338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.113 [2024-11-20 01:31:30.007437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.113 [2024-11-20 01:31:30.007465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.113 qpair failed and we were unable to recover it. 00:30:22.113 [2024-11-20 01:31:30.007596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.113 [2024-11-20 01:31:30.007716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.113 [2024-11-20 01:31:30.007742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.113 qpair failed and we were unable to recover it. 00:30:22.113 [2024-11-20 01:31:30.007861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.113 [2024-11-20 01:31:30.007946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.114 [2024-11-20 01:31:30.007971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.114 qpair failed and we were unable to recover it. 00:30:22.114 [2024-11-20 01:31:30.008090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.114 [2024-11-20 01:31:30.008184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.114 [2024-11-20 01:31:30.008211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.114 qpair failed and we were unable to recover it. 00:30:22.114 [2024-11-20 01:31:30.008332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.114 [2024-11-20 01:31:30.008419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.114 [2024-11-20 01:31:30.008444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.114 qpair failed and we were unable to recover it. 00:30:22.114 [2024-11-20 01:31:30.008564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.114 [2024-11-20 01:31:30.008654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.114 [2024-11-20 01:31:30.008680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.114 qpair failed and we were unable to recover it. 00:30:22.114 [2024-11-20 01:31:30.008826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.114 [2024-11-20 01:31:30.008982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.114 [2024-11-20 01:31:30.009007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.114 qpair failed and we were unable to recover it. 00:30:22.114 [2024-11-20 01:31:30.009142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.114 [2024-11-20 01:31:30.009229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.114 [2024-11-20 01:31:30.009255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.114 qpair failed and we were unable to recover it. 00:30:22.114 [2024-11-20 01:31:30.009354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.114 [2024-11-20 01:31:30.009496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.114 [2024-11-20 01:31:30.009521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.114 qpair failed and we were unable to recover it. 00:30:22.114 [2024-11-20 01:31:30.009637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.114 [2024-11-20 01:31:30.009738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.114 [2024-11-20 01:31:30.009762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.114 qpair failed and we were unable to recover it. 00:30:22.114 [2024-11-20 01:31:30.009844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.114 [2024-11-20 01:31:30.009929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.114 [2024-11-20 01:31:30.009955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.114 qpair failed and we were unable to recover it. 00:30:22.114 [2024-11-20 01:31:30.010049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.114 [2024-11-20 01:31:30.010136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.114 [2024-11-20 01:31:30.010161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.114 qpair failed and we were unable to recover it. 00:30:22.114 [2024-11-20 01:31:30.010275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.114 [2024-11-20 01:31:30.010401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.114 [2024-11-20 01:31:30.010426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.114 qpair failed and we were unable to recover it. 00:30:22.114 [2024-11-20 01:31:30.010542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.114 [2024-11-20 01:31:30.010662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.114 [2024-11-20 01:31:30.010688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.114 qpair failed and we were unable to recover it. 00:30:22.114 [2024-11-20 01:31:30.010811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.114 [2024-11-20 01:31:30.010927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.114 [2024-11-20 01:31:30.010952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.114 qpair failed and we were unable to recover it. 00:30:22.114 [2024-11-20 01:31:30.011031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.114 [2024-11-20 01:31:30.011130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.114 [2024-11-20 01:31:30.011156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.114 qpair failed and we were unable to recover it. 00:30:22.114 [2024-11-20 01:31:30.011270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.114 [2024-11-20 01:31:30.011360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.114 [2024-11-20 01:31:30.011385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.114 qpair failed and we were unable to recover it. 00:30:22.114 [2024-11-20 01:31:30.011467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.114 [2024-11-20 01:31:30.011576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.114 [2024-11-20 01:31:30.011600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.114 qpair failed and we were unable to recover it. 00:30:22.114 [2024-11-20 01:31:30.011697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.114 [2024-11-20 01:31:30.011797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.114 [2024-11-20 01:31:30.011823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.114 qpair failed and we were unable to recover it. 00:30:22.114 [2024-11-20 01:31:30.011915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.114 [2024-11-20 01:31:30.012034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.114 [2024-11-20 01:31:30.012060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.114 qpair failed and we were unable to recover it. 00:30:22.114 [2024-11-20 01:31:30.012160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.114 [2024-11-20 01:31:30.012245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.114 [2024-11-20 01:31:30.012271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.114 qpair failed and we were unable to recover it. 00:30:22.114 [2024-11-20 01:31:30.012367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.114 [2024-11-20 01:31:30.012485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.114 [2024-11-20 01:31:30.012510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.114 qpair failed and we were unable to recover it. 00:30:22.114 [2024-11-20 01:31:30.012598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.114 [2024-11-20 01:31:30.012713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.114 [2024-11-20 01:31:30.012737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.114 qpair failed and we were unable to recover it. 00:30:22.114 [2024-11-20 01:31:30.012835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.114 [2024-11-20 01:31:30.012926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.114 [2024-11-20 01:31:30.012951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.114 qpair failed and we were unable to recover it. 00:30:22.114 [2024-11-20 01:31:30.013080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.114 [2024-11-20 01:31:30.013164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.114 [2024-11-20 01:31:30.013190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.114 qpair failed and we were unable to recover it. 00:30:22.114 [2024-11-20 01:31:30.013277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.114 [2024-11-20 01:31:30.013432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.114 [2024-11-20 01:31:30.013457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.114 qpair failed and we were unable to recover it. 00:30:22.114 [2024-11-20 01:31:30.013579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.114 [2024-11-20 01:31:30.013694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.115 [2024-11-20 01:31:30.013720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.115 qpair failed and we were unable to recover it. 00:30:22.115 [2024-11-20 01:31:30.013867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.115 [2024-11-20 01:31:30.014005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.115 [2024-11-20 01:31:30.014031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.115 qpair failed and we were unable to recover it. 00:30:22.115 [2024-11-20 01:31:30.014157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.115 [2024-11-20 01:31:30.014246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.115 [2024-11-20 01:31:30.014271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.115 qpair failed and we were unable to recover it. 00:30:22.115 [2024-11-20 01:31:30.014360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.115 [2024-11-20 01:31:30.014474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.115 [2024-11-20 01:31:30.014499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.115 qpair failed and we were unable to recover it. 00:30:22.115 [2024-11-20 01:31:30.014616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.115 [2024-11-20 01:31:30.014725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.115 [2024-11-20 01:31:30.014751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.115 qpair failed and we were unable to recover it. 00:30:22.115 [2024-11-20 01:31:30.014872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.115 [2024-11-20 01:31:30.014962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.115 [2024-11-20 01:31:30.014987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.115 qpair failed and we were unable to recover it. 00:30:22.115 [2024-11-20 01:31:30.015102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.115 [2024-11-20 01:31:30.015220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.115 [2024-11-20 01:31:30.015246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.115 qpair failed and we were unable to recover it. 00:30:22.115 [2024-11-20 01:31:30.015340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.115 [2024-11-20 01:31:30.015441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.115 [2024-11-20 01:31:30.015465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.115 qpair failed and we were unable to recover it. 00:30:22.115 [2024-11-20 01:31:30.015554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.115 [2024-11-20 01:31:30.015643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.115 [2024-11-20 01:31:30.015669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.115 qpair failed and we were unable to recover it. 00:30:22.115 [2024-11-20 01:31:30.015817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.115 [2024-11-20 01:31:30.015937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.115 [2024-11-20 01:31:30.015962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.115 qpair failed and we were unable to recover it. 00:30:22.115 [2024-11-20 01:31:30.016104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.115 [2024-11-20 01:31:30.016227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.115 [2024-11-20 01:31:30.016252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.115 qpair failed and we were unable to recover it. 00:30:22.115 [2024-11-20 01:31:30.016349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.115 [2024-11-20 01:31:30.016458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.115 [2024-11-20 01:31:30.016483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.115 qpair failed and we were unable to recover it. 00:30:22.115 [2024-11-20 01:31:30.016602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.115 [2024-11-20 01:31:30.016719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.115 [2024-11-20 01:31:30.016745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.115 qpair failed and we were unable to recover it. 00:30:22.115 [2024-11-20 01:31:30.016890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.115 [2024-11-20 01:31:30.017004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.115 [2024-11-20 01:31:30.017034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.115 qpair failed and we were unable to recover it. 00:30:22.115 [2024-11-20 01:31:30.017156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.115 [2024-11-20 01:31:30.017273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.115 [2024-11-20 01:31:30.017298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.115 qpair failed and we were unable to recover it. 00:30:22.115 [2024-11-20 01:31:30.017415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.115 [2024-11-20 01:31:30.017530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.115 [2024-11-20 01:31:30.017556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.115 qpair failed and we were unable to recover it. 00:30:22.115 [2024-11-20 01:31:30.017678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.115 [2024-11-20 01:31:30.017797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.115 [2024-11-20 01:31:30.017822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.115 qpair failed and we were unable to recover it. 00:30:22.115 [2024-11-20 01:31:30.017943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.115 [2024-11-20 01:31:30.018031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.115 [2024-11-20 01:31:30.018056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.115 qpair failed and we were unable to recover it. 00:30:22.115 [2024-11-20 01:31:30.018198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.115 [2024-11-20 01:31:30.018315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.115 [2024-11-20 01:31:30.018344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.115 qpair failed and we were unable to recover it. 00:30:22.115 [2024-11-20 01:31:30.018481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.115 [2024-11-20 01:31:30.018597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.115 [2024-11-20 01:31:30.018624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.115 qpair failed and we were unable to recover it. 00:30:22.115 [2024-11-20 01:31:30.018735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.115 [2024-11-20 01:31:30.018819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.115 [2024-11-20 01:31:30.018844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.115 qpair failed and we were unable to recover it. 00:30:22.115 [2024-11-20 01:31:30.018985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.115 [2024-11-20 01:31:30.019101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.115 [2024-11-20 01:31:30.019127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.115 qpair failed and we were unable to recover it. 00:30:22.115 [2024-11-20 01:31:30.019224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.115 [2024-11-20 01:31:30.019341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.115 [2024-11-20 01:31:30.019367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.115 qpair failed and we were unable to recover it. 00:30:22.115 [2024-11-20 01:31:30.019459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.115 [2024-11-20 01:31:30.019579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.115 [2024-11-20 01:31:30.019610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.115 qpair failed and we were unable to recover it. 00:30:22.115 [2024-11-20 01:31:30.019696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.115 [2024-11-20 01:31:30.019808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.115 [2024-11-20 01:31:30.019834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.115 qpair failed and we were unable to recover it. 00:30:22.115 [2024-11-20 01:31:30.019912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.115 [2024-11-20 01:31:30.019996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.115 [2024-11-20 01:31:30.020022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.115 qpair failed and we were unable to recover it. 00:30:22.115 [2024-11-20 01:31:30.020114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.115 [2024-11-20 01:31:30.020229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.115 [2024-11-20 01:31:30.020254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.115 qpair failed and we were unable to recover it. 00:30:22.115 [2024-11-20 01:31:30.020375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.115 [2024-11-20 01:31:30.020492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.115 [2024-11-20 01:31:30.020518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.115 qpair failed and we were unable to recover it. 00:30:22.115 [2024-11-20 01:31:30.020626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.115 [2024-11-20 01:31:30.020770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.115 [2024-11-20 01:31:30.020794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.116 qpair failed and we were unable to recover it. 00:30:22.116 [2024-11-20 01:31:30.020915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.116 [2024-11-20 01:31:30.021056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.116 [2024-11-20 01:31:30.021089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.116 qpair failed and we were unable to recover it. 00:30:22.116 [2024-11-20 01:31:30.021206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.116 [2024-11-20 01:31:30.021326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.116 [2024-11-20 01:31:30.021351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.116 qpair failed and we were unable to recover it. 00:30:22.116 [2024-11-20 01:31:30.021446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.116 [2024-11-20 01:31:30.021563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.116 [2024-11-20 01:31:30.021588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.116 qpair failed and we were unable to recover it. 00:30:22.116 [2024-11-20 01:31:30.021707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.116 [2024-11-20 01:31:30.021801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.116 [2024-11-20 01:31:30.021825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.116 qpair failed and we were unable to recover it. 00:30:22.116 [2024-11-20 01:31:30.021940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.116 [2024-11-20 01:31:30.022032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.116 [2024-11-20 01:31:30.022061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.116 qpair failed and we were unable to recover it. 00:30:22.116 [2024-11-20 01:31:30.022164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.116 [2024-11-20 01:31:30.022263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.116 [2024-11-20 01:31:30.022288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.116 qpair failed and we were unable to recover it. 00:30:22.116 [2024-11-20 01:31:30.022406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.116 [2024-11-20 01:31:30.022523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.116 [2024-11-20 01:31:30.022549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.116 qpair failed and we were unable to recover it. 00:30:22.116 [2024-11-20 01:31:30.022666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.116 [2024-11-20 01:31:30.022779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.116 [2024-11-20 01:31:30.022805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.116 qpair failed and we were unable to recover it. 00:30:22.116 [2024-11-20 01:31:30.022882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.116 [2024-11-20 01:31:30.023010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.116 [2024-11-20 01:31:30.023036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.116 qpair failed and we were unable to recover it. 00:30:22.116 [2024-11-20 01:31:30.023168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.116 [2024-11-20 01:31:30.023277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.116 [2024-11-20 01:31:30.023303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.116 qpair failed and we were unable to recover it. 00:30:22.116 [2024-11-20 01:31:30.023417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.116 [2024-11-20 01:31:30.023533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.116 [2024-11-20 01:31:30.023559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.116 qpair failed and we were unable to recover it. 00:30:22.116 [2024-11-20 01:31:30.023691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.116 [2024-11-20 01:31:30.023805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.116 [2024-11-20 01:31:30.023829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.116 qpair failed and we were unable to recover it. 00:30:22.116 [2024-11-20 01:31:30.023915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.116 [2024-11-20 01:31:30.024027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.116 [2024-11-20 01:31:30.024051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.116 qpair failed and we were unable to recover it. 00:30:22.116 [2024-11-20 01:31:30.024184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.116 [2024-11-20 01:31:30.024304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.116 [2024-11-20 01:31:30.024328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.116 qpair failed and we were unable to recover it. 00:30:22.116 [2024-11-20 01:31:30.024448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.116 [2024-11-20 01:31:30.024531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.116 [2024-11-20 01:31:30.024560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.116 qpair failed and we were unable to recover it. 00:30:22.116 [2024-11-20 01:31:30.024679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.116 [2024-11-20 01:31:30.024795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.116 [2024-11-20 01:31:30.024820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.116 qpair failed and we were unable to recover it. 00:30:22.116 [2024-11-20 01:31:30.024927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.116 [2024-11-20 01:31:30.025033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.116 [2024-11-20 01:31:30.025057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.116 qpair failed and we were unable to recover it. 00:30:22.116 [2024-11-20 01:31:30.025218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.116 [2024-11-20 01:31:30.025333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.116 [2024-11-20 01:31:30.025358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.116 qpair failed and we were unable to recover it. 00:30:22.116 [2024-11-20 01:31:30.025481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.116 [2024-11-20 01:31:30.025564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.116 [2024-11-20 01:31:30.025588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.116 qpair failed and we were unable to recover it. 00:30:22.116 [2024-11-20 01:31:30.025701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.116 [2024-11-20 01:31:30.025818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.116 [2024-11-20 01:31:30.025843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.116 qpair failed and we were unable to recover it. 00:30:22.116 [2024-11-20 01:31:30.025931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.116 [2024-11-20 01:31:30.026052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.116 [2024-11-20 01:31:30.026087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.116 qpair failed and we were unable to recover it. 00:30:22.116 [2024-11-20 01:31:30.026181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.116 [2024-11-20 01:31:30.026322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.116 [2024-11-20 01:31:30.026346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.116 qpair failed and we were unable to recover it. 00:30:22.116 [2024-11-20 01:31:30.026436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.116 [2024-11-20 01:31:30.026554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.116 [2024-11-20 01:31:30.026580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.116 qpair failed and we were unable to recover it. 00:30:22.116 [2024-11-20 01:31:30.026698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.116 [2024-11-20 01:31:30.026815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.116 [2024-11-20 01:31:30.026839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.116 qpair failed and we were unable to recover it. 00:30:22.116 [2024-11-20 01:31:30.026932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.116 [2024-11-20 01:31:30.027025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.116 [2024-11-20 01:31:30.027049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.116 qpair failed and we were unable to recover it. 00:30:22.116 [2024-11-20 01:31:30.027217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.116 [2024-11-20 01:31:30.027307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.116 [2024-11-20 01:31:30.027332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.116 qpair failed and we were unable to recover it. 00:30:22.116 [2024-11-20 01:31:30.027478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.116 [2024-11-20 01:31:30.027621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.116 [2024-11-20 01:31:30.027645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.116 qpair failed and we were unable to recover it. 00:30:22.116 [2024-11-20 01:31:30.027742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.116 [2024-11-20 01:31:30.027829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.116 [2024-11-20 01:31:30.027856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.116 qpair failed and we were unable to recover it. 00:30:22.116 [2024-11-20 01:31:30.027977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-20 01:31:30.028061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-20 01:31:30.028095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.117 qpair failed and we were unable to recover it. 00:30:22.117 [2024-11-20 01:31:30.028238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-20 01:31:30.028366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-20 01:31:30.028408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.117 qpair failed and we were unable to recover it. 00:30:22.117 [2024-11-20 01:31:30.028496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-20 01:31:30.028603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-20 01:31:30.028628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.117 qpair failed and we were unable to recover it. 00:30:22.117 [2024-11-20 01:31:30.028749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-20 01:31:30.028864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-20 01:31:30.028888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.117 qpair failed and we were unable to recover it. 00:30:22.117 [2024-11-20 01:31:30.029003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-20 01:31:30.029120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-20 01:31:30.029146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.117 qpair failed and we were unable to recover it. 00:30:22.117 [2024-11-20 01:31:30.029265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-20 01:31:30.029358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-20 01:31:30.029383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.117 qpair failed and we were unable to recover it. 00:30:22.117 [2024-11-20 01:31:30.029467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-20 01:31:30.029583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-20 01:31:30.029608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.117 qpair failed and we were unable to recover it. 00:30:22.117 [2024-11-20 01:31:30.029726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-20 01:31:30.029845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-20 01:31:30.029871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.117 qpair failed and we were unable to recover it. 00:30:22.117 [2024-11-20 01:31:30.030016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-20 01:31:30.030144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-20 01:31:30.030188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.117 qpair failed and we were unable to recover it. 00:30:22.117 [2024-11-20 01:31:30.030328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-20 01:31:30.030519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-20 01:31:30.030561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.117 qpair failed and we were unable to recover it. 00:30:22.117 [2024-11-20 01:31:30.030652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-20 01:31:30.030738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-20 01:31:30.030763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.117 qpair failed and we were unable to recover it. 00:30:22.117 [2024-11-20 01:31:30.030911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-20 01:31:30.031002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-20 01:31:30.031027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.117 qpair failed and we were unable to recover it. 00:30:22.117 [2024-11-20 01:31:30.031146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-20 01:31:30.031261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-20 01:31:30.031286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.117 qpair failed and we were unable to recover it. 00:30:22.117 [2024-11-20 01:31:30.031369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-20 01:31:30.031480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-20 01:31:30.031504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.117 qpair failed and we were unable to recover it. 00:30:22.117 [2024-11-20 01:31:30.031615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-20 01:31:30.031707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-20 01:31:30.031733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.117 qpair failed and we were unable to recover it. 00:30:22.117 [2024-11-20 01:31:30.031847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-20 01:31:30.031959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-20 01:31:30.031983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.117 qpair failed and we were unable to recover it. 00:30:22.117 [2024-11-20 01:31:30.032101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-20 01:31:30.032210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-20 01:31:30.032234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.117 qpair failed and we were unable to recover it. 00:30:22.117 [2024-11-20 01:31:30.032328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-20 01:31:30.032449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-20 01:31:30.032474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.117 qpair failed and we were unable to recover it. 00:30:22.117 [2024-11-20 01:31:30.032623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-20 01:31:30.032735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-20 01:31:30.032760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.117 qpair failed and we were unable to recover it. 00:30:22.117 [2024-11-20 01:31:30.032880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-20 01:31:30.032966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-20 01:31:30.032991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.117 qpair failed and we were unable to recover it. 00:30:22.117 [2024-11-20 01:31:30.033102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-20 01:31:30.033245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-20 01:31:30.033269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.117 qpair failed and we were unable to recover it. 00:30:22.117 [2024-11-20 01:31:30.033388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-20 01:31:30.033528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-20 01:31:30.033552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.117 qpair failed and we were unable to recover it. 00:30:22.117 [2024-11-20 01:31:30.033642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-20 01:31:30.033762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-20 01:31:30.033787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.117 qpair failed and we were unable to recover it. 00:30:22.117 [2024-11-20 01:31:30.033931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-20 01:31:30.034093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-20 01:31:30.034120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.117 qpair failed and we were unable to recover it. 00:30:22.117 [2024-11-20 01:31:30.034256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-20 01:31:30.034416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-20 01:31:30.034460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.117 qpair failed and we were unable to recover it. 00:30:22.117 [2024-11-20 01:31:30.034575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-20 01:31:30.034660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-20 01:31:30.034686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.117 qpair failed and we were unable to recover it. 00:30:22.117 [2024-11-20 01:31:30.034839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-20 01:31:30.034955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-20 01:31:30.034981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.117 qpair failed and we were unable to recover it. 00:30:22.117 [2024-11-20 01:31:30.035083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-20 01:31:30.035250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-20 01:31:30.035293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.117 qpair failed and we were unable to recover it. 00:30:22.117 [2024-11-20 01:31:30.035442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-20 01:31:30.035549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-20 01:31:30.035573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.117 qpair failed and we were unable to recover it. 00:30:22.118 [2024-11-20 01:31:30.035686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-20 01:31:30.035796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-20 01:31:30.035821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.118 qpair failed and we were unable to recover it. 00:30:22.118 [2024-11-20 01:31:30.035941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-20 01:31:30.036045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-20 01:31:30.036076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.118 qpair failed and we were unable to recover it. 00:30:22.118 [2024-11-20 01:31:30.036163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-20 01:31:30.036248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-20 01:31:30.036273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.118 qpair failed and we were unable to recover it. 00:30:22.118 [2024-11-20 01:31:30.036397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-20 01:31:30.036510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-20 01:31:30.036535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.118 qpair failed and we were unable to recover it. 00:30:22.118 [2024-11-20 01:31:30.036647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-20 01:31:30.036735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-20 01:31:30.036762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.118 qpair failed and we were unable to recover it. 00:30:22.118 [2024-11-20 01:31:30.036875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-20 01:31:30.036995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-20 01:31:30.037019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.118 qpair failed and we were unable to recover it. 00:30:22.118 [2024-11-20 01:31:30.037111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-20 01:31:30.037281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-20 01:31:30.037324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.118 qpair failed and we were unable to recover it. 00:30:22.118 [2024-11-20 01:31:30.037414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-20 01:31:30.037535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-20 01:31:30.037560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.118 qpair failed and we were unable to recover it. 00:30:22.118 [2024-11-20 01:31:30.037680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-20 01:31:30.037794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-20 01:31:30.037819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.118 qpair failed and we were unable to recover it. 00:30:22.118 [2024-11-20 01:31:30.037921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-20 01:31:30.038065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-20 01:31:30.038099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.118 qpair failed and we were unable to recover it. 00:30:22.118 [2024-11-20 01:31:30.038268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-20 01:31:30.038407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-20 01:31:30.038432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.118 qpair failed and we were unable to recover it. 00:30:22.118 [2024-11-20 01:31:30.038539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-20 01:31:30.038632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-20 01:31:30.038657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.118 qpair failed and we were unable to recover it. 00:30:22.118 [2024-11-20 01:31:30.038752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-20 01:31:30.038838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-20 01:31:30.038863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.118 qpair failed and we were unable to recover it. 00:30:22.118 [2024-11-20 01:31:30.038978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-20 01:31:30.039096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-20 01:31:30.039121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.118 qpair failed and we were unable to recover it. 00:30:22.118 [2024-11-20 01:31:30.039269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-20 01:31:30.039383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-20 01:31:30.039408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.118 qpair failed and we were unable to recover it. 00:30:22.118 [2024-11-20 01:31:30.039526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-20 01:31:30.039643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-20 01:31:30.039668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.118 qpair failed and we were unable to recover it. 00:30:22.118 [2024-11-20 01:31:30.039812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-20 01:31:30.039924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-20 01:31:30.039949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.118 qpair failed and we were unable to recover it. 00:30:22.118 [2024-11-20 01:31:30.040088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-20 01:31:30.040171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-20 01:31:30.040195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.118 qpair failed and we were unable to recover it. 00:30:22.118 [2024-11-20 01:31:30.040292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-20 01:31:30.040379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-20 01:31:30.040405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.118 qpair failed and we were unable to recover it. 00:30:22.118 [2024-11-20 01:31:30.040551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-20 01:31:30.040672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-20 01:31:30.040697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.118 qpair failed and we were unable to recover it. 00:30:22.118 [2024-11-20 01:31:30.040815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-20 01:31:30.040910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-20 01:31:30.040934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.118 qpair failed and we were unable to recover it. 00:30:22.118 [2024-11-20 01:31:30.041049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-20 01:31:30.041173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-20 01:31:30.041199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.118 qpair failed and we were unable to recover it. 00:30:22.118 [2024-11-20 01:31:30.041325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-20 01:31:30.041412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-20 01:31:30.041436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.118 qpair failed and we were unable to recover it. 00:30:22.118 [2024-11-20 01:31:30.041557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-20 01:31:30.041640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-20 01:31:30.041664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.118 qpair failed and we were unable to recover it. 00:30:22.118 [2024-11-20 01:31:30.041751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-20 01:31:30.041859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-20 01:31:30.041884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.118 qpair failed and we were unable to recover it. 00:30:22.118 [2024-11-20 01:31:30.042004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-20 01:31:30.042119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-20 01:31:30.042145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.118 qpair failed and we were unable to recover it. 00:30:22.118 [2024-11-20 01:31:30.042296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-20 01:31:30.042415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-20 01:31:30.042440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.119 qpair failed and we were unable to recover it. 00:30:22.119 [2024-11-20 01:31:30.042558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-20 01:31:30.042637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-20 01:31:30.042661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.119 qpair failed and we were unable to recover it. 00:30:22.119 [2024-11-20 01:31:30.042778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-20 01:31:30.042898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-20 01:31:30.042925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.119 qpair failed and we were unable to recover it. 00:30:22.119 [2024-11-20 01:31:30.043044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-20 01:31:30.043176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-20 01:31:30.043202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.119 qpair failed and we were unable to recover it. 00:30:22.119 [2024-11-20 01:31:30.043300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-20 01:31:30.043417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-20 01:31:30.043443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.119 qpair failed and we were unable to recover it. 00:30:22.119 [2024-11-20 01:31:30.043535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-20 01:31:30.043621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-20 01:31:30.043647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.119 qpair failed and we were unable to recover it. 00:30:22.119 [2024-11-20 01:31:30.043739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-20 01:31:30.043829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-20 01:31:30.043853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.119 qpair failed and we were unable to recover it. 00:30:22.119 [2024-11-20 01:31:30.044007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-20 01:31:30.044156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-20 01:31:30.044182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.119 qpair failed and we were unable to recover it. 00:30:22.119 [2024-11-20 01:31:30.044332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-20 01:31:30.044415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-20 01:31:30.044440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.119 qpair failed and we were unable to recover it. 00:30:22.119 [2024-11-20 01:31:30.044521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-20 01:31:30.044661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-20 01:31:30.044685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.119 qpair failed and we were unable to recover it. 00:30:22.119 [2024-11-20 01:31:30.044827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-20 01:31:30.044945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-20 01:31:30.044970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.119 qpair failed and we were unable to recover it. 00:30:22.119 [2024-11-20 01:31:30.045082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-20 01:31:30.045221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-20 01:31:30.045246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.119 qpair failed and we were unable to recover it. 00:30:22.119 [2024-11-20 01:31:30.045393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-20 01:31:30.045478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-20 01:31:30.045503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.119 qpair failed and we were unable to recover it. 00:30:22.119 [2024-11-20 01:31:30.045595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-20 01:31:30.045682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-20 01:31:30.045707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.119 qpair failed and we were unable to recover it. 00:30:22.119 [2024-11-20 01:31:30.045788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-20 01:31:30.045901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-20 01:31:30.045925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.119 qpair failed and we were unable to recover it. 00:30:22.119 [2024-11-20 01:31:30.046016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-20 01:31:30.046141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-20 01:31:30.046167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.119 qpair failed and we were unable to recover it. 00:30:22.119 [2024-11-20 01:31:30.046266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-20 01:31:30.048031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-20 01:31:30.048114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.119 qpair failed and we were unable to recover it. 00:30:22.119 [2024-11-20 01:31:30.048232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-20 01:31:30.048327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-20 01:31:30.048352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.119 qpair failed and we were unable to recover it. 00:30:22.119 [2024-11-20 01:31:30.048472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-20 01:31:30.048591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-20 01:31:30.048615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.119 qpair failed and we were unable to recover it. 00:30:22.119 [2024-11-20 01:31:30.048763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-20 01:31:30.048877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-20 01:31:30.048901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.119 qpair failed and we were unable to recover it. 00:30:22.119 [2024-11-20 01:31:30.049019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-20 01:31:30.049164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-20 01:31:30.049192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.119 qpair failed and we were unable to recover it. 00:30:22.119 [2024-11-20 01:31:30.049328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-20 01:31:30.049489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-20 01:31:30.049532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.119 qpair failed and we were unable to recover it. 00:30:22.119 [2024-11-20 01:31:30.049652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-20 01:31:30.049751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-20 01:31:30.049776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.119 qpair failed and we were unable to recover it. 00:30:22.119 [2024-11-20 01:31:30.049889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-20 01:31:30.050007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-20 01:31:30.050033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.119 qpair failed and we were unable to recover it. 00:30:22.119 [2024-11-20 01:31:30.050236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.120 [2024-11-20 01:31:30.050364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.120 [2024-11-20 01:31:30.050407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.120 qpair failed and we were unable to recover it. 00:30:22.120 [2024-11-20 01:31:30.050549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.120 [2024-11-20 01:31:30.050668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.120 [2024-11-20 01:31:30.050692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.120 qpair failed and we were unable to recover it. 00:30:22.120 [2024-11-20 01:31:30.050770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.120 [2024-11-20 01:31:30.050862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.120 [2024-11-20 01:31:30.050886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.120 qpair failed and we were unable to recover it. 00:30:22.120 [2024-11-20 01:31:30.051006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.120 [2024-11-20 01:31:30.051122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.120 [2024-11-20 01:31:30.051149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.120 qpair failed and we were unable to recover it. 00:30:22.120 [2024-11-20 01:31:30.051272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.120 [2024-11-20 01:31:30.051371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.120 [2024-11-20 01:31:30.051396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.120 qpair failed and we were unable to recover it. 00:30:22.120 [2024-11-20 01:31:30.051515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.120 [2024-11-20 01:31:30.051607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.120 [2024-11-20 01:31:30.051635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.120 qpair failed and we were unable to recover it. 00:30:22.120 [2024-11-20 01:31:30.051724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.120 [2024-11-20 01:31:30.051842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.120 [2024-11-20 01:31:30.051866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.120 qpair failed and we were unable to recover it. 00:30:22.120 [2024-11-20 01:31:30.051961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.120 [2024-11-20 01:31:30.052049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.120 [2024-11-20 01:31:30.052080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.120 qpair failed and we were unable to recover it. 00:30:22.120 [2024-11-20 01:31:30.052172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.120 [2024-11-20 01:31:30.052292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.120 [2024-11-20 01:31:30.052317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.120 qpair failed and we were unable to recover it. 00:30:22.120 [2024-11-20 01:31:30.052434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.120 [2024-11-20 01:31:30.052528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.120 [2024-11-20 01:31:30.052554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.120 qpair failed and we were unable to recover it. 00:30:22.120 [2024-11-20 01:31:30.052649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.120 [2024-11-20 01:31:30.052791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.120 [2024-11-20 01:31:30.052815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.120 qpair failed and we were unable to recover it. 00:30:22.120 [2024-11-20 01:31:30.052934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.120 [2024-11-20 01:31:30.053082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.120 [2024-11-20 01:31:30.053108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.120 qpair failed and we were unable to recover it. 00:30:22.120 [2024-11-20 01:31:30.053227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.120 [2024-11-20 01:31:30.053382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.120 [2024-11-20 01:31:30.053409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.120 qpair failed and we were unable to recover it. 00:30:22.120 [2024-11-20 01:31:30.053517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.120 [2024-11-20 01:31:30.053609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.120 [2024-11-20 01:31:30.053633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.120 qpair failed and we were unable to recover it. 00:30:22.120 [2024-11-20 01:31:30.053782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.120 [2024-11-20 01:31:30.053895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.120 [2024-11-20 01:31:30.053919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.120 qpair failed and we were unable to recover it. 00:30:22.120 [2024-11-20 01:31:30.054031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.120 [2024-11-20 01:31:30.054155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.120 [2024-11-20 01:31:30.054180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.120 qpair failed and we were unable to recover it. 00:30:22.120 [2024-11-20 01:31:30.054278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.120 [2024-11-20 01:31:30.054388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.120 [2024-11-20 01:31:30.054412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.120 qpair failed and we were unable to recover it. 00:30:22.120 [2024-11-20 01:31:30.054530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.120 [2024-11-20 01:31:30.054612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.120 [2024-11-20 01:31:30.054636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.120 qpair failed and we were unable to recover it. 00:30:22.120 [2024-11-20 01:31:30.054748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.120 [2024-11-20 01:31:30.054865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.120 [2024-11-20 01:31:30.054890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.120 qpair failed and we were unable to recover it. 00:30:22.120 [2024-11-20 01:31:30.054983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.120 [2024-11-20 01:31:30.055104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.120 [2024-11-20 01:31:30.055130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.120 qpair failed and we were unable to recover it. 00:30:22.120 [2024-11-20 01:31:30.055222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.120 [2024-11-20 01:31:30.055334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.120 [2024-11-20 01:31:30.055358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.120 qpair failed and we were unable to recover it. 00:30:22.120 [2024-11-20 01:31:30.055450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.120 [2024-11-20 01:31:30.055534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.120 [2024-11-20 01:31:30.055558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.120 qpair failed and we were unable to recover it. 00:30:22.120 [2024-11-20 01:31:30.055669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.120 [2024-11-20 01:31:30.055759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.120 [2024-11-20 01:31:30.055785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.120 qpair failed and we were unable to recover it. 00:30:22.120 [2024-11-20 01:31:30.055908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.120 [2024-11-20 01:31:30.056025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.120 [2024-11-20 01:31:30.056050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.120 qpair failed and we were unable to recover it. 00:30:22.120 [2024-11-20 01:31:30.056179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.120 [2024-11-20 01:31:30.056287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.120 [2024-11-20 01:31:30.056312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.120 qpair failed and we were unable to recover it. 00:30:22.120 [2024-11-20 01:31:30.056444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.120 [2024-11-20 01:31:30.056575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.120 [2024-11-20 01:31:30.056600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.120 qpair failed and we were unable to recover it. 00:30:22.120 [2024-11-20 01:31:30.056685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.120 [2024-11-20 01:31:30.056800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.120 [2024-11-20 01:31:30.056825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.120 qpair failed and we were unable to recover it. 00:30:22.120 [2024-11-20 01:31:30.056918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.120 [2024-11-20 01:31:30.057015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.120 [2024-11-20 01:31:30.057042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.120 qpair failed and we were unable to recover it. 00:30:22.120 [2024-11-20 01:31:30.057183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.120 [2024-11-20 01:31:30.057370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.121 [2024-11-20 01:31:30.057413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.121 qpair failed and we were unable to recover it. 00:30:22.121 [2024-11-20 01:31:30.057500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.121 [2024-11-20 01:31:30.057627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.121 [2024-11-20 01:31:30.057651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.121 qpair failed and we were unable to recover it. 00:30:22.121 [2024-11-20 01:31:30.057763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.121 [2024-11-20 01:31:30.057873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.121 [2024-11-20 01:31:30.057897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.121 qpair failed and we were unable to recover it. 00:30:22.121 [2024-11-20 01:31:30.057988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.121 [2024-11-20 01:31:30.058104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.121 [2024-11-20 01:31:30.058132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.121 qpair failed and we were unable to recover it. 00:30:22.121 [2024-11-20 01:31:30.058220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.121 [2024-11-20 01:31:30.058305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.121 [2024-11-20 01:31:30.058332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.121 qpair failed and we were unable to recover it. 00:30:22.121 [2024-11-20 01:31:30.058448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.121 [2024-11-20 01:31:30.058565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.121 [2024-11-20 01:31:30.058591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.121 qpair failed and we were unable to recover it. 00:30:22.121 [2024-11-20 01:31:30.058708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.121 [2024-11-20 01:31:30.058822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.121 [2024-11-20 01:31:30.058848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.121 qpair failed and we were unable to recover it. 00:30:22.121 [2024-11-20 01:31:30.058960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.121 [2024-11-20 01:31:30.059082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.121 [2024-11-20 01:31:30.059108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.121 qpair failed and we were unable to recover it. 00:30:22.121 [2024-11-20 01:31:30.059254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.121 [2024-11-20 01:31:30.059338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.121 [2024-11-20 01:31:30.059363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.121 qpair failed and we were unable to recover it. 00:30:22.121 [2024-11-20 01:31:30.059484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.121 [2024-11-20 01:31:30.059574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.121 [2024-11-20 01:31:30.059599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.121 qpair failed and we were unable to recover it. 00:30:22.121 [2024-11-20 01:31:30.059742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.121 [2024-11-20 01:31:30.059887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.121 [2024-11-20 01:31:30.059917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.121 qpair failed and we were unable to recover it. 00:30:22.121 [2024-11-20 01:31:30.060014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.121 [2024-11-20 01:31:30.060109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.121 [2024-11-20 01:31:30.060135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.121 qpair failed and we were unable to recover it. 00:30:22.121 [2024-11-20 01:31:30.060226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.121 [2024-11-20 01:31:30.060345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.121 [2024-11-20 01:31:30.060370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.121 qpair failed and we were unable to recover it. 00:30:22.121 [2024-11-20 01:31:30.060516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.121 [2024-11-20 01:31:30.060597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.121 [2024-11-20 01:31:30.060622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.121 qpair failed and we were unable to recover it. 00:30:22.121 [2024-11-20 01:31:30.060731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.121 [2024-11-20 01:31:30.060848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.121 [2024-11-20 01:31:30.060873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.121 qpair failed and we were unable to recover it. 00:30:22.121 [2024-11-20 01:31:30.060986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.121 [2024-11-20 01:31:30.061101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.121 [2024-11-20 01:31:30.061126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.121 qpair failed and we were unable to recover it. 00:30:22.121 [2024-11-20 01:31:30.061245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.121 [2024-11-20 01:31:30.061371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.121 [2024-11-20 01:31:30.061395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.121 qpair failed and we were unable to recover it. 00:30:22.121 [2024-11-20 01:31:30.061511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.121 [2024-11-20 01:31:30.061593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.121 [2024-11-20 01:31:30.061617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.121 qpair failed and we were unable to recover it. 00:30:22.121 [2024-11-20 01:31:30.061740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.121 [2024-11-20 01:31:30.061879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.121 [2024-11-20 01:31:30.061903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.121 qpair failed and we were unable to recover it. 00:30:22.121 [2024-11-20 01:31:30.062047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.121 [2024-11-20 01:31:30.062185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.121 [2024-11-20 01:31:30.062211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.121 qpair failed and we were unable to recover it. 00:30:22.121 [2024-11-20 01:31:30.062299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.121 [2024-11-20 01:31:30.062420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.121 [2024-11-20 01:31:30.062449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.121 qpair failed and we were unable to recover it. 00:30:22.121 [2024-11-20 01:31:30.062592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.121 [2024-11-20 01:31:30.062715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.121 [2024-11-20 01:31:30.062740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.121 qpair failed and we were unable to recover it. 00:30:22.121 [2024-11-20 01:31:30.062860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.121 [2024-11-20 01:31:30.062980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.121 [2024-11-20 01:31:30.063004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.121 qpair failed and we were unable to recover it. 00:30:22.121 [2024-11-20 01:31:30.063099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.121 [2024-11-20 01:31:30.063207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.121 [2024-11-20 01:31:30.063236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.121 qpair failed and we were unable to recover it. 00:30:22.121 [2024-11-20 01:31:30.063343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.121 [2024-11-20 01:31:30.063511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.121 [2024-11-20 01:31:30.063554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.121 qpair failed and we were unable to recover it. 00:30:22.121 [2024-11-20 01:31:30.063672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.121 [2024-11-20 01:31:30.063760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.121 [2024-11-20 01:31:30.063785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.121 qpair failed and we were unable to recover it. 00:30:22.121 [2024-11-20 01:31:30.063899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.121 [2024-11-20 01:31:30.064014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.121 [2024-11-20 01:31:30.064039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.121 qpair failed and we were unable to recover it. 00:30:22.121 [2024-11-20 01:31:30.064205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.121 [2024-11-20 01:31:30.064353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.121 [2024-11-20 01:31:30.064394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.121 qpair failed and we were unable to recover it. 00:30:22.121 [2024-11-20 01:31:30.064498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.121 [2024-11-20 01:31:30.064629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.121 [2024-11-20 01:31:30.064653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.121 qpair failed and we were unable to recover it. 00:30:22.122 [2024-11-20 01:31:30.064771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.122 [2024-11-20 01:31:30.064857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.122 [2024-11-20 01:31:30.064882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.122 qpair failed and we were unable to recover it. 00:30:22.122 [2024-11-20 01:31:30.064977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.122 [2024-11-20 01:31:30.065086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.122 [2024-11-20 01:31:30.065126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.122 qpair failed and we were unable to recover it. 00:30:22.122 [2024-11-20 01:31:30.065273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.122 [2024-11-20 01:31:30.065420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.122 [2024-11-20 01:31:30.065445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.122 qpair failed and we were unable to recover it. 00:30:22.122 [2024-11-20 01:31:30.065588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.122 [2024-11-20 01:31:30.065703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.122 [2024-11-20 01:31:30.065729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.122 qpair failed and we were unable to recover it. 00:30:22.122 [2024-11-20 01:31:30.065847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.122 [2024-11-20 01:31:30.065976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.122 [2024-11-20 01:31:30.066000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.122 qpair failed and we were unable to recover it. 00:30:22.122 [2024-11-20 01:31:30.066139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.122 [2024-11-20 01:31:30.066298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.122 [2024-11-20 01:31:30.066347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.122 qpair failed and we were unable to recover it. 00:30:22.122 [2024-11-20 01:31:30.066462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.122 [2024-11-20 01:31:30.066599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.122 [2024-11-20 01:31:30.066623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.122 qpair failed and we were unable to recover it. 00:30:22.122 [2024-11-20 01:31:30.066741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.122 [2024-11-20 01:31:30.066853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.122 [2024-11-20 01:31:30.066877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.122 qpair failed and we were unable to recover it. 00:30:22.122 [2024-11-20 01:31:30.066964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.122 [2024-11-20 01:31:30.067100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.122 [2024-11-20 01:31:30.067125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.122 qpair failed and we were unable to recover it. 00:30:22.122 [2024-11-20 01:31:30.067242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.122 [2024-11-20 01:31:30.067361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.122 [2024-11-20 01:31:30.067385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.122 qpair failed and we were unable to recover it. 00:30:22.122 [2024-11-20 01:31:30.067486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.122 [2024-11-20 01:31:30.067570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.122 [2024-11-20 01:31:30.067595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.122 qpair failed and we were unable to recover it. 00:30:22.122 [2024-11-20 01:31:30.067683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.122 [2024-11-20 01:31:30.067825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.122 [2024-11-20 01:31:30.067854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.122 qpair failed and we were unable to recover it. 00:30:22.122 [2024-11-20 01:31:30.067971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.122 [2024-11-20 01:31:30.068089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.122 [2024-11-20 01:31:30.068114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.122 qpair failed and we were unable to recover it. 00:30:22.122 [2024-11-20 01:31:30.068203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.122 [2024-11-20 01:31:30.068312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.122 [2024-11-20 01:31:30.068336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.122 qpair failed and we were unable to recover it. 00:30:22.122 [2024-11-20 01:31:30.068426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.122 [2024-11-20 01:31:30.068510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.122 [2024-11-20 01:31:30.068534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.122 qpair failed and we were unable to recover it. 00:30:22.122 [2024-11-20 01:31:30.068626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.122 [2024-11-20 01:31:30.068708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.122 [2024-11-20 01:31:30.068732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.122 qpair failed and we were unable to recover it. 00:30:22.122 [2024-11-20 01:31:30.068828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.122 [2024-11-20 01:31:30.068942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.122 [2024-11-20 01:31:30.068966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.122 qpair failed and we were unable to recover it. 00:30:22.122 [2024-11-20 01:31:30.069082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.122 [2024-11-20 01:31:30.069170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.122 [2024-11-20 01:31:30.069196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.122 qpair failed and we were unable to recover it. 00:30:22.122 [2024-11-20 01:31:30.069293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.122 [2024-11-20 01:31:30.069434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.122 [2024-11-20 01:31:30.069459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.122 qpair failed and we were unable to recover it. 00:30:22.122 [2024-11-20 01:31:30.069575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.122 [2024-11-20 01:31:30.069693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.122 [2024-11-20 01:31:30.069718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.122 qpair failed and we were unable to recover it. 00:30:22.122 [2024-11-20 01:31:30.069835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.122 [2024-11-20 01:31:30.069925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.122 [2024-11-20 01:31:30.069950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.122 qpair failed and we were unable to recover it. 00:30:22.122 [2024-11-20 01:31:30.070076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.122 [2024-11-20 01:31:30.070201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.122 [2024-11-20 01:31:30.070228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.122 qpair failed and we were unable to recover it. 00:30:22.122 [2024-11-20 01:31:30.070319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.122 [2024-11-20 01:31:30.070404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.122 [2024-11-20 01:31:30.070428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.122 qpair failed and we were unable to recover it. 00:30:22.122 [2024-11-20 01:31:30.070509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.122 [2024-11-20 01:31:30.070651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.122 [2024-11-20 01:31:30.070676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.122 qpair failed and we were unable to recover it. 00:30:22.122 [2024-11-20 01:31:30.070762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.122 [2024-11-20 01:31:30.070851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.122 [2024-11-20 01:31:30.070875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.122 qpair failed and we were unable to recover it. 00:30:22.122 [2024-11-20 01:31:30.070972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.122 [2024-11-20 01:31:30.071101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.122 [2024-11-20 01:31:30.071127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.122 qpair failed and we were unable to recover it. 00:30:22.122 [2024-11-20 01:31:30.071229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.122 [2024-11-20 01:31:30.071336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.122 [2024-11-20 01:31:30.071360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.122 qpair failed and we were unable to recover it. 00:30:22.122 [2024-11-20 01:31:30.071451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.122 [2024-11-20 01:31:30.071576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.122 [2024-11-20 01:31:30.071600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.122 qpair failed and we were unable to recover it. 00:30:22.123 [2024-11-20 01:31:30.071695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.123 [2024-11-20 01:31:30.071816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.123 [2024-11-20 01:31:30.071840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.123 qpair failed and we were unable to recover it. 00:30:22.123 [2024-11-20 01:31:30.071981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.123 [2024-11-20 01:31:30.072100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.123 [2024-11-20 01:31:30.072125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.123 qpair failed and we were unable to recover it. 00:30:22.123 [2024-11-20 01:31:30.072242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.123 [2024-11-20 01:31:30.072332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.123 [2024-11-20 01:31:30.072357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.123 qpair failed and we were unable to recover it. 00:30:22.123 [2024-11-20 01:31:30.072469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.123 [2024-11-20 01:31:30.072614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.123 [2024-11-20 01:31:30.072638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.123 qpair failed and we were unable to recover it. 00:30:22.123 [2024-11-20 01:31:30.072740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.123 [2024-11-20 01:31:30.072825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.123 [2024-11-20 01:31:30.072850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.123 qpair failed and we were unable to recover it. 00:30:22.123 [2024-11-20 01:31:30.072963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.123 [2024-11-20 01:31:30.073085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.123 [2024-11-20 01:31:30.073119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.123 qpair failed and we were unable to recover it. 00:30:22.123 [2024-11-20 01:31:30.073216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.123 [2024-11-20 01:31:30.073330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.123 [2024-11-20 01:31:30.073356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.123 qpair failed and we were unable to recover it. 00:30:22.123 [2024-11-20 01:31:30.073510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.123 [2024-11-20 01:31:30.073627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.123 [2024-11-20 01:31:30.073652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.123 qpair failed and we were unable to recover it. 00:30:22.123 [2024-11-20 01:31:30.073772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.123 [2024-11-20 01:31:30.073854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.123 [2024-11-20 01:31:30.073879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.123 qpair failed and we were unable to recover it. 00:30:22.123 [2024-11-20 01:31:30.073995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.123 [2024-11-20 01:31:30.074104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.123 [2024-11-20 01:31:30.074130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.123 qpair failed and we were unable to recover it. 00:30:22.123 [2024-11-20 01:31:30.074259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.123 [2024-11-20 01:31:30.074372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.123 [2024-11-20 01:31:30.074397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.123 qpair failed and we were unable to recover it. 00:30:22.123 [2024-11-20 01:31:30.074518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.123 [2024-11-20 01:31:30.074621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.123 [2024-11-20 01:31:30.074646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.123 qpair failed and we were unable to recover it. 00:30:22.123 [2024-11-20 01:31:30.074766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.123 [2024-11-20 01:31:30.074912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.123 [2024-11-20 01:31:30.074937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.123 qpair failed and we were unable to recover it. 00:30:22.123 [2024-11-20 01:31:30.075104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.123 [2024-11-20 01:31:30.075186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.123 [2024-11-20 01:31:30.075211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.123 qpair failed and we were unable to recover it. 00:30:22.123 [2024-11-20 01:31:30.075299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.123 [2024-11-20 01:31:30.075388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.123 [2024-11-20 01:31:30.075413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.123 qpair failed and we were unable to recover it. 00:30:22.123 [2024-11-20 01:31:30.075537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.123 [2024-11-20 01:31:30.075629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.123 [2024-11-20 01:31:30.075654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.123 qpair failed and we were unable to recover it. 00:30:22.123 [2024-11-20 01:31:30.075748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.123 [2024-11-20 01:31:30.075860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.123 [2024-11-20 01:31:30.075885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.123 qpair failed and we were unable to recover it. 00:30:22.123 [2024-11-20 01:31:30.076005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.123 [2024-11-20 01:31:30.076093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.123 [2024-11-20 01:31:30.076119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.123 qpair failed and we were unable to recover it. 00:30:22.123 [2024-11-20 01:31:30.076203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.123 [2024-11-20 01:31:30.076357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.123 [2024-11-20 01:31:30.076381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.123 qpair failed and we were unable to recover it. 00:30:22.123 [2024-11-20 01:31:30.076497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.123 [2024-11-20 01:31:30.076584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.123 [2024-11-20 01:31:30.076608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.123 qpair failed and we were unable to recover it. 00:30:22.123 [2024-11-20 01:31:30.076727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.123 [2024-11-20 01:31:30.076843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.123 [2024-11-20 01:31:30.076867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.123 qpair failed and we were unable to recover it. 00:30:22.123 [2024-11-20 01:31:30.076979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.123 [2024-11-20 01:31:30.077101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.123 [2024-11-20 01:31:30.077126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.123 qpair failed and we were unable to recover it. 00:30:22.123 [2024-11-20 01:31:30.077221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.123 [2024-11-20 01:31:30.077306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.123 [2024-11-20 01:31:30.077330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.123 qpair failed and we were unable to recover it. 00:30:22.123 [2024-11-20 01:31:30.077454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.123 [2024-11-20 01:31:30.077545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.123 [2024-11-20 01:31:30.077570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.123 qpair failed and we were unable to recover it. 00:30:22.123 [2024-11-20 01:31:30.077665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.123 [2024-11-20 01:31:30.077778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.123 [2024-11-20 01:31:30.077803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.124 qpair failed and we were unable to recover it. 00:30:22.124 [2024-11-20 01:31:30.077921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.124 [2024-11-20 01:31:30.078037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.124 [2024-11-20 01:31:30.078062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.124 qpair failed and we were unable to recover it. 00:30:22.124 [2024-11-20 01:31:30.078190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.124 [2024-11-20 01:31:30.078288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.124 [2024-11-20 01:31:30.078314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.124 qpair failed and we were unable to recover it. 00:30:22.124 [2024-11-20 01:31:30.078411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.124 [2024-11-20 01:31:30.078525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.124 [2024-11-20 01:31:30.078550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.124 qpair failed and we were unable to recover it. 00:30:22.124 [2024-11-20 01:31:30.078668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.124 [2024-11-20 01:31:30.078810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.124 [2024-11-20 01:31:30.078834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.124 qpair failed and we were unable to recover it. 00:30:22.124 [2024-11-20 01:31:30.078923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.124 [2024-11-20 01:31:30.079053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.124 [2024-11-20 01:31:30.079085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.124 qpair failed and we were unable to recover it. 00:30:22.124 [2024-11-20 01:31:30.079252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.124 [2024-11-20 01:31:30.079385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.124 [2024-11-20 01:31:30.079409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.124 qpair failed and we were unable to recover it. 00:30:22.124 [2024-11-20 01:31:30.079526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.124 [2024-11-20 01:31:30.079618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.124 [2024-11-20 01:31:30.079642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.124 qpair failed and we were unable to recover it. 00:30:22.124 [2024-11-20 01:31:30.079756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.124 [2024-11-20 01:31:30.079849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.124 [2024-11-20 01:31:30.079874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.124 qpair failed and we were unable to recover it. 00:30:22.124 [2024-11-20 01:31:30.079966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.124 [2024-11-20 01:31:30.080063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.124 [2024-11-20 01:31:30.080098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.124 qpair failed and we were unable to recover it. 00:30:22.124 [2024-11-20 01:31:30.080214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.124 [2024-11-20 01:31:30.080331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.124 [2024-11-20 01:31:30.080356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.124 qpair failed and we were unable to recover it. 00:30:22.124 [2024-11-20 01:31:30.080505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.124 [2024-11-20 01:31:30.080649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.124 [2024-11-20 01:31:30.080673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.124 qpair failed and we were unable to recover it. 00:30:22.124 [2024-11-20 01:31:30.080766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.124 [2024-11-20 01:31:30.080876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.124 [2024-11-20 01:31:30.080901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.124 qpair failed and we were unable to recover it. 00:30:22.124 [2024-11-20 01:31:30.080989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.124 [2024-11-20 01:31:30.081106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.124 [2024-11-20 01:31:30.081131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.124 qpair failed and we were unable to recover it. 00:30:22.124 [2024-11-20 01:31:30.081212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.124 [2024-11-20 01:31:30.081331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.124 [2024-11-20 01:31:30.081355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.124 qpair failed and we were unable to recover it. 00:30:22.124 [2024-11-20 01:31:30.081454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.124 [2024-11-20 01:31:30.081536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.124 [2024-11-20 01:31:30.081561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.124 qpair failed and we were unable to recover it. 00:30:22.124 [2024-11-20 01:31:30.081679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.124 [2024-11-20 01:31:30.081802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.124 [2024-11-20 01:31:30.081827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.124 qpair failed and we were unable to recover it. 00:30:22.124 [2024-11-20 01:31:30.081911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.124 [2024-11-20 01:31:30.082031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.124 [2024-11-20 01:31:30.082056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.124 qpair failed and we were unable to recover it. 00:30:22.124 [2024-11-20 01:31:30.082151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.124 [2024-11-20 01:31:30.082249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.124 [2024-11-20 01:31:30.082275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.124 qpair failed and we were unable to recover it. 00:30:22.124 [2024-11-20 01:31:30.082387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.124 [2024-11-20 01:31:30.082498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.124 [2024-11-20 01:31:30.082523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.124 qpair failed and we were unable to recover it. 00:30:22.124 [2024-11-20 01:31:30.082649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.124 [2024-11-20 01:31:30.082731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.124 [2024-11-20 01:31:30.082756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.124 qpair failed and we were unable to recover it. 00:30:22.124 [2024-11-20 01:31:30.082852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.124 [2024-11-20 01:31:30.082997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.124 [2024-11-20 01:31:30.083022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.124 qpair failed and we were unable to recover it. 00:30:22.124 [2024-11-20 01:31:30.083111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.124 [2024-11-20 01:31:30.083241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.124 [2024-11-20 01:31:30.083283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.124 qpair failed and we were unable to recover it. 00:30:22.124 [2024-11-20 01:31:30.083427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.124 [2024-11-20 01:31:30.083535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.124 [2024-11-20 01:31:30.083560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.124 qpair failed and we were unable to recover it. 00:30:22.124 [2024-11-20 01:31:30.083680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.124 [2024-11-20 01:31:30.083803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.124 [2024-11-20 01:31:30.083829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.124 qpair failed and we were unable to recover it. 00:30:22.124 [2024-11-20 01:31:30.083925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.124 [2024-11-20 01:31:30.084014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.124 [2024-11-20 01:31:30.084040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.124 qpair failed and we were unable to recover it. 00:30:22.124 [2024-11-20 01:31:30.084194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.124 [2024-11-20 01:31:30.084279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.124 [2024-11-20 01:31:30.084303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.124 qpair failed and we were unable to recover it. 00:30:22.124 [2024-11-20 01:31:30.084418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.124 [2024-11-20 01:31:30.084532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.124 [2024-11-20 01:31:30.084556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.124 qpair failed and we were unable to recover it. 00:30:22.124 [2024-11-20 01:31:30.084704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.124 [2024-11-20 01:31:30.084823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.124 [2024-11-20 01:31:30.084848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.124 qpair failed and we were unable to recover it. 00:30:22.124 [2024-11-20 01:31:30.084991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.125 [2024-11-20 01:31:30.085084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.125 [2024-11-20 01:31:30.085114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.125 qpair failed and we were unable to recover it. 00:30:22.125 [2024-11-20 01:31:30.085275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.125 [2024-11-20 01:31:30.085422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.125 [2024-11-20 01:31:30.085448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.125 qpair failed and we were unable to recover it. 00:30:22.125 [2024-11-20 01:31:30.085611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.125 [2024-11-20 01:31:30.085725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.125 [2024-11-20 01:31:30.085750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.125 qpair failed and we were unable to recover it. 00:30:22.125 [2024-11-20 01:31:30.085858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.125 [2024-11-20 01:31:30.086003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.125 [2024-11-20 01:31:30.086027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.125 qpair failed and we were unable to recover it. 00:30:22.125 [2024-11-20 01:31:30.086130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.125 [2024-11-20 01:31:30.086240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.125 [2024-11-20 01:31:30.086267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.125 qpair failed and we were unable to recover it. 00:30:22.125 [2024-11-20 01:31:30.086401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.125 [2024-11-20 01:31:30.086516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.125 [2024-11-20 01:31:30.086542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.125 qpair failed and we were unable to recover it. 00:30:22.125 [2024-11-20 01:31:30.086655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.125 [2024-11-20 01:31:30.086771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.125 [2024-11-20 01:31:30.086795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.125 qpair failed and we were unable to recover it. 00:30:22.125 [2024-11-20 01:31:30.086890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.125 [2024-11-20 01:31:30.086982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.125 [2024-11-20 01:31:30.087006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.125 qpair failed and we were unable to recover it. 00:30:22.125 [2024-11-20 01:31:30.087126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.125 [2024-11-20 01:31:30.087242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.125 [2024-11-20 01:31:30.087266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.125 qpair failed and we were unable to recover it. 00:30:22.125 [2024-11-20 01:31:30.087355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.125 [2024-11-20 01:31:30.087466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.125 [2024-11-20 01:31:30.087492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.125 qpair failed and we were unable to recover it. 00:30:22.125 [2024-11-20 01:31:30.087607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.125 [2024-11-20 01:31:30.087699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.125 [2024-11-20 01:31:30.087724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.125 qpair failed and we were unable to recover it. 00:30:22.125 [2024-11-20 01:31:30.087816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.125 [2024-11-20 01:31:30.087911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.125 [2024-11-20 01:31:30.087937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.125 qpair failed and we were unable to recover it. 00:30:22.125 [2024-11-20 01:31:30.088056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.125 [2024-11-20 01:31:30.088180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.125 [2024-11-20 01:31:30.088206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.125 qpair failed and we were unable to recover it. 00:30:22.125 [2024-11-20 01:31:30.088322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.125 [2024-11-20 01:31:30.088409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.125 [2024-11-20 01:31:30.088434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.125 qpair failed and we were unable to recover it. 00:30:22.125 [2024-11-20 01:31:30.088548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.125 [2024-11-20 01:31:30.088634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.125 [2024-11-20 01:31:30.088659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.125 qpair failed and we were unable to recover it. 00:30:22.125 [2024-11-20 01:31:30.088807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.125 [2024-11-20 01:31:30.088918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.125 [2024-11-20 01:31:30.088942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.125 qpair failed and we were unable to recover it. 00:30:22.125 [2024-11-20 01:31:30.089061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.125 [2024-11-20 01:31:30.089202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.125 [2024-11-20 01:31:30.089245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.125 qpair failed and we were unable to recover it. 00:30:22.125 [2024-11-20 01:31:30.089337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.125 [2024-11-20 01:31:30.089485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.125 [2024-11-20 01:31:30.089511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.125 qpair failed and we were unable to recover it. 00:30:22.125 [2024-11-20 01:31:30.089625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.125 [2024-11-20 01:31:30.089721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.125 [2024-11-20 01:31:30.089746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.125 qpair failed and we were unable to recover it. 00:30:22.125 [2024-11-20 01:31:30.089838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.125 [2024-11-20 01:31:30.089956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.125 [2024-11-20 01:31:30.089981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.125 qpair failed and we were unable to recover it. 00:30:22.125 [2024-11-20 01:31:30.090081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.125 [2024-11-20 01:31:30.090162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.125 [2024-11-20 01:31:30.090186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.125 qpair failed and we were unable to recover it. 00:30:22.125 [2024-11-20 01:31:30.090278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.125 [2024-11-20 01:31:30.090363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.125 [2024-11-20 01:31:30.090387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.125 qpair failed and we were unable to recover it. 00:30:22.125 [2024-11-20 01:31:30.090506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.125 [2024-11-20 01:31:30.090623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.125 [2024-11-20 01:31:30.090648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.125 qpair failed and we were unable to recover it. 00:30:22.125 [2024-11-20 01:31:30.090762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.125 [2024-11-20 01:31:30.090878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.125 [2024-11-20 01:31:30.090904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.125 qpair failed and we were unable to recover it. 00:30:22.125 [2024-11-20 01:31:30.090990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.125 [2024-11-20 01:31:30.091101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.125 [2024-11-20 01:31:30.091128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.125 qpair failed and we were unable to recover it. 00:30:22.125 [2024-11-20 01:31:30.091250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.125 [2024-11-20 01:31:30.091337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.125 [2024-11-20 01:31:30.091361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.125 qpair failed and we were unable to recover it. 00:30:22.125 [2024-11-20 01:31:30.091485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.125 [2024-11-20 01:31:30.091630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.125 [2024-11-20 01:31:30.091656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.125 qpair failed and we were unable to recover it. 00:30:22.125 [2024-11-20 01:31:30.091771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.125 [2024-11-20 01:31:30.091886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.125 [2024-11-20 01:31:30.091911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.125 qpair failed and we were unable to recover it. 00:30:22.125 [2024-11-20 01:31:30.092028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.125 [2024-11-20 01:31:30.092123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.125 [2024-11-20 01:31:30.092149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.126 qpair failed and we were unable to recover it. 00:30:22.126 [2024-11-20 01:31:30.092292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.126 [2024-11-20 01:31:30.092435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.126 [2024-11-20 01:31:30.092459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.126 qpair failed and we were unable to recover it. 00:30:22.126 [2024-11-20 01:31:30.092600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.126 [2024-11-20 01:31:30.092743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.126 [2024-11-20 01:31:30.092768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.126 qpair failed and we were unable to recover it. 00:30:22.126 [2024-11-20 01:31:30.092887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.126 [2024-11-20 01:31:30.093038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.126 [2024-11-20 01:31:30.093062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.126 qpair failed and we were unable to recover it. 00:30:22.126 [2024-11-20 01:31:30.093210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.126 [2024-11-20 01:31:30.093333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.126 [2024-11-20 01:31:30.093362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.126 qpair failed and we were unable to recover it. 00:30:22.126 [2024-11-20 01:31:30.093495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.126 [2024-11-20 01:31:30.093660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.126 [2024-11-20 01:31:30.093688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.126 qpair failed and we were unable to recover it. 00:30:22.126 [2024-11-20 01:31:30.093827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.126 [2024-11-20 01:31:30.093920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.126 [2024-11-20 01:31:30.093945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.126 qpair failed and we were unable to recover it. 00:30:22.126 [2024-11-20 01:31:30.094088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.126 [2024-11-20 01:31:30.094202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.126 [2024-11-20 01:31:30.094227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.126 qpair failed and we were unable to recover it. 00:30:22.126 [2024-11-20 01:31:30.094343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.126 [2024-11-20 01:31:30.094458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.126 [2024-11-20 01:31:30.094483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.126 qpair failed and we were unable to recover it. 00:30:22.126 [2024-11-20 01:31:30.094605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.126 [2024-11-20 01:31:30.094686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.126 [2024-11-20 01:31:30.094712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.126 qpair failed and we were unable to recover it. 00:30:22.126 [2024-11-20 01:31:30.094831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.126 [2024-11-20 01:31:30.094937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.126 [2024-11-20 01:31:30.094963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.126 qpair failed and we were unable to recover it. 00:30:22.126 [2024-11-20 01:31:30.095109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.126 [2024-11-20 01:31:30.095260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.126 [2024-11-20 01:31:30.095285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.126 qpair failed and we were unable to recover it. 00:30:22.126 [2024-11-20 01:31:30.095403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.126 [2024-11-20 01:31:30.095525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.126 [2024-11-20 01:31:30.095550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.126 qpair failed and we were unable to recover it. 00:30:22.126 [2024-11-20 01:31:30.095664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.126 [2024-11-20 01:31:30.095810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.126 [2024-11-20 01:31:30.095835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.126 qpair failed and we were unable to recover it. 00:30:22.126 [2024-11-20 01:31:30.095947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.126 [2024-11-20 01:31:30.096061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.126 [2024-11-20 01:31:30.096093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.126 qpair failed and we were unable to recover it. 00:30:22.126 [2024-11-20 01:31:30.096214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.126 [2024-11-20 01:31:30.096329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.126 [2024-11-20 01:31:30.096353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.126 qpair failed and we were unable to recover it. 00:30:22.126 [2024-11-20 01:31:30.096502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.126 [2024-11-20 01:31:30.096594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.126 [2024-11-20 01:31:30.096619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.126 qpair failed and we were unable to recover it. 00:30:22.126 [2024-11-20 01:31:30.096765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.126 [2024-11-20 01:31:30.096849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.126 [2024-11-20 01:31:30.096873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.126 qpair failed and we were unable to recover it. 00:30:22.126 [2024-11-20 01:31:30.096964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.126 [2024-11-20 01:31:30.097047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.126 [2024-11-20 01:31:30.097078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.126 qpair failed and we were unable to recover it. 00:30:22.126 [2024-11-20 01:31:30.097170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.126 [2024-11-20 01:31:30.097283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.126 [2024-11-20 01:31:30.097309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.126 qpair failed and we were unable to recover it. 00:30:22.126 [2024-11-20 01:31:30.097430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.126 [2024-11-20 01:31:30.097544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.126 [2024-11-20 01:31:30.097569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.126 qpair failed and we were unable to recover it. 00:30:22.126 [2024-11-20 01:31:30.097667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.126 [2024-11-20 01:31:30.097777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.126 [2024-11-20 01:31:30.097802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.126 qpair failed and we were unable to recover it. 00:30:22.126 [2024-11-20 01:31:30.097913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.126 [2024-11-20 01:31:30.098006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.126 [2024-11-20 01:31:30.098032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.126 qpair failed and we were unable to recover it. 00:30:22.126 [2024-11-20 01:31:30.098161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.126 [2024-11-20 01:31:30.098281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.126 [2024-11-20 01:31:30.098305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.126 qpair failed and we were unable to recover it. 00:30:22.126 [2024-11-20 01:31:30.098393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.126 [2024-11-20 01:31:30.098512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.126 [2024-11-20 01:31:30.098536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.126 qpair failed and we were unable to recover it. 00:30:22.126 [2024-11-20 01:31:30.098655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.126 [2024-11-20 01:31:30.098769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.126 [2024-11-20 01:31:30.098794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.126 qpair failed and we were unable to recover it. 00:30:22.126 [2024-11-20 01:31:30.098944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.126 [2024-11-20 01:31:30.099040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.126 [2024-11-20 01:31:30.099065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.126 qpair failed and we were unable to recover it. 00:30:22.126 [2024-11-20 01:31:30.099220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.126 [2024-11-20 01:31:30.099372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.126 [2024-11-20 01:31:30.099414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.126 qpair failed and we were unable to recover it. 00:30:22.126 [2024-11-20 01:31:30.099502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.126 [2024-11-20 01:31:30.099644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.126 [2024-11-20 01:31:30.099669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.126 qpair failed and we were unable to recover it. 00:30:22.126 [2024-11-20 01:31:30.099758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.127 [2024-11-20 01:31:30.099901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.127 [2024-11-20 01:31:30.099925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.127 qpair failed and we were unable to recover it. 00:30:22.127 [2024-11-20 01:31:30.100083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.127 [2024-11-20 01:31:30.100214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.127 [2024-11-20 01:31:30.100241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.127 qpair failed and we were unable to recover it. 00:30:22.127 [2024-11-20 01:31:30.100350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.127 [2024-11-20 01:31:30.100496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.127 [2024-11-20 01:31:30.100520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.127 qpair failed and we were unable to recover it. 00:30:22.127 [2024-11-20 01:31:30.100615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.127 [2024-11-20 01:31:30.100700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.127 [2024-11-20 01:31:30.100725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.127 qpair failed and we were unable to recover it. 00:30:22.127 [2024-11-20 01:31:30.100869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.127 [2024-11-20 01:31:30.101010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.127 [2024-11-20 01:31:30.101038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.127 qpair failed and we were unable to recover it. 00:30:22.127 [2024-11-20 01:31:30.101137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.127 [2024-11-20 01:31:30.101288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.127 [2024-11-20 01:31:30.101330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.127 qpair failed and we were unable to recover it. 00:30:22.127 [2024-11-20 01:31:30.101460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.127 [2024-11-20 01:31:30.101561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.127 [2024-11-20 01:31:30.101586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.127 qpair failed and we were unable to recover it. 00:30:22.127 [2024-11-20 01:31:30.101704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.127 [2024-11-20 01:31:30.101791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.127 [2024-11-20 01:31:30.101815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.127 qpair failed and we were unable to recover it. 00:30:22.127 [2024-11-20 01:31:30.101936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.127 [2024-11-20 01:31:30.102021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.127 [2024-11-20 01:31:30.102046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.127 qpair failed and we were unable to recover it. 00:30:22.127 [2024-11-20 01:31:30.102171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.127 [2024-11-20 01:31:30.102308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.127 [2024-11-20 01:31:30.102333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.127 qpair failed and we were unable to recover it. 00:30:22.127 [2024-11-20 01:31:30.102453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.127 [2024-11-20 01:31:30.102544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.127 [2024-11-20 01:31:30.102568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.127 qpair failed and we were unable to recover it. 00:30:22.127 [2024-11-20 01:31:30.102658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.127 [2024-11-20 01:31:30.102774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.127 [2024-11-20 01:31:30.102799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.127 qpair failed and we were unable to recover it. 00:30:22.127 [2024-11-20 01:31:30.102915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.127 [2024-11-20 01:31:30.103002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.127 [2024-11-20 01:31:30.103027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.127 qpair failed and we were unable to recover it. 00:30:22.127 [2024-11-20 01:31:30.103178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.127 [2024-11-20 01:31:30.103276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.127 [2024-11-20 01:31:30.103300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.127 qpair failed and we were unable to recover it. 00:30:22.127 [2024-11-20 01:31:30.103385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.127 [2024-11-20 01:31:30.103475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.127 [2024-11-20 01:31:30.103504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.127 qpair failed and we were unable to recover it. 00:30:22.127 [2024-11-20 01:31:30.103645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.127 [2024-11-20 01:31:30.103793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.127 [2024-11-20 01:31:30.103818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.127 qpair failed and we were unable to recover it. 00:30:22.127 [2024-11-20 01:31:30.103930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.127 [2024-11-20 01:31:30.104023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.127 [2024-11-20 01:31:30.104047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.127 qpair failed and we were unable to recover it. 00:30:22.127 [2024-11-20 01:31:30.104173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.127 [2024-11-20 01:31:30.104259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.127 [2024-11-20 01:31:30.104284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.127 qpair failed and we were unable to recover it. 00:30:22.127 [2024-11-20 01:31:30.104410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.127 [2024-11-20 01:31:30.104503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.127 [2024-11-20 01:31:30.104527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.127 qpair failed and we were unable to recover it. 00:30:22.127 [2024-11-20 01:31:30.104649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.127 [2024-11-20 01:31:30.104744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.127 [2024-11-20 01:31:30.104770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.127 qpair failed and we were unable to recover it. 00:30:22.127 [2024-11-20 01:31:30.104918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.127 [2024-11-20 01:31:30.105059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.127 [2024-11-20 01:31:30.105093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.127 qpair failed and we were unable to recover it. 00:30:22.127 [2024-11-20 01:31:30.105229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.127 [2024-11-20 01:31:30.105335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.127 [2024-11-20 01:31:30.105360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.127 qpair failed and we were unable to recover it. 00:30:22.127 [2024-11-20 01:31:30.105502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.127 [2024-11-20 01:31:30.105660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.127 [2024-11-20 01:31:30.105713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.127 qpair failed and we were unable to recover it. 00:30:22.127 [2024-11-20 01:31:30.105823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.127 [2024-11-20 01:31:30.105938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.127 [2024-11-20 01:31:30.105963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.127 qpair failed and we were unable to recover it. 00:30:22.127 [2024-11-20 01:31:30.106122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.127 [2024-11-20 01:31:30.106265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.127 [2024-11-20 01:31:30.106315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.127 qpair failed and we were unable to recover it. 00:30:22.127 [2024-11-20 01:31:30.106404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.127 [2024-11-20 01:31:30.106518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.127 [2024-11-20 01:31:30.106543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.127 qpair failed and we were unable to recover it. 00:30:22.127 [2024-11-20 01:31:30.106631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.127 [2024-11-20 01:31:30.106723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.127 [2024-11-20 01:31:30.106748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.127 qpair failed and we were unable to recover it. 00:30:22.127 [2024-11-20 01:31:30.106863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.127 [2024-11-20 01:31:30.106984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.127 [2024-11-20 01:31:30.107008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.127 qpair failed and we were unable to recover it. 00:30:22.127 [2024-11-20 01:31:30.107097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.127 [2024-11-20 01:31:30.107209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.127 [2024-11-20 01:31:30.107233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.128 qpair failed and we were unable to recover it. 00:30:22.128 [2024-11-20 01:31:30.107320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.128 [2024-11-20 01:31:30.107437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.128 [2024-11-20 01:31:30.107461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.128 qpair failed and we were unable to recover it. 00:30:22.128 [2024-11-20 01:31:30.107581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.128 [2024-11-20 01:31:30.107696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.128 [2024-11-20 01:31:30.107721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.128 qpair failed and we were unable to recover it. 00:30:22.128 [2024-11-20 01:31:30.107837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.128 [2024-11-20 01:31:30.107916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.128 [2024-11-20 01:31:30.107940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.128 qpair failed and we were unable to recover it. 00:30:22.128 [2024-11-20 01:31:30.108057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.128 [2024-11-20 01:31:30.108146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.128 [2024-11-20 01:31:30.108171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.128 qpair failed and we were unable to recover it. 00:30:22.128 [2024-11-20 01:31:30.108274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.128 [2024-11-20 01:31:30.108416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.128 [2024-11-20 01:31:30.108439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.128 qpair failed and we were unable to recover it. 00:30:22.128 [2024-11-20 01:31:30.108536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.128 [2024-11-20 01:31:30.108628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.128 [2024-11-20 01:31:30.108656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.128 qpair failed and we were unable to recover it. 00:30:22.128 [2024-11-20 01:31:30.108737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.128 [2024-11-20 01:31:30.108880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.128 [2024-11-20 01:31:30.108903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.128 qpair failed and we were unable to recover it. 00:30:22.128 [2024-11-20 01:31:30.108987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.128 [2024-11-20 01:31:30.109104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.128 [2024-11-20 01:31:30.109129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.128 qpair failed and we were unable to recover it. 00:30:22.128 [2024-11-20 01:31:30.109247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.128 [2024-11-20 01:31:30.109370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.128 [2024-11-20 01:31:30.109394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.128 qpair failed and we were unable to recover it. 00:30:22.128 [2024-11-20 01:31:30.109481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.128 [2024-11-20 01:31:30.109572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.128 [2024-11-20 01:31:30.109596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.128 qpair failed and we were unable to recover it. 00:30:22.128 [2024-11-20 01:31:30.109685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.128 [2024-11-20 01:31:30.109800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.128 [2024-11-20 01:31:30.109825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.128 qpair failed and we were unable to recover it. 00:30:22.128 [2024-11-20 01:31:30.109940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.128 [2024-11-20 01:31:30.110027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.128 [2024-11-20 01:31:30.110051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.128 qpair failed and we were unable to recover it. 00:30:22.128 [2024-11-20 01:31:30.110158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.128 [2024-11-20 01:31:30.110281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.128 [2024-11-20 01:31:30.110306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.128 qpair failed and we were unable to recover it. 00:30:22.128 [2024-11-20 01:31:30.110392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.128 [2024-11-20 01:31:30.110480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.128 [2024-11-20 01:31:30.110504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.128 qpair failed and we were unable to recover it. 00:30:22.128 [2024-11-20 01:31:30.110646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.128 [2024-11-20 01:31:30.110763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.128 [2024-11-20 01:31:30.110788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.128 qpair failed and we were unable to recover it. 00:30:22.128 [2024-11-20 01:31:30.110941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.128 [2024-11-20 01:31:30.111025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.128 [2024-11-20 01:31:30.111050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.128 qpair failed and we were unable to recover it. 00:30:22.128 [2024-11-20 01:31:30.111183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.128 [2024-11-20 01:31:30.111302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.128 [2024-11-20 01:31:30.111327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.128 qpair failed and we were unable to recover it. 00:30:22.128 [2024-11-20 01:31:30.111449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.128 [2024-11-20 01:31:30.111561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.128 [2024-11-20 01:31:30.111586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.128 qpair failed and we were unable to recover it. 00:30:22.128 [2024-11-20 01:31:30.111664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.128 [2024-11-20 01:31:30.111748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.128 [2024-11-20 01:31:30.111772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.128 qpair failed and we were unable to recover it. 00:30:22.128 [2024-11-20 01:31:30.111859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.128 [2024-11-20 01:31:30.111973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.128 [2024-11-20 01:31:30.111997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.128 qpair failed and we were unable to recover it. 00:30:22.128 [2024-11-20 01:31:30.112148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.128 [2024-11-20 01:31:30.112298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.128 [2024-11-20 01:31:30.112323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.128 qpair failed and we were unable to recover it. 00:30:22.128 [2024-11-20 01:31:30.112446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.128 [2024-11-20 01:31:30.112540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.128 [2024-11-20 01:31:30.112565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.128 qpair failed and we were unable to recover it. 00:30:22.128 [2024-11-20 01:31:30.112683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.128 [2024-11-20 01:31:30.112766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.128 [2024-11-20 01:31:30.112790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.128 qpair failed and we were unable to recover it. 00:30:22.128 [2024-11-20 01:31:30.112913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.128 [2024-11-20 01:31:30.113000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.128 [2024-11-20 01:31:30.113025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.128 qpair failed and we were unable to recover it. 00:30:22.128 [2024-11-20 01:31:30.113150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.128 [2024-11-20 01:31:30.113236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.128 [2024-11-20 01:31:30.113260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.128 qpair failed and we were unable to recover it. 00:30:22.129 [2024-11-20 01:31:30.113375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.129 [2024-11-20 01:31:30.113468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.129 [2024-11-20 01:31:30.113492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.129 qpair failed and we were unable to recover it. 00:30:22.129 [2024-11-20 01:31:30.113613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.129 [2024-11-20 01:31:30.113730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.129 [2024-11-20 01:31:30.113754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.129 qpair failed and we were unable to recover it. 00:30:22.129 [2024-11-20 01:31:30.113876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.129 [2024-11-20 01:31:30.113993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.129 [2024-11-20 01:31:30.114018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.129 qpair failed and we were unable to recover it. 00:30:22.129 [2024-11-20 01:31:30.114115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.129 [2024-11-20 01:31:30.114231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.129 [2024-11-20 01:31:30.114256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.129 qpair failed and we were unable to recover it. 00:30:22.129 [2024-11-20 01:31:30.114370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.129 [2024-11-20 01:31:30.114491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.129 [2024-11-20 01:31:30.114514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.129 qpair failed and we were unable to recover it. 00:30:22.129 [2024-11-20 01:31:30.114631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.129 [2024-11-20 01:31:30.114780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.129 [2024-11-20 01:31:30.114804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.129 qpair failed and we were unable to recover it. 00:30:22.129 [2024-11-20 01:31:30.114890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.129 [2024-11-20 01:31:30.115004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.129 [2024-11-20 01:31:30.115028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.129 qpair failed and we were unable to recover it. 00:30:22.129 [2024-11-20 01:31:30.115158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.129 [2024-11-20 01:31:30.115301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.129 [2024-11-20 01:31:30.115325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.129 qpair failed and we were unable to recover it. 00:30:22.129 [2024-11-20 01:31:30.115416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.129 [2024-11-20 01:31:30.115501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.129 [2024-11-20 01:31:30.115525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.129 qpair failed and we were unable to recover it. 00:30:22.129 [2024-11-20 01:31:30.115670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.129 [2024-11-20 01:31:30.115761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.129 [2024-11-20 01:31:30.115785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.129 qpair failed and we were unable to recover it. 00:30:22.129 [2024-11-20 01:31:30.115891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.129 [2024-11-20 01:31:30.116017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.129 [2024-11-20 01:31:30.116041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.129 qpair failed and we were unable to recover it. 00:30:22.129 [2024-11-20 01:31:30.116148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.129 [2024-11-20 01:31:30.116264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.129 [2024-11-20 01:31:30.116288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.129 qpair failed and we were unable to recover it. 00:30:22.129 [2024-11-20 01:31:30.116379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.129 [2024-11-20 01:31:30.116493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.129 [2024-11-20 01:31:30.116518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.129 qpair failed and we were unable to recover it. 00:30:22.129 [2024-11-20 01:31:30.116616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.129 [2024-11-20 01:31:30.116728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.129 [2024-11-20 01:31:30.116753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.129 qpair failed and we were unable to recover it. 00:30:22.129 [2024-11-20 01:31:30.116873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.129 [2024-11-20 01:31:30.116964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.129 [2024-11-20 01:31:30.116990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.129 qpair failed and we were unable to recover it. 00:30:22.129 [2024-11-20 01:31:30.117112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.129 [2024-11-20 01:31:30.117241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.129 [2024-11-20 01:31:30.117267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.129 qpair failed and we were unable to recover it. 00:30:22.129 [2024-11-20 01:31:30.117363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.129 [2024-11-20 01:31:30.117487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.129 [2024-11-20 01:31:30.117512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.129 qpair failed and we were unable to recover it. 00:30:22.129 [2024-11-20 01:31:30.117632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.129 [2024-11-20 01:31:30.117771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.129 [2024-11-20 01:31:30.117796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.129 qpair failed and we were unable to recover it. 00:30:22.129 [2024-11-20 01:31:30.117914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.129 [2024-11-20 01:31:30.117995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.129 [2024-11-20 01:31:30.118020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.129 qpair failed and we were unable to recover it. 00:30:22.129 [2024-11-20 01:31:30.118134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.129 [2024-11-20 01:31:30.118224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.129 [2024-11-20 01:31:30.118249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.129 qpair failed and we were unable to recover it. 00:30:22.129 [2024-11-20 01:31:30.118337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.129 [2024-11-20 01:31:30.118469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.129 [2024-11-20 01:31:30.118494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.129 qpair failed and we were unable to recover it. 00:30:22.129 [2024-11-20 01:31:30.118642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.129 [2024-11-20 01:31:30.118725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.129 [2024-11-20 01:31:30.118750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.129 qpair failed and we were unable to recover it. 00:30:22.129 [2024-11-20 01:31:30.118870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.129 [2024-11-20 01:31:30.118955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.129 [2024-11-20 01:31:30.118980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.129 qpair failed and we were unable to recover it. 00:30:22.129 [2024-11-20 01:31:30.119097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.129 [2024-11-20 01:31:30.119239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.129 [2024-11-20 01:31:30.119264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.129 qpair failed and we were unable to recover it. 00:30:22.129 [2024-11-20 01:31:30.119385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.129 [2024-11-20 01:31:30.119468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.129 [2024-11-20 01:31:30.119492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.129 qpair failed and we were unable to recover it. 00:30:22.129 [2024-11-20 01:31:30.119586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.129 [2024-11-20 01:31:30.119676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.129 [2024-11-20 01:31:30.119700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.129 qpair failed and we were unable to recover it. 00:30:22.129 [2024-11-20 01:31:30.119785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.129 [2024-11-20 01:31:30.119895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.129 [2024-11-20 01:31:30.119919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.129 qpair failed and we were unable to recover it. 00:30:22.129 [2024-11-20 01:31:30.120014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.129 [2024-11-20 01:31:30.120135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.129 [2024-11-20 01:31:30.120162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.129 qpair failed and we were unable to recover it. 00:30:22.129 [2024-11-20 01:31:30.120262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.129 [2024-11-20 01:31:30.120376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.130 [2024-11-20 01:31:30.120400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.130 qpair failed and we were unable to recover it. 00:30:22.130 [2024-11-20 01:31:30.120518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.130 [2024-11-20 01:31:30.120635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.130 [2024-11-20 01:31:30.120659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.130 qpair failed and we were unable to recover it. 00:30:22.130 [2024-11-20 01:31:30.120752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.130 [2024-11-20 01:31:30.120838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.130 [2024-11-20 01:31:30.120863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.130 qpair failed and we were unable to recover it. 00:30:22.130 [2024-11-20 01:31:30.120982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.130 [2024-11-20 01:31:30.121078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.130 [2024-11-20 01:31:30.121104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.130 qpair failed and we were unable to recover it. 00:30:22.130 [2024-11-20 01:31:30.121187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.130 [2024-11-20 01:31:30.121280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.130 [2024-11-20 01:31:30.121305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.130 qpair failed and we were unable to recover it. 00:30:22.130 [2024-11-20 01:31:30.121423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.130 [2024-11-20 01:31:30.121517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.130 [2024-11-20 01:31:30.121542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.130 qpair failed and we were unable to recover it. 00:30:22.130 [2024-11-20 01:31:30.121629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.130 [2024-11-20 01:31:30.121742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.130 [2024-11-20 01:31:30.121766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.130 qpair failed and we were unable to recover it. 00:30:22.130 [2024-11-20 01:31:30.121860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.130 [2024-11-20 01:31:30.121971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.130 [2024-11-20 01:31:30.121995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.130 qpair failed and we were unable to recover it. 00:30:22.130 [2024-11-20 01:31:30.122094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.130 [2024-11-20 01:31:30.122202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.130 [2024-11-20 01:31:30.122228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.130 qpair failed and we were unable to recover it. 00:30:22.130 [2024-11-20 01:31:30.122313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.130 [2024-11-20 01:31:30.122455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.130 [2024-11-20 01:31:30.122479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.130 qpair failed and we were unable to recover it. 00:30:22.130 [2024-11-20 01:31:30.122598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.130 [2024-11-20 01:31:30.122714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.130 [2024-11-20 01:31:30.122741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.130 qpair failed and we were unable to recover it. 00:30:22.130 [2024-11-20 01:31:30.122835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.130 [2024-11-20 01:31:30.122946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.130 [2024-11-20 01:31:30.122970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.130 qpair failed and we were unable to recover it. 00:30:22.130 [2024-11-20 01:31:30.123093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.130 [2024-11-20 01:31:30.123215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.130 [2024-11-20 01:31:30.123240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.130 qpair failed and we were unable to recover it. 00:30:22.130 [2024-11-20 01:31:30.123342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.130 [2024-11-20 01:31:30.123483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.130 [2024-11-20 01:31:30.123507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.130 qpair failed and we were unable to recover it. 00:30:22.130 [2024-11-20 01:31:30.123595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.130 [2024-11-20 01:31:30.123686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.130 [2024-11-20 01:31:30.123710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.130 qpair failed and we were unable to recover it. 00:30:22.130 [2024-11-20 01:31:30.123841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.130 [2024-11-20 01:31:30.123929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.130 [2024-11-20 01:31:30.123954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.130 qpair failed and we were unable to recover it. 00:30:22.130 [2024-11-20 01:31:30.124048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.130 [2024-11-20 01:31:30.124202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.130 [2024-11-20 01:31:30.124226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.130 qpair failed and we were unable to recover it. 00:30:22.130 [2024-11-20 01:31:30.124346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.130 [2024-11-20 01:31:30.124439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.130 [2024-11-20 01:31:30.124463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.130 qpair failed and we were unable to recover it. 00:30:22.130 [2024-11-20 01:31:30.124576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.130 [2024-11-20 01:31:30.124668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.130 [2024-11-20 01:31:30.124692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.130 qpair failed and we were unable to recover it. 00:30:22.130 [2024-11-20 01:31:30.124785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.130 [2024-11-20 01:31:30.124865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.130 [2024-11-20 01:31:30.124888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.130 qpair failed and we were unable to recover it. 00:30:22.130 [2024-11-20 01:31:30.124981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.130 [2024-11-20 01:31:30.125126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.130 [2024-11-20 01:31:30.125152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.130 qpair failed and we were unable to recover it. 00:30:22.130 [2024-11-20 01:31:30.125246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.130 [2024-11-20 01:31:30.125333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.130 [2024-11-20 01:31:30.125357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.130 qpair failed and we were unable to recover it. 00:30:22.130 [2024-11-20 01:31:30.125450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.130 [2024-11-20 01:31:30.125566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.130 [2024-11-20 01:31:30.125592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.130 qpair failed and we were unable to recover it. 00:30:22.130 [2024-11-20 01:31:30.125683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.130 [2024-11-20 01:31:30.125809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.130 [2024-11-20 01:31:30.125833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.130 qpair failed and we were unable to recover it. 00:30:22.130 [2024-11-20 01:31:30.125949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.130 [2024-11-20 01:31:30.126060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.130 [2024-11-20 01:31:30.126096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.130 qpair failed and we were unable to recover it. 00:30:22.130 [2024-11-20 01:31:30.126191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.130 [2024-11-20 01:31:30.126334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.130 [2024-11-20 01:31:30.126359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.130 qpair failed and we were unable to recover it. 00:30:22.130 [2024-11-20 01:31:30.126477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.130 [2024-11-20 01:31:30.126562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.130 [2024-11-20 01:31:30.126587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.130 qpair failed and we were unable to recover it. 00:30:22.130 [2024-11-20 01:31:30.126708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.130 [2024-11-20 01:31:30.126852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.130 [2024-11-20 01:31:30.126876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.130 qpair failed and we were unable to recover it. 00:30:22.130 [2024-11-20 01:31:30.126995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.130 [2024-11-20 01:31:30.127114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.130 [2024-11-20 01:31:30.127140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.130 qpair failed and we were unable to recover it. 00:30:22.131 [2024-11-20 01:31:30.127234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.131 [2024-11-20 01:31:30.127322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.131 [2024-11-20 01:31:30.127346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.131 qpair failed and we were unable to recover it. 00:30:22.131 [2024-11-20 01:31:30.127460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.131 [2024-11-20 01:31:30.127553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.131 [2024-11-20 01:31:30.127577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.131 qpair failed and we were unable to recover it. 00:30:22.131 [2024-11-20 01:31:30.127694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.131 [2024-11-20 01:31:30.127784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.131 [2024-11-20 01:31:30.127810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.131 qpair failed and we were unable to recover it. 00:30:22.131 [2024-11-20 01:31:30.127931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.131 [2024-11-20 01:31:30.128051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.131 [2024-11-20 01:31:30.128085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.131 qpair failed and we were unable to recover it. 00:30:22.131 [2024-11-20 01:31:30.128232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.131 [2024-11-20 01:31:30.128365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.131 [2024-11-20 01:31:30.128393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.131 qpair failed and we were unable to recover it. 00:30:22.131 [2024-11-20 01:31:30.128492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.131 [2024-11-20 01:31:30.128638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.131 [2024-11-20 01:31:30.128663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.131 qpair failed and we were unable to recover it. 00:30:22.131 [2024-11-20 01:31:30.128781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.131 [2024-11-20 01:31:30.128869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.131 [2024-11-20 01:31:30.128895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.131 qpair failed and we were unable to recover it. 00:30:22.131 [2024-11-20 01:31:30.129046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.131 [2024-11-20 01:31:30.129170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.131 [2024-11-20 01:31:30.129196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.131 qpair failed and we were unable to recover it. 00:30:22.131 [2024-11-20 01:31:30.129283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.131 [2024-11-20 01:31:30.129423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.131 [2024-11-20 01:31:30.129451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.131 qpair failed and we were unable to recover it. 00:30:22.131 [2024-11-20 01:31:30.129578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.131 [2024-11-20 01:31:30.129678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.131 [2024-11-20 01:31:30.129708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.131 qpair failed and we were unable to recover it. 00:30:22.131 [2024-11-20 01:31:30.129839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.131 [2024-11-20 01:31:30.129974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.131 [2024-11-20 01:31:30.130000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.131 qpair failed and we were unable to recover it. 00:30:22.131 [2024-11-20 01:31:30.130085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.131 [2024-11-20 01:31:30.130201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.131 [2024-11-20 01:31:30.130225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.131 qpair failed and we were unable to recover it. 00:30:22.131 [2024-11-20 01:31:30.130335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.131 [2024-11-20 01:31:30.130466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.131 [2024-11-20 01:31:30.130495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.131 qpair failed and we were unable to recover it. 00:30:22.131 [2024-11-20 01:31:30.130651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.131 [2024-11-20 01:31:30.130811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.131 [2024-11-20 01:31:30.130839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.131 qpair failed and we were unable to recover it. 00:30:22.131 [2024-11-20 01:31:30.130957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.131 [2024-11-20 01:31:30.131084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.131 [2024-11-20 01:31:30.131111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.131 qpair failed and we were unable to recover it. 00:30:22.131 [2024-11-20 01:31:30.131227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.131 [2024-11-20 01:31:30.131343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.131 [2024-11-20 01:31:30.131368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.131 qpair failed and we were unable to recover it. 00:30:22.131 [2024-11-20 01:31:30.131478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.131 [2024-11-20 01:31:30.131603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.131 [2024-11-20 01:31:30.131631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.131 qpair failed and we were unable to recover it. 00:30:22.131 [2024-11-20 01:31:30.131729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.131 [2024-11-20 01:31:30.131821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.131 [2024-11-20 01:31:30.131849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.131 qpair failed and we were unable to recover it. 00:30:22.131 [2024-11-20 01:31:30.132002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.131 [2024-11-20 01:31:30.132097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.131 [2024-11-20 01:31:30.132139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.131 qpair failed and we were unable to recover it. 00:30:22.131 [2024-11-20 01:31:30.132261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.131 [2024-11-20 01:31:30.132382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.131 [2024-11-20 01:31:30.132407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.131 qpair failed and we were unable to recover it. 00:30:22.131 [2024-11-20 01:31:30.132549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.131 [2024-11-20 01:31:30.132679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.131 [2024-11-20 01:31:30.132707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.131 qpair failed and we were unable to recover it. 00:30:22.131 [2024-11-20 01:31:30.132834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.131 [2024-11-20 01:31:30.132966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.131 [2024-11-20 01:31:30.132994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.131 qpair failed and we were unable to recover it. 00:30:22.131 [2024-11-20 01:31:30.133099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.131 [2024-11-20 01:31:30.133182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.131 [2024-11-20 01:31:30.133208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.131 qpair failed and we were unable to recover it. 00:30:22.131 [2024-11-20 01:31:30.133326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.131 [2024-11-20 01:31:30.133482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.131 [2024-11-20 01:31:30.133507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.131 qpair failed and we were unable to recover it. 00:30:22.131 [2024-11-20 01:31:30.133658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.131 [2024-11-20 01:31:30.133757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.131 [2024-11-20 01:31:30.133785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.131 qpair failed and we were unable to recover it. 00:30:22.131 [2024-11-20 01:31:30.133939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.131 [2024-11-20 01:31:30.134099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.131 [2024-11-20 01:31:30.134140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.131 qpair failed and we were unable to recover it. 00:30:22.131 [2024-11-20 01:31:30.134228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.131 [2024-11-20 01:31:30.134315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.131 [2024-11-20 01:31:30.134340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.131 qpair failed and we were unable to recover it. 00:30:22.131 [2024-11-20 01:31:30.134452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.131 [2024-11-20 01:31:30.134580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.131 [2024-11-20 01:31:30.134608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.131 qpair failed and we were unable to recover it. 00:30:22.131 [2024-11-20 01:31:30.134708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.132 [2024-11-20 01:31:30.134829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.132 [2024-11-20 01:31:30.134857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.132 qpair failed and we were unable to recover it. 00:30:22.132 [2024-11-20 01:31:30.134979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.132 [2024-11-20 01:31:30.135124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.132 [2024-11-20 01:31:30.135150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.132 qpair failed and we were unable to recover it. 00:30:22.132 [2024-11-20 01:31:30.135266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.132 [2024-11-20 01:31:30.135399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.132 [2024-11-20 01:31:30.135428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.132 qpair failed and we were unable to recover it. 00:30:22.132 [2024-11-20 01:31:30.135533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.132 [2024-11-20 01:31:30.135694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.132 [2024-11-20 01:31:30.135737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.132 qpair failed and we were unable to recover it. 00:30:22.132 [2024-11-20 01:31:30.135840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.132 [2024-11-20 01:31:30.135942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.132 [2024-11-20 01:31:30.135969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.132 qpair failed and we were unable to recover it. 00:30:22.132 [2024-11-20 01:31:30.136064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.132 [2024-11-20 01:31:30.136201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.132 [2024-11-20 01:31:30.136227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.132 qpair failed and we were unable to recover it. 00:30:22.132 [2024-11-20 01:31:30.136384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.132 [2024-11-20 01:31:30.136518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.132 [2024-11-20 01:31:30.136547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.132 qpair failed and we were unable to recover it. 00:30:22.132 [2024-11-20 01:31:30.136672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.132 [2024-11-20 01:31:30.136797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.132 [2024-11-20 01:31:30.136825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.132 qpair failed and we were unable to recover it. 00:30:22.132 [2024-11-20 01:31:30.136915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.132 [2024-11-20 01:31:30.137065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.132 [2024-11-20 01:31:30.137116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.132 qpair failed and we were unable to recover it. 00:30:22.132 [2024-11-20 01:31:30.137199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.132 [2024-11-20 01:31:30.137319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.132 [2024-11-20 01:31:30.137344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.132 qpair failed and we were unable to recover it. 00:30:22.132 [2024-11-20 01:31:30.137487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.132 [2024-11-20 01:31:30.137609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.132 [2024-11-20 01:31:30.137637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.132 qpair failed and we were unable to recover it. 00:30:22.132 [2024-11-20 01:31:30.137771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.132 [2024-11-20 01:31:30.137942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.132 [2024-11-20 01:31:30.137966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.132 qpair failed and we were unable to recover it. 00:30:22.132 [2024-11-20 01:31:30.138053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.132 [2024-11-20 01:31:30.138178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.132 [2024-11-20 01:31:30.138203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.132 qpair failed and we were unable to recover it. 00:30:22.132 [2024-11-20 01:31:30.138313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.132 [2024-11-20 01:31:30.138404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.132 [2024-11-20 01:31:30.138429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.132 qpair failed and we were unable to recover it. 00:30:22.132 [2024-11-20 01:31:30.138518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.132 [2024-11-20 01:31:30.138633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.132 [2024-11-20 01:31:30.138659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.132 qpair failed and we were unable to recover it. 00:30:22.132 [2024-11-20 01:31:30.138827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.132 [2024-11-20 01:31:30.138964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.132 [2024-11-20 01:31:30.138990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.132 qpair failed and we were unable to recover it. 00:30:22.132 [2024-11-20 01:31:30.139131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.132 [2024-11-20 01:31:30.139217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.132 [2024-11-20 01:31:30.139247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.132 qpair failed and we were unable to recover it. 00:30:22.132 [2024-11-20 01:31:30.139412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.132 [2024-11-20 01:31:30.139507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.132 [2024-11-20 01:31:30.139535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.132 qpair failed and we were unable to recover it. 00:30:22.132 [2024-11-20 01:31:30.139646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.132 [2024-11-20 01:31:30.139765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.132 [2024-11-20 01:31:30.139790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.132 qpair failed and we were unable to recover it. 00:30:22.132 [2024-11-20 01:31:30.139901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.132 [2024-11-20 01:31:30.140039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.132 [2024-11-20 01:31:30.140067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.132 qpair failed and we were unable to recover it. 00:30:22.132 [2024-11-20 01:31:30.140230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.132 [2024-11-20 01:31:30.140382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.132 [2024-11-20 01:31:30.140414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.132 qpair failed and we were unable to recover it. 00:30:22.132 [2024-11-20 01:31:30.140533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.132 [2024-11-20 01:31:30.140649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.132 [2024-11-20 01:31:30.140674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.132 qpair failed and we were unable to recover it. 00:30:22.132 [2024-11-20 01:31:30.140795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.132 [2024-11-20 01:31:30.140911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.132 [2024-11-20 01:31:30.140936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.132 qpair failed and we were unable to recover it. 00:30:22.132 [2024-11-20 01:31:30.141057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.132 [2024-11-20 01:31:30.141206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.132 [2024-11-20 01:31:30.141234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.132 qpair failed and we were unable to recover it. 00:30:22.132 [2024-11-20 01:31:30.141370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.132 [2024-11-20 01:31:30.141461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.132 [2024-11-20 01:31:30.141488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.133 qpair failed and we were unable to recover it. 00:30:22.133 [2024-11-20 01:31:30.141617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.133 [2024-11-20 01:31:30.141732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.133 [2024-11-20 01:31:30.141758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.133 qpair failed and we were unable to recover it. 00:30:22.133 [2024-11-20 01:31:30.141879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.133 [2024-11-20 01:31:30.142045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.133 [2024-11-20 01:31:30.142092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.133 qpair failed and we were unable to recover it. 00:30:22.133 [2024-11-20 01:31:30.142210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.133 [2024-11-20 01:31:30.142332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.133 [2024-11-20 01:31:30.142357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.133 qpair failed and we were unable to recover it. 00:30:22.133 [2024-11-20 01:31:30.142486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.133 [2024-11-20 01:31:30.142593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.133 [2024-11-20 01:31:30.142620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.133 qpair failed and we were unable to recover it. 00:30:22.133 [2024-11-20 01:31:30.142753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.133 [2024-11-20 01:31:30.142881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.133 [2024-11-20 01:31:30.142908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.133 qpair failed and we were unable to recover it. 00:30:22.133 [2024-11-20 01:31:30.143030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.133 [2024-11-20 01:31:30.143148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.133 [2024-11-20 01:31:30.143178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.133 qpair failed and we were unable to recover it. 00:30:22.133 [2024-11-20 01:31:30.143295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.133 [2024-11-20 01:31:30.143383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.133 [2024-11-20 01:31:30.143407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.133 qpair failed and we were unable to recover it. 00:30:22.133 [2024-11-20 01:31:30.143525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.133 [2024-11-20 01:31:30.143704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.133 [2024-11-20 01:31:30.143728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.133 qpair failed and we were unable to recover it. 00:30:22.133 [2024-11-20 01:31:30.143875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.133 [2024-11-20 01:31:30.143961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.133 [2024-11-20 01:31:30.144003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.133 qpair failed and we were unable to recover it. 00:30:22.133 [2024-11-20 01:31:30.144141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.133 [2024-11-20 01:31:30.144271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.133 [2024-11-20 01:31:30.144300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.133 qpair failed and we were unable to recover it. 00:30:22.133 [2024-11-20 01:31:30.144436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.133 [2024-11-20 01:31:30.144551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.133 [2024-11-20 01:31:30.144576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.133 qpair failed and we were unable to recover it. 00:30:22.133 [2024-11-20 01:31:30.144673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.133 [2024-11-20 01:31:30.144761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.133 [2024-11-20 01:31:30.144791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.133 qpair failed and we were unable to recover it. 00:30:22.133 [2024-11-20 01:31:30.144907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.133 [2024-11-20 01:31:30.145025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.133 [2024-11-20 01:31:30.145076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.133 qpair failed and we were unable to recover it. 00:30:22.133 [2024-11-20 01:31:30.145213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.133 [2024-11-20 01:31:30.145309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.133 [2024-11-20 01:31:30.145337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.133 qpair failed and we were unable to recover it. 00:30:22.133 [2024-11-20 01:31:30.145455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.133 [2024-11-20 01:31:30.145552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.133 [2024-11-20 01:31:30.145576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.133 qpair failed and we were unable to recover it. 00:30:22.133 [2024-11-20 01:31:30.145693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.133 [2024-11-20 01:31:30.145825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.133 [2024-11-20 01:31:30.145852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.133 qpair failed and we were unable to recover it. 00:30:22.133 [2024-11-20 01:31:30.145994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.133 [2024-11-20 01:31:30.146110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.133 [2024-11-20 01:31:30.146136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.133 qpair failed and we were unable to recover it. 00:30:22.133 [2024-11-20 01:31:30.146255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.133 [2024-11-20 01:31:30.146375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.133 [2024-11-20 01:31:30.146401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.133 qpair failed and we were unable to recover it. 00:30:22.133 [2024-11-20 01:31:30.146518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.133 [2024-11-20 01:31:30.146637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.133 [2024-11-20 01:31:30.146663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.133 qpair failed and we were unable to recover it. 00:30:22.133 [2024-11-20 01:31:30.146754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.133 [2024-11-20 01:31:30.146886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.133 [2024-11-20 01:31:30.146913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.133 qpair failed and we were unable to recover it. 00:30:22.133 [2024-11-20 01:31:30.147078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.133 [2024-11-20 01:31:30.147215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.133 [2024-11-20 01:31:30.147240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.133 qpair failed and we were unable to recover it. 00:30:22.133 [2024-11-20 01:31:30.147330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.133 [2024-11-20 01:31:30.147416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.133 [2024-11-20 01:31:30.147447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.133 qpair failed and we were unable to recover it. 00:30:22.133 [2024-11-20 01:31:30.147564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.133 [2024-11-20 01:31:30.147689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.133 [2024-11-20 01:31:30.147713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.133 qpair failed and we were unable to recover it. 00:30:22.133 [2024-11-20 01:31:30.147803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.133 [2024-11-20 01:31:30.147893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.133 [2024-11-20 01:31:30.147917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.133 qpair failed and we were unable to recover it. 00:30:22.133 [2024-11-20 01:31:30.148030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.133 [2024-11-20 01:31:30.148144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.133 [2024-11-20 01:31:30.148173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.133 qpair failed and we were unable to recover it. 00:30:22.133 [2024-11-20 01:31:30.148318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.133 [2024-11-20 01:31:30.148431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.133 [2024-11-20 01:31:30.148455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.133 qpair failed and we were unable to recover it. 00:30:22.133 [2024-11-20 01:31:30.148573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.133 [2024-11-20 01:31:30.148662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.133 [2024-11-20 01:31:30.148688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.133 qpair failed and we were unable to recover it. 00:30:22.133 [2024-11-20 01:31:30.148783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.133 [2024-11-20 01:31:30.148902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.133 [2024-11-20 01:31:30.148926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.133 qpair failed and we were unable to recover it. 00:30:22.134 [2024-11-20 01:31:30.149014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-20 01:31:30.149105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-20 01:31:30.149131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.134 qpair failed and we were unable to recover it. 00:30:22.134 [2024-11-20 01:31:30.149223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-20 01:31:30.149308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-20 01:31:30.149334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.134 qpair failed and we were unable to recover it. 00:30:22.134 [2024-11-20 01:31:30.149443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-20 01:31:30.149565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-20 01:31:30.149589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.134 qpair failed and we were unable to recover it. 00:30:22.134 [2024-11-20 01:31:30.149700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-20 01:31:30.149842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-20 01:31:30.149867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.134 qpair failed and we were unable to recover it. 00:30:22.134 [2024-11-20 01:31:30.150019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-20 01:31:30.150138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-20 01:31:30.150166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.134 qpair failed and we were unable to recover it. 00:30:22.134 [2024-11-20 01:31:30.150300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-20 01:31:30.150426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-20 01:31:30.150451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.134 qpair failed and we were unable to recover it. 00:30:22.134 [2024-11-20 01:31:30.150568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-20 01:31:30.150684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-20 01:31:30.150709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.134 qpair failed and we were unable to recover it. 00:30:22.134 [2024-11-20 01:31:30.150795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-20 01:31:30.150908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-20 01:31:30.150932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.134 qpair failed and we were unable to recover it. 00:30:22.134 [2024-11-20 01:31:30.151093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-20 01:31:30.151193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-20 01:31:30.151221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.134 qpair failed and we were unable to recover it. 00:30:22.134 [2024-11-20 01:31:30.151361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-20 01:31:30.151506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-20 01:31:30.151531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.134 qpair failed and we were unable to recover it. 00:30:22.134 [2024-11-20 01:31:30.151652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-20 01:31:30.151744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-20 01:31:30.151769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.134 qpair failed and we were unable to recover it. 00:30:22.134 [2024-11-20 01:31:30.151908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-20 01:31:30.152033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-20 01:31:30.152061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.134 qpair failed and we were unable to recover it. 00:30:22.134 [2024-11-20 01:31:30.152206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-20 01:31:30.152301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-20 01:31:30.152326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.134 qpair failed and we were unable to recover it. 00:30:22.134 [2024-11-20 01:31:30.152437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-20 01:31:30.152557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-20 01:31:30.152583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.134 qpair failed and we were unable to recover it. 00:30:22.134 [2024-11-20 01:31:30.152741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-20 01:31:30.152857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-20 01:31:30.152897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.134 qpair failed and we were unable to recover it. 00:30:22.134 [2024-11-20 01:31:30.152991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-20 01:31:30.153092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-20 01:31:30.153136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.134 qpair failed and we were unable to recover it. 00:30:22.134 [2024-11-20 01:31:30.153260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-20 01:31:30.153349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-20 01:31:30.153375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.134 qpair failed and we were unable to recover it. 00:30:22.134 [2024-11-20 01:31:30.153495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-20 01:31:30.153578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-20 01:31:30.153602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.134 qpair failed and we were unable to recover it. 00:30:22.134 [2024-11-20 01:31:30.153721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-20 01:31:30.153808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-20 01:31:30.153834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.134 qpair failed and we were unable to recover it. 00:30:22.134 [2024-11-20 01:31:30.153974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-20 01:31:30.154064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-20 01:31:30.154110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.134 qpair failed and we were unable to recover it. 00:30:22.134 [2024-11-20 01:31:30.154239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-20 01:31:30.154373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-20 01:31:30.154397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.134 qpair failed and we were unable to recover it. 00:30:22.134 [2024-11-20 01:31:30.154489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-20 01:31:30.154603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-20 01:31:30.154627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.134 qpair failed and we were unable to recover it. 00:30:22.134 [2024-11-20 01:31:30.154741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-20 01:31:30.154828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-20 01:31:30.154852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.134 qpair failed and we were unable to recover it. 00:30:22.134 [2024-11-20 01:31:30.154946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-20 01:31:30.155090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-20 01:31:30.155115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.134 qpair failed and we were unable to recover it. 00:30:22.134 [2024-11-20 01:31:30.155259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-20 01:31:30.155397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-20 01:31:30.155426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.134 qpair failed and we were unable to recover it. 00:30:22.134 [2024-11-20 01:31:30.155551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-20 01:31:30.155668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-20 01:31:30.155694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.134 qpair failed and we were unable to recover it. 00:30:22.134 [2024-11-20 01:31:30.155779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-20 01:31:30.155890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-20 01:31:30.155915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.134 qpair failed and we were unable to recover it. 00:30:22.134 [2024-11-20 01:31:30.156081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-20 01:31:30.156200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-20 01:31:30.156228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.134 qpair failed and we were unable to recover it. 00:30:22.134 [2024-11-20 01:31:30.156350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-20 01:31:30.156480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-20 01:31:30.156504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.135 qpair failed and we were unable to recover it. 00:30:22.135 [2024-11-20 01:31:30.156625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-20 01:31:30.156741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-20 01:31:30.156765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.135 qpair failed and we were unable to recover it. 00:30:22.135 [2024-11-20 01:31:30.156875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-20 01:31:30.156989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-20 01:31:30.157014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.135 qpair failed and we were unable to recover it. 00:30:22.135 [2024-11-20 01:31:30.157132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-20 01:31:30.157221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-20 01:31:30.157247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.135 qpair failed and we were unable to recover it. 00:30:22.135 [2024-11-20 01:31:30.157338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-20 01:31:30.157428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-20 01:31:30.157468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.135 qpair failed and we were unable to recover it. 00:30:22.135 [2024-11-20 01:31:30.157637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-20 01:31:30.157749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-20 01:31:30.157774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.135 qpair failed and we were unable to recover it. 00:30:22.135 [2024-11-20 01:31:30.157941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-20 01:31:30.158061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-20 01:31:30.158094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.135 qpair failed and we were unable to recover it. 00:30:22.135 [2024-11-20 01:31:30.158205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-20 01:31:30.158363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-20 01:31:30.158388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.135 qpair failed and we were unable to recover it. 00:30:22.135 [2024-11-20 01:31:30.158552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-20 01:31:30.158690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-20 01:31:30.158715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.135 qpair failed and we were unable to recover it. 00:30:22.135 [2024-11-20 01:31:30.158832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-20 01:31:30.158949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-20 01:31:30.158973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.135 qpair failed and we were unable to recover it. 00:30:22.135 [2024-11-20 01:31:30.159119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-20 01:31:30.159208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-20 01:31:30.159232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.135 qpair failed and we were unable to recover it. 00:30:22.135 [2024-11-20 01:31:30.159321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-20 01:31:30.159438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-20 01:31:30.159463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.135 qpair failed and we were unable to recover it. 00:30:22.135 [2024-11-20 01:31:30.159617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-20 01:31:30.159746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-20 01:31:30.159773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.135 qpair failed and we were unable to recover it. 00:30:22.135 [2024-11-20 01:31:30.159882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-20 01:31:30.159994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-20 01:31:30.160019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.135 qpair failed and we were unable to recover it. 00:30:22.135 [2024-11-20 01:31:30.160133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-20 01:31:30.160227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-20 01:31:30.160252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.135 qpair failed and we were unable to recover it. 00:30:22.135 [2024-11-20 01:31:30.160338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-20 01:31:30.160449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-20 01:31:30.160474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.135 qpair failed and we were unable to recover it. 00:30:22.135 [2024-11-20 01:31:30.160598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-20 01:31:30.160719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-20 01:31:30.160744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.135 qpair failed and we were unable to recover it. 00:30:22.135 [2024-11-20 01:31:30.160825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-20 01:31:30.160940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-20 01:31:30.160965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.135 qpair failed and we were unable to recover it. 00:30:22.135 [2024-11-20 01:31:30.161084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-20 01:31:30.161166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-20 01:31:30.161191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.135 qpair failed and we were unable to recover it. 00:30:22.135 [2024-11-20 01:31:30.161358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-20 01:31:30.161461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-20 01:31:30.161503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.135 qpair failed and we were unable to recover it. 00:30:22.135 [2024-11-20 01:31:30.161635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-20 01:31:30.161743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-20 01:31:30.161767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.135 qpair failed and we were unable to recover it. 00:30:22.135 [2024-11-20 01:31:30.161880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-20 01:31:30.161991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-20 01:31:30.162015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.135 qpair failed and we were unable to recover it. 00:30:22.135 [2024-11-20 01:31:30.162109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-20 01:31:30.162199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-20 01:31:30.162225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.135 qpair failed and we were unable to recover it. 00:30:22.135 [2024-11-20 01:31:30.162309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-20 01:31:30.162426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-20 01:31:30.162452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.135 qpair failed and we were unable to recover it. 00:30:22.135 [2024-11-20 01:31:30.162559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-20 01:31:30.162684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-20 01:31:30.162713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.135 qpair failed and we were unable to recover it. 00:30:22.135 [2024-11-20 01:31:30.162836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-20 01:31:30.162949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-20 01:31:30.162974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.135 qpair failed and we were unable to recover it. 00:30:22.135 [2024-11-20 01:31:30.163097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-20 01:31:30.163179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-20 01:31:30.163205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.135 qpair failed and we were unable to recover it. 00:30:22.135 [2024-11-20 01:31:30.163294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-20 01:31:30.163417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-20 01:31:30.163459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.135 qpair failed and we were unable to recover it. 00:30:22.135 [2024-11-20 01:31:30.163582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-20 01:31:30.163703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-20 01:31:30.163731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.136 qpair failed and we were unable to recover it. 00:30:22.136 [2024-11-20 01:31:30.163844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-20 01:31:30.163951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-20 01:31:30.163975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.136 qpair failed and we were unable to recover it. 00:30:22.136 [2024-11-20 01:31:30.164084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-20 01:31:30.164166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-20 01:31:30.164190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.136 qpair failed and we were unable to recover it. 00:30:22.136 [2024-11-20 01:31:30.164327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-20 01:31:30.164458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-20 01:31:30.164487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.136 qpair failed and we were unable to recover it. 00:30:22.136 [2024-11-20 01:31:30.164616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-20 01:31:30.164743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-20 01:31:30.164771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.136 qpair failed and we were unable to recover it. 00:30:22.136 [2024-11-20 01:31:30.164917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-20 01:31:30.165033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-20 01:31:30.165059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.136 qpair failed and we were unable to recover it. 00:30:22.136 [2024-11-20 01:31:30.165191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-20 01:31:30.165301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-20 01:31:30.165326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.136 qpair failed and we were unable to recover it. 00:30:22.136 [2024-11-20 01:31:30.165505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-20 01:31:30.165625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-20 01:31:30.165652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.136 qpair failed and we were unable to recover it. 00:30:22.136 [2024-11-20 01:31:30.165753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-20 01:31:30.165895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-20 01:31:30.165920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.136 qpair failed and we were unable to recover it. 00:30:22.136 [2024-11-20 01:31:30.166005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-20 01:31:30.166127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-20 01:31:30.166153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.136 qpair failed and we were unable to recover it. 00:30:22.136 [2024-11-20 01:31:30.166284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-20 01:31:30.166427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-20 01:31:30.166468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.136 qpair failed and we were unable to recover it. 00:30:22.136 [2024-11-20 01:31:30.166579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-20 01:31:30.166707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-20 01:31:30.166734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.136 qpair failed and we were unable to recover it. 00:30:22.136 [2024-11-20 01:31:30.166880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-20 01:31:30.167029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-20 01:31:30.167053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.136 qpair failed and we were unable to recover it. 00:30:22.136 [2024-11-20 01:31:30.167147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-20 01:31:30.167266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-20 01:31:30.167290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.136 qpair failed and we were unable to recover it. 00:30:22.136 [2024-11-20 01:31:30.167411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-20 01:31:30.167556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-20 01:31:30.167581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.136 qpair failed and we were unable to recover it. 00:30:22.136 [2024-11-20 01:31:30.167734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-20 01:31:30.167826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-20 01:31:30.167853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.136 qpair failed and we were unable to recover it. 00:30:22.136 [2024-11-20 01:31:30.167997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-20 01:31:30.168097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-20 01:31:30.168122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.136 qpair failed and we were unable to recover it. 00:30:22.136 [2024-11-20 01:31:30.168217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-20 01:31:30.168299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-20 01:31:30.168324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.136 qpair failed and we were unable to recover it. 00:30:22.136 [2024-11-20 01:31:30.168465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-20 01:31:30.168622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-20 01:31:30.168667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.136 qpair failed and we were unable to recover it. 00:30:22.136 [2024-11-20 01:31:30.168808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-20 01:31:30.168943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-20 01:31:30.168969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.136 qpair failed and we were unable to recover it. 00:30:22.136 [2024-11-20 01:31:30.169095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-20 01:31:30.169178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-20 01:31:30.169203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.136 qpair failed and we were unable to recover it. 00:30:22.136 [2024-11-20 01:31:30.169317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-20 01:31:30.169436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-20 01:31:30.169461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.136 qpair failed and we were unable to recover it. 00:30:22.136 [2024-11-20 01:31:30.169582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-20 01:31:30.169725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-20 01:31:30.169750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.136 qpair failed and we were unable to recover it. 00:30:22.136 [2024-11-20 01:31:30.169835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-20 01:31:30.169914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-20 01:31:30.169939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.136 qpair failed and we were unable to recover it. 00:30:22.136 [2024-11-20 01:31:30.170062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-20 01:31:30.170158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-20 01:31:30.170182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.136 qpair failed and we were unable to recover it. 00:30:22.136 [2024-11-20 01:31:30.170294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-20 01:31:30.170410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-20 01:31:30.170436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.136 qpair failed and we were unable to recover it. 00:30:22.136 [2024-11-20 01:31:30.170551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-20 01:31:30.170637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-20 01:31:30.170661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.136 qpair failed and we were unable to recover it. 00:30:22.136 [2024-11-20 01:31:30.170776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.137 [2024-11-20 01:31:30.170888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.137 [2024-11-20 01:31:30.170912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.137 qpair failed and we were unable to recover it. 00:30:22.137 [2024-11-20 01:31:30.171030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.137 [2024-11-20 01:31:30.171124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.137 [2024-11-20 01:31:30.171149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.137 qpair failed and we were unable to recover it. 00:30:22.137 [2024-11-20 01:31:30.171266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.137 [2024-11-20 01:31:30.171354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.137 [2024-11-20 01:31:30.171378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.137 qpair failed and we were unable to recover it. 00:30:22.137 [2024-11-20 01:31:30.171494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.137 [2024-11-20 01:31:30.171608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.137 [2024-11-20 01:31:30.171634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.137 qpair failed and we were unable to recover it. 00:30:22.137 [2024-11-20 01:31:30.171750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.137 [2024-11-20 01:31:30.171897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.137 [2024-11-20 01:31:30.171921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.137 qpair failed and we were unable to recover it. 00:30:22.137 [2024-11-20 01:31:30.172039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.137 [2024-11-20 01:31:30.172135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.137 [2024-11-20 01:31:30.172160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.137 qpair failed and we were unable to recover it. 00:30:22.137 [2024-11-20 01:31:30.172284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.137 [2024-11-20 01:31:30.172374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.137 [2024-11-20 01:31:30.172399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.137 qpair failed and we were unable to recover it. 00:30:22.137 [2024-11-20 01:31:30.172485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.137 [2024-11-20 01:31:30.172595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.137 [2024-11-20 01:31:30.172620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.137 qpair failed and we were unable to recover it. 00:30:22.137 [2024-11-20 01:31:30.172705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.137 [2024-11-20 01:31:30.172829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.137 [2024-11-20 01:31:30.172853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.137 qpair failed and we were unable to recover it. 00:30:22.137 [2024-11-20 01:31:30.172940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.137 [2024-11-20 01:31:30.173022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.137 [2024-11-20 01:31:30.173047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.137 qpair failed and we were unable to recover it. 00:30:22.137 [2024-11-20 01:31:30.173098] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x948e00 (9): Bad file descriptor 00:30:22.137 [2024-11-20 01:31:30.173259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.137 [2024-11-20 01:31:30.173395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.137 [2024-11-20 01:31:30.173423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.137 qpair failed and we were unable to recover it. 00:30:22.137 [2024-11-20 01:31:30.173559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.137 [2024-11-20 01:31:30.173675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.137 [2024-11-20 01:31:30.173700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.137 qpair failed and we were unable to recover it. 00:30:22.137 [2024-11-20 01:31:30.173800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.137 [2024-11-20 01:31:30.173896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.137 [2024-11-20 01:31:30.173922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.137 qpair failed and we were unable to recover it. 00:30:22.137 [2024-11-20 01:31:30.174039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.137 [2024-11-20 01:31:30.174141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.137 [2024-11-20 01:31:30.174168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.137 qpair failed and we were unable to recover it. 00:30:22.137 [2024-11-20 01:31:30.174263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.137 [2024-11-20 01:31:30.174374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.137 [2024-11-20 01:31:30.174399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.137 qpair failed and we were unable to recover it. 00:30:22.137 [2024-11-20 01:31:30.174534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.137 [2024-11-20 01:31:30.174665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.137 [2024-11-20 01:31:30.174692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.137 qpair failed and we were unable to recover it. 00:30:22.137 [2024-11-20 01:31:30.174800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.137 [2024-11-20 01:31:30.174944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.137 [2024-11-20 01:31:30.174970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.137 qpair failed and we were unable to recover it. 00:30:22.137 [2024-11-20 01:31:30.175079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.137 [2024-11-20 01:31:30.175193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.137 [2024-11-20 01:31:30.175218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.137 qpair failed and we were unable to recover it. 00:30:22.137 [2024-11-20 01:31:30.175318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.137 [2024-11-20 01:31:30.175460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.137 [2024-11-20 01:31:30.175487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.137 qpair failed and we were unable to recover it. 00:30:22.137 [2024-11-20 01:31:30.175618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.137 [2024-11-20 01:31:30.175715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.137 [2024-11-20 01:31:30.175743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.137 qpair failed and we were unable to recover it. 00:30:22.137 [2024-11-20 01:31:30.175874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.137 [2024-11-20 01:31:30.175964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.137 [2024-11-20 01:31:30.175992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.137 qpair failed and we were unable to recover it. 00:30:22.137 [2024-11-20 01:31:30.176118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.137 [2024-11-20 01:31:30.176207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.137 [2024-11-20 01:31:30.176232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.137 qpair failed and we were unable to recover it. 00:30:22.137 [2024-11-20 01:31:30.176321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.137 [2024-11-20 01:31:30.176434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.137 [2024-11-20 01:31:30.176458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.137 qpair failed and we were unable to recover it. 00:30:22.138 [2024-11-20 01:31:30.176562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.138 [2024-11-20 01:31:30.176696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.138 [2024-11-20 01:31:30.176723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.138 qpair failed and we were unable to recover it. 00:30:22.138 [2024-11-20 01:31:30.176855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.138 [2024-11-20 01:31:30.176942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.138 [2024-11-20 01:31:30.176968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.138 qpair failed and we were unable to recover it. 00:30:22.138 [2024-11-20 01:31:30.177076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.138 [2024-11-20 01:31:30.177167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.138 [2024-11-20 01:31:30.177192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.138 qpair failed and we were unable to recover it. 00:30:22.138 [2024-11-20 01:31:30.177309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.138 [2024-11-20 01:31:30.177420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.138 [2024-11-20 01:31:30.177451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.138 qpair failed and we were unable to recover it. 00:30:22.138 [2024-11-20 01:31:30.177587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.138 [2024-11-20 01:31:30.177714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.138 [2024-11-20 01:31:30.177756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.138 qpair failed and we were unable to recover it. 00:30:22.138 [2024-11-20 01:31:30.177874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.138 [2024-11-20 01:31:30.177987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.138 [2024-11-20 01:31:30.178026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.138 qpair failed and we were unable to recover it. 00:30:22.138 [2024-11-20 01:31:30.178117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.138 [2024-11-20 01:31:30.178234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.138 [2024-11-20 01:31:30.178259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.138 qpair failed and we were unable to recover it. 00:30:22.138 [2024-11-20 01:31:30.178398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.138 [2024-11-20 01:31:30.178521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.138 [2024-11-20 01:31:30.178549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.138 qpair failed and we were unable to recover it. 00:30:22.138 [2024-11-20 01:31:30.178653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.138 [2024-11-20 01:31:30.178739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.138 [2024-11-20 01:31:30.178767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.138 qpair failed and we were unable to recover it. 00:30:22.138 [2024-11-20 01:31:30.178888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.138 [2024-11-20 01:31:30.179005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.138 [2024-11-20 01:31:30.179032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.138 qpair failed and we were unable to recover it. 00:30:22.138 [2024-11-20 01:31:30.179214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.138 [2024-11-20 01:31:30.179338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.138 [2024-11-20 01:31:30.179380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.138 qpair failed and we were unable to recover it. 00:30:22.138 [2024-11-20 01:31:30.179484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.138 [2024-11-20 01:31:30.179590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.138 [2024-11-20 01:31:30.179617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.138 qpair failed and we were unable to recover it. 00:30:22.138 [2024-11-20 01:31:30.179731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.138 [2024-11-20 01:31:30.179838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.138 [2024-11-20 01:31:30.179867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.138 qpair failed and we were unable to recover it. 00:30:22.138 [2024-11-20 01:31:30.179976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.138 [2024-11-20 01:31:30.180065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.138 [2024-11-20 01:31:30.180101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.138 qpair failed and we were unable to recover it. 00:30:22.138 [2024-11-20 01:31:30.180220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.138 [2024-11-20 01:31:30.180303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.138 [2024-11-20 01:31:30.180327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.138 qpair failed and we were unable to recover it. 00:30:22.138 [2024-11-20 01:31:30.180424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.138 [2024-11-20 01:31:30.180544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.138 [2024-11-20 01:31:30.180588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.138 qpair failed and we were unable to recover it. 00:30:22.138 [2024-11-20 01:31:30.180721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.138 [2024-11-20 01:31:30.180844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.138 [2024-11-20 01:31:30.180871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.138 qpair failed and we were unable to recover it. 00:30:22.138 [2024-11-20 01:31:30.181003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.138 [2024-11-20 01:31:30.181123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.138 [2024-11-20 01:31:30.181149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.138 qpair failed and we were unable to recover it. 00:30:22.138 [2024-11-20 01:31:30.181269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.138 [2024-11-20 01:31:30.181393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.138 [2024-11-20 01:31:30.181437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.138 qpair failed and we were unable to recover it. 00:30:22.138 [2024-11-20 01:31:30.181584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.138 [2024-11-20 01:31:30.181728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.138 [2024-11-20 01:31:30.181756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.138 qpair failed and we were unable to recover it. 00:30:22.138 [2024-11-20 01:31:30.181868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.138 [2024-11-20 01:31:30.182008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.138 [2024-11-20 01:31:30.182036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.138 qpair failed and we were unable to recover it. 00:30:22.138 [2024-11-20 01:31:30.182164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.138 [2024-11-20 01:31:30.182287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.138 [2024-11-20 01:31:30.182312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.138 qpair failed and we were unable to recover it. 00:30:22.138 [2024-11-20 01:31:30.182393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.138 [2024-11-20 01:31:30.182485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.138 [2024-11-20 01:31:30.182510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.138 qpair failed and we were unable to recover it. 00:30:22.138 [2024-11-20 01:31:30.182623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.138 [2024-11-20 01:31:30.182750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.138 [2024-11-20 01:31:30.182777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.138 qpair failed and we were unable to recover it. 00:30:22.138 [2024-11-20 01:31:30.182876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.138 [2024-11-20 01:31:30.182965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.138 [2024-11-20 01:31:30.182992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.138 qpair failed and we were unable to recover it. 00:30:22.138 [2024-11-20 01:31:30.183136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.138 [2024-11-20 01:31:30.183228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.138 [2024-11-20 01:31:30.183253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.138 qpair failed and we were unable to recover it. 00:30:22.138 [2024-11-20 01:31:30.183370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.138 [2024-11-20 01:31:30.183488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.138 [2024-11-20 01:31:30.183512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.138 qpair failed and we were unable to recover it. 00:30:22.138 [2024-11-20 01:31:30.183697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.138 [2024-11-20 01:31:30.183818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.138 [2024-11-20 01:31:30.183846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.139 qpair failed and we were unable to recover it. 00:30:22.139 [2024-11-20 01:31:30.183997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.139 [2024-11-20 01:31:30.184094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.139 [2024-11-20 01:31:30.184120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.139 qpair failed and we were unable to recover it. 00:30:22.139 [2024-11-20 01:31:30.184248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.139 [2024-11-20 01:31:30.184360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.139 [2024-11-20 01:31:30.184385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.139 qpair failed and we were unable to recover it. 00:30:22.139 [2024-11-20 01:31:30.184626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.139 [2024-11-20 01:31:30.184798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.139 [2024-11-20 01:31:30.184823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.139 qpair failed and we were unable to recover it. 00:30:22.139 [2024-11-20 01:31:30.184971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.139 [2024-11-20 01:31:30.185083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.139 [2024-11-20 01:31:30.185135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.139 qpair failed and we were unable to recover it. 00:30:22.139 [2024-11-20 01:31:30.185229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.139 [2024-11-20 01:31:30.185320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.139 [2024-11-20 01:31:30.185345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.139 qpair failed and we were unable to recover it. 00:30:22.139 [2024-11-20 01:31:30.185460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.139 [2024-11-20 01:31:30.185541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.139 [2024-11-20 01:31:30.185584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.139 qpair failed and we were unable to recover it. 00:30:22.139 [2024-11-20 01:31:30.185722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.139 [2024-11-20 01:31:30.185820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.139 [2024-11-20 01:31:30.185847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.139 qpair failed and we were unable to recover it. 00:30:22.139 [2024-11-20 01:31:30.185955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.139 [2024-11-20 01:31:30.186094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.139 [2024-11-20 01:31:30.186122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.139 qpair failed and we were unable to recover it. 00:30:22.139 [2024-11-20 01:31:30.186205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.139 [2024-11-20 01:31:30.186286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.139 [2024-11-20 01:31:30.186328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.139 qpair failed and we were unable to recover it. 00:30:22.139 [2024-11-20 01:31:30.186475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.139 [2024-11-20 01:31:30.186596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.139 [2024-11-20 01:31:30.186624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.139 qpair failed and we were unable to recover it. 00:30:22.139 [2024-11-20 01:31:30.186752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.139 [2024-11-20 01:31:30.186851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.139 [2024-11-20 01:31:30.186884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.139 qpair failed and we were unable to recover it. 00:30:22.139 [2024-11-20 01:31:30.186999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.139 [2024-11-20 01:31:30.187145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.139 [2024-11-20 01:31:30.187171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.139 qpair failed and we were unable to recover it. 00:30:22.139 [2024-11-20 01:31:30.187259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.139 [2024-11-20 01:31:30.187347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.139 [2024-11-20 01:31:30.187372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.139 qpair failed and we were unable to recover it. 00:30:22.139 [2024-11-20 01:31:30.187488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.139 [2024-11-20 01:31:30.187610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.139 [2024-11-20 01:31:30.187635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.139 qpair failed and we were unable to recover it. 00:30:22.139 [2024-11-20 01:31:30.187758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.139 [2024-11-20 01:31:30.187910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.139 [2024-11-20 01:31:30.187950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.139 qpair failed and we were unable to recover it. 00:30:22.139 [2024-11-20 01:31:30.188085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.139 [2024-11-20 01:31:30.188193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.139 [2024-11-20 01:31:30.188218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.139 qpair failed and we were unable to recover it. 00:30:22.139 [2024-11-20 01:31:30.188331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.139 [2024-11-20 01:31:30.188463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.139 [2024-11-20 01:31:30.188490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.139 qpair failed and we were unable to recover it. 00:30:22.139 [2024-11-20 01:31:30.188628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.139 [2024-11-20 01:31:30.188746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.139 [2024-11-20 01:31:30.188771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.139 qpair failed and we were unable to recover it. 00:30:22.139 [2024-11-20 01:31:30.188916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.139 [2024-11-20 01:31:30.189023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.139 [2024-11-20 01:31:30.189047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.139 qpair failed and we were unable to recover it. 00:30:22.139 [2024-11-20 01:31:30.189199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.139 [2024-11-20 01:31:30.189318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.139 [2024-11-20 01:31:30.189347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.139 qpair failed and we were unable to recover it. 00:30:22.139 [2024-11-20 01:31:30.189441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.139 [2024-11-20 01:31:30.189531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.139 [2024-11-20 01:31:30.189557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.139 qpair failed and we were unable to recover it. 00:30:22.139 [2024-11-20 01:31:30.189709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.139 [2024-11-20 01:31:30.189861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.139 [2024-11-20 01:31:30.189889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.139 qpair failed and we were unable to recover it. 00:30:22.139 [2024-11-20 01:31:30.190033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.139 [2024-11-20 01:31:30.190161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.139 [2024-11-20 01:31:30.190186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.139 qpair failed and we were unable to recover it. 00:30:22.139 [2024-11-20 01:31:30.190275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.139 [2024-11-20 01:31:30.190378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.139 [2024-11-20 01:31:30.190403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.139 qpair failed and we were unable to recover it. 00:30:22.139 [2024-11-20 01:31:30.190525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.139 [2024-11-20 01:31:30.190685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.139 [2024-11-20 01:31:30.190712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.139 qpair failed and we were unable to recover it. 00:30:22.139 [2024-11-20 01:31:30.190872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.139 [2024-11-20 01:31:30.190958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.139 [2024-11-20 01:31:30.190985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.140 qpair failed and we were unable to recover it. 00:30:22.140 [2024-11-20 01:31:30.191105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.140 [2024-11-20 01:31:30.191198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.140 [2024-11-20 01:31:30.191223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.140 qpair failed and we were unable to recover it. 00:30:22.140 [2024-11-20 01:31:30.191354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.140 [2024-11-20 01:31:30.191469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.140 [2024-11-20 01:31:30.191496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.140 qpair failed and we were unable to recover it. 00:30:22.140 [2024-11-20 01:31:30.191630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.140 [2024-11-20 01:31:30.191763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.140 [2024-11-20 01:31:30.191788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.140 qpair failed and we were unable to recover it. 00:30:22.140 [2024-11-20 01:31:30.191882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.140 [2024-11-20 01:31:30.191973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.140 [2024-11-20 01:31:30.191997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.140 qpair failed and we were unable to recover it. 00:30:22.140 [2024-11-20 01:31:30.192090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.140 [2024-11-20 01:31:30.192203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.140 [2024-11-20 01:31:30.192228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.140 qpair failed and we were unable to recover it. 00:30:22.140 [2024-11-20 01:31:30.192333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.140 [2024-11-20 01:31:30.192463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.140 [2024-11-20 01:31:30.192491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.140 qpair failed and we were unable to recover it. 00:30:22.140 [2024-11-20 01:31:30.192603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.140 [2024-11-20 01:31:30.192680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.140 [2024-11-20 01:31:30.192705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.140 qpair failed and we were unable to recover it. 00:30:22.140 [2024-11-20 01:31:30.192845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.140 [2024-11-20 01:31:30.192972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.140 [2024-11-20 01:31:30.192999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.140 qpair failed and we were unable to recover it. 00:30:22.140 [2024-11-20 01:31:30.193167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.140 [2024-11-20 01:31:30.193281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.140 [2024-11-20 01:31:30.193305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.140 qpair failed and we were unable to recover it. 00:30:22.140 [2024-11-20 01:31:30.193452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.140 [2024-11-20 01:31:30.193568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.140 [2024-11-20 01:31:30.193593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.140 qpair failed and we were unable to recover it. 00:30:22.140 [2024-11-20 01:31:30.193743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.140 [2024-11-20 01:31:30.193879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.140 [2024-11-20 01:31:30.193904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.140 qpair failed and we were unable to recover it. 00:30:22.140 [2024-11-20 01:31:30.193993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.140 [2024-11-20 01:31:30.194115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.140 [2024-11-20 01:31:30.194140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.140 qpair failed and we were unable to recover it. 00:30:22.140 [2024-11-20 01:31:30.194252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.140 [2024-11-20 01:31:30.194340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.140 [2024-11-20 01:31:30.194364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.140 qpair failed and we were unable to recover it. 00:30:22.140 [2024-11-20 01:31:30.194479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.140 [2024-11-20 01:31:30.194604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.140 [2024-11-20 01:31:30.194628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.140 qpair failed and we were unable to recover it. 00:30:22.140 [2024-11-20 01:31:30.194713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.140 [2024-11-20 01:31:30.194800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.140 [2024-11-20 01:31:30.194825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.140 qpair failed and we were unable to recover it. 00:30:22.140 [2024-11-20 01:31:30.194946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.140 [2024-11-20 01:31:30.195029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.140 [2024-11-20 01:31:30.195055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.140 qpair failed and we were unable to recover it. 00:30:22.140 [2024-11-20 01:31:30.195175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.140 [2024-11-20 01:31:30.195292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.140 [2024-11-20 01:31:30.195317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.140 qpair failed and we were unable to recover it. 00:30:22.140 [2024-11-20 01:31:30.195400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.140 [2024-11-20 01:31:30.195546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.140 [2024-11-20 01:31:30.195587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.140 qpair failed and we were unable to recover it. 00:30:22.140 [2024-11-20 01:31:30.195703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.140 [2024-11-20 01:31:30.195834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.140 [2024-11-20 01:31:30.195859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.140 qpair failed and we were unable to recover it. 00:30:22.140 [2024-11-20 01:31:30.195981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.140 [2024-11-20 01:31:30.196100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.140 [2024-11-20 01:31:30.196126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.140 qpair failed and we were unable to recover it. 00:30:22.140 [2024-11-20 01:31:30.196227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.140 [2024-11-20 01:31:30.196309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.140 [2024-11-20 01:31:30.196334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.140 qpair failed and we were unable to recover it. 00:30:22.140 [2024-11-20 01:31:30.196470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.140 [2024-11-20 01:31:30.196582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.140 [2024-11-20 01:31:30.196607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.140 qpair failed and we were unable to recover it. 00:30:22.140 [2024-11-20 01:31:30.196718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.140 [2024-11-20 01:31:30.196809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.140 [2024-11-20 01:31:30.196850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.140 qpair failed and we were unable to recover it. 00:30:22.140 [2024-11-20 01:31:30.196969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.140 [2024-11-20 01:31:30.197144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.140 [2024-11-20 01:31:30.197170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.140 qpair failed and we were unable to recover it. 00:30:22.140 [2024-11-20 01:31:30.197265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.140 [2024-11-20 01:31:30.198011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.140 [2024-11-20 01:31:30.198045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.140 qpair failed and we were unable to recover it. 00:30:22.140 [2024-11-20 01:31:30.198221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.140 [2024-11-20 01:31:30.198835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.140 [2024-11-20 01:31:30.198867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.140 qpair failed and we were unable to recover it. 00:30:22.140 [2024-11-20 01:31:30.199033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.140 [2024-11-20 01:31:30.199133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.140 [2024-11-20 01:31:30.199158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.140 qpair failed and we were unable to recover it. 00:30:22.140 [2024-11-20 01:31:30.199252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.140 [2024-11-20 01:31:30.199374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.140 [2024-11-20 01:31:30.199398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.141 qpair failed and we were unable to recover it. 00:30:22.141 [2024-11-20 01:31:30.199526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.141 [2024-11-20 01:31:30.199645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.141 [2024-11-20 01:31:30.199673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.141 qpair failed and we were unable to recover it. 00:30:22.141 [2024-11-20 01:31:30.199826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.141 [2024-11-20 01:31:30.199923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.141 [2024-11-20 01:31:30.199951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.141 qpair failed and we were unable to recover it. 00:30:22.141 [2024-11-20 01:31:30.200082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.141 [2024-11-20 01:31:30.200172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.141 [2024-11-20 01:31:30.200197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.141 qpair failed and we were unable to recover it. 00:30:22.141 [2024-11-20 01:31:30.200292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.141 [2024-11-20 01:31:30.200383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.141 [2024-11-20 01:31:30.200408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.141 qpair failed and we were unable to recover it. 00:30:22.141 [2024-11-20 01:31:30.200522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.141 [2024-11-20 01:31:30.200632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.141 [2024-11-20 01:31:30.200672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.141 qpair failed and we were unable to recover it. 00:30:22.141 [2024-11-20 01:31:30.200826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.141 [2024-11-20 01:31:30.200937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.141 [2024-11-20 01:31:30.200962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.141 qpair failed and we were unable to recover it. 00:30:22.141 [2024-11-20 01:31:30.201058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.141 [2024-11-20 01:31:30.201179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.141 [2024-11-20 01:31:30.201205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.141 qpair failed and we were unable to recover it. 00:30:22.141 [2024-11-20 01:31:30.201339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.141 [2024-11-20 01:31:30.201459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.141 [2024-11-20 01:31:30.201491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.141 qpair failed and we were unable to recover it. 00:30:22.141 [2024-11-20 01:31:30.201659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.141 [2024-11-20 01:31:30.201788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.141 [2024-11-20 01:31:30.201813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.141 qpair failed and we were unable to recover it. 00:30:22.141 [2024-11-20 01:31:30.201910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.141 [2024-11-20 01:31:30.202051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.141 [2024-11-20 01:31:30.202084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.141 qpair failed and we were unable to recover it. 00:30:22.141 [2024-11-20 01:31:30.202182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.141 [2024-11-20 01:31:30.202285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.141 [2024-11-20 01:31:30.202312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.141 qpair failed and we were unable to recover it. 00:30:22.141 [2024-11-20 01:31:30.202456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.141 [2024-11-20 01:31:30.202540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.141 [2024-11-20 01:31:30.202565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.141 qpair failed and we were unable to recover it. 00:30:22.141 [2024-11-20 01:31:30.202643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.141 [2024-11-20 01:31:30.202814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.141 [2024-11-20 01:31:30.202841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.141 qpair failed and we were unable to recover it. 00:30:22.141 [2024-11-20 01:31:30.202999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.141 [2024-11-20 01:31:30.203148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.141 [2024-11-20 01:31:30.203173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.141 qpair failed and we were unable to recover it. 00:30:22.141 [2024-11-20 01:31:30.203266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.141 [2024-11-20 01:31:30.203356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.141 [2024-11-20 01:31:30.203380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.141 qpair failed and we were unable to recover it. 00:30:22.141 [2024-11-20 01:31:30.203500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.141 [2024-11-20 01:31:30.203583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.141 [2024-11-20 01:31:30.203626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.141 qpair failed and we were unable to recover it. 00:30:22.141 [2024-11-20 01:31:30.203748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.141 [2024-11-20 01:31:30.203879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.141 [2024-11-20 01:31:30.203907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.141 qpair failed and we were unable to recover it. 00:30:22.141 [2024-11-20 01:31:30.204107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.141 [2024-11-20 01:31:30.204222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.141 [2024-11-20 01:31:30.204247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.141 qpair failed and we were unable to recover it. 00:30:22.141 [2024-11-20 01:31:30.204352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.141 [2024-11-20 01:31:30.204478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.141 [2024-11-20 01:31:30.204502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.141 qpair failed and we were unable to recover it. 00:30:22.141 [2024-11-20 01:31:30.204613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.141 [2024-11-20 01:31:30.204716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.141 [2024-11-20 01:31:30.204742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.141 qpair failed and we were unable to recover it. 00:30:22.141 [2024-11-20 01:31:30.204859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.141 [2024-11-20 01:31:30.204951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.141 [2024-11-20 01:31:30.204976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.141 qpair failed and we were unable to recover it. 00:30:22.141 [2024-11-20 01:31:30.205093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.141 [2024-11-20 01:31:30.205212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.141 [2024-11-20 01:31:30.205240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.141 qpair failed and we were unable to recover it. 00:30:22.141 [2024-11-20 01:31:30.205339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.141 [2024-11-20 01:31:30.205497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.141 [2024-11-20 01:31:30.205524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.141 qpair failed and we were unable to recover it. 00:30:22.141 [2024-11-20 01:31:30.205659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.141 [2024-11-20 01:31:30.205779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.141 [2024-11-20 01:31:30.205804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.141 qpair failed and we were unable to recover it. 00:30:22.141 [2024-11-20 01:31:30.205897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.141 [2024-11-20 01:31:30.205985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.142 [2024-11-20 01:31:30.206010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.142 qpair failed and we were unable to recover it. 00:30:22.142 [2024-11-20 01:31:30.206098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.142 [2024-11-20 01:31:30.206207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.142 [2024-11-20 01:31:30.206235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.142 qpair failed and we were unable to recover it. 00:30:22.142 [2024-11-20 01:31:30.206358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.142 [2024-11-20 01:31:30.206452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.142 [2024-11-20 01:31:30.206477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.142 qpair failed and we were unable to recover it. 00:30:22.142 [2024-11-20 01:31:30.206578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.142 [2024-11-20 01:31:30.206697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.142 [2024-11-20 01:31:30.206722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.142 qpair failed and we were unable to recover it. 00:30:22.142 [2024-11-20 01:31:30.206835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.142 [2024-11-20 01:31:30.206938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.142 [2024-11-20 01:31:30.206967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.142 qpair failed and we were unable to recover it. 00:30:22.142 [2024-11-20 01:31:30.207150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.142 [2024-11-20 01:31:30.207240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.142 [2024-11-20 01:31:30.207265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.142 qpair failed and we were unable to recover it. 00:30:22.142 [2024-11-20 01:31:30.207355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.142 [2024-11-20 01:31:30.207448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.142 [2024-11-20 01:31:30.207473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.142 qpair failed and we were unable to recover it. 00:30:22.142 [2024-11-20 01:31:30.207613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.142 [2024-11-20 01:31:30.207734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.142 [2024-11-20 01:31:30.207761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.142 qpair failed and we were unable to recover it. 00:30:22.142 [2024-11-20 01:31:30.207890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.142 [2024-11-20 01:31:30.208013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.142 [2024-11-20 01:31:30.208037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.142 qpair failed and we were unable to recover it. 00:30:22.142 [2024-11-20 01:31:30.208130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.142 [2024-11-20 01:31:30.208218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.142 [2024-11-20 01:31:30.208244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.142 qpair failed and we were unable to recover it. 00:30:22.142 [2024-11-20 01:31:30.208367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.142 [2024-11-20 01:31:30.208497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.142 [2024-11-20 01:31:30.208525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.142 qpair failed and we were unable to recover it. 00:30:22.142 [2024-11-20 01:31:30.208637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.142 [2024-11-20 01:31:30.208722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.142 [2024-11-20 01:31:30.208747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.142 qpair failed and we were unable to recover it. 00:30:22.142 [2024-11-20 01:31:30.208845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.142 [2024-11-20 01:31:30.208964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.142 [2024-11-20 01:31:30.208989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.142 qpair failed and we were unable to recover it. 00:30:22.142 [2024-11-20 01:31:30.209089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.142 [2024-11-20 01:31:30.209180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.142 [2024-11-20 01:31:30.209205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.142 qpair failed and we were unable to recover it. 00:30:22.142 [2024-11-20 01:31:30.209332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.142 [2024-11-20 01:31:30.209452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.142 [2024-11-20 01:31:30.209477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.142 qpair failed and we were unable to recover it. 00:30:22.142 [2024-11-20 01:31:30.209610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.142 [2024-11-20 01:31:30.209746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.142 [2024-11-20 01:31:30.209774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.142 qpair failed and we were unable to recover it. 00:30:22.142 [2024-11-20 01:31:30.209906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.142 [2024-11-20 01:31:30.210002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.142 [2024-11-20 01:31:30.210029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.142 qpair failed and we were unable to recover it. 00:30:22.142 [2024-11-20 01:31:30.210148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.142 [2024-11-20 01:31:30.210233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.142 [2024-11-20 01:31:30.210258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.142 qpair failed and we were unable to recover it. 00:30:22.142 [2024-11-20 01:31:30.210357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.142 [2024-11-20 01:31:30.210553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.142 [2024-11-20 01:31:30.210579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.142 qpair failed and we were unable to recover it. 00:30:22.142 [2024-11-20 01:31:30.210731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.142 [2024-11-20 01:31:30.210890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.142 [2024-11-20 01:31:30.210930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.142 qpair failed and we were unable to recover it. 00:30:22.142 [2024-11-20 01:31:30.211095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.142 [2024-11-20 01:31:30.211205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.142 [2024-11-20 01:31:30.211231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.142 qpair failed and we were unable to recover it. 00:30:22.142 [2024-11-20 01:31:30.211318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.142 [2024-11-20 01:31:30.211407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.142 [2024-11-20 01:31:30.211432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.142 qpair failed and we were unable to recover it. 00:30:22.142 [2024-11-20 01:31:30.211578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.142 [2024-11-20 01:31:30.211687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.142 [2024-11-20 01:31:30.211714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.142 qpair failed and we were unable to recover it. 00:30:22.142 [2024-11-20 01:31:30.211845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.142 [2024-11-20 01:31:30.211924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.142 [2024-11-20 01:31:30.211948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.142 qpair failed and we were unable to recover it. 00:30:22.142 [2024-11-20 01:31:30.212104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.142 [2024-11-20 01:31:30.212211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.143 [2024-11-20 01:31:30.212244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.143 qpair failed and we were unable to recover it. 00:30:22.143 [2024-11-20 01:31:30.212336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.143 [2024-11-20 01:31:30.212431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.143 [2024-11-20 01:31:30.212474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.143 qpair failed and we were unable to recover it. 00:30:22.143 [2024-11-20 01:31:30.212669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.143 [2024-11-20 01:31:30.212794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.143 [2024-11-20 01:31:30.212821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.143 qpair failed and we were unable to recover it. 00:30:22.143 [2024-11-20 01:31:30.212930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.143 [2024-11-20 01:31:30.213040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.143 [2024-11-20 01:31:30.213065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.143 qpair failed and we were unable to recover it. 00:30:22.143 [2024-11-20 01:31:30.213174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.143 [2024-11-20 01:31:30.213382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.143 [2024-11-20 01:31:30.213407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.143 qpair failed and we were unable to recover it. 00:30:22.143 [2024-11-20 01:31:30.213492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.143 [2024-11-20 01:31:30.213590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.143 [2024-11-20 01:31:30.213615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.143 qpair failed and we were unable to recover it. 00:30:22.143 [2024-11-20 01:31:30.213710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.143 [2024-11-20 01:31:30.213829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.143 [2024-11-20 01:31:30.213855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.143 qpair failed and we were unable to recover it. 00:30:22.143 [2024-11-20 01:31:30.214011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.143 [2024-11-20 01:31:30.214158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.143 [2024-11-20 01:31:30.214184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.143 qpair failed and we were unable to recover it. 00:30:22.143 [2024-11-20 01:31:30.214282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.143 [2024-11-20 01:31:30.214393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.143 [2024-11-20 01:31:30.214417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.143 qpair failed and we were unable to recover it. 00:30:22.143 [2024-11-20 01:31:30.214535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.143 [2024-11-20 01:31:30.214636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.143 [2024-11-20 01:31:30.214664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.143 qpair failed and we were unable to recover it. 00:30:22.143 [2024-11-20 01:31:30.214773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.143 [2024-11-20 01:31:30.214869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.143 [2024-11-20 01:31:30.214901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.143 qpair failed and we were unable to recover it. 00:30:22.143 [2024-11-20 01:31:30.215019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.143 [2024-11-20 01:31:30.215117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.143 [2024-11-20 01:31:30.215142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.143 qpair failed and we were unable to recover it. 00:30:22.143 [2024-11-20 01:31:30.215240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.143 [2024-11-20 01:31:30.215325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.143 [2024-11-20 01:31:30.215350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.143 qpair failed and we were unable to recover it. 00:30:22.143 [2024-11-20 01:31:30.215444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.143 [2024-11-20 01:31:30.215557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.143 [2024-11-20 01:31:30.215583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.143 qpair failed and we were unable to recover it. 00:30:22.143 [2024-11-20 01:31:30.215718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.143 [2024-11-20 01:31:30.215811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.143 [2024-11-20 01:31:30.215837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.143 qpair failed and we were unable to recover it. 00:30:22.143 [2024-11-20 01:31:30.215932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.143 [2024-11-20 01:31:30.216054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.143 [2024-11-20 01:31:30.216104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.143 qpair failed and we were unable to recover it. 00:30:22.143 [2024-11-20 01:31:30.216207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.143 [2024-11-20 01:31:30.216307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.143 [2024-11-20 01:31:30.216335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.143 qpair failed and we were unable to recover it. 00:30:22.143 [2024-11-20 01:31:30.216450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.143 [2024-11-20 01:31:30.216533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.143 [2024-11-20 01:31:30.216558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.143 qpair failed and we were unable to recover it. 00:30:22.143 [2024-11-20 01:31:30.216655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.143 [2024-11-20 01:31:30.216764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.143 [2024-11-20 01:31:30.216789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.143 qpair failed and we were unable to recover it. 00:30:22.143 [2024-11-20 01:31:30.216885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.143 [2024-11-20 01:31:30.216988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.143 [2024-11-20 01:31:30.217021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.143 qpair failed and we were unable to recover it. 00:30:22.143 [2024-11-20 01:31:30.217138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.143 [2024-11-20 01:31:30.217258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.143 [2024-11-20 01:31:30.217287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.143 qpair failed and we were unable to recover it. 00:30:22.143 [2024-11-20 01:31:30.217459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.143 [2024-11-20 01:31:30.217606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.143 [2024-11-20 01:31:30.217631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.143 qpair failed and we were unable to recover it. 00:30:22.143 [2024-11-20 01:31:30.217734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.143 [2024-11-20 01:31:30.217863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.143 [2024-11-20 01:31:30.217888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.143 qpair failed and we were unable to recover it. 00:30:22.143 [2024-11-20 01:31:30.218007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.143 [2024-11-20 01:31:30.218105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.143 [2024-11-20 01:31:30.218131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.143 qpair failed and we were unable to recover it. 00:30:22.143 [2024-11-20 01:31:30.218272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.143 [2024-11-20 01:31:30.218399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.143 [2024-11-20 01:31:30.218427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.143 qpair failed and we were unable to recover it. 00:30:22.143 [2024-11-20 01:31:30.218522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.143 [2024-11-20 01:31:30.218617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.143 [2024-11-20 01:31:30.218645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.143 qpair failed and we were unable to recover it. 00:30:22.143 [2024-11-20 01:31:30.218755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.143 [2024-11-20 01:31:30.218840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.143 [2024-11-20 01:31:30.218864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.143 qpair failed and we were unable to recover it. 00:30:22.143 [2024-11-20 01:31:30.218951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.143 [2024-11-20 01:31:30.219038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.143 [2024-11-20 01:31:30.219062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.144 qpair failed and we were unable to recover it. 00:30:22.144 [2024-11-20 01:31:30.219181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.144 [2024-11-20 01:31:30.219280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.144 [2024-11-20 01:31:30.219324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.144 qpair failed and we were unable to recover it. 00:30:22.144 [2024-11-20 01:31:30.219408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.144 [2024-11-20 01:31:30.219501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.144 [2024-11-20 01:31:30.219526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.144 qpair failed and we were unable to recover it. 00:30:22.144 [2024-11-20 01:31:30.219639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.144 [2024-11-20 01:31:30.219770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.144 [2024-11-20 01:31:30.219798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.144 qpair failed and we were unable to recover it. 00:30:22.144 [2024-11-20 01:31:30.219942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.144 [2024-11-20 01:31:30.220062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.144 [2024-11-20 01:31:30.220106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.144 qpair failed and we were unable to recover it. 00:30:22.144 [2024-11-20 01:31:30.220195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.144 [2024-11-20 01:31:30.220285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.144 [2024-11-20 01:31:30.220310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.144 qpair failed and we were unable to recover it. 00:30:22.144 [2024-11-20 01:31:30.220404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.144 [2024-11-20 01:31:30.220531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.144 [2024-11-20 01:31:30.220556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.144 qpair failed and we were unable to recover it. 00:30:22.144 [2024-11-20 01:31:30.220693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.144 [2024-11-20 01:31:30.220820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.144 [2024-11-20 01:31:30.220844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.144 qpair failed and we were unable to recover it. 00:30:22.144 [2024-11-20 01:31:30.220987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.144 [2024-11-20 01:31:30.221082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.144 [2024-11-20 01:31:30.221107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.144 qpair failed and we were unable to recover it. 00:30:22.144 [2024-11-20 01:31:30.221227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.144 [2024-11-20 01:31:30.221325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.144 [2024-11-20 01:31:30.221367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.144 qpair failed and we were unable to recover it. 00:30:22.144 [2024-11-20 01:31:30.221485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.144 [2024-11-20 01:31:30.221627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.144 [2024-11-20 01:31:30.221652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.144 qpair failed and we were unable to recover it. 00:30:22.144 [2024-11-20 01:31:30.221738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.144 [2024-11-20 01:31:30.221865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.144 [2024-11-20 01:31:30.221890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.144 qpair failed and we were unable to recover it. 00:30:22.144 [2024-11-20 01:31:30.222034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.144 [2024-11-20 01:31:30.222149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.144 [2024-11-20 01:31:30.222174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.144 qpair failed and we were unable to recover it. 00:30:22.144 [2024-11-20 01:31:30.222271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.144 [2024-11-20 01:31:30.222373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.144 [2024-11-20 01:31:30.222399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.144 qpair failed and we were unable to recover it. 00:30:22.144 [2024-11-20 01:31:30.222478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.144 [2024-11-20 01:31:30.222566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.144 [2024-11-20 01:31:30.222591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.144 qpair failed and we were unable to recover it. 00:30:22.144 [2024-11-20 01:31:30.222679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.144 [2024-11-20 01:31:30.222783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.144 [2024-11-20 01:31:30.222810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.144 qpair failed and we were unable to recover it. 00:30:22.144 [2024-11-20 01:31:30.222910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.144 [2024-11-20 01:31:30.223026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.144 [2024-11-20 01:31:30.223054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.144 qpair failed and we were unable to recover it. 00:30:22.144 [2024-11-20 01:31:30.223182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.144 [2024-11-20 01:31:30.223265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.144 [2024-11-20 01:31:30.223291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.144 qpair failed and we were unable to recover it. 00:30:22.144 [2024-11-20 01:31:30.223404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.144 [2024-11-20 01:31:30.223543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.144 [2024-11-20 01:31:30.223571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.144 qpair failed and we were unable to recover it. 00:30:22.144 [2024-11-20 01:31:30.223697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.144 [2024-11-20 01:31:30.223782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.144 [2024-11-20 01:31:30.223809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.144 qpair failed and we were unable to recover it. 00:30:22.144 [2024-11-20 01:31:30.223907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.144 [2024-11-20 01:31:30.224034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.144 [2024-11-20 01:31:30.224059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.144 qpair failed and we were unable to recover it. 00:30:22.144 [2024-11-20 01:31:30.224188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.144 [2024-11-20 01:31:30.224288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.144 [2024-11-20 01:31:30.224316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.144 qpair failed and we were unable to recover it. 00:30:22.144 [2024-11-20 01:31:30.224443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.144 [2024-11-20 01:31:30.224566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.144 [2024-11-20 01:31:30.224594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.144 qpair failed and we were unable to recover it. 00:30:22.144 [2024-11-20 01:31:30.224738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.144 [2024-11-20 01:31:30.224855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.144 [2024-11-20 01:31:30.224880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.144 qpair failed and we were unable to recover it. 00:30:22.144 [2024-11-20 01:31:30.224962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.144 [2024-11-20 01:31:30.225065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.144 [2024-11-20 01:31:30.225125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.144 qpair failed and we were unable to recover it. 00:30:22.144 [2024-11-20 01:31:30.225224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.144 [2024-11-20 01:31:30.225316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.144 [2024-11-20 01:31:30.225341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.144 qpair failed and we were unable to recover it. 00:30:22.144 [2024-11-20 01:31:30.225432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.144 [2024-11-20 01:31:30.225511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.144 [2024-11-20 01:31:30.225536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.144 qpair failed and we were unable to recover it. 00:30:22.144 [2024-11-20 01:31:30.225688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.145 [2024-11-20 01:31:30.225834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.145 [2024-11-20 01:31:30.225859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.145 qpair failed and we were unable to recover it. 00:30:22.145 [2024-11-20 01:31:30.225951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.145 [2024-11-20 01:31:30.226065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.145 [2024-11-20 01:31:30.226098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.145 qpair failed and we were unable to recover it. 00:30:22.145 [2024-11-20 01:31:30.226221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.145 [2024-11-20 01:31:30.226302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.145 [2024-11-20 01:31:30.226327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.145 qpair failed and we were unable to recover it. 00:30:22.145 [2024-11-20 01:31:30.226443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.145 [2024-11-20 01:31:30.226547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.145 [2024-11-20 01:31:30.226575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.145 qpair failed and we were unable to recover it. 00:30:22.145 [2024-11-20 01:31:30.226732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.145 [2024-11-20 01:31:30.226899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.145 [2024-11-20 01:31:30.226924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.145 qpair failed and we were unable to recover it. 00:30:22.145 [2024-11-20 01:31:30.227008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.145 [2024-11-20 01:31:30.227107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.145 [2024-11-20 01:31:30.227133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.145 qpair failed and we were unable to recover it. 00:30:22.145 [2024-11-20 01:31:30.227226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.145 [2024-11-20 01:31:30.227364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.145 [2024-11-20 01:31:30.227392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.145 qpair failed and we were unable to recover it. 00:30:22.145 [2024-11-20 01:31:30.227495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.145 [2024-11-20 01:31:30.227581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.145 [2024-11-20 01:31:30.227609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.145 qpair failed and we were unable to recover it. 00:30:22.145 [2024-11-20 01:31:30.227746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.145 [2024-11-20 01:31:30.227854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.145 [2024-11-20 01:31:30.227880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.145 qpair failed and we were unable to recover it. 00:30:22.145 [2024-11-20 01:31:30.228040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.145 [2024-11-20 01:31:30.228162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.145 [2024-11-20 01:31:30.228188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.145 qpair failed and we were unable to recover it. 00:30:22.145 [2024-11-20 01:31:30.228278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.145 [2024-11-20 01:31:30.228380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.145 [2024-11-20 01:31:30.228408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.145 qpair failed and we were unable to recover it. 00:30:22.145 [2024-11-20 01:31:30.228516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.145 [2024-11-20 01:31:30.228634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.145 [2024-11-20 01:31:30.228660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.145 qpair failed and we were unable to recover it. 00:30:22.145 [2024-11-20 01:31:30.228787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.145 [2024-11-20 01:31:30.228914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.145 [2024-11-20 01:31:30.228939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.145 qpair failed and we were unable to recover it. 00:30:22.145 [2024-11-20 01:31:30.229025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.145 [2024-11-20 01:31:30.229121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.145 [2024-11-20 01:31:30.229146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.145 qpair failed and we were unable to recover it. 00:30:22.145 [2024-11-20 01:31:30.229281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.145 [2024-11-20 01:31:30.229388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.145 [2024-11-20 01:31:30.229413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.145 qpair failed and we were unable to recover it. 00:30:22.145 [2024-11-20 01:31:30.229505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.145 [2024-11-20 01:31:30.229648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.145 [2024-11-20 01:31:30.229672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.145 qpair failed and we were unable to recover it. 00:30:22.145 [2024-11-20 01:31:30.229819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.145 [2024-11-20 01:31:30.229945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.145 [2024-11-20 01:31:30.229972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.145 qpair failed and we were unable to recover it. 00:30:22.145 [2024-11-20 01:31:30.230140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.145 [2024-11-20 01:31:30.230244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.145 [2024-11-20 01:31:30.230286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.145 qpair failed and we were unable to recover it. 00:30:22.145 [2024-11-20 01:31:30.230412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.145 [2024-11-20 01:31:30.230577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.145 [2024-11-20 01:31:30.230605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.145 qpair failed and we were unable to recover it. 00:30:22.145 [2024-11-20 01:31:30.230702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.145 [2024-11-20 01:31:30.230800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.145 [2024-11-20 01:31:30.230828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.145 qpair failed and we were unable to recover it. 00:30:22.145 [2024-11-20 01:31:30.230963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.145 [2024-11-20 01:31:30.231089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.145 [2024-11-20 01:31:30.231115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.145 qpair failed and we were unable to recover it. 00:30:22.145 [2024-11-20 01:31:30.231210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.145 [2024-11-20 01:31:30.231292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.145 [2024-11-20 01:31:30.231336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.145 qpair failed and we were unable to recover it. 00:30:22.145 [2024-11-20 01:31:30.231456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.145 [2024-11-20 01:31:30.231593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.145 [2024-11-20 01:31:30.231618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.145 qpair failed and we were unable to recover it. 00:30:22.145 [2024-11-20 01:31:30.231744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.145 [2024-11-20 01:31:30.231837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.145 [2024-11-20 01:31:30.231861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.145 qpair failed and we were unable to recover it. 00:30:22.145 [2024-11-20 01:31:30.232007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.145 [2024-11-20 01:31:30.232138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.145 [2024-11-20 01:31:30.232167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.145 qpair failed and we were unable to recover it. 00:30:22.145 [2024-11-20 01:31:30.232289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.145 [2024-11-20 01:31:30.232382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.145 [2024-11-20 01:31:30.232409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.145 qpair failed and we were unable to recover it. 00:30:22.145 [2024-11-20 01:31:30.232539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.145 [2024-11-20 01:31:30.232618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.145 [2024-11-20 01:31:30.232643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.145 qpair failed and we were unable to recover it. 00:30:22.145 [2024-11-20 01:31:30.232737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.145 [2024-11-20 01:31:30.232810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.145 [2024-11-20 01:31:30.232835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.145 qpair failed and we were unable to recover it. 00:30:22.145 [2024-11-20 01:31:30.232927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.145 [2024-11-20 01:31:30.233087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.145 [2024-11-20 01:31:30.233112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.146 qpair failed and we were unable to recover it. 00:30:22.146 [2024-11-20 01:31:30.233201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.146 [2024-11-20 01:31:30.233278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.146 [2024-11-20 01:31:30.233303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.146 qpair failed and we were unable to recover it. 00:30:22.146 [2024-11-20 01:31:30.233423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.146 [2024-11-20 01:31:30.233506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.146 [2024-11-20 01:31:30.233532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.146 qpair failed and we were unable to recover it. 00:30:22.146 [2024-11-20 01:31:30.233674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.146 [2024-11-20 01:31:30.233803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.146 [2024-11-20 01:31:30.233831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.146 qpair failed and we were unable to recover it. 00:30:22.146 [2024-11-20 01:31:30.233969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.146 [2024-11-20 01:31:30.234102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.146 [2024-11-20 01:31:30.234128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.146 qpair failed and we were unable to recover it. 00:30:22.146 [2024-11-20 01:31:30.234275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.146 [2024-11-20 01:31:30.234426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.146 [2024-11-20 01:31:30.234467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.146 qpair failed and we were unable to recover it. 00:30:22.146 [2024-11-20 01:31:30.234586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.146 [2024-11-20 01:31:30.234669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.146 [2024-11-20 01:31:30.234710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.146 qpair failed and we were unable to recover it. 00:30:22.146 [2024-11-20 01:31:30.234850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.146 [2024-11-20 01:31:30.234933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.146 [2024-11-20 01:31:30.234957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.146 qpair failed and we were unable to recover it. 00:30:22.146 [2024-11-20 01:31:30.235093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.146 [2024-11-20 01:31:30.235232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.146 [2024-11-20 01:31:30.235256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.146 qpair failed and we were unable to recover it. 00:30:22.146 [2024-11-20 01:31:30.235345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.146 [2024-11-20 01:31:30.235477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.146 [2024-11-20 01:31:30.235505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.146 qpair failed and we were unable to recover it. 00:30:22.146 [2024-11-20 01:31:30.235629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.146 [2024-11-20 01:31:30.235755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.146 [2024-11-20 01:31:30.235780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.146 qpair failed and we were unable to recover it. 00:30:22.146 [2024-11-20 01:31:30.235923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.146 [2024-11-20 01:31:30.236102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.146 [2024-11-20 01:31:30.236136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.146 qpair failed and we were unable to recover it. 00:30:22.146 [2024-11-20 01:31:30.236234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.146 [2024-11-20 01:31:30.236329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.146 [2024-11-20 01:31:30.236354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.146 qpair failed and we were unable to recover it. 00:30:22.146 [2024-11-20 01:31:30.236534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.146 [2024-11-20 01:31:30.236625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.146 [2024-11-20 01:31:30.236650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.146 qpair failed and we were unable to recover it. 00:30:22.146 [2024-11-20 01:31:30.236779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.146 [2024-11-20 01:31:30.236911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.146 [2024-11-20 01:31:30.236936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.146 qpair failed and we were unable to recover it. 00:30:22.146 [2024-11-20 01:31:30.237018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.146 [2024-11-20 01:31:30.237139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.146 [2024-11-20 01:31:30.237164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.146 qpair failed and we were unable to recover it. 00:30:22.146 [2024-11-20 01:31:30.237257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.146 [2024-11-20 01:31:30.237384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.146 [2024-11-20 01:31:30.237409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.146 qpair failed and we were unable to recover it. 00:30:22.146 [2024-11-20 01:31:30.237514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.146 [2024-11-20 01:31:30.237635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.146 [2024-11-20 01:31:30.237662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.146 qpair failed and we were unable to recover it. 00:30:22.146 [2024-11-20 01:31:30.237815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.146 [2024-11-20 01:31:30.237956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.146 [2024-11-20 01:31:30.237996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.146 qpair failed and we were unable to recover it. 00:30:22.146 [2024-11-20 01:31:30.238153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.146 [2024-11-20 01:31:30.238246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.146 [2024-11-20 01:31:30.238271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.146 qpair failed and we were unable to recover it. 00:30:22.146 [2024-11-20 01:31:30.238412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.146 [2024-11-20 01:31:30.238505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.146 [2024-11-20 01:31:30.238537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.146 qpair failed and we were unable to recover it. 00:30:22.146 [2024-11-20 01:31:30.238662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.146 [2024-11-20 01:31:30.238802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.146 [2024-11-20 01:31:30.238829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.146 qpair failed and we were unable to recover it. 00:30:22.146 [2024-11-20 01:31:30.238975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.146 [2024-11-20 01:31:30.239099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.146 [2024-11-20 01:31:30.239150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.146 qpair failed and we were unable to recover it. 00:30:22.146 [2024-11-20 01:31:30.239259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.146 [2024-11-20 01:31:30.239374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.146 [2024-11-20 01:31:30.239399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.146 qpair failed and we were unable to recover it. 00:30:22.146 [2024-11-20 01:31:30.239514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.146 [2024-11-20 01:31:30.239623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.146 [2024-11-20 01:31:30.239650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.146 qpair failed and we were unable to recover it. 00:30:22.146 [2024-11-20 01:31:30.239779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.146 [2024-11-20 01:31:30.239888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.146 [2024-11-20 01:31:30.239913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.146 qpair failed and we were unable to recover it. 00:30:22.146 [2024-11-20 01:31:30.240019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.146 [2024-11-20 01:31:30.240139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.146 [2024-11-20 01:31:30.240167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.146 qpair failed and we were unable to recover it. 00:30:22.146 [2024-11-20 01:31:30.240302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.146 [2024-11-20 01:31:30.240402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.146 [2024-11-20 01:31:30.240429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.146 qpair failed and we were unable to recover it. 00:30:22.146 [2024-11-20 01:31:30.240570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.146 [2024-11-20 01:31:30.240651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.146 [2024-11-20 01:31:30.240675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.146 qpair failed and we were unable to recover it. 00:30:22.146 [2024-11-20 01:31:30.240835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.146 [2024-11-20 01:31:30.240931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.147 [2024-11-20 01:31:30.240958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.147 qpair failed and we were unable to recover it. 00:30:22.147 [2024-11-20 01:31:30.241058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.147 [2024-11-20 01:31:30.241192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.147 [2024-11-20 01:31:30.241220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.147 qpair failed and we were unable to recover it. 00:30:22.147 [2024-11-20 01:31:30.241340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.147 [2024-11-20 01:31:30.241434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.147 [2024-11-20 01:31:30.241459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.147 qpair failed and we were unable to recover it. 00:30:22.147 [2024-11-20 01:31:30.241584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.147 [2024-11-20 01:31:30.241708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.147 [2024-11-20 01:31:30.241736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.147 qpair failed and we were unable to recover it. 00:30:22.147 [2024-11-20 01:31:30.241863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.147 [2024-11-20 01:31:30.241954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.147 [2024-11-20 01:31:30.241983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.147 qpair failed and we were unable to recover it. 00:30:22.147 [2024-11-20 01:31:30.242157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.147 [2024-11-20 01:31:30.242269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.147 [2024-11-20 01:31:30.242294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.147 qpair failed and we were unable to recover it. 00:30:22.147 [2024-11-20 01:31:30.242410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.147 [2024-11-20 01:31:30.242519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.147 [2024-11-20 01:31:30.242546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.147 qpair failed and we were unable to recover it. 00:30:22.147 [2024-11-20 01:31:30.242639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.147 [2024-11-20 01:31:30.242735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.147 [2024-11-20 01:31:30.242764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.147 qpair failed and we were unable to recover it. 00:30:22.147 [2024-11-20 01:31:30.242933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.147 [2024-11-20 01:31:30.243054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.147 [2024-11-20 01:31:30.243096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.147 qpair failed and we were unable to recover it. 00:30:22.147 [2024-11-20 01:31:30.243250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.147 [2024-11-20 01:31:30.243398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.147 [2024-11-20 01:31:30.243425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.147 qpair failed and we were unable to recover it. 00:30:22.147 [2024-11-20 01:31:30.243554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.147 [2024-11-20 01:31:30.243662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.147 [2024-11-20 01:31:30.243687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.147 qpair failed and we were unable to recover it. 00:30:22.147 [2024-11-20 01:31:30.243807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.147 [2024-11-20 01:31:30.243925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.147 [2024-11-20 01:31:30.243950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.147 qpair failed and we were unable to recover it. 00:30:22.147 [2024-11-20 01:31:30.244051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.147 [2024-11-20 01:31:30.244152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.147 [2024-11-20 01:31:30.244177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.147 qpair failed and we were unable to recover it. 00:30:22.147 [2024-11-20 01:31:30.244258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.147 [2024-11-20 01:31:30.244390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.147 [2024-11-20 01:31:30.244415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.147 qpair failed and we were unable to recover it. 00:30:22.147 [2024-11-20 01:31:30.244495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.147 [2024-11-20 01:31:30.244610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.147 [2024-11-20 01:31:30.244635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.147 qpair failed and we were unable to recover it. 00:30:22.147 [2024-11-20 01:31:30.244836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.147 [2024-11-20 01:31:30.244933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.147 [2024-11-20 01:31:30.244960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.147 qpair failed and we were unable to recover it. 00:30:22.147 [2024-11-20 01:31:30.245103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.147 [2024-11-20 01:31:30.245208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.147 [2024-11-20 01:31:30.245232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.147 qpair failed and we were unable to recover it. 00:30:22.147 [2024-11-20 01:31:30.245319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.147 [2024-11-20 01:31:30.245428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.147 [2024-11-20 01:31:30.245452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.147 qpair failed and we were unable to recover it. 00:30:22.147 [2024-11-20 01:31:30.245614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.147 [2024-11-20 01:31:30.245771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.148 [2024-11-20 01:31:30.245798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.148 qpair failed and we were unable to recover it. 00:30:22.148 [2024-11-20 01:31:30.245916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.148 [2024-11-20 01:31:30.246078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.148 [2024-11-20 01:31:30.246107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.148 qpair failed and we were unable to recover it. 00:30:22.148 [2024-11-20 01:31:30.246241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.148 [2024-11-20 01:31:30.246336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.148 [2024-11-20 01:31:30.246360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.148 qpair failed and we were unable to recover it. 00:30:22.148 [2024-11-20 01:31:30.246451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.148 [2024-11-20 01:31:30.246563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.148 [2024-11-20 01:31:30.246587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.148 qpair failed and we were unable to recover it. 00:30:22.148 [2024-11-20 01:31:30.246681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.148 [2024-11-20 01:31:30.246807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.148 [2024-11-20 01:31:30.246849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.148 qpair failed and we were unable to recover it. 00:30:22.148 [2024-11-20 01:31:30.246986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.148 [2024-11-20 01:31:30.247141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.148 [2024-11-20 01:31:30.247166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.148 qpair failed and we were unable to recover it. 00:30:22.148 [2024-11-20 01:31:30.247265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.148 [2024-11-20 01:31:30.247367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.148 [2024-11-20 01:31:30.247394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.148 qpair failed and we were unable to recover it. 00:30:22.148 [2024-11-20 01:31:30.247526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.148 [2024-11-20 01:31:30.247650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.148 [2024-11-20 01:31:30.247678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.148 qpair failed and we were unable to recover it. 00:30:22.148 [2024-11-20 01:31:30.247817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.148 [2024-11-20 01:31:30.247906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.148 [2024-11-20 01:31:30.247930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.148 qpair failed and we were unable to recover it. 00:30:22.148 [2024-11-20 01:31:30.248042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.148 [2024-11-20 01:31:30.248148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.148 [2024-11-20 01:31:30.248173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.148 qpair failed and we were unable to recover it. 00:30:22.148 [2024-11-20 01:31:30.248286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.148 [2024-11-20 01:31:30.248458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.148 [2024-11-20 01:31:30.248486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.148 qpair failed and we were unable to recover it. 00:30:22.148 [2024-11-20 01:31:30.248622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.148 [2024-11-20 01:31:30.248712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.148 [2024-11-20 01:31:30.248737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.148 qpair failed and we were unable to recover it. 00:30:22.148 [2024-11-20 01:31:30.248826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.148 [2024-11-20 01:31:30.248943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.148 [2024-11-20 01:31:30.248968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.148 qpair failed and we were unable to recover it. 00:30:22.148 [2024-11-20 01:31:30.249051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.148 [2024-11-20 01:31:30.249149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.148 [2024-11-20 01:31:30.249174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.148 qpair failed and we were unable to recover it. 00:30:22.148 [2024-11-20 01:31:30.249283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.148 [2024-11-20 01:31:30.249378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.148 [2024-11-20 01:31:30.249407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.148 qpair failed and we were unable to recover it. 00:30:22.148 [2024-11-20 01:31:30.249491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.148 [2024-11-20 01:31:30.249635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.148 [2024-11-20 01:31:30.249662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.148 qpair failed and we were unable to recover it. 00:30:22.148 [2024-11-20 01:31:30.249784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.148 [2024-11-20 01:31:30.249864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.148 [2024-11-20 01:31:30.249889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.148 qpair failed and we were unable to recover it. 00:30:22.148 [2024-11-20 01:31:30.249989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.148 [2024-11-20 01:31:30.250119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.148 [2024-11-20 01:31:30.250145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.148 qpair failed and we were unable to recover it. 00:30:22.148 [2024-11-20 01:31:30.250290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.148 [2024-11-20 01:31:30.250436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.148 [2024-11-20 01:31:30.250461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.148 qpair failed and we were unable to recover it. 00:30:22.148 [2024-11-20 01:31:30.250583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.148 [2024-11-20 01:31:30.250748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.148 [2024-11-20 01:31:30.250775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.148 qpair failed and we were unable to recover it. 00:30:22.148 [2024-11-20 01:31:30.250880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.148 [2024-11-20 01:31:30.250999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.148 [2024-11-20 01:31:30.251023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.148 qpair failed and we were unable to recover it. 00:30:22.148 [2024-11-20 01:31:30.251140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.148 [2024-11-20 01:31:30.251222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.148 [2024-11-20 01:31:30.251246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.148 qpair failed and we were unable to recover it. 00:30:22.148 [2024-11-20 01:31:30.251346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.148 [2024-11-20 01:31:30.251429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.148 [2024-11-20 01:31:30.251453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.148 qpair failed and we were unable to recover it. 00:30:22.148 [2024-11-20 01:31:30.251566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.148 [2024-11-20 01:31:30.251646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.148 [2024-11-20 01:31:30.251671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.148 qpair failed and we were unable to recover it. 00:30:22.148 [2024-11-20 01:31:30.251799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.148 [2024-11-20 01:31:30.251922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.148 [2024-11-20 01:31:30.251954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.148 qpair failed and we were unable to recover it. 00:30:22.148 [2024-11-20 01:31:30.252086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.148 [2024-11-20 01:31:30.252186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.148 [2024-11-20 01:31:30.252213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.148 qpair failed and we were unable to recover it. 00:30:22.148 [2024-11-20 01:31:30.252329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.148 [2024-11-20 01:31:30.252438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.148 [2024-11-20 01:31:30.252463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.148 qpair failed and we were unable to recover it. 00:30:22.148 [2024-11-20 01:31:30.252552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.148 [2024-11-20 01:31:30.252679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.148 [2024-11-20 01:31:30.252707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.148 qpair failed and we were unable to recover it. 00:30:22.148 [2024-11-20 01:31:30.252864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.148 [2024-11-20 01:31:30.253000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.148 [2024-11-20 01:31:30.253028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.148 qpair failed and we were unable to recover it. 00:30:22.148 [2024-11-20 01:31:30.253155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.149 [2024-11-20 01:31:30.253247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.149 [2024-11-20 01:31:30.253272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.149 qpair failed and we were unable to recover it. 00:30:22.149 [2024-11-20 01:31:30.253374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.149 [2024-11-20 01:31:30.253488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.149 [2024-11-20 01:31:30.253512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.149 qpair failed and we were unable to recover it. 00:30:22.149 [2024-11-20 01:31:30.253624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.149 [2024-11-20 01:31:30.253750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.149 [2024-11-20 01:31:30.253803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.149 qpair failed and we were unable to recover it. 00:30:22.149 [2024-11-20 01:31:30.253939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.149 [2024-11-20 01:31:30.254024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.149 [2024-11-20 01:31:30.254049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.149 qpair failed and we were unable to recover it. 00:30:22.149 [2024-11-20 01:31:30.254149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.149 [2024-11-20 01:31:30.254258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.149 [2024-11-20 01:31:30.254282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.149 qpair failed and we were unable to recover it. 00:30:22.149 [2024-11-20 01:31:30.254402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.149 [2024-11-20 01:31:30.254527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.149 [2024-11-20 01:31:30.254554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.149 qpair failed and we were unable to recover it. 00:30:22.149 [2024-11-20 01:31:30.254700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.149 [2024-11-20 01:31:30.254790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.149 [2024-11-20 01:31:30.254815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.149 qpair failed and we were unable to recover it. 00:30:22.149 [2024-11-20 01:31:30.254936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.149 [2024-11-20 01:31:30.255066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.149 [2024-11-20 01:31:30.255117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.149 qpair failed and we were unable to recover it. 00:30:22.149 [2024-11-20 01:31:30.255217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.149 [2024-11-20 01:31:30.255327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.149 [2024-11-20 01:31:30.255352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.149 qpair failed and we were unable to recover it. 00:30:22.149 [2024-11-20 01:31:30.255464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.149 [2024-11-20 01:31:30.255580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.149 [2024-11-20 01:31:30.255605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.149 qpair failed and we were unable to recover it. 00:30:22.149 [2024-11-20 01:31:30.255714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.149 [2024-11-20 01:31:30.255807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.149 [2024-11-20 01:31:30.255834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.149 qpair failed and we were unable to recover it. 00:30:22.149 [2024-11-20 01:31:30.255965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.149 [2024-11-20 01:31:30.256108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.149 [2024-11-20 01:31:30.256135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.149 qpair failed and we were unable to recover it. 00:30:22.149 [2024-11-20 01:31:30.256223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.149 [2024-11-20 01:31:30.256315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.149 [2024-11-20 01:31:30.256340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.149 qpair failed and we were unable to recover it. 00:30:22.149 [2024-11-20 01:31:30.256473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.149 [2024-11-20 01:31:30.256603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.149 [2024-11-20 01:31:30.256630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.149 qpair failed and we were unable to recover it. 00:30:22.149 [2024-11-20 01:31:30.256759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.149 [2024-11-20 01:31:30.256861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.149 [2024-11-20 01:31:30.256888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.149 qpair failed and we were unable to recover it. 00:30:22.149 [2024-11-20 01:31:30.256990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.149 [2024-11-20 01:31:30.257103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.149 [2024-11-20 01:31:30.257128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.149 qpair failed and we were unable to recover it. 00:30:22.149 [2024-11-20 01:31:30.257272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.149 [2024-11-20 01:31:30.257374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.149 [2024-11-20 01:31:30.257401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.149 qpair failed and we were unable to recover it. 00:30:22.149 [2024-11-20 01:31:30.257582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.149 [2024-11-20 01:31:30.257701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.149 [2024-11-20 01:31:30.257729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.149 qpair failed and we were unable to recover it. 00:30:22.149 [2024-11-20 01:31:30.257839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.149 [2024-11-20 01:31:30.257929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.149 [2024-11-20 01:31:30.257965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.149 qpair failed and we were unable to recover it. 00:30:22.149 [2024-11-20 01:31:30.258087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.149 [2024-11-20 01:31:30.258181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.149 [2024-11-20 01:31:30.258207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.149 qpair failed and we were unable to recover it. 00:30:22.149 [2024-11-20 01:31:30.258335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.149 [2024-11-20 01:31:30.258469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.149 [2024-11-20 01:31:30.258493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.149 qpair failed and we were unable to recover it. 00:30:22.149 [2024-11-20 01:31:30.258578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.149 [2024-11-20 01:31:30.258665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.149 [2024-11-20 01:31:30.258689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.149 qpair failed and we were unable to recover it. 00:30:22.149 [2024-11-20 01:31:30.258783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.149 [2024-11-20 01:31:30.258897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.149 [2024-11-20 01:31:30.258923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.149 qpair failed and we were unable to recover it. 00:30:22.149 [2024-11-20 01:31:30.259009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.149 [2024-11-20 01:31:30.259130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.149 [2024-11-20 01:31:30.259155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.149 qpair failed and we were unable to recover it. 00:30:22.149 [2024-11-20 01:31:30.259276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.149 [2024-11-20 01:31:30.259369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.149 [2024-11-20 01:31:30.259394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.149 qpair failed and we were unable to recover it. 00:30:22.149 [2024-11-20 01:31:30.259537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.149 [2024-11-20 01:31:30.259639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.149 [2024-11-20 01:31:30.259663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.149 qpair failed and we were unable to recover it. 00:30:22.149 [2024-11-20 01:31:30.259756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.149 [2024-11-20 01:31:30.259874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.149 [2024-11-20 01:31:30.259899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.149 qpair failed and we were unable to recover it. 00:30:22.149 [2024-11-20 01:31:30.260023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.149 [2024-11-20 01:31:30.260106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.149 [2024-11-20 01:31:30.260132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.149 qpair failed and we were unable to recover it. 00:30:22.149 [2024-11-20 01:31:30.260211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.149 [2024-11-20 01:31:30.260293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.149 [2024-11-20 01:31:30.260318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.149 qpair failed and we were unable to recover it. 00:30:22.150 [2024-11-20 01:31:30.260429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.150 [2024-11-20 01:31:30.260525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.150 [2024-11-20 01:31:30.260552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.150 qpair failed and we were unable to recover it. 00:30:22.150 [2024-11-20 01:31:30.260676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.150 [2024-11-20 01:31:30.260786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.150 [2024-11-20 01:31:30.260812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.150 qpair failed and we were unable to recover it. 00:30:22.150 [2024-11-20 01:31:30.260957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.150 [2024-11-20 01:31:30.261135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.150 [2024-11-20 01:31:30.261160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.150 qpair failed and we were unable to recover it. 00:30:22.150 [2024-11-20 01:31:30.261247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.150 [2024-11-20 01:31:30.261334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.150 [2024-11-20 01:31:30.261358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.150 qpair failed and we were unable to recover it. 00:30:22.150 [2024-11-20 01:31:30.261440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.150 [2024-11-20 01:31:30.261553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.150 [2024-11-20 01:31:30.261577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.150 qpair failed and we were unable to recover it. 00:30:22.150 [2024-11-20 01:31:30.261659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.150 [2024-11-20 01:31:30.261774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.150 [2024-11-20 01:31:30.261798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.150 qpair failed and we were unable to recover it. 00:30:22.150 [2024-11-20 01:31:30.261943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.150 [2024-11-20 01:31:30.262037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.150 [2024-11-20 01:31:30.262064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.150 qpair failed and we were unable to recover it. 00:30:22.150 [2024-11-20 01:31:30.262215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.150 [2024-11-20 01:31:30.262323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.150 [2024-11-20 01:31:30.262352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.150 qpair failed and we were unable to recover it. 00:30:22.150 [2024-11-20 01:31:30.262461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.150 [2024-11-20 01:31:30.262564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.150 [2024-11-20 01:31:30.262589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.150 qpair failed and we were unable to recover it. 00:30:22.150 [2024-11-20 01:31:30.262706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.150 [2024-11-20 01:31:30.262797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.150 [2024-11-20 01:31:30.262822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.150 qpair failed and we were unable to recover it. 00:30:22.150 [2024-11-20 01:31:30.262939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.150 [2024-11-20 01:31:30.263020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.150 [2024-11-20 01:31:30.263045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.150 qpair failed and we were unable to recover it. 00:30:22.150 [2024-11-20 01:31:30.263150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.150 [2024-11-20 01:31:30.263293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.150 [2024-11-20 01:31:30.263318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.150 qpair failed and we were unable to recover it. 00:30:22.150 [2024-11-20 01:31:30.263423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.150 [2024-11-20 01:31:30.263535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.150 [2024-11-20 01:31:30.263559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.150 qpair failed and we were unable to recover it. 00:30:22.150 [2024-11-20 01:31:30.263669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.150 [2024-11-20 01:31:30.263754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.150 [2024-11-20 01:31:30.263778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.150 qpair failed and we were unable to recover it. 00:30:22.150 [2024-11-20 01:31:30.263892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.150 [2024-11-20 01:31:30.264003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.150 [2024-11-20 01:31:30.264030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.150 qpair failed and we were unable to recover it. 00:30:22.150 [2024-11-20 01:31:30.264165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.150 [2024-11-20 01:31:30.264291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.150 [2024-11-20 01:31:30.264318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.150 qpair failed and we were unable to recover it. 00:30:22.150 [2024-11-20 01:31:30.264482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.150 [2024-11-20 01:31:30.264638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.150 [2024-11-20 01:31:30.264680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.150 qpair failed and we were unable to recover it. 00:30:22.150 [2024-11-20 01:31:30.264771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.150 [2024-11-20 01:31:30.264867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.150 [2024-11-20 01:31:30.264894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.150 qpair failed and we were unable to recover it. 00:30:22.150 [2024-11-20 01:31:30.265034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.150 [2024-11-20 01:31:30.265167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.150 [2024-11-20 01:31:30.265195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.150 qpair failed and we were unable to recover it. 00:30:22.150 [2024-11-20 01:31:30.265332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.150 [2024-11-20 01:31:30.265474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.150 [2024-11-20 01:31:30.265499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.150 qpair failed and we were unable to recover it. 00:30:22.150 [2024-11-20 01:31:30.266345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.150 [2024-11-20 01:31:30.266509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.150 [2024-11-20 01:31:30.266538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.150 qpair failed and we were unable to recover it. 00:30:22.150 [2024-11-20 01:31:30.266666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.150 [2024-11-20 01:31:30.266821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.150 [2024-11-20 01:31:30.266849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.150 qpair failed and we were unable to recover it. 00:30:22.150 [2024-11-20 01:31:30.266963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.150 [2024-11-20 01:31:30.267050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.150 [2024-11-20 01:31:30.267082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.150 qpair failed and we were unable to recover it. 00:30:22.150 [2024-11-20 01:31:30.267180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.150 [2024-11-20 01:31:30.267365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.150 [2024-11-20 01:31:30.267391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.150 qpair failed and we were unable to recover it. 00:30:22.150 [2024-11-20 01:31:30.267489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.150 [2024-11-20 01:31:30.267575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.150 [2024-11-20 01:31:30.267600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.150 qpair failed and we were unable to recover it. 00:30:22.150 [2024-11-20 01:31:30.267747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.150 [2024-11-20 01:31:30.267836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.150 [2024-11-20 01:31:30.267861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.150 qpair failed and we were unable to recover it. 00:30:22.150 [2024-11-20 01:31:30.267982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.150 [2024-11-20 01:31:30.268123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.150 [2024-11-20 01:31:30.268149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.150 qpair failed and we were unable to recover it. 00:30:22.150 [2024-11-20 01:31:30.268232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.150 [2024-11-20 01:31:30.268326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.150 [2024-11-20 01:31:30.268351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.150 qpair failed and we were unable to recover it. 00:30:22.150 [2024-11-20 01:31:30.268499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.150 [2024-11-20 01:31:30.268614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.150 [2024-11-20 01:31:30.268640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.151 qpair failed and we were unable to recover it. 00:30:22.151 [2024-11-20 01:31:30.268750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.151 [2024-11-20 01:31:30.268876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.151 [2024-11-20 01:31:30.268903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.151 qpair failed and we were unable to recover it. 00:30:22.151 [2024-11-20 01:31:30.269045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.151 [2024-11-20 01:31:30.269183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.151 [2024-11-20 01:31:30.269209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.151 qpair failed and we were unable to recover it. 00:30:22.151 [2024-11-20 01:31:30.269307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.151 [2024-11-20 01:31:30.269394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.151 [2024-11-20 01:31:30.269419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.151 qpair failed and we were unable to recover it. 00:30:22.151 [2024-11-20 01:31:30.269535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.151 [2024-11-20 01:31:30.269656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.151 [2024-11-20 01:31:30.269681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.151 qpair failed and we were unable to recover it. 00:30:22.151 [2024-11-20 01:31:30.269811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.151 [2024-11-20 01:31:30.269910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.151 [2024-11-20 01:31:30.269938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.151 qpair failed and we were unable to recover it. 00:30:22.151 [2024-11-20 01:31:30.270053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.151 [2024-11-20 01:31:30.270156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.151 [2024-11-20 01:31:30.270182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.151 qpair failed and we were unable to recover it. 00:30:22.151 [2024-11-20 01:31:30.270298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.151 [2024-11-20 01:31:30.270393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.151 [2024-11-20 01:31:30.270418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.151 qpair failed and we were unable to recover it. 00:30:22.151 [2024-11-20 01:31:30.270565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.151 [2024-11-20 01:31:30.270699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.151 [2024-11-20 01:31:30.270727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.151 qpair failed and we were unable to recover it. 00:30:22.151 [2024-11-20 01:31:30.270860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.151 [2024-11-20 01:31:30.270946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.151 [2024-11-20 01:31:30.270971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.151 qpair failed and we were unable to recover it. 00:30:22.151 [2024-11-20 01:31:30.271106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.151 [2024-11-20 01:31:30.271226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.151 [2024-11-20 01:31:30.271254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.151 qpair failed and we were unable to recover it. 00:30:22.151 [2024-11-20 01:31:30.271384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.151 [2024-11-20 01:31:30.271485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.151 [2024-11-20 01:31:30.271513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.151 qpair failed and we were unable to recover it. 00:30:22.151 [2024-11-20 01:31:30.271658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.151 [2024-11-20 01:31:30.271773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.151 [2024-11-20 01:31:30.271797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.151 qpair failed and we were unable to recover it. 00:30:22.151 [2024-11-20 01:31:30.271876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.151 [2024-11-20 01:31:30.272050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.151 [2024-11-20 01:31:30.272086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.151 qpair failed and we were unable to recover it. 00:30:22.151 [2024-11-20 01:31:30.272191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.151 [2024-11-20 01:31:30.272338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.151 [2024-11-20 01:31:30.272363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.151 qpair failed and we were unable to recover it. 00:30:22.151 [2024-11-20 01:31:30.272455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.151 [2024-11-20 01:31:30.272598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.151 [2024-11-20 01:31:30.272623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.151 qpair failed and we were unable to recover it. 00:30:22.151 [2024-11-20 01:31:30.272727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.151 [2024-11-20 01:31:30.272862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.151 [2024-11-20 01:31:30.272887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.151 qpair failed and we were unable to recover it. 00:30:22.151 [2024-11-20 01:31:30.273017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.151 [2024-11-20 01:31:30.273122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.151 [2024-11-20 01:31:30.273167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.151 qpair failed and we were unable to recover it. 00:30:22.151 [2024-11-20 01:31:30.273284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.151 [2024-11-20 01:31:30.273406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.151 [2024-11-20 01:31:30.273431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.151 qpair failed and we were unable to recover it. 00:30:22.151 [2024-11-20 01:31:30.273539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.151 [2024-11-20 01:31:30.273634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.151 [2024-11-20 01:31:30.273658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.151 qpair failed and we were unable to recover it. 00:30:22.151 [2024-11-20 01:31:30.273770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.151 [2024-11-20 01:31:30.273878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.151 [2024-11-20 01:31:30.273919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.151 qpair failed and we were unable to recover it. 00:30:22.151 [2024-11-20 01:31:30.274035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.151 [2024-11-20 01:31:30.274210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.151 [2024-11-20 01:31:30.274236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.151 qpair failed and we were unable to recover it. 00:30:22.151 [2024-11-20 01:31:30.274393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.151 [2024-11-20 01:31:30.274497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.151 [2024-11-20 01:31:30.274539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.151 qpair failed and we were unable to recover it. 00:30:22.151 [2024-11-20 01:31:30.274634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.151 [2024-11-20 01:31:30.274744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.151 [2024-11-20 01:31:30.274769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.151 qpair failed and we were unable to recover it. 00:30:22.151 [2024-11-20 01:31:30.274885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.151 [2024-11-20 01:31:30.274967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.151 [2024-11-20 01:31:30.274992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.151 qpair failed and we were unable to recover it. 00:30:22.151 [2024-11-20 01:31:30.275085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.151 [2024-11-20 01:31:30.275228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.151 [2024-11-20 01:31:30.275253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.151 qpair failed and we were unable to recover it. 00:30:22.151 [2024-11-20 01:31:30.275389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.151 [2024-11-20 01:31:30.275516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.151 [2024-11-20 01:31:30.275560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.151 qpair failed and we were unable to recover it. 00:30:22.151 [2024-11-20 01:31:30.275683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.151 [2024-11-20 01:31:30.275792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.151 [2024-11-20 01:31:30.275816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.151 qpair failed and we were unable to recover it. 00:30:22.151 [2024-11-20 01:31:30.275921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.151 [2024-11-20 01:31:30.276049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.151 [2024-11-20 01:31:30.276083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.151 qpair failed and we were unable to recover it. 00:30:22.152 [2024-11-20 01:31:30.276191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.152 [2024-11-20 01:31:30.276330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.152 [2024-11-20 01:31:30.276355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.152 qpair failed and we were unable to recover it. 00:30:22.152 [2024-11-20 01:31:30.276474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.152 [2024-11-20 01:31:30.276559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.152 [2024-11-20 01:31:30.276587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.152 qpair failed and we were unable to recover it. 00:30:22.152 [2024-11-20 01:31:30.276731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.152 [2024-11-20 01:31:30.276854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.152 [2024-11-20 01:31:30.276882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.152 qpair failed and we were unable to recover it. 00:30:22.152 [2024-11-20 01:31:30.277019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.152 [2024-11-20 01:31:30.277152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.152 [2024-11-20 01:31:30.277180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.152 qpair failed and we were unable to recover it. 00:30:22.152 [2024-11-20 01:31:30.277284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.152 [2024-11-20 01:31:30.277395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.152 [2024-11-20 01:31:30.277430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.152 qpair failed and we were unable to recover it. 00:30:22.152 [2024-11-20 01:31:30.277514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.152 [2024-11-20 01:31:30.277645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.152 [2024-11-20 01:31:30.277673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.152 qpair failed and we were unable to recover it. 00:30:22.152 [2024-11-20 01:31:30.277811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.152 [2024-11-20 01:31:30.277948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.152 [2024-11-20 01:31:30.277976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.152 qpair failed and we were unable to recover it. 00:30:22.152 [2024-11-20 01:31:30.278103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.152 [2024-11-20 01:31:30.278191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.152 [2024-11-20 01:31:30.278216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.152 qpair failed and we were unable to recover it. 00:30:22.152 [2024-11-20 01:31:30.278330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.152 [2024-11-20 01:31:30.278451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.152 [2024-11-20 01:31:30.278492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.152 qpair failed and we were unable to recover it. 00:30:22.152 [2024-11-20 01:31:30.278600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.152 [2024-11-20 01:31:30.278749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.152 [2024-11-20 01:31:30.278775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.152 qpair failed and we were unable to recover it. 00:30:22.152 [2024-11-20 01:31:30.278938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.152 [2024-11-20 01:31:30.279118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.152 [2024-11-20 01:31:30.279144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.152 qpair failed and we were unable to recover it. 00:30:22.152 [2024-11-20 01:31:30.279261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.152 [2024-11-20 01:31:30.279386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.152 [2024-11-20 01:31:30.279411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.152 qpair failed and we were unable to recover it. 00:30:22.152 [2024-11-20 01:31:30.279546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.152 [2024-11-20 01:31:30.279662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.152 [2024-11-20 01:31:30.279691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.152 qpair failed and we were unable to recover it. 00:30:22.152 [2024-11-20 01:31:30.279800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.152 [2024-11-20 01:31:30.279891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.152 [2024-11-20 01:31:30.279916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.152 qpair failed and we were unable to recover it. 00:30:22.152 [2024-11-20 01:31:30.279994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.152 [2024-11-20 01:31:30.280098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.152 [2024-11-20 01:31:30.280139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.152 qpair failed and we were unable to recover it. 00:30:22.152 [2024-11-20 01:31:30.280265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.152 [2024-11-20 01:31:30.280413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.152 [2024-11-20 01:31:30.280438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.152 qpair failed and we were unable to recover it. 00:30:22.152 [2024-11-20 01:31:30.280543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.152 [2024-11-20 01:31:30.280663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.152 [2024-11-20 01:31:30.280688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.152 qpair failed and we were unable to recover it. 00:30:22.152 [2024-11-20 01:31:30.280783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.152 [2024-11-20 01:31:30.280864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.152 [2024-11-20 01:31:30.280889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.152 qpair failed and we were unable to recover it. 00:30:22.152 [2024-11-20 01:31:30.281008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.152 [2024-11-20 01:31:30.281096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.152 [2024-11-20 01:31:30.281122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.152 qpair failed and we were unable to recover it. 00:30:22.152 [2024-11-20 01:31:30.281239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.152 [2024-11-20 01:31:30.281352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.152 [2024-11-20 01:31:30.281377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.152 qpair failed and we were unable to recover it. 00:30:22.152 [2024-11-20 01:31:30.281487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.152 [2024-11-20 01:31:30.281616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.152 [2024-11-20 01:31:30.281658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.152 qpair failed and we were unable to recover it. 00:30:22.152 [2024-11-20 01:31:30.281756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.152 [2024-11-20 01:31:30.281868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.152 [2024-11-20 01:31:30.281909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.152 qpair failed and we were unable to recover it. 00:30:22.152 [2024-11-20 01:31:30.282077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.152 [2024-11-20 01:31:30.282189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.152 [2024-11-20 01:31:30.282214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.152 qpair failed and we were unable to recover it. 00:30:22.152 [2024-11-20 01:31:30.282324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.152 [2024-11-20 01:31:30.282461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.152 [2024-11-20 01:31:30.282487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.152 qpair failed and we were unable to recover it. 00:30:22.152 [2024-11-20 01:31:30.282564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.152 [2024-11-20 01:31:30.282672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.152 [2024-11-20 01:31:30.282697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.153 qpair failed and we were unable to recover it. 00:30:22.153 [2024-11-20 01:31:30.282828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.153 [2024-11-20 01:31:30.282942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.153 [2024-11-20 01:31:30.282967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.153 qpair failed and we were unable to recover it. 00:30:22.153 [2024-11-20 01:31:30.283134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.153 [2024-11-20 01:31:30.283253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.153 [2024-11-20 01:31:30.283278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.153 qpair failed and we were unable to recover it. 00:30:22.153 [2024-11-20 01:31:30.283359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.153 [2024-11-20 01:31:30.283495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.153 [2024-11-20 01:31:30.283523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.153 qpair failed and we were unable to recover it. 00:30:22.153 [2024-11-20 01:31:30.283633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.153 [2024-11-20 01:31:30.283754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.153 [2024-11-20 01:31:30.283778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.153 qpair failed and we were unable to recover it. 00:30:22.153 [2024-11-20 01:31:30.283901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.153 [2024-11-20 01:31:30.283993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.153 [2024-11-20 01:31:30.284018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.153 qpair failed and we were unable to recover it. 00:30:22.153 [2024-11-20 01:31:30.284118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.153 [2024-11-20 01:31:30.284227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.153 [2024-11-20 01:31:30.284255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.153 qpair failed and we were unable to recover it. 00:30:22.153 [2024-11-20 01:31:30.284367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.153 [2024-11-20 01:31:30.284487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.153 [2024-11-20 01:31:30.284512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.153 qpair failed and we were unable to recover it. 00:30:22.153 [2024-11-20 01:31:30.284653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.153 [2024-11-20 01:31:30.284795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.153 [2024-11-20 01:31:30.284824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.153 qpair failed and we were unable to recover it. 00:30:22.153 [2024-11-20 01:31:30.284952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.153 [2024-11-20 01:31:30.285047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.153 [2024-11-20 01:31:30.285083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.153 qpair failed and we were unable to recover it. 00:30:22.153 [2024-11-20 01:31:30.285200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.153 [2024-11-20 01:31:30.285285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.153 [2024-11-20 01:31:30.285310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.153 qpair failed and we were unable to recover it. 00:30:22.153 [2024-11-20 01:31:30.285444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.153 [2024-11-20 01:31:30.285578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.153 [2024-11-20 01:31:30.285605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.153 qpair failed and we were unable to recover it. 00:30:22.153 [2024-11-20 01:31:30.285710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.153 [2024-11-20 01:31:30.285842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.153 [2024-11-20 01:31:30.285869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.153 qpair failed and we were unable to recover it. 00:30:22.153 [2024-11-20 01:31:30.285986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.153 [2024-11-20 01:31:30.286119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.153 [2024-11-20 01:31:30.286145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.153 qpair failed and we were unable to recover it. 00:30:22.153 [2024-11-20 01:31:30.286303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.153 [2024-11-20 01:31:30.286428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.153 [2024-11-20 01:31:30.286456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.153 qpair failed and we were unable to recover it. 00:30:22.153 [2024-11-20 01:31:30.286556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.153 [2024-11-20 01:31:30.286722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.153 [2024-11-20 01:31:30.286748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.153 qpair failed and we were unable to recover it. 00:30:22.153 [2024-11-20 01:31:30.286862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.153 [2024-11-20 01:31:30.286953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.153 [2024-11-20 01:31:30.286978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.153 qpair failed and we were unable to recover it. 00:30:22.153 [2024-11-20 01:31:30.287064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.153 [2024-11-20 01:31:30.287166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.153 [2024-11-20 01:31:30.287192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.153 qpair failed and we were unable to recover it. 00:30:22.153 [2024-11-20 01:31:30.287301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.153 [2024-11-20 01:31:30.287388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.153 [2024-11-20 01:31:30.287445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.153 qpair failed and we were unable to recover it. 00:30:22.153 [2024-11-20 01:31:30.287613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.153 [2024-11-20 01:31:30.287726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.153 [2024-11-20 01:31:30.287751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.153 qpair failed and we were unable to recover it. 00:30:22.153 [2024-11-20 01:31:30.287869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.153 [2024-11-20 01:31:30.287997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.153 [2024-11-20 01:31:30.288024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.153 qpair failed and we were unable to recover it. 00:30:22.153 [2024-11-20 01:31:30.288163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.153 [2024-11-20 01:31:30.288288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.153 [2024-11-20 01:31:30.288316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.153 qpair failed and we were unable to recover it. 00:30:22.153 [2024-11-20 01:31:30.288493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.153 [2024-11-20 01:31:30.288638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.153 [2024-11-20 01:31:30.288674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.153 qpair failed and we were unable to recover it. 00:30:22.153 [2024-11-20 01:31:30.288788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.153 [2024-11-20 01:31:30.288923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.153 [2024-11-20 01:31:30.288952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.153 qpair failed and we were unable to recover it. 00:30:22.153 [2024-11-20 01:31:30.289087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.153 [2024-11-20 01:31:30.289222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.153 [2024-11-20 01:31:30.289250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.153 qpair failed and we were unable to recover it. 00:30:22.153 [2024-11-20 01:31:30.289359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.153 [2024-11-20 01:31:30.289446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.153 [2024-11-20 01:31:30.289471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.153 qpair failed and we were unable to recover it. 00:30:22.153 [2024-11-20 01:31:30.289581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.153 [2024-11-20 01:31:30.289725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.153 [2024-11-20 01:31:30.289753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.153 qpair failed and we were unable to recover it. 00:30:22.153 [2024-11-20 01:31:30.289891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.153 [2024-11-20 01:31:30.290005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.153 [2024-11-20 01:31:30.290030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.153 qpair failed and we were unable to recover it. 00:30:22.153 [2024-11-20 01:31:30.290175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.153 [2024-11-20 01:31:30.290292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.153 [2024-11-20 01:31:30.290321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.153 qpair failed and we were unable to recover it. 00:30:22.154 [2024-11-20 01:31:30.290440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.154 [2024-11-20 01:31:30.290568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.154 [2024-11-20 01:31:30.290609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.154 qpair failed and we were unable to recover it. 00:30:22.154 [2024-11-20 01:31:30.290698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.154 [2024-11-20 01:31:30.290815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.154 [2024-11-20 01:31:30.290840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.154 qpair failed and we were unable to recover it. 00:30:22.154 [2024-11-20 01:31:30.290928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.154 [2024-11-20 01:31:30.291084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.154 [2024-11-20 01:31:30.291110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.154 qpair failed and we were unable to recover it. 00:30:22.154 [2024-11-20 01:31:30.291250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.154 [2024-11-20 01:31:30.291386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.154 [2024-11-20 01:31:30.291413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.154 qpair failed and we were unable to recover it. 00:30:22.154 [2024-11-20 01:31:30.291535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.154 [2024-11-20 01:31:30.291644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.154 [2024-11-20 01:31:30.291669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.154 qpair failed and we were unable to recover it. 00:30:22.154 [2024-11-20 01:31:30.291788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.154 [2024-11-20 01:31:30.291904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.154 [2024-11-20 01:31:30.291929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.154 qpair failed and we were unable to recover it. 00:30:22.154 [2024-11-20 01:31:30.292058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.154 [2024-11-20 01:31:30.292174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.154 [2024-11-20 01:31:30.292203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.154 qpair failed and we were unable to recover it. 00:30:22.154 [2024-11-20 01:31:30.292300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.154 [2024-11-20 01:31:30.292433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.154 [2024-11-20 01:31:30.292460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.154 qpair failed and we were unable to recover it. 00:30:22.154 [2024-11-20 01:31:30.292635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.154 [2024-11-20 01:31:30.292725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.154 [2024-11-20 01:31:30.292750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.154 qpair failed and we were unable to recover it. 00:30:22.154 [2024-11-20 01:31:30.292845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.154 [2024-11-20 01:31:30.293006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.154 [2024-11-20 01:31:30.293032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.154 qpair failed and we were unable to recover it. 00:30:22.154 [2024-11-20 01:31:30.293174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.154 [2024-11-20 01:31:30.293284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.154 [2024-11-20 01:31:30.293309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.154 qpair failed and we were unable to recover it. 00:30:22.154 [2024-11-20 01:31:30.293446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.154 [2024-11-20 01:31:30.293530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.154 [2024-11-20 01:31:30.293556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.154 qpair failed and we were unable to recover it. 00:30:22.154 [2024-11-20 01:31:30.293668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.154 [2024-11-20 01:31:30.293758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.154 [2024-11-20 01:31:30.293783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.154 qpair failed and we were unable to recover it. 00:30:22.154 [2024-11-20 01:31:30.293919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.154 [2024-11-20 01:31:30.294098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.154 [2024-11-20 01:31:30.294124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.154 qpair failed and we were unable to recover it. 00:30:22.154 [2024-11-20 01:31:30.294213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.154 [2024-11-20 01:31:30.294330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.154 [2024-11-20 01:31:30.294355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.154 qpair failed and we were unable to recover it. 00:30:22.154 [2024-11-20 01:31:30.294457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.154 [2024-11-20 01:31:30.294583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.154 [2024-11-20 01:31:30.294607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.154 qpair failed and we were unable to recover it. 00:30:22.154 [2024-11-20 01:31:30.294745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.154 [2024-11-20 01:31:30.294875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.154 [2024-11-20 01:31:30.294903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.154 qpair failed and we were unable to recover it. 00:30:22.154 [2024-11-20 01:31:30.295035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.154 [2024-11-20 01:31:30.295151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.154 [2024-11-20 01:31:30.295177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.154 qpair failed and we were unable to recover it. 00:30:22.154 [2024-11-20 01:31:30.295296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.154 [2024-11-20 01:31:30.295383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.154 [2024-11-20 01:31:30.295408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.154 qpair failed and we were unable to recover it. 00:30:22.154 [2024-11-20 01:31:30.295500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.154 [2024-11-20 01:31:30.295574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.154 [2024-11-20 01:31:30.295599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b390 with addr=10.0.0.2, port=4420 00:30:22.154 qpair failed and we were unable to recover it. 00:30:22.154 [2024-11-20 01:31:30.295740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.154 [2024-11-20 01:31:30.295883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.154 [2024-11-20 01:31:30.295929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.154 qpair failed and we were unable to recover it. 00:30:22.154 [2024-11-20 01:31:30.296053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.154 [2024-11-20 01:31:30.296158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.154 [2024-11-20 01:31:30.296183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.154 qpair failed and we were unable to recover it. 00:30:22.154 [2024-11-20 01:31:30.296327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.154 [2024-11-20 01:31:30.296417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.154 [2024-11-20 01:31:30.296442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.154 qpair failed and we were unable to recover it. 00:30:22.154 [2024-11-20 01:31:30.296558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.154 [2024-11-20 01:31:30.296675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.154 [2024-11-20 01:31:30.296700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.154 qpair failed and we were unable to recover it. 00:30:22.154 [2024-11-20 01:31:30.296797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.154 [2024-11-20 01:31:30.296937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.154 [2024-11-20 01:31:30.296962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.154 qpair failed and we were unable to recover it. 00:30:22.154 [2024-11-20 01:31:30.297104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.154 [2024-11-20 01:31:30.297215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.154 [2024-11-20 01:31:30.297240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.154 qpair failed and we were unable to recover it. 00:30:22.154 [2024-11-20 01:31:30.297353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.154 [2024-11-20 01:31:30.297482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.155 [2024-11-20 01:31:30.297509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.155 qpair failed and we were unable to recover it. 00:30:22.155 [2024-11-20 01:31:30.297613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.155 [2024-11-20 01:31:30.297725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.155 [2024-11-20 01:31:30.297750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.155 qpair failed and we were unable to recover it. 00:30:22.155 [2024-11-20 01:31:30.297864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.155 [2024-11-20 01:31:30.297948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.155 [2024-11-20 01:31:30.297975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.155 qpair failed and we were unable to recover it. 00:30:22.155 [2024-11-20 01:31:30.298096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.155 [2024-11-20 01:31:30.298214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.155 [2024-11-20 01:31:30.298241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.155 qpair failed and we were unable to recover it. 00:30:22.155 [2024-11-20 01:31:30.298341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.155 [2024-11-20 01:31:30.298462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.155 [2024-11-20 01:31:30.298486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.155 qpair failed and we were unable to recover it. 00:30:22.155 [2024-11-20 01:31:30.298568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.155 [2024-11-20 01:31:30.298672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.155 [2024-11-20 01:31:30.298696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.155 qpair failed and we were unable to recover it. 00:30:22.155 [2024-11-20 01:31:30.298792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.155 [2024-11-20 01:31:30.298891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.155 [2024-11-20 01:31:30.298917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.155 qpair failed and we were unable to recover it. 00:30:22.155 [2024-11-20 01:31:30.299082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.155 [2024-11-20 01:31:30.299198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.155 [2024-11-20 01:31:30.299223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.155 qpair failed and we were unable to recover it. 00:30:22.155 [2024-11-20 01:31:30.299317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.155 [2024-11-20 01:31:30.299421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.155 [2024-11-20 01:31:30.299448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.155 qpair failed and we were unable to recover it. 00:30:22.155 [2024-11-20 01:31:30.299567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.155 [2024-11-20 01:31:30.299656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.155 [2024-11-20 01:31:30.299682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.155 qpair failed and we were unable to recover it. 00:30:22.155 [2024-11-20 01:31:30.299766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.155 [2024-11-20 01:31:30.299860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.155 [2024-11-20 01:31:30.299884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.155 qpair failed and we were unable to recover it. 00:30:22.155 [2024-11-20 01:31:30.299978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.155 [2024-11-20 01:31:30.300057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.155 [2024-11-20 01:31:30.300098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.155 qpair failed and we were unable to recover it. 00:30:22.155 [2024-11-20 01:31:30.300191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.155 [2024-11-20 01:31:30.300306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.155 [2024-11-20 01:31:30.300331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.155 qpair failed and we were unable to recover it. 00:30:22.155 [2024-11-20 01:31:30.300479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.155 [2024-11-20 01:31:30.300601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.155 [2024-11-20 01:31:30.300626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.155 qpair failed and we were unable to recover it. 00:30:22.155 [2024-11-20 01:31:30.300720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.155 [2024-11-20 01:31:30.300821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.155 [2024-11-20 01:31:30.300848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.155 qpair failed and we were unable to recover it. 00:30:22.155 [2024-11-20 01:31:30.300995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.155 [2024-11-20 01:31:30.301121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.155 [2024-11-20 01:31:30.301146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.155 qpair failed and we were unable to recover it. 00:30:22.155 [2024-11-20 01:31:30.301242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.155 [2024-11-20 01:31:30.301354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.155 [2024-11-20 01:31:30.301378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.155 qpair failed and we were unable to recover it. 00:30:22.155 [2024-11-20 01:31:30.301490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.155 [2024-11-20 01:31:30.301638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.155 [2024-11-20 01:31:30.301663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.155 qpair failed and we were unable to recover it. 00:30:22.155 [2024-11-20 01:31:30.301780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.155 [2024-11-20 01:31:30.301892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.155 [2024-11-20 01:31:30.301917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.155 qpair failed and we were unable to recover it. 00:30:22.155 [2024-11-20 01:31:30.302031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.155 [2024-11-20 01:31:30.302137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.155 [2024-11-20 01:31:30.302163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.155 qpair failed and we were unable to recover it. 00:30:22.155 [2024-11-20 01:31:30.302258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.155 [2024-11-20 01:31:30.302341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.155 [2024-11-20 01:31:30.302367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.155 qpair failed and we were unable to recover it. 00:30:22.155 [2024-11-20 01:31:30.302489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.155 [2024-11-20 01:31:30.302600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.155 [2024-11-20 01:31:30.302624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.155 qpair failed and we were unable to recover it. 00:30:22.155 [2024-11-20 01:31:30.302721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.155 [2024-11-20 01:31:30.302836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.155 [2024-11-20 01:31:30.302861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.155 qpair failed and we were unable to recover it. 00:30:22.155 [2024-11-20 01:31:30.302952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.438 [2024-11-20 01:31:30.303065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.438 [2024-11-20 01:31:30.303106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.438 qpair failed and we were unable to recover it. 00:30:22.438 [2024-11-20 01:31:30.303231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.438 [2024-11-20 01:31:30.303353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.438 [2024-11-20 01:31:30.303379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.438 qpair failed and we were unable to recover it. 00:30:22.438 [2024-11-20 01:31:30.303505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.438 [2024-11-20 01:31:30.303592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.438 [2024-11-20 01:31:30.303617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.438 qpair failed and we were unable to recover it. 00:30:22.438 [2024-11-20 01:31:30.303767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.438 [2024-11-20 01:31:30.303860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.438 [2024-11-20 01:31:30.303885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.438 qpair failed and we were unable to recover it. 00:30:22.438 [2024-11-20 01:31:30.303979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.438 [2024-11-20 01:31:30.304080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.438 [2024-11-20 01:31:30.304106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.438 qpair failed and we were unable to recover it. 00:30:22.438 [2024-11-20 01:31:30.304196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.438 [2024-11-20 01:31:30.304279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.438 [2024-11-20 01:31:30.304303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.438 qpair failed and we were unable to recover it. 00:30:22.439 [2024-11-20 01:31:30.304402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.439 [2024-11-20 01:31:30.304491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.439 [2024-11-20 01:31:30.304516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.439 qpair failed and we were unable to recover it. 00:30:22.439 [2024-11-20 01:31:30.304608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.439 [2024-11-20 01:31:30.304694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.439 [2024-11-20 01:31:30.304719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.439 qpair failed and we were unable to recover it. 00:30:22.439 [2024-11-20 01:31:30.304834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.439 [2024-11-20 01:31:30.304949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.439 [2024-11-20 01:31:30.304974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.439 qpair failed and we were unable to recover it. 00:30:22.439 [2024-11-20 01:31:30.305097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.439 [2024-11-20 01:31:30.305211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.439 [2024-11-20 01:31:30.305235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.439 qpair failed and we were unable to recover it. 00:30:22.439 [2024-11-20 01:31:30.305324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.439 [2024-11-20 01:31:30.305413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.439 [2024-11-20 01:31:30.305439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.439 qpair failed and we were unable to recover it. 00:30:22.439 [2024-11-20 01:31:30.305530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.439 [2024-11-20 01:31:30.305643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.439 [2024-11-20 01:31:30.305668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.439 qpair failed and we were unable to recover it. 00:30:22.439 [2024-11-20 01:31:30.305771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.439 [2024-11-20 01:31:30.305877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.439 [2024-11-20 01:31:30.305901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.439 qpair failed and we were unable to recover it. 00:30:22.439 [2024-11-20 01:31:30.306044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.439 [2024-11-20 01:31:30.306139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.439 [2024-11-20 01:31:30.306166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.439 qpair failed and we were unable to recover it. 00:30:22.439 [2024-11-20 01:31:30.306270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.439 [2024-11-20 01:31:30.306392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.439 [2024-11-20 01:31:30.306417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.439 qpair failed and we were unable to recover it. 00:30:22.439 [2024-11-20 01:31:30.306499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.439 [2024-11-20 01:31:30.306589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.439 [2024-11-20 01:31:30.306615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.439 qpair failed and we were unable to recover it. 00:30:22.439 [2024-11-20 01:31:30.306733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.439 [2024-11-20 01:31:30.306821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.439 [2024-11-20 01:31:30.306846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.439 qpair failed and we were unable to recover it. 00:30:22.439 [2024-11-20 01:31:30.306962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.439 [2024-11-20 01:31:30.307050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.439 [2024-11-20 01:31:30.307080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.439 qpair failed and we were unable to recover it. 00:30:22.439 [2024-11-20 01:31:30.307194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.439 [2024-11-20 01:31:30.307278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.439 [2024-11-20 01:31:30.307302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.439 qpair failed and we were unable to recover it. 00:30:22.439 [2024-11-20 01:31:30.307392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.439 [2024-11-20 01:31:30.307504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.439 [2024-11-20 01:31:30.307529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.439 qpair failed and we were unable to recover it. 00:30:22.439 [2024-11-20 01:31:30.307649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.439 [2024-11-20 01:31:30.307747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.439 [2024-11-20 01:31:30.307771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.439 qpair failed and we were unable to recover it. 00:30:22.439 [2024-11-20 01:31:30.307887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.439 [2024-11-20 01:31:30.307982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.439 [2024-11-20 01:31:30.308007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.439 qpair failed and we were unable to recover it. 00:30:22.439 [2024-11-20 01:31:30.308133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.439 [2024-11-20 01:31:30.308228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.439 [2024-11-20 01:31:30.308253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.439 qpair failed and we were unable to recover it. 00:30:22.439 [2024-11-20 01:31:30.308345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.439 [2024-11-20 01:31:30.308431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.439 [2024-11-20 01:31:30.308454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.439 qpair failed and we were unable to recover it. 00:30:22.439 [2024-11-20 01:31:30.308582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.439 [2024-11-20 01:31:30.308703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.439 [2024-11-20 01:31:30.308728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.439 qpair failed and we were unable to recover it. 00:30:22.439 [2024-11-20 01:31:30.308843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.439 [2024-11-20 01:31:30.308963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.439 [2024-11-20 01:31:30.308988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.439 qpair failed and we were unable to recover it. 00:30:22.439 [2024-11-20 01:31:30.309083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.439 [2024-11-20 01:31:30.309177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.439 [2024-11-20 01:31:30.309203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.439 qpair failed and we were unable to recover it. 00:30:22.439 [2024-11-20 01:31:30.309297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.439 [2024-11-20 01:31:30.309406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.439 [2024-11-20 01:31:30.309434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.439 qpair failed and we were unable to recover it. 00:30:22.439 [2024-11-20 01:31:30.309517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.439 [2024-11-20 01:31:30.309608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.439 [2024-11-20 01:31:30.309634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.439 qpair failed and we were unable to recover it. 00:30:22.439 [2024-11-20 01:31:30.309753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.439 [2024-11-20 01:31:30.309872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.439 [2024-11-20 01:31:30.309896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.439 qpair failed and we were unable to recover it. 00:30:22.439 [2024-11-20 01:31:30.310014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.439 [2024-11-20 01:31:30.310100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.439 [2024-11-20 01:31:30.310125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.439 qpair failed and we were unable to recover it. 00:30:22.439 [2024-11-20 01:31:30.310213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.439 [2024-11-20 01:31:30.310332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.439 [2024-11-20 01:31:30.310362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.439 qpair failed and we were unable to recover it. 00:30:22.439 [2024-11-20 01:31:30.310475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.439 [2024-11-20 01:31:30.310597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.439 [2024-11-20 01:31:30.310622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.439 qpair failed and we were unable to recover it. 00:30:22.439 [2024-11-20 01:31:30.310714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.439 [2024-11-20 01:31:30.310834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.439 [2024-11-20 01:31:30.310858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.439 qpair failed and we were unable to recover it. 00:30:22.440 [2024-11-20 01:31:30.310953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.440 [2024-11-20 01:31:30.311073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.440 [2024-11-20 01:31:30.311099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.440 qpair failed and we were unable to recover it. 00:30:22.440 [2024-11-20 01:31:30.311182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.440 [2024-11-20 01:31:30.311278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.440 [2024-11-20 01:31:30.311303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.440 qpair failed and we were unable to recover it. 00:30:22.440 [2024-11-20 01:31:30.311390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.440 [2024-11-20 01:31:30.311479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.440 [2024-11-20 01:31:30.311502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.440 qpair failed and we were unable to recover it. 00:30:22.440 [2024-11-20 01:31:30.311589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.440 [2024-11-20 01:31:30.311678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.440 [2024-11-20 01:31:30.311703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.440 qpair failed and we were unable to recover it. 00:30:22.440 [2024-11-20 01:31:30.311824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.440 [2024-11-20 01:31:30.311908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.440 [2024-11-20 01:31:30.311933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.440 qpair failed and we were unable to recover it. 00:30:22.440 [2024-11-20 01:31:30.312020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.440 [2024-11-20 01:31:30.312107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.440 [2024-11-20 01:31:30.312132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.440 qpair failed and we were unable to recover it. 00:30:22.440 [2024-11-20 01:31:30.312226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.440 [2024-11-20 01:31:30.312338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.440 [2024-11-20 01:31:30.312362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.440 qpair failed and we were unable to recover it. 00:30:22.440 [2024-11-20 01:31:30.312452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.440 [2024-11-20 01:31:30.312543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.440 [2024-11-20 01:31:30.312572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.440 qpair failed and we were unable to recover it. 00:30:22.440 [2024-11-20 01:31:30.312690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.440 [2024-11-20 01:31:30.312791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.440 [2024-11-20 01:31:30.312815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.440 qpair failed and we were unable to recover it. 00:30:22.440 [2024-11-20 01:31:30.312910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.440 [2024-11-20 01:31:30.313001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.440 [2024-11-20 01:31:30.313027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.440 qpair failed and we were unable to recover it. 00:30:22.440 [2024-11-20 01:31:30.313143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.440 [2024-11-20 01:31:30.313235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.440 [2024-11-20 01:31:30.313261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.440 qpair failed and we were unable to recover it. 00:30:22.440 [2024-11-20 01:31:30.313361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.440 [2024-11-20 01:31:30.313474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.440 [2024-11-20 01:31:30.313499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.440 qpair failed and we were unable to recover it. 00:30:22.440 [2024-11-20 01:31:30.313616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.440 [2024-11-20 01:31:30.313703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.440 [2024-11-20 01:31:30.313727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.440 qpair failed and we were unable to recover it. 00:30:22.440 [2024-11-20 01:31:30.313848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.440 [2024-11-20 01:31:30.313987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.440 [2024-11-20 01:31:30.314011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.440 qpair failed and we were unable to recover it. 00:30:22.440 [2024-11-20 01:31:30.314101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.440 [2024-11-20 01:31:30.314192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.440 [2024-11-20 01:31:30.314216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.440 qpair failed and we were unable to recover it. 00:30:22.440 [2024-11-20 01:31:30.314303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.440 [2024-11-20 01:31:30.314453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.440 [2024-11-20 01:31:30.314478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.440 qpair failed and we were unable to recover it. 00:30:22.440 [2024-11-20 01:31:30.314593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.440 [2024-11-20 01:31:30.314731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.440 [2024-11-20 01:31:30.314756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.440 qpair failed and we were unable to recover it. 00:30:22.440 [2024-11-20 01:31:30.314909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.440 [2024-11-20 01:31:30.315031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.440 [2024-11-20 01:31:30.315060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.440 qpair failed and we were unable to recover it. 00:30:22.440 [2024-11-20 01:31:30.315190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.440 [2024-11-20 01:31:30.315316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.440 [2024-11-20 01:31:30.315344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.440 qpair failed and we were unable to recover it. 00:30:22.440 [2024-11-20 01:31:30.315492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.440 [2024-11-20 01:31:30.315656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.440 [2024-11-20 01:31:30.315681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.440 qpair failed and we were unable to recover it. 00:30:22.440 [2024-11-20 01:31:30.315824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.440 [2024-11-20 01:31:30.315979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.440 [2024-11-20 01:31:30.316004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.440 qpair failed and we were unable to recover it. 00:30:22.440 [2024-11-20 01:31:30.316097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.440 [2024-11-20 01:31:30.316199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.440 [2024-11-20 01:31:30.316228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.440 qpair failed and we were unable to recover it. 00:30:22.440 [2024-11-20 01:31:30.316358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.440 [2024-11-20 01:31:30.316461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.440 [2024-11-20 01:31:30.316485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.440 qpair failed and we were unable to recover it. 00:30:22.440 [2024-11-20 01:31:30.316602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.440 [2024-11-20 01:31:30.316715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.440 [2024-11-20 01:31:30.316742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.440 qpair failed and we were unable to recover it. 00:30:22.440 [2024-11-20 01:31:30.316830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.440 [2024-11-20 01:31:30.316916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.440 [2024-11-20 01:31:30.316940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.440 qpair failed and we were unable to recover it. 00:30:22.440 [2024-11-20 01:31:30.317040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.440 [2024-11-20 01:31:30.317138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.440 [2024-11-20 01:31:30.317163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.440 qpair failed and we were unable to recover it. 00:30:22.440 [2024-11-20 01:31:30.317251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.440 [2024-11-20 01:31:30.317334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.440 [2024-11-20 01:31:30.317358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.440 qpair failed and we were unable to recover it. 00:30:22.440 [2024-11-20 01:31:30.317466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.440 [2024-11-20 01:31:30.317558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.440 [2024-11-20 01:31:30.317582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.440 qpair failed and we were unable to recover it. 00:30:22.440 [2024-11-20 01:31:30.317675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.441 [2024-11-20 01:31:30.317755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.441 [2024-11-20 01:31:30.317779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.441 qpair failed and we were unable to recover it. 00:30:22.441 [2024-11-20 01:31:30.317896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.441 [2024-11-20 01:31:30.318013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.441 [2024-11-20 01:31:30.318038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.441 qpair failed and we were unable to recover it. 00:30:22.441 [2024-11-20 01:31:30.318139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.441 [2024-11-20 01:31:30.318226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.441 [2024-11-20 01:31:30.318250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.441 qpair failed and we were unable to recover it. 00:30:22.441 [2024-11-20 01:31:30.318340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.441 [2024-11-20 01:31:30.318491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.441 [2024-11-20 01:31:30.318514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.441 qpair failed and we were unable to recover it. 00:30:22.441 [2024-11-20 01:31:30.318628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.441 [2024-11-20 01:31:30.318773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.441 [2024-11-20 01:31:30.318798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.441 qpair failed and we were unable to recover it. 00:30:22.441 [2024-11-20 01:31:30.318915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.441 [2024-11-20 01:31:30.318996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.441 [2024-11-20 01:31:30.319020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.441 qpair failed and we were unable to recover it. 00:30:22.441 [2024-11-20 01:31:30.319106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.441 [2024-11-20 01:31:30.319223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.441 [2024-11-20 01:31:30.319247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.441 qpair failed and we were unable to recover it. 00:30:22.441 [2024-11-20 01:31:30.319335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.441 [2024-11-20 01:31:30.319447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.441 [2024-11-20 01:31:30.319471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.441 qpair failed and we were unable to recover it. 00:30:22.441 [2024-11-20 01:31:30.319558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.441 [2024-11-20 01:31:30.319699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.441 [2024-11-20 01:31:30.319723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.441 qpair failed and we were unable to recover it. 00:30:22.441 [2024-11-20 01:31:30.319806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.441 [2024-11-20 01:31:30.319898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.441 [2024-11-20 01:31:30.319923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.441 qpair failed and we were unable to recover it. 00:30:22.441 [2024-11-20 01:31:30.320013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.441 [2024-11-20 01:31:30.320107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.441 [2024-11-20 01:31:30.320132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.441 qpair failed and we were unable to recover it. 00:30:22.441 [2024-11-20 01:31:30.320231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.441 [2024-11-20 01:31:30.320311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.441 [2024-11-20 01:31:30.320335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.441 qpair failed and we were unable to recover it. 00:30:22.441 [2024-11-20 01:31:30.320435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.441 [2024-11-20 01:31:30.320548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.441 [2024-11-20 01:31:30.320573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.441 qpair failed and we were unable to recover it. 00:30:22.441 [2024-11-20 01:31:30.320715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.441 [2024-11-20 01:31:30.320799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.441 [2024-11-20 01:31:30.320824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.441 qpair failed and we were unable to recover it. 00:30:22.441 [2024-11-20 01:31:30.320919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.441 [2024-11-20 01:31:30.321063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.441 [2024-11-20 01:31:30.321093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.441 qpair failed and we were unable to recover it. 00:30:22.441 [2024-11-20 01:31:30.321195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.441 [2024-11-20 01:31:30.321313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.441 [2024-11-20 01:31:30.321338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.441 qpair failed and we were unable to recover it. 00:30:22.441 [2024-11-20 01:31:30.321434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.441 [2024-11-20 01:31:30.321554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.441 [2024-11-20 01:31:30.321578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.441 qpair failed and we were unable to recover it. 00:30:22.441 [2024-11-20 01:31:30.321700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.441 [2024-11-20 01:31:30.321786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.441 [2024-11-20 01:31:30.321812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.441 qpair failed and we were unable to recover it. 00:30:22.441 [2024-11-20 01:31:30.321958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.441 [2024-11-20 01:31:30.322049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.441 [2024-11-20 01:31:30.322079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.441 qpair failed and we were unable to recover it. 00:30:22.441 [2024-11-20 01:31:30.322170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.441 [2024-11-20 01:31:30.322255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.441 [2024-11-20 01:31:30.322284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.441 qpair failed and we were unable to recover it. 00:30:22.441 [2024-11-20 01:31:30.322404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.441 [2024-11-20 01:31:30.322513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.441 [2024-11-20 01:31:30.322537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.441 qpair failed and we were unable to recover it. 00:30:22.441 [2024-11-20 01:31:30.322632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.441 [2024-11-20 01:31:30.322749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.441 [2024-11-20 01:31:30.322774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.441 qpair failed and we were unable to recover it. 00:30:22.441 [2024-11-20 01:31:30.322917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.441 [2024-11-20 01:31:30.323058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.441 [2024-11-20 01:31:30.323091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.441 qpair failed and we were unable to recover it. 00:30:22.441 [2024-11-20 01:31:30.323181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.441 [2024-11-20 01:31:30.323290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.441 [2024-11-20 01:31:30.323314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.441 qpair failed and we were unable to recover it. 00:30:22.441 [2024-11-20 01:31:30.323411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.441 [2024-11-20 01:31:30.323502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.441 [2024-11-20 01:31:30.323526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.441 qpair failed and we were unable to recover it. 00:30:22.441 [2024-11-20 01:31:30.323640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.441 [2024-11-20 01:31:30.323728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.441 [2024-11-20 01:31:30.323754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.441 qpair failed and we were unable to recover it. 00:30:22.441 [2024-11-20 01:31:30.323842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.441 [2024-11-20 01:31:30.323924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.441 [2024-11-20 01:31:30.323949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.441 qpair failed and we were unable to recover it. 00:30:22.441 [2024-11-20 01:31:30.324078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.441 [2024-11-20 01:31:30.324168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.441 [2024-11-20 01:31:30.324193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.441 qpair failed and we were unable to recover it. 00:30:22.441 [2024-11-20 01:31:30.324315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.441 [2024-11-20 01:31:30.324439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.441 [2024-11-20 01:31:30.324464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.442 qpair failed and we were unable to recover it. 00:30:22.442 [2024-11-20 01:31:30.324605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.442 [2024-11-20 01:31:30.324694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.442 [2024-11-20 01:31:30.324719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.442 qpair failed and we were unable to recover it. 00:30:22.442 [2024-11-20 01:31:30.324842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.442 [2024-11-20 01:31:30.324930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.442 [2024-11-20 01:31:30.324954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.442 qpair failed and we were unable to recover it. 00:30:22.442 [2024-11-20 01:31:30.325064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.442 [2024-11-20 01:31:30.325188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.442 [2024-11-20 01:31:30.325213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.442 qpair failed and we were unable to recover it. 00:30:22.442 [2024-11-20 01:31:30.325307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.442 [2024-11-20 01:31:30.325428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.442 [2024-11-20 01:31:30.325454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.442 qpair failed and we were unable to recover it. 00:30:22.442 [2024-11-20 01:31:30.325569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.442 [2024-11-20 01:31:30.325659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.442 [2024-11-20 01:31:30.325683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.442 qpair failed and we were unable to recover it. 00:30:22.442 [2024-11-20 01:31:30.325779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.442 [2024-11-20 01:31:30.325916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.442 [2024-11-20 01:31:30.325940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.442 qpair failed and we were unable to recover it. 00:30:22.442 [2024-11-20 01:31:30.326051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.442 [2024-11-20 01:31:30.326163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.442 [2024-11-20 01:31:30.326188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.442 qpair failed and we were unable to recover it. 00:30:22.442 [2024-11-20 01:31:30.326285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.442 [2024-11-20 01:31:30.326429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.442 [2024-11-20 01:31:30.326453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.442 qpair failed and we were unable to recover it. 00:30:22.442 [2024-11-20 01:31:30.326568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.442 [2024-11-20 01:31:30.326683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.442 [2024-11-20 01:31:30.326708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.442 qpair failed and we were unable to recover it. 00:30:22.442 [2024-11-20 01:31:30.326853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.442 [2024-11-20 01:31:30.326970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.442 [2024-11-20 01:31:30.326995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.442 qpair failed and we were unable to recover it. 00:30:22.442 [2024-11-20 01:31:30.327105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.442 [2024-11-20 01:31:30.327216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.442 [2024-11-20 01:31:30.327243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.442 qpair failed and we were unable to recover it. 00:30:22.442 [2024-11-20 01:31:30.327394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.442 [2024-11-20 01:31:30.327487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.442 [2024-11-20 01:31:30.327513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.442 qpair failed and we were unable to recover it. 00:30:22.442 [2024-11-20 01:31:30.327664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.442 [2024-11-20 01:31:30.327781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.442 [2024-11-20 01:31:30.327807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.442 qpair failed and we were unable to recover it. 00:30:22.442 [2024-11-20 01:31:30.327896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.442 [2024-11-20 01:31:30.328007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.442 [2024-11-20 01:31:30.328031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.442 qpair failed and we were unable to recover it. 00:30:22.442 [2024-11-20 01:31:30.328151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.442 [2024-11-20 01:31:30.328245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.442 [2024-11-20 01:31:30.328270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.442 qpair failed and we were unable to recover it. 00:30:22.442 [2024-11-20 01:31:30.328365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.442 [2024-11-20 01:31:30.328481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.442 [2024-11-20 01:31:30.328505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.442 qpair failed and we were unable to recover it. 00:30:22.442 [2024-11-20 01:31:30.328622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.442 [2024-11-20 01:31:30.328741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.442 [2024-11-20 01:31:30.328765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.442 qpair failed and we were unable to recover it. 00:30:22.442 [2024-11-20 01:31:30.328879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.442 [2024-11-20 01:31:30.328996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.442 [2024-11-20 01:31:30.329020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.442 qpair failed and we were unable to recover it. 00:30:22.442 [2024-11-20 01:31:30.329126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.442 [2024-11-20 01:31:30.329211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.442 [2024-11-20 01:31:30.329234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.442 qpair failed and we were unable to recover it. 00:30:22.442 [2024-11-20 01:31:30.329327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.442 [2024-11-20 01:31:30.329413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.442 [2024-11-20 01:31:30.329437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.442 qpair failed and we were unable to recover it. 00:30:22.442 [2024-11-20 01:31:30.329524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.442 [2024-11-20 01:31:30.329598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.442 [2024-11-20 01:31:30.329622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.442 qpair failed and we were unable to recover it. 00:30:22.442 [2024-11-20 01:31:30.329748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.442 [2024-11-20 01:31:30.329892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.442 [2024-11-20 01:31:30.329917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.442 qpair failed and we were unable to recover it. 00:30:22.442 [2024-11-20 01:31:30.330037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.442 [2024-11-20 01:31:30.330136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.442 [2024-11-20 01:31:30.330162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.442 qpair failed and we were unable to recover it. 00:30:22.442 [2024-11-20 01:31:30.330249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.442 [2024-11-20 01:31:30.330349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.442 [2024-11-20 01:31:30.330375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.442 qpair failed and we were unable to recover it. 00:30:22.442 [2024-11-20 01:31:30.330487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.442 [2024-11-20 01:31:30.330629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.442 [2024-11-20 01:31:30.330654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.442 qpair failed and we were unable to recover it. 00:30:22.442 [2024-11-20 01:31:30.330778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.442 [2024-11-20 01:31:30.330870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.442 [2024-11-20 01:31:30.330896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.442 qpair failed and we were unable to recover it. 00:30:22.442 [2024-11-20 01:31:30.330983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.442 [2024-11-20 01:31:30.331062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.442 [2024-11-20 01:31:30.331093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.442 qpair failed and we were unable to recover it. 00:30:22.442 [2024-11-20 01:31:30.331180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.442 [2024-11-20 01:31:30.331263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.442 [2024-11-20 01:31:30.331287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.442 qpair failed and we were unable to recover it. 00:30:22.442 [2024-11-20 01:31:30.331431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.443 [2024-11-20 01:31:30.331517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.443 [2024-11-20 01:31:30.331541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.443 qpair failed and we were unable to recover it. 00:30:22.443 [2024-11-20 01:31:30.331683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.443 [2024-11-20 01:31:30.331795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.443 [2024-11-20 01:31:30.331818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.443 qpair failed and we were unable to recover it. 00:30:22.443 [2024-11-20 01:31:30.331905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.443 [2024-11-20 01:31:30.332019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.443 [2024-11-20 01:31:30.332043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.443 qpair failed and we were unable to recover it. 00:30:22.443 [2024-11-20 01:31:30.332150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.443 [2024-11-20 01:31:30.332268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.443 [2024-11-20 01:31:30.332293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.443 qpair failed and we were unable to recover it. 00:30:22.443 [2024-11-20 01:31:30.332381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.443 [2024-11-20 01:31:30.332471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.443 [2024-11-20 01:31:30.332497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.443 qpair failed and we were unable to recover it. 00:30:22.443 [2024-11-20 01:31:30.332583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.443 [2024-11-20 01:31:30.332710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.443 [2024-11-20 01:31:30.332734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.443 qpair failed and we were unable to recover it. 00:30:22.443 [2024-11-20 01:31:30.332812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.443 [2024-11-20 01:31:30.332905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.443 [2024-11-20 01:31:30.332931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.443 qpair failed and we were unable to recover it. 00:30:22.443 [2024-11-20 01:31:30.333081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.443 [2024-11-20 01:31:30.333174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.443 [2024-11-20 01:31:30.333199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.443 qpair failed and we were unable to recover it. 00:30:22.443 [2024-11-20 01:31:30.333313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.443 [2024-11-20 01:31:30.333408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.443 [2024-11-20 01:31:30.333432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.443 qpair failed and we were unable to recover it. 00:30:22.443 [2024-11-20 01:31:30.333532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.443 [2024-11-20 01:31:30.333645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.443 [2024-11-20 01:31:30.333669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.443 qpair failed and we were unable to recover it. 00:30:22.443 [2024-11-20 01:31:30.333783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.443 [2024-11-20 01:31:30.333893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.443 [2024-11-20 01:31:30.333918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.443 qpair failed and we were unable to recover it. 00:30:22.443 [2024-11-20 01:31:30.334040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.443 [2024-11-20 01:31:30.334167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.443 [2024-11-20 01:31:30.334193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.443 qpair failed and we were unable to recover it. 00:30:22.443 [2024-11-20 01:31:30.334282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.443 [2024-11-20 01:31:30.334397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.443 [2024-11-20 01:31:30.334423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:22.443 qpair failed and we were unable to recover it. 00:30:22.443 [2024-11-20 01:31:30.334563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.443 [2024-11-20 01:31:30.334673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.443 [2024-11-20 01:31:30.334704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.443 qpair failed and we were unable to recover it. 00:30:22.443 [2024-11-20 01:31:30.334831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.443 [2024-11-20 01:31:30.334931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.443 [2024-11-20 01:31:30.334957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.443 qpair failed and we were unable to recover it. 00:30:22.443 [2024-11-20 01:31:30.335043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.443 [2024-11-20 01:31:30.335153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.443 [2024-11-20 01:31:30.335179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.443 qpair failed and we were unable to recover it. 00:30:22.443 [2024-11-20 01:31:30.335274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.443 [2024-11-20 01:31:30.335385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.443 [2024-11-20 01:31:30.335414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.443 qpair failed and we were unable to recover it. 00:30:22.443 [2024-11-20 01:31:30.335518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.443 [2024-11-20 01:31:30.335614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.443 [2024-11-20 01:31:30.335642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.443 qpair failed and we were unable to recover it. 00:30:22.443 [2024-11-20 01:31:30.335774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.443 [2024-11-20 01:31:30.335871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.443 [2024-11-20 01:31:30.335913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.443 qpair failed and we were unable to recover it. 00:30:22.443 [2024-11-20 01:31:30.336058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.443 [2024-11-20 01:31:30.336164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.443 [2024-11-20 01:31:30.336191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.443 qpair failed and we were unable to recover it. 00:30:22.443 [2024-11-20 01:31:30.336279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.443 [2024-11-20 01:31:30.336412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.443 [2024-11-20 01:31:30.336440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.443 qpair failed and we were unable to recover it. 00:30:22.443 [2024-11-20 01:31:30.336566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.443 [2024-11-20 01:31:30.336706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.443 [2024-11-20 01:31:30.336733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.443 qpair failed and we were unable to recover it. 00:30:22.443 [2024-11-20 01:31:30.336843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.443 [2024-11-20 01:31:30.336978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.443 [2024-11-20 01:31:30.337005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.443 qpair failed and we were unable to recover it. 00:30:22.443 [2024-11-20 01:31:30.337154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.443 [2024-11-20 01:31:30.337242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.443 [2024-11-20 01:31:30.337268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.443 qpair failed and we were unable to recover it. 00:30:22.443 [2024-11-20 01:31:30.337356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.444 [2024-11-20 01:31:30.337496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.444 [2024-11-20 01:31:30.337523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.444 qpair failed and we were unable to recover it. 00:30:22.444 [2024-11-20 01:31:30.337679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.444 [2024-11-20 01:31:30.337806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.444 [2024-11-20 01:31:30.337834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.444 qpair failed and we were unable to recover it. 00:30:22.444 [2024-11-20 01:31:30.337941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.444 [2024-11-20 01:31:30.338064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.444 [2024-11-20 01:31:30.338116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.444 qpair failed and we were unable to recover it. 00:30:22.444 [2024-11-20 01:31:30.338208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.444 [2024-11-20 01:31:30.338300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.444 [2024-11-20 01:31:30.338325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.444 qpair failed and we were unable to recover it. 00:30:22.444 [2024-11-20 01:31:30.338478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.444 [2024-11-20 01:31:30.338585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.444 [2024-11-20 01:31:30.338614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.444 qpair failed and we were unable to recover it. 00:30:22.444 [2024-11-20 01:31:30.338741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.444 [2024-11-20 01:31:30.338840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.444 [2024-11-20 01:31:30.338868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.444 qpair failed and we were unable to recover it. 00:30:22.444 [2024-11-20 01:31:30.338972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.444 [2024-11-20 01:31:30.339094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.444 [2024-11-20 01:31:30.339121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.444 qpair failed and we were unable to recover it. 00:30:22.444 [2024-11-20 01:31:30.339211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.444 [2024-11-20 01:31:30.339303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.444 [2024-11-20 01:31:30.339328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.444 qpair failed and we were unable to recover it. 00:30:22.444 [2024-11-20 01:31:30.339412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.444 [2024-11-20 01:31:30.339560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.444 [2024-11-20 01:31:30.339589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.444 qpair failed and we were unable to recover it. 00:30:22.444 [2024-11-20 01:31:30.339714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.444 [2024-11-20 01:31:30.339810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.444 [2024-11-20 01:31:30.339838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.444 qpair failed and we were unable to recover it. 00:30:22.444 [2024-11-20 01:31:30.339979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.444 [2024-11-20 01:31:30.340093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.444 [2024-11-20 01:31:30.340119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.444 qpair failed and we were unable to recover it. 00:30:22.444 [2024-11-20 01:31:30.340208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.444 [2024-11-20 01:31:30.340291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.444 [2024-11-20 01:31:30.340316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.444 qpair failed and we were unable to recover it. 00:30:22.444 [2024-11-20 01:31:30.340430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.444 [2024-11-20 01:31:30.340522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.444 [2024-11-20 01:31:30.340550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.444 qpair failed and we were unable to recover it. 00:30:22.444 [2024-11-20 01:31:30.340679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.444 [2024-11-20 01:31:30.340812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.444 [2024-11-20 01:31:30.340840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.444 qpair failed and we were unable to recover it. 00:30:22.444 [2024-11-20 01:31:30.340964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.444 [2024-11-20 01:31:30.341106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.444 [2024-11-20 01:31:30.341142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.444 qpair failed and we were unable to recover it. 00:30:22.444 [2024-11-20 01:31:30.341257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.444 [2024-11-20 01:31:30.341420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.444 [2024-11-20 01:31:30.341447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.444 qpair failed and we were unable to recover it. 00:30:22.444 [2024-11-20 01:31:30.341600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.444 [2024-11-20 01:31:30.341724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.444 [2024-11-20 01:31:30.341753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.444 qpair failed and we were unable to recover it. 00:30:22.444 [2024-11-20 01:31:30.341850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.444 [2024-11-20 01:31:30.342003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.444 [2024-11-20 01:31:30.342032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.444 qpair failed and we were unable to recover it. 00:30:22.444 [2024-11-20 01:31:30.342160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.444 [2024-11-20 01:31:30.342243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.444 [2024-11-20 01:31:30.342268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.444 qpair failed and we were unable to recover it. 00:30:22.444 [2024-11-20 01:31:30.342410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.444 [2024-11-20 01:31:30.342545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.444 [2024-11-20 01:31:30.342573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.444 qpair failed and we were unable to recover it. 00:30:22.444 [2024-11-20 01:31:30.342733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.444 [2024-11-20 01:31:30.342866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.444 [2024-11-20 01:31:30.342894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.444 qpair failed and we were unable to recover it. 00:30:22.444 [2024-11-20 01:31:30.343016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.444 [2024-11-20 01:31:30.343152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.444 [2024-11-20 01:31:30.343177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.444 qpair failed and we were unable to recover it. 00:30:22.444 [2024-11-20 01:31:30.343271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.444 [2024-11-20 01:31:30.343380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.444 [2024-11-20 01:31:30.343409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.444 qpair failed and we were unable to recover it. 00:30:22.444 [2024-11-20 01:31:30.343543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.444 [2024-11-20 01:31:30.343674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.444 [2024-11-20 01:31:30.343702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.444 qpair failed and we were unable to recover it. 00:30:22.444 [2024-11-20 01:31:30.343824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.444 [2024-11-20 01:31:30.343924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.444 [2024-11-20 01:31:30.343952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.444 qpair failed and we were unable to recover it. 00:30:22.444 [2024-11-20 01:31:30.344092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.444 [2024-11-20 01:31:30.344235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.444 [2024-11-20 01:31:30.344260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.444 qpair failed and we were unable to recover it. 00:30:22.444 [2024-11-20 01:31:30.344348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.444 [2024-11-20 01:31:30.344497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.444 [2024-11-20 01:31:30.344525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.444 qpair failed and we were unable to recover it. 00:30:22.444 [2024-11-20 01:31:30.344617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.444 [2024-11-20 01:31:30.344702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.444 [2024-11-20 01:31:30.344730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.444 qpair failed and we were unable to recover it. 00:30:22.444 [2024-11-20 01:31:30.344940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.444 [2024-11-20 01:31:30.345079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.445 [2024-11-20 01:31:30.345104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.445 qpair failed and we were unable to recover it. 00:30:22.445 [2024-11-20 01:31:30.345203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.445 [2024-11-20 01:31:30.345321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.445 [2024-11-20 01:31:30.345346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.445 qpair failed and we were unable to recover it. 00:30:22.445 [2024-11-20 01:31:30.345494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.445 [2024-11-20 01:31:30.345586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.445 [2024-11-20 01:31:30.345616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.445 qpair failed and we were unable to recover it. 00:30:22.445 [2024-11-20 01:31:30.345752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.445 [2024-11-20 01:31:30.345887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.445 [2024-11-20 01:31:30.345915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.445 qpair failed and we were unable to recover it. 00:30:22.445 [2024-11-20 01:31:30.346035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.445 [2024-11-20 01:31:30.346169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.445 [2024-11-20 01:31:30.346195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.445 qpair failed and we were unable to recover it. 00:30:22.445 [2024-11-20 01:31:30.346290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.445 [2024-11-20 01:31:30.346406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.445 [2024-11-20 01:31:30.346434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.445 qpair failed and we were unable to recover it. 00:30:22.445 [2024-11-20 01:31:30.346556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.445 [2024-11-20 01:31:30.346709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.445 [2024-11-20 01:31:30.346737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.445 qpair failed and we were unable to recover it. 00:30:22.445 [2024-11-20 01:31:30.346835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.445 [2024-11-20 01:31:30.346960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.445 [2024-11-20 01:31:30.346987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.445 qpair failed and we were unable to recover it. 00:30:22.445 [2024-11-20 01:31:30.347083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.445 [2024-11-20 01:31:30.347191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.445 [2024-11-20 01:31:30.347216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.445 qpair failed and we were unable to recover it. 00:30:22.445 [2024-11-20 01:31:30.347345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.445 [2024-11-20 01:31:30.347447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.445 [2024-11-20 01:31:30.347474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.445 qpair failed and we were unable to recover it. 00:30:22.445 [2024-11-20 01:31:30.347602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.445 [2024-11-20 01:31:30.347741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.445 [2024-11-20 01:31:30.347784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.445 qpair failed and we were unable to recover it. 00:30:22.445 [2024-11-20 01:31:30.347918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.445 [2024-11-20 01:31:30.348039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.445 [2024-11-20 01:31:30.348078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.445 qpair failed and we were unable to recover it. 00:30:22.445 [2024-11-20 01:31:30.348197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.445 [2024-11-20 01:31:30.348303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.445 [2024-11-20 01:31:30.348331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.445 qpair failed and we were unable to recover it. 00:30:22.445 [2024-11-20 01:31:30.348459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.445 [2024-11-20 01:31:30.348593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.445 [2024-11-20 01:31:30.348621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.445 qpair failed and we were unable to recover it. 00:30:22.445 [2024-11-20 01:31:30.348754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.445 [2024-11-20 01:31:30.348844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.445 [2024-11-20 01:31:30.348873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.445 qpair failed and we were unable to recover it. 00:30:22.445 [2024-11-20 01:31:30.348974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.445 [2024-11-20 01:31:30.349109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.445 [2024-11-20 01:31:30.349142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.445 qpair failed and we were unable to recover it. 00:30:22.445 [2024-11-20 01:31:30.349228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.445 [2024-11-20 01:31:30.349366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.445 [2024-11-20 01:31:30.349394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.445 qpair failed and we were unable to recover it. 00:30:22.445 [2024-11-20 01:31:30.349559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.445 [2024-11-20 01:31:30.349698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.445 [2024-11-20 01:31:30.349726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.445 qpair failed and we were unable to recover it. 00:30:22.445 [2024-11-20 01:31:30.349835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.445 [2024-11-20 01:31:30.349952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.445 [2024-11-20 01:31:30.349977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.445 qpair failed and we were unable to recover it. 00:30:22.445 [2024-11-20 01:31:30.350090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.445 [2024-11-20 01:31:30.350198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.445 [2024-11-20 01:31:30.350223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.445 qpair failed and we were unable to recover it. 00:30:22.445 [2024-11-20 01:31:30.350333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.445 [2024-11-20 01:31:30.350469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.445 [2024-11-20 01:31:30.350497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.445 qpair failed and we were unable to recover it. 00:30:22.445 [2024-11-20 01:31:30.350651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.445 [2024-11-20 01:31:30.350781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.445 [2024-11-20 01:31:30.350814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.445 qpair failed and we were unable to recover it. 00:30:22.445 [2024-11-20 01:31:30.350948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.445 [2024-11-20 01:31:30.351082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.445 [2024-11-20 01:31:30.351126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.445 qpair failed and we were unable to recover it. 00:30:22.445 [2024-11-20 01:31:30.351219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.445 [2024-11-20 01:31:30.351304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.445 [2024-11-20 01:31:30.351329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.445 qpair failed and we were unable to recover it. 00:30:22.445 [2024-11-20 01:31:30.351465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.445 [2024-11-20 01:31:30.351612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.445 [2024-11-20 01:31:30.351637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.445 qpair failed and we were unable to recover it. 00:30:22.445 [2024-11-20 01:31:30.351770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.445 [2024-11-20 01:31:30.351877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.445 [2024-11-20 01:31:30.351905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.445 qpair failed and we were unable to recover it. 00:30:22.445 [2024-11-20 01:31:30.352035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.445 [2024-11-20 01:31:30.352134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.445 [2024-11-20 01:31:30.352164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.445 qpair failed and we were unable to recover it. 00:30:22.445 [2024-11-20 01:31:30.352282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.445 [2024-11-20 01:31:30.352394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.445 [2024-11-20 01:31:30.352419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.445 qpair failed and we were unable to recover it. 00:30:22.445 [2024-11-20 01:31:30.352588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.445 [2024-11-20 01:31:30.352711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.445 [2024-11-20 01:31:30.352738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.445 qpair failed and we were unable to recover it. 00:30:22.446 [2024-11-20 01:31:30.352860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.446 [2024-11-20 01:31:30.353000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.446 [2024-11-20 01:31:30.353025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.446 qpair failed and we were unable to recover it. 00:30:22.446 [2024-11-20 01:31:30.353129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.446 [2024-11-20 01:31:30.353250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.446 [2024-11-20 01:31:30.353275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.446 qpair failed and we were unable to recover it. 00:30:22.446 [2024-11-20 01:31:30.353425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.446 [2024-11-20 01:31:30.353581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.446 [2024-11-20 01:31:30.353614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.446 qpair failed and we were unable to recover it. 00:30:22.446 [2024-11-20 01:31:30.353762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.446 [2024-11-20 01:31:30.353841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.446 [2024-11-20 01:31:30.353867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.446 qpair failed and we were unable to recover it. 00:30:22.446 [2024-11-20 01:31:30.354009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.446 [2024-11-20 01:31:30.354125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.446 [2024-11-20 01:31:30.354153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.446 qpair failed and we were unable to recover it. 00:30:22.446 [2024-11-20 01:31:30.354272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.446 [2024-11-20 01:31:30.354431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.446 [2024-11-20 01:31:30.354456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.446 qpair failed and we were unable to recover it. 00:30:22.446 [2024-11-20 01:31:30.354620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.446 [2024-11-20 01:31:30.354720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.446 [2024-11-20 01:31:30.354748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.446 qpair failed and we were unable to recover it. 00:30:22.446 [2024-11-20 01:31:30.354920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.446 [2024-11-20 01:31:30.355011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.446 [2024-11-20 01:31:30.355036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.446 qpair failed and we were unable to recover it. 00:30:22.446 [2024-11-20 01:31:30.355162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.446 [2024-11-20 01:31:30.355251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.446 [2024-11-20 01:31:30.355292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.446 qpair failed and we were unable to recover it. 00:30:22.446 [2024-11-20 01:31:30.355450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.446 [2024-11-20 01:31:30.355583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.446 [2024-11-20 01:31:30.355608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.446 qpair failed and we were unable to recover it. 00:30:22.446 [2024-11-20 01:31:30.355725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.446 [2024-11-20 01:31:30.355843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.446 [2024-11-20 01:31:30.355868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.446 qpair failed and we were unable to recover it. 00:30:22.446 [2024-11-20 01:31:30.355978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.446 [2024-11-20 01:31:30.356113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.446 [2024-11-20 01:31:30.356147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.446 qpair failed and we were unable to recover it. 00:30:22.446 [2024-11-20 01:31:30.356266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.446 [2024-11-20 01:31:30.356347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.446 [2024-11-20 01:31:30.356377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.446 qpair failed and we were unable to recover it. 00:30:22.446 [2024-11-20 01:31:30.356565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.446 [2024-11-20 01:31:30.356677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.446 [2024-11-20 01:31:30.356703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.446 qpair failed and we were unable to recover it. 00:30:22.446 [2024-11-20 01:31:30.356877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.446 [2024-11-20 01:31:30.356992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.446 [2024-11-20 01:31:30.357018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.446 qpair failed and we were unable to recover it. 00:30:22.446 [2024-11-20 01:31:30.357116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.446 [2024-11-20 01:31:30.357228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.446 [2024-11-20 01:31:30.357253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.446 qpair failed and we were unable to recover it. 00:30:22.446 [2024-11-20 01:31:30.357369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.446 [2024-11-20 01:31:30.357472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.446 [2024-11-20 01:31:30.357497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.446 qpair failed and we were unable to recover it. 00:30:22.446 [2024-11-20 01:31:30.357610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.446 [2024-11-20 01:31:30.357719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.446 [2024-11-20 01:31:30.357747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.446 qpair failed and we were unable to recover it. 00:30:22.446 [2024-11-20 01:31:30.357910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.446 [2024-11-20 01:31:30.358005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.446 [2024-11-20 01:31:30.358034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.446 qpair failed and we were unable to recover it. 00:30:22.446 [2024-11-20 01:31:30.358175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.446 [2024-11-20 01:31:30.358286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.446 [2024-11-20 01:31:30.358311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.446 qpair failed and we were unable to recover it. 00:30:22.446 [2024-11-20 01:31:30.358409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.446 [2024-11-20 01:31:30.358519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.446 [2024-11-20 01:31:30.358548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.446 qpair failed and we were unable to recover it. 00:30:22.446 [2024-11-20 01:31:30.358672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.446 [2024-11-20 01:31:30.358795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.446 [2024-11-20 01:31:30.358824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.446 qpair failed and we were unable to recover it. 00:30:22.446 [2024-11-20 01:31:30.358980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.446 [2024-11-20 01:31:30.359123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.446 [2024-11-20 01:31:30.359149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.446 qpair failed and we were unable to recover it. 00:30:22.446 [2024-11-20 01:31:30.359272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.446 [2024-11-20 01:31:30.359453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.446 [2024-11-20 01:31:30.359478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.446 qpair failed and we were unable to recover it. 00:30:22.446 [2024-11-20 01:31:30.359595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.446 [2024-11-20 01:31:30.359686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.446 [2024-11-20 01:31:30.359713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.446 qpair failed and we were unable to recover it. 00:30:22.446 [2024-11-20 01:31:30.359880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.446 [2024-11-20 01:31:30.360007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.446 [2024-11-20 01:31:30.360035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.446 qpair failed and we were unable to recover it. 00:30:22.446 [2024-11-20 01:31:30.360176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.446 [2024-11-20 01:31:30.360275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.446 [2024-11-20 01:31:30.360301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.446 qpair failed and we were unable to recover it. 00:30:22.446 [2024-11-20 01:31:30.360391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.446 [2024-11-20 01:31:30.360529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.446 [2024-11-20 01:31:30.360554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.446 qpair failed and we were unable to recover it. 00:30:22.446 [2024-11-20 01:31:30.360632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.446 [2024-11-20 01:31:30.360716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.447 [2024-11-20 01:31:30.360743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.447 qpair failed and we were unable to recover it. 00:30:22.447 [2024-11-20 01:31:30.360827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.447 [2024-11-20 01:31:30.360923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.447 [2024-11-20 01:31:30.360952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.447 qpair failed and we were unable to recover it. 00:30:22.447 [2024-11-20 01:31:30.361136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.447 [2024-11-20 01:31:30.361218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.447 [2024-11-20 01:31:30.361243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.447 qpair failed and we were unable to recover it. 00:30:22.447 [2024-11-20 01:31:30.361336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.447 [2024-11-20 01:31:30.361456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.447 [2024-11-20 01:31:30.361481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.447 qpair failed and we were unable to recover it. 00:30:22.447 [2024-11-20 01:31:30.361616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.447 [2024-11-20 01:31:30.361742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.447 [2024-11-20 01:31:30.361769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.447 qpair failed and we were unable to recover it. 00:30:22.447 [2024-11-20 01:31:30.361877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.447 [2024-11-20 01:31:30.362000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.447 [2024-11-20 01:31:30.362028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.447 qpair failed and we were unable to recover it. 00:30:22.447 [2024-11-20 01:31:30.362142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.447 [2024-11-20 01:31:30.362241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.447 [2024-11-20 01:31:30.362267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.447 qpair failed and we were unable to recover it. 00:30:22.447 [2024-11-20 01:31:30.362358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.447 [2024-11-20 01:31:30.362442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.447 [2024-11-20 01:31:30.362485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.447 qpair failed and we were unable to recover it. 00:30:22.447 [2024-11-20 01:31:30.362642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.447 [2024-11-20 01:31:30.362776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.447 [2024-11-20 01:31:30.362819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.447 qpair failed and we were unable to recover it. 00:30:22.447 [2024-11-20 01:31:30.362924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.447 [2024-11-20 01:31:30.363002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.447 [2024-11-20 01:31:30.363028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.447 qpair failed and we were unable to recover it. 00:30:22.447 [2024-11-20 01:31:30.363124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.447 [2024-11-20 01:31:30.363211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.447 [2024-11-20 01:31:30.363238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.447 qpair failed and we were unable to recover it. 00:30:22.447 [2024-11-20 01:31:30.363380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.447 [2024-11-20 01:31:30.363503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.447 [2024-11-20 01:31:30.363531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.447 qpair failed and we were unable to recover it. 00:30:22.447 [2024-11-20 01:31:30.363640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.447 [2024-11-20 01:31:30.363752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.447 [2024-11-20 01:31:30.363780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.447 qpair failed and we were unable to recover it. 00:30:22.447 [2024-11-20 01:31:30.363886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.447 [2024-11-20 01:31:30.363980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.447 [2024-11-20 01:31:30.364009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.447 qpair failed and we were unable to recover it. 00:30:22.447 [2024-11-20 01:31:30.364113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.447 [2024-11-20 01:31:30.364245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.447 [2024-11-20 01:31:30.364271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.447 qpair failed and we were unable to recover it. 00:30:22.447 [2024-11-20 01:31:30.364375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.447 [2024-11-20 01:31:30.364485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.447 [2024-11-20 01:31:30.364510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.447 qpair failed and we were unable to recover it. 00:30:22.447 [2024-11-20 01:31:30.364600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.447 [2024-11-20 01:31:30.364683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.447 [2024-11-20 01:31:30.364724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.447 qpair failed and we were unable to recover it. 00:30:22.447 [2024-11-20 01:31:30.364866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.447 [2024-11-20 01:31:30.364964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.447 [2024-11-20 01:31:30.364994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.447 qpair failed and we were unable to recover it. 00:30:22.447 [2024-11-20 01:31:30.365133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.447 [2024-11-20 01:31:30.365246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.447 [2024-11-20 01:31:30.365271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.447 qpair failed and we were unable to recover it. 00:30:22.447 [2024-11-20 01:31:30.365445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.447 [2024-11-20 01:31:30.365573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.447 [2024-11-20 01:31:30.365601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.447 qpair failed and we were unable to recover it. 00:30:22.447 [2024-11-20 01:31:30.365737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.447 [2024-11-20 01:31:30.365857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.447 [2024-11-20 01:31:30.365882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.447 qpair failed and we were unable to recover it. 00:30:22.447 [2024-11-20 01:31:30.366048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.447 [2024-11-20 01:31:30.366172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.447 [2024-11-20 01:31:30.366198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.447 qpair failed and we were unable to recover it. 00:30:22.447 [2024-11-20 01:31:30.366285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.447 [2024-11-20 01:31:30.366395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.447 [2024-11-20 01:31:30.366420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.447 qpair failed and we were unable to recover it. 00:30:22.447 [2024-11-20 01:31:30.366510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.447 [2024-11-20 01:31:30.366614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.447 [2024-11-20 01:31:30.366642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.447 qpair failed and we were unable to recover it. 00:30:22.447 [2024-11-20 01:31:30.366755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.447 [2024-11-20 01:31:30.366873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.447 [2024-11-20 01:31:30.366900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.447 qpair failed and we were unable to recover it. 00:30:22.447 [2024-11-20 01:31:30.367082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.447 [2024-11-20 01:31:30.367218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.447 [2024-11-20 01:31:30.367246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.447 qpair failed and we were unable to recover it. 00:30:22.447 [2024-11-20 01:31:30.367352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.447 [2024-11-20 01:31:30.367445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.447 [2024-11-20 01:31:30.367473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.448 qpair failed and we were unable to recover it. 00:30:22.448 [2024-11-20 01:31:30.367610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.448 [2024-11-20 01:31:30.367732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.448 [2024-11-20 01:31:30.367758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.448 qpair failed and we were unable to recover it. 00:30:22.448 [2024-11-20 01:31:30.367875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.448 [2024-11-20 01:31:30.368042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.448 [2024-11-20 01:31:30.368080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.448 qpair failed and we were unable to recover it. 00:30:22.448 [2024-11-20 01:31:30.368197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.448 [2024-11-20 01:31:30.368284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.448 [2024-11-20 01:31:30.368312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.448 qpair failed and we were unable to recover it. 00:30:22.448 [2024-11-20 01:31:30.368431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.448 [2024-11-20 01:31:30.368547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.448 [2024-11-20 01:31:30.368572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.448 qpair failed and we were unable to recover it. 00:30:22.448 [2024-11-20 01:31:30.368690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.448 [2024-11-20 01:31:30.368810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.448 [2024-11-20 01:31:30.368835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.448 qpair failed and we were unable to recover it. 00:30:22.448 [2024-11-20 01:31:30.368953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.448 [2024-11-20 01:31:30.369064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.448 [2024-11-20 01:31:30.369098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.448 qpair failed and we were unable to recover it. 00:30:22.448 [2024-11-20 01:31:30.369183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.448 [2024-11-20 01:31:30.369270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.448 [2024-11-20 01:31:30.369296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.448 qpair failed and we were unable to recover it. 00:30:22.448 [2024-11-20 01:31:30.369378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.448 [2024-11-20 01:31:30.369471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.448 [2024-11-20 01:31:30.369498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.448 qpair failed and we were unable to recover it. 00:30:22.448 [2024-11-20 01:31:30.369680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.448 [2024-11-20 01:31:30.369808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.448 [2024-11-20 01:31:30.369833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.448 qpair failed and we were unable to recover it. 00:30:22.448 [2024-11-20 01:31:30.369925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.448 [2024-11-20 01:31:30.370007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.448 [2024-11-20 01:31:30.370033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.448 qpair failed and we were unable to recover it. 00:30:22.448 [2024-11-20 01:31:30.370196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.448 [2024-11-20 01:31:30.370297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.448 [2024-11-20 01:31:30.370325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.448 qpair failed and we were unable to recover it. 00:30:22.448 [2024-11-20 01:31:30.370442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.448 [2024-11-20 01:31:30.370550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.448 [2024-11-20 01:31:30.370577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.448 qpair failed and we were unable to recover it. 00:30:22.448 [2024-11-20 01:31:30.370697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.448 [2024-11-20 01:31:30.370783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.448 [2024-11-20 01:31:30.370808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.448 qpair failed and we were unable to recover it. 00:30:22.448 [2024-11-20 01:31:30.370900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.448 [2024-11-20 01:31:30.371079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.448 [2024-11-20 01:31:30.371107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.448 qpair failed and we were unable to recover it. 00:30:22.448 [2024-11-20 01:31:30.371248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.448 [2024-11-20 01:31:30.371365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.448 [2024-11-20 01:31:30.371392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.448 qpair failed and we were unable to recover it. 00:30:22.448 [2024-11-20 01:31:30.371507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.448 [2024-11-20 01:31:30.371594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.448 [2024-11-20 01:31:30.371619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.448 qpair failed and we were unable to recover it. 00:30:22.448 [2024-11-20 01:31:30.371756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.448 [2024-11-20 01:31:30.371876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.448 [2024-11-20 01:31:30.371904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.448 qpair failed and we were unable to recover it. 00:30:22.448 [2024-11-20 01:31:30.372005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.448 [2024-11-20 01:31:30.372140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.448 [2024-11-20 01:31:30.372169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.448 qpair failed and we were unable to recover it. 00:30:22.448 [2024-11-20 01:31:30.372309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.448 [2024-11-20 01:31:30.372436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.448 [2024-11-20 01:31:30.372461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.448 qpair failed and we were unable to recover it. 00:30:22.448 [2024-11-20 01:31:30.372565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.448 [2024-11-20 01:31:30.372729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.448 [2024-11-20 01:31:30.372754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.448 qpair failed and we were unable to recover it. 00:30:22.448 [2024-11-20 01:31:30.372840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.448 [2024-11-20 01:31:30.372982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.448 [2024-11-20 01:31:30.373007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.448 qpair failed and we were unable to recover it. 00:30:22.448 [2024-11-20 01:31:30.373108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.448 [2024-11-20 01:31:30.373204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.448 [2024-11-20 01:31:30.373229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.448 qpair failed and we were unable to recover it. 00:30:22.448 [2024-11-20 01:31:30.373317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.448 [2024-11-20 01:31:30.373430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.448 [2024-11-20 01:31:30.373457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.448 qpair failed and we were unable to recover it. 00:30:22.448 [2024-11-20 01:31:30.373558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.448 [2024-11-20 01:31:30.373651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.448 [2024-11-20 01:31:30.373679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.448 qpair failed and we were unable to recover it. 00:30:22.448 [2024-11-20 01:31:30.373824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.448 [2024-11-20 01:31:30.373936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.448 [2024-11-20 01:31:30.373961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.448 qpair failed and we were unable to recover it. 00:30:22.448 [2024-11-20 01:31:30.374084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.448 [2024-11-20 01:31:30.374186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.448 [2024-11-20 01:31:30.374214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.448 qpair failed and we were unable to recover it. 00:30:22.448 [2024-11-20 01:31:30.374309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.448 [2024-11-20 01:31:30.374401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.448 [2024-11-20 01:31:30.374428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.449 qpair failed and we were unable to recover it. 00:30:22.449 [2024-11-20 01:31:30.374545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.449 [2024-11-20 01:31:30.374662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.449 [2024-11-20 01:31:30.374687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.449 qpair failed and we were unable to recover it. 00:30:22.449 [2024-11-20 01:31:30.374794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.449 [2024-11-20 01:31:30.374921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.449 [2024-11-20 01:31:30.374946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.449 qpair failed and we were unable to recover it. 00:30:22.449 [2024-11-20 01:31:30.375034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.449 [2024-11-20 01:31:30.375171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.449 [2024-11-20 01:31:30.375198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.449 qpair failed and we were unable to recover it. 00:30:22.449 [2024-11-20 01:31:30.375297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.449 [2024-11-20 01:31:30.375447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.449 [2024-11-20 01:31:30.375473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.449 qpair failed and we were unable to recover it. 00:30:22.449 [2024-11-20 01:31:30.375599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.449 [2024-11-20 01:31:30.375729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.449 [2024-11-20 01:31:30.375757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.449 qpair failed and we were unable to recover it. 00:30:22.449 [2024-11-20 01:31:30.375857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.449 [2024-11-20 01:31:30.375979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.449 [2024-11-20 01:31:30.376007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.449 qpair failed and we were unable to recover it. 00:30:22.449 [2024-11-20 01:31:30.376150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.449 [2024-11-20 01:31:30.376259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.449 [2024-11-20 01:31:30.376285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.449 qpair failed and we were unable to recover it. 00:30:22.449 [2024-11-20 01:31:30.376449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.449 [2024-11-20 01:31:30.376568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.449 [2024-11-20 01:31:30.376597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.449 qpair failed and we were unable to recover it. 00:30:22.449 [2024-11-20 01:31:30.376732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.449 [2024-11-20 01:31:30.376826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.449 [2024-11-20 01:31:30.376851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.449 qpair failed and we were unable to recover it. 00:30:22.449 [2024-11-20 01:31:30.376967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.449 [2024-11-20 01:31:30.377050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.449 [2024-11-20 01:31:30.377083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.449 qpair failed and we were unable to recover it. 00:30:22.449 [2024-11-20 01:31:30.377221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.449 [2024-11-20 01:31:30.377315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.449 [2024-11-20 01:31:30.377345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:22.449 qpair failed and we were unable to recover it. 00:30:22.449 [2024-11-20 01:31:30.377501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.449 [2024-11-20 01:31:30.377649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.449 [2024-11-20 01:31:30.377681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.449 qpair failed and we were unable to recover it. 00:30:22.449 [2024-11-20 01:31:30.377813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.449 [2024-11-20 01:31:30.377904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.449 [2024-11-20 01:31:30.377931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.449 qpair failed and we were unable to recover it. 00:30:22.449 [2024-11-20 01:31:30.378041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.449 [2024-11-20 01:31:30.378144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.449 [2024-11-20 01:31:30.378173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.449 qpair failed and we were unable to recover it. 00:30:22.449 [2024-11-20 01:31:30.378299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.449 [2024-11-20 01:31:30.378422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.449 [2024-11-20 01:31:30.378450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.449 qpair failed and we were unable to recover it. 00:30:22.449 [2024-11-20 01:31:30.378563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.449 [2024-11-20 01:31:30.378653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.449 [2024-11-20 01:31:30.378679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.449 qpair failed and we were unable to recover it. 00:30:22.449 [2024-11-20 01:31:30.378762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.449 [2024-11-20 01:31:30.378909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.449 [2024-11-20 01:31:30.378934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.449 qpair failed and we were unable to recover it. 00:30:22.449 [2024-11-20 01:31:30.379028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.449 [2024-11-20 01:31:30.379124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.449 [2024-11-20 01:31:30.379165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.449 qpair failed and we were unable to recover it. 00:30:22.449 [2024-11-20 01:31:30.379295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.449 [2024-11-20 01:31:30.379390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.449 [2024-11-20 01:31:30.379415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.449 qpair failed and we were unable to recover it. 00:30:22.449 [2024-11-20 01:31:30.379550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.449 [2024-11-20 01:31:30.379672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.449 [2024-11-20 01:31:30.379700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.449 qpair failed and we were unable to recover it. 00:30:22.449 [2024-11-20 01:31:30.379851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.449 [2024-11-20 01:31:30.379935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.449 [2024-11-20 01:31:30.379960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.449 qpair failed and we were unable to recover it. 00:30:22.449 [2024-11-20 01:31:30.380106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.449 [2024-11-20 01:31:30.380200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.449 [2024-11-20 01:31:30.380226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.449 qpair failed and we were unable to recover it. 00:30:22.449 [2024-11-20 01:31:30.380318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.449 [2024-11-20 01:31:30.380447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.449 [2024-11-20 01:31:30.380476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.449 qpair failed and we were unable to recover it. 00:30:22.449 [2024-11-20 01:31:30.380611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.449 [2024-11-20 01:31:30.380701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.449 [2024-11-20 01:31:30.380726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.449 qpair failed and we were unable to recover it. 00:30:22.449 [2024-11-20 01:31:30.380872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.449 [2024-11-20 01:31:30.380961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.449 [2024-11-20 01:31:30.380985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.449 qpair failed and we were unable to recover it. 00:30:22.449 [2024-11-20 01:31:30.381089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.449 [2024-11-20 01:31:30.381238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.449 [2024-11-20 01:31:30.381265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.449 qpair failed and we were unable to recover it. 00:30:22.449 [2024-11-20 01:31:30.381359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.449 [2024-11-20 01:31:30.381451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.449 [2024-11-20 01:31:30.381478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.449 qpair failed and we were unable to recover it. 00:30:22.449 [2024-11-20 01:31:30.381595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.449 [2024-11-20 01:31:30.381683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.449 [2024-11-20 01:31:30.381708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.449 qpair failed and we were unable to recover it. 00:30:22.449 [2024-11-20 01:31:30.381824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.450 [2024-11-20 01:31:30.381936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.450 [2024-11-20 01:31:30.381961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.450 qpair failed and we were unable to recover it. 00:30:22.450 [2024-11-20 01:31:30.382079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.450 [2024-11-20 01:31:30.382169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.450 [2024-11-20 01:31:30.382195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.450 qpair failed and we were unable to recover it. 00:30:22.450 [2024-11-20 01:31:30.382279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.450 [2024-11-20 01:31:30.382394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.450 [2024-11-20 01:31:30.382419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.450 qpair failed and we were unable to recover it. 00:30:22.450 [2024-11-20 01:31:30.382502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.450 [2024-11-20 01:31:30.382649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.450 [2024-11-20 01:31:30.382677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.450 qpair failed and we were unable to recover it. 00:30:22.450 [2024-11-20 01:31:30.382834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.450 [2024-11-20 01:31:30.382931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.450 [2024-11-20 01:31:30.382959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.450 qpair failed and we were unable to recover it. 00:30:22.450 [2024-11-20 01:31:30.383099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.450 [2024-11-20 01:31:30.383216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.450 [2024-11-20 01:31:30.383240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.450 qpair failed and we were unable to recover it. 00:30:22.450 [2024-11-20 01:31:30.383369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.450 [2024-11-20 01:31:30.383496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.450 [2024-11-20 01:31:30.383524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.450 qpair failed and we were unable to recover it. 00:30:22.450 [2024-11-20 01:31:30.383682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.450 [2024-11-20 01:31:30.383801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.450 [2024-11-20 01:31:30.383827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.450 qpair failed and we were unable to recover it. 00:30:22.450 [2024-11-20 01:31:30.383986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.450 [2024-11-20 01:31:30.384081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.450 [2024-11-20 01:31:30.384107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.450 qpair failed and we were unable to recover it. 00:30:22.450 [2024-11-20 01:31:30.384218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.450 [2024-11-20 01:31:30.384313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.450 [2024-11-20 01:31:30.384341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.450 qpair failed and we were unable to recover it. 00:30:22.450 [2024-11-20 01:31:30.384537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.450 [2024-11-20 01:31:30.384691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.450 [2024-11-20 01:31:30.384719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.450 qpair failed and we were unable to recover it. 00:30:22.450 [2024-11-20 01:31:30.384850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.450 [2024-11-20 01:31:30.384956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.450 [2024-11-20 01:31:30.384980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.450 qpair failed and we were unable to recover it. 00:30:22.450 [2024-11-20 01:31:30.385116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.450 [2024-11-20 01:31:30.385226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.450 [2024-11-20 01:31:30.385252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.450 qpair failed and we were unable to recover it. 00:30:22.450 [2024-11-20 01:31:30.385341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.450 [2024-11-20 01:31:30.385446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.450 [2024-11-20 01:31:30.385473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.450 qpair failed and we were unable to recover it. 00:30:22.450 [2024-11-20 01:31:30.385590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.450 [2024-11-20 01:31:30.385677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.450 [2024-11-20 01:31:30.385703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.450 qpair failed and we were unable to recover it. 00:30:22.450 [2024-11-20 01:31:30.385790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.450 [2024-11-20 01:31:30.385926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.450 [2024-11-20 01:31:30.385954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.450 qpair failed and we were unable to recover it. 00:30:22.450 [2024-11-20 01:31:30.386110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.450 [2024-11-20 01:31:30.386206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.450 [2024-11-20 01:31:30.386235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.450 qpair failed and we were unable to recover it. 00:30:22.450 [2024-11-20 01:31:30.386371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.450 [2024-11-20 01:31:30.386465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.450 [2024-11-20 01:31:30.386490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.450 qpair failed and we were unable to recover it. 00:30:22.450 [2024-11-20 01:31:30.386583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.450 [2024-11-20 01:31:30.386699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.450 [2024-11-20 01:31:30.386725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.450 qpair failed and we were unable to recover it. 00:30:22.450 [2024-11-20 01:31:30.386891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.450 [2024-11-20 01:31:30.386986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.450 [2024-11-20 01:31:30.387030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.450 qpair failed and we were unable to recover it. 00:30:22.450 [2024-11-20 01:31:30.387157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.450 [2024-11-20 01:31:30.387250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.450 [2024-11-20 01:31:30.387275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.450 qpair failed and we were unable to recover it. 00:30:22.450 [2024-11-20 01:31:30.387376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.450 [2024-11-20 01:31:30.387467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.450 [2024-11-20 01:31:30.387494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.450 qpair failed and we were unable to recover it. 00:30:22.450 [2024-11-20 01:31:30.387598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.450 [2024-11-20 01:31:30.387698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.450 [2024-11-20 01:31:30.387739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.450 qpair failed and we were unable to recover it. 00:30:22.450 [2024-11-20 01:31:30.387834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.450 [2024-11-20 01:31:30.387931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.450 [2024-11-20 01:31:30.387955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.450 qpair failed and we were unable to recover it. 00:30:22.450 [2024-11-20 01:31:30.388079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.450 [2024-11-20 01:31:30.388166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.450 [2024-11-20 01:31:30.388190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.450 qpair failed and we were unable to recover it. 00:30:22.450 [2024-11-20 01:31:30.388334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.450 [2024-11-20 01:31:30.388463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.450 [2024-11-20 01:31:30.388491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.450 qpair failed and we were unable to recover it. 00:30:22.450 [2024-11-20 01:31:30.388618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.450 [2024-11-20 01:31:30.388700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.450 [2024-11-20 01:31:30.388724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.450 qpair failed and we were unable to recover it. 00:30:22.450 [2024-11-20 01:31:30.388855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.450 [2024-11-20 01:31:30.388942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.450 [2024-11-20 01:31:30.388986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.450 qpair failed and we were unable to recover it. 00:30:22.450 [2024-11-20 01:31:30.389080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.450 [2024-11-20 01:31:30.389177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.451 [2024-11-20 01:31:30.389201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.451 qpair failed and we were unable to recover it. 00:30:22.451 [2024-11-20 01:31:30.389288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.451 [2024-11-20 01:31:30.389374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.451 [2024-11-20 01:31:30.389398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.451 qpair failed and we were unable to recover it. 00:30:22.451 [2024-11-20 01:31:30.389485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.451 [2024-11-20 01:31:30.389624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.451 [2024-11-20 01:31:30.389650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.451 qpair failed and we were unable to recover it. 00:30:22.451 [2024-11-20 01:31:30.389756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.451 [2024-11-20 01:31:30.389881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.451 [2024-11-20 01:31:30.389908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.451 qpair failed and we were unable to recover it. 00:30:22.451 [2024-11-20 01:31:30.390021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.451 [2024-11-20 01:31:30.390111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.451 [2024-11-20 01:31:30.390137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.451 qpair failed and we were unable to recover it. 00:30:22.451 [2024-11-20 01:31:30.390228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.451 [2024-11-20 01:31:30.390389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.451 [2024-11-20 01:31:30.390422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.451 qpair failed and we were unable to recover it. 00:30:22.451 [2024-11-20 01:31:30.390579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.451 [2024-11-20 01:31:30.390723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.451 [2024-11-20 01:31:30.390748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.451 qpair failed and we were unable to recover it. 00:30:22.451 [2024-11-20 01:31:30.390865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.451 [2024-11-20 01:31:30.390956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.451 [2024-11-20 01:31:30.390981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.451 qpair failed and we were unable to recover it. 00:30:22.451 [2024-11-20 01:31:30.391104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.451 [2024-11-20 01:31:30.391192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.451 [2024-11-20 01:31:30.391234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.451 qpair failed and we were unable to recover it. 00:30:22.451 [2024-11-20 01:31:30.391362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.451 [2024-11-20 01:31:30.391488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.451 [2024-11-20 01:31:30.391515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.451 qpair failed and we were unable to recover it. 00:30:22.451 [2024-11-20 01:31:30.391664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.451 [2024-11-20 01:31:30.391756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.451 [2024-11-20 01:31:30.391782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.451 qpair failed and we were unable to recover it. 00:30:22.451 [2024-11-20 01:31:30.391897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.451 [2024-11-20 01:31:30.391982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.451 [2024-11-20 01:31:30.392007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.451 qpair failed and we were unable to recover it. 00:30:22.451 [2024-11-20 01:31:30.392128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.451 [2024-11-20 01:31:30.392216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.451 [2024-11-20 01:31:30.392259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.451 qpair failed and we were unable to recover it. 00:30:22.451 [2024-11-20 01:31:30.392378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.451 [2024-11-20 01:31:30.392471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.451 [2024-11-20 01:31:30.392495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.451 qpair failed and we were unable to recover it. 00:30:22.451 [2024-11-20 01:31:30.392602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.451 [2024-11-20 01:31:30.392724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.451 [2024-11-20 01:31:30.392751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.451 qpair failed and we were unable to recover it. 00:30:22.451 [2024-11-20 01:31:30.392854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.451 [2024-11-20 01:31:30.392958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.451 [2024-11-20 01:31:30.393003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.451 qpair failed and we were unable to recover it. 00:30:22.451 [2024-11-20 01:31:30.393115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.451 [2024-11-20 01:31:30.393210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.451 [2024-11-20 01:31:30.393234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.451 qpair failed and we were unable to recover it. 00:30:22.451 [2024-11-20 01:31:30.393315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.451 [2024-11-20 01:31:30.393394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.451 [2024-11-20 01:31:30.393418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.451 qpair failed and we were unable to recover it. 00:30:22.451 [2024-11-20 01:31:30.393551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.451 [2024-11-20 01:31:30.393682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.451 [2024-11-20 01:31:30.393706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.451 qpair failed and we were unable to recover it. 00:30:22.451 [2024-11-20 01:31:30.393847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.451 [2024-11-20 01:31:30.393965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.451 [2024-11-20 01:31:30.393989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.451 qpair failed and we were unable to recover it. 00:30:22.451 [2024-11-20 01:31:30.394135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.451 [2024-11-20 01:31:30.394238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.451 [2024-11-20 01:31:30.394282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.451 qpair failed and we were unable to recover it. 00:30:22.451 [2024-11-20 01:31:30.394380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.451 [2024-11-20 01:31:30.394495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.451 [2024-11-20 01:31:30.394539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.451 qpair failed and we were unable to recover it. 00:30:22.451 [2024-11-20 01:31:30.394657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.451 [2024-11-20 01:31:30.394740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.451 [2024-11-20 01:31:30.394764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.451 qpair failed and we were unable to recover it. 00:30:22.451 [2024-11-20 01:31:30.394849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.451 [2024-11-20 01:31:30.394940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.451 [2024-11-20 01:31:30.394964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.451 qpair failed and we were unable to recover it. 00:30:22.451 [2024-11-20 01:31:30.395057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.451 [2024-11-20 01:31:30.395181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.451 [2024-11-20 01:31:30.395209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.451 qpair failed and we were unable to recover it. 00:30:22.451 [2024-11-20 01:31:30.395316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.451 [2024-11-20 01:31:30.395458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.451 [2024-11-20 01:31:30.395486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.451 qpair failed and we were unable to recover it. 00:30:22.451 [2024-11-20 01:31:30.395631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.451 [2024-11-20 01:31:30.395736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.451 [2024-11-20 01:31:30.395764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.451 qpair failed and we were unable to recover it. 00:30:22.451 [2024-11-20 01:31:30.395866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.451 [2024-11-20 01:31:30.395984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.451 [2024-11-20 01:31:30.396008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.451 qpair failed and we were unable to recover it. 00:30:22.451 [2024-11-20 01:31:30.396094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.451 [2024-11-20 01:31:30.396215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.451 [2024-11-20 01:31:30.396239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.451 qpair failed and we were unable to recover it. 00:30:22.451 [2024-11-20 01:31:30.396372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.452 [2024-11-20 01:31:30.396471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.452 [2024-11-20 01:31:30.396500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.452 qpair failed and we were unable to recover it. 00:30:22.452 [2024-11-20 01:31:30.396649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.452 [2024-11-20 01:31:30.396730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.452 [2024-11-20 01:31:30.396754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.452 qpair failed and we were unable to recover it. 00:30:22.452 [2024-11-20 01:31:30.396844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.452 [2024-11-20 01:31:30.396955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.452 [2024-11-20 01:31:30.396981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.452 qpair failed and we were unable to recover it. 00:30:22.452 [2024-11-20 01:31:30.397098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.452 [2024-11-20 01:31:30.397216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.452 [2024-11-20 01:31:30.397256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.452 qpair failed and we were unable to recover it. 00:30:22.452 [2024-11-20 01:31:30.397394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.452 [2024-11-20 01:31:30.397493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.452 [2024-11-20 01:31:30.397519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.452 qpair failed and we were unable to recover it. 00:30:22.452 [2024-11-20 01:31:30.397631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.452 [2024-11-20 01:31:30.397713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.452 [2024-11-20 01:31:30.397738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.452 qpair failed and we were unable to recover it. 00:30:22.452 [2024-11-20 01:31:30.397897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.452 [2024-11-20 01:31:30.397997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.452 [2024-11-20 01:31:30.398029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.452 qpair failed and we were unable to recover it. 00:30:22.452 [2024-11-20 01:31:30.398163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.452 [2024-11-20 01:31:30.398261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.452 [2024-11-20 01:31:30.398289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.452 qpair failed and we were unable to recover it. 00:30:22.452 [2024-11-20 01:31:30.398429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.452 [2024-11-20 01:31:30.398524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.452 [2024-11-20 01:31:30.398550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.452 qpair failed and we were unable to recover it. 00:30:22.452 [2024-11-20 01:31:30.398666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.452 [2024-11-20 01:31:30.398819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.452 [2024-11-20 01:31:30.398844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.452 qpair failed and we were unable to recover it. 00:30:22.452 [2024-11-20 01:31:30.398957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.452 [2024-11-20 01:31:30.399127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.452 [2024-11-20 01:31:30.399152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.452 qpair failed and we were unable to recover it. 00:30:22.452 [2024-11-20 01:31:30.399270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.452 [2024-11-20 01:31:30.399353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.452 [2024-11-20 01:31:30.399378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.452 qpair failed and we were unable to recover it. 00:30:22.452 [2024-11-20 01:31:30.399469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.452 [2024-11-20 01:31:30.399561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.452 [2024-11-20 01:31:30.399586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.452 qpair failed and we were unable to recover it. 00:30:22.452 [2024-11-20 01:31:30.399742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.452 [2024-11-20 01:31:30.399836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.452 [2024-11-20 01:31:30.399862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.452 qpair failed and we were unable to recover it. 00:30:22.452 [2024-11-20 01:31:30.400004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.452 [2024-11-20 01:31:30.400095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.452 [2024-11-20 01:31:30.400121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.452 qpair failed and we were unable to recover it. 00:30:22.452 [2024-11-20 01:31:30.400241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.452 [2024-11-20 01:31:30.400326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.452 [2024-11-20 01:31:30.400351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.452 qpair failed and we were unable to recover it. 00:30:22.452 [2024-11-20 01:31:30.400443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.452 [2024-11-20 01:31:30.400580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.452 [2024-11-20 01:31:30.400607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.452 qpair failed and we were unable to recover it. 00:30:22.452 [2024-11-20 01:31:30.400730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.452 [2024-11-20 01:31:30.400845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.452 [2024-11-20 01:31:30.400869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.452 qpair failed and we were unable to recover it. 00:30:22.452 [2024-11-20 01:31:30.401001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.452 [2024-11-20 01:31:30.401126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.452 [2024-11-20 01:31:30.401154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.452 qpair failed and we were unable to recover it. 00:30:22.452 [2024-11-20 01:31:30.401261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.452 [2024-11-20 01:31:30.401379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.452 [2024-11-20 01:31:30.401419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.452 qpair failed and we were unable to recover it. 00:30:22.452 [2024-11-20 01:31:30.401511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.452 [2024-11-20 01:31:30.401642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.452 [2024-11-20 01:31:30.401665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.452 qpair failed and we were unable to recover it. 00:30:22.452 [2024-11-20 01:31:30.401798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.452 [2024-11-20 01:31:30.401928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.452 [2024-11-20 01:31:30.401955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.452 qpair failed and we were unable to recover it. 00:30:22.452 [2024-11-20 01:31:30.402085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.452 [2024-11-20 01:31:30.402224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.452 [2024-11-20 01:31:30.402249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.452 qpair failed and we were unable to recover it. 00:30:22.452 [2024-11-20 01:31:30.402367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.452 [2024-11-20 01:31:30.402478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.452 [2024-11-20 01:31:30.402503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.452 qpair failed and we were unable to recover it. 00:30:22.452 [2024-11-20 01:31:30.402626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.452 [2024-11-20 01:31:30.402720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.452 [2024-11-20 01:31:30.402747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.452 qpair failed and we were unable to recover it. 00:30:22.452 [2024-11-20 01:31:30.402905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.452 [2024-11-20 01:31:30.403010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.453 [2024-11-20 01:31:30.403038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.453 qpair failed and we were unable to recover it. 00:30:22.453 [2024-11-20 01:31:30.403177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.453 [2024-11-20 01:31:30.403292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.453 [2024-11-20 01:31:30.403316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.453 qpair failed and we were unable to recover it. 00:30:22.453 [2024-11-20 01:31:30.403459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.453 [2024-11-20 01:31:30.403618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.453 [2024-11-20 01:31:30.403645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.453 qpair failed and we were unable to recover it. 00:30:22.453 [2024-11-20 01:31:30.403772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.453 [2024-11-20 01:31:30.403875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.453 [2024-11-20 01:31:30.403901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.453 qpair failed and we were unable to recover it. 00:30:22.453 [2024-11-20 01:31:30.404009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.453 [2024-11-20 01:31:30.404098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.453 [2024-11-20 01:31:30.404123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.453 qpair failed and we were unable to recover it. 00:30:22.453 [2024-11-20 01:31:30.404285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.453 [2024-11-20 01:31:30.404385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.453 [2024-11-20 01:31:30.404412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.453 qpair failed and we were unable to recover it. 00:30:22.453 [2024-11-20 01:31:30.404572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.453 [2024-11-20 01:31:30.404713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.453 [2024-11-20 01:31:30.404736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.453 qpair failed and we were unable to recover it. 00:30:22.453 [2024-11-20 01:31:30.404852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.453 [2024-11-20 01:31:30.404943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.453 [2024-11-20 01:31:30.404968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.453 qpair failed and we were unable to recover it. 00:30:22.453 [2024-11-20 01:31:30.405055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.453 [2024-11-20 01:31:30.405150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.453 [2024-11-20 01:31:30.405175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.453 qpair failed and we were unable to recover it. 00:30:22.453 [2024-11-20 01:31:30.405293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.453 [2024-11-20 01:31:30.405409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.453 [2024-11-20 01:31:30.405451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.453 qpair failed and we were unable to recover it. 00:30:22.453 [2024-11-20 01:31:30.405615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.453 [2024-11-20 01:31:30.405706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.453 [2024-11-20 01:31:30.405730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.453 qpair failed and we were unable to recover it. 00:30:22.453 [2024-11-20 01:31:30.405815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.453 [2024-11-20 01:31:30.405931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.453 [2024-11-20 01:31:30.405971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.453 qpair failed and we were unable to recover it. 00:30:22.453 [2024-11-20 01:31:30.406128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.453 [2024-11-20 01:31:30.406222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.453 [2024-11-20 01:31:30.406246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.453 qpair failed and we were unable to recover it. 00:30:22.453 [2024-11-20 01:31:30.406390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.453 [2024-11-20 01:31:30.406478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.453 [2024-11-20 01:31:30.406503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.453 qpair failed and we were unable to recover it. 00:30:22.453 [2024-11-20 01:31:30.406665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.453 [2024-11-20 01:31:30.406753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.453 [2024-11-20 01:31:30.406781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.453 qpair failed and we were unable to recover it. 00:30:22.453 [2024-11-20 01:31:30.406913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.453 [2024-11-20 01:31:30.407032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.453 [2024-11-20 01:31:30.407058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.453 qpair failed and we were unable to recover it. 00:30:22.453 [2024-11-20 01:31:30.407185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.453 [2024-11-20 01:31:30.407279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.453 [2024-11-20 01:31:30.407305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.453 qpair failed and we were unable to recover it. 00:30:22.453 [2024-11-20 01:31:30.407400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.453 [2024-11-20 01:31:30.407486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.453 [2024-11-20 01:31:30.407526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.453 qpair failed and we were unable to recover it. 00:30:22.453 [2024-11-20 01:31:30.407669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.453 [2024-11-20 01:31:30.407784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.453 [2024-11-20 01:31:30.407809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.453 qpair failed and we were unable to recover it. 00:30:22.453 [2024-11-20 01:31:30.407896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.453 [2024-11-20 01:31:30.408007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.453 [2024-11-20 01:31:30.408030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.453 qpair failed and we were unable to recover it. 00:30:22.453 [2024-11-20 01:31:30.408135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.453 [2024-11-20 01:31:30.408262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.453 [2024-11-20 01:31:30.408286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.453 qpair failed and we were unable to recover it. 00:30:22.453 [2024-11-20 01:31:30.408415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.453 [2024-11-20 01:31:30.408539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.453 [2024-11-20 01:31:30.408566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.453 qpair failed and we were unable to recover it. 00:30:22.453 [2024-11-20 01:31:30.408727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.453 [2024-11-20 01:31:30.408840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.453 [2024-11-20 01:31:30.408864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.453 qpair failed and we were unable to recover it. 00:30:22.453 [2024-11-20 01:31:30.408956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.453 [2024-11-20 01:31:30.409038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.453 [2024-11-20 01:31:30.409085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.453 qpair failed and we were unable to recover it. 00:30:22.453 [2024-11-20 01:31:30.409211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.453 [2024-11-20 01:31:30.409343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.453 [2024-11-20 01:31:30.409383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.453 qpair failed and we were unable to recover it. 00:30:22.453 [2024-11-20 01:31:30.409496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.453 [2024-11-20 01:31:30.409617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.453 [2024-11-20 01:31:30.409641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.453 qpair failed and we were unable to recover it. 00:30:22.453 [2024-11-20 01:31:30.409774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.453 [2024-11-20 01:31:30.409870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.453 [2024-11-20 01:31:30.409897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.453 qpair failed and we were unable to recover it. 00:30:22.453 [2024-11-20 01:31:30.410040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.453 [2024-11-20 01:31:30.410166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.453 [2024-11-20 01:31:30.410191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.453 qpair failed and we were unable to recover it. 00:30:22.453 [2024-11-20 01:31:30.410288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.453 [2024-11-20 01:31:30.410374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.454 [2024-11-20 01:31:30.410399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.454 qpair failed and we were unable to recover it. 00:30:22.454 [2024-11-20 01:31:30.410521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.454 [2024-11-20 01:31:30.410635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.454 [2024-11-20 01:31:30.410677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.454 qpair failed and we were unable to recover it. 00:30:22.454 [2024-11-20 01:31:30.410767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.454 [2024-11-20 01:31:30.410885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.454 [2024-11-20 01:31:30.410928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.454 qpair failed and we were unable to recover it. 00:30:22.454 [2024-11-20 01:31:30.411067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.454 [2024-11-20 01:31:30.411212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.454 [2024-11-20 01:31:30.411237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.454 qpair failed and we were unable to recover it. 00:30:22.454 [2024-11-20 01:31:30.411331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.454 [2024-11-20 01:31:30.411424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.454 [2024-11-20 01:31:30.411464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.454 qpair failed and we were unable to recover it. 00:30:22.454 [2024-11-20 01:31:30.411574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.454 [2024-11-20 01:31:30.411666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.454 [2024-11-20 01:31:30.411692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.454 qpair failed and we were unable to recover it. 00:30:22.454 [2024-11-20 01:31:30.411799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.454 [2024-11-20 01:31:30.411886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.454 [2024-11-20 01:31:30.411910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.454 qpair failed and we were unable to recover it. 00:30:22.454 [2024-11-20 01:31:30.412005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.454 [2024-11-20 01:31:30.412107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.454 [2024-11-20 01:31:30.412132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.454 qpair failed and we were unable to recover it. 00:30:22.454 [2024-11-20 01:31:30.412249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.454 [2024-11-20 01:31:30.412338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.454 [2024-11-20 01:31:30.412363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.454 qpair failed and we were unable to recover it. 00:30:22.454 [2024-11-20 01:31:30.412458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.454 [2024-11-20 01:31:30.412545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.454 [2024-11-20 01:31:30.412571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.454 qpair failed and we were unable to recover it. 00:30:22.454 [2024-11-20 01:31:30.412674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.454 [2024-11-20 01:31:30.412839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.454 [2024-11-20 01:31:30.412864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.454 qpair failed and we were unable to recover it. 00:30:22.454 [2024-11-20 01:31:30.412979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.454 [2024-11-20 01:31:30.413087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.454 [2024-11-20 01:31:30.413131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.454 qpair failed and we were unable to recover it. 00:30:22.454 [2024-11-20 01:31:30.413255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.454 [2024-11-20 01:31:30.413347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.454 [2024-11-20 01:31:30.413371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.454 qpair failed and we were unable to recover it. 00:30:22.454 [2024-11-20 01:31:30.413482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.454 [2024-11-20 01:31:30.413572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.454 [2024-11-20 01:31:30.413600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.454 qpair failed and we were unable to recover it. 00:30:22.454 [2024-11-20 01:31:30.413731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.454 [2024-11-20 01:31:30.413827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.454 [2024-11-20 01:31:30.413856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.454 qpair failed and we were unable to recover it. 00:30:22.454 [2024-11-20 01:31:30.413970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.454 [2024-11-20 01:31:30.414066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.454 [2024-11-20 01:31:30.414097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.454 qpair failed and we were unable to recover it. 00:30:22.454 [2024-11-20 01:31:30.414228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.454 [2024-11-20 01:31:30.414330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.454 [2024-11-20 01:31:30.414359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.454 qpair failed and we were unable to recover it. 00:30:22.454 [2024-11-20 01:31:30.414484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.454 [2024-11-20 01:31:30.414580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.454 [2024-11-20 01:31:30.414608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.454 qpair failed and we were unable to recover it. 00:30:22.454 [2024-11-20 01:31:30.414716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.454 [2024-11-20 01:31:30.414806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.454 [2024-11-20 01:31:30.414830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.454 qpair failed and we were unable to recover it. 00:30:22.454 [2024-11-20 01:31:30.414943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.454 [2024-11-20 01:31:30.415051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.454 [2024-11-20 01:31:30.415108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.454 qpair failed and we were unable to recover it. 00:30:22.454 [2024-11-20 01:31:30.415248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.454 [2024-11-20 01:31:30.415391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.454 [2024-11-20 01:31:30.415417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.454 qpair failed and we were unable to recover it. 00:30:22.454 [2024-11-20 01:31:30.415561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.454 [2024-11-20 01:31:30.415648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.454 [2024-11-20 01:31:30.415673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.454 qpair failed and we were unable to recover it. 00:30:22.454 [2024-11-20 01:31:30.415814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.454 [2024-11-20 01:31:30.415905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.454 [2024-11-20 01:31:30.415933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.454 qpair failed and we were unable to recover it. 00:30:22.454 [2024-11-20 01:31:30.416061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.454 [2024-11-20 01:31:30.416169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.454 [2024-11-20 01:31:30.416196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.454 qpair failed and we were unable to recover it. 00:30:22.454 [2024-11-20 01:31:30.416350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.454 [2024-11-20 01:31:30.416443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.454 [2024-11-20 01:31:30.416468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.454 qpair failed and we were unable to recover it. 00:30:22.454 [2024-11-20 01:31:30.416557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.454 [2024-11-20 01:31:30.416700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.454 [2024-11-20 01:31:30.416727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.454 qpair failed and we were unable to recover it. 00:30:22.454 [2024-11-20 01:31:30.416859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.454 [2024-11-20 01:31:30.416951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.454 [2024-11-20 01:31:30.416994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.454 qpair failed and we were unable to recover it. 00:30:22.454 [2024-11-20 01:31:30.417120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.454 [2024-11-20 01:31:30.417215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.454 [2024-11-20 01:31:30.417241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.454 qpair failed and we were unable to recover it. 00:30:22.454 [2024-11-20 01:31:30.417355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.454 [2024-11-20 01:31:30.417450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.454 [2024-11-20 01:31:30.417494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.454 qpair failed and we were unable to recover it. 00:30:22.455 [2024-11-20 01:31:30.417613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.455 [2024-11-20 01:31:30.417767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.455 [2024-11-20 01:31:30.417794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.455 qpair failed and we were unable to recover it. 00:30:22.455 [2024-11-20 01:31:30.417962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.455 [2024-11-20 01:31:30.418047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.455 [2024-11-20 01:31:30.418078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.455 qpair failed and we were unable to recover it. 00:30:22.455 [2024-11-20 01:31:30.418219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.455 [2024-11-20 01:31:30.418319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.455 [2024-11-20 01:31:30.418348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.455 qpair failed and we were unable to recover it. 00:30:22.455 [2024-11-20 01:31:30.418475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.455 [2024-11-20 01:31:30.418572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.455 [2024-11-20 01:31:30.418600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.455 qpair failed and we were unable to recover it. 00:30:22.455 [2024-11-20 01:31:30.418701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.455 [2024-11-20 01:31:30.418817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.455 [2024-11-20 01:31:30.418842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.455 qpair failed and we were unable to recover it. 00:30:22.455 [2024-11-20 01:31:30.418933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.455 [2024-11-20 01:31:30.419053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.455 [2024-11-20 01:31:30.419122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.455 qpair failed and we were unable to recover it. 00:30:22.455 [2024-11-20 01:31:30.419212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.455 [2024-11-20 01:31:30.419330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.455 [2024-11-20 01:31:30.419373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.455 qpair failed and we were unable to recover it. 00:30:22.455 [2024-11-20 01:31:30.419545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.455 [2024-11-20 01:31:30.419622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.455 [2024-11-20 01:31:30.419647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.455 qpair failed and we were unable to recover it. 00:30:22.455 [2024-11-20 01:31:30.419772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.455 [2024-11-20 01:31:30.419898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.455 [2024-11-20 01:31:30.419925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.455 qpair failed and we were unable to recover it. 00:30:22.455 [2024-11-20 01:31:30.420033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.455 [2024-11-20 01:31:30.420197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.455 [2024-11-20 01:31:30.420225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.455 qpair failed and we were unable to recover it. 00:30:22.455 [2024-11-20 01:31:30.420367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.455 [2024-11-20 01:31:30.420507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.455 [2024-11-20 01:31:30.420532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.455 qpair failed and we were unable to recover it. 00:30:22.455 [2024-11-20 01:31:30.420681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.455 [2024-11-20 01:31:30.420828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.455 [2024-11-20 01:31:30.420852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.455 qpair failed and we were unable to recover it. 00:30:22.455 [2024-11-20 01:31:30.420992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.455 [2024-11-20 01:31:30.421133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.455 [2024-11-20 01:31:30.421158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.455 qpair failed and we were unable to recover it. 00:30:22.455 [2024-11-20 01:31:30.421278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.455 [2024-11-20 01:31:30.421373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.455 [2024-11-20 01:31:30.421399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.455 qpair failed and we were unable to recover it. 00:30:22.455 [2024-11-20 01:31:30.421530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.455 [2024-11-20 01:31:30.421619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.455 [2024-11-20 01:31:30.421647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.455 qpair failed and we were unable to recover it. 00:30:22.455 [2024-11-20 01:31:30.421788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.455 [2024-11-20 01:31:30.421916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.455 [2024-11-20 01:31:30.421941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.455 qpair failed and we were unable to recover it. 00:30:22.455 [2024-11-20 01:31:30.422052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.455 [2024-11-20 01:31:30.422146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.455 [2024-11-20 01:31:30.422172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.455 qpair failed and we were unable to recover it. 00:30:22.455 [2024-11-20 01:31:30.422290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.455 [2024-11-20 01:31:30.422381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.455 [2024-11-20 01:31:30.422408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.455 qpair failed and we were unable to recover it. 00:30:22.455 [2024-11-20 01:31:30.422510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.455 [2024-11-20 01:31:30.422605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.455 [2024-11-20 01:31:30.422633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.455 qpair failed and we were unable to recover it. 00:30:22.455 [2024-11-20 01:31:30.422776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.455 [2024-11-20 01:31:30.422890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.455 [2024-11-20 01:31:30.422915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.455 qpair failed and we were unable to recover it. 00:30:22.455 [2024-11-20 01:31:30.423005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.455 [2024-11-20 01:31:30.423118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.455 [2024-11-20 01:31:30.423143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.455 qpair failed and we were unable to recover it. 00:30:22.455 [2024-11-20 01:31:30.423235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.455 [2024-11-20 01:31:30.423343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.455 [2024-11-20 01:31:30.423370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.455 qpair failed and we were unable to recover it. 00:30:22.455 [2024-11-20 01:31:30.423509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.455 [2024-11-20 01:31:30.423620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.455 [2024-11-20 01:31:30.423645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.455 qpair failed and we were unable to recover it. 00:30:22.455 [2024-11-20 01:31:30.423790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.455 [2024-11-20 01:31:30.423921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.455 [2024-11-20 01:31:30.423951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.455 qpair failed and we were unable to recover it. 00:30:22.455 [2024-11-20 01:31:30.424090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.455 [2024-11-20 01:31:30.424221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.455 [2024-11-20 01:31:30.424245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.455 qpair failed and we were unable to recover it. 00:30:22.455 [2024-11-20 01:31:30.424332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.455 [2024-11-20 01:31:30.424456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.455 [2024-11-20 01:31:30.424480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.455 qpair failed and we were unable to recover it. 00:30:22.455 [2024-11-20 01:31:30.424570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.455 [2024-11-20 01:31:30.424651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.455 [2024-11-20 01:31:30.424677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.455 qpair failed and we were unable to recover it. 00:30:22.455 [2024-11-20 01:31:30.424796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.455 [2024-11-20 01:31:30.424924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.455 [2024-11-20 01:31:30.424951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.455 qpair failed and we were unable to recover it. 00:30:22.455 [2024-11-20 01:31:30.425098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.456 [2024-11-20 01:31:30.425181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.456 [2024-11-20 01:31:30.425206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.456 qpair failed and we were unable to recover it. 00:30:22.456 [2024-11-20 01:31:30.425303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.456 [2024-11-20 01:31:30.425419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.456 [2024-11-20 01:31:30.425445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.456 qpair failed and we were unable to recover it. 00:30:22.456 [2024-11-20 01:31:30.425546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.456 [2024-11-20 01:31:30.425699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.456 [2024-11-20 01:31:30.425727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.456 qpair failed and we were unable to recover it. 00:30:22.456 [2024-11-20 01:31:30.425867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.456 [2024-11-20 01:31:30.425985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.456 [2024-11-20 01:31:30.426010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.456 qpair failed and we were unable to recover it. 00:30:22.456 [2024-11-20 01:31:30.426117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.456 [2024-11-20 01:31:30.426236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.456 [2024-11-20 01:31:30.426263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.456 qpair failed and we were unable to recover it. 00:30:22.456 [2024-11-20 01:31:30.426363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.456 [2024-11-20 01:31:30.426496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.456 [2024-11-20 01:31:30.426524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.456 qpair failed and we were unable to recover it. 00:30:22.456 [2024-11-20 01:31:30.426631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.456 [2024-11-20 01:31:30.426715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.456 [2024-11-20 01:31:30.426740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.456 qpair failed and we were unable to recover it. 00:30:22.456 [2024-11-20 01:31:30.426853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.456 [2024-11-20 01:31:30.426987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.456 [2024-11-20 01:31:30.427014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.456 qpair failed and we were unable to recover it. 00:30:22.456 [2024-11-20 01:31:30.427113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.456 [2024-11-20 01:31:30.427263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.456 [2024-11-20 01:31:30.427291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.456 qpair failed and we were unable to recover it. 00:30:22.456 [2024-11-20 01:31:30.427395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.456 [2024-11-20 01:31:30.427515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.456 [2024-11-20 01:31:30.427539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.456 qpair failed and we were unable to recover it. 00:30:22.456 [2024-11-20 01:31:30.427658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.456 [2024-11-20 01:31:30.427753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.456 [2024-11-20 01:31:30.427778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.456 qpair failed and we were unable to recover it. 00:30:22.456 [2024-11-20 01:31:30.427919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.456 [2024-11-20 01:31:30.428056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.456 [2024-11-20 01:31:30.428087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.456 qpair failed and we were unable to recover it. 00:30:22.456 [2024-11-20 01:31:30.428204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.456 [2024-11-20 01:31:30.428319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.456 [2024-11-20 01:31:30.428345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.456 qpair failed and we were unable to recover it. 00:30:22.456 [2024-11-20 01:31:30.428511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.456 [2024-11-20 01:31:30.428666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.456 [2024-11-20 01:31:30.428690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.456 qpair failed and we were unable to recover it. 00:30:22.456 [2024-11-20 01:31:30.428787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.456 [2024-11-20 01:31:30.428901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.456 [2024-11-20 01:31:30.428927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.456 qpair failed and we were unable to recover it. 00:30:22.456 [2024-11-20 01:31:30.429030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.456 [2024-11-20 01:31:30.429126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.456 [2024-11-20 01:31:30.429162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.456 qpair failed and we were unable to recover it. 00:30:22.456 [2024-11-20 01:31:30.429258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.456 [2024-11-20 01:31:30.429352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.456 [2024-11-20 01:31:30.429377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.456 qpair failed and we were unable to recover it. 00:30:22.456 [2024-11-20 01:31:30.429524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.456 [2024-11-20 01:31:30.429671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.456 [2024-11-20 01:31:30.429698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.456 qpair failed and we were unable to recover it. 00:30:22.456 [2024-11-20 01:31:30.429805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.456 [2024-11-20 01:31:30.429896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.456 [2024-11-20 01:31:30.429920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.456 qpair failed and we were unable to recover it. 00:30:22.456 [2024-11-20 01:31:30.430004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.456 [2024-11-20 01:31:30.430098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.456 [2024-11-20 01:31:30.430124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.456 qpair failed and we were unable to recover it. 00:30:22.456 [2024-11-20 01:31:30.430275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.456 [2024-11-20 01:31:30.430423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.456 [2024-11-20 01:31:30.430448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.456 qpair failed and we were unable to recover it. 00:30:22.456 [2024-11-20 01:31:30.430568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.456 [2024-11-20 01:31:30.430687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.456 [2024-11-20 01:31:30.430712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.456 qpair failed and we were unable to recover it. 00:30:22.456 [2024-11-20 01:31:30.430834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.456 [2024-11-20 01:31:30.430948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.456 [2024-11-20 01:31:30.430974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.456 qpair failed and we were unable to recover it. 00:30:22.456 [2024-11-20 01:31:30.431066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.456 [2024-11-20 01:31:30.431213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.456 [2024-11-20 01:31:30.431237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.456 qpair failed and we were unable to recover it. 00:30:22.456 [2024-11-20 01:31:30.431385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.456 [2024-11-20 01:31:30.431502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.456 [2024-11-20 01:31:30.431527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.456 qpair failed and we were unable to recover it. 00:30:22.456 [2024-11-20 01:31:30.431672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.456 [2024-11-20 01:31:30.431825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.456 [2024-11-20 01:31:30.431852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.456 qpair failed and we were unable to recover it. 00:30:22.456 [2024-11-20 01:31:30.432022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.456 [2024-11-20 01:31:30.432140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.456 [2024-11-20 01:31:30.432166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.456 qpair failed and we were unable to recover it. 00:30:22.456 [2024-11-20 01:31:30.432287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.456 [2024-11-20 01:31:30.432396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.456 [2024-11-20 01:31:30.432426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.456 qpair failed and we were unable to recover it. 00:30:22.456 [2024-11-20 01:31:30.432560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.456 [2024-11-20 01:31:30.432705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.456 [2024-11-20 01:31:30.432731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.457 qpair failed and we were unable to recover it. 00:30:22.457 [2024-11-20 01:31:30.432828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.457 [2024-11-20 01:31:30.432941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.457 [2024-11-20 01:31:30.432965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.457 qpair failed and we were unable to recover it. 00:30:22.457 [2024-11-20 01:31:30.433081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.457 [2024-11-20 01:31:30.433199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.457 [2024-11-20 01:31:30.433223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.457 qpair failed and we were unable to recover it. 00:30:22.457 [2024-11-20 01:31:30.433328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.457 [2024-11-20 01:31:30.433459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.457 [2024-11-20 01:31:30.433484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.457 qpair failed and we were unable to recover it. 00:30:22.457 [2024-11-20 01:31:30.433623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.457 [2024-11-20 01:31:30.433722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.457 [2024-11-20 01:31:30.433761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.457 qpair failed and we were unable to recover it. 00:30:22.457 [2024-11-20 01:31:30.433881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.457 [2024-11-20 01:31:30.433997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.457 [2024-11-20 01:31:30.434022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.457 qpair failed and we were unable to recover it. 00:30:22.457 [2024-11-20 01:31:30.434122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.457 [2024-11-20 01:31:30.434214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.457 [2024-11-20 01:31:30.434239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.457 qpair failed and we were unable to recover it. 00:30:22.457 [2024-11-20 01:31:30.434323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.457 [2024-11-20 01:31:30.434434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.457 [2024-11-20 01:31:30.434474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.457 qpair failed and we were unable to recover it. 00:30:22.457 [2024-11-20 01:31:30.434592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.457 [2024-11-20 01:31:30.434703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.457 [2024-11-20 01:31:30.434727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.457 qpair failed and we were unable to recover it. 00:30:22.457 [2024-11-20 01:31:30.434842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.457 [2024-11-20 01:31:30.434955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.457 [2024-11-20 01:31:30.434983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.457 qpair failed and we were unable to recover it. 00:30:22.457 [2024-11-20 01:31:30.435120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.457 [2024-11-20 01:31:30.435242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.457 [2024-11-20 01:31:30.435269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.457 qpair failed and we were unable to recover it. 00:30:22.457 [2024-11-20 01:31:30.435378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.457 [2024-11-20 01:31:30.435471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.457 [2024-11-20 01:31:30.435496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.457 qpair failed and we were unable to recover it. 00:30:22.457 [2024-11-20 01:31:30.435642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.457 [2024-11-20 01:31:30.435736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.457 [2024-11-20 01:31:30.435762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.457 qpair failed and we were unable to recover it. 00:30:22.457 [2024-11-20 01:31:30.435880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.457 [2024-11-20 01:31:30.436037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.457 [2024-11-20 01:31:30.436065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.457 qpair failed and we were unable to recover it. 00:30:22.457 [2024-11-20 01:31:30.436209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.457 [2024-11-20 01:31:30.436336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.457 [2024-11-20 01:31:30.436360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.457 qpair failed and we were unable to recover it. 00:30:22.457 [2024-11-20 01:31:30.436496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.457 [2024-11-20 01:31:30.436620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.457 [2024-11-20 01:31:30.436648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.457 qpair failed and we were unable to recover it. 00:30:22.457 [2024-11-20 01:31:30.436741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.457 [2024-11-20 01:31:30.436865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.457 [2024-11-20 01:31:30.436892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.457 qpair failed and we were unable to recover it. 00:30:22.457 [2024-11-20 01:31:30.437019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.457 [2024-11-20 01:31:30.437155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.457 [2024-11-20 01:31:30.437181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.457 qpair failed and we were unable to recover it. 00:30:22.457 [2024-11-20 01:31:30.437300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.457 [2024-11-20 01:31:30.437456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.457 [2024-11-20 01:31:30.437480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.457 qpair failed and we were unable to recover it. 00:30:22.457 [2024-11-20 01:31:30.437574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.457 [2024-11-20 01:31:30.437692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.457 [2024-11-20 01:31:30.437737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.457 qpair failed and we were unable to recover it. 00:30:22.457 [2024-11-20 01:31:30.437850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.457 [2024-11-20 01:31:30.437968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.457 [2024-11-20 01:31:30.437994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.457 qpair failed and we were unable to recover it. 00:30:22.457 [2024-11-20 01:31:30.438134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.457 [2024-11-20 01:31:30.438281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.457 [2024-11-20 01:31:30.438306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.457 qpair failed and we were unable to recover it. 00:30:22.457 [2024-11-20 01:31:30.438432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.457 [2024-11-20 01:31:30.438548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.457 [2024-11-20 01:31:30.438588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.457 qpair failed and we were unable to recover it. 00:30:22.457 [2024-11-20 01:31:30.438728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.457 [2024-11-20 01:31:30.438843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.457 [2024-11-20 01:31:30.438870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.457 qpair failed and we were unable to recover it. 00:30:22.457 [2024-11-20 01:31:30.439000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.457 [2024-11-20 01:31:30.439124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.457 [2024-11-20 01:31:30.439153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.457 qpair failed and we were unable to recover it. 00:30:22.457 [2024-11-20 01:31:30.439256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.457 [2024-11-20 01:31:30.439354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.458 [2024-11-20 01:31:30.439382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.458 qpair failed and we were unable to recover it. 00:30:22.458 [2024-11-20 01:31:30.439503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.458 [2024-11-20 01:31:30.439591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.458 [2024-11-20 01:31:30.439618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.458 qpair failed and we were unable to recover it. 00:30:22.458 [2024-11-20 01:31:30.439711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.458 [2024-11-20 01:31:30.439827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.458 [2024-11-20 01:31:30.439872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.458 qpair failed and we were unable to recover it. 00:30:22.458 [2024-11-20 01:31:30.439967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.458 [2024-11-20 01:31:30.440095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.458 [2024-11-20 01:31:30.440121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.458 qpair failed and we were unable to recover it. 00:30:22.458 [2024-11-20 01:31:30.440264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.458 [2024-11-20 01:31:30.440339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.458 [2024-11-20 01:31:30.440363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.458 qpair failed and we were unable to recover it. 00:30:22.458 [2024-11-20 01:31:30.440491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.458 [2024-11-20 01:31:30.440577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.458 [2024-11-20 01:31:30.440603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.458 qpair failed and we were unable to recover it. 00:30:22.458 [2024-11-20 01:31:30.440695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.458 [2024-11-20 01:31:30.440788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.458 [2024-11-20 01:31:30.440811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.458 qpair failed and we were unable to recover it. 00:30:22.458 [2024-11-20 01:31:30.440899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.458 [2024-11-20 01:31:30.440993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.458 [2024-11-20 01:31:30.441018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.458 qpair failed and we were unable to recover it. 00:30:22.458 [2024-11-20 01:31:30.441131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.458 [2024-11-20 01:31:30.441215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.458 [2024-11-20 01:31:30.441240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.458 qpair failed and we were unable to recover it. 00:30:22.458 [2024-11-20 01:31:30.441334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.458 [2024-11-20 01:31:30.441497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.458 [2024-11-20 01:31:30.441524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.458 qpair failed and we were unable to recover it. 00:30:22.458 [2024-11-20 01:31:30.441667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.458 [2024-11-20 01:31:30.441783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.458 [2024-11-20 01:31:30.441807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.458 qpair failed and we were unable to recover it. 00:30:22.458 [2024-11-20 01:31:30.441938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.458 [2024-11-20 01:31:30.442038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.458 [2024-11-20 01:31:30.442067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.458 qpair failed and we were unable to recover it. 00:30:22.458 [2024-11-20 01:31:30.442187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.458 [2024-11-20 01:31:30.442275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.458 [2024-11-20 01:31:30.442299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.458 qpair failed and we were unable to recover it. 00:30:22.458 [2024-11-20 01:31:30.442429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.458 [2024-11-20 01:31:30.442511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.458 [2024-11-20 01:31:30.442535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.458 qpair failed and we were unable to recover it. 00:30:22.458 [2024-11-20 01:31:30.442625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.458 [2024-11-20 01:31:30.442748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.458 [2024-11-20 01:31:30.442790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.458 qpair failed and we were unable to recover it. 00:30:22.458 [2024-11-20 01:31:30.442921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.458 [2024-11-20 01:31:30.443044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.458 [2024-11-20 01:31:30.443096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.458 qpair failed and we were unable to recover it. 00:30:22.458 [2024-11-20 01:31:30.443270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.458 [2024-11-20 01:31:30.443387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.458 [2024-11-20 01:31:30.443412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.458 qpair failed and we were unable to recover it. 00:30:22.458 [2024-11-20 01:31:30.443510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.458 [2024-11-20 01:31:30.443601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.458 [2024-11-20 01:31:30.443629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.458 qpair failed and we were unable to recover it. 00:30:22.458 [2024-11-20 01:31:30.443729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.458 [2024-11-20 01:31:30.443890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.458 [2024-11-20 01:31:30.443915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.458 qpair failed and we were unable to recover it. 00:30:22.458 [2024-11-20 01:31:30.444027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.458 [2024-11-20 01:31:30.444126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.458 [2024-11-20 01:31:30.444152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.458 qpair failed and we were unable to recover it. 00:30:22.458 [2024-11-20 01:31:30.444270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.458 [2024-11-20 01:31:30.444353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.458 [2024-11-20 01:31:30.444378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.458 qpair failed and we were unable to recover it. 00:30:22.458 [2024-11-20 01:31:30.444513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.458 [2024-11-20 01:31:30.444610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.458 [2024-11-20 01:31:30.444638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.458 qpair failed and we were unable to recover it. 00:30:22.458 [2024-11-20 01:31:30.444769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.458 [2024-11-20 01:31:30.444915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.458 [2024-11-20 01:31:30.444939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.458 qpair failed and we were unable to recover it. 00:30:22.458 [2024-11-20 01:31:30.445049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.458 [2024-11-20 01:31:30.445195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.458 [2024-11-20 01:31:30.445221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.458 qpair failed and we were unable to recover it. 00:30:22.458 [2024-11-20 01:31:30.445318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.458 [2024-11-20 01:31:30.445407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.458 [2024-11-20 01:31:30.445450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.458 qpair failed and we were unable to recover it. 00:30:22.458 [2024-11-20 01:31:30.445594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.458 [2024-11-20 01:31:30.445710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.458 [2024-11-20 01:31:30.445735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.458 qpair failed and we were unable to recover it. 00:30:22.458 [2024-11-20 01:31:30.445888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.458 [2024-11-20 01:31:30.446029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.458 [2024-11-20 01:31:30.446053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.458 qpair failed and we were unable to recover it. 00:30:22.458 [2024-11-20 01:31:30.446199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.458 [2024-11-20 01:31:30.446334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.458 [2024-11-20 01:31:30.446359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.458 qpair failed and we were unable to recover it. 00:30:22.458 [2024-11-20 01:31:30.446451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.458 [2024-11-20 01:31:30.446596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.458 [2024-11-20 01:31:30.446620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.458 qpair failed and we were unable to recover it. 00:30:22.458 [2024-11-20 01:31:30.446727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.459 [2024-11-20 01:31:30.446825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.459 [2024-11-20 01:31:30.446852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.459 qpair failed and we were unable to recover it. 00:30:22.459 [2024-11-20 01:31:30.446955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.459 [2024-11-20 01:31:30.447050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.459 [2024-11-20 01:31:30.447085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.459 qpair failed and we were unable to recover it. 00:30:22.459 [2024-11-20 01:31:30.447227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.459 [2024-11-20 01:31:30.447347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.459 [2024-11-20 01:31:30.447372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.459 qpair failed and we were unable to recover it. 00:30:22.459 [2024-11-20 01:31:30.447485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.459 [2024-11-20 01:31:30.447604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.459 [2024-11-20 01:31:30.447628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.459 qpair failed and we were unable to recover it. 00:30:22.459 [2024-11-20 01:31:30.447747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.459 [2024-11-20 01:31:30.447861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.459 [2024-11-20 01:31:30.447888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.459 qpair failed and we were unable to recover it. 00:30:22.459 [2024-11-20 01:31:30.447986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.459 [2024-11-20 01:31:30.448098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.459 [2024-11-20 01:31:30.448123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.459 qpair failed and we were unable to recover it. 00:30:22.459 [2024-11-20 01:31:30.448224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.459 [2024-11-20 01:31:30.448339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.459 [2024-11-20 01:31:30.448381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.459 qpair failed and we were unable to recover it. 00:30:22.459 [2024-11-20 01:31:30.448485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.459 [2024-11-20 01:31:30.448584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.459 [2024-11-20 01:31:30.448613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.459 qpair failed and we were unable to recover it. 00:30:22.459 [2024-11-20 01:31:30.448749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.459 [2024-11-20 01:31:30.448867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.459 [2024-11-20 01:31:30.448891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.459 qpair failed and we were unable to recover it. 00:30:22.459 [2024-11-20 01:31:30.449053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.459 [2024-11-20 01:31:30.449189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.459 [2024-11-20 01:31:30.449216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.459 qpair failed and we were unable to recover it. 00:30:22.459 [2024-11-20 01:31:30.449316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.459 [2024-11-20 01:31:30.449468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.459 [2024-11-20 01:31:30.449495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.459 qpair failed and we were unable to recover it. 00:30:22.459 [2024-11-20 01:31:30.449602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.459 [2024-11-20 01:31:30.449716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.459 [2024-11-20 01:31:30.449740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.459 qpair failed and we were unable to recover it. 00:30:22.459 [2024-11-20 01:31:30.449869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.459 [2024-11-20 01:31:30.449981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.459 [2024-11-20 01:31:30.450007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.459 qpair failed and we were unable to recover it. 00:30:22.459 [2024-11-20 01:31:30.450159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.459 [2024-11-20 01:31:30.450248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.459 [2024-11-20 01:31:30.450273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.459 qpair failed and we were unable to recover it. 00:30:22.459 [2024-11-20 01:31:30.450362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.459 [2024-11-20 01:31:30.450507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.459 [2024-11-20 01:31:30.450532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.459 qpair failed and we were unable to recover it. 00:30:22.459 [2024-11-20 01:31:30.450633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.459 [2024-11-20 01:31:30.450726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.459 [2024-11-20 01:31:30.450754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.459 qpair failed and we were unable to recover it. 00:30:22.459 [2024-11-20 01:31:30.450859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.459 [2024-11-20 01:31:30.450993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.459 [2024-11-20 01:31:30.451020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.459 qpair failed and we were unable to recover it. 00:30:22.459 [2024-11-20 01:31:30.451146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.459 [2024-11-20 01:31:30.451261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.459 [2024-11-20 01:31:30.451287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.459 qpair failed and we were unable to recover it. 00:30:22.459 [2024-11-20 01:31:30.451426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.459 [2024-11-20 01:31:30.451530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.459 [2024-11-20 01:31:30.451557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.459 qpair failed and we were unable to recover it. 00:30:22.459 [2024-11-20 01:31:30.451692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.459 [2024-11-20 01:31:30.451810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.459 [2024-11-20 01:31:30.451835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.459 qpair failed and we were unable to recover it. 00:30:22.459 [2024-11-20 01:31:30.451918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.459 [2024-11-20 01:31:30.452035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.459 [2024-11-20 01:31:30.452059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.459 qpair failed and we were unable to recover it. 00:30:22.459 [2024-11-20 01:31:30.452168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.459 [2024-11-20 01:31:30.452268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.459 [2024-11-20 01:31:30.452296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.459 qpair failed and we were unable to recover it. 00:30:22.459 [2024-11-20 01:31:30.452407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.459 [2024-11-20 01:31:30.452535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.459 [2024-11-20 01:31:30.452562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.459 qpair failed and we were unable to recover it. 00:30:22.459 [2024-11-20 01:31:30.452679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.459 [2024-11-20 01:31:30.452796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.459 [2024-11-20 01:31:30.452821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.459 qpair failed and we were unable to recover it. 00:30:22.459 [2024-11-20 01:31:30.452953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.459 [2024-11-20 01:31:30.453111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.459 [2024-11-20 01:31:30.453139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.459 qpair failed and we were unable to recover it. 00:30:22.459 [2024-11-20 01:31:30.453273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.459 [2024-11-20 01:31:30.453360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.459 [2024-11-20 01:31:30.453400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.459 qpair failed and we were unable to recover it. 00:30:22.459 [2024-11-20 01:31:30.453523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.459 [2024-11-20 01:31:30.453636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.459 [2024-11-20 01:31:30.453662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.459 qpair failed and we were unable to recover it. 00:30:22.459 [2024-11-20 01:31:30.453764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.459 [2024-11-20 01:31:30.453894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.459 [2024-11-20 01:31:30.453922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.459 qpair failed and we were unable to recover it. 00:30:22.459 [2024-11-20 01:31:30.454059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.459 [2024-11-20 01:31:30.454171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.460 [2024-11-20 01:31:30.454199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.460 qpair failed and we were unable to recover it. 00:30:22.460 [2024-11-20 01:31:30.454315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.460 [2024-11-20 01:31:30.454429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.460 [2024-11-20 01:31:30.454454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.460 qpair failed and we were unable to recover it. 00:30:22.460 [2024-11-20 01:31:30.454594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.460 [2024-11-20 01:31:30.454717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.460 [2024-11-20 01:31:30.454745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.460 qpair failed and we were unable to recover it. 00:30:22.460 [2024-11-20 01:31:30.454870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.460 [2024-11-20 01:31:30.454959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.460 [2024-11-20 01:31:30.455005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.460 qpair failed and we were unable to recover it. 00:30:22.460 [2024-11-20 01:31:30.455097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.460 [2024-11-20 01:31:30.455193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.460 [2024-11-20 01:31:30.455218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.460 qpair failed and we were unable to recover it. 00:30:22.460 [2024-11-20 01:31:30.455334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.460 [2024-11-20 01:31:30.455453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.460 [2024-11-20 01:31:30.455496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.460 qpair failed and we were unable to recover it. 00:30:22.460 [2024-11-20 01:31:30.455603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.460 [2024-11-20 01:31:30.455726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.460 [2024-11-20 01:31:30.455753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.460 qpair failed and we were unable to recover it. 00:30:22.460 [2024-11-20 01:31:30.455863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.460 [2024-11-20 01:31:30.455996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.460 [2024-11-20 01:31:30.456036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.460 qpair failed and we were unable to recover it. 00:30:22.460 [2024-11-20 01:31:30.456188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.460 [2024-11-20 01:31:30.456305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.460 [2024-11-20 01:31:30.456331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.460 qpair failed and we were unable to recover it. 00:30:22.460 [2024-11-20 01:31:30.456455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.460 [2024-11-20 01:31:30.456623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.460 [2024-11-20 01:31:30.456652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.460 qpair failed and we were unable to recover it. 00:30:22.460 [2024-11-20 01:31:30.456791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.460 [2024-11-20 01:31:30.456880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.460 [2024-11-20 01:31:30.456905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.460 qpair failed and we were unable to recover it. 00:30:22.460 [2024-11-20 01:31:30.457016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.460 [2024-11-20 01:31:30.457156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.460 [2024-11-20 01:31:30.457181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.460 qpair failed and we were unable to recover it. 00:30:22.460 [2024-11-20 01:31:30.457301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.460 [2024-11-20 01:31:30.457400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.460 [2024-11-20 01:31:30.457428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.460 qpair failed and we were unable to recover it. 00:30:22.460 [2024-11-20 01:31:30.457564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.460 [2024-11-20 01:31:30.457658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.460 [2024-11-20 01:31:30.457685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.460 qpair failed and we were unable to recover it. 00:30:22.460 [2024-11-20 01:31:30.457798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.460 [2024-11-20 01:31:30.457937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.460 [2024-11-20 01:31:30.457965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.460 qpair failed and we were unable to recover it. 00:30:22.460 [2024-11-20 01:31:30.458103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.460 [2024-11-20 01:31:30.458194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.460 [2024-11-20 01:31:30.458220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.460 qpair failed and we were unable to recover it. 00:30:22.460 [2024-11-20 01:31:30.458341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.460 [2024-11-20 01:31:30.458490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.460 [2024-11-20 01:31:30.458515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.460 qpair failed and we were unable to recover it. 00:30:22.460 [2024-11-20 01:31:30.458668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.460 [2024-11-20 01:31:30.458755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.460 [2024-11-20 01:31:30.458780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.460 qpair failed and we were unable to recover it. 00:30:22.460 [2024-11-20 01:31:30.458881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.460 [2024-11-20 01:31:30.458985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.460 [2024-11-20 01:31:30.459013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.460 qpair failed and we were unable to recover it. 00:30:22.460 [2024-11-20 01:31:30.459146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.460 [2024-11-20 01:31:30.459231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.460 [2024-11-20 01:31:30.459257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.460 qpair failed and we were unable to recover it. 00:30:22.460 [2024-11-20 01:31:30.459373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.460 [2024-11-20 01:31:30.459488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.460 [2024-11-20 01:31:30.459513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.460 qpair failed and we were unable to recover it. 00:30:22.460 [2024-11-20 01:31:30.459649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.460 [2024-11-20 01:31:30.459773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.460 [2024-11-20 01:31:30.459800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.460 qpair failed and we were unable to recover it. 00:30:22.460 [2024-11-20 01:31:30.459966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.460 [2024-11-20 01:31:30.460054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.460 [2024-11-20 01:31:30.460087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.460 qpair failed and we were unable to recover it. 00:30:22.460 [2024-11-20 01:31:30.460194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.460 [2024-11-20 01:31:30.460322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.460 [2024-11-20 01:31:30.460350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.460 qpair failed and we were unable to recover it. 00:30:22.460 [2024-11-20 01:31:30.460517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.460 [2024-11-20 01:31:30.460631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.460 [2024-11-20 01:31:30.460655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.460 qpair failed and we were unable to recover it. 00:30:22.460 [2024-11-20 01:31:30.460750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.460 [2024-11-20 01:31:30.460863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.460 [2024-11-20 01:31:30.460888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.460 qpair failed and we were unable to recover it. 00:30:22.460 [2024-11-20 01:31:30.460976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.460 [2024-11-20 01:31:30.461091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.460 [2024-11-20 01:31:30.461118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.460 qpair failed and we were unable to recover it. 00:30:22.460 [2024-11-20 01:31:30.461205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.460 [2024-11-20 01:31:30.461285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.460 [2024-11-20 01:31:30.461310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.460 qpair failed and we were unable to recover it. 00:30:22.460 [2024-11-20 01:31:30.461407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.460 [2024-11-20 01:31:30.461552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.460 [2024-11-20 01:31:30.461576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.460 qpair failed and we were unable to recover it. 00:30:22.461 [2024-11-20 01:31:30.461744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.461 [2024-11-20 01:31:30.461840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.461 [2024-11-20 01:31:30.461868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.461 qpair failed and we were unable to recover it. 00:30:22.461 [2024-11-20 01:31:30.461965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.461 [2024-11-20 01:31:30.462095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.461 [2024-11-20 01:31:30.462137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.461 qpair failed and we were unable to recover it. 00:30:22.461 [2024-11-20 01:31:30.462227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.461 [2024-11-20 01:31:30.462343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.461 [2024-11-20 01:31:30.462367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.461 qpair failed and we were unable to recover it. 00:30:22.461 [2024-11-20 01:31:30.462507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.461 [2024-11-20 01:31:30.462636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.461 [2024-11-20 01:31:30.462663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.461 qpair failed and we were unable to recover it. 00:30:22.461 [2024-11-20 01:31:30.462797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.461 [2024-11-20 01:31:30.462944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.461 [2024-11-20 01:31:30.462972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.461 qpair failed and we were unable to recover it. 00:30:22.461 [2024-11-20 01:31:30.463105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.461 [2024-11-20 01:31:30.463185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.461 [2024-11-20 01:31:30.463209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.461 qpair failed and we were unable to recover it. 00:30:22.461 [2024-11-20 01:31:30.463330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.461 [2024-11-20 01:31:30.463413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.461 [2024-11-20 01:31:30.463439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.461 qpair failed and we were unable to recover it. 00:30:22.461 [2024-11-20 01:31:30.463534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.461 [2024-11-20 01:31:30.463669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.461 [2024-11-20 01:31:30.463696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.461 qpair failed and we were unable to recover it. 00:30:22.461 [2024-11-20 01:31:30.463803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.461 [2024-11-20 01:31:30.463916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.461 [2024-11-20 01:31:30.463941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.461 qpair failed and we were unable to recover it. 00:30:22.461 [2024-11-20 01:31:30.464059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.461 [2024-11-20 01:31:30.464227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.461 [2024-11-20 01:31:30.464255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.461 qpair failed and we were unable to recover it. 00:30:22.461 [2024-11-20 01:31:30.464349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.461 [2024-11-20 01:31:30.464468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.461 [2024-11-20 01:31:30.464495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.461 qpair failed and we were unable to recover it. 00:30:22.461 [2024-11-20 01:31:30.464613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.461 [2024-11-20 01:31:30.464734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.461 [2024-11-20 01:31:30.464758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.461 qpair failed and we were unable to recover it. 00:30:22.461 [2024-11-20 01:31:30.464846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.461 [2024-11-20 01:31:30.465000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.461 [2024-11-20 01:31:30.465024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.461 qpair failed and we were unable to recover it. 00:30:22.461 [2024-11-20 01:31:30.465129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.461 [2024-11-20 01:31:30.465270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.461 [2024-11-20 01:31:30.465298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.461 qpair failed and we were unable to recover it. 00:30:22.461 [2024-11-20 01:31:30.465476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.461 [2024-11-20 01:31:30.465592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.461 [2024-11-20 01:31:30.465617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.461 qpair failed and we were unable to recover it. 00:30:22.461 [2024-11-20 01:31:30.465765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.461 [2024-11-20 01:31:30.465881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.461 [2024-11-20 01:31:30.465909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.461 qpair failed and we were unable to recover it. 00:30:22.461 [2024-11-20 01:31:30.466049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.461 [2024-11-20 01:31:30.466190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.461 [2024-11-20 01:31:30.466218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.461 qpair failed and we were unable to recover it. 00:30:22.461 [2024-11-20 01:31:30.466329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.461 [2024-11-20 01:31:30.466442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.461 [2024-11-20 01:31:30.466468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.461 qpair failed and we were unable to recover it. 00:30:22.461 [2024-11-20 01:31:30.466559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.461 [2024-11-20 01:31:30.466688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.461 [2024-11-20 01:31:30.466716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.461 qpair failed and we were unable to recover it. 00:30:22.461 [2024-11-20 01:31:30.466845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.461 [2024-11-20 01:31:30.466953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.461 [2024-11-20 01:31:30.466981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.461 qpair failed and we were unable to recover it. 00:30:22.461 [2024-11-20 01:31:30.467086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.461 [2024-11-20 01:31:30.467204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.461 [2024-11-20 01:31:30.467229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.461 qpair failed and we were unable to recover it. 00:30:22.461 [2024-11-20 01:31:30.467327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.461 [2024-11-20 01:31:30.467439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.461 [2024-11-20 01:31:30.467466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.461 qpair failed and we were unable to recover it. 00:30:22.461 [2024-11-20 01:31:30.467565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.461 [2024-11-20 01:31:30.467656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.461 [2024-11-20 01:31:30.467700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.461 qpair failed and we were unable to recover it. 00:30:22.461 [2024-11-20 01:31:30.467844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.461 [2024-11-20 01:31:30.467936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.461 [2024-11-20 01:31:30.467960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.461 qpair failed and we were unable to recover it. 00:30:22.461 [2024-11-20 01:31:30.468049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.461 [2024-11-20 01:31:30.468177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.461 [2024-11-20 01:31:30.468203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.461 qpair failed and we were unable to recover it. 00:30:22.462 [2024-11-20 01:31:30.468316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.462 [2024-11-20 01:31:30.468446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.462 [2024-11-20 01:31:30.468473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.462 qpair failed and we were unable to recover it. 00:30:22.462 [2024-11-20 01:31:30.468575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.462 [2024-11-20 01:31:30.468657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.462 [2024-11-20 01:31:30.468682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.462 qpair failed and we were unable to recover it. 00:30:22.462 [2024-11-20 01:31:30.468769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.462 [2024-11-20 01:31:30.468950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.462 [2024-11-20 01:31:30.468975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.462 qpair failed and we were unable to recover it. 00:30:22.462 [2024-11-20 01:31:30.469142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.462 [2024-11-20 01:31:30.469260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.462 [2024-11-20 01:31:30.469286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.462 qpair failed and we were unable to recover it. 00:30:22.462 [2024-11-20 01:31:30.469406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.462 [2024-11-20 01:31:30.469526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.462 [2024-11-20 01:31:30.469552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.462 qpair failed and we were unable to recover it. 00:30:22.462 [2024-11-20 01:31:30.469662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.462 [2024-11-20 01:31:30.469795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.462 [2024-11-20 01:31:30.469820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.462 qpair failed and we were unable to recover it. 00:30:22.462 [2024-11-20 01:31:30.469917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.462 [2024-11-20 01:31:30.470052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.462 [2024-11-20 01:31:30.470086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.462 qpair failed and we were unable to recover it. 00:30:22.462 [2024-11-20 01:31:30.470220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.462 [2024-11-20 01:31:30.470307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.462 [2024-11-20 01:31:30.470332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.462 qpair failed and we were unable to recover it. 00:30:22.462 [2024-11-20 01:31:30.470448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.462 [2024-11-20 01:31:30.470528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.462 [2024-11-20 01:31:30.470553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.462 qpair failed and we were unable to recover it. 00:30:22.462 [2024-11-20 01:31:30.470706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.462 [2024-11-20 01:31:30.470854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.462 [2024-11-20 01:31:30.470880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.462 qpair failed and we were unable to recover it. 00:30:22.462 [2024-11-20 01:31:30.470972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.462 [2024-11-20 01:31:30.471091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.462 [2024-11-20 01:31:30.471117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.462 qpair failed and we were unable to recover it. 00:30:22.462 [2024-11-20 01:31:30.471212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.462 [2024-11-20 01:31:30.471345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.462 [2024-11-20 01:31:30.471374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.462 qpair failed and we were unable to recover it. 00:30:22.462 [2024-11-20 01:31:30.471545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.462 [2024-11-20 01:31:30.471655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.462 [2024-11-20 01:31:30.471679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.462 qpair failed and we were unable to recover it. 00:30:22.462 [2024-11-20 01:31:30.471799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.462 [2024-11-20 01:31:30.471906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.462 [2024-11-20 01:31:30.471930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.462 qpair failed and we were unable to recover it. 00:30:22.462 [2024-11-20 01:31:30.472062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.462 [2024-11-20 01:31:30.472169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.462 [2024-11-20 01:31:30.472201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.462 qpair failed and we were unable to recover it. 00:30:22.462 [2024-11-20 01:31:30.472334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.462 [2024-11-20 01:31:30.472455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.462 [2024-11-20 01:31:30.472479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.462 qpair failed and we were unable to recover it. 00:30:22.462 [2024-11-20 01:31:30.472600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.462 [2024-11-20 01:31:30.472686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.462 [2024-11-20 01:31:30.472710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.462 qpair failed and we were unable to recover it. 00:30:22.462 [2024-11-20 01:31:30.472861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.462 [2024-11-20 01:31:30.472983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.462 [2024-11-20 01:31:30.473008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.462 qpair failed and we were unable to recover it. 00:30:22.462 [2024-11-20 01:31:30.473173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.462 [2024-11-20 01:31:30.473292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.462 [2024-11-20 01:31:30.473317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.462 qpair failed and we were unable to recover it. 00:30:22.462 [2024-11-20 01:31:30.473404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.462 [2024-11-20 01:31:30.473498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.462 [2024-11-20 01:31:30.473523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.462 qpair failed and we were unable to recover it. 00:30:22.462 [2024-11-20 01:31:30.473639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.462 [2024-11-20 01:31:30.473752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.462 [2024-11-20 01:31:30.473777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.462 qpair failed and we were unable to recover it. 00:30:22.462 [2024-11-20 01:31:30.473895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.462 [2024-11-20 01:31:30.473983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.462 [2024-11-20 01:31:30.474008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.462 qpair failed and we were unable to recover it. 00:30:22.462 [2024-11-20 01:31:30.474101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.462 [2024-11-20 01:31:30.474229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.462 [2024-11-20 01:31:30.474254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.462 qpair failed and we were unable to recover it. 00:30:22.462 [2024-11-20 01:31:30.474341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.462 [2024-11-20 01:31:30.474462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.462 [2024-11-20 01:31:30.474489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.462 qpair failed and we were unable to recover it. 00:30:22.462 [2024-11-20 01:31:30.474585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.462 [2024-11-20 01:31:30.474730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.462 [2024-11-20 01:31:30.474759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.462 qpair failed and we were unable to recover it. 00:30:22.462 [2024-11-20 01:31:30.474847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.462 [2024-11-20 01:31:30.474963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.462 [2024-11-20 01:31:30.474988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.462 qpair failed and we were unable to recover it. 00:30:22.462 [2024-11-20 01:31:30.475088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.462 [2024-11-20 01:31:30.475199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.462 [2024-11-20 01:31:30.475223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.462 qpair failed and we were unable to recover it. 00:30:22.463 [2024-11-20 01:31:30.475313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.463 [2024-11-20 01:31:30.475428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.463 [2024-11-20 01:31:30.475453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.463 qpair failed and we were unable to recover it. 00:30:22.463 [2024-11-20 01:31:30.475572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.463 [2024-11-20 01:31:30.475655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.463 [2024-11-20 01:31:30.475679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.463 qpair failed and we were unable to recover it. 00:30:22.463 [2024-11-20 01:31:30.475791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.463 [2024-11-20 01:31:30.475876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.463 [2024-11-20 01:31:30.475900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.463 qpair failed and we were unable to recover it. 00:30:22.463 [2024-11-20 01:31:30.476024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.463 [2024-11-20 01:31:30.476128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.463 [2024-11-20 01:31:30.476156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.463 qpair failed and we were unable to recover it. 00:30:22.463 [2024-11-20 01:31:30.476265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.463 [2024-11-20 01:31:30.476347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.463 [2024-11-20 01:31:30.476372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.463 qpair failed and we were unable to recover it. 00:30:22.463 [2024-11-20 01:31:30.476475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.463 [2024-11-20 01:31:30.476607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.463 [2024-11-20 01:31:30.476634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.463 qpair failed and we were unable to recover it. 00:30:22.463 [2024-11-20 01:31:30.476732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.463 [2024-11-20 01:31:30.476851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.463 [2024-11-20 01:31:30.476875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.463 qpair failed and we were unable to recover it. 00:30:22.463 [2024-11-20 01:31:30.476963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.463 [2024-11-20 01:31:30.477106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.463 [2024-11-20 01:31:30.477134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.463 qpair failed and we were unable to recover it. 00:30:22.463 [2024-11-20 01:31:30.477239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.463 [2024-11-20 01:31:30.477377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.463 [2024-11-20 01:31:30.477402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.463 qpair failed and we were unable to recover it. 00:30:22.463 [2024-11-20 01:31:30.477499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.463 [2024-11-20 01:31:30.477612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.463 [2024-11-20 01:31:30.477639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.463 qpair failed and we were unable to recover it. 00:30:22.463 [2024-11-20 01:31:30.477742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.463 [2024-11-20 01:31:30.477856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.463 [2024-11-20 01:31:30.477880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.463 qpair failed and we were unable to recover it. 00:30:22.463 [2024-11-20 01:31:30.478021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.463 [2024-11-20 01:31:30.478121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.463 [2024-11-20 01:31:30.478149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.463 qpair failed and we were unable to recover it. 00:30:22.463 [2024-11-20 01:31:30.478251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.463 [2024-11-20 01:31:30.478344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.463 [2024-11-20 01:31:30.478371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.463 qpair failed and we were unable to recover it. 00:30:22.463 [2024-11-20 01:31:30.478538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.463 [2024-11-20 01:31:30.478681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.463 [2024-11-20 01:31:30.478720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.463 qpair failed and we were unable to recover it. 00:30:22.463 [2024-11-20 01:31:30.478817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.463 [2024-11-20 01:31:30.478969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.463 [2024-11-20 01:31:30.478995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.463 qpair failed and we were unable to recover it. 00:30:22.463 [2024-11-20 01:31:30.479116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.463 [2024-11-20 01:31:30.479206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.463 [2024-11-20 01:31:30.479231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.463 qpair failed and we were unable to recover it. 00:30:22.463 [2024-11-20 01:31:30.479323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.463 [2024-11-20 01:31:30.479405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.463 [2024-11-20 01:31:30.479430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.463 qpair failed and we were unable to recover it. 00:30:22.463 [2024-11-20 01:31:30.479560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.463 [2024-11-20 01:31:30.479698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.463 [2024-11-20 01:31:30.479727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.463 qpair failed and we were unable to recover it. 00:30:22.463 [2024-11-20 01:31:30.479840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.463 [2024-11-20 01:31:30.479999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.463 [2024-11-20 01:31:30.480026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.463 qpair failed and we were unable to recover it. 00:30:22.464 [2024-11-20 01:31:30.480193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.464 [2024-11-20 01:31:30.480293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.464 [2024-11-20 01:31:30.480317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.464 qpair failed and we were unable to recover it. 00:30:22.464 [2024-11-20 01:31:30.480408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.464 [2024-11-20 01:31:30.480522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.464 [2024-11-20 01:31:30.480547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.464 qpair failed and we were unable to recover it. 00:30:22.464 [2024-11-20 01:31:30.480633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.464 [2024-11-20 01:31:30.480728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.464 [2024-11-20 01:31:30.480768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.464 qpair failed and we were unable to recover it. 00:30:22.464 [2024-11-20 01:31:30.480888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.464 [2024-11-20 01:31:30.481004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.464 [2024-11-20 01:31:30.481031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.464 qpair failed and we were unable to recover it. 00:30:22.464 [2024-11-20 01:31:30.481155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.464 [2024-11-20 01:31:30.481240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.464 [2024-11-20 01:31:30.481265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.464 qpair failed and we were unable to recover it. 00:30:22.464 [2024-11-20 01:31:30.481426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.464 [2024-11-20 01:31:30.481525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.464 [2024-11-20 01:31:30.481554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.464 qpair failed and we were unable to recover it. 00:30:22.464 [2024-11-20 01:31:30.481715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.464 [2024-11-20 01:31:30.481839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.464 [2024-11-20 01:31:30.481878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.464 qpair failed and we were unable to recover it. 00:30:22.464 [2024-11-20 01:31:30.482002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.464 [2024-11-20 01:31:30.482136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.464 [2024-11-20 01:31:30.482162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.464 qpair failed and we were unable to recover it. 00:30:22.464 [2024-11-20 01:31:30.482310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.464 [2024-11-20 01:31:30.482448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.464 [2024-11-20 01:31:30.482473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.464 qpair failed and we were unable to recover it. 00:30:22.464 [2024-11-20 01:31:30.482621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.464 [2024-11-20 01:31:30.482769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.464 [2024-11-20 01:31:30.482810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.464 qpair failed and we were unable to recover it. 00:30:22.464 [2024-11-20 01:31:30.482918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.464 [2024-11-20 01:31:30.483035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.464 [2024-11-20 01:31:30.483061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.464 qpair failed and we were unable to recover it. 00:30:22.464 [2024-11-20 01:31:30.483249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.464 [2024-11-20 01:31:30.483348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.464 [2024-11-20 01:31:30.483375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.464 qpair failed and we were unable to recover it. 00:30:22.464 [2024-11-20 01:31:30.483517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.464 [2024-11-20 01:31:30.483618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.464 [2024-11-20 01:31:30.483642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.464 qpair failed and we were unable to recover it. 00:30:22.464 [2024-11-20 01:31:30.483823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.464 [2024-11-20 01:31:30.483943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.464 [2024-11-20 01:31:30.483968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.464 qpair failed and we were unable to recover it. 00:30:22.464 [2024-11-20 01:31:30.484062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.464 [2024-11-20 01:31:30.484253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.464 [2024-11-20 01:31:30.484278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.464 qpair failed and we were unable to recover it. 00:30:22.464 [2024-11-20 01:31:30.484427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.464 [2024-11-20 01:31:30.484541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.464 [2024-11-20 01:31:30.484566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.464 qpair failed and we were unable to recover it. 00:30:22.464 [2024-11-20 01:31:30.484710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.464 [2024-11-20 01:31:30.484844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.464 [2024-11-20 01:31:30.484870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.464 qpair failed and we were unable to recover it. 00:30:22.464 [2024-11-20 01:31:30.484973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.464 [2024-11-20 01:31:30.485075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.464 [2024-11-20 01:31:30.485103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.464 qpair failed and we were unable to recover it. 00:30:22.464 [2024-11-20 01:31:30.485215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.464 [2024-11-20 01:31:30.485331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.465 [2024-11-20 01:31:30.485354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.465 qpair failed and we were unable to recover it. 00:30:22.465 [2024-11-20 01:31:30.485499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.465 [2024-11-20 01:31:30.485622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.465 [2024-11-20 01:31:30.485649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.465 qpair failed and we were unable to recover it. 00:30:22.465 [2024-11-20 01:31:30.485786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.465 [2024-11-20 01:31:30.485882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.465 [2024-11-20 01:31:30.485910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.465 qpair failed and we were unable to recover it. 00:30:22.465 [2024-11-20 01:31:30.486036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.465 [2024-11-20 01:31:30.486138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.465 [2024-11-20 01:31:30.486163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.465 qpair failed and we were unable to recover it. 00:30:22.465 [2024-11-20 01:31:30.486328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.465 [2024-11-20 01:31:30.486421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.465 [2024-11-20 01:31:30.486462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.465 qpair failed and we were unable to recover it. 00:30:22.465 [2024-11-20 01:31:30.486610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.465 [2024-11-20 01:31:30.486741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.465 [2024-11-20 01:31:30.486768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.465 qpair failed and we were unable to recover it. 00:30:22.465 [2024-11-20 01:31:30.486918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.465 [2024-11-20 01:31:30.487006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.465 [2024-11-20 01:31:30.487030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.465 qpair failed and we were unable to recover it. 00:30:22.465 [2024-11-20 01:31:30.487149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.465 [2024-11-20 01:31:30.487291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.465 [2024-11-20 01:31:30.487316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.465 qpair failed and we were unable to recover it. 00:30:22.465 [2024-11-20 01:31:30.487422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.465 [2024-11-20 01:31:30.487532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.465 [2024-11-20 01:31:30.487572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.465 qpair failed and we were unable to recover it. 00:30:22.465 [2024-11-20 01:31:30.487663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.465 [2024-11-20 01:31:30.487777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.465 [2024-11-20 01:31:30.487801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.465 qpair failed and we were unable to recover it. 00:30:22.465 [2024-11-20 01:31:30.487920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.465 [2024-11-20 01:31:30.488062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.465 [2024-11-20 01:31:30.488113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.465 qpair failed and we were unable to recover it. 00:30:22.465 [2024-11-20 01:31:30.488237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.465 [2024-11-20 01:31:30.488319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.465 [2024-11-20 01:31:30.488343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.465 qpair failed and we were unable to recover it. 00:30:22.465 [2024-11-20 01:31:30.488441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.465 [2024-11-20 01:31:30.488586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.465 [2024-11-20 01:31:30.488611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.465 qpair failed and we were unable to recover it. 00:30:22.465 [2024-11-20 01:31:30.488750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.465 [2024-11-20 01:31:30.488876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.465 [2024-11-20 01:31:30.488902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.465 qpair failed and we were unable to recover it. 00:30:22.465 [2024-11-20 01:31:30.489006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.465 [2024-11-20 01:31:30.489135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.465 [2024-11-20 01:31:30.489163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.465 qpair failed and we were unable to recover it. 00:30:22.465 [2024-11-20 01:31:30.489301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.465 [2024-11-20 01:31:30.489413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.465 [2024-11-20 01:31:30.489437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.465 qpair failed and we were unable to recover it. 00:30:22.465 [2024-11-20 01:31:30.489545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.465 [2024-11-20 01:31:30.489638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.465 [2024-11-20 01:31:30.489666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.465 qpair failed and we were unable to recover it. 00:30:22.465 [2024-11-20 01:31:30.489821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.465 [2024-11-20 01:31:30.489918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.465 [2024-11-20 01:31:30.489945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.465 qpair failed and we were unable to recover it. 00:30:22.465 [2024-11-20 01:31:30.490081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.465 [2024-11-20 01:31:30.490179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.465 [2024-11-20 01:31:30.490204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.465 qpair failed and we were unable to recover it. 00:30:22.466 [2024-11-20 01:31:30.490286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.466 [2024-11-20 01:31:30.490401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.466 [2024-11-20 01:31:30.490425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.466 qpair failed and we were unable to recover it. 00:30:22.466 [2024-11-20 01:31:30.490514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.466 [2024-11-20 01:31:30.490670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.466 [2024-11-20 01:31:30.490694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.466 qpair failed and we were unable to recover it. 00:30:22.466 [2024-11-20 01:31:30.490819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.466 [2024-11-20 01:31:30.490932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.466 [2024-11-20 01:31:30.490956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.466 qpair failed and we were unable to recover it. 00:30:22.466 [2024-11-20 01:31:30.491033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.466 [2024-11-20 01:31:30.491137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.466 [2024-11-20 01:31:30.491162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.466 qpair failed and we were unable to recover it. 00:30:22.466 [2024-11-20 01:31:30.491261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.466 [2024-11-20 01:31:30.491410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.466 [2024-11-20 01:31:30.491439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.466 qpair failed and we were unable to recover it. 00:30:22.466 [2024-11-20 01:31:30.491535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.466 [2024-11-20 01:31:30.491663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.466 [2024-11-20 01:31:30.491687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.466 qpair failed and we were unable to recover it. 00:30:22.466 [2024-11-20 01:31:30.491830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.466 [2024-11-20 01:31:30.491925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.466 [2024-11-20 01:31:30.491952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.466 qpair failed and we were unable to recover it. 00:30:22.466 [2024-11-20 01:31:30.492050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.466 [2024-11-20 01:31:30.492153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.466 [2024-11-20 01:31:30.492180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.466 qpair failed and we were unable to recover it. 00:30:22.466 [2024-11-20 01:31:30.492295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.466 [2024-11-20 01:31:30.492372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.466 [2024-11-20 01:31:30.492396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.466 qpair failed and we were unable to recover it. 00:30:22.466 [2024-11-20 01:31:30.492486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.466 [2024-11-20 01:31:30.492598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.466 [2024-11-20 01:31:30.492622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.466 qpair failed and we were unable to recover it. 00:30:22.466 [2024-11-20 01:31:30.492722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.466 [2024-11-20 01:31:30.492865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.466 [2024-11-20 01:31:30.492891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.466 qpair failed and we were unable to recover it. 00:30:22.466 [2024-11-20 01:31:30.493032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.466 [2024-11-20 01:31:30.493125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.466 [2024-11-20 01:31:30.493150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.466 qpair failed and we were unable to recover it. 00:30:22.466 [2024-11-20 01:31:30.493264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.466 [2024-11-20 01:31:30.493390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.466 [2024-11-20 01:31:30.493416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.466 qpair failed and we were unable to recover it. 00:30:22.466 [2024-11-20 01:31:30.493524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.466 [2024-11-20 01:31:30.493621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.466 [2024-11-20 01:31:30.493647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.466 qpair failed and we were unable to recover it. 00:30:22.466 [2024-11-20 01:31:30.493760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.466 [2024-11-20 01:31:30.493839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.466 [2024-11-20 01:31:30.493862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.466 qpair failed and we were unable to recover it. 00:30:22.466 [2024-11-20 01:31:30.493948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.466 [2024-11-20 01:31:30.494065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.466 [2024-11-20 01:31:30.494113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.466 qpair failed and we were unable to recover it. 00:30:22.466 [2024-11-20 01:31:30.494211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.466 [2024-11-20 01:31:30.494309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.466 [2024-11-20 01:31:30.494338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.466 qpair failed and we were unable to recover it. 00:30:22.466 [2024-11-20 01:31:30.494510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.466 [2024-11-20 01:31:30.494654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.466 [2024-11-20 01:31:30.494695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.466 qpair failed and we were unable to recover it. 00:30:22.466 [2024-11-20 01:31:30.494845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.467 [2024-11-20 01:31:30.494965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.467 [2024-11-20 01:31:30.494992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.467 qpair failed and we were unable to recover it. 00:30:22.467 [2024-11-20 01:31:30.495134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.467 [2024-11-20 01:31:30.495224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.467 [2024-11-20 01:31:30.495249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.467 qpair failed and we were unable to recover it. 00:30:22.467 [2024-11-20 01:31:30.495342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.467 [2024-11-20 01:31:30.495461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.467 [2024-11-20 01:31:30.495485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.467 qpair failed and we were unable to recover it. 00:30:22.467 [2024-11-20 01:31:30.495592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.467 [2024-11-20 01:31:30.495688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.467 [2024-11-20 01:31:30.495716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.467 qpair failed and we were unable to recover it. 00:30:22.467 [2024-11-20 01:31:30.495862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.467 [2024-11-20 01:31:30.496010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.467 [2024-11-20 01:31:30.496037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.467 qpair failed and we were unable to recover it. 00:30:22.467 [2024-11-20 01:31:30.496193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.467 [2024-11-20 01:31:30.496282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.467 [2024-11-20 01:31:30.496307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.467 qpair failed and we were unable to recover it. 00:30:22.467 [2024-11-20 01:31:30.496451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.467 [2024-11-20 01:31:30.496541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.467 [2024-11-20 01:31:30.496566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.467 qpair failed and we were unable to recover it. 00:30:22.467 [2024-11-20 01:31:30.496683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.467 [2024-11-20 01:31:30.496813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.467 [2024-11-20 01:31:30.496841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.467 qpair failed and we were unable to recover it. 00:30:22.467 [2024-11-20 01:31:30.496989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.467 [2024-11-20 01:31:30.497111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.467 [2024-11-20 01:31:30.497136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.467 qpair failed and we were unable to recover it. 00:30:22.467 [2024-11-20 01:31:30.497271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.467 [2024-11-20 01:31:30.497371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.467 [2024-11-20 01:31:30.497398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.467 qpair failed and we were unable to recover it. 00:30:22.467 [2024-11-20 01:31:30.497554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.467 [2024-11-20 01:31:30.497672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.467 [2024-11-20 01:31:30.497698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.467 qpair failed and we were unable to recover it. 00:30:22.467 [2024-11-20 01:31:30.497805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.467 [2024-11-20 01:31:30.497915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.467 [2024-11-20 01:31:30.497939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.467 qpair failed and we were unable to recover it. 00:30:22.467 [2024-11-20 01:31:30.498078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.467 [2024-11-20 01:31:30.498176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.467 [2024-11-20 01:31:30.498202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.467 qpair failed and we were unable to recover it. 00:30:22.467 [2024-11-20 01:31:30.498306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.467 [2024-11-20 01:31:30.498468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.467 [2024-11-20 01:31:30.498493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.467 qpair failed and we were unable to recover it. 00:30:22.467 [2024-11-20 01:31:30.498584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.467 [2024-11-20 01:31:30.498700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.467 [2024-11-20 01:31:30.498724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.467 qpair failed and we were unable to recover it. 00:30:22.467 [2024-11-20 01:31:30.498829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.467 [2024-11-20 01:31:30.498984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.467 [2024-11-20 01:31:30.499011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.467 qpair failed and we were unable to recover it. 00:30:22.467 [2024-11-20 01:31:30.499126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.467 [2024-11-20 01:31:30.499219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.467 [2024-11-20 01:31:30.499246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.467 qpair failed and we were unable to recover it. 00:30:22.467 [2024-11-20 01:31:30.499404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.467 [2024-11-20 01:31:30.499552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.467 [2024-11-20 01:31:30.499592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.467 qpair failed and we were unable to recover it. 00:30:22.467 [2024-11-20 01:31:30.499723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.467 [2024-11-20 01:31:30.499881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.467 [2024-11-20 01:31:30.499906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.467 qpair failed and we were unable to recover it. 00:30:22.467 [2024-11-20 01:31:30.500027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.468 [2024-11-20 01:31:30.500131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.468 [2024-11-20 01:31:30.500159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.468 qpair failed and we were unable to recover it. 00:30:22.468 [2024-11-20 01:31:30.500266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.468 [2024-11-20 01:31:30.500360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.468 [2024-11-20 01:31:30.500384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.468 qpair failed and we were unable to recover it. 00:30:22.468 [2024-11-20 01:31:30.500501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.468 [2024-11-20 01:31:30.500589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.468 [2024-11-20 01:31:30.500613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.468 qpair failed and we were unable to recover it. 00:30:22.468 [2024-11-20 01:31:30.500728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.468 [2024-11-20 01:31:30.500862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.468 [2024-11-20 01:31:30.500890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.468 qpair failed and we were unable to recover it. 00:30:22.468 [2024-11-20 01:31:30.500994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.468 [2024-11-20 01:31:30.501107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.468 [2024-11-20 01:31:30.501133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.468 qpair failed and we were unable to recover it. 00:30:22.468 [2024-11-20 01:31:30.501223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.468 [2024-11-20 01:31:30.501367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.468 [2024-11-20 01:31:30.501392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.468 qpair failed and we were unable to recover it. 00:30:22.468 [2024-11-20 01:31:30.501497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.468 [2024-11-20 01:31:30.501594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.468 [2024-11-20 01:31:30.501621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.468 qpair failed and we were unable to recover it. 00:30:22.468 [2024-11-20 01:31:30.501733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.468 [2024-11-20 01:31:30.501850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.468 [2024-11-20 01:31:30.501874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.468 qpair failed and we were unable to recover it. 00:30:22.468 [2024-11-20 01:31:30.502045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.468 [2024-11-20 01:31:30.502181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.468 [2024-11-20 01:31:30.502207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.468 qpair failed and we were unable to recover it. 00:30:22.468 [2024-11-20 01:31:30.502288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.468 [2024-11-20 01:31:30.502421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.468 [2024-11-20 01:31:30.502448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.468 qpair failed and we were unable to recover it. 00:30:22.468 [2024-11-20 01:31:30.502569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.468 [2024-11-20 01:31:30.502653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.468 [2024-11-20 01:31:30.502678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.468 qpair failed and we were unable to recover it. 00:30:22.468 [2024-11-20 01:31:30.502805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.468 [2024-11-20 01:31:30.502987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.468 [2024-11-20 01:31:30.503014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.468 qpair failed and we were unable to recover it. 00:30:22.468 [2024-11-20 01:31:30.503122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.468 [2024-11-20 01:31:30.503237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.468 [2024-11-20 01:31:30.503265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.468 qpair failed and we were unable to recover it. 00:30:22.468 [2024-11-20 01:31:30.503406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.468 [2024-11-20 01:31:30.503497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.468 [2024-11-20 01:31:30.503523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.468 qpair failed and we were unable to recover it. 00:30:22.468 [2024-11-20 01:31:30.503623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.468 [2024-11-20 01:31:30.503732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.468 [2024-11-20 01:31:30.503757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.468 qpair failed and we were unable to recover it. 00:30:22.468 [2024-11-20 01:31:30.503834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.468 [2024-11-20 01:31:30.504001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.468 [2024-11-20 01:31:30.504027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.468 qpair failed and we were unable to recover it. 00:30:22.469 [2024-11-20 01:31:30.504145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.469 [2024-11-20 01:31:30.504264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.469 [2024-11-20 01:31:30.504289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.469 qpair failed and we were unable to recover it. 00:30:22.469 [2024-11-20 01:31:30.504380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.469 [2024-11-20 01:31:30.504540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.469 [2024-11-20 01:31:30.504567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.469 qpair failed and we were unable to recover it. 00:30:22.469 [2024-11-20 01:31:30.504659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.469 [2024-11-20 01:31:30.504755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.469 [2024-11-20 01:31:30.504783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.469 qpair failed and we were unable to recover it. 00:30:22.469 [2024-11-20 01:31:30.504897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.469 [2024-11-20 01:31:30.504986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.469 [2024-11-20 01:31:30.505011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.469 qpair failed and we were unable to recover it. 00:30:22.469 [2024-11-20 01:31:30.505115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.469 [2024-11-20 01:31:30.505247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.469 [2024-11-20 01:31:30.505274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.469 qpair failed and we were unable to recover it. 00:30:22.469 [2024-11-20 01:31:30.505435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.469 [2024-11-20 01:31:30.505562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.469 [2024-11-20 01:31:30.505589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.469 qpair failed and we were unable to recover it. 00:30:22.469 [2024-11-20 01:31:30.505704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.469 [2024-11-20 01:31:30.505786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.469 [2024-11-20 01:31:30.505812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.469 qpair failed and we were unable to recover it. 00:30:22.469 [2024-11-20 01:31:30.505926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.469 [2024-11-20 01:31:30.506012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.469 [2024-11-20 01:31:30.506037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.469 qpair failed and we were unable to recover it. 00:30:22.469 [2024-11-20 01:31:30.506138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.469 [2024-11-20 01:31:30.506265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.469 [2024-11-20 01:31:30.506289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.469 qpair failed and we were unable to recover it. 00:30:22.469 [2024-11-20 01:31:30.506439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.469 [2024-11-20 01:31:30.506537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.469 [2024-11-20 01:31:30.506562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.469 qpair failed and we were unable to recover it. 00:30:22.469 [2024-11-20 01:31:30.506730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.469 [2024-11-20 01:31:30.506849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.469 [2024-11-20 01:31:30.506878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.469 qpair failed and we were unable to recover it. 00:30:22.469 [2024-11-20 01:31:30.506983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.469 [2024-11-20 01:31:30.507143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.469 [2024-11-20 01:31:30.507172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.469 qpair failed and we were unable to recover it. 00:30:22.469 [2024-11-20 01:31:30.507308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.469 [2024-11-20 01:31:30.507430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.469 [2024-11-20 01:31:30.507455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.469 qpair failed and we were unable to recover it. 00:30:22.469 [2024-11-20 01:31:30.507546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.469 [2024-11-20 01:31:30.507648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.469 [2024-11-20 01:31:30.507675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.469 qpair failed and we were unable to recover it. 00:30:22.469 [2024-11-20 01:31:30.507794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.469 [2024-11-20 01:31:30.507908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.469 [2024-11-20 01:31:30.507935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.469 qpair failed and we were unable to recover it. 00:30:22.469 [2024-11-20 01:31:30.508047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.469 [2024-11-20 01:31:30.508144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.469 [2024-11-20 01:31:30.508170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.469 qpair failed and we were unable to recover it. 00:30:22.469 [2024-11-20 01:31:30.508321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.469 [2024-11-20 01:31:30.508476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.469 [2024-11-20 01:31:30.508504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.469 qpair failed and we were unable to recover it. 00:30:22.469 [2024-11-20 01:31:30.508659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.469 [2024-11-20 01:31:30.508761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.469 [2024-11-20 01:31:30.508787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.469 qpair failed and we were unable to recover it. 00:30:22.469 [2024-11-20 01:31:30.508943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.469 [2024-11-20 01:31:30.509031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.469 [2024-11-20 01:31:30.509054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.469 qpair failed and we were unable to recover it. 00:30:22.469 [2024-11-20 01:31:30.509162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.469 [2024-11-20 01:31:30.509267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.469 [2024-11-20 01:31:30.509294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.469 qpair failed and we were unable to recover it. 00:30:22.469 [2024-11-20 01:31:30.509422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.469 [2024-11-20 01:31:30.509520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.469 [2024-11-20 01:31:30.509546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.469 qpair failed and we were unable to recover it. 00:30:22.469 [2024-11-20 01:31:30.509656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.469 [2024-11-20 01:31:30.509750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.469 [2024-11-20 01:31:30.509775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.469 qpair failed and we were unable to recover it. 00:30:22.469 [2024-11-20 01:31:30.509899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.469 [2024-11-20 01:31:30.510042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.469 [2024-11-20 01:31:30.510066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.469 qpair failed and we were unable to recover it. 00:30:22.469 [2024-11-20 01:31:30.510190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.469 [2024-11-20 01:31:30.510277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.469 [2024-11-20 01:31:30.510304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.469 qpair failed and we were unable to recover it. 00:30:22.469 [2024-11-20 01:31:30.510444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.469 [2024-11-20 01:31:30.510539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.469 [2024-11-20 01:31:30.510563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.469 qpair failed and we were unable to recover it. 00:30:22.469 [2024-11-20 01:31:30.510649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.469 [2024-11-20 01:31:30.510755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.469 [2024-11-20 01:31:30.510783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.469 qpair failed and we were unable to recover it. 00:30:22.469 [2024-11-20 01:31:30.510881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.469 [2024-11-20 01:31:30.511016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.469 [2024-11-20 01:31:30.511042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.469 qpair failed and we were unable to recover it. 00:30:22.469 [2024-11-20 01:31:30.511151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.469 [2024-11-20 01:31:30.511276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.469 [2024-11-20 01:31:30.511302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.470 qpair failed and we were unable to recover it. 00:30:22.470 [2024-11-20 01:31:30.511420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.470 [2024-11-20 01:31:30.511540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.470 [2024-11-20 01:31:30.511565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.470 qpair failed and we were unable to recover it. 00:30:22.470 [2024-11-20 01:31:30.511727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.470 [2024-11-20 01:31:30.511865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.470 [2024-11-20 01:31:30.511892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.470 qpair failed and we were unable to recover it. 00:30:22.470 [2024-11-20 01:31:30.512026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.470 [2024-11-20 01:31:30.512110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.470 [2024-11-20 01:31:30.512135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.470 qpair failed and we were unable to recover it. 00:30:22.470 [2024-11-20 01:31:30.512274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.470 [2024-11-20 01:31:30.512425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.470 [2024-11-20 01:31:30.512452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.470 qpair failed and we were unable to recover it. 00:30:22.470 [2024-11-20 01:31:30.512553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.470 [2024-11-20 01:31:30.512651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.470 [2024-11-20 01:31:30.512678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.470 qpair failed and we were unable to recover it. 00:30:22.470 [2024-11-20 01:31:30.512787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.470 [2024-11-20 01:31:30.512881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.470 [2024-11-20 01:31:30.512906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.470 qpair failed and we were unable to recover it. 00:30:22.470 [2024-11-20 01:31:30.513027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.470 [2024-11-20 01:31:30.513176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.470 [2024-11-20 01:31:30.513204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.470 qpair failed and we were unable to recover it. 00:30:22.470 [2024-11-20 01:31:30.513315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.470 [2024-11-20 01:31:30.513445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.470 [2024-11-20 01:31:30.513471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.470 qpair failed and we were unable to recover it. 00:30:22.470 [2024-11-20 01:31:30.513613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.470 [2024-11-20 01:31:30.513725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.470 [2024-11-20 01:31:30.513749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.470 qpair failed and we were unable to recover it. 00:30:22.470 [2024-11-20 01:31:30.513903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.470 [2024-11-20 01:31:30.513994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.470 [2024-11-20 01:31:30.514019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.470 qpair failed and we were unable to recover it. 00:30:22.470 [2024-11-20 01:31:30.514182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.470 [2024-11-20 01:31:30.514309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.470 [2024-11-20 01:31:30.514336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.470 qpair failed and we were unable to recover it. 00:30:22.470 [2024-11-20 01:31:30.514471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.470 [2024-11-20 01:31:30.514585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.470 [2024-11-20 01:31:30.514615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.470 qpair failed and we were unable to recover it. 00:30:22.470 [2024-11-20 01:31:30.514775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.470 [2024-11-20 01:31:30.514906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.470 [2024-11-20 01:31:30.514934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.470 qpair failed and we were unable to recover it. 00:30:22.470 [2024-11-20 01:31:30.515094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.470 [2024-11-20 01:31:30.515290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.470 [2024-11-20 01:31:30.515343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.470 qpair failed and we were unable to recover it. 00:30:22.470 [2024-11-20 01:31:30.515457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.470 [2024-11-20 01:31:30.515551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.470 [2024-11-20 01:31:30.515575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.470 qpair failed and we were unable to recover it. 00:30:22.470 [2024-11-20 01:31:30.515670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.470 [2024-11-20 01:31:30.515781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.470 [2024-11-20 01:31:30.515805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.470 qpair failed and we were unable to recover it. 00:30:22.470 [2024-11-20 01:31:30.515885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.470 [2024-11-20 01:31:30.515972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.470 [2024-11-20 01:31:30.515997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.470 qpair failed and we were unable to recover it. 00:30:22.470 [2024-11-20 01:31:30.516083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.470 [2024-11-20 01:31:30.516203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.470 [2024-11-20 01:31:30.516227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.470 qpair failed and we were unable to recover it. 00:30:22.470 [2024-11-20 01:31:30.516343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.470 [2024-11-20 01:31:30.516451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.470 [2024-11-20 01:31:30.516476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.470 qpair failed and we were unable to recover it. 00:30:22.470 [2024-11-20 01:31:30.516587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.470 [2024-11-20 01:31:30.516706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.470 [2024-11-20 01:31:30.516733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.470 qpair failed and we were unable to recover it. 00:30:22.470 [2024-11-20 01:31:30.516838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.470 [2024-11-20 01:31:30.516956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.470 [2024-11-20 01:31:30.516981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.470 qpair failed and we were unable to recover it. 00:30:22.470 [2024-11-20 01:31:30.517121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.470 [2024-11-20 01:31:30.517259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.470 [2024-11-20 01:31:30.517287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.470 qpair failed and we were unable to recover it. 00:30:22.470 [2024-11-20 01:31:30.517406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.470 [2024-11-20 01:31:30.517502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.470 [2024-11-20 01:31:30.517526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.470 qpair failed and we were unable to recover it. 00:30:22.470 [2024-11-20 01:31:30.517611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.470 [2024-11-20 01:31:30.517693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.470 [2024-11-20 01:31:30.517717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.470 qpair failed and we were unable to recover it. 00:30:22.470 [2024-11-20 01:31:30.517854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.470 [2024-11-20 01:31:30.518003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.470 [2024-11-20 01:31:30.518030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.470 qpair failed and we were unable to recover it. 00:30:22.470 [2024-11-20 01:31:30.518206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.471 [2024-11-20 01:31:30.518358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.471 [2024-11-20 01:31:30.518383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.471 qpair failed and we were unable to recover it. 00:30:22.471 [2024-11-20 01:31:30.518503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.471 [2024-11-20 01:31:30.518593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.471 [2024-11-20 01:31:30.518617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.471 qpair failed and we were unable to recover it. 00:30:22.471 [2024-11-20 01:31:30.518717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.471 [2024-11-20 01:31:30.518844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.471 [2024-11-20 01:31:30.518871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.471 qpair failed and we were unable to recover it. 00:30:22.471 [2024-11-20 01:31:30.518972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.471 [2024-11-20 01:31:30.519064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.471 [2024-11-20 01:31:30.519101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.471 qpair failed and we were unable to recover it. 00:30:22.471 [2024-11-20 01:31:30.519240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.471 [2024-11-20 01:31:30.519356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.471 [2024-11-20 01:31:30.519382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.471 qpair failed and we were unable to recover it. 00:30:22.471 [2024-11-20 01:31:30.519539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.471 [2024-11-20 01:31:30.519640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.471 [2024-11-20 01:31:30.519666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.471 qpair failed and we were unable to recover it. 00:30:22.471 [2024-11-20 01:31:30.519794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.471 [2024-11-20 01:31:30.519893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.471 [2024-11-20 01:31:30.519925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.471 qpair failed and we were unable to recover it. 00:30:22.471 [2024-11-20 01:31:30.520105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.471 [2024-11-20 01:31:30.520198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.471 [2024-11-20 01:31:30.520222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.471 qpair failed and we were unable to recover it. 00:30:22.471 [2024-11-20 01:31:30.520354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.471 [2024-11-20 01:31:30.520494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.471 [2024-11-20 01:31:30.520518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.471 qpair failed and we were unable to recover it. 00:30:22.471 [2024-11-20 01:31:30.520609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.471 [2024-11-20 01:31:30.520690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.471 [2024-11-20 01:31:30.520714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.471 qpair failed and we were unable to recover it. 00:30:22.471 [2024-11-20 01:31:30.520826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.471 [2024-11-20 01:31:30.520962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.471 [2024-11-20 01:31:30.520986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.471 qpair failed and we were unable to recover it. 00:30:22.471 [2024-11-20 01:31:30.521095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.471 [2024-11-20 01:31:30.521218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.471 [2024-11-20 01:31:30.521244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.471 qpair failed and we were unable to recover it. 00:30:22.471 [2024-11-20 01:31:30.521372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.471 [2024-11-20 01:31:30.521468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.471 [2024-11-20 01:31:30.521495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.471 qpair failed and we were unable to recover it. 00:30:22.471 [2024-11-20 01:31:30.521603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.471 [2024-11-20 01:31:30.521709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.471 [2024-11-20 01:31:30.521733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.471 qpair failed and we were unable to recover it. 00:30:22.471 [2024-11-20 01:31:30.521863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.471 [2024-11-20 01:31:30.522001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.471 [2024-11-20 01:31:30.522028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.471 qpair failed and we were unable to recover it. 00:30:22.471 [2024-11-20 01:31:30.522146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.471 [2024-11-20 01:31:30.522233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.471 [2024-11-20 01:31:30.522261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.471 qpair failed and we were unable to recover it. 00:30:22.471 [2024-11-20 01:31:30.522422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.471 [2024-11-20 01:31:30.522535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.471 [2024-11-20 01:31:30.522564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.471 qpair failed and we were unable to recover it. 00:30:22.471 [2024-11-20 01:31:30.522741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.471 [2024-11-20 01:31:30.522859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.471 [2024-11-20 01:31:30.522883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.471 qpair failed and we were unable to recover it. 00:30:22.471 [2024-11-20 01:31:30.522985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.471 [2024-11-20 01:31:30.523107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.471 [2024-11-20 01:31:30.523135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.471 qpair failed and we were unable to recover it. 00:30:22.471 [2024-11-20 01:31:30.523299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.471 [2024-11-20 01:31:30.523410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.471 [2024-11-20 01:31:30.523434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.471 qpair failed and we were unable to recover it. 00:30:22.471 [2024-11-20 01:31:30.523593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.471 [2024-11-20 01:31:30.523724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.471 [2024-11-20 01:31:30.523748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.471 qpair failed and we were unable to recover it. 00:30:22.471 [2024-11-20 01:31:30.523867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.471 [2024-11-20 01:31:30.523974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.471 [2024-11-20 01:31:30.524002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.471 qpair failed and we were unable to recover it. 00:30:22.471 [2024-11-20 01:31:30.524112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.471 [2024-11-20 01:31:30.524227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.471 [2024-11-20 01:31:30.524253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.471 qpair failed and we were unable to recover it. 00:30:22.471 [2024-11-20 01:31:30.524345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.471 [2024-11-20 01:31:30.524444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.471 [2024-11-20 01:31:30.524471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.471 qpair failed and we were unable to recover it. 00:30:22.471 [2024-11-20 01:31:30.524568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.471 [2024-11-20 01:31:30.524677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.471 [2024-11-20 01:31:30.524702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.471 qpair failed and we were unable to recover it. 00:30:22.471 [2024-11-20 01:31:30.524796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.471 [2024-11-20 01:31:30.524951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.471 [2024-11-20 01:31:30.524975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.471 qpair failed and we were unable to recover it. 00:30:22.471 [2024-11-20 01:31:30.525094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.471 [2024-11-20 01:31:30.525215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.471 [2024-11-20 01:31:30.525239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.471 qpair failed and we were unable to recover it. 00:30:22.471 [2024-11-20 01:31:30.525354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.471 [2024-11-20 01:31:30.525503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.471 [2024-11-20 01:31:30.525526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.471 qpair failed and we were unable to recover it. 00:30:22.472 [2024-11-20 01:31:30.525668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.472 [2024-11-20 01:31:30.525785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.472 [2024-11-20 01:31:30.525810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.472 qpair failed and we were unable to recover it. 00:30:22.472 [2024-11-20 01:31:30.525957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.472 [2024-11-20 01:31:30.526083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.472 [2024-11-20 01:31:30.526110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.472 qpair failed and we were unable to recover it. 00:30:22.472 [2024-11-20 01:31:30.526207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.472 [2024-11-20 01:31:30.526307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.472 [2024-11-20 01:31:30.526334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.472 qpair failed and we were unable to recover it. 00:30:22.472 [2024-11-20 01:31:30.526448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.472 [2024-11-20 01:31:30.526562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.472 [2024-11-20 01:31:30.526586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.472 qpair failed and we were unable to recover it. 00:30:22.472 [2024-11-20 01:31:30.526728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.472 [2024-11-20 01:31:30.526893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.472 [2024-11-20 01:31:30.526918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.472 qpair failed and we were unable to recover it. 00:30:22.472 [2024-11-20 01:31:30.527033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.472 [2024-11-20 01:31:30.527182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.472 [2024-11-20 01:31:30.527211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.472 qpair failed and we were unable to recover it. 00:30:22.472 [2024-11-20 01:31:30.527320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.472 [2024-11-20 01:31:30.527442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.472 [2024-11-20 01:31:30.527467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.472 qpair failed and we were unable to recover it. 00:30:22.472 [2024-11-20 01:31:30.527599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.472 [2024-11-20 01:31:30.527726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.472 [2024-11-20 01:31:30.527753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.472 qpair failed and we were unable to recover it. 00:30:22.472 [2024-11-20 01:31:30.527852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.472 [2024-11-20 01:31:30.527948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.472 [2024-11-20 01:31:30.527976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.472 qpair failed and we were unable to recover it. 00:30:22.472 [2024-11-20 01:31:30.528125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.472 [2024-11-20 01:31:30.528236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.472 [2024-11-20 01:31:30.528261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.472 qpair failed and we were unable to recover it. 00:30:22.472 [2024-11-20 01:31:30.528344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.472 [2024-11-20 01:31:30.528496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.472 [2024-11-20 01:31:30.528521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.472 qpair failed and we were unable to recover it. 00:30:22.472 [2024-11-20 01:31:30.528661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.472 [2024-11-20 01:31:30.528806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.472 [2024-11-20 01:31:30.528831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.472 qpair failed and we were unable to recover it. 00:30:22.472 [2024-11-20 01:31:30.528968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.472 [2024-11-20 01:31:30.529120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.472 [2024-11-20 01:31:30.529146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.472 qpair failed and we were unable to recover it. 00:30:22.472 [2024-11-20 01:31:30.529237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.472 [2024-11-20 01:31:30.529363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.472 [2024-11-20 01:31:30.529388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.472 qpair failed and we were unable to recover it. 00:30:22.472 [2024-11-20 01:31:30.529503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.472 [2024-11-20 01:31:30.529629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.472 [2024-11-20 01:31:30.529657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.472 qpair failed and we were unable to recover it. 00:30:22.472 [2024-11-20 01:31:30.529796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.472 [2024-11-20 01:31:30.529914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.472 [2024-11-20 01:31:30.529940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.472 qpair failed and we were unable to recover it. 00:30:22.472 [2024-11-20 01:31:30.530107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.472 [2024-11-20 01:31:30.530233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.472 [2024-11-20 01:31:30.530261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.472 qpair failed and we were unable to recover it. 00:30:22.472 [2024-11-20 01:31:30.530385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.472 [2024-11-20 01:31:30.530528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.472 [2024-11-20 01:31:30.530552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.472 qpair failed and we were unable to recover it. 00:30:22.472 [2024-11-20 01:31:30.530640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.472 [2024-11-20 01:31:30.530754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.472 [2024-11-20 01:31:30.530779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.472 qpair failed and we were unable to recover it. 00:30:22.472 [2024-11-20 01:31:30.530917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.472 [2024-11-20 01:31:30.531010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.472 [2024-11-20 01:31:30.531037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.472 qpair failed and we were unable to recover it. 00:30:22.472 [2024-11-20 01:31:30.531182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.472 [2024-11-20 01:31:30.531273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.472 [2024-11-20 01:31:30.531298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.472 qpair failed and we were unable to recover it. 00:30:22.472 [2024-11-20 01:31:30.531424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.472 [2024-11-20 01:31:30.531539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.472 [2024-11-20 01:31:30.531563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.472 qpair failed and we were unable to recover it. 00:30:22.472 [2024-11-20 01:31:30.531678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.472 [2024-11-20 01:31:30.531779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.472 [2024-11-20 01:31:30.531823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.472 qpair failed and we were unable to recover it. 00:30:22.472 [2024-11-20 01:31:30.531908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.472 [2024-11-20 01:31:30.532022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.472 [2024-11-20 01:31:30.532063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.472 qpair failed and we were unable to recover it. 00:30:22.472 [2024-11-20 01:31:30.532175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.472 [2024-11-20 01:31:30.532288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.472 [2024-11-20 01:31:30.532313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.472 qpair failed and we were unable to recover it. 00:30:22.472 [2024-11-20 01:31:30.532408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.472 [2024-11-20 01:31:30.532554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.472 [2024-11-20 01:31:30.532582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.472 qpair failed and we were unable to recover it. 00:30:22.472 [2024-11-20 01:31:30.532680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.472 [2024-11-20 01:31:30.532808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.472 [2024-11-20 01:31:30.532836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.472 qpair failed and we were unable to recover it. 00:30:22.472 [2024-11-20 01:31:30.532957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.472 [2024-11-20 01:31:30.533066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.472 [2024-11-20 01:31:30.533099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.472 qpair failed and we were unable to recover it. 00:30:22.472 [2024-11-20 01:31:30.533214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.473 [2024-11-20 01:31:30.533306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.473 [2024-11-20 01:31:30.533351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.473 qpair failed and we were unable to recover it. 00:30:22.473 [2024-11-20 01:31:30.533481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.473 [2024-11-20 01:31:30.533577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.473 [2024-11-20 01:31:30.533601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.473 qpair failed and we were unable to recover it. 00:30:22.473 [2024-11-20 01:31:30.533697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.473 [2024-11-20 01:31:30.533785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.473 [2024-11-20 01:31:30.533809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.473 qpair failed and we were unable to recover it. 00:30:22.473 [2024-11-20 01:31:30.533906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.473 [2024-11-20 01:31:30.534015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.473 [2024-11-20 01:31:30.534043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.473 qpair failed and we were unable to recover it. 00:30:22.473 [2024-11-20 01:31:30.534181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.473 [2024-11-20 01:31:30.534327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.473 [2024-11-20 01:31:30.534352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.473 qpair failed and we were unable to recover it. 00:30:22.473 [2024-11-20 01:31:30.534469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.473 [2024-11-20 01:31:30.534583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.473 [2024-11-20 01:31:30.534608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.473 qpair failed and we were unable to recover it. 00:30:22.473 [2024-11-20 01:31:30.534713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.473 [2024-11-20 01:31:30.534837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.473 [2024-11-20 01:31:30.534865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.473 qpair failed and we were unable to recover it. 00:30:22.473 [2024-11-20 01:31:30.534967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.473 [2024-11-20 01:31:30.535063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.473 [2024-11-20 01:31:30.535101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.473 qpair failed and we were unable to recover it. 00:30:22.473 [2024-11-20 01:31:30.535269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.473 [2024-11-20 01:31:30.535350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.473 [2024-11-20 01:31:30.535374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.473 qpair failed and we were unable to recover it. 00:30:22.473 [2024-11-20 01:31:30.535513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.473 [2024-11-20 01:31:30.535617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.473 [2024-11-20 01:31:30.535645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.473 qpair failed and we were unable to recover it. 00:30:22.473 [2024-11-20 01:31:30.535772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.473 [2024-11-20 01:31:30.535882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.473 [2024-11-20 01:31:30.535910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.473 qpair failed and we were unable to recover it. 00:30:22.473 [2024-11-20 01:31:30.536085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.473 [2024-11-20 01:31:30.536175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.473 [2024-11-20 01:31:30.536201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.473 qpair failed and we were unable to recover it. 00:30:22.473 [2024-11-20 01:31:30.536332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.473 [2024-11-20 01:31:30.536414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.473 [2024-11-20 01:31:30.536440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.473 qpair failed and we were unable to recover it. 00:30:22.473 [2024-11-20 01:31:30.536554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.473 [2024-11-20 01:31:30.536666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.473 [2024-11-20 01:31:30.536691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.473 qpair failed and we were unable to recover it. 00:30:22.473 [2024-11-20 01:31:30.536812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.473 [2024-11-20 01:31:30.536924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.473 [2024-11-20 01:31:30.536949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.473 qpair failed and we were unable to recover it. 00:30:22.473 [2024-11-20 01:31:30.537093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.473 [2024-11-20 01:31:30.537230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.473 [2024-11-20 01:31:30.537255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.473 qpair failed and we were unable to recover it. 00:30:22.473 [2024-11-20 01:31:30.537417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.473 [2024-11-20 01:31:30.537545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.473 [2024-11-20 01:31:30.537572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.473 qpair failed and we were unable to recover it. 00:30:22.473 [2024-11-20 01:31:30.537680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.473 [2024-11-20 01:31:30.537796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.473 [2024-11-20 01:31:30.537821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.473 qpair failed and we were unable to recover it. 00:30:22.473 [2024-11-20 01:31:30.537952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.473 [2024-11-20 01:31:30.538082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.473 [2024-11-20 01:31:30.538110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.473 qpair failed and we were unable to recover it. 00:30:22.473 [2024-11-20 01:31:30.538218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.473 [2024-11-20 01:31:30.538312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.473 [2024-11-20 01:31:30.538339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.473 qpair failed and we were unable to recover it. 00:30:22.473 [2024-11-20 01:31:30.538448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.473 [2024-11-20 01:31:30.538535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.473 [2024-11-20 01:31:30.538559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.473 qpair failed and we were unable to recover it. 00:30:22.473 [2024-11-20 01:31:30.538675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.473 [2024-11-20 01:31:30.538792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.473 [2024-11-20 01:31:30.538835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.473 qpair failed and we were unable to recover it. 00:30:22.473 [2024-11-20 01:31:30.538967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.473 [2024-11-20 01:31:30.539057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.473 [2024-11-20 01:31:30.539102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.473 qpair failed and we were unable to recover it. 00:30:22.473 [2024-11-20 01:31:30.539214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.473 [2024-11-20 01:31:30.539299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.473 [2024-11-20 01:31:30.539324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.473 qpair failed and we were unable to recover it. 00:30:22.473 [2024-11-20 01:31:30.539468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.473 [2024-11-20 01:31:30.539559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.473 [2024-11-20 01:31:30.539584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.474 qpair failed and we were unable to recover it. 00:30:22.474 [2024-11-20 01:31:30.539680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.474 [2024-11-20 01:31:30.539789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.474 [2024-11-20 01:31:30.539814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.474 qpair failed and we were unable to recover it. 00:30:22.474 [2024-11-20 01:31:30.539945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.474 [2024-11-20 01:31:30.540058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.474 [2024-11-20 01:31:30.540094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.474 qpair failed and we were unable to recover it. 00:30:22.474 [2024-11-20 01:31:30.540224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.474 [2024-11-20 01:31:30.540317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.474 [2024-11-20 01:31:30.540358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.474 qpair failed and we were unable to recover it. 00:30:22.474 [2024-11-20 01:31:30.540485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.474 [2024-11-20 01:31:30.540613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.474 [2024-11-20 01:31:30.540638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.474 qpair failed and we were unable to recover it. 00:30:22.474 [2024-11-20 01:31:30.540729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.474 [2024-11-20 01:31:30.540841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.474 [2024-11-20 01:31:30.540867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.474 qpair failed and we were unable to recover it. 00:30:22.474 [2024-11-20 01:31:30.540946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.474 [2024-11-20 01:31:30.541026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.474 [2024-11-20 01:31:30.541050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.474 qpair failed and we were unable to recover it. 00:30:22.474 [2024-11-20 01:31:30.541175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.474 [2024-11-20 01:31:30.541284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.474 [2024-11-20 01:31:30.541308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.474 qpair failed and we were unable to recover it. 00:30:22.474 [2024-11-20 01:31:30.541427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.474 [2024-11-20 01:31:30.541506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.474 [2024-11-20 01:31:30.541530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.474 qpair failed and we were unable to recover it. 00:30:22.474 [2024-11-20 01:31:30.541624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.474 [2024-11-20 01:31:30.541737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.474 [2024-11-20 01:31:30.541761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.474 qpair failed and we were unable to recover it. 00:30:22.474 [2024-11-20 01:31:30.541869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.474 [2024-11-20 01:31:30.542004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.474 [2024-11-20 01:31:30.542030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.474 qpair failed and we were unable to recover it. 00:30:22.474 [2024-11-20 01:31:30.542177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.474 [2024-11-20 01:31:30.542296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.474 [2024-11-20 01:31:30.542321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.474 qpair failed and we were unable to recover it. 00:30:22.474 [2024-11-20 01:31:30.542457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.474 [2024-11-20 01:31:30.542575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.474 [2024-11-20 01:31:30.542602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.474 qpair failed and we were unable to recover it. 00:30:22.474 [2024-11-20 01:31:30.542710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.474 [2024-11-20 01:31:30.542852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.474 [2024-11-20 01:31:30.542878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.474 qpair failed and we were unable to recover it. 00:30:22.474 [2024-11-20 01:31:30.543027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.474 [2024-11-20 01:31:30.543129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.474 [2024-11-20 01:31:30.543155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.474 qpair failed and we were unable to recover it. 00:30:22.474 [2024-11-20 01:31:30.543298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.474 [2024-11-20 01:31:30.543394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.474 [2024-11-20 01:31:30.543439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.474 qpair failed and we were unable to recover it. 00:30:22.474 [2024-11-20 01:31:30.543535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.474 [2024-11-20 01:31:30.543623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.474 [2024-11-20 01:31:30.543648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.474 qpair failed and we were unable to recover it. 00:30:22.474 [2024-11-20 01:31:30.543751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.474 [2024-11-20 01:31:30.543842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.474 [2024-11-20 01:31:30.543866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.474 qpair failed and we were unable to recover it. 00:30:22.474 [2024-11-20 01:31:30.543984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.474 [2024-11-20 01:31:30.544102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.474 [2024-11-20 01:31:30.544127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.474 qpair failed and we were unable to recover it. 00:30:22.474 [2024-11-20 01:31:30.544212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.474 [2024-11-20 01:31:30.544321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.474 [2024-11-20 01:31:30.544345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.474 qpair failed and we were unable to recover it. 00:30:22.474 [2024-11-20 01:31:30.544424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.474 [2024-11-20 01:31:30.544508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.474 [2024-11-20 01:31:30.544532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.474 qpair failed and we were unable to recover it. 00:30:22.474 [2024-11-20 01:31:30.544673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.474 [2024-11-20 01:31:30.544767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.474 [2024-11-20 01:31:30.544794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.474 qpair failed and we were unable to recover it. 00:30:22.474 [2024-11-20 01:31:30.544923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.474 [2024-11-20 01:31:30.545085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.474 [2024-11-20 01:31:30.545125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.474 qpair failed and we were unable to recover it. 00:30:22.474 [2024-11-20 01:31:30.545271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.474 [2024-11-20 01:31:30.545369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.474 [2024-11-20 01:31:30.545393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.474 qpair failed and we were unable to recover it. 00:30:22.474 [2024-11-20 01:31:30.545518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.474 [2024-11-20 01:31:30.545644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.474 [2024-11-20 01:31:30.545671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.474 qpair failed and we were unable to recover it. 00:30:22.474 [2024-11-20 01:31:30.545813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.474 [2024-11-20 01:31:30.545904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.474 [2024-11-20 01:31:30.545930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.474 qpair failed and we were unable to recover it. 00:30:22.474 [2024-11-20 01:31:30.546053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.474 [2024-11-20 01:31:30.546176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.474 [2024-11-20 01:31:30.546202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.474 qpair failed and we were unable to recover it. 00:30:22.474 [2024-11-20 01:31:30.546307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.474 [2024-11-20 01:31:30.546437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.474 [2024-11-20 01:31:30.546478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.474 qpair failed and we were unable to recover it. 00:30:22.474 [2024-11-20 01:31:30.546602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.474 [2024-11-20 01:31:30.546683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.474 [2024-11-20 01:31:30.546724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.474 qpair failed and we were unable to recover it. 00:30:22.475 [2024-11-20 01:31:30.546824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.475 [2024-11-20 01:31:30.546961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.475 [2024-11-20 01:31:30.546988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.475 qpair failed and we were unable to recover it. 00:30:22.475 [2024-11-20 01:31:30.547139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.475 [2024-11-20 01:31:30.547236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.475 [2024-11-20 01:31:30.547261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.475 qpair failed and we were unable to recover it. 00:30:22.475 [2024-11-20 01:31:30.547380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.475 [2024-11-20 01:31:30.547465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.475 [2024-11-20 01:31:30.547489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.475 qpair failed and we were unable to recover it. 00:30:22.475 [2024-11-20 01:31:30.547609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.475 [2024-11-20 01:31:30.547750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.475 [2024-11-20 01:31:30.547775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.475 qpair failed and we were unable to recover it. 00:30:22.475 [2024-11-20 01:31:30.547913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.475 [2024-11-20 01:31:30.548039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.475 [2024-11-20 01:31:30.548067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.475 qpair failed and we were unable to recover it. 00:30:22.475 [2024-11-20 01:31:30.548206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.475 [2024-11-20 01:31:30.548298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.475 [2024-11-20 01:31:30.548325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.475 qpair failed and we were unable to recover it. 00:30:22.475 [2024-11-20 01:31:30.548469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.475 [2024-11-20 01:31:30.548586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.475 [2024-11-20 01:31:30.548611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.475 qpair failed and we were unable to recover it. 00:30:22.475 [2024-11-20 01:31:30.548713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.475 [2024-11-20 01:31:30.548801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.475 [2024-11-20 01:31:30.548826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.475 qpair failed and we were unable to recover it. 00:30:22.475 [2024-11-20 01:31:30.548919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.475 [2024-11-20 01:31:30.549033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.475 [2024-11-20 01:31:30.549058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.475 qpair failed and we were unable to recover it. 00:30:22.475 [2024-11-20 01:31:30.549156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.475 [2024-11-20 01:31:30.549272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.475 [2024-11-20 01:31:30.549299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.475 qpair failed and we were unable to recover it. 00:30:22.475 [2024-11-20 01:31:30.549405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.475 [2024-11-20 01:31:30.549528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.475 [2024-11-20 01:31:30.549555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.475 qpair failed and we were unable to recover it. 00:30:22.475 [2024-11-20 01:31:30.549682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.475 [2024-11-20 01:31:30.549835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.475 [2024-11-20 01:31:30.549862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.475 qpair failed and we were unable to recover it. 00:30:22.475 [2024-11-20 01:31:30.549970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.475 [2024-11-20 01:31:30.550057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.475 [2024-11-20 01:31:30.550088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.475 qpair failed and we were unable to recover it. 00:30:22.475 [2024-11-20 01:31:30.550185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.475 [2024-11-20 01:31:30.550298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.475 [2024-11-20 01:31:30.550322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.475 qpair failed and we were unable to recover it. 00:30:22.475 [2024-11-20 01:31:30.550414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.475 [2024-11-20 01:31:30.550530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.475 [2024-11-20 01:31:30.550553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.475 qpair failed and we were unable to recover it. 00:30:22.475 [2024-11-20 01:31:30.550670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.475 [2024-11-20 01:31:30.550787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.475 [2024-11-20 01:31:30.550811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.475 qpair failed and we were unable to recover it. 00:30:22.475 [2024-11-20 01:31:30.550939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.475 [2024-11-20 01:31:30.551028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.475 [2024-11-20 01:31:30.551056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.475 qpair failed and we were unable to recover it. 00:30:22.475 [2024-11-20 01:31:30.551177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.475 [2024-11-20 01:31:30.551268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.475 [2024-11-20 01:31:30.551292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.475 qpair failed and we were unable to recover it. 00:30:22.475 [2024-11-20 01:31:30.551377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.475 [2024-11-20 01:31:30.551473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.475 [2024-11-20 01:31:30.551498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.475 qpair failed and we were unable to recover it. 00:30:22.475 [2024-11-20 01:31:30.551626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.475 [2024-11-20 01:31:30.551751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.475 [2024-11-20 01:31:30.551779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.475 qpair failed and we were unable to recover it. 00:30:22.475 [2024-11-20 01:31:30.551913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.475 [2024-11-20 01:31:30.552010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.475 [2024-11-20 01:31:30.552039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.475 qpair failed and we were unable to recover it. 00:30:22.475 [2024-11-20 01:31:30.552176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.475 [2024-11-20 01:31:30.552295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.475 [2024-11-20 01:31:30.552321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.475 qpair failed and we were unable to recover it. 00:30:22.475 [2024-11-20 01:31:30.552417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.475 [2024-11-20 01:31:30.552502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.475 [2024-11-20 01:31:30.552545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.475 qpair failed and we were unable to recover it. 00:30:22.475 [2024-11-20 01:31:30.552649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.475 [2024-11-20 01:31:30.552776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.475 [2024-11-20 01:31:30.552804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.475 qpair failed and we were unable to recover it. 00:30:22.475 [2024-11-20 01:31:30.552918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.475 [2024-11-20 01:31:30.553049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.475 [2024-11-20 01:31:30.553086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.475 qpair failed and we were unable to recover it. 00:30:22.475 [2024-11-20 01:31:30.553227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.475 [2024-11-20 01:31:30.553308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.475 [2024-11-20 01:31:30.553332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.475 qpair failed and we were unable to recover it. 00:30:22.475 [2024-11-20 01:31:30.553431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.475 [2024-11-20 01:31:30.553538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.475 [2024-11-20 01:31:30.553567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.475 qpair failed and we were unable to recover it. 00:30:22.475 [2024-11-20 01:31:30.553733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.475 [2024-11-20 01:31:30.553851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.475 [2024-11-20 01:31:30.553875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.475 qpair failed and we were unable to recover it. 00:30:22.475 [2024-11-20 01:31:30.554022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.475 [2024-11-20 01:31:30.554130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.476 [2024-11-20 01:31:30.554158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.476 qpair failed and we were unable to recover it. 00:30:22.476 [2024-11-20 01:31:30.554262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.476 [2024-11-20 01:31:30.554393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.476 [2024-11-20 01:31:30.554420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.476 qpair failed and we were unable to recover it. 00:30:22.476 [2024-11-20 01:31:30.554562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.476 [2024-11-20 01:31:30.554705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.476 [2024-11-20 01:31:30.554729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.476 qpair failed and we were unable to recover it. 00:30:22.476 [2024-11-20 01:31:30.554853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.476 [2024-11-20 01:31:30.555008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.476 [2024-11-20 01:31:30.555035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.476 qpair failed and we were unable to recover it. 00:30:22.476 [2024-11-20 01:31:30.555209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.476 [2024-11-20 01:31:30.555303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.476 [2024-11-20 01:31:30.555329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.476 qpair failed and we were unable to recover it. 00:30:22.476 [2024-11-20 01:31:30.555420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.476 [2024-11-20 01:31:30.555534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.476 [2024-11-20 01:31:30.555558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.476 qpair failed and we were unable to recover it. 00:30:22.476 [2024-11-20 01:31:30.555669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.476 [2024-11-20 01:31:30.555843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.476 [2024-11-20 01:31:30.555867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.476 qpair failed and we were unable to recover it. 00:30:22.476 [2024-11-20 01:31:30.555988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.476 [2024-11-20 01:31:30.556113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.476 [2024-11-20 01:31:30.556139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.476 qpair failed and we were unable to recover it. 00:30:22.476 [2024-11-20 01:31:30.556228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.476 [2024-11-20 01:31:30.556322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.476 [2024-11-20 01:31:30.556346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.476 qpair failed and we were unable to recover it. 00:30:22.476 [2024-11-20 01:31:30.556503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.476 [2024-11-20 01:31:30.556594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.476 [2024-11-20 01:31:30.556622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.476 qpair failed and we were unable to recover it. 00:30:22.476 [2024-11-20 01:31:30.556756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.476 [2024-11-20 01:31:30.556858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.476 [2024-11-20 01:31:30.556890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.476 qpair failed and we were unable to recover it. 00:30:22.476 [2024-11-20 01:31:30.557007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.476 [2024-11-20 01:31:30.557091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.476 [2024-11-20 01:31:30.557116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.476 qpair failed and we were unable to recover it. 00:30:22.476 [2024-11-20 01:31:30.557234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.476 [2024-11-20 01:31:30.557353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.476 [2024-11-20 01:31:30.557378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.476 qpair failed and we were unable to recover it. 00:30:22.476 [2024-11-20 01:31:30.557492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.476 [2024-11-20 01:31:30.557580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.476 [2024-11-20 01:31:30.557604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.476 qpair failed and we were unable to recover it. 00:30:22.476 [2024-11-20 01:31:30.557724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.476 [2024-11-20 01:31:30.557815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.476 [2024-11-20 01:31:30.557839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.476 qpair failed and we were unable to recover it. 00:30:22.476 [2024-11-20 01:31:30.557977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.476 [2024-11-20 01:31:30.558128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.476 [2024-11-20 01:31:30.558153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.476 qpair failed and we were unable to recover it. 00:30:22.476 [2024-11-20 01:31:30.558239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.476 [2024-11-20 01:31:30.558383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.476 [2024-11-20 01:31:30.558407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.476 qpair failed and we were unable to recover it. 00:30:22.476 [2024-11-20 01:31:30.558494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.476 [2024-11-20 01:31:30.558605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.476 [2024-11-20 01:31:30.558628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.476 qpair failed and we were unable to recover it. 00:30:22.476 [2024-11-20 01:31:30.558711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.476 [2024-11-20 01:31:30.558853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.476 [2024-11-20 01:31:30.558879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.476 qpair failed and we were unable to recover it. 00:30:22.476 [2024-11-20 01:31:30.558981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.476 [2024-11-20 01:31:30.559082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.476 [2024-11-20 01:31:30.559109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.476 qpair failed and we were unable to recover it. 00:30:22.476 [2024-11-20 01:31:30.559248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.476 [2024-11-20 01:31:30.559337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.476 [2024-11-20 01:31:30.559365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.476 qpair failed and we were unable to recover it. 00:30:22.476 [2024-11-20 01:31:30.559504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.476 [2024-11-20 01:31:30.559589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.476 [2024-11-20 01:31:30.559615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.476 qpair failed and we were unable to recover it. 00:30:22.476 [2024-11-20 01:31:30.559777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.476 [2024-11-20 01:31:30.559881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.476 [2024-11-20 01:31:30.559908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.476 qpair failed and we were unable to recover it. 00:30:22.476 [2024-11-20 01:31:30.560019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.476 [2024-11-20 01:31:30.560106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.476 [2024-11-20 01:31:30.560132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.476 qpair failed and we were unable to recover it. 00:30:22.476 [2024-11-20 01:31:30.560270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.476 [2024-11-20 01:31:30.560436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.476 [2024-11-20 01:31:30.560460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.476 qpair failed and we were unable to recover it. 00:30:22.476 [2024-11-20 01:31:30.560598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.476 [2024-11-20 01:31:30.560737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.476 [2024-11-20 01:31:30.560761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.476 qpair failed and we were unable to recover it. 00:30:22.476 [2024-11-20 01:31:30.560876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.476 [2024-11-20 01:31:30.560963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.476 [2024-11-20 01:31:30.560990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.476 qpair failed and we were unable to recover it. 00:30:22.476 [2024-11-20 01:31:30.561117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.476 [2024-11-20 01:31:30.561232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.476 [2024-11-20 01:31:30.561257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.476 qpair failed and we were unable to recover it. 00:30:22.476 [2024-11-20 01:31:30.561347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.476 [2024-11-20 01:31:30.561443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.476 [2024-11-20 01:31:30.561469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.477 qpair failed and we were unable to recover it. 00:30:22.477 [2024-11-20 01:31:30.561586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.477 [2024-11-20 01:31:30.561705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.477 [2024-11-20 01:31:30.561729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.477 qpair failed and we were unable to recover it. 00:30:22.477 [2024-11-20 01:31:30.561815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.477 [2024-11-20 01:31:30.561977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.477 [2024-11-20 01:31:30.562009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.477 qpair failed and we were unable to recover it. 00:30:22.477 [2024-11-20 01:31:30.562139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.477 [2024-11-20 01:31:30.562235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.477 [2024-11-20 01:31:30.562262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.477 qpair failed and we were unable to recover it. 00:30:22.477 [2024-11-20 01:31:30.562390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.477 [2024-11-20 01:31:30.562540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.477 [2024-11-20 01:31:30.562564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.477 qpair failed and we were unable to recover it. 00:30:22.477 [2024-11-20 01:31:30.562674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.477 [2024-11-20 01:31:30.562766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.477 [2024-11-20 01:31:30.562810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.477 qpair failed and we were unable to recover it. 00:30:22.477 [2024-11-20 01:31:30.562933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.477 [2024-11-20 01:31:30.563026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.477 [2024-11-20 01:31:30.563051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.477 qpair failed and we were unable to recover it. 00:30:22.477 [2024-11-20 01:31:30.563146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.477 [2024-11-20 01:31:30.563229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.477 [2024-11-20 01:31:30.563252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.477 qpair failed and we were unable to recover it. 00:30:22.477 [2024-11-20 01:31:30.563343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.477 [2024-11-20 01:31:30.563502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.477 [2024-11-20 01:31:30.563526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.477 qpair failed and we were unable to recover it. 00:30:22.477 [2024-11-20 01:31:30.563646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.477 [2024-11-20 01:31:30.563733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.477 [2024-11-20 01:31:30.563758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.477 qpair failed and we were unable to recover it. 00:30:22.477 [2024-11-20 01:31:30.563891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.477 [2024-11-20 01:31:30.563978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.477 [2024-11-20 01:31:30.564004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.477 qpair failed and we were unable to recover it. 00:30:22.477 [2024-11-20 01:31:30.564153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.477 [2024-11-20 01:31:30.564273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.477 [2024-11-20 01:31:30.564297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.477 qpair failed and we were unable to recover it. 00:30:22.477 [2024-11-20 01:31:30.564409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.477 [2024-11-20 01:31:30.564532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.477 [2024-11-20 01:31:30.564558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.477 qpair failed and we were unable to recover it. 00:30:22.477 [2024-11-20 01:31:30.564730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.477 [2024-11-20 01:31:30.564809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.477 [2024-11-20 01:31:30.564833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.477 qpair failed and we were unable to recover it. 00:30:22.477 [2024-11-20 01:31:30.564927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.477 [2024-11-20 01:31:30.565022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.477 [2024-11-20 01:31:30.565046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.477 qpair failed and we were unable to recover it. 00:30:22.477 [2024-11-20 01:31:30.565150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.477 [2024-11-20 01:31:30.565266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.477 [2024-11-20 01:31:30.565290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.477 qpair failed and we were unable to recover it. 00:30:22.477 [2024-11-20 01:31:30.565406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.477 [2024-11-20 01:31:30.565498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.477 [2024-11-20 01:31:30.565523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.477 qpair failed and we were unable to recover it. 00:30:22.477 [2024-11-20 01:31:30.565647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.477 [2024-11-20 01:31:30.565763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.477 [2024-11-20 01:31:30.565788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.477 qpair failed and we were unable to recover it. 00:30:22.477 [2024-11-20 01:31:30.565901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.477 [2024-11-20 01:31:30.566016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.477 [2024-11-20 01:31:30.566041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.477 qpair failed and we were unable to recover it. 00:30:22.477 [2024-11-20 01:31:30.566148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.477 [2024-11-20 01:31:30.566259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.477 [2024-11-20 01:31:30.566283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.477 qpair failed and we were unable to recover it. 00:30:22.477 [2024-11-20 01:31:30.566424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.477 [2024-11-20 01:31:30.566550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.477 [2024-11-20 01:31:30.566589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.477 qpair failed and we were unable to recover it. 00:30:22.477 [2024-11-20 01:31:30.566677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.477 [2024-11-20 01:31:30.566790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.477 [2024-11-20 01:31:30.566814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.477 qpair failed and we were unable to recover it. 00:30:22.477 [2024-11-20 01:31:30.566905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.477 [2024-11-20 01:31:30.567016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.477 [2024-11-20 01:31:30.567041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.477 qpair failed and we were unable to recover it. 00:30:22.477 [2024-11-20 01:31:30.567161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.477 [2024-11-20 01:31:30.567307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.477 [2024-11-20 01:31:30.567331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.477 qpair failed and we were unable to recover it. 00:30:22.477 [2024-11-20 01:31:30.567444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.477 [2024-11-20 01:31:30.567566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.477 [2024-11-20 01:31:30.567593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.477 qpair failed and we were unable to recover it. 00:30:22.478 [2024-11-20 01:31:30.567764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.478 [2024-11-20 01:31:30.567860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.478 [2024-11-20 01:31:30.567885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.478 qpair failed and we were unable to recover it. 00:30:22.478 [2024-11-20 01:31:30.568028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.478 [2024-11-20 01:31:30.568145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.478 [2024-11-20 01:31:30.568174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.478 qpair failed and we were unable to recover it. 00:30:22.478 [2024-11-20 01:31:30.568280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.478 [2024-11-20 01:31:30.568377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.478 [2024-11-20 01:31:30.568404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.478 qpair failed and we were unable to recover it. 00:30:22.478 [2024-11-20 01:31:30.568514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.478 [2024-11-20 01:31:30.568638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.478 [2024-11-20 01:31:30.568662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.478 qpair failed and we were unable to recover it. 00:30:22.478 [2024-11-20 01:31:30.568839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.478 [2024-11-20 01:31:30.568936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.478 [2024-11-20 01:31:30.568977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.478 qpair failed and we were unable to recover it. 00:30:22.478 [2024-11-20 01:31:30.569119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.478 [2024-11-20 01:31:30.569211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.478 [2024-11-20 01:31:30.569236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.478 qpair failed and we were unable to recover it. 00:30:22.478 [2024-11-20 01:31:30.569345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.478 [2024-11-20 01:31:30.569458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.478 [2024-11-20 01:31:30.569484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.478 qpair failed and we were unable to recover it. 00:30:22.478 [2024-11-20 01:31:30.569601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.478 [2024-11-20 01:31:30.569723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.478 [2024-11-20 01:31:30.569751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.478 qpair failed and we were unable to recover it. 00:30:22.478 [2024-11-20 01:31:30.569856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.478 [2024-11-20 01:31:30.569989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.478 [2024-11-20 01:31:30.570017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.478 qpair failed and we were unable to recover it. 00:30:22.478 [2024-11-20 01:31:30.570132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.478 [2024-11-20 01:31:30.570227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.478 [2024-11-20 01:31:30.570252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.478 qpair failed and we were unable to recover it. 00:30:22.478 [2024-11-20 01:31:30.570371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.478 [2024-11-20 01:31:30.570514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.478 [2024-11-20 01:31:30.570541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.478 qpair failed and we were unable to recover it. 00:30:22.478 [2024-11-20 01:31:30.570642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.478 [2024-11-20 01:31:30.570800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.478 [2024-11-20 01:31:30.570824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.478 qpair failed and we were unable to recover it. 00:30:22.478 [2024-11-20 01:31:30.570911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.478 [2024-11-20 01:31:30.570992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.478 [2024-11-20 01:31:30.571017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.478 qpair failed and we were unable to recover it. 00:30:22.478 [2024-11-20 01:31:30.571112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.478 [2024-11-20 01:31:30.571204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.478 [2024-11-20 01:31:30.571229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.478 qpair failed and we were unable to recover it. 00:30:22.478 [2024-11-20 01:31:30.571307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.478 [2024-11-20 01:31:30.571400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.478 [2024-11-20 01:31:30.571425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.478 qpair failed and we were unable to recover it. 00:30:22.478 [2024-11-20 01:31:30.571583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.478 [2024-11-20 01:31:30.571669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.478 [2024-11-20 01:31:30.571694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.478 qpair failed and we were unable to recover it. 00:30:22.478 [2024-11-20 01:31:30.571804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.478 [2024-11-20 01:31:30.571928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.478 [2024-11-20 01:31:30.571957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.478 qpair failed and we were unable to recover it. 00:30:22.478 [2024-11-20 01:31:30.572100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.478 [2024-11-20 01:31:30.572245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.478 [2024-11-20 01:31:30.572270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.478 qpair failed and we were unable to recover it. 00:30:22.478 [2024-11-20 01:31:30.572385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.478 [2024-11-20 01:31:30.572470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.478 [2024-11-20 01:31:30.572495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.478 qpair failed and we were unable to recover it. 00:30:22.478 [2024-11-20 01:31:30.572578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.478 [2024-11-20 01:31:30.572662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.478 [2024-11-20 01:31:30.572686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.478 qpair failed and we were unable to recover it. 00:30:22.478 [2024-11-20 01:31:30.572770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.478 [2024-11-20 01:31:30.572906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.478 [2024-11-20 01:31:30.572930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.478 qpair failed and we were unable to recover it. 00:30:22.478 [2024-11-20 01:31:30.573048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.478 [2024-11-20 01:31:30.573140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.478 [2024-11-20 01:31:30.573166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.478 qpair failed and we were unable to recover it. 00:30:22.478 [2024-11-20 01:31:30.573336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.478 [2024-11-20 01:31:30.573461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.478 [2024-11-20 01:31:30.573488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.478 qpair failed and we were unable to recover it. 00:30:22.478 [2024-11-20 01:31:30.573617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.478 [2024-11-20 01:31:30.573720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.478 [2024-11-20 01:31:30.573748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.478 qpair failed and we were unable to recover it. 00:30:22.478 [2024-11-20 01:31:30.573861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.478 [2024-11-20 01:31:30.573987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.478 [2024-11-20 01:31:30.574011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.478 qpair failed and we were unable to recover it. 00:30:22.478 [2024-11-20 01:31:30.574147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.478 [2024-11-20 01:31:30.574269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.478 [2024-11-20 01:31:30.574296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.478 qpair failed and we were unable to recover it. 00:30:22.478 [2024-11-20 01:31:30.574428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.478 [2024-11-20 01:31:30.574518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.478 [2024-11-20 01:31:30.574545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.478 qpair failed and we were unable to recover it. 00:30:22.478 [2024-11-20 01:31:30.574709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.478 [2024-11-20 01:31:30.574823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.478 [2024-11-20 01:31:30.574848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.478 qpair failed and we were unable to recover it. 00:30:22.478 [2024-11-20 01:31:30.574967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.479 [2024-11-20 01:31:30.575100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.479 [2024-11-20 01:31:30.575129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.479 qpair failed and we were unable to recover it. 00:30:22.479 [2024-11-20 01:31:30.575271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.479 [2024-11-20 01:31:30.575386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.479 [2024-11-20 01:31:30.575411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.479 qpair failed and we were unable to recover it. 00:30:22.479 [2024-11-20 01:31:30.575529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.479 [2024-11-20 01:31:30.575637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.479 [2024-11-20 01:31:30.575662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.479 qpair failed and we were unable to recover it. 00:30:22.479 [2024-11-20 01:31:30.575815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.479 [2024-11-20 01:31:30.575904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.479 [2024-11-20 01:31:30.575929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.479 qpair failed and we were unable to recover it. 00:30:22.479 [2024-11-20 01:31:30.576048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.479 [2024-11-20 01:31:30.576146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.479 [2024-11-20 01:31:30.576189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.479 qpair failed and we were unable to recover it. 00:30:22.479 [2024-11-20 01:31:30.576337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.479 [2024-11-20 01:31:30.576450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.479 [2024-11-20 01:31:30.576474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.479 qpair failed and we were unable to recover it. 00:30:22.479 [2024-11-20 01:31:30.576607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.479 [2024-11-20 01:31:30.576731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.479 [2024-11-20 01:31:30.576773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.479 qpair failed and we were unable to recover it. 00:30:22.479 [2024-11-20 01:31:30.576897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.479 [2024-11-20 01:31:30.576987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.479 [2024-11-20 01:31:30.577026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.479 qpair failed and we were unable to recover it. 00:30:22.479 [2024-11-20 01:31:30.577173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.479 [2024-11-20 01:31:30.577253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.479 [2024-11-20 01:31:30.577278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.479 qpair failed and we were unable to recover it. 00:30:22.479 [2024-11-20 01:31:30.577396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.479 [2024-11-20 01:31:30.577481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.479 [2024-11-20 01:31:30.577522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.479 qpair failed and we were unable to recover it. 00:30:22.479 [2024-11-20 01:31:30.577662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.479 [2024-11-20 01:31:30.577782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.479 [2024-11-20 01:31:30.577810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.479 qpair failed and we were unable to recover it. 00:30:22.479 [2024-11-20 01:31:30.577954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.479 [2024-11-20 01:31:30.578080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.479 [2024-11-20 01:31:30.578105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.479 qpair failed and we were unable to recover it. 00:30:22.479 [2024-11-20 01:31:30.578248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.479 [2024-11-20 01:31:30.578375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.479 [2024-11-20 01:31:30.578403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.479 qpair failed and we were unable to recover it. 00:30:22.479 [2024-11-20 01:31:30.578500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.479 [2024-11-20 01:31:30.578641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.479 [2024-11-20 01:31:30.578665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.479 qpair failed and we were unable to recover it. 00:30:22.479 [2024-11-20 01:31:30.578778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.479 [2024-11-20 01:31:30.578892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.479 [2024-11-20 01:31:30.578917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.479 qpair failed and we were unable to recover it. 00:30:22.479 [2024-11-20 01:31:30.579013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.479 [2024-11-20 01:31:30.579142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.479 [2024-11-20 01:31:30.579171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.479 qpair failed and we were unable to recover it. 00:30:22.479 [2024-11-20 01:31:30.579302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.479 [2024-11-20 01:31:30.579427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.479 [2024-11-20 01:31:30.579455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.479 qpair failed and we were unable to recover it. 00:30:22.479 [2024-11-20 01:31:30.579564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.479 [2024-11-20 01:31:30.579685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.479 [2024-11-20 01:31:30.579709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.479 qpair failed and we were unable to recover it. 00:30:22.479 [2024-11-20 01:31:30.579846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.479 [2024-11-20 01:31:30.579971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.479 [2024-11-20 01:31:30.579997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.479 qpair failed and we were unable to recover it. 00:30:22.479 [2024-11-20 01:31:30.580105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.479 [2024-11-20 01:31:30.580199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.479 [2024-11-20 01:31:30.580244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.479 qpair failed and we were unable to recover it. 00:30:22.479 [2024-11-20 01:31:30.580364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.479 [2024-11-20 01:31:30.580494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.479 [2024-11-20 01:31:30.580518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.479 qpair failed and we were unable to recover it. 00:30:22.479 [2024-11-20 01:31:30.580658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.479 [2024-11-20 01:31:30.580810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.479 [2024-11-20 01:31:30.580838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.479 qpair failed and we were unable to recover it. 00:30:22.479 [2024-11-20 01:31:30.580983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.479 [2024-11-20 01:31:30.581079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.479 [2024-11-20 01:31:30.581104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.479 qpair failed and we were unable to recover it. 00:30:22.479 [2024-11-20 01:31:30.581200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.479 [2024-11-20 01:31:30.581315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.479 [2024-11-20 01:31:30.581339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.479 qpair failed and we were unable to recover it. 00:30:22.479 [2024-11-20 01:31:30.581448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.479 [2024-11-20 01:31:30.581540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.479 [2024-11-20 01:31:30.581583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.479 qpair failed and we were unable to recover it. 00:30:22.479 [2024-11-20 01:31:30.581679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.479 [2024-11-20 01:31:30.581799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.479 [2024-11-20 01:31:30.581841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.479 qpair failed and we were unable to recover it. 00:30:22.479 [2024-11-20 01:31:30.581978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.479 [2024-11-20 01:31:30.582078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.479 [2024-11-20 01:31:30.582104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.479 qpair failed and we were unable to recover it. 00:30:22.479 [2024-11-20 01:31:30.582228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.479 [2024-11-20 01:31:30.582339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.479 [2024-11-20 01:31:30.582367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.479 qpair failed and we were unable to recover it. 00:30:22.479 [2024-11-20 01:31:30.582491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.479 [2024-11-20 01:31:30.582615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.480 [2024-11-20 01:31:30.582643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.480 qpair failed and we were unable to recover it. 00:30:22.480 [2024-11-20 01:31:30.582777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.480 [2024-11-20 01:31:30.582863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.480 [2024-11-20 01:31:30.582888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.480 qpair failed and we were unable to recover it. 00:30:22.480 [2024-11-20 01:31:30.582979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.480 [2024-11-20 01:31:30.583094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.480 [2024-11-20 01:31:30.583120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.480 qpair failed and we were unable to recover it. 00:30:22.480 [2024-11-20 01:31:30.583266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.480 [2024-11-20 01:31:30.583365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.480 [2024-11-20 01:31:30.583393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.480 qpair failed and we were unable to recover it. 00:30:22.480 [2024-11-20 01:31:30.583533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.480 [2024-11-20 01:31:30.583623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.480 [2024-11-20 01:31:30.583647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.480 qpair failed and we were unable to recover it. 00:30:22.480 [2024-11-20 01:31:30.583736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.480 [2024-11-20 01:31:30.583871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.480 [2024-11-20 01:31:30.583898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.480 qpair failed and we were unable to recover it. 00:30:22.480 [2024-11-20 01:31:30.584026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.480 [2024-11-20 01:31:30.584191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.480 [2024-11-20 01:31:30.584217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.480 qpair failed and we were unable to recover it. 00:30:22.480 [2024-11-20 01:31:30.584306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.480 [2024-11-20 01:31:30.584457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.480 [2024-11-20 01:31:30.584482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.480 qpair failed and we were unable to recover it. 00:30:22.480 [2024-11-20 01:31:30.584592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.480 [2024-11-20 01:31:30.584722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.480 [2024-11-20 01:31:30.584750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.480 qpair failed and we were unable to recover it. 00:30:22.480 [2024-11-20 01:31:30.584858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.480 [2024-11-20 01:31:30.584956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.480 [2024-11-20 01:31:30.584982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.480 qpair failed and we were unable to recover it. 00:30:22.480 [2024-11-20 01:31:30.585090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.480 [2024-11-20 01:31:30.585212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.480 [2024-11-20 01:31:30.585237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.480 qpair failed and we were unable to recover it. 00:30:22.480 [2024-11-20 01:31:30.585351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.480 [2024-11-20 01:31:30.585462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.480 [2024-11-20 01:31:30.585505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.480 qpair failed and we were unable to recover it. 00:30:22.480 [2024-11-20 01:31:30.585644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.480 [2024-11-20 01:31:30.585740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.480 [2024-11-20 01:31:30.585766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.480 qpair failed and we were unable to recover it. 00:30:22.480 [2024-11-20 01:31:30.585865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.480 [2024-11-20 01:31:30.585979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.480 [2024-11-20 01:31:30.586005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.480 qpair failed and we were unable to recover it. 00:30:22.480 [2024-11-20 01:31:30.586150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.480 [2024-11-20 01:31:30.586280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.480 [2024-11-20 01:31:30.586307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.480 qpair failed and we were unable to recover it. 00:30:22.480 [2024-11-20 01:31:30.586405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.480 [2024-11-20 01:31:30.586506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.480 [2024-11-20 01:31:30.586533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.480 qpair failed and we were unable to recover it. 00:30:22.480 [2024-11-20 01:31:30.586675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.480 [2024-11-20 01:31:30.586786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.480 [2024-11-20 01:31:30.586811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.480 qpair failed and we were unable to recover it. 00:30:22.480 [2024-11-20 01:31:30.586897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.480 [2024-11-20 01:31:30.587013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.480 [2024-11-20 01:31:30.587037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.480 qpair failed and we were unable to recover it. 00:30:22.480 [2024-11-20 01:31:30.587176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.480 [2024-11-20 01:31:30.587326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.480 [2024-11-20 01:31:30.587352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.480 qpair failed and we were unable to recover it. 00:30:22.480 [2024-11-20 01:31:30.587472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.480 [2024-11-20 01:31:30.587590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.480 [2024-11-20 01:31:30.587614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.480 qpair failed and we were unable to recover it. 00:30:22.480 [2024-11-20 01:31:30.587732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.480 [2024-11-20 01:31:30.587867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.480 [2024-11-20 01:31:30.587894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.480 qpair failed and we were unable to recover it. 00:30:22.480 [2024-11-20 01:31:30.588014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.480 [2024-11-20 01:31:30.588115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.480 [2024-11-20 01:31:30.588142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.480 qpair failed and we were unable to recover it. 00:30:22.480 [2024-11-20 01:31:30.588278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.480 [2024-11-20 01:31:30.588378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.480 [2024-11-20 01:31:30.588402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.480 qpair failed and we were unable to recover it. 00:30:22.480 [2024-11-20 01:31:30.588526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.480 [2024-11-20 01:31:30.588649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.480 [2024-11-20 01:31:30.588676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.480 qpair failed and we were unable to recover it. 00:30:22.480 [2024-11-20 01:31:30.588836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.480 [2024-11-20 01:31:30.588948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.480 [2024-11-20 01:31:30.588974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.480 qpair failed and we were unable to recover it. 00:30:22.480 [2024-11-20 01:31:30.589094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.480 [2024-11-20 01:31:30.589201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.480 [2024-11-20 01:31:30.589226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.480 qpair failed and we were unable to recover it. 00:30:22.480 [2024-11-20 01:31:30.589312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.480 [2024-11-20 01:31:30.589423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.480 [2024-11-20 01:31:30.589448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.480 qpair failed and we were unable to recover it. 00:30:22.480 [2024-11-20 01:31:30.589556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.480 [2024-11-20 01:31:30.589675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.480 [2024-11-20 01:31:30.589700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.480 qpair failed and we were unable to recover it. 00:30:22.480 [2024-11-20 01:31:30.589819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.480 [2024-11-20 01:31:30.589935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.481 [2024-11-20 01:31:30.589962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.481 qpair failed and we were unable to recover it. 00:30:22.481 [2024-11-20 01:31:30.590120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.481 [2024-11-20 01:31:30.590242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.481 [2024-11-20 01:31:30.590268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.481 qpair failed and we were unable to recover it. 00:30:22.481 [2024-11-20 01:31:30.590362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.481 [2024-11-20 01:31:30.590469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.481 [2024-11-20 01:31:30.590512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.481 qpair failed and we were unable to recover it. 00:30:22.481 [2024-11-20 01:31:30.590602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.481 [2024-11-20 01:31:30.590692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.481 [2024-11-20 01:31:30.590718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.481 qpair failed and we were unable to recover it. 00:30:22.481 [2024-11-20 01:31:30.590811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.481 [2024-11-20 01:31:30.590898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.481 [2024-11-20 01:31:30.590922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.481 qpair failed and we were unable to recover it. 00:30:22.481 [2024-11-20 01:31:30.591062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.481 [2024-11-20 01:31:30.591154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.481 [2024-11-20 01:31:30.591178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.481 qpair failed and we were unable to recover it. 00:30:22.481 [2024-11-20 01:31:30.591288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.481 [2024-11-20 01:31:30.591386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.481 [2024-11-20 01:31:30.591410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.481 qpair failed and we were unable to recover it. 00:30:22.481 [2024-11-20 01:31:30.591494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.481 [2024-11-20 01:31:30.591610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.481 [2024-11-20 01:31:30.591634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.481 qpair failed and we were unable to recover it. 00:30:22.481 [2024-11-20 01:31:30.591766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.481 [2024-11-20 01:31:30.591864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.481 [2024-11-20 01:31:30.591892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.481 qpair failed and we were unable to recover it. 00:30:22.481 [2024-11-20 01:31:30.592033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.481 [2024-11-20 01:31:30.592157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.481 [2024-11-20 01:31:30.592181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.481 qpair failed and we were unable to recover it. 00:30:22.481 [2024-11-20 01:31:30.592295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.481 [2024-11-20 01:31:30.592422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.481 [2024-11-20 01:31:30.592449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.481 qpair failed and we were unable to recover it. 00:30:22.481 [2024-11-20 01:31:30.592607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.481 [2024-11-20 01:31:30.592693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.481 [2024-11-20 01:31:30.592719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.481 qpair failed and we were unable to recover it. 00:30:22.481 [2024-11-20 01:31:30.592831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.481 [2024-11-20 01:31:30.592913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.481 [2024-11-20 01:31:30.592938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.481 qpair failed and we were unable to recover it. 00:30:22.481 [2024-11-20 01:31:30.593101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.481 [2024-11-20 01:31:30.593226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.481 [2024-11-20 01:31:30.593253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.481 qpair failed and we were unable to recover it. 00:30:22.481 [2024-11-20 01:31:30.593382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.481 [2024-11-20 01:31:30.593489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.481 [2024-11-20 01:31:30.593532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.481 qpair failed and we were unable to recover it. 00:30:22.481 [2024-11-20 01:31:30.593656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.481 [2024-11-20 01:31:30.593768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.481 [2024-11-20 01:31:30.593791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.481 qpair failed and we were unable to recover it. 00:30:22.481 [2024-11-20 01:31:30.593928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.481 [2024-11-20 01:31:30.594119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.481 [2024-11-20 01:31:30.594145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.481 qpair failed and we were unable to recover it. 00:30:22.481 [2024-11-20 01:31:30.594256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.481 [2024-11-20 01:31:30.594380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.481 [2024-11-20 01:31:30.594405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.481 qpair failed and we were unable to recover it. 00:30:22.481 [2024-11-20 01:31:30.594515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.481 [2024-11-20 01:31:30.594608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.481 [2024-11-20 01:31:30.594634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.481 qpair failed and we were unable to recover it. 00:30:22.481 [2024-11-20 01:31:30.594798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.481 [2024-11-20 01:31:30.594919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.481 [2024-11-20 01:31:30.594946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.481 qpair failed and we were unable to recover it. 00:30:22.481 [2024-11-20 01:31:30.595090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.481 [2024-11-20 01:31:30.595207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.481 [2024-11-20 01:31:30.595231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.481 qpair failed and we were unable to recover it. 00:30:22.481 [2024-11-20 01:31:30.595326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.481 [2024-11-20 01:31:30.595440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.481 [2024-11-20 01:31:30.595464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.481 qpair failed and we were unable to recover it. 00:30:22.481 [2024-11-20 01:31:30.595552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.481 [2024-11-20 01:31:30.595693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.481 [2024-11-20 01:31:30.595721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.481 qpair failed and we were unable to recover it. 00:30:22.481 [2024-11-20 01:31:30.595811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.481 [2024-11-20 01:31:30.595911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.481 [2024-11-20 01:31:30.595939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.481 qpair failed and we were unable to recover it. 00:30:22.481 [2024-11-20 01:31:30.596048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.481 [2024-11-20 01:31:30.596193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.481 [2024-11-20 01:31:30.596224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.481 qpair failed and we were unable to recover it. 00:30:22.481 [2024-11-20 01:31:30.596338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.481 [2024-11-20 01:31:30.596488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.481 [2024-11-20 01:31:30.596514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.481 qpair failed and we were unable to recover it. 00:30:22.481 [2024-11-20 01:31:30.596650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.481 [2024-11-20 01:31:30.596794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.481 [2024-11-20 01:31:30.596819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.481 qpair failed and we were unable to recover it. 00:30:22.481 [2024-11-20 01:31:30.596905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.481 [2024-11-20 01:31:30.597005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.481 [2024-11-20 01:31:30.597029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.481 qpair failed and we were unable to recover it. 00:30:22.481 [2024-11-20 01:31:30.597157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.481 [2024-11-20 01:31:30.597250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.481 [2024-11-20 01:31:30.597274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.481 qpair failed and we were unable to recover it. 00:30:22.481 [2024-11-20 01:31:30.597391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.481 [2024-11-20 01:31:30.597483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.481 [2024-11-20 01:31:30.597507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.481 qpair failed and we were unable to recover it. 00:30:22.481 [2024-11-20 01:31:30.597623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.482 [2024-11-20 01:31:30.597742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.482 [2024-11-20 01:31:30.597768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.482 qpair failed and we were unable to recover it. 00:30:22.482 [2024-11-20 01:31:30.597877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.482 [2024-11-20 01:31:30.598002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.482 [2024-11-20 01:31:30.598031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.482 qpair failed and we were unable to recover it. 00:30:22.482 [2024-11-20 01:31:30.598185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.482 [2024-11-20 01:31:30.598305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.482 [2024-11-20 01:31:30.598329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.482 qpair failed and we were unable to recover it. 00:30:22.482 [2024-11-20 01:31:30.598477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.482 [2024-11-20 01:31:30.598586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.482 [2024-11-20 01:31:30.598611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.482 qpair failed and we were unable to recover it. 00:30:22.482 [2024-11-20 01:31:30.598763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.482 [2024-11-20 01:31:30.598876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.482 [2024-11-20 01:31:30.598906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.482 qpair failed and we were unable to recover it. 00:30:22.482 [2024-11-20 01:31:30.599034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.482 [2024-11-20 01:31:30.599195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.482 [2024-11-20 01:31:30.599222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.482 qpair failed and we were unable to recover it. 00:30:22.482 [2024-11-20 01:31:30.599345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.482 [2024-11-20 01:31:30.599426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.482 [2024-11-20 01:31:30.599450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.482 qpair failed and we were unable to recover it. 00:30:22.482 [2024-11-20 01:31:30.599569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.482 [2024-11-20 01:31:30.599660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.482 [2024-11-20 01:31:30.599684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.482 qpair failed and we were unable to recover it. 00:30:22.482 [2024-11-20 01:31:30.599769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.482 [2024-11-20 01:31:30.599921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.482 [2024-11-20 01:31:30.599953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.482 qpair failed and we were unable to recover it. 00:30:22.482 [2024-11-20 01:31:30.600091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.482 [2024-11-20 01:31:30.600183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.482 [2024-11-20 01:31:30.600208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.482 qpair failed and we were unable to recover it. 00:30:22.482 [2024-11-20 01:31:30.600315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.482 [2024-11-20 01:31:30.600402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.482 [2024-11-20 01:31:30.600430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.482 qpair failed and we were unable to recover it. 00:30:22.482 [2024-11-20 01:31:30.600560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.482 [2024-11-20 01:31:30.600655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.482 [2024-11-20 01:31:30.600682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.482 qpair failed and we were unable to recover it. 00:30:22.482 [2024-11-20 01:31:30.600796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.482 [2024-11-20 01:31:30.600876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.482 [2024-11-20 01:31:30.600900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.482 qpair failed and we were unable to recover it. 00:30:22.482 [2024-11-20 01:31:30.601014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.482 [2024-11-20 01:31:30.601131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.482 [2024-11-20 01:31:30.601159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.482 qpair failed and we were unable to recover it. 00:30:22.482 [2024-11-20 01:31:30.601288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.482 [2024-11-20 01:31:30.601417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.482 [2024-11-20 01:31:30.601449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.482 qpair failed and we were unable to recover it. 00:30:22.482 [2024-11-20 01:31:30.601593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.482 [2024-11-20 01:31:30.601691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.482 [2024-11-20 01:31:30.601715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.482 qpair failed and we were unable to recover it. 00:30:22.482 [2024-11-20 01:31:30.601880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.482 [2024-11-20 01:31:30.602010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.482 [2024-11-20 01:31:30.602037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.482 qpair failed and we were unable to recover it. 00:30:22.482 [2024-11-20 01:31:30.602175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.482 [2024-11-20 01:31:30.602269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.482 [2024-11-20 01:31:30.602298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.482 qpair failed and we were unable to recover it. 00:30:22.482 [2024-11-20 01:31:30.602438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.482 [2024-11-20 01:31:30.602523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.482 [2024-11-20 01:31:30.602548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.482 qpair failed and we were unable to recover it. 00:30:22.482 [2024-11-20 01:31:30.602639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.482 [2024-11-20 01:31:30.602726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.482 [2024-11-20 01:31:30.602750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.482 qpair failed and we were unable to recover it. 00:30:22.482 [2024-11-20 01:31:30.602865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.482 [2024-11-20 01:31:30.603002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.482 [2024-11-20 01:31:30.603028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.482 qpair failed and we were unable to recover it. 00:30:22.482 [2024-11-20 01:31:30.603158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.482 [2024-11-20 01:31:30.603248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.482 [2024-11-20 01:31:30.603272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.482 qpair failed and we were unable to recover it. 00:30:22.482 [2024-11-20 01:31:30.603363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.482 [2024-11-20 01:31:30.603475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.482 [2024-11-20 01:31:30.603500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.482 qpair failed and we were unable to recover it. 00:30:22.482 [2024-11-20 01:31:30.603619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.482 [2024-11-20 01:31:30.603741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.482 [2024-11-20 01:31:30.603766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.482 qpair failed and we were unable to recover it. 00:30:22.482 [2024-11-20 01:31:30.603910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.482 [2024-11-20 01:31:30.604038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.482 [2024-11-20 01:31:30.604092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.482 qpair failed and we were unable to recover it. 00:30:22.482 [2024-11-20 01:31:30.604259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.482 [2024-11-20 01:31:30.604394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.482 [2024-11-20 01:31:30.604422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.482 qpair failed and we were unable to recover it. 00:30:22.482 [2024-11-20 01:31:30.604530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.482 [2024-11-20 01:31:30.604672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.482 [2024-11-20 01:31:30.604698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.483 qpair failed and we were unable to recover it. 00:30:22.483 [2024-11-20 01:31:30.604845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.604939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.604964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.483 qpair failed and we were unable to recover it. 00:30:22.483 [2024-11-20 01:31:30.605082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.605178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.605206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.483 qpair failed and we were unable to recover it. 00:30:22.483 [2024-11-20 01:31:30.605291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.605380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.605407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.483 qpair failed and we were unable to recover it. 00:30:22.483 [2024-11-20 01:31:30.605523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.605617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.605641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.483 qpair failed and we were unable to recover it. 00:30:22.483 [2024-11-20 01:31:30.605758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.605871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.605895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.483 qpair failed and we were unable to recover it. 00:30:22.483 [2024-11-20 01:31:30.606011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.606134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.606160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.483 qpair failed and we were unable to recover it. 00:30:22.483 [2024-11-20 01:31:30.606272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.606363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.606388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.483 qpair failed and we were unable to recover it. 00:30:22.483 [2024-11-20 01:31:30.606484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.606578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.606606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.483 qpair failed and we were unable to recover it. 00:30:22.483 [2024-11-20 01:31:30.606744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.606843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.606871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.483 qpair failed and we were unable to recover it. 00:30:22.483 [2024-11-20 01:31:30.607007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.607130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.607156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.483 qpair failed and we were unable to recover it. 00:30:22.483 [2024-11-20 01:31:30.607243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.607376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.607403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.483 qpair failed and we were unable to recover it. 00:30:22.483 [2024-11-20 01:31:30.607531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.607650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.607677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.483 qpair failed and we were unable to recover it. 00:30:22.483 [2024-11-20 01:31:30.607784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.607891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.607915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.483 qpair failed and we were unable to recover it. 00:30:22.483 [2024-11-20 01:31:30.608009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.608128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.608154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.483 qpair failed and we were unable to recover it. 00:30:22.483 [2024-11-20 01:31:30.608241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.608371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.608400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.483 qpair failed and we were unable to recover it. 00:30:22.483 [2024-11-20 01:31:30.608539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.608628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.608653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.483 qpair failed and we were unable to recover it. 00:30:22.483 [2024-11-20 01:31:30.608793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.608911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.608939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.483 qpair failed and we were unable to recover it. 00:30:22.483 [2024-11-20 01:31:30.609077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.609176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.609200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.483 qpair failed and we were unable to recover it. 00:30:22.483 [2024-11-20 01:31:30.609324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.609405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.609431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.483 qpair failed and we were unable to recover it. 00:30:22.483 [2024-11-20 01:31:30.609533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.609644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.609669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.483 qpair failed and we were unable to recover it. 00:30:22.483 [2024-11-20 01:31:30.609757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.609873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.609901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.483 qpair failed and we were unable to recover it. 00:30:22.483 [2024-11-20 01:31:30.610018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.610157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.610183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.483 qpair failed and we were unable to recover it. 00:30:22.483 [2024-11-20 01:31:30.610265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.610360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.610385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.483 qpair failed and we were unable to recover it. 00:30:22.483 [2024-11-20 01:31:30.610504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.610622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.610664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.483 qpair failed and we were unable to recover it. 00:30:22.483 [2024-11-20 01:31:30.610801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.610897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.610922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.483 qpair failed and we were unable to recover it. 00:30:22.483 [2024-11-20 01:31:30.611062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.611165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.611194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.483 qpair failed and we were unable to recover it. 00:30:22.483 [2024-11-20 01:31:30.611350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.611477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.611504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.483 qpair failed and we were unable to recover it. 00:30:22.483 [2024-11-20 01:31:30.611609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.611695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.611721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.483 qpair failed and we were unable to recover it. 00:30:22.483 [2024-11-20 01:31:30.611818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.611926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.611967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.483 qpair failed and we were unable to recover it. 00:30:22.483 [2024-11-20 01:31:30.612102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.612232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.483 [2024-11-20 01:31:30.612259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.483 qpair failed and we were unable to recover it. 00:30:22.483 [2024-11-20 01:31:30.612377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.612524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.612549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.484 qpair failed and we were unable to recover it. 00:30:22.484 [2024-11-20 01:31:30.612653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.612792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.612819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.484 qpair failed and we were unable to recover it. 00:30:22.484 [2024-11-20 01:31:30.612942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.613104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.613133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.484 qpair failed and we were unable to recover it. 00:30:22.484 [2024-11-20 01:31:30.613271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.613358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.613383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.484 qpair failed and we were unable to recover it. 00:30:22.484 [2024-11-20 01:31:30.613468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.613554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.613578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.484 qpair failed and we were unable to recover it. 00:30:22.484 [2024-11-20 01:31:30.613694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.613811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.613837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.484 qpair failed and we were unable to recover it. 00:30:22.484 [2024-11-20 01:31:30.613926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.614034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.614059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.484 qpair failed and we were unable to recover it. 00:30:22.484 [2024-11-20 01:31:30.614190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.614282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.614326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.484 qpair failed and we were unable to recover it. 00:30:22.484 [2024-11-20 01:31:30.614421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.614508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.614533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.484 qpair failed and we were unable to recover it. 00:30:22.484 [2024-11-20 01:31:30.614662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.614804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.614828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.484 qpair failed and we were unable to recover it. 00:30:22.484 [2024-11-20 01:31:30.614998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.615097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.615139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.484 qpair failed and we were unable to recover it. 00:30:22.484 [2024-11-20 01:31:30.615231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.615323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.615347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.484 qpair failed and we were unable to recover it. 00:30:22.484 [2024-11-20 01:31:30.615480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.615611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.615636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.484 qpair failed and we were unable to recover it. 00:30:22.484 [2024-11-20 01:31:30.615744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.615840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.615867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.484 qpair failed and we were unable to recover it. 00:30:22.484 [2024-11-20 01:31:30.615968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.616085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.616113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.484 qpair failed and we were unable to recover it. 00:30:22.484 [2024-11-20 01:31:30.616228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.616344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.616367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.484 qpair failed and we were unable to recover it. 00:30:22.484 [2024-11-20 01:31:30.616510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.616610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.616653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.484 qpair failed and we were unable to recover it. 00:30:22.484 [2024-11-20 01:31:30.616738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.616854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.616879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.484 qpair failed and we were unable to recover it. 00:30:22.484 [2024-11-20 01:31:30.617047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.617178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.617203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.484 qpair failed and we were unable to recover it. 00:30:22.484 [2024-11-20 01:31:30.617322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.617450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.617478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.484 qpair failed and we were unable to recover it. 00:30:22.484 [2024-11-20 01:31:30.617577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.617708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.617733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.484 qpair failed and we were unable to recover it. 00:30:22.484 [2024-11-20 01:31:30.617817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.617934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.617960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.484 qpair failed and we were unable to recover it. 00:30:22.484 [2024-11-20 01:31:30.618099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.618184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.618212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.484 qpair failed and we were unable to recover it. 00:30:22.484 [2024-11-20 01:31:30.618315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.618435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.618462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.484 qpair failed and we were unable to recover it. 00:30:22.484 [2024-11-20 01:31:30.618567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.618663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.618688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.484 qpair failed and we were unable to recover it. 00:30:22.484 [2024-11-20 01:31:30.618803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.618945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.618969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.484 qpair failed and we were unable to recover it. 00:30:22.484 [2024-11-20 01:31:30.619081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.619181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.619225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.484 qpair failed and we were unable to recover it. 00:30:22.484 [2024-11-20 01:31:30.619314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.619397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.619422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.484 qpair failed and we were unable to recover it. 00:30:22.484 [2024-11-20 01:31:30.619542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.619632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.619658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.484 qpair failed and we were unable to recover it. 00:30:22.484 [2024-11-20 01:31:30.619779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.619888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.619915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.484 qpair failed and we were unable to recover it. 00:30:22.484 [2024-11-20 01:31:30.620047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.620207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.620231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.484 qpair failed and we were unable to recover it. 00:30:22.484 [2024-11-20 01:31:30.620325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.620409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.620434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.484 qpair failed and we were unable to recover it. 00:30:22.484 [2024-11-20 01:31:30.620531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.620663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.484 [2024-11-20 01:31:30.620691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.485 qpair failed and we were unable to recover it. 00:30:22.485 [2024-11-20 01:31:30.620802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.620897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.620922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.485 qpair failed and we were unable to recover it. 00:30:22.485 [2024-11-20 01:31:30.621021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.621131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.621159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.485 qpair failed and we were unable to recover it. 00:30:22.485 [2024-11-20 01:31:30.621261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.621354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.621380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.485 qpair failed and we were unable to recover it. 00:30:22.485 [2024-11-20 01:31:30.621493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.621607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.621632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.485 qpair failed and we were unable to recover it. 00:30:22.485 [2024-11-20 01:31:30.621762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.621857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.621886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.485 qpair failed and we were unable to recover it. 00:30:22.485 [2024-11-20 01:31:30.621992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.622146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.622174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.485 qpair failed and we were unable to recover it. 00:30:22.485 [2024-11-20 01:31:30.622337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.622433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.622459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.485 qpair failed and we were unable to recover it. 00:30:22.485 [2024-11-20 01:31:30.622574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.622664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.622705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.485 qpair failed and we were unable to recover it. 00:30:22.485 [2024-11-20 01:31:30.622829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.622917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.622944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.485 qpair failed and we were unable to recover it. 00:30:22.485 [2024-11-20 01:31:30.623085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.623181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.623206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.485 qpair failed and we were unable to recover it. 00:30:22.485 [2024-11-20 01:31:30.623327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.623438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.623462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.485 qpair failed and we were unable to recover it. 00:30:22.485 [2024-11-20 01:31:30.623553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.623683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.623712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.485 qpair failed and we were unable to recover it. 00:30:22.485 [2024-11-20 01:31:30.623826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.623909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.623933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.485 qpair failed and we were unable to recover it. 00:30:22.485 [2024-11-20 01:31:30.624028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.624139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.624166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.485 qpair failed and we were unable to recover it. 00:30:22.485 [2024-11-20 01:31:30.624285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.624365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.624389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.485 qpair failed and we were unable to recover it. 00:30:22.485 [2024-11-20 01:31:30.624535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.624651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.624676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.485 qpair failed and we were unable to recover it. 00:30:22.485 [2024-11-20 01:31:30.624857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.624936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.624960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.485 qpair failed and we were unable to recover it. 00:30:22.485 [2024-11-20 01:31:30.625077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.625169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.625193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.485 qpair failed and we were unable to recover it. 00:30:22.485 [2024-11-20 01:31:30.625308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.625424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.625448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.485 qpair failed and we were unable to recover it. 00:30:22.485 [2024-11-20 01:31:30.625555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.625696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.625720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.485 qpair failed and we were unable to recover it. 00:30:22.485 [2024-11-20 01:31:30.625816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.625933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.625956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.485 qpair failed and we were unable to recover it. 00:30:22.485 [2024-11-20 01:31:30.626082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.626171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.626195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.485 qpair failed and we were unable to recover it. 00:30:22.485 [2024-11-20 01:31:30.626279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.626395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.626423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.485 qpair failed and we were unable to recover it. 00:30:22.485 [2024-11-20 01:31:30.626548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.626644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.626672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.485 qpair failed and we were unable to recover it. 00:30:22.485 [2024-11-20 01:31:30.626842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.626936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.626960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.485 qpair failed and we were unable to recover it. 00:30:22.485 [2024-11-20 01:31:30.627106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.627203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.627227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.485 qpair failed and we were unable to recover it. 00:30:22.485 [2024-11-20 01:31:30.627363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.627501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.627528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.485 qpair failed and we were unable to recover it. 00:30:22.485 [2024-11-20 01:31:30.627675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.627791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.627816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.485 qpair failed and we were unable to recover it. 00:30:22.485 [2024-11-20 01:31:30.627914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.628066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.628098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.485 qpair failed and we were unable to recover it. 00:30:22.485 [2024-11-20 01:31:30.628186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.628269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.628292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.485 qpair failed and we were unable to recover it. 00:30:22.485 [2024-11-20 01:31:30.628383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.628496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.628522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.485 qpair failed and we were unable to recover it. 00:30:22.485 [2024-11-20 01:31:30.628607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.628745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.628770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.485 qpair failed and we were unable to recover it. 00:30:22.485 [2024-11-20 01:31:30.628852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.485 [2024-11-20 01:31:30.628955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.486 [2024-11-20 01:31:30.628983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.486 qpair failed and we were unable to recover it. 00:30:22.486 [2024-11-20 01:31:30.629091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.486 [2024-11-20 01:31:30.629177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.486 [2024-11-20 01:31:30.629201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.486 qpair failed and we were unable to recover it. 00:30:22.486 [2024-11-20 01:31:30.629297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.486 [2024-11-20 01:31:30.629412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.486 [2024-11-20 01:31:30.629436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.486 qpair failed and we were unable to recover it. 00:30:22.486 [2024-11-20 01:31:30.629530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.486 [2024-11-20 01:31:30.629678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.486 [2024-11-20 01:31:30.629704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.486 qpair failed and we were unable to recover it. 00:30:22.486 [2024-11-20 01:31:30.629811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.486 [2024-11-20 01:31:30.629902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.486 [2024-11-20 01:31:30.629926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.486 qpair failed and we were unable to recover it. 00:30:22.486 [2024-11-20 01:31:30.630044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.486 [2024-11-20 01:31:30.630164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.486 [2024-11-20 01:31:30.630192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.486 qpair failed and we were unable to recover it. 00:30:22.486 [2024-11-20 01:31:30.630291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.486 [2024-11-20 01:31:30.630389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.486 [2024-11-20 01:31:30.630416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.486 qpair failed and we were unable to recover it. 00:30:22.486 [2024-11-20 01:31:30.630573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.486 [2024-11-20 01:31:30.630686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.486 [2024-11-20 01:31:30.630710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.486 qpair failed and we were unable to recover it. 00:30:22.769 [2024-11-20 01:31:30.630823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.769 [2024-11-20 01:31:30.630927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.769 [2024-11-20 01:31:30.630956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.769 qpair failed and we were unable to recover it. 00:30:22.769 [2024-11-20 01:31:30.631100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.769 [2024-11-20 01:31:30.631234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.769 [2024-11-20 01:31:30.631258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.769 qpair failed and we were unable to recover it. 00:30:22.769 [2024-11-20 01:31:30.631374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.769 [2024-11-20 01:31:30.631471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.769 [2024-11-20 01:31:30.631496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.769 qpair failed and we were unable to recover it. 00:30:22.769 [2024-11-20 01:31:30.631615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.769 [2024-11-20 01:31:30.631745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.769 [2024-11-20 01:31:30.631774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.769 qpair failed and we were unable to recover it. 00:30:22.769 [2024-11-20 01:31:30.631874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.769 [2024-11-20 01:31:30.631996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.769 [2024-11-20 01:31:30.632024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.769 qpair failed and we were unable to recover it. 00:30:22.769 [2024-11-20 01:31:30.632184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.769 [2024-11-20 01:31:30.632302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.769 [2024-11-20 01:31:30.632327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.769 qpair failed and we were unable to recover it. 00:30:22.769 [2024-11-20 01:31:30.632436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.769 [2024-11-20 01:31:30.632533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.769 [2024-11-20 01:31:30.632559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.769 qpair failed and we were unable to recover it. 00:30:22.769 [2024-11-20 01:31:30.632655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.769 [2024-11-20 01:31:30.632770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.769 [2024-11-20 01:31:30.632796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.770 qpair failed and we were unable to recover it. 00:30:22.770 [2024-11-20 01:31:30.632883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-20 01:31:30.633000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-20 01:31:30.633024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.770 qpair failed and we were unable to recover it. 00:30:22.770 [2024-11-20 01:31:30.633177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-20 01:31:30.633262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-20 01:31:30.633288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.770 qpair failed and we were unable to recover it. 00:30:22.770 [2024-11-20 01:31:30.633449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-20 01:31:30.633553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-20 01:31:30.633582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.770 qpair failed and we were unable to recover it. 00:30:22.770 [2024-11-20 01:31:30.633683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-20 01:31:30.633819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-20 01:31:30.633843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.770 qpair failed and we were unable to recover it. 00:30:22.770 [2024-11-20 01:31:30.633929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-20 01:31:30.634044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-20 01:31:30.634076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.770 qpair failed and we were unable to recover it. 00:30:22.770 [2024-11-20 01:31:30.634174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-20 01:31:30.634291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-20 01:31:30.634317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.770 qpair failed and we were unable to recover it. 00:30:22.770 [2024-11-20 01:31:30.634407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-20 01:31:30.634498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-20 01:31:30.634523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.770 qpair failed and we were unable to recover it. 00:30:22.770 [2024-11-20 01:31:30.634615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-20 01:31:30.634736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-20 01:31:30.634762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.770 qpair failed and we were unable to recover it. 00:30:22.770 [2024-11-20 01:31:30.634845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-20 01:31:30.634970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-20 01:31:30.634998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.770 qpair failed and we were unable to recover it. 00:30:22.770 [2024-11-20 01:31:30.635139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-20 01:31:30.635217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-20 01:31:30.635242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.770 qpair failed and we were unable to recover it. 00:30:22.770 [2024-11-20 01:31:30.635361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-20 01:31:30.635474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-20 01:31:30.635501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.770 qpair failed and we were unable to recover it. 00:30:22.770 [2024-11-20 01:31:30.635659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-20 01:31:30.635754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-20 01:31:30.635782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.770 qpair failed and we were unable to recover it. 00:30:22.770 [2024-11-20 01:31:30.635942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-20 01:31:30.636092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-20 01:31:30.636135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.770 qpair failed and we were unable to recover it. 00:30:22.770 [2024-11-20 01:31:30.636223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-20 01:31:30.636330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-20 01:31:30.636371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.770 qpair failed and we were unable to recover it. 00:30:22.770 [2024-11-20 01:31:30.636499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-20 01:31:30.636636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-20 01:31:30.636663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.770 qpair failed and we were unable to recover it. 00:30:22.770 [2024-11-20 01:31:30.636768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-20 01:31:30.636884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-20 01:31:30.636909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.770 qpair failed and we were unable to recover it. 00:30:22.770 [2024-11-20 01:31:30.637040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-20 01:31:30.637162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-20 01:31:30.637190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.770 qpair failed and we were unable to recover it. 00:30:22.770 [2024-11-20 01:31:30.637325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-20 01:31:30.637450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-20 01:31:30.637482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.770 qpair failed and we were unable to recover it. 00:30:22.770 [2024-11-20 01:31:30.637620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-20 01:31:30.637733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-20 01:31:30.637758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.770 qpair failed and we were unable to recover it. 00:30:22.770 [2024-11-20 01:31:30.637847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-20 01:31:30.637933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-20 01:31:30.637957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.770 qpair failed and we were unable to recover it. 00:30:22.770 [2024-11-20 01:31:30.638097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-20 01:31:30.638206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-20 01:31:30.638236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.770 qpair failed and we were unable to recover it. 00:30:22.770 [2024-11-20 01:31:30.638355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-20 01:31:30.638471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-20 01:31:30.638495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.770 qpair failed and we were unable to recover it. 00:30:22.770 [2024-11-20 01:31:30.638629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-20 01:31:30.638768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-20 01:31:30.638793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.770 qpair failed and we were unable to recover it. 00:30:22.770 [2024-11-20 01:31:30.638884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-20 01:31:30.638997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-20 01:31:30.639040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.770 qpair failed and we were unable to recover it. 00:30:22.770 [2024-11-20 01:31:30.639166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-20 01:31:30.639283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-20 01:31:30.639307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.770 qpair failed and we were unable to recover it. 00:30:22.770 [2024-11-20 01:31:30.639448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-20 01:31:30.639568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-20 01:31:30.639596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.770 qpair failed and we were unable to recover it. 00:30:22.770 [2024-11-20 01:31:30.639750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-20 01:31:30.639873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-20 01:31:30.639900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.770 qpair failed and we were unable to recover it. 00:30:22.770 [2024-11-20 01:31:30.640015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-20 01:31:30.640131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-20 01:31:30.640160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.770 qpair failed and we were unable to recover it. 00:30:22.771 [2024-11-20 01:31:30.640273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-20 01:31:30.640368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-20 01:31:30.640410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.771 qpair failed and we were unable to recover it. 00:30:22.771 [2024-11-20 01:31:30.640559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-20 01:31:30.640690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-20 01:31:30.640717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.771 qpair failed and we were unable to recover it. 00:30:22.771 [2024-11-20 01:31:30.640831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-20 01:31:30.640907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-20 01:31:30.640932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.771 qpair failed and we were unable to recover it. 00:30:22.771 [2024-11-20 01:31:30.641027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-20 01:31:30.641143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-20 01:31:30.641168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.771 qpair failed and we were unable to recover it. 00:30:22.771 [2024-11-20 01:31:30.641261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-20 01:31:30.641396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-20 01:31:30.641421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.771 qpair failed and we were unable to recover it. 00:30:22.771 [2024-11-20 01:31:30.641511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-20 01:31:30.641595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-20 01:31:30.641618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.771 qpair failed and we were unable to recover it. 00:30:22.771 [2024-11-20 01:31:30.641735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-20 01:31:30.641878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-20 01:31:30.641902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.771 qpair failed and we were unable to recover it. 00:30:22.771 [2024-11-20 01:31:30.642008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-20 01:31:30.642104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-20 01:31:30.642147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.771 qpair failed and we were unable to recover it. 00:30:22.771 [2024-11-20 01:31:30.642268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-20 01:31:30.642353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-20 01:31:30.642377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.771 qpair failed and we were unable to recover it. 00:30:22.771 [2024-11-20 01:31:30.642480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-20 01:31:30.642618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-20 01:31:30.642646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.771 qpair failed and we were unable to recover it. 00:30:22.771 [2024-11-20 01:31:30.642806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-20 01:31:30.642893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-20 01:31:30.642920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.771 qpair failed and we were unable to recover it. 00:30:22.771 [2024-11-20 01:31:30.643057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-20 01:31:30.643179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-20 01:31:30.643204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.771 qpair failed and we were unable to recover it. 00:30:22.771 [2024-11-20 01:31:30.643298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-20 01:31:30.643461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-20 01:31:30.643488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.771 qpair failed and we were unable to recover it. 00:30:22.771 [2024-11-20 01:31:30.643646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-20 01:31:30.643805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-20 01:31:30.643830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.771 qpair failed and we were unable to recover it. 00:30:22.771 [2024-11-20 01:31:30.643942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-20 01:31:30.644057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-20 01:31:30.644110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.771 qpair failed and we were unable to recover it. 00:30:22.771 [2024-11-20 01:31:30.644222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-20 01:31:30.644370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-20 01:31:30.644395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.771 qpair failed and we were unable to recover it. 00:30:22.771 [2024-11-20 01:31:30.644512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-20 01:31:30.644658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-20 01:31:30.644684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.771 qpair failed and we were unable to recover it. 00:30:22.771 [2024-11-20 01:31:30.644843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-20 01:31:30.644930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-20 01:31:30.644956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.771 qpair failed and we were unable to recover it. 00:30:22.771 [2024-11-20 01:31:30.645107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-20 01:31:30.645223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-20 01:31:30.645247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.771 qpair failed and we were unable to recover it. 00:30:22.771 [2024-11-20 01:31:30.645340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-20 01:31:30.645449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-20 01:31:30.645481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.771 qpair failed and we were unable to recover it. 00:30:22.771 [2024-11-20 01:31:30.645595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-20 01:31:30.645701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-20 01:31:30.645725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.771 qpair failed and we were unable to recover it. 00:30:22.771 [2024-11-20 01:31:30.645892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-20 01:31:30.646056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-20 01:31:30.646086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.771 qpair failed and we were unable to recover it. 00:30:22.771 [2024-11-20 01:31:30.646175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-20 01:31:30.646290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-20 01:31:30.646314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.771 qpair failed and we were unable to recover it. 00:30:22.771 [2024-11-20 01:31:30.646408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-20 01:31:30.646549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-20 01:31:30.646573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.771 qpair failed and we were unable to recover it. 00:30:22.771 [2024-11-20 01:31:30.646717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-20 01:31:30.646871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-20 01:31:30.646899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.771 qpair failed and we were unable to recover it. 00:30:22.771 [2024-11-20 01:31:30.646999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-20 01:31:30.647120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-20 01:31:30.647148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.771 qpair failed and we were unable to recover it. 00:30:22.771 [2024-11-20 01:31:30.647259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-20 01:31:30.647345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-20 01:31:30.647368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.771 qpair failed and we were unable to recover it. 00:30:22.771 [2024-11-20 01:31:30.647499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-20 01:31:30.647600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-20 01:31:30.647627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.771 qpair failed and we were unable to recover it. 00:30:22.771 [2024-11-20 01:31:30.647755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-20 01:31:30.647878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-20 01:31:30.647904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.772 qpair failed and we were unable to recover it. 00:30:22.772 [2024-11-20 01:31:30.648011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-20 01:31:30.648144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-20 01:31:30.648170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.772 qpair failed and we were unable to recover it. 00:30:22.772 [2024-11-20 01:31:30.648296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-20 01:31:30.648434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-20 01:31:30.648475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.772 qpair failed and we were unable to recover it. 00:30:22.772 [2024-11-20 01:31:30.648596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-20 01:31:30.648680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-20 01:31:30.648705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.772 qpair failed and we were unable to recover it. 00:30:22.772 [2024-11-20 01:31:30.648807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-20 01:31:30.648894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-20 01:31:30.648919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.772 qpair failed and we were unable to recover it. 00:30:22.772 [2024-11-20 01:31:30.649006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-20 01:31:30.649115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-20 01:31:30.649140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.772 qpair failed and we were unable to recover it. 00:30:22.772 [2024-11-20 01:31:30.649249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-20 01:31:30.649338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-20 01:31:30.649362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.772 qpair failed and we were unable to recover it. 00:30:22.772 [2024-11-20 01:31:30.649477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-20 01:31:30.649560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-20 01:31:30.649585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.772 qpair failed and we were unable to recover it. 00:30:22.772 [2024-11-20 01:31:30.649702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-20 01:31:30.649821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-20 01:31:30.649848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.772 qpair failed and we were unable to recover it. 00:30:22.772 [2024-11-20 01:31:30.649943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-20 01:31:30.650065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-20 01:31:30.650099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.772 qpair failed and we were unable to recover it. 00:30:22.772 [2024-11-20 01:31:30.650208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-20 01:31:30.650294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-20 01:31:30.650319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.772 qpair failed and we were unable to recover it. 00:30:22.772 [2024-11-20 01:31:30.650466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-20 01:31:30.650619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-20 01:31:30.650646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.772 qpair failed and we were unable to recover it. 00:30:22.772 [2024-11-20 01:31:30.650757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-20 01:31:30.650877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-20 01:31:30.650905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.772 qpair failed and we were unable to recover it. 00:30:22.772 [2024-11-20 01:31:30.651014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-20 01:31:30.651089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-20 01:31:30.651114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.772 qpair failed and we were unable to recover it. 00:30:22.772 [2024-11-20 01:31:30.651209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-20 01:31:30.651303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-20 01:31:30.651326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.772 qpair failed and we were unable to recover it. 00:30:22.772 [2024-11-20 01:31:30.651426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-20 01:31:30.651567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-20 01:31:30.651607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.772 qpair failed and we were unable to recover it. 00:30:22.772 [2024-11-20 01:31:30.651701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-20 01:31:30.651811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-20 01:31:30.651835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.772 qpair failed and we were unable to recover it. 00:30:22.772 [2024-11-20 01:31:30.651930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-20 01:31:30.652031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-20 01:31:30.652060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.772 qpair failed and we were unable to recover it. 00:30:22.772 [2024-11-20 01:31:30.652218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-20 01:31:30.652338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-20 01:31:30.652365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.772 qpair failed and we were unable to recover it. 00:30:22.772 [2024-11-20 01:31:30.652486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-20 01:31:30.652605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-20 01:31:30.652629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.772 qpair failed and we were unable to recover it. 00:30:22.772 [2024-11-20 01:31:30.652794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-20 01:31:30.652943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-20 01:31:30.652970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.772 qpair failed and we were unable to recover it. 00:30:22.772 [2024-11-20 01:31:30.653123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-20 01:31:30.653213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-20 01:31:30.653239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.772 qpair failed and we were unable to recover it. 00:30:22.772 [2024-11-20 01:31:30.653338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-20 01:31:30.653427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-20 01:31:30.653456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.772 qpair failed and we were unable to recover it. 00:30:22.772 [2024-11-20 01:31:30.653544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-20 01:31:30.653660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-20 01:31:30.653684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.772 qpair failed and we were unable to recover it. 00:30:22.772 [2024-11-20 01:31:30.653771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-20 01:31:30.653854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-20 01:31:30.653880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.772 qpair failed and we were unable to recover it. 00:30:22.772 [2024-11-20 01:31:30.653978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-20 01:31:30.654097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-20 01:31:30.654125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.772 qpair failed and we were unable to recover it. 00:30:22.772 [2024-11-20 01:31:30.654222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-20 01:31:30.654309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-20 01:31:30.654333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.772 qpair failed and we were unable to recover it. 00:30:22.772 [2024-11-20 01:31:30.654417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-20 01:31:30.654502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-20 01:31:30.654526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.772 qpair failed and we were unable to recover it. 00:30:22.772 [2024-11-20 01:31:30.654639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-20 01:31:30.654755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-20 01:31:30.654780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.773 qpair failed and we were unable to recover it. 00:30:22.773 [2024-11-20 01:31:30.654894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-20 01:31:30.654982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-20 01:31:30.655006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.773 qpair failed and we were unable to recover it. 00:30:22.773 [2024-11-20 01:31:30.655129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-20 01:31:30.655213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-20 01:31:30.655237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.773 qpair failed and we were unable to recover it. 00:30:22.773 [2024-11-20 01:31:30.655354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-20 01:31:30.655437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-20 01:31:30.655462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.773 qpair failed and we were unable to recover it. 00:30:22.773 [2024-11-20 01:31:30.655554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-20 01:31:30.655643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-20 01:31:30.655669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.773 qpair failed and we were unable to recover it. 00:30:22.773 [2024-11-20 01:31:30.655819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-20 01:31:30.655896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-20 01:31:30.655920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.773 qpair failed and we were unable to recover it. 00:30:22.773 [2024-11-20 01:31:30.656056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-20 01:31:30.656170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-20 01:31:30.656194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.773 qpair failed and we were unable to recover it. 00:30:22.773 [2024-11-20 01:31:30.656279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-20 01:31:30.656391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-20 01:31:30.656415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.773 qpair failed and we were unable to recover it. 00:30:22.773 [2024-11-20 01:31:30.656496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-20 01:31:30.656585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-20 01:31:30.656610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.773 qpair failed and we were unable to recover it. 00:30:22.773 [2024-11-20 01:31:30.656766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-20 01:31:30.656909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-20 01:31:30.656935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.773 qpair failed and we were unable to recover it. 00:30:22.773 [2024-11-20 01:31:30.657082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-20 01:31:30.657211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-20 01:31:30.657238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.773 qpair failed and we were unable to recover it. 00:30:22.773 [2024-11-20 01:31:30.657371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-20 01:31:30.657498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-20 01:31:30.657525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.773 qpair failed and we were unable to recover it. 00:30:22.773 [2024-11-20 01:31:30.657686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-20 01:31:30.657809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-20 01:31:30.657834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.773 qpair failed and we were unable to recover it. 00:30:22.773 [2024-11-20 01:31:30.657917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-20 01:31:30.658010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-20 01:31:30.658052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.773 qpair failed and we were unable to recover it. 00:30:22.773 [2024-11-20 01:31:30.658161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-20 01:31:30.658298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-20 01:31:30.658323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.773 qpair failed and we were unable to recover it. 00:30:22.773 [2024-11-20 01:31:30.658412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-20 01:31:30.658554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-20 01:31:30.658578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.773 qpair failed and we were unable to recover it. 00:30:22.773 [2024-11-20 01:31:30.658682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-20 01:31:30.658844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-20 01:31:30.658869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.773 qpair failed and we were unable to recover it. 00:30:22.773 [2024-11-20 01:31:30.658966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-20 01:31:30.659076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-20 01:31:30.659105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.773 qpair failed and we were unable to recover it. 00:30:22.773 [2024-11-20 01:31:30.659248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-20 01:31:30.659364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-20 01:31:30.659388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.773 qpair failed and we were unable to recover it. 00:30:22.773 [2024-11-20 01:31:30.659521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-20 01:31:30.659607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-20 01:31:30.659633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.773 qpair failed and we were unable to recover it. 00:30:22.773 [2024-11-20 01:31:30.659725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-20 01:31:30.659820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-20 01:31:30.659847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.773 qpair failed and we were unable to recover it. 00:30:22.773 [2024-11-20 01:31:30.659968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-20 01:31:30.660095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-20 01:31:30.660120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.773 qpair failed and we were unable to recover it. 00:30:22.773 [2024-11-20 01:31:30.660236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-20 01:31:30.660327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-20 01:31:30.660352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.773 qpair failed and we were unable to recover it. 00:30:22.773 [2024-11-20 01:31:30.660440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-20 01:31:30.660546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-20 01:31:30.660587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.773 qpair failed and we were unable to recover it. 00:30:22.773 [2024-11-20 01:31:30.660713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-20 01:31:30.660857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-20 01:31:30.660882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.773 qpair failed and we were unable to recover it. 00:30:22.773 [2024-11-20 01:31:30.661026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-20 01:31:30.661160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-20 01:31:30.661189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.773 qpair failed and we were unable to recover it. 00:30:22.773 [2024-11-20 01:31:30.661289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-20 01:31:30.661441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-20 01:31:30.661468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.773 qpair failed and we were unable to recover it. 00:30:22.773 [2024-11-20 01:31:30.661578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-20 01:31:30.661705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-20 01:31:30.661729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.773 qpair failed and we were unable to recover it. 00:30:22.773 [2024-11-20 01:31:30.661811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-20 01:31:30.661926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-20 01:31:30.661951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.773 qpair failed and we were unable to recover it. 00:30:22.773 [2024-11-20 01:31:30.662036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.774 [2024-11-20 01:31:30.662134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.774 [2024-11-20 01:31:30.662161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.774 qpair failed and we were unable to recover it. 00:30:22.774 [2024-11-20 01:31:30.662253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.774 [2024-11-20 01:31:30.662330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.774 [2024-11-20 01:31:30.662355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.774 qpair failed and we were unable to recover it. 00:30:22.774 [2024-11-20 01:31:30.662496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.774 [2024-11-20 01:31:30.662581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.774 [2024-11-20 01:31:30.662606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.774 qpair failed and we were unable to recover it. 00:30:22.774 [2024-11-20 01:31:30.662692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.774 [2024-11-20 01:31:30.662841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.774 [2024-11-20 01:31:30.662864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.774 qpair failed and we were unable to recover it. 00:30:22.774 [2024-11-20 01:31:30.663023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.774 [2024-11-20 01:31:30.663143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.774 [2024-11-20 01:31:30.663169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.774 qpair failed and we were unable to recover it. 00:30:22.774 [2024-11-20 01:31:30.663265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.774 [2024-11-20 01:31:30.663378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.774 [2024-11-20 01:31:30.663402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.774 qpair failed and we were unable to recover it. 00:30:22.774 [2024-11-20 01:31:30.663521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.774 [2024-11-20 01:31:30.663604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.774 [2024-11-20 01:31:30.663628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.774 qpair failed and we were unable to recover it. 00:30:22.774 [2024-11-20 01:31:30.663768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.774 [2024-11-20 01:31:30.663860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.774 [2024-11-20 01:31:30.663884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.774 qpair failed and we were unable to recover it. 00:30:22.774 [2024-11-20 01:31:30.663978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.774 [2024-11-20 01:31:30.664105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.774 [2024-11-20 01:31:30.664130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.774 qpair failed and we were unable to recover it. 00:30:22.774 [2024-11-20 01:31:30.664211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.774 [2024-11-20 01:31:30.664326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.774 [2024-11-20 01:31:30.664353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.774 qpair failed and we were unable to recover it. 00:30:22.774 [2024-11-20 01:31:30.664491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.774 [2024-11-20 01:31:30.664604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.774 [2024-11-20 01:31:30.664629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.774 qpair failed and we were unable to recover it. 00:30:22.774 [2024-11-20 01:31:30.664758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.774 [2024-11-20 01:31:30.664858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.774 [2024-11-20 01:31:30.664901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.774 qpair failed and we were unable to recover it. 00:30:22.774 [2024-11-20 01:31:30.665024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.774 [2024-11-20 01:31:30.665149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.774 [2024-11-20 01:31:30.665177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.774 qpair failed and we were unable to recover it. 00:30:22.774 [2024-11-20 01:31:30.665312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.774 [2024-11-20 01:31:30.665427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.774 [2024-11-20 01:31:30.665453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.774 qpair failed and we were unable to recover it. 00:30:22.774 [2024-11-20 01:31:30.665560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.774 [2024-11-20 01:31:30.665681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.774 [2024-11-20 01:31:30.665708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.774 qpair failed and we were unable to recover it. 00:30:22.774 [2024-11-20 01:31:30.665814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.774 [2024-11-20 01:31:30.665914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.774 [2024-11-20 01:31:30.665941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.774 qpair failed and we were unable to recover it. 00:30:22.774 [2024-11-20 01:31:30.666058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.774 [2024-11-20 01:31:30.666187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.774 [2024-11-20 01:31:30.666211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.774 qpair failed and we were unable to recover it. 00:30:22.774 [2024-11-20 01:31:30.666302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.774 [2024-11-20 01:31:30.666410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.774 [2024-11-20 01:31:30.666451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.774 qpair failed and we were unable to recover it. 00:30:22.774 [2024-11-20 01:31:30.666612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.774 [2024-11-20 01:31:30.666712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.774 [2024-11-20 01:31:30.666739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.774 qpair failed and we were unable to recover it. 00:30:22.774 [2024-11-20 01:31:30.666850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.774 [2024-11-20 01:31:30.666963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.774 [2024-11-20 01:31:30.666987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.774 qpair failed and we were unable to recover it. 00:30:22.774 [2024-11-20 01:31:30.667099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.774 [2024-11-20 01:31:30.667211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.774 [2024-11-20 01:31:30.667257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.774 qpair failed and we were unable to recover it. 00:30:22.774 [2024-11-20 01:31:30.667407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.774 [2024-11-20 01:31:30.667515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.774 [2024-11-20 01:31:30.667542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.774 qpair failed and we were unable to recover it. 00:30:22.774 [2024-11-20 01:31:30.667650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.774 [2024-11-20 01:31:30.667764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.774 [2024-11-20 01:31:30.667789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.774 qpair failed and we were unable to recover it. 00:30:22.774 [2024-11-20 01:31:30.667924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.774 [2024-11-20 01:31:30.668053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.774 [2024-11-20 01:31:30.668111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.774 qpair failed and we were unable to recover it. 00:30:22.774 [2024-11-20 01:31:30.668218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.775 [2024-11-20 01:31:30.668314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.775 [2024-11-20 01:31:30.668341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.775 qpair failed and we were unable to recover it. 00:30:22.775 [2024-11-20 01:31:30.668481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.775 [2024-11-20 01:31:30.668581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.775 [2024-11-20 01:31:30.668606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.775 qpair failed and we were unable to recover it. 00:30:22.775 [2024-11-20 01:31:30.668700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.775 [2024-11-20 01:31:30.668810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.775 [2024-11-20 01:31:30.668836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.775 qpair failed and we were unable to recover it. 00:30:22.775 [2024-11-20 01:31:30.668980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.775 [2024-11-20 01:31:30.669081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.775 [2024-11-20 01:31:30.669124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.775 qpair failed and we were unable to recover it. 00:30:22.775 [2024-11-20 01:31:30.669209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.775 [2024-11-20 01:31:30.669324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.775 [2024-11-20 01:31:30.669349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.775 qpair failed and we were unable to recover it. 00:30:22.775 [2024-11-20 01:31:30.669440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.775 [2024-11-20 01:31:30.669523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.775 [2024-11-20 01:31:30.669548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.775 qpair failed and we were unable to recover it. 00:30:22.775 [2024-11-20 01:31:30.669635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.775 [2024-11-20 01:31:30.669790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.775 [2024-11-20 01:31:30.669815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.775 qpair failed and we were unable to recover it. 00:30:22.775 [2024-11-20 01:31:30.669945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.775 [2024-11-20 01:31:30.670077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.775 [2024-11-20 01:31:30.670121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.775 qpair failed and we were unable to recover it. 00:30:22.775 [2024-11-20 01:31:30.670212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.775 [2024-11-20 01:31:30.670365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.775 [2024-11-20 01:31:30.670392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.775 qpair failed and we were unable to recover it. 00:30:22.775 [2024-11-20 01:31:30.670491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.775 [2024-11-20 01:31:30.670652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.775 [2024-11-20 01:31:30.670677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.775 qpair failed and we were unable to recover it. 00:30:22.775 [2024-11-20 01:31:30.670805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.775 [2024-11-20 01:31:30.670924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.775 [2024-11-20 01:31:30.670948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.775 qpair failed and we were unable to recover it. 00:30:22.775 [2024-11-20 01:31:30.671084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.775 [2024-11-20 01:31:30.671212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.775 [2024-11-20 01:31:30.671239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.775 qpair failed and we were unable to recover it. 00:30:22.775 [2024-11-20 01:31:30.671341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.775 [2024-11-20 01:31:30.671463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.775 [2024-11-20 01:31:30.671489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.775 qpair failed and we were unable to recover it. 00:30:22.775 [2024-11-20 01:31:30.671601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.775 [2024-11-20 01:31:30.671694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.775 [2024-11-20 01:31:30.671718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.775 qpair failed and we were unable to recover it. 00:30:22.775 [2024-11-20 01:31:30.671836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.775 [2024-11-20 01:31:30.671949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.775 [2024-11-20 01:31:30.671990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.775 qpair failed and we were unable to recover it. 00:30:22.775 [2024-11-20 01:31:30.672136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.775 [2024-11-20 01:31:30.672270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.775 [2024-11-20 01:31:30.672298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.775 qpair failed and we were unable to recover it. 00:30:22.775 [2024-11-20 01:31:30.672395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.775 [2024-11-20 01:31:30.672507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.775 [2024-11-20 01:31:30.672532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.775 qpair failed and we were unable to recover it. 00:30:22.775 [2024-11-20 01:31:30.672618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.775 [2024-11-20 01:31:30.672763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.775 [2024-11-20 01:31:30.672789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.775 qpair failed and we were unable to recover it. 00:30:22.775 [2024-11-20 01:31:30.672886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.775 [2024-11-20 01:31:30.672980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.775 [2024-11-20 01:31:30.673023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.775 qpair failed and we were unable to recover it. 00:30:22.775 [2024-11-20 01:31:30.673153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.775 [2024-11-20 01:31:30.673247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.775 [2024-11-20 01:31:30.673272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.775 qpair failed and we were unable to recover it. 00:30:22.775 [2024-11-20 01:31:30.673390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.775 [2024-11-20 01:31:30.673493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.775 [2024-11-20 01:31:30.673535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.775 qpair failed and we were unable to recover it. 00:30:22.775 [2024-11-20 01:31:30.673633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.775 [2024-11-20 01:31:30.673749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.775 [2024-11-20 01:31:30.673790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.775 qpair failed and we were unable to recover it. 00:30:22.775 [2024-11-20 01:31:30.673910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.775 [2024-11-20 01:31:30.673995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.775 [2024-11-20 01:31:30.674019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.775 qpair failed and we were unable to recover it. 00:30:22.775 [2024-11-20 01:31:30.674111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.775 [2024-11-20 01:31:30.674191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.775 [2024-11-20 01:31:30.674216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.775 qpair failed and we were unable to recover it. 00:30:22.775 [2024-11-20 01:31:30.674306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.775 [2024-11-20 01:31:30.674417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.775 [2024-11-20 01:31:30.674442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.775 qpair failed and we were unable to recover it. 00:30:22.775 [2024-11-20 01:31:30.674531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.775 [2024-11-20 01:31:30.674646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.775 [2024-11-20 01:31:30.674670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.775 qpair failed and we were unable to recover it. 00:30:22.775 [2024-11-20 01:31:30.674788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.775 [2024-11-20 01:31:30.674885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.775 [2024-11-20 01:31:30.674913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.775 qpair failed and we were unable to recover it. 00:30:22.775 [2024-11-20 01:31:30.675040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.775 [2024-11-20 01:31:30.675175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.775 [2024-11-20 01:31:30.675203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.775 qpair failed and we were unable to recover it. 00:30:22.775 [2024-11-20 01:31:30.675318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.775 [2024-11-20 01:31:30.675403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.776 [2024-11-20 01:31:30.675428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.776 qpair failed and we were unable to recover it. 00:30:22.776 [2024-11-20 01:31:30.675517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.776 [2024-11-20 01:31:30.675626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.776 [2024-11-20 01:31:30.675650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.776 qpair failed and we were unable to recover it. 00:30:22.776 [2024-11-20 01:31:30.675752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.776 [2024-11-20 01:31:30.675855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.776 [2024-11-20 01:31:30.675882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.776 qpair failed and we were unable to recover it. 00:30:22.776 [2024-11-20 01:31:30.675997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.776 [2024-11-20 01:31:30.676151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.776 [2024-11-20 01:31:30.676180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.776 qpair failed and we were unable to recover it. 00:30:22.776 [2024-11-20 01:31:30.676274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.776 [2024-11-20 01:31:30.676403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.776 [2024-11-20 01:31:30.676430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.776 qpair failed and we were unable to recover it. 00:30:22.776 [2024-11-20 01:31:30.676575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.776 [2024-11-20 01:31:30.676658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.776 [2024-11-20 01:31:30.676682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.776 qpair failed and we were unable to recover it. 00:30:22.776 [2024-11-20 01:31:30.676774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.776 [2024-11-20 01:31:30.676868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.776 [2024-11-20 01:31:30.676893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.776 qpair failed and we were unable to recover it. 00:30:22.776 [2024-11-20 01:31:30.677042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.776 [2024-11-20 01:31:30.677151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.776 [2024-11-20 01:31:30.677193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.776 qpair failed and we were unable to recover it. 00:30:22.776 [2024-11-20 01:31:30.677282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.776 [2024-11-20 01:31:30.677365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.776 [2024-11-20 01:31:30.677389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.776 qpair failed and we were unable to recover it. 00:30:22.776 [2024-11-20 01:31:30.677499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.776 [2024-11-20 01:31:30.677586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.776 [2024-11-20 01:31:30.677617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.776 qpair failed and we were unable to recover it. 00:30:22.776 [2024-11-20 01:31:30.677706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.776 [2024-11-20 01:31:30.677817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.776 [2024-11-20 01:31:30.677841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.776 qpair failed and we were unable to recover it. 00:30:22.776 [2024-11-20 01:31:30.677931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.776 [2024-11-20 01:31:30.678022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.776 [2024-11-20 01:31:30.678065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.776 qpair failed and we were unable to recover it. 00:30:22.776 [2024-11-20 01:31:30.678245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.776 [2024-11-20 01:31:30.678360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.776 [2024-11-20 01:31:30.678386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.776 qpair failed and we were unable to recover it. 00:30:22.776 [2024-11-20 01:31:30.678504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.776 [2024-11-20 01:31:30.678615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.776 [2024-11-20 01:31:30.678644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.776 qpair failed and we were unable to recover it. 00:30:22.776 [2024-11-20 01:31:30.678765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.776 [2024-11-20 01:31:30.678876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.776 [2024-11-20 01:31:30.678901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.776 qpair failed and we were unable to recover it. 00:30:22.776 [2024-11-20 01:31:30.679013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.776 [2024-11-20 01:31:30.679115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.776 [2024-11-20 01:31:30.679140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.776 qpair failed and we were unable to recover it. 00:30:22.776 [2024-11-20 01:31:30.679302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.776 [2024-11-20 01:31:30.679454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.776 [2024-11-20 01:31:30.679493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.776 qpair failed and we were unable to recover it. 00:30:22.776 [2024-11-20 01:31:30.679583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.776 [2024-11-20 01:31:30.679665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.776 [2024-11-20 01:31:30.679690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.776 qpair failed and we were unable to recover it. 00:30:22.776 [2024-11-20 01:31:30.679807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.776 [2024-11-20 01:31:30.679919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.776 [2024-11-20 01:31:30.679944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.776 qpair failed and we were unable to recover it. 00:30:22.776 [2024-11-20 01:31:30.680124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.776 [2024-11-20 01:31:30.680217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.776 [2024-11-20 01:31:30.680241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.776 qpair failed and we were unable to recover it. 00:30:22.776 [2024-11-20 01:31:30.680335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.776 [2024-11-20 01:31:30.680478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.776 [2024-11-20 01:31:30.680503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.776 qpair failed and we were unable to recover it. 00:30:22.776 [2024-11-20 01:31:30.680581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.776 [2024-11-20 01:31:30.680665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.776 [2024-11-20 01:31:30.680690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.776 qpair failed and we were unable to recover it. 00:30:22.776 [2024-11-20 01:31:30.680812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.776 [2024-11-20 01:31:30.680897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.776 [2024-11-20 01:31:30.680922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.776 qpair failed and we were unable to recover it. 00:30:22.776 [2024-11-20 01:31:30.681079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.776 [2024-11-20 01:31:30.681174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.776 [2024-11-20 01:31:30.681223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.776 qpair failed and we were unable to recover it. 00:30:22.776 [2024-11-20 01:31:30.681366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.776 [2024-11-20 01:31:30.681484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.776 [2024-11-20 01:31:30.681509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.776 qpair failed and we were unable to recover it. 00:30:22.776 [2024-11-20 01:31:30.681625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.776 [2024-11-20 01:31:30.681713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.776 [2024-11-20 01:31:30.681740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.776 qpair failed and we were unable to recover it. 00:30:22.776 [2024-11-20 01:31:30.681847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.776 [2024-11-20 01:31:30.681996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.776 [2024-11-20 01:31:30.682024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.776 qpair failed and we were unable to recover it. 00:30:22.776 [2024-11-20 01:31:30.682144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.776 [2024-11-20 01:31:30.682242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.776 [2024-11-20 01:31:30.682266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.776 qpair failed and we were unable to recover it. 00:30:22.776 [2024-11-20 01:31:30.682358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.776 [2024-11-20 01:31:30.682515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.776 [2024-11-20 01:31:30.682542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.776 qpair failed and we were unable to recover it. 00:30:22.776 [2024-11-20 01:31:30.682671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.777 [2024-11-20 01:31:30.682762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.777 [2024-11-20 01:31:30.682788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.777 qpair failed and we were unable to recover it. 00:30:22.777 [2024-11-20 01:31:30.682947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.777 [2024-11-20 01:31:30.683030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.777 [2024-11-20 01:31:30.683055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.777 qpair failed and we were unable to recover it. 00:30:22.777 [2024-11-20 01:31:30.683202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.777 [2024-11-20 01:31:30.683302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.777 [2024-11-20 01:31:30.683329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.777 qpair failed and we were unable to recover it. 00:30:22.777 [2024-11-20 01:31:30.683432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.777 [2024-11-20 01:31:30.683563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.777 [2024-11-20 01:31:30.683591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.777 qpair failed and we were unable to recover it. 00:30:22.777 [2024-11-20 01:31:30.683741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.777 [2024-11-20 01:31:30.683829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.777 [2024-11-20 01:31:30.683858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.777 qpair failed and we were unable to recover it. 00:30:22.777 [2024-11-20 01:31:30.683976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.777 [2024-11-20 01:31:30.684092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.777 [2024-11-20 01:31:30.684121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.777 qpair failed and we were unable to recover it. 00:30:22.777 [2024-11-20 01:31:30.684253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.777 [2024-11-20 01:31:30.684370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.777 [2024-11-20 01:31:30.684412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.777 qpair failed and we were unable to recover it. 00:30:22.777 [2024-11-20 01:31:30.684529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.777 [2024-11-20 01:31:30.684617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.777 [2024-11-20 01:31:30.684641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.777 qpair failed and we were unable to recover it. 00:30:22.777 [2024-11-20 01:31:30.684761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.777 [2024-11-20 01:31:30.684923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.777 [2024-11-20 01:31:30.684951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.777 qpair failed and we were unable to recover it. 00:30:22.777 [2024-11-20 01:31:30.685099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.777 [2024-11-20 01:31:30.685213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.777 [2024-11-20 01:31:30.685263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.777 qpair failed and we were unable to recover it. 00:30:22.777 [2024-11-20 01:31:30.685353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.777 [2024-11-20 01:31:30.685434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.777 [2024-11-20 01:31:30.685460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.777 qpair failed and we were unable to recover it. 00:30:22.777 [2024-11-20 01:31:30.685594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.777 [2024-11-20 01:31:30.685767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.777 [2024-11-20 01:31:30.685793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.777 qpair failed and we were unable to recover it. 00:30:22.777 [2024-11-20 01:31:30.685881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.777 [2024-11-20 01:31:30.686000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.777 [2024-11-20 01:31:30.686026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.777 qpair failed and we were unable to recover it. 00:30:22.777 [2024-11-20 01:31:30.686131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.777 [2024-11-20 01:31:30.686250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.777 [2024-11-20 01:31:30.686275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.777 qpair failed and we were unable to recover it. 00:30:22.777 [2024-11-20 01:31:30.686367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.777 [2024-11-20 01:31:30.686457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.777 [2024-11-20 01:31:30.686482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.777 qpair failed and we were unable to recover it. 00:30:22.777 [2024-11-20 01:31:30.686576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.777 [2024-11-20 01:31:30.686707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.777 [2024-11-20 01:31:30.686736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.777 qpair failed and we were unable to recover it. 00:30:22.777 [2024-11-20 01:31:30.686874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.777 [2024-11-20 01:31:30.686963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.777 [2024-11-20 01:31:30.686989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.777 qpair failed and we were unable to recover it. 00:30:22.777 [2024-11-20 01:31:30.687080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.777 [2024-11-20 01:31:30.687197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.777 [2024-11-20 01:31:30.687221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.777 qpair failed and we were unable to recover it. 00:30:22.777 [2024-11-20 01:31:30.687302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.777 [2024-11-20 01:31:30.687412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.777 [2024-11-20 01:31:30.687435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.777 qpair failed and we were unable to recover it. 00:30:22.777 [2024-11-20 01:31:30.687596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.777 [2024-11-20 01:31:30.687739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.777 [2024-11-20 01:31:30.687763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.777 qpair failed and we were unable to recover it. 00:30:22.777 [2024-11-20 01:31:30.687877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.777 [2024-11-20 01:31:30.688016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.777 [2024-11-20 01:31:30.688041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.777 qpair failed and we were unable to recover it. 00:30:22.777 [2024-11-20 01:31:30.688210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.777 [2024-11-20 01:31:30.688342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.777 [2024-11-20 01:31:30.688369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.777 qpair failed and we were unable to recover it. 00:30:22.777 [2024-11-20 01:31:30.688517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.777 [2024-11-20 01:31:30.688633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.777 [2024-11-20 01:31:30.688658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.777 qpair failed and we were unable to recover it. 00:30:22.777 [2024-11-20 01:31:30.688770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.777 [2024-11-20 01:31:30.688899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.777 [2024-11-20 01:31:30.688927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.777 qpair failed and we were unable to recover it. 00:30:22.777 [2024-11-20 01:31:30.689090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.777 [2024-11-20 01:31:30.689203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.777 [2024-11-20 01:31:30.689227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.777 qpair failed and we were unable to recover it. 00:30:22.777 [2024-11-20 01:31:30.689370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.777 [2024-11-20 01:31:30.689457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.777 [2024-11-20 01:31:30.689482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.777 qpair failed and we were unable to recover it. 00:30:22.777 [2024-11-20 01:31:30.689569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.777 [2024-11-20 01:31:30.689704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.777 [2024-11-20 01:31:30.689731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.777 qpair failed and we were unable to recover it. 00:30:22.777 [2024-11-20 01:31:30.689833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.777 [2024-11-20 01:31:30.689940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.777 [2024-11-20 01:31:30.689966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.777 qpair failed and we were unable to recover it. 00:30:22.777 [2024-11-20 01:31:30.690082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.777 [2024-11-20 01:31:30.690199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.778 [2024-11-20 01:31:30.690223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.778 qpair failed and we were unable to recover it. 00:30:22.778 [2024-11-20 01:31:30.690340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.778 [2024-11-20 01:31:30.690434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.778 [2024-11-20 01:31:30.690458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.778 qpair failed and we were unable to recover it. 00:30:22.778 [2024-11-20 01:31:30.690580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.778 [2024-11-20 01:31:30.690729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.778 [2024-11-20 01:31:30.690754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.778 qpair failed and we were unable to recover it. 00:30:22.778 [2024-11-20 01:31:30.690857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.778 [2024-11-20 01:31:30.690960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.778 [2024-11-20 01:31:30.690990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.778 qpair failed and we were unable to recover it. 00:30:22.778 [2024-11-20 01:31:30.691114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.778 [2024-11-20 01:31:30.691195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.778 [2024-11-20 01:31:30.691220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.778 qpair failed and we were unable to recover it. 00:30:22.778 [2024-11-20 01:31:30.691337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.778 [2024-11-20 01:31:30.691421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.778 [2024-11-20 01:31:30.691446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.778 qpair failed and we were unable to recover it. 00:30:22.778 [2024-11-20 01:31:30.691565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.778 [2024-11-20 01:31:30.691684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.778 [2024-11-20 01:31:30.691708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.778 qpair failed and we were unable to recover it. 00:30:22.778 [2024-11-20 01:31:30.691802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.778 [2024-11-20 01:31:30.691967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.778 [2024-11-20 01:31:30.691994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.778 qpair failed and we were unable to recover it. 00:30:22.778 [2024-11-20 01:31:30.692116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.778 [2024-11-20 01:31:30.692242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.778 [2024-11-20 01:31:30.692271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.778 qpair failed and we were unable to recover it. 00:30:22.778 [2024-11-20 01:31:30.692374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.778 [2024-11-20 01:31:30.692469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.778 [2024-11-20 01:31:30.692493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.778 qpair failed and we were unable to recover it. 00:30:22.778 [2024-11-20 01:31:30.692583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.778 [2024-11-20 01:31:30.692670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.778 [2024-11-20 01:31:30.692695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.778 qpair failed and we were unable to recover it. 00:30:22.778 [2024-11-20 01:31:30.692778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.778 [2024-11-20 01:31:30.692911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.778 [2024-11-20 01:31:30.692951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.778 qpair failed and we were unable to recover it. 00:30:22.778 [2024-11-20 01:31:30.693080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.778 [2024-11-20 01:31:30.693202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.778 [2024-11-20 01:31:30.693226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.778 qpair failed and we were unable to recover it. 00:30:22.778 [2024-11-20 01:31:30.693331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.778 [2024-11-20 01:31:30.693452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.778 [2024-11-20 01:31:30.693478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.778 qpair failed and we were unable to recover it. 00:30:22.778 [2024-11-20 01:31:30.693579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.778 [2024-11-20 01:31:30.693717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.778 [2024-11-20 01:31:30.693741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.778 qpair failed and we were unable to recover it. 00:30:22.778 [2024-11-20 01:31:30.693831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.778 [2024-11-20 01:31:30.693946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.778 [2024-11-20 01:31:30.693971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.778 qpair failed and we were unable to recover it. 00:30:22.778 [2024-11-20 01:31:30.694055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.778 [2024-11-20 01:31:30.694151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.778 [2024-11-20 01:31:30.694176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.778 qpair failed and we were unable to recover it. 00:30:22.778 [2024-11-20 01:31:30.694275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.778 [2024-11-20 01:31:30.694367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.778 [2024-11-20 01:31:30.694392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.778 qpair failed and we were unable to recover it. 00:30:22.778 [2024-11-20 01:31:30.694475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.778 [2024-11-20 01:31:30.694615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.778 [2024-11-20 01:31:30.694639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.778 qpair failed and we were unable to recover it. 00:30:22.778 [2024-11-20 01:31:30.694760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.778 [2024-11-20 01:31:30.694876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.778 [2024-11-20 01:31:30.694901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.778 qpair failed and we were unable to recover it. 00:30:22.778 [2024-11-20 01:31:30.695009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.778 [2024-11-20 01:31:30.695138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.778 [2024-11-20 01:31:30.695165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.778 qpair failed and we were unable to recover it. 00:30:22.778 [2024-11-20 01:31:30.695299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.778 [2024-11-20 01:31:30.695384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.778 [2024-11-20 01:31:30.695408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.778 qpair failed and we were unable to recover it. 00:30:22.778 [2024-11-20 01:31:30.695500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.778 [2024-11-20 01:31:30.695614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.778 [2024-11-20 01:31:30.695640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.778 qpair failed and we were unable to recover it. 00:30:22.778 [2024-11-20 01:31:30.695760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.778 [2024-11-20 01:31:30.695843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.778 [2024-11-20 01:31:30.695888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.778 qpair failed and we were unable to recover it. 00:30:22.778 [2024-11-20 01:31:30.696010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.778 [2024-11-20 01:31:30.696127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.778 [2024-11-20 01:31:30.696153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.778 qpair failed and we were unable to recover it. 00:30:22.778 [2024-11-20 01:31:30.696284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.778 [2024-11-20 01:31:30.696390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.778 [2024-11-20 01:31:30.696435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.778 qpair failed and we were unable to recover it. 00:30:22.779 [2024-11-20 01:31:30.696525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.779 [2024-11-20 01:31:30.696640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.779 [2024-11-20 01:31:30.696665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.779 qpair failed and we were unable to recover it. 00:30:22.779 [2024-11-20 01:31:30.696853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.779 [2024-11-20 01:31:30.696972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.779 [2024-11-20 01:31:30.696996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.779 qpair failed and we were unable to recover it. 00:30:22.779 [2024-11-20 01:31:30.697188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.779 [2024-11-20 01:31:30.697268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.779 [2024-11-20 01:31:30.697292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.779 qpair failed and we were unable to recover it. 00:30:22.779 [2024-11-20 01:31:30.697412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.779 [2024-11-20 01:31:30.697501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.779 [2024-11-20 01:31:30.697525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.779 qpair failed and we were unable to recover it. 00:30:22.779 [2024-11-20 01:31:30.697610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.779 [2024-11-20 01:31:30.697707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.779 [2024-11-20 01:31:30.697731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.779 qpair failed and we were unable to recover it. 00:30:22.779 [2024-11-20 01:31:30.697848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.779 [2024-11-20 01:31:30.698012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.779 [2024-11-20 01:31:30.698039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.779 qpair failed and we were unable to recover it. 00:30:22.779 [2024-11-20 01:31:30.698147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.779 [2024-11-20 01:31:30.698236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.779 [2024-11-20 01:31:30.698263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.779 qpair failed and we were unable to recover it. 00:30:22.779 [2024-11-20 01:31:30.698381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.779 [2024-11-20 01:31:30.698481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.779 [2024-11-20 01:31:30.698505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.779 qpair failed and we were unable to recover it. 00:30:22.779 [2024-11-20 01:31:30.698595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.779 [2024-11-20 01:31:30.698679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.779 [2024-11-20 01:31:30.698704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.779 qpair failed and we were unable to recover it. 00:30:22.779 [2024-11-20 01:31:30.698832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.779 [2024-11-20 01:31:30.698918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.779 [2024-11-20 01:31:30.698945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.779 qpair failed and we were unable to recover it. 00:30:22.779 [2024-11-20 01:31:30.699091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.779 [2024-11-20 01:31:30.699212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.779 [2024-11-20 01:31:30.699237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.779 qpair failed and we were unable to recover it. 00:30:22.779 [2024-11-20 01:31:30.699425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.779 [2024-11-20 01:31:30.699541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.779 [2024-11-20 01:31:30.699566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.779 qpair failed and we were unable to recover it. 00:30:22.779 [2024-11-20 01:31:30.699695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.779 [2024-11-20 01:31:30.699796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.779 [2024-11-20 01:31:30.699822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.779 qpair failed and we were unable to recover it. 00:30:22.779 [2024-11-20 01:31:30.699926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.779 [2024-11-20 01:31:30.700041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.779 [2024-11-20 01:31:30.700065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.779 qpair failed and we were unable to recover it. 00:30:22.779 [2024-11-20 01:31:30.700212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.779 [2024-11-20 01:31:30.700311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.779 [2024-11-20 01:31:30.700338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.779 qpair failed and we were unable to recover it. 00:30:22.779 [2024-11-20 01:31:30.700443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.779 [2024-11-20 01:31:30.700568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.779 [2024-11-20 01:31:30.700594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.779 qpair failed and we were unable to recover it. 00:30:22.779 [2024-11-20 01:31:30.700737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.779 [2024-11-20 01:31:30.700850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.779 [2024-11-20 01:31:30.700874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.779 qpair failed and we were unable to recover it. 00:30:22.779 [2024-11-20 01:31:30.701036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.779 [2024-11-20 01:31:30.701141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.779 [2024-11-20 01:31:30.701168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.779 qpair failed and we were unable to recover it. 00:30:22.779 [2024-11-20 01:31:30.701271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.779 [2024-11-20 01:31:30.701378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.779 [2024-11-20 01:31:30.701403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.779 qpair failed and we were unable to recover it. 00:30:22.779 [2024-11-20 01:31:30.701490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.779 [2024-11-20 01:31:30.701585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.779 [2024-11-20 01:31:30.701608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.779 qpair failed and we were unable to recover it. 00:30:22.779 [2024-11-20 01:31:30.701767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.779 [2024-11-20 01:31:30.701900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.779 [2024-11-20 01:31:30.701924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.779 qpair failed and we were unable to recover it. 00:30:22.779 [2024-11-20 01:31:30.702057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.779 [2024-11-20 01:31:30.702174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.779 [2024-11-20 01:31:30.702199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.779 qpair failed and we were unable to recover it. 00:30:22.779 [2024-11-20 01:31:30.702288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.779 [2024-11-20 01:31:30.702378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.779 [2024-11-20 01:31:30.702402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.779 qpair failed and we were unable to recover it. 00:30:22.779 [2024-11-20 01:31:30.702501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.779 [2024-11-20 01:31:30.702581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.779 [2024-11-20 01:31:30.702605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.779 qpair failed and we were unable to recover it. 00:30:22.779 [2024-11-20 01:31:30.702738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.779 [2024-11-20 01:31:30.702836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.779 [2024-11-20 01:31:30.702862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.779 qpair failed and we were unable to recover it. 00:30:22.779 [2024-11-20 01:31:30.702976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.779 [2024-11-20 01:31:30.703086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.779 [2024-11-20 01:31:30.703128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.779 qpair failed and we were unable to recover it. 00:30:22.779 [2024-11-20 01:31:30.703225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.779 [2024-11-20 01:31:30.703316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.779 [2024-11-20 01:31:30.703341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.779 qpair failed and we were unable to recover it. 00:30:22.779 [2024-11-20 01:31:30.703478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.779 [2024-11-20 01:31:30.703600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.779 [2024-11-20 01:31:30.703627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.779 qpair failed and we were unable to recover it. 00:30:22.779 [2024-11-20 01:31:30.703777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.779 [2024-11-20 01:31:30.703920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.780 [2024-11-20 01:31:30.703944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.780 qpair failed and we were unable to recover it. 00:30:22.780 [2024-11-20 01:31:30.704098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.780 [2024-11-20 01:31:30.704260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.780 [2024-11-20 01:31:30.704285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.780 qpair failed and we were unable to recover it. 00:30:22.780 [2024-11-20 01:31:30.704378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.780 [2024-11-20 01:31:30.704468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.780 [2024-11-20 01:31:30.704491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.780 qpair failed and we were unable to recover it. 00:30:22.780 [2024-11-20 01:31:30.704606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.780 [2024-11-20 01:31:30.704719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.780 [2024-11-20 01:31:30.704746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.780 qpair failed and we were unable to recover it. 00:30:22.780 [2024-11-20 01:31:30.704892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.780 [2024-11-20 01:31:30.704985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.780 [2024-11-20 01:31:30.705009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.780 qpair failed and we were unable to recover it. 00:30:22.780 [2024-11-20 01:31:30.705105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.780 [2024-11-20 01:31:30.705268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.780 [2024-11-20 01:31:30.705295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.780 qpair failed and we were unable to recover it. 00:30:22.780 [2024-11-20 01:31:30.705408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.780 [2024-11-20 01:31:30.705489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.780 [2024-11-20 01:31:30.705513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.780 qpair failed and we were unable to recover it. 00:30:22.780 [2024-11-20 01:31:30.705602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.780 [2024-11-20 01:31:30.705714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.780 [2024-11-20 01:31:30.705741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.780 qpair failed and we were unable to recover it. 00:30:22.780 [2024-11-20 01:31:30.705841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.780 [2024-11-20 01:31:30.705973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.780 [2024-11-20 01:31:30.705999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.780 qpair failed and we were unable to recover it. 00:30:22.780 [2024-11-20 01:31:30.706137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.780 [2024-11-20 01:31:30.706224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.780 [2024-11-20 01:31:30.706249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.780 qpair failed and we were unable to recover it. 00:30:22.780 [2024-11-20 01:31:30.706366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.780 [2024-11-20 01:31:30.706460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.780 [2024-11-20 01:31:30.706488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.780 qpair failed and we were unable to recover it. 00:30:22.780 [2024-11-20 01:31:30.706612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.780 [2024-11-20 01:31:30.706702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.780 [2024-11-20 01:31:30.706730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.780 qpair failed and we were unable to recover it. 00:30:22.780 [2024-11-20 01:31:30.706868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.780 [2024-11-20 01:31:30.706982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.780 [2024-11-20 01:31:30.707006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.780 qpair failed and we were unable to recover it. 00:30:22.780 [2024-11-20 01:31:30.707122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.780 [2024-11-20 01:31:30.707253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.780 [2024-11-20 01:31:30.707281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.780 qpair failed and we were unable to recover it. 00:30:22.780 [2024-11-20 01:31:30.707410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.780 [2024-11-20 01:31:30.707572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.780 [2024-11-20 01:31:30.707596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.780 qpair failed and we were unable to recover it. 00:30:22.780 [2024-11-20 01:31:30.707682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.780 [2024-11-20 01:31:30.707797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.780 [2024-11-20 01:31:30.707823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.780 qpair failed and we were unable to recover it. 00:30:22.780 [2024-11-20 01:31:30.707976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.780 [2024-11-20 01:31:30.708123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.780 [2024-11-20 01:31:30.708149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.780 qpair failed and we were unable to recover it. 00:30:22.780 [2024-11-20 01:31:30.708281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.780 [2024-11-20 01:31:30.708404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.780 [2024-11-20 01:31:30.708431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.780 qpair failed and we were unable to recover it. 00:30:22.780 [2024-11-20 01:31:30.708597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.780 [2024-11-20 01:31:30.708675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.780 [2024-11-20 01:31:30.708700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.780 qpair failed and we were unable to recover it. 00:30:22.780 [2024-11-20 01:31:30.708835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.780 [2024-11-20 01:31:30.708931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.780 [2024-11-20 01:31:30.708961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.780 qpair failed and we were unable to recover it. 00:30:22.780 [2024-11-20 01:31:30.709064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.780 [2024-11-20 01:31:30.709195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.780 [2024-11-20 01:31:30.709223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.780 qpair failed and we were unable to recover it. 00:30:22.780 [2024-11-20 01:31:30.709358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.780 [2024-11-20 01:31:30.709476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.780 [2024-11-20 01:31:30.709502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.780 qpair failed and we were unable to recover it. 00:30:22.780 [2024-11-20 01:31:30.709636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.780 [2024-11-20 01:31:30.709801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.780 [2024-11-20 01:31:30.709826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.780 qpair failed and we were unable to recover it. 00:30:22.780 [2024-11-20 01:31:30.709941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.780 [2024-11-20 01:31:30.710051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.780 [2024-11-20 01:31:30.710086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.780 qpair failed and we were unable to recover it. 00:30:22.780 [2024-11-20 01:31:30.710200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.780 [2024-11-20 01:31:30.710292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.780 [2024-11-20 01:31:30.710319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.780 qpair failed and we were unable to recover it. 00:30:22.780 [2024-11-20 01:31:30.710415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.780 [2024-11-20 01:31:30.710506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.780 [2024-11-20 01:31:30.710530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.780 qpair failed and we were unable to recover it. 00:30:22.780 [2024-11-20 01:31:30.710610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.780 [2024-11-20 01:31:30.710728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.780 [2024-11-20 01:31:30.710753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.780 qpair failed and we were unable to recover it. 00:30:22.780 [2024-11-20 01:31:30.710855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.780 [2024-11-20 01:31:30.710979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.780 [2024-11-20 01:31:30.711006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.780 qpair failed and we were unable to recover it. 00:30:22.780 [2024-11-20 01:31:30.711150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.780 [2024-11-20 01:31:30.711247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.780 [2024-11-20 01:31:30.711272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.780 qpair failed and we were unable to recover it. 00:30:22.781 [2024-11-20 01:31:30.711360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.781 [2024-11-20 01:31:30.711452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.781 [2024-11-20 01:31:30.711477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.781 qpair failed and we were unable to recover it. 00:30:22.781 [2024-11-20 01:31:30.711567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.781 [2024-11-20 01:31:30.711684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.781 [2024-11-20 01:31:30.711708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.781 qpair failed and we were unable to recover it. 00:30:22.781 [2024-11-20 01:31:30.711841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.781 [2024-11-20 01:31:30.711961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.781 [2024-11-20 01:31:30.711988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.781 qpair failed and we were unable to recover it. 00:30:22.781 [2024-11-20 01:31:30.712102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.781 [2024-11-20 01:31:30.712202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.781 [2024-11-20 01:31:30.712229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.781 qpair failed and we were unable to recover it. 00:30:22.781 [2024-11-20 01:31:30.712337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.781 [2024-11-20 01:31:30.712449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.781 [2024-11-20 01:31:30.712474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.781 qpair failed and we were unable to recover it. 00:30:22.781 [2024-11-20 01:31:30.712568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.781 [2024-11-20 01:31:30.712672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.781 [2024-11-20 01:31:30.712698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.781 qpair failed and we were unable to recover it. 00:30:22.781 [2024-11-20 01:31:30.712803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.781 [2024-11-20 01:31:30.712966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.781 [2024-11-20 01:31:30.712991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.781 qpair failed and we were unable to recover it. 00:30:22.781 [2024-11-20 01:31:30.713082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.781 [2024-11-20 01:31:30.713171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.781 [2024-11-20 01:31:30.713195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.781 qpair failed and we were unable to recover it. 00:30:22.781 [2024-11-20 01:31:30.713302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.781 [2024-11-20 01:31:30.713404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.781 [2024-11-20 01:31:30.713433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.781 qpair failed and we were unable to recover it. 00:30:22.781 [2024-11-20 01:31:30.713554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.781 [2024-11-20 01:31:30.713650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.781 [2024-11-20 01:31:30.713677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.781 qpair failed and we were unable to recover it. 00:30:22.781 [2024-11-20 01:31:30.713786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.781 [2024-11-20 01:31:30.713928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.781 [2024-11-20 01:31:30.713953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.781 qpair failed and we were unable to recover it. 00:30:22.781 [2024-11-20 01:31:30.714052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.781 [2024-11-20 01:31:30.714157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.781 [2024-11-20 01:31:30.714186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.781 qpair failed and we were unable to recover it. 00:30:22.781 [2024-11-20 01:31:30.714281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.781 [2024-11-20 01:31:30.714425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.781 [2024-11-20 01:31:30.714449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.781 qpair failed and we were unable to recover it. 00:30:22.781 [2024-11-20 01:31:30.714596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.781 [2024-11-20 01:31:30.714680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.781 [2024-11-20 01:31:30.714706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.781 qpair failed and we were unable to recover it. 00:30:22.781 [2024-11-20 01:31:30.714837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.781 [2024-11-20 01:31:30.714981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.781 [2024-11-20 01:31:30.715006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.781 qpair failed and we were unable to recover it. 00:30:22.781 [2024-11-20 01:31:30.715135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.781 [2024-11-20 01:31:30.715244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.781 [2024-11-20 01:31:30.715271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.781 qpair failed and we were unable to recover it. 00:30:22.781 [2024-11-20 01:31:30.715404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.781 [2024-11-20 01:31:30.715518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.781 [2024-11-20 01:31:30.715541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.781 qpair failed and we were unable to recover it. 00:30:22.781 [2024-11-20 01:31:30.715662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.781 [2024-11-20 01:31:30.715777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.781 [2024-11-20 01:31:30.715802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.781 qpair failed and we were unable to recover it. 00:30:22.781 [2024-11-20 01:31:30.715904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.781 [2024-11-20 01:31:30.715997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.781 [2024-11-20 01:31:30.716025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.781 qpair failed and we were unable to recover it. 00:30:22.781 [2024-11-20 01:31:30.716184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.781 [2024-11-20 01:31:30.716278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.781 [2024-11-20 01:31:30.716303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.781 qpair failed and we were unable to recover it. 00:30:22.781 [2024-11-20 01:31:30.716394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.781 [2024-11-20 01:31:30.716500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.781 [2024-11-20 01:31:30.716541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.781 qpair failed and we were unable to recover it. 00:30:22.781 [2024-11-20 01:31:30.716639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.781 [2024-11-20 01:31:30.716761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.781 [2024-11-20 01:31:30.716788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.781 qpair failed and we were unable to recover it. 00:30:22.781 [2024-11-20 01:31:30.716938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.781 [2024-11-20 01:31:30.717049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.781 [2024-11-20 01:31:30.717080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.781 qpair failed and we were unable to recover it. 00:30:22.781 [2024-11-20 01:31:30.717223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.781 [2024-11-20 01:31:30.717317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.781 [2024-11-20 01:31:30.717342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.781 qpair failed and we were unable to recover it. 00:30:22.781 [2024-11-20 01:31:30.717423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.781 [2024-11-20 01:31:30.717509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.781 [2024-11-20 01:31:30.717537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.781 qpair failed and we were unable to recover it. 00:30:22.781 [2024-11-20 01:31:30.717680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.781 [2024-11-20 01:31:30.717768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.781 [2024-11-20 01:31:30.717793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.781 qpair failed and we were unable to recover it. 00:30:22.781 [2024-11-20 01:31:30.717898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.781 [2024-11-20 01:31:30.717987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.781 [2024-11-20 01:31:30.718014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.781 qpair failed and we were unable to recover it. 00:30:22.781 [2024-11-20 01:31:30.718120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.781 [2024-11-20 01:31:30.718287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.781 [2024-11-20 01:31:30.718314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.781 qpair failed and we were unable to recover it. 00:30:22.782 [2024-11-20 01:31:30.718456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.782 [2024-11-20 01:31:30.718543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.782 [2024-11-20 01:31:30.718569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.782 qpair failed and we were unable to recover it. 00:30:22.782 [2024-11-20 01:31:30.718684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.782 [2024-11-20 01:31:30.718816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.782 [2024-11-20 01:31:30.718844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.782 qpair failed and we were unable to recover it. 00:30:22.782 [2024-11-20 01:31:30.718948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.782 [2024-11-20 01:31:30.719080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.782 [2024-11-20 01:31:30.719122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.782 qpair failed and we were unable to recover it. 00:30:22.782 [2024-11-20 01:31:30.719221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.782 [2024-11-20 01:31:30.719310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.782 [2024-11-20 01:31:30.719334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.782 qpair failed and we were unable to recover it. 00:30:22.782 [2024-11-20 01:31:30.719453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.782 [2024-11-20 01:31:30.719536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.782 [2024-11-20 01:31:30.719560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.782 qpair failed and we were unable to recover it. 00:30:22.782 [2024-11-20 01:31:30.719669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.782 [2024-11-20 01:31:30.719797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.782 [2024-11-20 01:31:30.719822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.782 qpair failed and we were unable to recover it. 00:30:22.782 [2024-11-20 01:31:30.719945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.782 [2024-11-20 01:31:30.720058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.782 [2024-11-20 01:31:30.720105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.782 qpair failed and we were unable to recover it. 00:30:22.782 [2024-11-20 01:31:30.720275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.782 [2024-11-20 01:31:30.720364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.782 [2024-11-20 01:31:30.720388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.782 qpair failed and we were unable to recover it. 00:30:22.782 [2024-11-20 01:31:30.720508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.782 [2024-11-20 01:31:30.720619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.782 [2024-11-20 01:31:30.720660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.782 qpair failed and we were unable to recover it. 00:30:22.782 [2024-11-20 01:31:30.720831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.782 [2024-11-20 01:31:30.720943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.782 [2024-11-20 01:31:30.720967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.782 qpair failed and we were unable to recover it. 00:30:22.782 [2024-11-20 01:31:30.721100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.782 [2024-11-20 01:31:30.721193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.782 [2024-11-20 01:31:30.721220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.782 qpair failed and we were unable to recover it. 00:30:22.782 [2024-11-20 01:31:30.721343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.782 [2024-11-20 01:31:30.721509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.782 [2024-11-20 01:31:30.721534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.782 qpair failed and we were unable to recover it. 00:30:22.782 [2024-11-20 01:31:30.721625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.782 [2024-11-20 01:31:30.721718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.782 [2024-11-20 01:31:30.721742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.782 qpair failed and we were unable to recover it. 00:30:22.782 [2024-11-20 01:31:30.721832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.782 [2024-11-20 01:31:30.721966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.782 [2024-11-20 01:31:30.721992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.782 qpair failed and we were unable to recover it. 00:30:22.782 [2024-11-20 01:31:30.722120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.782 [2024-11-20 01:31:30.722222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.782 [2024-11-20 01:31:30.722249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.782 qpair failed and we were unable to recover it. 00:30:22.782 [2024-11-20 01:31:30.722383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.782 [2024-11-20 01:31:30.722478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.782 [2024-11-20 01:31:30.722502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.782 qpair failed and we were unable to recover it. 00:30:22.782 [2024-11-20 01:31:30.722644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.782 [2024-11-20 01:31:30.722746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.782 [2024-11-20 01:31:30.722777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.782 qpair failed and we were unable to recover it. 00:30:22.782 [2024-11-20 01:31:30.722882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.782 [2024-11-20 01:31:30.723043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.782 [2024-11-20 01:31:30.723074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.782 qpair failed and we were unable to recover it. 00:30:22.782 [2024-11-20 01:31:30.723199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.782 [2024-11-20 01:31:30.723293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.782 [2024-11-20 01:31:30.723317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.782 qpair failed and we were unable to recover it. 00:30:22.782 [2024-11-20 01:31:30.723429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.782 [2024-11-20 01:31:30.723513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.782 [2024-11-20 01:31:30.723536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.782 qpair failed and we were unable to recover it. 00:30:22.782 [2024-11-20 01:31:30.723693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.782 [2024-11-20 01:31:30.723780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.782 [2024-11-20 01:31:30.723804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.782 qpair failed and we were unable to recover it. 00:30:22.782 [2024-11-20 01:31:30.723965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.782 [2024-11-20 01:31:30.724088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.782 [2024-11-20 01:31:30.724129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.782 qpair failed and we were unable to recover it. 00:30:22.782 [2024-11-20 01:31:30.724242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.782 [2024-11-20 01:31:30.724334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.782 [2024-11-20 01:31:30.724378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.782 qpair failed and we were unable to recover it. 00:30:22.782 [2024-11-20 01:31:30.724478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.782 [2024-11-20 01:31:30.724578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.782 [2024-11-20 01:31:30.724604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.782 qpair failed and we were unable to recover it. 00:30:22.782 [2024-11-20 01:31:30.724742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.782 [2024-11-20 01:31:30.724856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.782 [2024-11-20 01:31:30.724881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.782 qpair failed and we were unable to recover it. 00:30:22.782 [2024-11-20 01:31:30.724988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.782 [2024-11-20 01:31:30.725170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.782 [2024-11-20 01:31:30.725195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.782 qpair failed and we were unable to recover it. 00:30:22.782 [2024-11-20 01:31:30.725310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.782 [2024-11-20 01:31:30.725417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.782 [2024-11-20 01:31:30.725463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.782 qpair failed and we were unable to recover it. 00:30:22.782 [2024-11-20 01:31:30.725583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.782 [2024-11-20 01:31:30.725698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.782 [2024-11-20 01:31:30.725724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.782 qpair failed and we were unable to recover it. 00:30:22.782 [2024-11-20 01:31:30.725831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.782 [2024-11-20 01:31:30.725979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.783 [2024-11-20 01:31:30.726006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.783 qpair failed and we were unable to recover it. 00:30:22.783 [2024-11-20 01:31:30.726121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.783 [2024-11-20 01:31:30.726227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.783 [2024-11-20 01:31:30.726254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.783 qpair failed and we were unable to recover it. 00:30:22.783 [2024-11-20 01:31:30.726426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.783 [2024-11-20 01:31:30.726520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.783 [2024-11-20 01:31:30.726545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.783 qpair failed and we were unable to recover it. 00:30:22.783 [2024-11-20 01:31:30.726626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.783 [2024-11-20 01:31:30.726715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.783 [2024-11-20 01:31:30.726739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.783 qpair failed and we were unable to recover it. 00:30:22.783 [2024-11-20 01:31:30.726903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.783 [2024-11-20 01:31:30.727006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.783 [2024-11-20 01:31:30.727033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.783 qpair failed and we were unable to recover it. 00:30:22.783 [2024-11-20 01:31:30.727160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.783 [2024-11-20 01:31:30.727247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.783 [2024-11-20 01:31:30.727272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.783 qpair failed and we were unable to recover it. 00:30:22.783 [2024-11-20 01:31:30.727413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.783 [2024-11-20 01:31:30.727580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.783 [2024-11-20 01:31:30.727608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.783 qpair failed and we were unable to recover it. 00:30:22.783 [2024-11-20 01:31:30.727705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.783 [2024-11-20 01:31:30.727794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.783 [2024-11-20 01:31:30.727821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.783 qpair failed and we were unable to recover it. 00:30:22.783 [2024-11-20 01:31:30.727932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.783 [2024-11-20 01:31:30.728089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.783 [2024-11-20 01:31:30.728115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.783 qpair failed and we were unable to recover it. 00:30:22.783 [2024-11-20 01:31:30.728237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.783 [2024-11-20 01:31:30.728331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.783 [2024-11-20 01:31:30.728374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.783 qpair failed and we were unable to recover it. 00:30:22.783 [2024-11-20 01:31:30.728495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.783 [2024-11-20 01:31:30.728614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.783 [2024-11-20 01:31:30.728639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.783 qpair failed and we were unable to recover it. 00:30:22.783 [2024-11-20 01:31:30.728736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.783 [2024-11-20 01:31:30.728827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.783 [2024-11-20 01:31:30.728853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.783 qpair failed and we were unable to recover it. 00:30:22.783 [2024-11-20 01:31:30.728986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.783 [2024-11-20 01:31:30.729091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.783 [2024-11-20 01:31:30.729120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.783 qpair failed and we were unable to recover it. 00:30:22.783 [2024-11-20 01:31:30.729208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.783 [2024-11-20 01:31:30.729335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.783 [2024-11-20 01:31:30.729363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.783 qpair failed and we were unable to recover it. 00:30:22.783 [2024-11-20 01:31:30.729493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.783 [2024-11-20 01:31:30.729578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.783 [2024-11-20 01:31:30.729603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.783 qpair failed and we were unable to recover it. 00:30:22.783 [2024-11-20 01:31:30.729732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.783 [2024-11-20 01:31:30.729817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.783 [2024-11-20 01:31:30.729844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.783 qpair failed and we were unable to recover it. 00:30:22.783 [2024-11-20 01:31:30.729971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.783 [2024-11-20 01:31:30.730063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.783 [2024-11-20 01:31:30.730098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.783 qpair failed and we were unable to recover it. 00:30:22.783 [2024-11-20 01:31:30.730208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.783 [2024-11-20 01:31:30.730293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.783 [2024-11-20 01:31:30.730319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.783 qpair failed and we were unable to recover it. 00:30:22.783 [2024-11-20 01:31:30.730408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.783 [2024-11-20 01:31:30.730524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.783 [2024-11-20 01:31:30.730565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.783 qpair failed and we were unable to recover it. 00:30:22.783 [2024-11-20 01:31:30.730710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.783 [2024-11-20 01:31:30.730793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.783 [2024-11-20 01:31:30.730817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.783 qpair failed and we were unable to recover it. 00:30:22.783 [2024-11-20 01:31:30.730942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.783 [2024-11-20 01:31:30.731084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.783 [2024-11-20 01:31:30.731126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.783 qpair failed and we were unable to recover it. 00:30:22.783 [2024-11-20 01:31:30.731219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.783 [2024-11-20 01:31:30.731309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.783 [2024-11-20 01:31:30.731333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.784 qpair failed and we were unable to recover it. 00:30:22.784 [2024-11-20 01:31:30.731415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.784 [2024-11-20 01:31:30.731580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.784 [2024-11-20 01:31:30.731606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.784 qpair failed and we were unable to recover it. 00:30:22.784 [2024-11-20 01:31:30.731740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.784 [2024-11-20 01:31:30.731856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.784 [2024-11-20 01:31:30.731881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.784 qpair failed and we were unable to recover it. 00:30:22.784 [2024-11-20 01:31:30.731966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.784 [2024-11-20 01:31:30.732052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.784 [2024-11-20 01:31:30.732084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.784 qpair failed and we were unable to recover it. 00:30:22.784 [2024-11-20 01:31:30.732184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.784 [2024-11-20 01:31:30.732319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.784 [2024-11-20 01:31:30.732345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.784 qpair failed and we were unable to recover it. 00:30:22.784 [2024-11-20 01:31:30.732473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.784 [2024-11-20 01:31:30.732614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.784 [2024-11-20 01:31:30.732638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.784 qpair failed and we were unable to recover it. 00:30:22.784 [2024-11-20 01:31:30.732756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.784 [2024-11-20 01:31:30.732875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.784 [2024-11-20 01:31:30.732900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.784 qpair failed and we were unable to recover it. 00:30:22.784 [2024-11-20 01:31:30.733079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.784 [2024-11-20 01:31:30.733217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.784 [2024-11-20 01:31:30.733241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.784 qpair failed and we were unable to recover it. 00:30:22.784 [2024-11-20 01:31:30.733387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.784 [2024-11-20 01:31:30.733506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.784 [2024-11-20 01:31:30.733531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.784 qpair failed and we were unable to recover it. 00:30:22.784 [2024-11-20 01:31:30.733670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.784 [2024-11-20 01:31:30.733822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.784 [2024-11-20 01:31:30.733848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.784 qpair failed and we were unable to recover it. 00:30:22.784 [2024-11-20 01:31:30.733951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.784 [2024-11-20 01:31:30.734085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.784 [2024-11-20 01:31:30.734110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.784 qpair failed and we were unable to recover it. 00:30:22.784 [2024-11-20 01:31:30.734203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.784 [2024-11-20 01:31:30.734324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.784 [2024-11-20 01:31:30.734348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.784 qpair failed and we were unable to recover it. 00:30:22.784 [2024-11-20 01:31:30.734480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.784 [2024-11-20 01:31:30.734606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.784 [2024-11-20 01:31:30.734634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.784 qpair failed and we were unable to recover it. 00:30:22.784 [2024-11-20 01:31:30.734766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.784 [2024-11-20 01:31:30.734922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.784 [2024-11-20 01:31:30.734951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.784 qpair failed and we were unable to recover it. 00:30:22.784 [2024-11-20 01:31:30.735065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.784 [2024-11-20 01:31:30.735200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.784 [2024-11-20 01:31:30.735225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.784 qpair failed and we were unable to recover it. 00:30:22.784 [2024-11-20 01:31:30.735386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.784 [2024-11-20 01:31:30.735507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.784 [2024-11-20 01:31:30.735532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.784 qpair failed and we were unable to recover it. 00:30:22.784 [2024-11-20 01:31:30.735697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.784 [2024-11-20 01:31:30.735836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.784 [2024-11-20 01:31:30.735862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.784 qpair failed and we were unable to recover it. 00:30:22.784 [2024-11-20 01:31:30.735979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.784 [2024-11-20 01:31:30.736063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.784 [2024-11-20 01:31:30.736115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.784 qpair failed and we were unable to recover it. 00:30:22.784 [2024-11-20 01:31:30.736254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.784 [2024-11-20 01:31:30.736350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.784 [2024-11-20 01:31:30.736378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.784 qpair failed and we were unable to recover it. 00:30:22.784 [2024-11-20 01:31:30.736490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.784 [2024-11-20 01:31:30.736613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.784 [2024-11-20 01:31:30.736641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.784 qpair failed and we were unable to recover it. 00:30:22.784 [2024-11-20 01:31:30.736751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.784 [2024-11-20 01:31:30.736868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.784 [2024-11-20 01:31:30.736893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.784 qpair failed and we were unable to recover it. 00:30:22.784 [2024-11-20 01:31:30.736995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.784 [2024-11-20 01:31:30.737104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.784 [2024-11-20 01:31:30.737132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.784 qpair failed and we were unable to recover it. 00:30:22.784 [2024-11-20 01:31:30.737255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.784 [2024-11-20 01:31:30.737342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.784 [2024-11-20 01:31:30.737368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.784 qpair failed and we were unable to recover it. 00:30:22.784 [2024-11-20 01:31:30.737507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.784 [2024-11-20 01:31:30.737621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.784 [2024-11-20 01:31:30.737645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.784 qpair failed and we were unable to recover it. 00:30:22.784 [2024-11-20 01:31:30.737744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.784 [2024-11-20 01:31:30.737831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.784 [2024-11-20 01:31:30.737859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.784 qpair failed and we were unable to recover it. 00:30:22.784 [2024-11-20 01:31:30.737988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.784 [2024-11-20 01:31:30.738125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.784 [2024-11-20 01:31:30.738150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.784 qpair failed and we were unable to recover it. 00:30:22.784 [2024-11-20 01:31:30.738259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.784 [2024-11-20 01:31:30.738346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.784 [2024-11-20 01:31:30.738370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.784 qpair failed and we were unable to recover it. 00:30:22.784 [2024-11-20 01:31:30.738502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.784 [2024-11-20 01:31:30.738594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.784 [2024-11-20 01:31:30.738622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.784 qpair failed and we were unable to recover it. 00:30:22.784 [2024-11-20 01:31:30.738781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.784 [2024-11-20 01:31:30.738901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.784 [2024-11-20 01:31:30.738925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.784 qpair failed and we were unable to recover it. 00:30:22.785 [2024-11-20 01:31:30.739057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.785 [2024-11-20 01:31:30.739199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.785 [2024-11-20 01:31:30.739224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.785 qpair failed and we were unable to recover it. 00:30:22.785 [2024-11-20 01:31:30.739314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.785 [2024-11-20 01:31:30.739444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.785 [2024-11-20 01:31:30.739472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.785 qpair failed and we were unable to recover it. 00:30:22.785 [2024-11-20 01:31:30.739576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.785 [2024-11-20 01:31:30.739679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.785 [2024-11-20 01:31:30.739705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.785 qpair failed and we were unable to recover it. 00:30:22.785 [2024-11-20 01:31:30.739845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.785 [2024-11-20 01:31:30.739960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.785 [2024-11-20 01:31:30.739985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.785 qpair failed and we were unable to recover it. 00:30:22.785 [2024-11-20 01:31:30.740100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.785 [2024-11-20 01:31:30.740201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.785 [2024-11-20 01:31:30.740228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.785 qpair failed and we were unable to recover it. 00:30:22.785 [2024-11-20 01:31:30.740352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.785 [2024-11-20 01:31:30.740451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.785 [2024-11-20 01:31:30.740479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.785 qpair failed and we were unable to recover it. 00:30:22.785 [2024-11-20 01:31:30.740607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.785 [2024-11-20 01:31:30.740749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.785 [2024-11-20 01:31:30.740773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.785 qpair failed and we were unable to recover it. 00:30:22.785 [2024-11-20 01:31:30.740912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.785 [2024-11-20 01:31:30.741039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.785 [2024-11-20 01:31:30.741066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.785 qpair failed and we were unable to recover it. 00:30:22.785 [2024-11-20 01:31:30.741187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.785 [2024-11-20 01:31:30.741284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.785 [2024-11-20 01:31:30.741308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.785 qpair failed and we were unable to recover it. 00:30:22.785 [2024-11-20 01:31:30.741437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.785 [2024-11-20 01:31:30.741516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.785 [2024-11-20 01:31:30.741540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.785 qpair failed and we were unable to recover it. 00:30:22.785 [2024-11-20 01:31:30.741625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.785 [2024-11-20 01:31:30.741711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.785 [2024-11-20 01:31:30.741735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.785 qpair failed and we were unable to recover it. 00:30:22.785 [2024-11-20 01:31:30.741824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.785 [2024-11-20 01:31:30.741936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.785 [2024-11-20 01:31:30.741960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.785 qpair failed and we were unable to recover it. 00:30:22.785 [2024-11-20 01:31:30.742081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.785 [2024-11-20 01:31:30.742195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.785 [2024-11-20 01:31:30.742219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.785 qpair failed and we were unable to recover it. 00:30:22.785 [2024-11-20 01:31:30.742354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.785 [2024-11-20 01:31:30.742474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.785 [2024-11-20 01:31:30.742502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.785 qpair failed and we were unable to recover it. 00:30:22.785 [2024-11-20 01:31:30.742636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.785 [2024-11-20 01:31:30.742767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.785 [2024-11-20 01:31:30.742794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.785 qpair failed and we were unable to recover it. 00:30:22.785 [2024-11-20 01:31:30.742900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.785 [2024-11-20 01:31:30.743014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.785 [2024-11-20 01:31:30.743039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.785 qpair failed and we were unable to recover it. 00:30:22.785 [2024-11-20 01:31:30.743165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.785 [2024-11-20 01:31:30.743274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.785 [2024-11-20 01:31:30.743298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.785 qpair failed and we were unable to recover it. 00:30:22.785 [2024-11-20 01:31:30.743407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.785 [2024-11-20 01:31:30.743532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.785 [2024-11-20 01:31:30.743559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.785 qpair failed and we were unable to recover it. 00:30:22.785 [2024-11-20 01:31:30.743711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.785 [2024-11-20 01:31:30.743849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.785 [2024-11-20 01:31:30.743873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.785 qpair failed and we were unable to recover it. 00:30:22.785 [2024-11-20 01:31:30.744027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.785 [2024-11-20 01:31:30.744147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.785 [2024-11-20 01:31:30.744173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.785 qpair failed and we were unable to recover it. 00:30:22.785 [2024-11-20 01:31:30.744343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.785 [2024-11-20 01:31:30.744439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.785 [2024-11-20 01:31:30.744467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.785 qpair failed and we were unable to recover it. 00:30:22.785 [2024-11-20 01:31:30.744608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.785 [2024-11-20 01:31:30.744717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.785 [2024-11-20 01:31:30.744742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.785 qpair failed and we were unable to recover it. 00:30:22.785 [2024-11-20 01:31:30.744875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.785 [2024-11-20 01:31:30.744974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.785 [2024-11-20 01:31:30.745000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.785 qpair failed and we were unable to recover it. 00:30:22.785 [2024-11-20 01:31:30.745099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.785 [2024-11-20 01:31:30.745236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.785 [2024-11-20 01:31:30.745261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.785 qpair failed and we were unable to recover it. 00:30:22.785 [2024-11-20 01:31:30.745349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.785 [2024-11-20 01:31:30.745437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.785 [2024-11-20 01:31:30.745462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.785 qpair failed and we were unable to recover it. 00:30:22.785 [2024-11-20 01:31:30.745582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.785 [2024-11-20 01:31:30.745708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.785 [2024-11-20 01:31:30.745736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.785 qpair failed and we were unable to recover it. 00:30:22.785 [2024-11-20 01:31:30.745839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.786 [2024-11-20 01:31:30.745969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.786 [2024-11-20 01:31:30.745994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.786 qpair failed and we were unable to recover it. 00:30:22.786 [2024-11-20 01:31:30.746114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.786 [2024-11-20 01:31:30.746203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.786 [2024-11-20 01:31:30.746228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.786 qpair failed and we were unable to recover it. 00:30:22.786 [2024-11-20 01:31:30.746309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.786 [2024-11-20 01:31:30.746427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.786 [2024-11-20 01:31:30.746452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.786 qpair failed and we were unable to recover it. 00:30:22.786 [2024-11-20 01:31:30.746563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.786 [2024-11-20 01:31:30.746694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.786 [2024-11-20 01:31:30.746721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.786 qpair failed and we were unable to recover it. 00:30:22.786 [2024-11-20 01:31:30.746886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.786 [2024-11-20 01:31:30.747005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.786 [2024-11-20 01:31:30.747030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.786 qpair failed and we were unable to recover it. 00:30:22.786 [2024-11-20 01:31:30.747127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.786 [2024-11-20 01:31:30.747208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.786 [2024-11-20 01:31:30.747234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.786 qpair failed and we were unable to recover it. 00:30:22.786 [2024-11-20 01:31:30.747346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.786 [2024-11-20 01:31:30.747459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.786 [2024-11-20 01:31:30.747484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.786 qpair failed and we were unable to recover it. 00:30:22.786 [2024-11-20 01:31:30.747601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.786 [2024-11-20 01:31:30.747720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.786 [2024-11-20 01:31:30.747745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.786 qpair failed and we were unable to recover it. 00:30:22.786 [2024-11-20 01:31:30.747850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.786 [2024-11-20 01:31:30.747943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.786 [2024-11-20 01:31:30.747986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.786 qpair failed and we were unable to recover it. 00:30:22.786 [2024-11-20 01:31:30.748101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.786 [2024-11-20 01:31:30.748185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.786 [2024-11-20 01:31:30.748210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.786 qpair failed and we were unable to recover it. 00:30:22.786 [2024-11-20 01:31:30.748292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.786 [2024-11-20 01:31:30.748377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.786 [2024-11-20 01:31:30.748403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.786 qpair failed and we were unable to recover it. 00:30:22.786 [2024-11-20 01:31:30.748518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.786 [2024-11-20 01:31:30.748601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.786 [2024-11-20 01:31:30.748626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.786 qpair failed and we were unable to recover it. 00:30:22.786 [2024-11-20 01:31:30.748742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.786 [2024-11-20 01:31:30.748870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.786 [2024-11-20 01:31:30.748898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.786 qpair failed and we were unable to recover it. 00:30:22.786 [2024-11-20 01:31:30.749011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.786 [2024-11-20 01:31:30.749173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.786 [2024-11-20 01:31:30.749199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.786 qpair failed and we were unable to recover it. 00:30:22.786 [2024-11-20 01:31:30.749365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.786 [2024-11-20 01:31:30.749454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.786 [2024-11-20 01:31:30.749481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.786 qpair failed and we were unable to recover it. 00:30:22.786 [2024-11-20 01:31:30.749620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.786 [2024-11-20 01:31:30.749710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.786 [2024-11-20 01:31:30.749735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.786 qpair failed and we were unable to recover it. 00:30:22.786 [2024-11-20 01:31:30.749824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.786 [2024-11-20 01:31:30.749942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.786 [2024-11-20 01:31:30.749967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.786 qpair failed and we were unable to recover it. 00:30:22.786 [2024-11-20 01:31:30.750131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.786 [2024-11-20 01:31:30.750302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.786 [2024-11-20 01:31:30.750327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.786 qpair failed and we were unable to recover it. 00:30:22.786 [2024-11-20 01:31:30.750410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.786 [2024-11-20 01:31:30.750498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.786 [2024-11-20 01:31:30.750523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.786 qpair failed and we were unable to recover it. 00:30:22.786 [2024-11-20 01:31:30.750641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.786 [2024-11-20 01:31:30.750749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.786 [2024-11-20 01:31:30.750773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.786 qpair failed and we were unable to recover it. 00:30:22.786 [2024-11-20 01:31:30.750891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.786 [2024-11-20 01:31:30.751051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.786 [2024-11-20 01:31:30.751082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.786 qpair failed and we were unable to recover it. 00:30:22.786 [2024-11-20 01:31:30.751177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.786 [2024-11-20 01:31:30.751283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.786 [2024-11-20 01:31:30.751311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.786 qpair failed and we were unable to recover it. 00:30:22.786 [2024-11-20 01:31:30.751429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.786 [2024-11-20 01:31:30.751510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.786 [2024-11-20 01:31:30.751534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.786 qpair failed and we were unable to recover it. 00:30:22.786 [2024-11-20 01:31:30.751650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.786 [2024-11-20 01:31:30.751743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.786 [2024-11-20 01:31:30.751767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.786 qpair failed and we were unable to recover it. 00:30:22.786 [2024-11-20 01:31:30.751874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.786 [2024-11-20 01:31:30.752034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.786 [2024-11-20 01:31:30.752061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.786 qpair failed and we were unable to recover it. 00:30:22.786 [2024-11-20 01:31:30.752219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.786 [2024-11-20 01:31:30.752343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.786 [2024-11-20 01:31:30.752368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.786 qpair failed and we were unable to recover it. 00:30:22.786 [2024-11-20 01:31:30.752519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.786 [2024-11-20 01:31:30.752608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.786 [2024-11-20 01:31:30.752634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.786 qpair failed and we were unable to recover it. 00:30:22.786 [2024-11-20 01:31:30.752729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.786 [2024-11-20 01:31:30.752890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.786 [2024-11-20 01:31:30.752915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.786 qpair failed and we were unable to recover it. 00:30:22.787 [2024-11-20 01:31:30.753033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.787 [2024-11-20 01:31:30.753152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.787 [2024-11-20 01:31:30.753177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.787 qpair failed and we were unable to recover it. 00:30:22.787 [2024-11-20 01:31:30.753335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.787 [2024-11-20 01:31:30.753447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.787 [2024-11-20 01:31:30.753472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.787 qpair failed and we were unable to recover it. 00:30:22.787 [2024-11-20 01:31:30.753558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.787 [2024-11-20 01:31:30.753701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.787 [2024-11-20 01:31:30.753726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.787 qpair failed and we were unable to recover it. 00:30:22.787 [2024-11-20 01:31:30.753809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.787 [2024-11-20 01:31:30.753950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.787 [2024-11-20 01:31:30.753975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.787 qpair failed and we were unable to recover it. 00:30:22.787 [2024-11-20 01:31:30.754116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.787 [2024-11-20 01:31:30.754234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.787 [2024-11-20 01:31:30.754260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.787 qpair failed and we were unable to recover it. 00:30:22.787 [2024-11-20 01:31:30.754355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.787 [2024-11-20 01:31:30.754480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.787 [2024-11-20 01:31:30.754522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.787 qpair failed and we were unable to recover it. 00:30:22.787 [2024-11-20 01:31:30.754635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.787 [2024-11-20 01:31:30.754762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.787 [2024-11-20 01:31:30.754786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.787 qpair failed and we were unable to recover it. 00:30:22.787 [2024-11-20 01:31:30.754894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.787 [2024-11-20 01:31:30.754997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.787 [2024-11-20 01:31:30.755025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.787 qpair failed and we were unable to recover it. 00:30:22.787 [2024-11-20 01:31:30.755171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.787 [2024-11-20 01:31:30.755260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.787 [2024-11-20 01:31:30.755286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.787 qpair failed and we were unable to recover it. 00:30:22.787 [2024-11-20 01:31:30.755408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.787 [2024-11-20 01:31:30.755522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.787 [2024-11-20 01:31:30.755545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.787 qpair failed and we were unable to recover it. 00:30:22.787 [2024-11-20 01:31:30.755702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.787 [2024-11-20 01:31:30.755834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.787 [2024-11-20 01:31:30.755858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.787 qpair failed and we were unable to recover it. 00:30:22.787 [2024-11-20 01:31:30.755969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.787 [2024-11-20 01:31:30.756060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.787 [2024-11-20 01:31:30.756094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.787 qpair failed and we were unable to recover it. 00:30:22.787 [2024-11-20 01:31:30.756227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.787 [2024-11-20 01:31:30.756323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.787 [2024-11-20 01:31:30.756347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.787 qpair failed and we were unable to recover it. 00:30:22.787 [2024-11-20 01:31:30.756484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.787 [2024-11-20 01:31:30.756614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.787 [2024-11-20 01:31:30.756641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.787 qpair failed and we were unable to recover it. 00:30:22.787 [2024-11-20 01:31:30.756735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.787 [2024-11-20 01:31:30.756832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.787 [2024-11-20 01:31:30.756859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.787 qpair failed and we were unable to recover it. 00:30:22.787 [2024-11-20 01:31:30.756978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.787 [2024-11-20 01:31:30.757080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.787 [2024-11-20 01:31:30.757105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.787 qpair failed and we were unable to recover it. 00:30:22.787 [2024-11-20 01:31:30.757195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.787 [2024-11-20 01:31:30.757281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.787 [2024-11-20 01:31:30.757306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.787 qpair failed and we were unable to recover it. 00:30:22.787 [2024-11-20 01:31:30.757464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.787 [2024-11-20 01:31:30.757583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.787 [2024-11-20 01:31:30.757610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.787 qpair failed and we were unable to recover it. 00:30:22.787 [2024-11-20 01:31:30.757778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.787 [2024-11-20 01:31:30.757922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.787 [2024-11-20 01:31:30.757962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.787 qpair failed and we were unable to recover it. 00:30:22.787 [2024-11-20 01:31:30.758076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.787 [2024-11-20 01:31:30.758175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.787 [2024-11-20 01:31:30.758201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.787 qpair failed and we were unable to recover it. 00:30:22.787 [2024-11-20 01:31:30.758330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.787 [2024-11-20 01:31:30.758440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.787 [2024-11-20 01:31:30.758463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.787 qpair failed and we were unable to recover it. 00:30:22.787 [2024-11-20 01:31:30.758579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.787 [2024-11-20 01:31:30.758695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.787 [2024-11-20 01:31:30.758719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.787 qpair failed and we were unable to recover it. 00:30:22.787 [2024-11-20 01:31:30.758836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.787 [2024-11-20 01:31:30.758951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.787 [2024-11-20 01:31:30.758974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.787 qpair failed and we were unable to recover it. 00:30:22.787 [2024-11-20 01:31:30.759083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.787 [2024-11-20 01:31:30.759185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.787 [2024-11-20 01:31:30.759212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.787 qpair failed and we were unable to recover it. 00:30:22.787 [2024-11-20 01:31:30.759327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.787 [2024-11-20 01:31:30.759469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.788 [2024-11-20 01:31:30.759494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.788 qpair failed and we were unable to recover it. 00:30:22.788 [2024-11-20 01:31:30.759664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.788 [2024-11-20 01:31:30.759782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.788 [2024-11-20 01:31:30.759810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.788 qpair failed and we were unable to recover it. 00:30:22.788 [2024-11-20 01:31:30.759939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.788 [2024-11-20 01:31:30.760030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.788 [2024-11-20 01:31:30.760092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.788 qpair failed and we were unable to recover it. 00:30:22.788 [2024-11-20 01:31:30.760222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.788 [2024-11-20 01:31:30.760342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.788 [2024-11-20 01:31:30.760367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.788 qpair failed and we were unable to recover it. 00:30:22.788 [2024-11-20 01:31:30.760452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.788 [2024-11-20 01:31:30.760572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.788 [2024-11-20 01:31:30.760595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.788 qpair failed and we were unable to recover it. 00:30:22.788 [2024-11-20 01:31:30.760689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.788 [2024-11-20 01:31:30.760806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.788 [2024-11-20 01:31:30.760830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.788 qpair failed and we were unable to recover it. 00:30:22.788 [2024-11-20 01:31:30.760945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.788 [2024-11-20 01:31:30.761088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.788 [2024-11-20 01:31:30.761113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.788 qpair failed and we were unable to recover it. 00:30:22.788 [2024-11-20 01:31:30.761242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.788 [2024-11-20 01:31:30.761336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.788 [2024-11-20 01:31:30.761362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.788 qpair failed and we were unable to recover it. 00:30:22.788 [2024-11-20 01:31:30.761494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.788 [2024-11-20 01:31:30.761622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.788 [2024-11-20 01:31:30.761650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.788 qpair failed and we were unable to recover it. 00:30:22.788 [2024-11-20 01:31:30.761761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.788 [2024-11-20 01:31:30.761876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.788 [2024-11-20 01:31:30.761900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.788 qpair failed and we were unable to recover it. 00:30:22.788 [2024-11-20 01:31:30.761989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.788 [2024-11-20 01:31:30.762102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.788 [2024-11-20 01:31:30.762127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.788 qpair failed and we were unable to recover it. 00:30:22.788 [2024-11-20 01:31:30.762265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.788 [2024-11-20 01:31:30.762398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.788 [2024-11-20 01:31:30.762429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.788 qpair failed and we were unable to recover it. 00:30:22.788 [2024-11-20 01:31:30.762539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.788 [2024-11-20 01:31:30.762634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.788 [2024-11-20 01:31:30.762657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.788 qpair failed and we were unable to recover it. 00:30:22.788 [2024-11-20 01:31:30.762741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.788 [2024-11-20 01:31:30.762885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.788 [2024-11-20 01:31:30.762909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.788 qpair failed and we were unable to recover it. 00:30:22.788 [2024-11-20 01:31:30.763018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.788 [2024-11-20 01:31:30.763162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.788 [2024-11-20 01:31:30.763189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.788 qpair failed and we were unable to recover it. 00:30:22.788 [2024-11-20 01:31:30.763275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.788 [2024-11-20 01:31:30.763409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.788 [2024-11-20 01:31:30.763433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.788 qpair failed and we were unable to recover it. 00:30:22.788 [2024-11-20 01:31:30.763522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.788 [2024-11-20 01:31:30.763636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.788 [2024-11-20 01:31:30.763660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.788 qpair failed and we were unable to recover it. 00:30:22.788 [2024-11-20 01:31:30.763772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.788 [2024-11-20 01:31:30.763903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.788 [2024-11-20 01:31:30.763929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.788 qpair failed and we were unable to recover it. 00:30:22.788 [2024-11-20 01:31:30.764057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.788 [2024-11-20 01:31:30.764145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.788 [2024-11-20 01:31:30.764170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.788 qpair failed and we were unable to recover it. 00:30:22.788 [2024-11-20 01:31:30.764260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.788 [2024-11-20 01:31:30.764381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.788 [2024-11-20 01:31:30.764406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.788 qpair failed and we were unable to recover it. 00:30:22.788 [2024-11-20 01:31:30.764487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.788 [2024-11-20 01:31:30.764601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.788 [2024-11-20 01:31:30.764625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.788 qpair failed and we were unable to recover it. 00:30:22.788 [2024-11-20 01:31:30.764721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.788 [2024-11-20 01:31:30.764839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.788 [2024-11-20 01:31:30.764867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.788 qpair failed and we were unable to recover it. 00:30:22.788 [2024-11-20 01:31:30.764970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.788 [2024-11-20 01:31:30.765101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.788 [2024-11-20 01:31:30.765129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.788 qpair failed and we were unable to recover it. 00:30:22.788 [2024-11-20 01:31:30.765223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.788 [2024-11-20 01:31:30.765314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.788 [2024-11-20 01:31:30.765340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.788 qpair failed and we were unable to recover it. 00:30:22.788 [2024-11-20 01:31:30.765447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.788 [2024-11-20 01:31:30.765537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.788 [2024-11-20 01:31:30.765561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.788 qpair failed and we were unable to recover it. 00:30:22.788 [2024-11-20 01:31:30.765692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.789 [2024-11-20 01:31:30.765823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.789 [2024-11-20 01:31:30.765847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.789 qpair failed and we were unable to recover it. 00:30:22.789 [2024-11-20 01:31:30.765990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.789 [2024-11-20 01:31:30.766104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.789 [2024-11-20 01:31:30.766131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.789 qpair failed and we were unable to recover it. 00:30:22.789 [2024-11-20 01:31:30.766278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.789 [2024-11-20 01:31:30.766360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.789 [2024-11-20 01:31:30.766384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.789 qpair failed and we were unable to recover it. 00:30:22.789 [2024-11-20 01:31:30.766497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.789 [2024-11-20 01:31:30.766624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.789 [2024-11-20 01:31:30.766647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.789 qpair failed and we were unable to recover it. 00:30:22.789 [2024-11-20 01:31:30.766735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.789 [2024-11-20 01:31:30.766849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.789 [2024-11-20 01:31:30.766873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.789 qpair failed and we were unable to recover it. 00:30:22.789 [2024-11-20 01:31:30.767017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.789 [2024-11-20 01:31:30.767097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.789 [2024-11-20 01:31:30.767122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.789 qpair failed and we were unable to recover it. 00:30:22.789 [2024-11-20 01:31:30.767277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.789 [2024-11-20 01:31:30.767393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.789 [2024-11-20 01:31:30.767421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.789 qpair failed and we were unable to recover it. 00:30:22.789 [2024-11-20 01:31:30.767514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.789 [2024-11-20 01:31:30.767629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.789 [2024-11-20 01:31:30.767655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.789 qpair failed and we were unable to recover it. 00:30:22.789 [2024-11-20 01:31:30.767805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.789 [2024-11-20 01:31:30.767901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.789 [2024-11-20 01:31:30.767926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.789 qpair failed and we were unable to recover it. 00:30:22.789 [2024-11-20 01:31:30.768077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.789 [2024-11-20 01:31:30.768186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.789 [2024-11-20 01:31:30.768214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.789 qpair failed and we were unable to recover it. 00:30:22.789 [2024-11-20 01:31:30.768314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.789 [2024-11-20 01:31:30.768453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.789 [2024-11-20 01:31:30.768478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.789 qpair failed and we were unable to recover it. 00:30:22.789 [2024-11-20 01:31:30.768625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.789 [2024-11-20 01:31:30.768739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.789 [2024-11-20 01:31:30.768764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.789 qpair failed and we were unable to recover it. 00:30:22.789 [2024-11-20 01:31:30.768897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.789 [2024-11-20 01:31:30.769054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.789 [2024-11-20 01:31:30.769090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.789 qpair failed and we were unable to recover it. 00:30:22.789 [2024-11-20 01:31:30.769202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.789 [2024-11-20 01:31:30.769362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.789 [2024-11-20 01:31:30.769390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.789 qpair failed and we were unable to recover it. 00:30:22.789 [2024-11-20 01:31:30.769505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.789 [2024-11-20 01:31:30.769623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.789 [2024-11-20 01:31:30.769647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.789 qpair failed and we were unable to recover it. 00:30:22.789 [2024-11-20 01:31:30.769732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.789 [2024-11-20 01:31:30.769851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.789 [2024-11-20 01:31:30.769875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.789 qpair failed and we were unable to recover it. 00:30:22.789 [2024-11-20 01:31:30.769959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.789 [2024-11-20 01:31:30.770075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.789 [2024-11-20 01:31:30.770102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.789 qpair failed and we were unable to recover it. 00:30:22.789 [2024-11-20 01:31:30.770271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.789 [2024-11-20 01:31:30.770360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.789 [2024-11-20 01:31:30.770385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.789 qpair failed and we were unable to recover it. 00:30:22.789 [2024-11-20 01:31:30.770495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.789 [2024-11-20 01:31:30.770621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.789 [2024-11-20 01:31:30.770649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.789 qpair failed and we were unable to recover it. 00:30:22.789 [2024-11-20 01:31:30.770748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.789 [2024-11-20 01:31:30.770838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.789 [2024-11-20 01:31:30.770867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.789 qpair failed and we were unable to recover it. 00:30:22.789 [2024-11-20 01:31:30.770978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.789 [2024-11-20 01:31:30.771081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.789 [2024-11-20 01:31:30.771105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.789 qpair failed and we were unable to recover it. 00:30:22.789 [2024-11-20 01:31:30.771224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.789 [2024-11-20 01:31:30.771336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.789 [2024-11-20 01:31:30.771363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.789 qpair failed and we were unable to recover it. 00:30:22.789 [2024-11-20 01:31:30.771459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.789 [2024-11-20 01:31:30.771556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.789 [2024-11-20 01:31:30.771582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.789 qpair failed and we were unable to recover it. 00:30:22.789 [2024-11-20 01:31:30.771687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.789 [2024-11-20 01:31:30.771781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.789 [2024-11-20 01:31:30.771805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.789 qpair failed and we were unable to recover it. 00:30:22.789 [2024-11-20 01:31:30.771898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.789 [2024-11-20 01:31:30.771981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.789 [2024-11-20 01:31:30.772005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.789 qpair failed and we were unable to recover it. 00:30:22.789 [2024-11-20 01:31:30.772093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.789 [2024-11-20 01:31:30.772175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.789 [2024-11-20 01:31:30.772200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.789 qpair failed and we were unable to recover it. 00:30:22.789 [2024-11-20 01:31:30.772284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.789 [2024-11-20 01:31:30.772395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.789 [2024-11-20 01:31:30.772419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.789 qpair failed and we were unable to recover it. 00:30:22.790 [2024-11-20 01:31:30.772561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.790 [2024-11-20 01:31:30.772699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.790 [2024-11-20 01:31:30.772724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.790 qpair failed and we were unable to recover it. 00:30:22.790 [2024-11-20 01:31:30.772862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.790 [2024-11-20 01:31:30.772982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.790 [2024-11-20 01:31:30.773009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.790 qpair failed and we were unable to recover it. 00:30:22.790 [2024-11-20 01:31:30.773121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.790 [2024-11-20 01:31:30.773244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.790 [2024-11-20 01:31:30.773269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.790 qpair failed and we were unable to recover it. 00:30:22.790 [2024-11-20 01:31:30.773355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.790 [2024-11-20 01:31:30.773472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.790 [2024-11-20 01:31:30.773498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.790 qpair failed and we were unable to recover it. 00:30:22.790 [2024-11-20 01:31:30.773592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.790 [2024-11-20 01:31:30.773767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.790 [2024-11-20 01:31:30.773795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.790 qpair failed and we were unable to recover it. 00:30:22.790 [2024-11-20 01:31:30.773991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.790 [2024-11-20 01:31:30.774137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.790 [2024-11-20 01:31:30.774162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.790 qpair failed and we were unable to recover it. 00:30:22.790 [2024-11-20 01:31:30.774313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.790 [2024-11-20 01:31:30.774451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.790 [2024-11-20 01:31:30.774478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.790 qpair failed and we were unable to recover it. 00:30:22.790 [2024-11-20 01:31:30.774602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.790 [2024-11-20 01:31:30.774699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.790 [2024-11-20 01:31:30.774726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.790 qpair failed and we were unable to recover it. 00:30:22.790 [2024-11-20 01:31:30.774838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.790 [2024-11-20 01:31:30.774925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.790 [2024-11-20 01:31:30.774950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.790 qpair failed and we were unable to recover it. 00:30:22.790 [2024-11-20 01:31:30.775086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.790 [2024-11-20 01:31:30.775251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.790 [2024-11-20 01:31:30.775279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.790 qpair failed and we were unable to recover it. 00:30:22.790 [2024-11-20 01:31:30.775420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.790 [2024-11-20 01:31:30.775516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.790 [2024-11-20 01:31:30.775543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.790 qpair failed and we were unable to recover it. 00:30:22.790 [2024-11-20 01:31:30.775680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.790 [2024-11-20 01:31:30.775769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.790 [2024-11-20 01:31:30.775795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.790 qpair failed and we were unable to recover it. 00:30:22.790 [2024-11-20 01:31:30.775886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.790 [2024-11-20 01:31:30.775972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.790 [2024-11-20 01:31:30.775997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.790 qpair failed and we were unable to recover it. 00:30:22.790 [2024-11-20 01:31:30.776097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.790 [2024-11-20 01:31:30.776186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.790 [2024-11-20 01:31:30.776210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.790 qpair failed and we were unable to recover it. 00:30:22.790 [2024-11-20 01:31:30.776300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.790 [2024-11-20 01:31:30.776414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.790 [2024-11-20 01:31:30.776439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.790 qpair failed and we were unable to recover it. 00:30:22.790 [2024-11-20 01:31:30.776520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.790 [2024-11-20 01:31:30.776636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.790 [2024-11-20 01:31:30.776660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.790 qpair failed and we were unable to recover it. 00:30:22.790 [2024-11-20 01:31:30.776743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.790 [2024-11-20 01:31:30.776875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.790 [2024-11-20 01:31:30.776902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.790 qpair failed and we were unable to recover it. 00:30:22.790 [2024-11-20 01:31:30.777075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.790 [2024-11-20 01:31:30.777192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.790 [2024-11-20 01:31:30.777216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.790 qpair failed and we were unable to recover it. 00:30:22.790 [2024-11-20 01:31:30.777358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.790 [2024-11-20 01:31:30.777457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.790 [2024-11-20 01:31:30.777484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.790 qpair failed and we were unable to recover it. 00:30:22.790 [2024-11-20 01:31:30.777619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.790 [2024-11-20 01:31:30.777761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.790 [2024-11-20 01:31:30.777785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.790 qpair failed and we were unable to recover it. 00:30:22.790 [2024-11-20 01:31:30.777907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.790 [2024-11-20 01:31:30.778046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.790 [2024-11-20 01:31:30.778075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.790 qpair failed and we were unable to recover it. 00:30:22.790 [2024-11-20 01:31:30.778191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.790 [2024-11-20 01:31:30.778313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.790 [2024-11-20 01:31:30.778339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.790 qpair failed and we were unable to recover it. 00:30:22.790 [2024-11-20 01:31:30.778429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.790 [2024-11-20 01:31:30.778560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.790 [2024-11-20 01:31:30.778583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.790 qpair failed and we were unable to recover it. 00:30:22.790 [2024-11-20 01:31:30.778699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.790 [2024-11-20 01:31:30.778810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.790 [2024-11-20 01:31:30.778834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.790 qpair failed and we were unable to recover it. 00:30:22.790 [2024-11-20 01:31:30.778970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.790 [2024-11-20 01:31:30.779078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.790 [2024-11-20 01:31:30.779105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.790 qpair failed and we were unable to recover it. 00:30:22.790 [2024-11-20 01:31:30.779213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.790 [2024-11-20 01:31:30.779338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.790 [2024-11-20 01:31:30.779366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.790 qpair failed and we were unable to recover it. 00:30:22.790 [2024-11-20 01:31:30.779515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.790 [2024-11-20 01:31:30.779655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.790 [2024-11-20 01:31:30.779679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.790 qpair failed and we were unable to recover it. 00:30:22.790 [2024-11-20 01:31:30.779774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.790 [2024-11-20 01:31:30.779918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.791 [2024-11-20 01:31:30.779945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.791 qpair failed and we were unable to recover it. 00:30:22.791 [2024-11-20 01:31:30.780083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.791 [2024-11-20 01:31:30.780178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.791 [2024-11-20 01:31:30.780203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.791 qpair failed and we were unable to recover it. 00:30:22.791 [2024-11-20 01:31:30.780348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.791 [2024-11-20 01:31:30.780436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.791 [2024-11-20 01:31:30.780462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.791 qpair failed and we were unable to recover it. 00:30:22.791 [2024-11-20 01:31:30.780579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.791 [2024-11-20 01:31:30.780685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.791 [2024-11-20 01:31:30.780709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.791 qpair failed and we were unable to recover it. 00:30:22.791 [2024-11-20 01:31:30.780800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.791 [2024-11-20 01:31:30.780904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.791 [2024-11-20 01:31:30.780948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.791 qpair failed and we were unable to recover it. 00:30:22.791 [2024-11-20 01:31:30.781089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.791 [2024-11-20 01:31:30.781171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.791 [2024-11-20 01:31:30.781197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.791 qpair failed and we were unable to recover it. 00:30:22.791 [2024-11-20 01:31:30.781314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.791 [2024-11-20 01:31:30.781471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.791 [2024-11-20 01:31:30.781499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.791 qpair failed and we were unable to recover it. 00:30:22.791 [2024-11-20 01:31:30.781623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.791 [2024-11-20 01:31:30.781722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.791 [2024-11-20 01:31:30.781750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.791 qpair failed and we were unable to recover it. 00:30:22.791 [2024-11-20 01:31:30.781876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.791 [2024-11-20 01:31:30.781987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.791 [2024-11-20 01:31:30.782011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.791 qpair failed and we were unable to recover it. 00:30:22.791 [2024-11-20 01:31:30.782109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.791 [2024-11-20 01:31:30.782244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.791 [2024-11-20 01:31:30.782272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.791 qpair failed and we were unable to recover it. 00:30:22.791 [2024-11-20 01:31:30.782430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.791 [2024-11-20 01:31:30.782551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.791 [2024-11-20 01:31:30.782578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.791 qpair failed and we were unable to recover it. 00:30:22.791 [2024-11-20 01:31:30.782717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.791 [2024-11-20 01:31:30.782805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.791 [2024-11-20 01:31:30.782829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.791 qpair failed and we were unable to recover it. 00:30:22.791 [2024-11-20 01:31:30.782996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.791 [2024-11-20 01:31:30.783124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.791 [2024-11-20 01:31:30.783151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.791 qpair failed and we were unable to recover it. 00:30:22.791 [2024-11-20 01:31:30.783245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.791 [2024-11-20 01:31:30.783369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.791 [2024-11-20 01:31:30.783397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.791 qpair failed and we were unable to recover it. 00:30:22.791 [2024-11-20 01:31:30.783524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.791 [2024-11-20 01:31:30.783632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.791 [2024-11-20 01:31:30.783657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.791 qpair failed and we were unable to recover it. 00:30:22.791 [2024-11-20 01:31:30.783778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.791 [2024-11-20 01:31:30.783912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.791 [2024-11-20 01:31:30.783940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.791 qpair failed and we were unable to recover it. 00:30:22.791 [2024-11-20 01:31:30.784103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.791 [2024-11-20 01:31:30.784199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.791 [2024-11-20 01:31:30.784227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.791 qpair failed and we were unable to recover it. 00:30:22.791 [2024-11-20 01:31:30.784340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.791 [2024-11-20 01:31:30.784439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.791 [2024-11-20 01:31:30.784463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.791 qpair failed and we were unable to recover it. 00:30:22.791 [2024-11-20 01:31:30.784549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.791 [2024-11-20 01:31:30.784688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.791 [2024-11-20 01:31:30.784714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.791 qpair failed and we were unable to recover it. 00:30:22.791 [2024-11-20 01:31:30.784861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.791 [2024-11-20 01:31:30.784976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.791 [2024-11-20 01:31:30.784999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.791 qpair failed and we were unable to recover it. 00:30:22.791 [2024-11-20 01:31:30.785080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.791 [2024-11-20 01:31:30.785163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.791 [2024-11-20 01:31:30.785189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.791 qpair failed and we were unable to recover it. 00:30:22.791 [2024-11-20 01:31:30.785277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.791 [2024-11-20 01:31:30.785363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.791 [2024-11-20 01:31:30.785388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.791 qpair failed and we were unable to recover it. 00:30:22.791 [2024-11-20 01:31:30.785532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.791 [2024-11-20 01:31:30.785664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.791 [2024-11-20 01:31:30.785691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.791 qpair failed and we were unable to recover it. 00:30:22.791 [2024-11-20 01:31:30.785835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.791 [2024-11-20 01:31:30.785981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.791 [2024-11-20 01:31:30.786006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.791 qpair failed and we were unable to recover it. 00:30:22.791 [2024-11-20 01:31:30.786168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.791 [2024-11-20 01:31:30.786288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.791 [2024-11-20 01:31:30.786312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.791 qpair failed and we were unable to recover it. 00:30:22.791 [2024-11-20 01:31:30.786404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.791 [2024-11-20 01:31:30.786504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.791 [2024-11-20 01:31:30.786531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.791 qpair failed and we were unable to recover it. 00:30:22.791 [2024-11-20 01:31:30.786673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.791 [2024-11-20 01:31:30.786784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.791 [2024-11-20 01:31:30.786808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.791 qpair failed and we were unable to recover it. 00:30:22.791 [2024-11-20 01:31:30.786919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.791 [2024-11-20 01:31:30.787015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.791 [2024-11-20 01:31:30.787041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.791 qpair failed and we were unable to recover it. 00:30:22.791 [2024-11-20 01:31:30.787153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.791 [2024-11-20 01:31:30.787283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.791 [2024-11-20 01:31:30.787310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.792 qpair failed and we were unable to recover it. 00:30:22.792 [2024-11-20 01:31:30.787445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.792 [2024-11-20 01:31:30.787530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.792 [2024-11-20 01:31:30.787554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.792 qpair failed and we were unable to recover it. 00:30:22.792 [2024-11-20 01:31:30.787642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.792 [2024-11-20 01:31:30.787755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.792 [2024-11-20 01:31:30.787782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.792 qpair failed and we were unable to recover it. 00:30:22.792 [2024-11-20 01:31:30.787881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.792 [2024-11-20 01:31:30.788001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.792 [2024-11-20 01:31:30.788027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.792 qpair failed and we were unable to recover it. 00:30:22.792 [2024-11-20 01:31:30.788179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.792 [2024-11-20 01:31:30.788299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.792 [2024-11-20 01:31:30.788323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.792 qpair failed and we were unable to recover it. 00:30:22.792 [2024-11-20 01:31:30.788432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.792 [2024-11-20 01:31:30.788551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.792 [2024-11-20 01:31:30.788575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.792 qpair failed and we were unable to recover it. 00:30:22.792 [2024-11-20 01:31:30.788661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.792 [2024-11-20 01:31:30.788782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.792 [2024-11-20 01:31:30.788824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.792 qpair failed and we were unable to recover it. 00:30:22.792 [2024-11-20 01:31:30.788917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.792 [2024-11-20 01:31:30.789008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.792 [2024-11-20 01:31:30.789032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.792 qpair failed and we were unable to recover it. 00:30:22.792 [2024-11-20 01:31:30.789149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.792 [2024-11-20 01:31:30.789232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.792 [2024-11-20 01:31:30.789257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.792 qpair failed and we were unable to recover it. 00:30:22.792 [2024-11-20 01:31:30.789373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.792 [2024-11-20 01:31:30.789489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.792 [2024-11-20 01:31:30.789515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.792 qpair failed and we were unable to recover it. 00:30:22.792 [2024-11-20 01:31:30.789634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.792 [2024-11-20 01:31:30.789725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.792 [2024-11-20 01:31:30.789751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.792 qpair failed and we were unable to recover it. 00:30:22.792 [2024-11-20 01:31:30.789834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.792 [2024-11-20 01:31:30.789917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.792 [2024-11-20 01:31:30.789941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.792 qpair failed and we were unable to recover it. 00:30:22.792 [2024-11-20 01:31:30.790058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.792 [2024-11-20 01:31:30.790225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.792 [2024-11-20 01:31:30.790251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.792 qpair failed and we were unable to recover it. 00:30:22.792 [2024-11-20 01:31:30.790371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.792 [2024-11-20 01:31:30.790510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.792 [2024-11-20 01:31:30.790535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.792 qpair failed and we were unable to recover it. 00:30:22.792 [2024-11-20 01:31:30.790715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.792 [2024-11-20 01:31:30.790801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.792 [2024-11-20 01:31:30.790825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.792 qpair failed and we were unable to recover it. 00:30:22.792 [2024-11-20 01:31:30.790943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.792 [2024-11-20 01:31:30.791090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.792 [2024-11-20 01:31:30.791135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.792 qpair failed and we were unable to recover it. 00:30:22.792 [2024-11-20 01:31:30.791282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.792 [2024-11-20 01:31:30.791424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.792 [2024-11-20 01:31:30.791464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.792 qpair failed and we were unable to recover it. 00:30:22.792 [2024-11-20 01:31:30.791620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.792 [2024-11-20 01:31:30.791736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.792 [2024-11-20 01:31:30.791762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.792 qpair failed and we were unable to recover it. 00:30:22.792 [2024-11-20 01:31:30.791860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.792 [2024-11-20 01:31:30.791967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.792 [2024-11-20 01:31:30.791991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.792 qpair failed and we were unable to recover it. 00:30:22.792 [2024-11-20 01:31:30.792108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.792 [2024-11-20 01:31:30.792198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.792 [2024-11-20 01:31:30.792222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.792 qpair failed and we were unable to recover it. 00:30:22.792 [2024-11-20 01:31:30.792332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.792 [2024-11-20 01:31:30.792428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.792 [2024-11-20 01:31:30.792454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.792 qpair failed and we were unable to recover it. 00:30:22.792 [2024-11-20 01:31:30.792581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.792 [2024-11-20 01:31:30.792696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.792 [2024-11-20 01:31:30.792722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.792 qpair failed and we were unable to recover it. 00:30:22.792 [2024-11-20 01:31:30.792839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.792 [2024-11-20 01:31:30.792929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.792 [2024-11-20 01:31:30.792953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.792 qpair failed and we were unable to recover it. 00:30:22.792 [2024-11-20 01:31:30.793078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.792 [2024-11-20 01:31:30.793216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.792 [2024-11-20 01:31:30.793242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.792 qpair failed and we were unable to recover it. 00:30:22.792 [2024-11-20 01:31:30.793326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.792 [2024-11-20 01:31:30.793462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.792 [2024-11-20 01:31:30.793487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.792 qpair failed and we were unable to recover it. 00:30:22.792 [2024-11-20 01:31:30.793630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.792 [2024-11-20 01:31:30.793779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.792 [2024-11-20 01:31:30.793819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.792 qpair failed and we were unable to recover it. 00:30:22.792 [2024-11-20 01:31:30.793964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.792 [2024-11-20 01:31:30.794050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.792 [2024-11-20 01:31:30.794084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.792 qpair failed and we were unable to recover it. 00:30:22.792 [2024-11-20 01:31:30.794226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.792 [2024-11-20 01:31:30.794332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.792 [2024-11-20 01:31:30.794359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.792 qpair failed and we were unable to recover it. 00:30:22.792 [2024-11-20 01:31:30.794531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.792 [2024-11-20 01:31:30.794623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.792 [2024-11-20 01:31:30.794648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.792 qpair failed and we were unable to recover it. 00:30:22.793 [2024-11-20 01:31:30.794759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.793 [2024-11-20 01:31:30.794911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.793 [2024-11-20 01:31:30.794940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.793 qpair failed and we were unable to recover it. 00:30:22.793 [2024-11-20 01:31:30.795059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.793 [2024-11-20 01:31:30.795172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.793 [2024-11-20 01:31:30.795199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.793 qpair failed and we were unable to recover it. 00:30:22.793 [2024-11-20 01:31:30.795370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.793 [2024-11-20 01:31:30.795489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.793 [2024-11-20 01:31:30.795514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.793 qpair failed and we were unable to recover it. 00:30:22.793 [2024-11-20 01:31:30.795643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.793 [2024-11-20 01:31:30.795749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.793 [2024-11-20 01:31:30.795776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.793 qpair failed and we were unable to recover it. 00:30:22.793 [2024-11-20 01:31:30.795893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.793 [2024-11-20 01:31:30.796023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.793 [2024-11-20 01:31:30.796051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.793 qpair failed and we were unable to recover it. 00:30:22.793 [2024-11-20 01:31:30.796198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.793 [2024-11-20 01:31:30.796291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.793 [2024-11-20 01:31:30.796315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.793 qpair failed and we were unable to recover it. 00:30:22.793 [2024-11-20 01:31:30.796429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.793 [2024-11-20 01:31:30.796570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.793 [2024-11-20 01:31:30.796596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.793 qpair failed and we were unable to recover it. 00:30:22.793 [2024-11-20 01:31:30.796719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.793 [2024-11-20 01:31:30.796817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.793 [2024-11-20 01:31:30.796844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.793 qpair failed and we were unable to recover it. 00:30:22.793 [2024-11-20 01:31:30.796981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.793 [2024-11-20 01:31:30.797088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.793 [2024-11-20 01:31:30.797118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.793 qpair failed and we were unable to recover it. 00:30:22.793 [2024-11-20 01:31:30.797246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.793 [2024-11-20 01:31:30.797345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.793 [2024-11-20 01:31:30.797373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.793 qpair failed and we were unable to recover it. 00:30:22.793 [2024-11-20 01:31:30.797496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.793 [2024-11-20 01:31:30.797625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.793 [2024-11-20 01:31:30.797652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.793 qpair failed and we were unable to recover it. 00:30:22.793 [2024-11-20 01:31:30.797765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.793 [2024-11-20 01:31:30.797853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.793 [2024-11-20 01:31:30.797879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.793 qpair failed and we were unable to recover it. 00:30:22.793 [2024-11-20 01:31:30.797993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.793 [2024-11-20 01:31:30.798161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.793 [2024-11-20 01:31:30.798189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.793 qpair failed and we were unable to recover it. 00:30:22.793 [2024-11-20 01:31:30.798290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.793 [2024-11-20 01:31:30.798452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.793 [2024-11-20 01:31:30.798479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.793 qpair failed and we were unable to recover it. 00:30:22.793 [2024-11-20 01:31:30.798595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.793 [2024-11-20 01:31:30.798710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.793 [2024-11-20 01:31:30.798735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.793 qpair failed and we were unable to recover it. 00:30:22.793 [2024-11-20 01:31:30.798880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.793 [2024-11-20 01:31:30.799006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.793 [2024-11-20 01:31:30.799032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.793 qpair failed and we were unable to recover it. 00:30:22.793 [2024-11-20 01:31:30.799172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.793 [2024-11-20 01:31:30.799272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.793 [2024-11-20 01:31:30.799305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.793 qpair failed and we were unable to recover it. 00:30:22.793 [2024-11-20 01:31:30.799466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.793 [2024-11-20 01:31:30.799592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.793 [2024-11-20 01:31:30.799633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.793 qpair failed and we were unable to recover it. 00:30:22.793 [2024-11-20 01:31:30.799773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.793 [2024-11-20 01:31:30.799863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.793 [2024-11-20 01:31:30.799888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.793 qpair failed and we were unable to recover it. 00:30:22.793 [2024-11-20 01:31:30.799977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.793 [2024-11-20 01:31:30.800134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.793 [2024-11-20 01:31:30.800160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.793 qpair failed and we were unable to recover it. 00:30:22.793 [2024-11-20 01:31:30.800280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.793 [2024-11-20 01:31:30.800373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.793 [2024-11-20 01:31:30.800398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.793 qpair failed and we were unable to recover it. 00:30:22.793 [2024-11-20 01:31:30.800498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.793 [2024-11-20 01:31:30.800595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.793 [2024-11-20 01:31:30.800622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.793 qpair failed and we were unable to recover it. 00:30:22.793 [2024-11-20 01:31:30.800756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.793 [2024-11-20 01:31:30.800918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.793 [2024-11-20 01:31:30.800959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.793 qpair failed and we were unable to recover it. 00:30:22.793 [2024-11-20 01:31:30.801118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.793 [2024-11-20 01:31:30.801234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.793 [2024-11-20 01:31:30.801260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.793 qpair failed and we were unable to recover it. 00:30:22.793 [2024-11-20 01:31:30.801352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.801443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.801467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.794 qpair failed and we were unable to recover it. 00:30:22.794 [2024-11-20 01:31:30.801585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.801706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.801733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.794 qpair failed and we were unable to recover it. 00:30:22.794 [2024-11-20 01:31:30.801842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.801933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.801962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.794 qpair failed and we were unable to recover it. 00:30:22.794 [2024-11-20 01:31:30.802057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.802182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.802206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.794 qpair failed and we were unable to recover it. 00:30:22.794 [2024-11-20 01:31:30.802316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.802426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.802452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.794 qpair failed and we were unable to recover it. 00:30:22.794 [2024-11-20 01:31:30.802565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.802651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.802676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.794 qpair failed and we were unable to recover it. 00:30:22.794 [2024-11-20 01:31:30.802757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.802880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.802908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.794 qpair failed and we were unable to recover it. 00:30:22.794 [2024-11-20 01:31:30.803007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.803131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.803159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.794 qpair failed and we were unable to recover it. 00:30:22.794 [2024-11-20 01:31:30.803279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.803365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.803390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.794 qpair failed and we were unable to recover it. 00:30:22.794 [2024-11-20 01:31:30.803482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.803595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.803621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.794 qpair failed and we were unable to recover it. 00:30:22.794 [2024-11-20 01:31:30.803758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.803897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.803921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.794 qpair failed and we were unable to recover it. 00:30:22.794 [2024-11-20 01:31:30.804041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.804162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.804186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.794 qpair failed and we were unable to recover it. 00:30:22.794 [2024-11-20 01:31:30.804332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.804429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.804462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.794 qpair failed and we were unable to recover it. 00:30:22.794 [2024-11-20 01:31:30.804586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.804717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.804742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.794 qpair failed and we were unable to recover it. 00:30:22.794 [2024-11-20 01:31:30.804865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.804974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.804999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.794 qpair failed and we were unable to recover it. 00:30:22.794 [2024-11-20 01:31:30.805121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.805224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.805252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.794 qpair failed and we were unable to recover it. 00:30:22.794 [2024-11-20 01:31:30.805388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.805468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.805491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.794 qpair failed and we were unable to recover it. 00:30:22.794 [2024-11-20 01:31:30.805573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.805685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.805709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.794 qpair failed and we were unable to recover it. 00:30:22.794 [2024-11-20 01:31:30.805837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.805945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.805971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.794 qpair failed and we were unable to recover it. 00:30:22.794 [2024-11-20 01:31:30.806095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.806200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.806224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.794 qpair failed and we were unable to recover it. 00:30:22.794 [2024-11-20 01:31:30.806339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.806424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.806449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.794 qpair failed and we were unable to recover it. 00:30:22.794 [2024-11-20 01:31:30.806587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.806742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.806769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.794 qpair failed and we were unable to recover it. 00:30:22.794 [2024-11-20 01:31:30.806860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.806944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.806975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.794 qpair failed and we were unable to recover it. 00:30:22.794 [2024-11-20 01:31:30.807115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.807204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.807228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.794 qpair failed and we were unable to recover it. 00:30:22.794 [2024-11-20 01:31:30.807318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.807436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.807459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.794 qpair failed and we were unable to recover it. 00:30:22.794 [2024-11-20 01:31:30.807577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.807668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.807692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.794 qpair failed and we were unable to recover it. 00:30:22.794 [2024-11-20 01:31:30.807779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.807921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.807945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.794 qpair failed and we were unable to recover it. 00:30:22.794 [2024-11-20 01:31:30.808082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.808219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.808243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.794 qpair failed and we were unable to recover it. 00:30:22.794 [2024-11-20 01:31:30.808373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.808498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.808525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.794 qpair failed and we were unable to recover it. 00:30:22.794 [2024-11-20 01:31:30.808685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.808772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.794 [2024-11-20 01:31:30.808795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.794 qpair failed and we were unable to recover it. 00:30:22.795 [2024-11-20 01:31:30.808909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.809032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.809099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.795 qpair failed and we were unable to recover it. 00:30:22.795 [2024-11-20 01:31:30.809197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.809316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.809341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.795 qpair failed and we were unable to recover it. 00:30:22.795 [2024-11-20 01:31:30.809464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.809554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.809580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.795 qpair failed and we were unable to recover it. 00:30:22.795 [2024-11-20 01:31:30.809731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.809824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.809852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.795 qpair failed and we were unable to recover it. 00:30:22.795 [2024-11-20 01:31:30.810018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.810133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.810157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.795 qpair failed and we were unable to recover it. 00:30:22.795 [2024-11-20 01:31:30.810243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.810361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.810385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.795 qpair failed and we were unable to recover it. 00:30:22.795 [2024-11-20 01:31:30.810482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.810577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.810603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.795 qpair failed and we were unable to recover it. 00:30:22.795 [2024-11-20 01:31:30.810701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.810820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.810846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.795 qpair failed and we were unable to recover it. 00:30:22.795 [2024-11-20 01:31:30.810987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.811066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.811099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.795 qpair failed and we were unable to recover it. 00:30:22.795 [2024-11-20 01:31:30.811193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.811282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.811307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.795 qpair failed and we were unable to recover it. 00:30:22.795 [2024-11-20 01:31:30.811403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.811521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.811545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.795 qpair failed and we were unable to recover it. 00:30:22.795 [2024-11-20 01:31:30.811669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.811758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.811783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.795 qpair failed and we were unable to recover it. 00:30:22.795 [2024-11-20 01:31:30.811908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.812033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.812060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.795 qpair failed and we were unable to recover it. 00:30:22.795 [2024-11-20 01:31:30.812189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.812272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.812299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.795 qpair failed and we were unable to recover it. 00:30:22.795 [2024-11-20 01:31:30.812410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.812525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.812549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.795 qpair failed and we were unable to recover it. 00:30:22.795 [2024-11-20 01:31:30.812665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.812761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.812788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.795 qpair failed and we were unable to recover it. 00:30:22.795 [2024-11-20 01:31:30.812892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.813021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.813047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.795 qpair failed and we were unable to recover it. 00:30:22.795 [2024-11-20 01:31:30.813220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.813375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.813400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.795 qpair failed and we were unable to recover it. 00:30:22.795 [2024-11-20 01:31:30.813512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.813621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.813649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.795 qpair failed and we were unable to recover it. 00:30:22.795 [2024-11-20 01:31:30.813755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.813878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.813906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.795 qpair failed and we were unable to recover it. 00:30:22.795 [2024-11-20 01:31:30.814080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.814207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.814231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.795 qpair failed and we were unable to recover it. 00:30:22.795 [2024-11-20 01:31:30.814350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.814457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.814500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.795 qpair failed and we were unable to recover it. 00:30:22.795 [2024-11-20 01:31:30.814634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.814747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.814773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.795 qpair failed and we were unable to recover it. 00:30:22.795 [2024-11-20 01:31:30.814899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.814984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.815008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.795 qpair failed and we were unable to recover it. 00:30:22.795 [2024-11-20 01:31:30.815100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.815214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.815255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.795 qpair failed and we were unable to recover it. 00:30:22.795 [2024-11-20 01:31:30.815339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.815428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.815456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.795 qpair failed and we were unable to recover it. 00:30:22.795 [2024-11-20 01:31:30.815558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.815683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.815708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.795 qpair failed and we were unable to recover it. 00:30:22.795 [2024-11-20 01:31:30.815828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.815912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.815937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.795 qpair failed and we were unable to recover it. 00:30:22.795 [2024-11-20 01:31:30.816056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.816200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.816227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.795 qpair failed and we were unable to recover it. 00:30:22.795 [2024-11-20 01:31:30.816349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.816478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.816502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.795 qpair failed and we were unable to recover it. 00:30:22.795 [2024-11-20 01:31:30.816617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.795 [2024-11-20 01:31:30.816730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.816755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.796 qpair failed and we were unable to recover it. 00:30:22.796 [2024-11-20 01:31:30.816862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.816955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.816982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.796 qpair failed and we were unable to recover it. 00:30:22.796 [2024-11-20 01:31:30.817122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.817241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.817266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.796 qpair failed and we were unable to recover it. 00:30:22.796 [2024-11-20 01:31:30.817382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.817520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.817545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.796 qpair failed and we were unable to recover it. 00:30:22.796 [2024-11-20 01:31:30.817682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.817777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.817804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.796 qpair failed and we were unable to recover it. 00:30:22.796 [2024-11-20 01:31:30.817911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.818057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.818090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.796 qpair failed and we were unable to recover it. 00:30:22.796 [2024-11-20 01:31:30.818196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.818278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.818302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.796 qpair failed and we were unable to recover it. 00:30:22.796 [2024-11-20 01:31:30.818391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.818480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.818504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.796 qpair failed and we were unable to recover it. 00:30:22.796 [2024-11-20 01:31:30.818620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.818730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.818753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.796 qpair failed and we were unable to recover it. 00:30:22.796 [2024-11-20 01:31:30.818868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.818974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.819001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.796 qpair failed and we were unable to recover it. 00:30:22.796 [2024-11-20 01:31:30.819144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.819231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.819256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.796 qpair failed and we were unable to recover it. 00:30:22.796 [2024-11-20 01:31:30.819372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.819462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.819487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.796 qpair failed and we were unable to recover it. 00:30:22.796 [2024-11-20 01:31:30.819601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.819690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.819715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.796 qpair failed and we were unable to recover it. 00:30:22.796 [2024-11-20 01:31:30.819839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.819917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.819941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.796 qpair failed and we were unable to recover it. 00:30:22.796 [2024-11-20 01:31:30.820032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.820170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.820196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.796 qpair failed and we were unable to recover it. 00:30:22.796 [2024-11-20 01:31:30.820300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.820429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.820458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.796 qpair failed and we were unable to recover it. 00:30:22.796 [2024-11-20 01:31:30.820597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.820683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.820708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.796 qpair failed and we were unable to recover it. 00:30:22.796 [2024-11-20 01:31:30.820792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.820907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.820932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.796 qpair failed and we were unable to recover it. 00:30:22.796 [2024-11-20 01:31:30.821045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.821181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.821207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.796 qpair failed and we were unable to recover it. 00:30:22.796 [2024-11-20 01:31:30.821295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.821443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.821468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.796 qpair failed and we were unable to recover it. 00:30:22.796 [2024-11-20 01:31:30.821584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.821729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.821754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.796 qpair failed and we were unable to recover it. 00:30:22.796 [2024-11-20 01:31:30.821870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.822001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.822029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.796 qpair failed and we were unable to recover it. 00:30:22.796 [2024-11-20 01:31:30.822165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.822321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.822349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.796 qpair failed and we were unable to recover it. 00:30:22.796 [2024-11-20 01:31:30.822490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.822606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.822631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.796 qpair failed and we were unable to recover it. 00:30:22.796 [2024-11-20 01:31:30.822731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.822846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.822871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.796 qpair failed and we were unable to recover it. 00:30:22.796 [2024-11-20 01:31:30.823006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.823113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.823141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.796 qpair failed and we were unable to recover it. 00:30:22.796 [2024-11-20 01:31:30.823284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.823373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.823398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.796 qpair failed and we were unable to recover it. 00:30:22.796 [2024-11-20 01:31:30.823498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.823619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.823646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.796 qpair failed and we were unable to recover it. 00:30:22.796 [2024-11-20 01:31:30.823743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.823882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.823907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.796 qpair failed and we were unable to recover it. 00:30:22.796 [2024-11-20 01:31:30.824025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.824111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.824138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.796 qpair failed and we were unable to recover it. 00:30:22.796 [2024-11-20 01:31:30.824255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.824335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.824359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.796 qpair failed and we were unable to recover it. 00:30:22.796 [2024-11-20 01:31:30.824473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.796 [2024-11-20 01:31:30.824582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.797 [2024-11-20 01:31:30.824606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.797 qpair failed and we were unable to recover it. 00:30:22.797 [2024-11-20 01:31:30.824690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.797 [2024-11-20 01:31:30.824799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.797 [2024-11-20 01:31:30.824823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.797 qpair failed and we were unable to recover it. 00:30:22.797 [2024-11-20 01:31:30.824918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.797 [2024-11-20 01:31:30.825036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.797 [2024-11-20 01:31:30.825061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.797 qpair failed and we were unable to recover it. 00:30:22.797 [2024-11-20 01:31:30.825177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.797 [2024-11-20 01:31:30.825333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.797 [2024-11-20 01:31:30.825358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.797 qpair failed and we were unable to recover it. 00:30:22.797 [2024-11-20 01:31:30.825453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.797 [2024-11-20 01:31:30.825543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.797 [2024-11-20 01:31:30.825567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.797 qpair failed and we were unable to recover it. 00:30:22.797 [2024-11-20 01:31:30.825657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.797 [2024-11-20 01:31:30.825783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.797 [2024-11-20 01:31:30.825807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.797 qpair failed and we were unable to recover it. 00:30:22.797 [2024-11-20 01:31:30.825893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.797 [2024-11-20 01:31:30.825997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.797 [2024-11-20 01:31:30.826024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.797 qpair failed and we were unable to recover it. 00:30:22.797 [2024-11-20 01:31:30.826142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.797 [2024-11-20 01:31:30.826282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.797 [2024-11-20 01:31:30.826306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.797 qpair failed and we were unable to recover it. 00:30:22.797 [2024-11-20 01:31:30.826416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.797 [2024-11-20 01:31:30.826545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.797 [2024-11-20 01:31:30.826572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.797 qpair failed and we were unable to recover it. 00:30:22.797 [2024-11-20 01:31:30.826676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.797 [2024-11-20 01:31:30.826768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.797 [2024-11-20 01:31:30.826795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.797 qpair failed and we were unable to recover it. 00:30:22.797 [2024-11-20 01:31:30.826908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.797 [2024-11-20 01:31:30.827002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.797 [2024-11-20 01:31:30.827041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.797 qpair failed and we were unable to recover it. 00:30:22.797 [2024-11-20 01:31:30.827165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.797 [2024-11-20 01:31:30.827281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.797 [2024-11-20 01:31:30.827306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.797 qpair failed and we were unable to recover it. 00:30:22.797 [2024-11-20 01:31:30.827427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.797 [2024-11-20 01:31:30.827584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.797 [2024-11-20 01:31:30.827611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.797 qpair failed and we were unable to recover it. 00:30:22.797 [2024-11-20 01:31:30.827753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.797 [2024-11-20 01:31:30.827870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.797 [2024-11-20 01:31:30.827895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.797 qpair failed and we were unable to recover it. 00:30:22.797 [2024-11-20 01:31:30.828016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.797 [2024-11-20 01:31:30.828136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.797 [2024-11-20 01:31:30.828164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.797 qpair failed and we were unable to recover it. 00:30:22.797 [2024-11-20 01:31:30.828263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.797 [2024-11-20 01:31:30.828385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.797 [2024-11-20 01:31:30.828413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.797 qpair failed and we were unable to recover it. 00:30:22.797 [2024-11-20 01:31:30.828532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.797 [2024-11-20 01:31:30.828671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.797 [2024-11-20 01:31:30.828694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.797 qpair failed and we were unable to recover it. 00:30:22.797 [2024-11-20 01:31:30.828782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.797 [2024-11-20 01:31:30.828887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.797 [2024-11-20 01:31:30.828915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.797 qpair failed and we were unable to recover it. 00:30:22.797 [2024-11-20 01:31:30.829055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.797 [2024-11-20 01:31:30.829183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.797 [2024-11-20 01:31:30.829208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.797 qpair failed and we were unable to recover it. 00:30:22.797 [2024-11-20 01:31:30.829329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.797 [2024-11-20 01:31:30.829444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.797 [2024-11-20 01:31:30.829468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.797 qpair failed and we were unable to recover it. 00:30:22.797 [2024-11-20 01:31:30.829632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.797 [2024-11-20 01:31:30.829762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.797 [2024-11-20 01:31:30.829789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.797 qpair failed and we were unable to recover it. 00:30:22.797 [2024-11-20 01:31:30.829942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.797 [2024-11-20 01:31:30.830064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.797 [2024-11-20 01:31:30.830114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.797 qpair failed and we were unable to recover it. 00:30:22.797 [2024-11-20 01:31:30.830235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.797 [2024-11-20 01:31:30.830349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.797 [2024-11-20 01:31:30.830374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.797 qpair failed and we were unable to recover it. 00:30:22.797 [2024-11-20 01:31:30.830520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.797 [2024-11-20 01:31:30.830644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.797 [2024-11-20 01:31:30.830672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.797 qpair failed and we were unable to recover it. 00:30:22.797 [2024-11-20 01:31:30.830797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.797 [2024-11-20 01:31:30.830926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.797 [2024-11-20 01:31:30.830953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.797 qpair failed and we were unable to recover it. 00:30:22.797 [2024-11-20 01:31:30.831056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.797 [2024-11-20 01:31:30.831179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.797 [2024-11-20 01:31:30.831204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.797 qpair failed and we were unable to recover it. 00:30:22.797 [2024-11-20 01:31:30.831333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.797 [2024-11-20 01:31:30.831467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.797 [2024-11-20 01:31:30.831492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.797 qpair failed and we were unable to recover it. 00:30:22.797 [2024-11-20 01:31:30.831630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.797 [2024-11-20 01:31:30.831733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.797 [2024-11-20 01:31:30.831760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.797 qpair failed and we were unable to recover it. 00:30:22.798 [2024-11-20 01:31:30.831876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.831966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.831989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.798 qpair failed and we were unable to recover it. 00:30:22.798 [2024-11-20 01:31:30.832098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.832250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.832276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.798 qpair failed and we were unable to recover it. 00:30:22.798 [2024-11-20 01:31:30.832368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.832477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.832502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.798 qpair failed and we were unable to recover it. 00:30:22.798 [2024-11-20 01:31:30.832623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.832735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.832761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.798 qpair failed and we were unable to recover it. 00:30:22.798 [2024-11-20 01:31:30.832885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.832987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.833016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.798 qpair failed and we were unable to recover it. 00:30:22.798 [2024-11-20 01:31:30.833170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.833281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.833304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.798 qpair failed and we were unable to recover it. 00:30:22.798 [2024-11-20 01:31:30.833421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.833538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.833563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.798 qpair failed and we were unable to recover it. 00:30:22.798 [2024-11-20 01:31:30.833676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.833798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.833825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.798 qpair failed and we were unable to recover it. 00:30:22.798 [2024-11-20 01:31:30.833924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.834066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.834098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.798 qpair failed and we were unable to recover it. 00:30:22.798 [2024-11-20 01:31:30.834185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.834275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.834300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.798 qpair failed and we were unable to recover it. 00:30:22.798 [2024-11-20 01:31:30.834428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.834592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.834619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.798 qpair failed and we were unable to recover it. 00:30:22.798 [2024-11-20 01:31:30.834763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.834874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.834898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.798 qpair failed and we were unable to recover it. 00:30:22.798 [2024-11-20 01:31:30.835018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.835166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.835191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.798 qpair failed and we were unable to recover it. 00:30:22.798 [2024-11-20 01:31:30.835312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.835406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.835432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.798 qpair failed and we were unable to recover it. 00:30:22.798 [2024-11-20 01:31:30.835585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.835685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.835713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.798 qpair failed and we were unable to recover it. 00:30:22.798 [2024-11-20 01:31:30.835849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.835930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.835955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.798 qpair failed and we were unable to recover it. 00:30:22.798 [2024-11-20 01:31:30.836120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.836227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.836254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.798 qpair failed and we were unable to recover it. 00:30:22.798 [2024-11-20 01:31:30.836358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.836449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.836476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.798 qpair failed and we were unable to recover it. 00:30:22.798 [2024-11-20 01:31:30.836618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.836737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.836760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.798 qpair failed and we were unable to recover it. 00:30:22.798 [2024-11-20 01:31:30.836897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.837035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.837060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.798 qpair failed and we were unable to recover it. 00:30:22.798 [2024-11-20 01:31:30.837218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.837331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.837359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.798 qpair failed and we were unable to recover it. 00:30:22.798 [2024-11-20 01:31:30.837497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.837579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.837603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.798 qpair failed and we were unable to recover it. 00:30:22.798 [2024-11-20 01:31:30.837697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.837834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.837862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.798 qpair failed and we were unable to recover it. 00:30:22.798 [2024-11-20 01:31:30.837961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.838056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.838091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.798 qpair failed and we were unable to recover it. 00:30:22.798 [2024-11-20 01:31:30.838226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.838322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.838347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.798 qpair failed and we were unable to recover it. 00:30:22.798 [2024-11-20 01:31:30.838486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.838579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.838603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.798 qpair failed and we were unable to recover it. 00:30:22.798 [2024-11-20 01:31:30.838693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.838813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.838839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.798 qpair failed and we were unable to recover it. 00:30:22.798 [2024-11-20 01:31:30.838984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.839128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.839171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.798 qpair failed and we were unable to recover it. 00:30:22.798 [2024-11-20 01:31:30.839276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.839437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.839462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.798 qpair failed and we were unable to recover it. 00:30:22.798 [2024-11-20 01:31:30.839549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.839653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.839676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.798 qpair failed and we were unable to recover it. 00:30:22.798 [2024-11-20 01:31:30.839771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.798 [2024-11-20 01:31:30.839889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.839913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.799 qpair failed and we were unable to recover it. 00:30:22.799 [2024-11-20 01:31:30.840039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.840143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.840174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.799 qpair failed and we were unable to recover it. 00:30:22.799 [2024-11-20 01:31:30.840304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.840397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.840423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.799 qpair failed and we were unable to recover it. 00:30:22.799 [2024-11-20 01:31:30.840564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.840649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.840673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.799 qpair failed and we were unable to recover it. 00:30:22.799 [2024-11-20 01:31:30.840767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.840857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.840886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.799 qpair failed and we were unable to recover it. 00:30:22.799 [2024-11-20 01:31:30.841023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.841117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.841161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.799 qpair failed and we were unable to recover it. 00:30:22.799 [2024-11-20 01:31:30.841261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.841353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.841378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.799 qpair failed and we were unable to recover it. 00:30:22.799 [2024-11-20 01:31:30.841489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.841617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.841644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.799 qpair failed and we were unable to recover it. 00:30:22.799 [2024-11-20 01:31:30.841746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.841874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.841902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.799 qpair failed and we were unable to recover it. 00:30:22.799 [2024-11-20 01:31:30.842037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.842126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.842150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.799 qpair failed and we were unable to recover it. 00:30:22.799 [2024-11-20 01:31:30.842262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.842387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.842416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.799 qpair failed and we were unable to recover it. 00:30:22.799 [2024-11-20 01:31:30.842559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.842685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.842727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.799 qpair failed and we were unable to recover it. 00:30:22.799 [2024-11-20 01:31:30.842845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.842937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.842961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.799 qpair failed and we were unable to recover it. 00:30:22.799 [2024-11-20 01:31:30.843053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.843148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.843174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.799 qpair failed and we were unable to recover it. 00:30:22.799 [2024-11-20 01:31:30.843291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.843401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.843431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.799 qpair failed and we were unable to recover it. 00:30:22.799 [2024-11-20 01:31:30.843520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.843606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.843630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.799 qpair failed and we were unable to recover it. 00:30:22.799 [2024-11-20 01:31:30.843782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.843875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.843901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.799 qpair failed and we were unable to recover it. 00:30:22.799 [2024-11-20 01:31:30.844044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.844161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.844186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.799 qpair failed and we were unable to recover it. 00:30:22.799 [2024-11-20 01:31:30.844305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.844391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.844414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.799 qpair failed and we were unable to recover it. 00:30:22.799 [2024-11-20 01:31:30.844560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.844675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.844700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.799 qpair failed and we were unable to recover it. 00:30:22.799 [2024-11-20 01:31:30.844829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.844970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.844994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.799 qpair failed and we were unable to recover it. 00:30:22.799 [2024-11-20 01:31:30.849240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.849408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.849453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.799 qpair failed and we were unable to recover it. 00:30:22.799 [2024-11-20 01:31:30.849618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.849742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.849769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.799 qpair failed and we were unable to recover it. 00:30:22.799 [2024-11-20 01:31:30.849896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.850059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.850093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.799 qpair failed and we were unable to recover it. 00:30:22.799 [2024-11-20 01:31:30.850183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.850326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.850355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.799 qpair failed and we were unable to recover it. 00:30:22.799 [2024-11-20 01:31:30.850471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.850605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.850632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.799 qpair failed and we were unable to recover it. 00:30:22.799 [2024-11-20 01:31:30.850728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.850839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.850866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.799 qpair failed and we were unable to recover it. 00:30:22.799 [2024-11-20 01:31:30.850976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.851067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.851099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.799 qpair failed and we were unable to recover it. 00:30:22.799 [2024-11-20 01:31:30.851186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.851320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.851346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.799 qpair failed and we were unable to recover it. 00:30:22.799 [2024-11-20 01:31:30.851505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.851638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.851665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.799 qpair failed and we were unable to recover it. 00:30:22.799 [2024-11-20 01:31:30.851786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.851888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.851928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.799 qpair failed and we were unable to recover it. 00:30:22.799 [2024-11-20 01:31:30.852047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.852167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.852192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.799 qpair failed and we were unable to recover it. 00:30:22.799 [2024-11-20 01:31:30.852285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.852393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.799 [2024-11-20 01:31:30.852437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.799 qpair failed and we were unable to recover it. 00:30:22.799 [2024-11-20 01:31:30.852557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.852647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.852671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.800 qpair failed and we were unable to recover it. 00:30:22.800 [2024-11-20 01:31:30.852807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.852943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.852979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.800 qpair failed and we were unable to recover it. 00:30:22.800 [2024-11-20 01:31:30.853104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.853223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.853247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.800 qpair failed and we were unable to recover it. 00:30:22.800 [2024-11-20 01:31:30.853363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.853453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.853479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.800 qpair failed and we were unable to recover it. 00:30:22.800 [2024-11-20 01:31:30.853619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.853751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.853778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.800 qpair failed and we were unable to recover it. 00:30:22.800 [2024-11-20 01:31:30.853883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.853988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.854014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.800 qpair failed and we were unable to recover it. 00:30:22.800 [2024-11-20 01:31:30.854159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.854268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.854292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.800 qpair failed and we were unable to recover it. 00:30:22.800 [2024-11-20 01:31:30.854379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.854493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.854517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.800 qpair failed and we were unable to recover it. 00:30:22.800 [2024-11-20 01:31:30.854677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.854769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.854794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.800 qpair failed and we were unable to recover it. 00:30:22.800 [2024-11-20 01:31:30.854929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.855080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.855122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.800 qpair failed and we were unable to recover it. 00:30:22.800 [2024-11-20 01:31:30.855242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.855336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.855361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.800 qpair failed and we were unable to recover it. 00:30:22.800 [2024-11-20 01:31:30.855478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.855605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.855633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.800 qpair failed and we were unable to recover it. 00:30:22.800 [2024-11-20 01:31:30.855754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.855914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.855942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.800 qpair failed and we were unable to recover it. 00:30:22.800 [2024-11-20 01:31:30.856076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.856201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.856228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.800 qpair failed and we were unable to recover it. 00:30:22.800 [2024-11-20 01:31:30.856328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.856410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.856436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.800 qpair failed and we were unable to recover it. 00:30:22.800 [2024-11-20 01:31:30.856591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.856713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.856740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.800 qpair failed and we were unable to recover it. 00:30:22.800 [2024-11-20 01:31:30.856843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.856929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.856953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.800 qpair failed and we were unable to recover it. 00:30:22.800 [2024-11-20 01:31:30.857063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.857213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.857238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.800 qpair failed and we were unable to recover it. 00:30:22.800 [2024-11-20 01:31:30.857337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.857452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.857477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.800 qpair failed and we were unable to recover it. 00:30:22.800 [2024-11-20 01:31:30.857615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.857746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.857773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.800 qpair failed and we were unable to recover it. 00:30:22.800 [2024-11-20 01:31:30.857870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.858014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.858039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.800 qpair failed and we were unable to recover it. 00:30:22.800 [2024-11-20 01:31:30.858143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.858256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.858280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.800 qpair failed and we were unable to recover it. 00:30:22.800 [2024-11-20 01:31:30.858401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.858521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.858545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.800 qpair failed and we were unable to recover it. 00:30:22.800 [2024-11-20 01:31:30.858678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.858774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.858801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.800 qpair failed and we were unable to recover it. 00:30:22.800 [2024-11-20 01:31:30.858910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.858994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.859018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.800 qpair failed and we were unable to recover it. 00:30:22.800 [2024-11-20 01:31:30.859146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.859239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.859264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.800 qpair failed and we were unable to recover it. 00:30:22.800 [2024-11-20 01:31:30.859384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.859497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.859521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.800 qpair failed and we were unable to recover it. 00:30:22.800 [2024-11-20 01:31:30.859641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.859785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.859808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.800 qpair failed and we were unable to recover it. 00:30:22.800 [2024-11-20 01:31:30.859980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.860081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.860109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.800 qpair failed and we were unable to recover it. 00:30:22.800 [2024-11-20 01:31:30.860249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.860338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.860362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.800 qpair failed and we were unable to recover it. 00:30:22.800 [2024-11-20 01:31:30.860473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.860566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.860592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.800 qpair failed and we were unable to recover it. 00:30:22.800 [2024-11-20 01:31:30.860681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.860792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.860833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.800 qpair failed and we were unable to recover it. 00:30:22.800 [2024-11-20 01:31:30.860959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.861090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.800 [2024-11-20 01:31:30.861115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.800 qpair failed and we were unable to recover it. 00:30:22.800 [2024-11-20 01:31:30.861209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.801 [2024-11-20 01:31:30.861310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.801 [2024-11-20 01:31:30.861335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.801 qpair failed and we were unable to recover it. 00:30:22.801 [2024-11-20 01:31:30.861475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.801 [2024-11-20 01:31:30.861570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.801 [2024-11-20 01:31:30.861598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.801 qpair failed and we were unable to recover it. 00:30:22.801 [2024-11-20 01:31:30.861696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.801 [2024-11-20 01:31:30.861820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.801 [2024-11-20 01:31:30.861848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.801 qpair failed and we were unable to recover it. 00:30:22.801 [2024-11-20 01:31:30.861989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.801 [2024-11-20 01:31:30.862081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.801 [2024-11-20 01:31:30.862107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.801 qpair failed and we were unable to recover it. 00:30:22.801 [2024-11-20 01:31:30.862195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.801 [2024-11-20 01:31:30.862309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.801 [2024-11-20 01:31:30.862334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.801 qpair failed and we were unable to recover it. 00:30:22.801 [2024-11-20 01:31:30.862428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.801 [2024-11-20 01:31:30.862518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.801 [2024-11-20 01:31:30.862543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.801 qpair failed and we were unable to recover it. 00:30:22.801 [2024-11-20 01:31:30.862673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.801 [2024-11-20 01:31:30.862795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.801 [2024-11-20 01:31:30.862820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.801 qpair failed and we were unable to recover it. 00:30:22.801 [2024-11-20 01:31:30.862959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.801 [2024-11-20 01:31:30.863063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.801 [2024-11-20 01:31:30.863100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.801 qpair failed and we were unable to recover it. 00:30:22.801 [2024-11-20 01:31:30.863206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.801 [2024-11-20 01:31:30.863327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.801 [2024-11-20 01:31:30.863351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.801 qpair failed and we were unable to recover it. 00:30:22.801 [2024-11-20 01:31:30.863475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.801 [2024-11-20 01:31:30.863615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.801 [2024-11-20 01:31:30.863640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.801 qpair failed and we were unable to recover it. 00:30:22.801 [2024-11-20 01:31:30.863757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.801 [2024-11-20 01:31:30.863847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.801 [2024-11-20 01:31:30.863874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.801 qpair failed and we were unable to recover it. 00:30:22.801 [2024-11-20 01:31:30.863972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.801 [2024-11-20 01:31:30.864098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.801 [2024-11-20 01:31:30.864127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.801 qpair failed and we were unable to recover it. 00:30:22.801 [2024-11-20 01:31:30.864293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.801 [2024-11-20 01:31:30.864372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.801 [2024-11-20 01:31:30.864396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.801 qpair failed and we were unable to recover it. 00:30:22.801 [2024-11-20 01:31:30.864488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.801 [2024-11-20 01:31:30.864591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.801 [2024-11-20 01:31:30.864619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.801 qpair failed and we were unable to recover it. 00:30:22.801 [2024-11-20 01:31:30.864717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.801 [2024-11-20 01:31:30.864847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.801 [2024-11-20 01:31:30.864875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.801 qpair failed and we were unable to recover it. 00:30:22.801 [2024-11-20 01:31:30.865013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.801 [2024-11-20 01:31:30.865148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.801 [2024-11-20 01:31:30.865173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.801 qpair failed and we were unable to recover it. 00:30:22.801 [2024-11-20 01:31:30.865309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.801 [2024-11-20 01:31:30.865408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.801 [2024-11-20 01:31:30.865438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.801 qpair failed and we were unable to recover it. 00:30:22.801 [2024-11-20 01:31:30.865599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.801 [2024-11-20 01:31:30.865704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.801 [2024-11-20 01:31:30.865731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.801 qpair failed and we were unable to recover it. 00:30:22.801 [2024-11-20 01:31:30.865845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.801 [2024-11-20 01:31:30.865961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.801 [2024-11-20 01:31:30.865986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.801 qpair failed and we were unable to recover it. 00:30:22.801 [2024-11-20 01:31:30.866128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.801 [2024-11-20 01:31:30.866224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.801 [2024-11-20 01:31:30.866252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.801 qpair failed and we were unable to recover it. 00:30:22.801 [2024-11-20 01:31:30.866350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.801 [2024-11-20 01:31:30.866456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.801 [2024-11-20 01:31:30.866484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.801 qpair failed and we were unable to recover it. 00:30:22.801 [2024-11-20 01:31:30.866598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.801 [2024-11-20 01:31:30.866713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.801 [2024-11-20 01:31:30.866737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.801 qpair failed and we were unable to recover it. 00:30:22.801 [2024-11-20 01:31:30.866840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.801 [2024-11-20 01:31:30.866938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.801 [2024-11-20 01:31:30.866965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.801 qpair failed and we were unable to recover it. 00:30:22.801 [2024-11-20 01:31:30.867076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.801 [2024-11-20 01:31:30.867234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.801 [2024-11-20 01:31:30.867261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.801 qpair failed and we were unable to recover it. 00:30:22.801 [2024-11-20 01:31:30.867398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.801 [2024-11-20 01:31:30.867551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.801 [2024-11-20 01:31:30.867575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.801 qpair failed and we were unable to recover it. 00:30:22.801 [2024-11-20 01:31:30.867693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.801 [2024-11-20 01:31:30.867811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.801 [2024-11-20 01:31:30.867838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.801 qpair failed and we were unable to recover it. 00:30:22.801 [2024-11-20 01:31:30.867967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.801 [2024-11-20 01:31:30.868108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.801 [2024-11-20 01:31:30.868134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.801 qpair failed and we were unable to recover it. 00:30:22.801 [2024-11-20 01:31:30.868261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.801 [2024-11-20 01:31:30.868352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.801 [2024-11-20 01:31:30.868378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.801 qpair failed and we were unable to recover it. 00:30:22.801 [2024-11-20 01:31:30.868497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.801 [2024-11-20 01:31:30.868624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.801 [2024-11-20 01:31:30.868652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.801 qpair failed and we were unable to recover it. 00:30:22.801 [2024-11-20 01:31:30.868790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.801 [2024-11-20 01:31:30.868881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.868908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.802 qpair failed and we were unable to recover it. 00:30:22.802 [2024-11-20 01:31:30.869022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.869140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.869165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.802 qpair failed and we were unable to recover it. 00:30:22.802 [2024-11-20 01:31:30.869262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.869383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.869408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.802 qpair failed and we were unable to recover it. 00:30:22.802 [2024-11-20 01:31:30.869490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.869641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.869666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.802 qpair failed and we were unable to recover it. 00:30:22.802 [2024-11-20 01:31:30.869809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.869972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.870000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.802 qpair failed and we were unable to recover it. 00:30:22.802 [2024-11-20 01:31:30.870142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.870232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.870258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.802 qpair failed and we were unable to recover it. 00:30:22.802 [2024-11-20 01:31:30.870343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.870453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.870482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.802 qpair failed and we were unable to recover it. 00:30:22.802 [2024-11-20 01:31:30.870620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.870765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.870790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.802 qpair failed and we were unable to recover it. 00:30:22.802 [2024-11-20 01:31:30.870936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.871086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.871113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.802 qpair failed and we were unable to recover it. 00:30:22.802 [2024-11-20 01:31:30.871247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.871340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.871368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.802 qpair failed and we were unable to recover it. 00:30:22.802 [2024-11-20 01:31:30.871488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.871603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.871628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.802 qpair failed and we were unable to recover it. 00:30:22.802 [2024-11-20 01:31:30.871765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.871890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.871917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.802 qpair failed and we were unable to recover it. 00:30:22.802 [2024-11-20 01:31:30.872050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.872207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.872236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.802 qpair failed and we were unable to recover it. 00:30:22.802 [2024-11-20 01:31:30.872344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.872495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.872520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.802 qpair failed and we were unable to recover it. 00:30:22.802 [2024-11-20 01:31:30.872625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.872751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.872778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.802 qpair failed and we were unable to recover it. 00:30:22.802 [2024-11-20 01:31:30.872922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.873065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.873099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.802 qpair failed and we were unable to recover it. 00:30:22.802 [2024-11-20 01:31:30.873219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.873309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.873334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.802 qpair failed and we were unable to recover it. 00:30:22.802 [2024-11-20 01:31:30.873453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.873531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.873572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.802 qpair failed and we were unable to recover it. 00:30:22.802 [2024-11-20 01:31:30.873692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.873817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.873844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.802 qpair failed and we were unable to recover it. 00:30:22.802 [2024-11-20 01:31:30.873976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.874064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.874096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.802 qpair failed and we were unable to recover it. 00:30:22.802 [2024-11-20 01:31:30.874219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.874317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.874343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.802 qpair failed and we were unable to recover it. 00:30:22.802 [2024-11-20 01:31:30.874442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.874534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.874574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.802 qpair failed and we were unable to recover it. 00:30:22.802 [2024-11-20 01:31:30.874707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.874849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.874874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.802 qpair failed and we were unable to recover it. 00:30:22.802 [2024-11-20 01:31:30.875039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.875172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.875200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.802 qpair failed and we were unable to recover it. 00:30:22.802 [2024-11-20 01:31:30.875300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.875404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.875432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.802 qpair failed and we were unable to recover it. 00:30:22.802 [2024-11-20 01:31:30.875574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.875667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.875693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.802 qpair failed and we were unable to recover it. 00:30:22.802 [2024-11-20 01:31:30.875805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.875944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.875971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.802 qpair failed and we were unable to recover it. 00:30:22.802 [2024-11-20 01:31:30.876092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.876234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.876259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.802 qpair failed and we were unable to recover it. 00:30:22.802 [2024-11-20 01:31:30.876350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.876440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.876465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.802 qpair failed and we were unable to recover it. 00:30:22.802 [2024-11-20 01:31:30.876580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.876753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.876780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.802 qpair failed and we were unable to recover it. 00:30:22.802 [2024-11-20 01:31:30.876900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.877010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.877037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.802 qpair failed and we were unable to recover it. 00:30:22.802 [2024-11-20 01:31:30.877170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.877290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.877315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.802 qpair failed and we were unable to recover it. 00:30:22.802 [2024-11-20 01:31:30.877446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.877548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.877577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.802 qpair failed and we were unable to recover it. 00:30:22.802 [2024-11-20 01:31:30.877743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.877835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.877859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.802 qpair failed and we were unable to recover it. 00:30:22.802 [2024-11-20 01:31:30.877994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.878085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.802 [2024-11-20 01:31:30.878128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.802 qpair failed and we were unable to recover it. 00:30:22.802 [2024-11-20 01:31:30.878238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.878353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.878378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.803 qpair failed and we were unable to recover it. 00:30:22.803 [2024-11-20 01:31:30.878455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.878531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.878556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.803 qpair failed and we were unable to recover it. 00:30:22.803 [2024-11-20 01:31:30.878696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.878814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.878839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.803 qpair failed and we were unable to recover it. 00:30:22.803 [2024-11-20 01:31:30.878953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.879080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.879108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.803 qpair failed and we were unable to recover it. 00:30:22.803 [2024-11-20 01:31:30.879201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.879307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.879332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.803 qpair failed and we were unable to recover it. 00:30:22.803 [2024-11-20 01:31:30.879473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.879559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.879584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.803 qpair failed and we were unable to recover it. 00:30:22.803 [2024-11-20 01:31:30.879685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.879852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.879877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.803 qpair failed and we were unable to recover it. 00:30:22.803 [2024-11-20 01:31:30.879967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.880054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.880098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.803 qpair failed and we were unable to recover it. 00:30:22.803 [2024-11-20 01:31:30.880221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.880332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.880357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.803 qpair failed and we were unable to recover it. 00:30:22.803 [2024-11-20 01:31:30.880474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.880591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.880635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.803 qpair failed and we were unable to recover it. 00:30:22.803 [2024-11-20 01:31:30.880761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.880883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.880911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.803 qpair failed and we were unable to recover it. 00:30:22.803 [2024-11-20 01:31:30.881020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.881118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.881144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.803 qpair failed and we were unable to recover it. 00:30:22.803 [2024-11-20 01:31:30.881286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.881417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.881445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.803 qpair failed and we were unable to recover it. 00:30:22.803 [2024-11-20 01:31:30.881585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.881698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.881724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.803 qpair failed and we were unable to recover it. 00:30:22.803 [2024-11-20 01:31:30.881814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.881955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.881983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.803 qpair failed and we were unable to recover it. 00:30:22.803 [2024-11-20 01:31:30.882090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.882195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.882220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.803 qpair failed and we were unable to recover it. 00:30:22.803 [2024-11-20 01:31:30.882317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.882457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.882484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.803 qpair failed and we were unable to recover it. 00:30:22.803 [2024-11-20 01:31:30.882599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.882710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.882734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.803 qpair failed and we were unable to recover it. 00:30:22.803 [2024-11-20 01:31:30.882864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.883003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.883028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.803 qpair failed and we were unable to recover it. 00:30:22.803 [2024-11-20 01:31:30.883155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.883244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.883286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.803 qpair failed and we were unable to recover it. 00:30:22.803 [2024-11-20 01:31:30.883385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.883524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.883548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.803 qpair failed and we were unable to recover it. 00:30:22.803 [2024-11-20 01:31:30.883639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.883738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.883767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.803 qpair failed and we were unable to recover it. 00:30:22.803 [2024-11-20 01:31:30.883891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.883990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.884017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.803 qpair failed and we were unable to recover it. 00:30:22.803 [2024-11-20 01:31:30.884185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.884299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.884324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.803 qpair failed and we were unable to recover it. 00:30:22.803 [2024-11-20 01:31:30.884440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.884540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.884568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.803 qpair failed and we were unable to recover it. 00:30:22.803 [2024-11-20 01:31:30.884693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.884853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.884879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.803 qpair failed and we were unable to recover it. 00:30:22.803 [2024-11-20 01:31:30.884989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.885096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.885121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.803 qpair failed and we were unable to recover it. 00:30:22.803 [2024-11-20 01:31:30.885237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.885328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.885352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.803 qpair failed and we were unable to recover it. 00:30:22.803 [2024-11-20 01:31:30.885472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.885604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.885632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.803 qpair failed and we were unable to recover it. 00:30:22.803 [2024-11-20 01:31:30.885779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.885925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.885949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.803 qpair failed and we were unable to recover it. 00:30:22.803 [2024-11-20 01:31:30.886058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.886155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.886182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.803 qpair failed and we were unable to recover it. 00:30:22.803 [2024-11-20 01:31:30.886276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.886406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.886433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.803 qpair failed and we were unable to recover it. 00:30:22.803 [2024-11-20 01:31:30.886551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.886660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.886684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.803 qpair failed and we were unable to recover it. 00:30:22.803 [2024-11-20 01:31:30.886798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.886964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.886991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.803 qpair failed and we were unable to recover it. 00:30:22.803 [2024-11-20 01:31:30.887122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.887242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.887270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.803 qpair failed and we were unable to recover it. 00:30:22.803 [2024-11-20 01:31:30.887377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.887511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.803 [2024-11-20 01:31:30.887539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.804 qpair failed and we were unable to recover it. 00:30:22.804 [2024-11-20 01:31:30.887701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.887827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.887854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.804 qpair failed and we were unable to recover it. 00:30:22.804 [2024-11-20 01:31:30.887949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.888038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.888066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.804 qpair failed and we were unable to recover it. 00:30:22.804 [2024-11-20 01:31:30.888200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.888316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.888341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.804 qpair failed and we were unable to recover it. 00:30:22.804 [2024-11-20 01:31:30.888458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.888538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.888562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.804 qpair failed and we were unable to recover it. 00:30:22.804 [2024-11-20 01:31:30.888652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.888785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.888813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.804 qpair failed and we were unable to recover it. 00:30:22.804 [2024-11-20 01:31:30.888912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.889065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.889117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.804 qpair failed and we were unable to recover it. 00:30:22.804 [2024-11-20 01:31:30.889243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.889329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.889369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.804 qpair failed and we were unable to recover it. 00:30:22.804 [2024-11-20 01:31:30.889503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.889629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.889657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.804 qpair failed and we were unable to recover it. 00:30:22.804 [2024-11-20 01:31:30.889762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.889843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.889868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.804 qpair failed and we were unable to recover it. 00:30:22.804 [2024-11-20 01:31:30.889951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.890084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.890116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.804 qpair failed and we were unable to recover it. 00:30:22.804 [2024-11-20 01:31:30.890214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.890337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.890364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.804 qpair failed and we were unable to recover it. 00:30:22.804 [2024-11-20 01:31:30.890472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.890561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.890587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.804 qpair failed and we were unable to recover it. 00:30:22.804 [2024-11-20 01:31:30.890677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.890796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.890821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.804 qpair failed and we were unable to recover it. 00:30:22.804 [2024-11-20 01:31:30.890915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.891000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.891024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.804 qpair failed and we were unable to recover it. 00:30:22.804 [2024-11-20 01:31:30.891150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.891273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.891298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.804 qpair failed and we were unable to recover it. 00:30:22.804 [2024-11-20 01:31:30.891408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.891578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.891603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.804 qpair failed and we were unable to recover it. 00:30:22.804 [2024-11-20 01:31:30.891719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.891805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.891830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.804 qpair failed and we were unable to recover it. 00:30:22.804 [2024-11-20 01:31:30.891920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.892040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.892066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.804 qpair failed and we were unable to recover it. 00:30:22.804 [2024-11-20 01:31:30.892205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.892302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.892329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.804 qpair failed and we were unable to recover it. 00:30:22.804 [2024-11-20 01:31:30.892476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.892568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.892600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.804 qpair failed and we were unable to recover it. 00:30:22.804 [2024-11-20 01:31:30.892714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.892814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.892839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.804 qpair failed and we were unable to recover it. 00:30:22.804 [2024-11-20 01:31:30.892968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.893079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.893107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.804 qpair failed and we were unable to recover it. 00:30:22.804 [2024-11-20 01:31:30.893200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.893290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.893319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.804 qpair failed and we were unable to recover it. 00:30:22.804 [2024-11-20 01:31:30.893483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.893601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.893625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.804 qpair failed and we were unable to recover it. 00:30:22.804 [2024-11-20 01:31:30.893730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.893848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.893875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.804 qpair failed and we were unable to recover it. 00:30:22.804 [2024-11-20 01:31:30.893962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.894054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.894091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.804 qpair failed and we were unable to recover it. 00:30:22.804 [2024-11-20 01:31:30.894215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.894338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.894363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.804 qpair failed and we were unable to recover it. 00:30:22.804 [2024-11-20 01:31:30.894525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.894646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.894673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.804 qpair failed and we were unable to recover it. 00:30:22.804 [2024-11-20 01:31:30.894792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.894894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.894935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.804 qpair failed and we were unable to recover it. 00:30:22.804 [2024-11-20 01:31:30.895033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.895160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.895190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.804 qpair failed and we were unable to recover it. 00:30:22.804 [2024-11-20 01:31:30.895286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.895446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.895474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.804 qpair failed and we were unable to recover it. 00:30:22.804 [2024-11-20 01:31:30.895585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.895678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.895703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.804 qpair failed and we were unable to recover it. 00:30:22.804 [2024-11-20 01:31:30.895792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.895902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.895927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.804 qpair failed and we were unable to recover it. 00:30:22.804 [2024-11-20 01:31:30.896031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.896191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.896218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.804 qpair failed and we were unable to recover it. 00:30:22.804 [2024-11-20 01:31:30.896304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.896434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.804 [2024-11-20 01:31:30.896461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.804 qpair failed and we were unable to recover it. 00:30:22.804 [2024-11-20 01:31:30.896562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.896646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.896672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.805 qpair failed and we were unable to recover it. 00:30:22.805 [2024-11-20 01:31:30.896791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.896920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.896948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.805 qpair failed and we were unable to recover it. 00:30:22.805 [2024-11-20 01:31:30.897045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.897229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.897254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.805 qpair failed and we were unable to recover it. 00:30:22.805 [2024-11-20 01:31:30.897371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.897455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.897480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.805 qpair failed and we were unable to recover it. 00:30:22.805 [2024-11-20 01:31:30.897621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.897711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.897738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.805 qpair failed and we were unable to recover it. 00:30:22.805 [2024-11-20 01:31:30.897884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.898000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.898025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.805 qpair failed and we were unable to recover it. 00:30:22.805 [2024-11-20 01:31:30.898148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.898255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.898281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.805 qpair failed and we were unable to recover it. 00:30:22.805 [2024-11-20 01:31:30.898410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.898532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.898560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.805 qpair failed and we were unable to recover it. 00:30:22.805 [2024-11-20 01:31:30.898681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.898831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.898859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.805 qpair failed and we were unable to recover it. 00:30:22.805 [2024-11-20 01:31:30.898996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.899116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.899142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.805 qpair failed and we were unable to recover it. 00:30:22.805 [2024-11-20 01:31:30.899242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.899401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.899429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.805 qpair failed and we were unable to recover it. 00:30:22.805 [2024-11-20 01:31:30.899558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.899647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.899691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.805 qpair failed and we were unable to recover it. 00:30:22.805 [2024-11-20 01:31:30.899809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.899899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.899923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.805 qpair failed and we were unable to recover it. 00:30:22.805 [2024-11-20 01:31:30.900033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.900198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.900227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.805 qpair failed and we were unable to recover it. 00:30:22.805 [2024-11-20 01:31:30.900391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.900508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.900532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.805 qpair failed and we were unable to recover it. 00:30:22.805 [2024-11-20 01:31:30.900647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.900766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.900791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.805 qpair failed and we were unable to recover it. 00:30:22.805 [2024-11-20 01:31:30.900902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.901067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.901102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.805 qpair failed and we were unable to recover it. 00:30:22.805 [2024-11-20 01:31:30.901230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.901357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.901386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.805 qpair failed and we were unable to recover it. 00:30:22.805 [2024-11-20 01:31:30.901526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.901607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.901632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.805 qpair failed and we were unable to recover it. 00:30:22.805 [2024-11-20 01:31:30.901756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.901855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.901883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.805 qpair failed and we were unable to recover it. 00:30:22.805 [2024-11-20 01:31:30.902010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.902150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.902176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.805 qpair failed and we were unable to recover it. 00:30:22.805 [2024-11-20 01:31:30.902262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.902407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.902432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.805 qpair failed and we were unable to recover it. 00:30:22.805 [2024-11-20 01:31:30.902566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.902693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.902735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.805 qpair failed and we were unable to recover it. 00:30:22.805 [2024-11-20 01:31:30.902833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.902946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.902971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.805 qpair failed and we were unable to recover it. 00:30:22.805 [2024-11-20 01:31:30.903133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.903219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.903244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.805 qpair failed and we were unable to recover it. 00:30:22.805 [2024-11-20 01:31:30.903380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.903469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.903514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.805 qpair failed and we were unable to recover it. 00:30:22.805 [2024-11-20 01:31:30.903660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.903770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.903797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.805 qpair failed and we were unable to recover it. 00:30:22.805 [2024-11-20 01:31:30.903904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.903984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.904009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.805 qpair failed and we were unable to recover it. 00:30:22.805 [2024-11-20 01:31:30.904129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.904273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.904300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.805 qpair failed and we were unable to recover it. 00:30:22.805 [2024-11-20 01:31:30.904462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.904579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.904603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.805 qpair failed and we were unable to recover it. 00:30:22.805 [2024-11-20 01:31:30.904717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.904842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.904866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.805 qpair failed and we were unable to recover it. 00:30:22.805 [2024-11-20 01:31:30.904963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.905098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.805 [2024-11-20 01:31:30.905125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.805 qpair failed and we were unable to recover it. 00:30:22.806 [2024-11-20 01:31:30.905220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.905371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.905397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.806 qpair failed and we were unable to recover it. 00:30:22.806 [2024-11-20 01:31:30.905505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.905594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.905618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.806 qpair failed and we were unable to recover it. 00:30:22.806 [2024-11-20 01:31:30.905732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.905844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.905885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.806 qpair failed and we were unable to recover it. 00:30:22.806 [2024-11-20 01:31:30.906022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.906123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.906150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.806 qpair failed and we were unable to recover it. 00:30:22.806 [2024-11-20 01:31:30.906282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.906371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.906395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.806 qpair failed and we were unable to recover it. 00:30:22.806 [2024-11-20 01:31:30.906498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.906637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.906661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.806 qpair failed and we were unable to recover it. 00:30:22.806 [2024-11-20 01:31:30.906746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.906856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.906880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.806 qpair failed and we were unable to recover it. 00:30:22.806 [2024-11-20 01:31:30.907003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.907085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.907110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.806 qpair failed and we were unable to recover it. 00:30:22.806 [2024-11-20 01:31:30.907198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.907315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.907339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.806 qpair failed and we were unable to recover it. 00:30:22.806 [2024-11-20 01:31:30.907418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.907533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.907557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.806 qpair failed and we were unable to recover it. 00:30:22.806 [2024-11-20 01:31:30.907701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.907787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.907811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.806 qpair failed and we were unable to recover it. 00:30:22.806 [2024-11-20 01:31:30.907919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.908056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.908099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.806 qpair failed and we were unable to recover it. 00:30:22.806 [2024-11-20 01:31:30.908258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.908400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.908426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.806 qpair failed and we were unable to recover it. 00:30:22.806 [2024-11-20 01:31:30.908599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.908681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.908706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.806 qpair failed and we were unable to recover it. 00:30:22.806 [2024-11-20 01:31:30.908814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.908921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.908945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.806 qpair failed and we were unable to recover it. 00:30:22.806 [2024-11-20 01:31:30.909093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.909218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.909245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.806 qpair failed and we were unable to recover it. 00:30:22.806 [2024-11-20 01:31:30.909351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.909471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.909495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.806 qpair failed and we were unable to recover it. 00:30:22.806 [2024-11-20 01:31:30.909590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.909670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.909694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.806 qpair failed and we were unable to recover it. 00:30:22.806 [2024-11-20 01:31:30.909813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.909925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.909952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.806 qpair failed and we were unable to recover it. 00:30:22.806 [2024-11-20 01:31:30.910062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.910188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.910213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.806 qpair failed and we were unable to recover it. 00:30:22.806 [2024-11-20 01:31:30.910293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.910413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.910454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.806 qpair failed and we were unable to recover it. 00:30:22.806 [2024-11-20 01:31:30.910544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.910637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.910664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.806 qpair failed and we were unable to recover it. 00:30:22.806 [2024-11-20 01:31:30.910803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.910885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.910912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.806 qpair failed and we were unable to recover it. 00:30:22.806 [2024-11-20 01:31:30.911037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.911176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.911204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.806 qpair failed and we were unable to recover it. 00:30:22.806 [2024-11-20 01:31:30.911329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.911453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.911494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.806 qpair failed and we were unable to recover it. 00:30:22.806 [2024-11-20 01:31:30.911610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.911698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.911721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.806 qpair failed and we were unable to recover it. 00:30:22.806 [2024-11-20 01:31:30.911854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.912009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.912035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.806 qpair failed and we were unable to recover it. 00:30:22.806 [2024-11-20 01:31:30.912163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.912301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.912325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.806 qpair failed and we were unable to recover it. 00:30:22.806 [2024-11-20 01:31:30.912464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.912605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.912647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.806 qpair failed and we were unable to recover it. 00:30:22.806 [2024-11-20 01:31:30.912782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.912867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.912893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.806 qpair failed and we were unable to recover it. 00:30:22.806 [2024-11-20 01:31:30.913011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.913175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.913201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.806 qpair failed and we were unable to recover it. 00:30:22.806 [2024-11-20 01:31:30.913316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.913443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.913467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.806 qpair failed and we were unable to recover it. 00:30:22.806 [2024-11-20 01:31:30.913578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.913704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.913731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.806 qpair failed and we were unable to recover it. 00:30:22.806 [2024-11-20 01:31:30.913897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.913998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.914025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.806 qpair failed and we were unable to recover it. 00:30:22.806 [2024-11-20 01:31:30.914154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.914263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.914287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.806 qpair failed and we were unable to recover it. 00:30:22.806 [2024-11-20 01:31:30.914421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.914519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.914562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.806 qpair failed and we were unable to recover it. 00:30:22.806 [2024-11-20 01:31:30.914684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.914798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.914822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.806 qpair failed and we were unable to recover it. 00:30:22.806 [2024-11-20 01:31:30.914937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.915085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.806 [2024-11-20 01:31:30.915109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.806 qpair failed and we were unable to recover it. 00:30:22.807 [2024-11-20 01:31:30.915247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.915375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.915401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.807 qpair failed and we were unable to recover it. 00:30:22.807 [2024-11-20 01:31:30.915509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.915650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.915675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.807 qpair failed and we were unable to recover it. 00:30:22.807 [2024-11-20 01:31:30.915794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.915915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.915939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.807 qpair failed and we were unable to recover it. 00:30:22.807 [2024-11-20 01:31:30.916106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.916257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.916284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.807 qpair failed and we were unable to recover it. 00:30:22.807 [2024-11-20 01:31:30.916410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.916499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.916527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.807 qpair failed and we were unable to recover it. 00:30:22.807 [2024-11-20 01:31:30.916667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.916779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.916803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.807 qpair failed and we were unable to recover it. 00:30:22.807 [2024-11-20 01:31:30.916909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.917038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.917065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.807 qpair failed and we were unable to recover it. 00:30:22.807 [2024-11-20 01:31:30.917205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.917368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.917393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.807 qpair failed and we were unable to recover it. 00:30:22.807 [2024-11-20 01:31:30.917507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.917621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.917645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.807 qpair failed and we were unable to recover it. 00:30:22.807 [2024-11-20 01:31:30.917758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.917890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.917917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.807 qpair failed and we were unable to recover it. 00:30:22.807 [2024-11-20 01:31:30.918057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.918180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.918205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.807 qpair failed and we were unable to recover it. 00:30:22.807 [2024-11-20 01:31:30.918296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.918411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.918435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.807 qpair failed and we were unable to recover it. 00:30:22.807 [2024-11-20 01:31:30.918520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.918662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.918686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.807 qpair failed and we were unable to recover it. 00:30:22.807 [2024-11-20 01:31:30.918820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.918913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.918941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.807 qpair failed and we were unable to recover it. 00:30:22.807 [2024-11-20 01:31:30.919084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.919168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.919191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.807 qpair failed and we were unable to recover it. 00:30:22.807 [2024-11-20 01:31:30.919347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.919469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.919496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.807 qpair failed and we were unable to recover it. 00:30:22.807 [2024-11-20 01:31:30.919651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.919744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.919770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.807 qpair failed and we were unable to recover it. 00:30:22.807 [2024-11-20 01:31:30.919885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.920028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.920052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.807 qpair failed and we were unable to recover it. 00:30:22.807 [2024-11-20 01:31:30.920175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.920299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.920326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.807 qpair failed and we were unable to recover it. 00:30:22.807 [2024-11-20 01:31:30.920458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.920554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.920597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.807 qpair failed and we were unable to recover it. 00:30:22.807 [2024-11-20 01:31:30.920721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.920831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.920855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.807 qpair failed and we were unable to recover it. 00:30:22.807 [2024-11-20 01:31:30.920958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.921107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.921132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.807 qpair failed and we were unable to recover it. 00:30:22.807 [2024-11-20 01:31:30.921223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.921338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.921362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.807 qpair failed and we were unable to recover it. 00:30:22.807 [2024-11-20 01:31:30.921478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.921596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.921621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.807 qpair failed and we were unable to recover it. 00:30:22.807 [2024-11-20 01:31:30.921745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.921879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.921906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.807 qpair failed and we were unable to recover it. 00:30:22.807 [2024-11-20 01:31:30.922066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.922196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.922221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.807 qpair failed and we were unable to recover it. 00:30:22.807 [2024-11-20 01:31:30.922342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.922463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.922487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.807 qpair failed and we were unable to recover it. 00:30:22.807 [2024-11-20 01:31:30.922596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.922718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.922744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.807 qpair failed and we were unable to recover it. 00:30:22.807 [2024-11-20 01:31:30.922872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.922962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.922988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.807 qpair failed and we were unable to recover it. 00:30:22.807 [2024-11-20 01:31:30.923138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.923252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.923277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.807 qpair failed and we were unable to recover it. 00:30:22.807 [2024-11-20 01:31:30.923437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.923561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.923588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.807 qpair failed and we were unable to recover it. 00:30:22.807 [2024-11-20 01:31:30.923747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.923894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.923918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.807 qpair failed and we were unable to recover it. 00:30:22.807 [2024-11-20 01:31:30.924060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.924190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.924215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.807 qpair failed and we were unable to recover it. 00:30:22.807 [2024-11-20 01:31:30.924313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.924450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.924478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.807 qpair failed and we were unable to recover it. 00:30:22.807 [2024-11-20 01:31:30.924605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.924727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.924755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.807 qpair failed and we were unable to recover it. 00:30:22.807 [2024-11-20 01:31:30.924921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.925008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.925033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.807 qpair failed and we were unable to recover it. 00:30:22.807 [2024-11-20 01:31:30.925137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.925224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.807 [2024-11-20 01:31:30.925249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.807 qpair failed and we were unable to recover it. 00:30:22.807 [2024-11-20 01:31:30.925386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.925527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.925551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.808 qpair failed and we were unable to recover it. 00:30:22.808 [2024-11-20 01:31:30.925659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.925769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.925794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.808 qpair failed and we were unable to recover it. 00:30:22.808 [2024-11-20 01:31:30.925931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.926031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.926059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.808 qpair failed and we were unable to recover it. 00:30:22.808 [2024-11-20 01:31:30.926167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.926276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.926301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.808 qpair failed and we were unable to recover it. 00:30:22.808 [2024-11-20 01:31:30.926392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.926535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.926559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.808 qpair failed and we were unable to recover it. 00:30:22.808 [2024-11-20 01:31:30.926669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.926809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.926833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.808 qpair failed and we were unable to recover it. 00:30:22.808 [2024-11-20 01:31:30.926958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.927096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.927125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.808 qpair failed and we were unable to recover it. 00:30:22.808 [2024-11-20 01:31:30.927263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.927357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.927382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.808 qpair failed and we were unable to recover it. 00:30:22.808 [2024-11-20 01:31:30.927495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.927574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.927603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.808 qpair failed and we were unable to recover it. 00:30:22.808 [2024-11-20 01:31:30.927696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.927804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.927828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.808 qpair failed and we were unable to recover it. 00:30:22.808 [2024-11-20 01:31:30.927977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.928065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.928105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.808 qpair failed and we were unable to recover it. 00:30:22.808 [2024-11-20 01:31:30.928241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.928392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.928420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.808 qpair failed and we were unable to recover it. 00:30:22.808 [2024-11-20 01:31:30.928517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.928651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.928679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.808 qpair failed and we were unable to recover it. 00:30:22.808 [2024-11-20 01:31:30.928810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.928905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.928929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.808 qpair failed and we were unable to recover it. 00:30:22.808 [2024-11-20 01:31:30.929045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.929171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.929196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.808 qpair failed and we were unable to recover it. 00:30:22.808 [2024-11-20 01:31:30.929341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.929482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.929509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.808 qpair failed and we were unable to recover it. 00:30:22.808 [2024-11-20 01:31:30.929615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.929765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.929789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.808 qpair failed and we were unable to recover it. 00:30:22.808 [2024-11-20 01:31:30.929944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.930066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.930099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.808 qpair failed and we were unable to recover it. 00:30:22.808 [2024-11-20 01:31:30.930195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.930310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.930338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.808 qpair failed and we were unable to recover it. 00:30:22.808 [2024-11-20 01:31:30.930480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.930569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.930592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.808 qpair failed and we were unable to recover it. 00:30:22.808 [2024-11-20 01:31:30.930773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.930909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.930936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.808 qpair failed and we were unable to recover it. 00:30:22.808 [2024-11-20 01:31:30.931040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.931186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.931211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.808 qpair failed and we were unable to recover it. 00:30:22.808 [2024-11-20 01:31:30.931328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.931445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.931469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.808 qpair failed and we were unable to recover it. 00:30:22.808 [2024-11-20 01:31:30.931566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.931698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.931723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.808 qpair failed and we were unable to recover it. 00:30:22.808 [2024-11-20 01:31:30.931885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.931985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.932027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.808 qpair failed and we were unable to recover it. 00:30:22.808 [2024-11-20 01:31:30.932127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.932245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.932269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.808 qpair failed and we were unable to recover it. 00:30:22.808 [2024-11-20 01:31:30.932372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.932526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.932553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.808 qpair failed and we were unable to recover it. 00:30:22.808 [2024-11-20 01:31:30.932655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.932789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.932815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.808 qpair failed and we were unable to recover it. 00:30:22.808 [2024-11-20 01:31:30.932927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.933043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.933082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.808 qpair failed and we were unable to recover it. 00:30:22.808 [2024-11-20 01:31:30.933183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.933267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.933291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.808 qpair failed and we were unable to recover it. 00:30:22.808 [2024-11-20 01:31:30.933381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.933514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.933541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.808 qpair failed and we were unable to recover it. 00:30:22.808 [2024-11-20 01:31:30.933643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.933771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.933795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.808 qpair failed and we were unable to recover it. 00:30:22.808 [2024-11-20 01:31:30.933935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.934049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.934085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.808 qpair failed and we were unable to recover it. 00:30:22.808 [2024-11-20 01:31:30.934197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.934310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.808 [2024-11-20 01:31:30.934334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.808 qpair failed and we were unable to recover it. 00:30:22.809 [2024-11-20 01:31:30.934490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.934607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.934631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.809 qpair failed and we were unable to recover it. 00:30:22.809 [2024-11-20 01:31:30.934746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.934888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.934913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.809 qpair failed and we were unable to recover it. 00:30:22.809 [2024-11-20 01:31:30.935066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.935214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.935239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.809 qpair failed and we were unable to recover it. 00:30:22.809 [2024-11-20 01:31:30.935335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.935426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.935451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.809 qpair failed and we were unable to recover it. 00:30:22.809 [2024-11-20 01:31:30.935541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 44: 1272350 Killed "${NVMF_APP[@]}" "$@" 00:30:22.809 [2024-11-20 01:31:30.935684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.935708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.809 qpair failed and we were unable to recover it. 00:30:22.809 [2024-11-20 01:31:30.935809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.935903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.935930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.809 01:31:30 -- host/target_disconnect.sh@56 -- # disconnect_init 10.0.0.2 00:30:22.809 qpair failed and we were unable to recover it. 00:30:22.809 [2024-11-20 01:31:30.936066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 01:31:30 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:30:22.809 [2024-11-20 01:31:30.936167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.936192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.809 qpair failed and we were unable to recover it. 00:30:22.809 01:31:30 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:22.809 [2024-11-20 01:31:30.936308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 01:31:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:22.809 [2024-11-20 01:31:30.936395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.936420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.809 qpair failed and we were unable to recover it. 00:30:22.809 01:31:30 -- common/autotest_common.sh@10 -- # set +x 00:30:22.809 [2024-11-20 01:31:30.936504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.936587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.936611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.809 qpair failed and we were unable to recover it. 00:30:22.809 [2024-11-20 01:31:30.936764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.936875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.936899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.809 qpair failed and we were unable to recover it. 00:30:22.809 [2024-11-20 01:31:30.937016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.937134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.937160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.809 qpair failed and we were unable to recover it. 00:30:22.809 [2024-11-20 01:31:30.937278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.937379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.937407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.809 qpair failed and we were unable to recover it. 00:30:22.809 [2024-11-20 01:31:30.937509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.937623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.937648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.809 qpair failed and we were unable to recover it. 00:30:22.809 [2024-11-20 01:31:30.937735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.937852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.937881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.809 qpair failed and we were unable to recover it. 00:30:22.809 [2024-11-20 01:31:30.937975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.938092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.938121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.809 qpair failed and we were unable to recover it. 00:30:22.809 [2024-11-20 01:31:30.938232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.938319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.938343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.809 qpair failed and we were unable to recover it. 00:30:22.809 [2024-11-20 01:31:30.938460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.938626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.938653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.809 qpair failed and we were unable to recover it. 00:30:22.809 [2024-11-20 01:31:30.938794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.938907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.938934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.809 qpair failed and we were unable to recover it. 00:30:22.809 [2024-11-20 01:31:30.939045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.939199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.939224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.809 qpair failed and we were unable to recover it. 00:30:22.809 [2024-11-20 01:31:30.939317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.939404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.939428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.809 qpair failed and we were unable to recover it. 00:30:22.809 [2024-11-20 01:31:30.939540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.939650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.939686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.809 qpair failed and we were unable to recover it. 00:30:22.809 01:31:30 -- nvmf/common.sh@469 -- # nvmfpid=1272938 00:30:22.809 [2024-11-20 01:31:30.939836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 01:31:30 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:30:22.809 01:31:30 -- nvmf/common.sh@470 -- # waitforlisten 1272938 00:30:22.809 [2024-11-20 01:31:30.939916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.939941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.809 qpair failed and we were unable to recover it. 00:30:22.809 [2024-11-20 01:31:30.940044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 01:31:30 -- common/autotest_common.sh@829 -- # '[' -z 1272938 ']' 00:30:22.809 [2024-11-20 01:31:30.940183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.940208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.809 qpair failed and we were unable to recover it. 00:30:22.809 01:31:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:22.809 [2024-11-20 01:31:30.940336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 01:31:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:22.809 [2024-11-20 01:31:30.940419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.940459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.809 qpair failed and we were unable to recover it. 00:30:22.809 01:31:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:22.809 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:22.809 [2024-11-20 01:31:30.940576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 01:31:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:22.809 [2024-11-20 01:31:30.940684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.940714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.809 qpair failed and we were unable to recover it. 00:30:22.809 01:31:30 -- common/autotest_common.sh@10 -- # set +x 00:30:22.809 [2024-11-20 01:31:30.940825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.940920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.940963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.809 qpair failed and we were unable to recover it. 00:30:22.809 [2024-11-20 01:31:30.941111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.941207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.941233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.809 qpair failed and we were unable to recover it. 00:30:22.809 [2024-11-20 01:31:30.941328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.941415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.941441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.809 qpair failed and we were unable to recover it. 00:30:22.809 [2024-11-20 01:31:30.941570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.941693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.941722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.809 qpair failed and we were unable to recover it. 00:30:22.809 [2024-11-20 01:31:30.941887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.941983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.942011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.809 qpair failed and we were unable to recover it. 00:30:22.809 [2024-11-20 01:31:30.942139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.942286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.942310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.809 qpair failed and we were unable to recover it. 00:30:22.809 [2024-11-20 01:31:30.942445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.942545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.942577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.809 qpair failed and we were unable to recover it. 00:30:22.809 [2024-11-20 01:31:30.942705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.942833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.942863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.809 qpair failed and we were unable to recover it. 00:30:22.809 [2024-11-20 01:31:30.942970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.943088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.943115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.809 qpair failed and we were unable to recover it. 00:30:22.809 [2024-11-20 01:31:30.943199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.943281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.943305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.809 qpair failed and we were unable to recover it. 00:30:22.809 [2024-11-20 01:31:30.943391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.943477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.943502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.809 qpair failed and we were unable to recover it. 00:30:22.809 [2024-11-20 01:31:30.943592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.943682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.809 [2024-11-20 01:31:30.943706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.810 qpair failed and we were unable to recover it. 00:30:22.810 [2024-11-20 01:31:30.943843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.943928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.943953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.810 qpair failed and we were unable to recover it. 00:30:22.810 [2024-11-20 01:31:30.944079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.944199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.944224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.810 qpair failed and we were unable to recover it. 00:30:22.810 [2024-11-20 01:31:30.944310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.944423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.944448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.810 qpair failed and we were unable to recover it. 00:30:22.810 [2024-11-20 01:31:30.944563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.944685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.944710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.810 qpair failed and we were unable to recover it. 00:30:22.810 [2024-11-20 01:31:30.944833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.944923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.944952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.810 qpair failed and we were unable to recover it. 00:30:22.810 [2024-11-20 01:31:30.945082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.945171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.945195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.810 qpair failed and we were unable to recover it. 00:30:22.810 [2024-11-20 01:31:30.945283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.945421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.945445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.810 qpair failed and we were unable to recover it. 00:30:22.810 [2024-11-20 01:31:30.945574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.945686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.945710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.810 qpair failed and we were unable to recover it. 00:30:22.810 [2024-11-20 01:31:30.945823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.945918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.945943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.810 qpair failed and we were unable to recover it. 00:30:22.810 [2024-11-20 01:31:30.946057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.946189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.946214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.810 qpair failed and we were unable to recover it. 00:30:22.810 [2024-11-20 01:31:30.946354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.946432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.946456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.810 qpair failed and we were unable to recover it. 00:30:22.810 [2024-11-20 01:31:30.946574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.946662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.946686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.810 qpair failed and we were unable to recover it. 00:30:22.810 [2024-11-20 01:31:30.946800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.946877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.946901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.810 qpair failed and we were unable to recover it. 00:30:22.810 [2024-11-20 01:31:30.947024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.947142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.947167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.810 qpair failed and we were unable to recover it. 00:30:22.810 [2024-11-20 01:31:30.947255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.947349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.947374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.810 qpair failed and we were unable to recover it. 00:30:22.810 [2024-11-20 01:31:30.947493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.947631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.947655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.810 qpair failed and we were unable to recover it. 00:30:22.810 [2024-11-20 01:31:30.947740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.947857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.947883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.810 qpair failed and we were unable to recover it. 00:30:22.810 [2024-11-20 01:31:30.947999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.948090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.948115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.810 qpair failed and we were unable to recover it. 00:30:22.810 [2024-11-20 01:31:30.948212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.948326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.948350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.810 qpair failed and we were unable to recover it. 00:30:22.810 [2024-11-20 01:31:30.948462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.948550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.948573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.810 qpair failed and we were unable to recover it. 00:30:22.810 [2024-11-20 01:31:30.948662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.948775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.948801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.810 qpair failed and we were unable to recover it. 00:30:22.810 [2024-11-20 01:31:30.948915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.949008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.949033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.810 qpair failed and we were unable to recover it. 00:30:22.810 [2024-11-20 01:31:30.949135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.949228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.949253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.810 qpair failed and we were unable to recover it. 00:30:22.810 [2024-11-20 01:31:30.949365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.949452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.949477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.810 qpair failed and we were unable to recover it. 00:30:22.810 [2024-11-20 01:31:30.949599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.949688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.949712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.810 qpair failed and we were unable to recover it. 00:30:22.810 [2024-11-20 01:31:30.949832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.949919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.949945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.810 qpair failed and we were unable to recover it. 00:30:22.810 [2024-11-20 01:31:30.950034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.950163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.950189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.810 qpair failed and we were unable to recover it. 00:30:22.810 [2024-11-20 01:31:30.950308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.950461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.950486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.810 qpair failed and we were unable to recover it. 00:30:22.810 [2024-11-20 01:31:30.950578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.950691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.950717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.810 qpair failed and we were unable to recover it. 00:30:22.810 [2024-11-20 01:31:30.950830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.950909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.950933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.810 qpair failed and we were unable to recover it. 00:30:22.810 [2024-11-20 01:31:30.951046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.951145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.951170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.810 qpair failed and we were unable to recover it. 00:30:22.810 [2024-11-20 01:31:30.951286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.951401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.951425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.810 qpair failed and we were unable to recover it. 00:30:22.810 [2024-11-20 01:31:30.951514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.951628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.951652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.810 qpair failed and we were unable to recover it. 00:30:22.810 [2024-11-20 01:31:30.951743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.951833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.951859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.810 qpair failed and we were unable to recover it. 00:30:22.810 [2024-11-20 01:31:30.951976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.952095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.952120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.810 qpair failed and we were unable to recover it. 00:30:22.810 [2024-11-20 01:31:30.952238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.952329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.952353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.810 qpair failed and we were unable to recover it. 00:30:22.810 [2024-11-20 01:31:30.952440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.952529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.952554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.810 qpair failed and we were unable to recover it. 00:30:22.810 [2024-11-20 01:31:30.952672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.952783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.952808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.810 qpair failed and we were unable to recover it. 00:30:22.810 [2024-11-20 01:31:30.952899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.952986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.953011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.810 qpair failed and we were unable to recover it. 00:30:22.810 [2024-11-20 01:31:30.953132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.953251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.810 [2024-11-20 01:31:30.953276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.810 qpair failed and we were unable to recover it. 00:30:22.811 [2024-11-20 01:31:30.953371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.953492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.953517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-11-20 01:31:30.953617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.953731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.953755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-11-20 01:31:30.953873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.953990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.954014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-11-20 01:31:30.954102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.954190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.954215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-11-20 01:31:30.954309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.954394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.954419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-11-20 01:31:30.954516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.954634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.954659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-11-20 01:31:30.954749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.954845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.954871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-11-20 01:31:30.954990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.955080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.955106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-11-20 01:31:30.955196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.955306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.955330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-11-20 01:31:30.955450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.955558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.955582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-11-20 01:31:30.955692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.955831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.955854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-11-20 01:31:30.955999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.956121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.956147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-11-20 01:31:30.956235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.956314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.956338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-11-20 01:31:30.956464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.956548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.956572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-11-20 01:31:30.956687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.956801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.956825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-11-20 01:31:30.956944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.957039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.957063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-11-20 01:31:30.957167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.957275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.957299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-11-20 01:31:30.957412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.957493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.957517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-11-20 01:31:30.957634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.957750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.957774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-11-20 01:31:30.957866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.957953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.957978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-11-20 01:31:30.958098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.958177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.958202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-11-20 01:31:30.958283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.958368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.958393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-11-20 01:31:30.958509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.958624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.958648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-11-20 01:31:30.958735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.958828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.958853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-11-20 01:31:30.958950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.959037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.959063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-11-20 01:31:30.959165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.959258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.959282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-11-20 01:31:30.959370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.959486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.959510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-11-20 01:31:30.959600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.959688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.959712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-11-20 01:31:30.959827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.959903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.959927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-11-20 01:31:30.960046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.960177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.960203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-11-20 01:31:30.960300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.960419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.960444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-11-20 01:31:30.960585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.960702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.960728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-11-20 01:31:30.960849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.960959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.811 [2024-11-20 01:31:30.960984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:22.811 qpair failed and we were unable to recover it. 00:30:23.096 [2024-11-20 01:31:30.961079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.096 [2024-11-20 01:31:30.961163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.096 [2024-11-20 01:31:30.961188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.096 qpair failed and we were unable to recover it. 00:30:23.096 [2024-11-20 01:31:30.961279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.096 [2024-11-20 01:31:30.961420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.096 [2024-11-20 01:31:30.961445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.096 qpair failed and we were unable to recover it. 00:30:23.096 [2024-11-20 01:31:30.961570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.096 [2024-11-20 01:31:30.961685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.096 [2024-11-20 01:31:30.961709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.096 qpair failed and we were unable to recover it. 00:30:23.096 [2024-11-20 01:31:30.961825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.096 [2024-11-20 01:31:30.961939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.096 [2024-11-20 01:31:30.961963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.096 qpair failed and we were unable to recover it. 00:30:23.096 [2024-11-20 01:31:30.962082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.096 [2024-11-20 01:31:30.962167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.096 [2024-11-20 01:31:30.962191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.096 qpair failed and we were unable to recover it. 00:30:23.096 [2024-11-20 01:31:30.962291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.096 [2024-11-20 01:31:30.962403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.096 [2024-11-20 01:31:30.962426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.096 qpair failed and we were unable to recover it. 00:30:23.096 [2024-11-20 01:31:30.962512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.096 [2024-11-20 01:31:30.962604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.096 [2024-11-20 01:31:30.962629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.096 qpair failed and we were unable to recover it. 00:30:23.096 [2024-11-20 01:31:30.962746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.096 [2024-11-20 01:31:30.962847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.096 [2024-11-20 01:31:30.962872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.096 qpair failed and we were unable to recover it. 00:30:23.096 [2024-11-20 01:31:30.962998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.096 [2024-11-20 01:31:30.963085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.096 [2024-11-20 01:31:30.963110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.096 qpair failed and we were unable to recover it. 00:30:23.096 [2024-11-20 01:31:30.963196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.096 [2024-11-20 01:31:30.963289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.096 [2024-11-20 01:31:30.963313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.096 qpair failed and we were unable to recover it. 00:30:23.096 [2024-11-20 01:31:30.963454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.096 [2024-11-20 01:31:30.963541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.096 [2024-11-20 01:31:30.963567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.096 qpair failed and we were unable to recover it. 00:30:23.096 [2024-11-20 01:31:30.963682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.096 [2024-11-20 01:31:30.963795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.096 [2024-11-20 01:31:30.963820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.096 qpair failed and we were unable to recover it. 00:30:23.096 [2024-11-20 01:31:30.963964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.096 [2024-11-20 01:31:30.964064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.096 [2024-11-20 01:31:30.964103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.096 qpair failed and we were unable to recover it. 00:30:23.096 [2024-11-20 01:31:30.964204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.096 [2024-11-20 01:31:30.964298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.096 [2024-11-20 01:31:30.964324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.096 qpair failed and we were unable to recover it. 00:30:23.096 [2024-11-20 01:31:30.964410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.096 [2024-11-20 01:31:30.964530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.096 [2024-11-20 01:31:30.964555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.096 qpair failed and we were unable to recover it. 00:30:23.096 [2024-11-20 01:31:30.964674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.096 [2024-11-20 01:31:30.964757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.096 [2024-11-20 01:31:30.964782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.096 qpair failed and we were unable to recover it. 00:30:23.096 [2024-11-20 01:31:30.964900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.096 [2024-11-20 01:31:30.964994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.096 [2024-11-20 01:31:30.965019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.096 qpair failed and we were unable to recover it. 00:30:23.096 [2024-11-20 01:31:30.965102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.096 [2024-11-20 01:31:30.965219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.096 [2024-11-20 01:31:30.965245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.096 qpair failed and we were unable to recover it. 00:30:23.096 [2024-11-20 01:31:30.965337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.096 [2024-11-20 01:31:30.965463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.096 [2024-11-20 01:31:30.965489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.096 qpair failed and we were unable to recover it. 00:30:23.096 [2024-11-20 01:31:30.965608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.096 [2024-11-20 01:31:30.965720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.096 [2024-11-20 01:31:30.965746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.096 qpair failed and we were unable to recover it. 00:30:23.096 [2024-11-20 01:31:30.965860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.096 [2024-11-20 01:31:30.965970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.096 [2024-11-20 01:31:30.965995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.096 qpair failed and we were unable to recover it. 00:30:23.096 [2024-11-20 01:31:30.966084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.096 [2024-11-20 01:31:30.966238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.096 [2024-11-20 01:31:30.966263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.096 qpair failed and we were unable to recover it. 00:30:23.096 [2024-11-20 01:31:30.966354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.096 [2024-11-20 01:31:30.966479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.096 [2024-11-20 01:31:30.966504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.096 qpair failed and we were unable to recover it. 00:30:23.096 [2024-11-20 01:31:30.966592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.096 [2024-11-20 01:31:30.966703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.096 [2024-11-20 01:31:30.966728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.096 qpair failed and we were unable to recover it. 00:30:23.096 [2024-11-20 01:31:30.966844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.096 [2024-11-20 01:31:30.966927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.096 [2024-11-20 01:31:30.966952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.096 qpair failed and we were unable to recover it. 00:30:23.096 [2024-11-20 01:31:30.967040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.097 [2024-11-20 01:31:30.967165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.097 [2024-11-20 01:31:30.967191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.097 qpair failed and we were unable to recover it. 00:30:23.097 [2024-11-20 01:31:30.967307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.097 [2024-11-20 01:31:30.967392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.097 [2024-11-20 01:31:30.967417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.097 qpair failed and we were unable to recover it. 00:30:23.097 [2024-11-20 01:31:30.967509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.097 [2024-11-20 01:31:30.967594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.097 [2024-11-20 01:31:30.967619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.097 qpair failed and we were unable to recover it. 00:30:23.097 [2024-11-20 01:31:30.967738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.097 [2024-11-20 01:31:30.967820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.097 [2024-11-20 01:31:30.967845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.097 qpair failed and we were unable to recover it. 00:30:23.097 [2024-11-20 01:31:30.967991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.097 [2024-11-20 01:31:30.968117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.097 [2024-11-20 01:31:30.968143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.097 qpair failed and we were unable to recover it. 00:30:23.097 [2024-11-20 01:31:30.968253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.097 [2024-11-20 01:31:30.968369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.097 [2024-11-20 01:31:30.968394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.097 qpair failed and we were unable to recover it. 00:30:23.097 [2024-11-20 01:31:30.968512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.097 [2024-11-20 01:31:30.968602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.097 [2024-11-20 01:31:30.968629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.097 qpair failed and we were unable to recover it. 00:30:23.097 [2024-11-20 01:31:30.968724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.097 [2024-11-20 01:31:30.968824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.097 [2024-11-20 01:31:30.968850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.097 qpair failed and we were unable to recover it. 00:30:23.097 [2024-11-20 01:31:30.968937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.097 [2024-11-20 01:31:30.969049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.097 [2024-11-20 01:31:30.969082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.097 qpair failed and we were unable to recover it. 00:30:23.097 [2024-11-20 01:31:30.969198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.097 [2024-11-20 01:31:30.969317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.097 [2024-11-20 01:31:30.969344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.097 qpair failed and we were unable to recover it. 00:30:23.097 [2024-11-20 01:31:30.969463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.097 [2024-11-20 01:31:30.969574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.097 [2024-11-20 01:31:30.969600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.097 qpair failed and we were unable to recover it. 00:30:23.097 [2024-11-20 01:31:30.969710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.097 [2024-11-20 01:31:30.969793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.097 [2024-11-20 01:31:30.969819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.097 qpair failed and we were unable to recover it. 00:30:23.097 [2024-11-20 01:31:30.969936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.097 [2024-11-20 01:31:30.970029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.097 [2024-11-20 01:31:30.970054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.097 qpair failed and we were unable to recover it. 00:30:23.097 [2024-11-20 01:31:30.970158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.097 [2024-11-20 01:31:30.970253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.097 [2024-11-20 01:31:30.970279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.097 qpair failed and we were unable to recover it. 00:30:23.097 [2024-11-20 01:31:30.970378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.097 [2024-11-20 01:31:30.970465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.097 [2024-11-20 01:31:30.970490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.097 qpair failed and we were unable to recover it. 00:30:23.097 [2024-11-20 01:31:30.970614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.097 [2024-11-20 01:31:30.970723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.097 [2024-11-20 01:31:30.970747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.097 qpair failed and we were unable to recover it. 00:30:23.097 [2024-11-20 01:31:30.970835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.097 [2024-11-20 01:31:30.970915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.097 [2024-11-20 01:31:30.970940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.097 qpair failed and we were unable to recover it. 00:30:23.097 [2024-11-20 01:31:30.971060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.097 [2024-11-20 01:31:30.971165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.097 [2024-11-20 01:31:30.971190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.097 qpair failed and we were unable to recover it. 00:30:23.097 [2024-11-20 01:31:30.971283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.097 [2024-11-20 01:31:30.971377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.097 [2024-11-20 01:31:30.971401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.097 qpair failed and we were unable to recover it. 00:30:23.097 [2024-11-20 01:31:30.971509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.097 [2024-11-20 01:31:30.971621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.097 [2024-11-20 01:31:30.971646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.097 qpair failed and we were unable to recover it. 00:30:23.097 [2024-11-20 01:31:30.971729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.097 [2024-11-20 01:31:30.971847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.097 [2024-11-20 01:31:30.971871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.097 qpair failed and we were unable to recover it. 00:30:23.097 [2024-11-20 01:31:30.971955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.097 [2024-11-20 01:31:30.972041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.097 [2024-11-20 01:31:30.972066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.097 qpair failed and we were unable to recover it. 00:30:23.097 [2024-11-20 01:31:30.972199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.097 [2024-11-20 01:31:30.972288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.097 [2024-11-20 01:31:30.972313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.097 qpair failed and we were unable to recover it. 00:30:23.097 [2024-11-20 01:31:30.972460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.097 [2024-11-20 01:31:30.972575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.097 [2024-11-20 01:31:30.972600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.097 qpair failed and we were unable to recover it. 00:30:23.097 [2024-11-20 01:31:30.972683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.097 [2024-11-20 01:31:30.972828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.097 [2024-11-20 01:31:30.972851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.097 qpair failed and we were unable to recover it. 00:30:23.097 [2024-11-20 01:31:30.972937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.097 [2024-11-20 01:31:30.973024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.097 [2024-11-20 01:31:30.973050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.097 qpair failed and we were unable to recover it. 00:30:23.097 [2024-11-20 01:31:30.973204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.097 [2024-11-20 01:31:30.973330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.097 [2024-11-20 01:31:30.973359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.097 qpair failed and we were unable to recover it. 00:30:23.097 [2024-11-20 01:31:30.973482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.097 [2024-11-20 01:31:30.973571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.097 [2024-11-20 01:31:30.973602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.097 qpair failed and we were unable to recover it. 00:30:23.098 [2024-11-20 01:31:30.973696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.098 [2024-11-20 01:31:30.973782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.098 [2024-11-20 01:31:30.973807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.098 qpair failed and we were unable to recover it. 00:30:23.098 [2024-11-20 01:31:30.973901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.098 [2024-11-20 01:31:30.974015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.098 [2024-11-20 01:31:30.974040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.098 qpair failed and we were unable to recover it. 00:30:23.098 [2024-11-20 01:31:30.974137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.098 [2024-11-20 01:31:30.974252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.098 [2024-11-20 01:31:30.974278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.098 qpair failed and we were unable to recover it. 00:30:23.098 [2024-11-20 01:31:30.974367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.098 [2024-11-20 01:31:30.974507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.098 [2024-11-20 01:31:30.974533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.098 qpair failed and we were unable to recover it. 00:30:23.098 [2024-11-20 01:31:30.974617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.098 [2024-11-20 01:31:30.974697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.098 [2024-11-20 01:31:30.974722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.098 qpair failed and we were unable to recover it. 00:30:23.098 [2024-11-20 01:31:30.974841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.098 [2024-11-20 01:31:30.974924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.098 [2024-11-20 01:31:30.974949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.098 qpair failed and we were unable to recover it. 00:30:23.098 [2024-11-20 01:31:30.975077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.098 [2024-11-20 01:31:30.975192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.098 [2024-11-20 01:31:30.975217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.098 qpair failed and we were unable to recover it. 00:30:23.098 [2024-11-20 01:31:30.975335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.098 [2024-11-20 01:31:30.975453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.098 [2024-11-20 01:31:30.975478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.098 qpair failed and we were unable to recover it. 00:30:23.098 [2024-11-20 01:31:30.975596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.098 [2024-11-20 01:31:30.975709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.098 [2024-11-20 01:31:30.975734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.098 qpair failed and we were unable to recover it. 00:30:23.098 [2024-11-20 01:31:30.975821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.098 [2024-11-20 01:31:30.975916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.098 [2024-11-20 01:31:30.975948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.098 qpair failed and we were unable to recover it. 00:30:23.098 [2024-11-20 01:31:30.976035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.098 [2024-11-20 01:31:30.976134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.098 [2024-11-20 01:31:30.976160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.098 qpair failed and we were unable to recover it. 00:30:23.098 [2024-11-20 01:31:30.976246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.098 [2024-11-20 01:31:30.976357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.098 [2024-11-20 01:31:30.976383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.098 qpair failed and we were unable to recover it. 00:30:23.098 [2024-11-20 01:31:30.976502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.098 [2024-11-20 01:31:30.976586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.098 [2024-11-20 01:31:30.976611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.098 qpair failed and we were unable to recover it. 00:30:23.098 [2024-11-20 01:31:30.976709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.098 [2024-11-20 01:31:30.976800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.098 [2024-11-20 01:31:30.976825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.098 qpair failed and we were unable to recover it. 00:30:23.098 [2024-11-20 01:31:30.976915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.098 [2024-11-20 01:31:30.977030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.098 [2024-11-20 01:31:30.977055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.098 qpair failed and we were unable to recover it. 00:30:23.098 [2024-11-20 01:31:30.977204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.098 [2024-11-20 01:31:30.977301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.098 [2024-11-20 01:31:30.977327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.098 qpair failed and we were unable to recover it. 00:30:23.098 [2024-11-20 01:31:30.977482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.098 [2024-11-20 01:31:30.977622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.098 [2024-11-20 01:31:30.977648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.098 qpair failed and we were unable to recover it. 00:30:23.098 [2024-11-20 01:31:30.977769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.098 [2024-11-20 01:31:30.977912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.098 [2024-11-20 01:31:30.977937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.098 qpair failed and we were unable to recover it. 00:30:23.098 [2024-11-20 01:31:30.978053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.098 [2024-11-20 01:31:30.978146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.098 [2024-11-20 01:31:30.978172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.098 qpair failed and we were unable to recover it. 00:30:23.098 [2024-11-20 01:31:30.978259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.098 [2024-11-20 01:31:30.978358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.098 [2024-11-20 01:31:30.978387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.098 qpair failed and we were unable to recover it. 00:30:23.098 [2024-11-20 01:31:30.978507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.098 [2024-11-20 01:31:30.978597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.098 [2024-11-20 01:31:30.978622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.098 qpair failed and we were unable to recover it. 00:30:23.098 [2024-11-20 01:31:30.978738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.098 [2024-11-20 01:31:30.978884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.098 [2024-11-20 01:31:30.978909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.098 qpair failed and we were unable to recover it. 00:30:23.098 [2024-11-20 01:31:30.978994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.098 [2024-11-20 01:31:30.979082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.098 [2024-11-20 01:31:30.979109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.098 qpair failed and we were unable to recover it. 00:30:23.098 [2024-11-20 01:31:30.979198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.098 [2024-11-20 01:31:30.979318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.098 [2024-11-20 01:31:30.979343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.098 qpair failed and we were unable to recover it. 00:30:23.098 [2024-11-20 01:31:30.979431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.098 [2024-11-20 01:31:30.979544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.098 [2024-11-20 01:31:30.979569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.098 qpair failed and we were unable to recover it. 00:30:23.098 [2024-11-20 01:31:30.979714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.098 [2024-11-20 01:31:30.979836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.098 [2024-11-20 01:31:30.979863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.098 qpair failed and we were unable to recover it. 00:30:23.098 [2024-11-20 01:31:30.980009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.098 [2024-11-20 01:31:30.980101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.098 [2024-11-20 01:31:30.980126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.098 qpair failed and we were unable to recover it. 00:30:23.098 [2024-11-20 01:31:30.980268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.098 [2024-11-20 01:31:30.980357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.098 [2024-11-20 01:31:30.980383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.098 qpair failed and we were unable to recover it. 00:30:23.098 [2024-11-20 01:31:30.980500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.099 [2024-11-20 01:31:30.980578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.099 [2024-11-20 01:31:30.980603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.099 qpair failed and we were unable to recover it. 00:30:23.099 [2024-11-20 01:31:30.980697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.099 [2024-11-20 01:31:30.980808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.099 [2024-11-20 01:31:30.980837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.099 qpair failed and we were unable to recover it. 00:30:23.099 [2024-11-20 01:31:30.980950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.099 [2024-11-20 01:31:30.981048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.099 [2024-11-20 01:31:30.981078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.099 qpair failed and we were unable to recover it. 00:30:23.099 [2024-11-20 01:31:30.981195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.099 [2024-11-20 01:31:30.981321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.099 [2024-11-20 01:31:30.981347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.099 qpair failed and we were unable to recover it. 00:30:23.099 [2024-11-20 01:31:30.981487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.099 [2024-11-20 01:31:30.981576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.099 [2024-11-20 01:31:30.981602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.099 qpair failed and we were unable to recover it. 00:30:23.099 [2024-11-20 01:31:30.981722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.099 [2024-11-20 01:31:30.981814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.099 [2024-11-20 01:31:30.981839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.099 qpair failed and we were unable to recover it. 00:30:23.099 [2024-11-20 01:31:30.981930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.099 [2024-11-20 01:31:30.982051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.099 [2024-11-20 01:31:30.982085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.099 qpair failed and we were unable to recover it. 00:30:23.099 [2024-11-20 01:31:30.982213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.099 [2024-11-20 01:31:30.982293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.099 [2024-11-20 01:31:30.982317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.099 qpair failed and we were unable to recover it. 00:30:23.099 [2024-11-20 01:31:30.982360] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:30:23.099 [2024-11-20 01:31:30.982425] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:[2024-11-20 01:31:30.982424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.099 5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:23.099 [2024-11-20 01:31:30.982538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.099 [2024-11-20 01:31:30.982562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.099 qpair failed and we were unable to recover it. 00:30:23.099 [2024-11-20 01:31:30.982676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.099 [2024-11-20 01:31:30.982786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.099 [2024-11-20 01:31:30.982809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.099 qpair failed and we were unable to recover it. 00:30:23.099 [2024-11-20 01:31:30.982929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.099 [2024-11-20 01:31:30.983013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.099 [2024-11-20 01:31:30.983039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.099 qpair failed and we were unable to recover it. 00:30:23.099 [2024-11-20 01:31:30.983166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.099 [2024-11-20 01:31:30.983253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.099 [2024-11-20 01:31:30.983277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.099 qpair failed and we were unable to recover it. 00:30:23.099 [2024-11-20 01:31:30.983404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.099 [2024-11-20 01:31:30.983489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.099 [2024-11-20 01:31:30.983515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.099 qpair failed and we were unable to recover it. 00:30:23.099 [2024-11-20 01:31:30.983638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.099 [2024-11-20 01:31:30.983734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.099 [2024-11-20 01:31:30.983760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.099 qpair failed and we were unable to recover it. 00:30:23.099 [2024-11-20 01:31:30.983869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.099 [2024-11-20 01:31:30.983960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.099 [2024-11-20 01:31:30.983985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.099 qpair failed and we were unable to recover it. 00:30:23.099 [2024-11-20 01:31:30.984077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.099 [2024-11-20 01:31:30.984168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.099 [2024-11-20 01:31:30.984193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.099 qpair failed and we were unable to recover it. 00:30:23.099 [2024-11-20 01:31:30.984314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.099 [2024-11-20 01:31:30.984427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.099 [2024-11-20 01:31:30.984452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.099 qpair failed and we were unable to recover it. 00:30:23.099 [2024-11-20 01:31:30.984540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.099 [2024-11-20 01:31:30.984659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.099 [2024-11-20 01:31:30.984683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.099 qpair failed and we were unable to recover it. 00:30:23.099 [2024-11-20 01:31:30.984828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.099 [2024-11-20 01:31:30.984941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.099 [2024-11-20 01:31:30.984965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.099 qpair failed and we were unable to recover it. 00:30:23.099 [2024-11-20 01:31:30.985088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.099 [2024-11-20 01:31:30.985227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.099 [2024-11-20 01:31:30.985251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.099 qpair failed and we were unable to recover it. 00:30:23.099 [2024-11-20 01:31:30.985349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.099 [2024-11-20 01:31:30.985465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.099 [2024-11-20 01:31:30.985491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.099 qpair failed and we were unable to recover it. 00:30:23.099 [2024-11-20 01:31:30.985617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.099 [2024-11-20 01:31:30.985708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.099 [2024-11-20 01:31:30.985734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.099 qpair failed and we were unable to recover it. 00:30:23.099 [2024-11-20 01:31:30.985851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.099 [2024-11-20 01:31:30.985945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.099 [2024-11-20 01:31:30.985971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.099 qpair failed and we were unable to recover it. 00:30:23.099 [2024-11-20 01:31:30.986094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.099 [2024-11-20 01:31:30.986219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.099 [2024-11-20 01:31:30.986244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.099 qpair failed and we were unable to recover it. 00:30:23.099 [2024-11-20 01:31:30.986362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.099 [2024-11-20 01:31:30.986473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.099 [2024-11-20 01:31:30.986498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.099 qpair failed and we were unable to recover it. 00:30:23.099 [2024-11-20 01:31:30.986583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.099 [2024-11-20 01:31:30.986676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.099 [2024-11-20 01:31:30.986701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.099 qpair failed and we were unable to recover it. 00:30:23.099 [2024-11-20 01:31:30.986821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.099 [2024-11-20 01:31:30.986915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.099 [2024-11-20 01:31:30.986940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.099 qpair failed and we were unable to recover it. 00:30:23.099 [2024-11-20 01:31:30.987055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.099 [2024-11-20 01:31:30.987150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.099 [2024-11-20 01:31:30.987177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.100 qpair failed and we were unable to recover it. 00:30:23.100 [2024-11-20 01:31:30.987295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.100 [2024-11-20 01:31:30.987389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.100 [2024-11-20 01:31:30.987414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.100 qpair failed and we were unable to recover it. 00:30:23.100 [2024-11-20 01:31:30.987526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.100 [2024-11-20 01:31:30.987606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.100 [2024-11-20 01:31:30.987631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.100 qpair failed and we were unable to recover it. 00:30:23.100 [2024-11-20 01:31:30.987747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.100 [2024-11-20 01:31:30.987863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.100 [2024-11-20 01:31:30.987888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.100 qpair failed and we were unable to recover it. 00:30:23.100 [2024-11-20 01:31:30.988010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.100 [2024-11-20 01:31:30.988135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.100 [2024-11-20 01:31:30.988161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.100 qpair failed and we were unable to recover it. 00:30:23.100 [2024-11-20 01:31:30.988278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.100 [2024-11-20 01:31:30.988369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.100 [2024-11-20 01:31:30.988393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.100 qpair failed and we were unable to recover it. 00:30:23.100 [2024-11-20 01:31:30.988509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.100 [2024-11-20 01:31:30.988624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.100 [2024-11-20 01:31:30.988649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.100 qpair failed and we were unable to recover it. 00:30:23.100 [2024-11-20 01:31:30.988762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.100 [2024-11-20 01:31:30.988876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.100 [2024-11-20 01:31:30.988900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.100 qpair failed and we were unable to recover it. 00:30:23.100 [2024-11-20 01:31:30.989018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.100 [2024-11-20 01:31:30.989108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.100 [2024-11-20 01:31:30.989133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.100 qpair failed and we were unable to recover it. 00:30:23.100 [2024-11-20 01:31:30.989250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.100 [2024-11-20 01:31:30.989337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.100 [2024-11-20 01:31:30.989362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.100 qpair failed and we were unable to recover it. 00:30:23.100 [2024-11-20 01:31:30.989451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.100 [2024-11-20 01:31:30.989560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.100 [2024-11-20 01:31:30.989586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.100 qpair failed and we were unable to recover it. 00:30:23.100 [2024-11-20 01:31:30.989729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.100 [2024-11-20 01:31:30.989848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.100 [2024-11-20 01:31:30.989874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.100 qpair failed and we were unable to recover it. 00:30:23.100 [2024-11-20 01:31:30.989995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.100 [2024-11-20 01:31:30.990093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.100 [2024-11-20 01:31:30.990119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.100 qpair failed and we were unable to recover it. 00:30:23.100 [2024-11-20 01:31:30.990208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.100 [2024-11-20 01:31:30.990295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.100 [2024-11-20 01:31:30.990322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.100 qpair failed and we were unable to recover it. 00:30:23.100 [2024-11-20 01:31:30.990415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.100 [2024-11-20 01:31:30.990528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.100 [2024-11-20 01:31:30.990554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.100 qpair failed and we were unable to recover it. 00:30:23.100 [2024-11-20 01:31:30.990652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.100 [2024-11-20 01:31:30.990740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.100 [2024-11-20 01:31:30.990767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.100 qpair failed and we were unable to recover it. 00:30:23.100 [2024-11-20 01:31:30.990884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.100 [2024-11-20 01:31:30.990996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.100 [2024-11-20 01:31:30.991021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.100 qpair failed and we were unable to recover it. 00:30:23.100 [2024-11-20 01:31:30.991117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.100 [2024-11-20 01:31:30.991209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.100 [2024-11-20 01:31:30.991234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.100 qpair failed and we were unable to recover it. 00:30:23.100 [2024-11-20 01:31:30.991382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.100 [2024-11-20 01:31:30.991470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.100 [2024-11-20 01:31:30.991495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.100 qpair failed and we were unable to recover it. 00:30:23.100 [2024-11-20 01:31:30.991587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.100 [2024-11-20 01:31:30.991703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.100 [2024-11-20 01:31:30.991728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.100 qpair failed and we were unable to recover it. 00:30:23.100 [2024-11-20 01:31:30.991851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.100 [2024-11-20 01:31:30.991943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.100 [2024-11-20 01:31:30.991969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.100 qpair failed and we were unable to recover it. 00:30:23.100 [2024-11-20 01:31:30.992063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.100 [2024-11-20 01:31:30.992215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.100 [2024-11-20 01:31:30.992241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.100 qpair failed and we were unable to recover it. 00:30:23.100 [2024-11-20 01:31:30.992326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.100 [2024-11-20 01:31:30.992437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.100 [2024-11-20 01:31:30.992462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.100 qpair failed and we were unable to recover it. 00:30:23.100 [2024-11-20 01:31:30.992587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.100 [2024-11-20 01:31:30.992668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.100 [2024-11-20 01:31:30.992693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd44000b90 with addr=10.0.0.2, port=4420 00:30:23.100 qpair failed and we were unable to recover it. 00:30:23.100 [2024-11-20 01:31:30.992818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.100 [2024-11-20 01:31:30.992934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.101 [2024-11-20 01:31:30.992959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.101 qpair failed and we were unable to recover it. 00:30:23.101 [2024-11-20 01:31:30.993080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.101 [2024-11-20 01:31:30.993169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.101 [2024-11-20 01:31:30.993195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.101 qpair failed and we were unable to recover it. 00:30:23.101 [2024-11-20 01:31:30.993321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.101 [2024-11-20 01:31:30.993413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.101 [2024-11-20 01:31:30.993438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.101 qpair failed and we were unable to recover it. 00:30:23.101 [2024-11-20 01:31:30.993530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.101 [2024-11-20 01:31:30.993643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.101 [2024-11-20 01:31:30.993667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.101 qpair failed and we were unable to recover it. 00:30:23.101 [2024-11-20 01:31:30.993783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.101 [2024-11-20 01:31:30.993899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.101 [2024-11-20 01:31:30.993923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.101 qpair failed and we were unable to recover it. 00:30:23.101 [2024-11-20 01:31:30.994039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.101 [2024-11-20 01:31:30.994140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.101 [2024-11-20 01:31:30.994166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.101 qpair failed and we were unable to recover it. 00:30:23.101 [2024-11-20 01:31:30.994280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.101 [2024-11-20 01:31:30.994400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.101 [2024-11-20 01:31:30.994425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.101 qpair failed and we were unable to recover it. 00:30:23.101 [2024-11-20 01:31:30.994510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.101 [2024-11-20 01:31:30.994636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.101 [2024-11-20 01:31:30.994661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.101 qpair failed and we were unable to recover it. 00:30:23.101 [2024-11-20 01:31:30.994748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.101 [2024-11-20 01:31:30.994864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.101 [2024-11-20 01:31:30.994888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.101 qpair failed and we were unable to recover it. 00:30:23.101 [2024-11-20 01:31:30.994999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.101 [2024-11-20 01:31:30.995096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.101 [2024-11-20 01:31:30.995122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.101 qpair failed and we were unable to recover it. 00:30:23.101 [2024-11-20 01:31:30.995244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.101 [2024-11-20 01:31:30.995362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.101 [2024-11-20 01:31:30.995386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.101 qpair failed and we were unable to recover it. 00:30:23.101 [2024-11-20 01:31:30.995493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.101 [2024-11-20 01:31:30.995607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.101 [2024-11-20 01:31:30.995631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.101 qpair failed and we were unable to recover it. 00:30:23.101 [2024-11-20 01:31:30.995711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.101 [2024-11-20 01:31:30.995797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.101 [2024-11-20 01:31:30.995824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.101 qpair failed and we were unable to recover it. 00:30:23.101 [2024-11-20 01:31:30.995939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.101 [2024-11-20 01:31:30.996027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.101 [2024-11-20 01:31:30.996053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.101 qpair failed and we were unable to recover it. 00:30:23.101 [2024-11-20 01:31:30.996192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.101 [2024-11-20 01:31:30.996288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.101 [2024-11-20 01:31:30.996313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.101 qpair failed and we were unable to recover it. 00:30:23.101 [2024-11-20 01:31:30.996430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.101 [2024-11-20 01:31:30.996545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.101 [2024-11-20 01:31:30.996569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.101 qpair failed and we were unable to recover it. 00:30:23.101 [2024-11-20 01:31:30.996651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.101 [2024-11-20 01:31:30.996745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.101 [2024-11-20 01:31:30.996770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.101 qpair failed and we were unable to recover it. 00:30:23.101 [2024-11-20 01:31:30.996866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.101 [2024-11-20 01:31:30.996955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.101 [2024-11-20 01:31:30.996981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.101 qpair failed and we were unable to recover it. 00:30:23.101 [2024-11-20 01:31:30.997092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.101 [2024-11-20 01:31:30.997173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.101 [2024-11-20 01:31:30.997199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.101 qpair failed and we were unable to recover it. 00:30:23.101 [2024-11-20 01:31:30.997346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.101 [2024-11-20 01:31:30.997432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.101 [2024-11-20 01:31:30.997456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.101 qpair failed and we were unable to recover it. 00:30:23.101 [2024-11-20 01:31:30.997599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.101 [2024-11-20 01:31:30.997724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.101 [2024-11-20 01:31:30.997748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.101 qpair failed and we were unable to recover it. 00:30:23.101 [2024-11-20 01:31:30.997889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.101 [2024-11-20 01:31:30.997978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.101 [2024-11-20 01:31:30.998004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.101 qpair failed and we were unable to recover it. 00:30:23.101 [2024-11-20 01:31:30.998117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.101 [2024-11-20 01:31:30.998233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.101 [2024-11-20 01:31:30.998257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.101 qpair failed and we were unable to recover it. 00:30:23.101 [2024-11-20 01:31:30.998354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.101 [2024-11-20 01:31:30.998494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.101 [2024-11-20 01:31:30.998518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.101 qpair failed and we were unable to recover it. 00:30:23.101 [2024-11-20 01:31:30.998634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.101 [2024-11-20 01:31:30.998721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.101 [2024-11-20 01:31:30.998745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.101 qpair failed and we were unable to recover it. 00:30:23.101 [2024-11-20 01:31:30.998834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.101 [2024-11-20 01:31:30.998977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.101 [2024-11-20 01:31:30.999001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.101 qpair failed and we were unable to recover it. 00:30:23.101 [2024-11-20 01:31:30.999094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.101 [2024-11-20 01:31:30.999202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.101 [2024-11-20 01:31:30.999226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.101 qpair failed and we were unable to recover it. 00:30:23.101 [2024-11-20 01:31:30.999345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.101 [2024-11-20 01:31:30.999431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.101 [2024-11-20 01:31:30.999456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.101 qpair failed and we were unable to recover it. 00:30:23.101 [2024-11-20 01:31:30.999578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.101 [2024-11-20 01:31:30.999696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.101 [2024-11-20 01:31:30.999720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.101 qpair failed and we were unable to recover it. 00:30:23.102 [2024-11-20 01:31:30.999834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.102 [2024-11-20 01:31:30.999918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.102 [2024-11-20 01:31:30.999942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.102 qpair failed and we were unable to recover it. 00:30:23.102 [2024-11-20 01:31:31.000063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.102 [2024-11-20 01:31:31.000157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.102 [2024-11-20 01:31:31.000182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.102 qpair failed and we were unable to recover it. 00:30:23.102 [2024-11-20 01:31:31.000275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.102 [2024-11-20 01:31:31.000359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.102 [2024-11-20 01:31:31.000382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.102 qpair failed and we were unable to recover it. 00:30:23.102 [2024-11-20 01:31:31.000470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.102 [2024-11-20 01:31:31.000552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.102 [2024-11-20 01:31:31.000577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.102 qpair failed and we were unable to recover it. 00:30:23.102 [2024-11-20 01:31:31.000692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.102 [2024-11-20 01:31:31.000810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.102 [2024-11-20 01:31:31.000834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.102 qpair failed and we were unable to recover it. 00:30:23.102 [2024-11-20 01:31:31.000950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.102 [2024-11-20 01:31:31.001027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.102 [2024-11-20 01:31:31.001051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.102 qpair failed and we were unable to recover it. 00:30:23.102 [2024-11-20 01:31:31.001157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.102 [2024-11-20 01:31:31.001245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.102 [2024-11-20 01:31:31.001269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.102 qpair failed and we were unable to recover it. 00:30:23.102 [2024-11-20 01:31:31.001383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.102 [2024-11-20 01:31:31.001462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.102 [2024-11-20 01:31:31.001487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.102 qpair failed and we were unable to recover it. 00:30:23.102 [2024-11-20 01:31:31.001595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.102 [2024-11-20 01:31:31.001683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.102 [2024-11-20 01:31:31.001707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.102 qpair failed and we were unable to recover it. 00:30:23.102 [2024-11-20 01:31:31.001798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.102 [2024-11-20 01:31:31.001884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.102 [2024-11-20 01:31:31.001908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.102 qpair failed and we were unable to recover it. 00:30:23.102 [2024-11-20 01:31:31.001993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.102 [2024-11-20 01:31:31.002079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.102 [2024-11-20 01:31:31.002105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.102 qpair failed and we were unable to recover it. 00:30:23.102 [2024-11-20 01:31:31.002189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.102 [2024-11-20 01:31:31.002338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.102 [2024-11-20 01:31:31.002364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.102 qpair failed and we were unable to recover it. 00:30:23.102 [2024-11-20 01:31:31.002457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.102 [2024-11-20 01:31:31.002575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.102 [2024-11-20 01:31:31.002599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.102 qpair failed and we were unable to recover it. 00:30:23.102 [2024-11-20 01:31:31.002683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.102 [2024-11-20 01:31:31.002774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.102 [2024-11-20 01:31:31.002798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.102 qpair failed and we were unable to recover it. 00:30:23.102 [2024-11-20 01:31:31.002893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.102 [2024-11-20 01:31:31.002985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.102 [2024-11-20 01:31:31.003010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.102 qpair failed and we were unable to recover it. 00:30:23.102 [2024-11-20 01:31:31.003096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.102 [2024-11-20 01:31:31.003181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.102 [2024-11-20 01:31:31.003206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.102 qpair failed and we were unable to recover it. 00:30:23.102 [2024-11-20 01:31:31.003319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.102 [2024-11-20 01:31:31.003431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.102 [2024-11-20 01:31:31.003456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.102 qpair failed and we were unable to recover it. 00:30:23.102 [2024-11-20 01:31:31.003613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.102 [2024-11-20 01:31:31.003709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.102 [2024-11-20 01:31:31.003734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.102 qpair failed and we were unable to recover it. 00:30:23.102 [2024-11-20 01:31:31.003843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.102 [2024-11-20 01:31:31.003927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.102 [2024-11-20 01:31:31.003951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.102 qpair failed and we were unable to recover it. 00:30:23.102 [2024-11-20 01:31:31.004036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.102 [2024-11-20 01:31:31.004180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.102 [2024-11-20 01:31:31.004206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.102 qpair failed and we were unable to recover it. 00:30:23.102 [2024-11-20 01:31:31.004344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.102 [2024-11-20 01:31:31.004431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.102 [2024-11-20 01:31:31.004456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.102 qpair failed and we were unable to recover it. 00:30:23.102 [2024-11-20 01:31:31.004538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.102 [2024-11-20 01:31:31.004677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.102 [2024-11-20 01:31:31.004703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.102 qpair failed and we were unable to recover it. 00:30:23.102 [2024-11-20 01:31:31.004788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.102 [2024-11-20 01:31:31.004902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.102 [2024-11-20 01:31:31.004926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.102 qpair failed and we were unable to recover it. 00:30:23.102 [2024-11-20 01:31:31.005006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.102 [2024-11-20 01:31:31.005121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.102 [2024-11-20 01:31:31.005148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.102 qpair failed and we were unable to recover it. 00:30:23.102 [2024-11-20 01:31:31.005266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.102 [2024-11-20 01:31:31.005359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.102 [2024-11-20 01:31:31.005384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.102 qpair failed and we were unable to recover it. 00:30:23.102 [2024-11-20 01:31:31.005477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.102 [2024-11-20 01:31:31.005562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.102 [2024-11-20 01:31:31.005588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.102 qpair failed and we were unable to recover it. 00:30:23.102 [2024-11-20 01:31:31.005709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.102 [2024-11-20 01:31:31.005826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.102 [2024-11-20 01:31:31.005851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.102 qpair failed and we were unable to recover it. 00:30:23.102 [2024-11-20 01:31:31.005933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.102 [2024-11-20 01:31:31.006056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.102 [2024-11-20 01:31:31.006088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.102 qpair failed and we were unable to recover it. 00:30:23.102 [2024-11-20 01:31:31.006201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.102 [2024-11-20 01:31:31.006314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.103 [2024-11-20 01:31:31.006339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.103 qpair failed and we were unable to recover it. 00:30:23.103 [2024-11-20 01:31:31.006423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.103 [2024-11-20 01:31:31.006535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.103 [2024-11-20 01:31:31.006560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.103 qpair failed and we were unable to recover it. 00:30:23.103 [2024-11-20 01:31:31.006649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.103 [2024-11-20 01:31:31.006791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.103 [2024-11-20 01:31:31.006816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.103 qpair failed and we were unable to recover it. 00:30:23.103 [2024-11-20 01:31:31.006926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.103 [2024-11-20 01:31:31.007012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.103 [2024-11-20 01:31:31.007041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.103 qpair failed and we were unable to recover it. 00:30:23.103 [2024-11-20 01:31:31.007144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.103 [2024-11-20 01:31:31.007254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.103 [2024-11-20 01:31:31.007279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.103 qpair failed and we were unable to recover it. 00:30:23.103 [2024-11-20 01:31:31.007371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.103 [2024-11-20 01:31:31.007493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.103 [2024-11-20 01:31:31.007518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.103 qpair failed and we were unable to recover it. 00:30:23.103 [2024-11-20 01:31:31.007641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.103 [2024-11-20 01:31:31.007731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.103 [2024-11-20 01:31:31.007756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.103 qpair failed and we were unable to recover it. 00:30:23.103 [2024-11-20 01:31:31.007846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.103 [2024-11-20 01:31:31.007957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.103 [2024-11-20 01:31:31.007982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.103 qpair failed and we were unable to recover it. 00:30:23.103 [2024-11-20 01:31:31.008066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.103 [2024-11-20 01:31:31.008189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.103 [2024-11-20 01:31:31.008214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.103 qpair failed and we were unable to recover it. 00:30:23.103 [2024-11-20 01:31:31.008328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.103 [2024-11-20 01:31:31.008419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.103 [2024-11-20 01:31:31.008444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.103 qpair failed and we were unable to recover it. 00:30:23.103 [2024-11-20 01:31:31.008587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.103 [2024-11-20 01:31:31.008672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.103 [2024-11-20 01:31:31.008699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.103 qpair failed and we were unable to recover it. 00:30:23.103 [2024-11-20 01:31:31.008796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.103 [2024-11-20 01:31:31.008936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.103 [2024-11-20 01:31:31.008961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.103 qpair failed and we were unable to recover it. 00:30:23.103 [2024-11-20 01:31:31.009052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.103 [2024-11-20 01:31:31.009142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.103 [2024-11-20 01:31:31.009168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.103 qpair failed and we were unable to recover it. 00:30:23.103 [2024-11-20 01:31:31.009284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.103 [2024-11-20 01:31:31.009428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.103 [2024-11-20 01:31:31.009457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.103 qpair failed and we were unable to recover it. 00:30:23.103 [2024-11-20 01:31:31.009577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.103 [2024-11-20 01:31:31.009697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.103 [2024-11-20 01:31:31.009722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.103 qpair failed and we were unable to recover it. 00:30:23.103 [2024-11-20 01:31:31.009836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.103 [2024-11-20 01:31:31.009923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.103 [2024-11-20 01:31:31.009948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.103 qpair failed and we were unable to recover it. 00:30:23.103 [2024-11-20 01:31:31.010065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.103 [2024-11-20 01:31:31.010195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.103 [2024-11-20 01:31:31.010220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.103 qpair failed and we were unable to recover it. 00:30:23.103 [2024-11-20 01:31:31.010306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.103 [2024-11-20 01:31:31.010420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.103 [2024-11-20 01:31:31.010445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.103 qpair failed and we were unable to recover it. 00:30:23.103 [2024-11-20 01:31:31.010536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.103 [2024-11-20 01:31:31.010622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.103 [2024-11-20 01:31:31.010647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.103 qpair failed and we were unable to recover it. 00:30:23.103 [2024-11-20 01:31:31.010764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.103 [2024-11-20 01:31:31.010879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.103 [2024-11-20 01:31:31.010904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.103 qpair failed and we were unable to recover it. 00:30:23.103 [2024-11-20 01:31:31.011024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.103 [2024-11-20 01:31:31.011152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.103 [2024-11-20 01:31:31.011178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.103 qpair failed and we were unable to recover it. 00:30:23.103 [2024-11-20 01:31:31.011300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.103 [2024-11-20 01:31:31.011420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.103 [2024-11-20 01:31:31.011444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.103 qpair failed and we were unable to recover it. 00:30:23.103 [2024-11-20 01:31:31.011531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.103 [2024-11-20 01:31:31.011624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.103 [2024-11-20 01:31:31.011651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.103 qpair failed and we were unable to recover it. 00:30:23.103 [2024-11-20 01:31:31.011732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.103 [2024-11-20 01:31:31.011829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.103 [2024-11-20 01:31:31.011860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.103 qpair failed and we were unable to recover it. 00:30:23.103 [2024-11-20 01:31:31.011973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.103 [2024-11-20 01:31:31.012053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.103 [2024-11-20 01:31:31.012086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.103 qpair failed and we were unable to recover it. 00:30:23.103 [2024-11-20 01:31:31.012179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.103 [2024-11-20 01:31:31.012321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.103 [2024-11-20 01:31:31.012346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.103 qpair failed and we were unable to recover it. 00:30:23.103 [2024-11-20 01:31:31.012464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.103 [2024-11-20 01:31:31.012577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.103 [2024-11-20 01:31:31.012602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.103 qpair failed and we were unable to recover it. 00:30:23.103 [2024-11-20 01:31:31.012692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.103 [2024-11-20 01:31:31.012808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.103 [2024-11-20 01:31:31.012835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.103 qpair failed and we were unable to recover it. 00:30:23.103 [2024-11-20 01:31:31.012952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.103 [2024-11-20 01:31:31.013075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.104 [2024-11-20 01:31:31.013102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.104 qpair failed and we were unable to recover it. 00:30:23.104 [2024-11-20 01:31:31.013214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.104 [2024-11-20 01:31:31.013297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.104 [2024-11-20 01:31:31.013322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.104 qpair failed and we were unable to recover it. 00:30:23.104 [2024-11-20 01:31:31.013442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.104 [2024-11-20 01:31:31.013525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.104 [2024-11-20 01:31:31.013549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.104 qpair failed and we were unable to recover it. 00:30:23.104 [2024-11-20 01:31:31.013642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.104 [2024-11-20 01:31:31.013757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.104 [2024-11-20 01:31:31.013783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.104 qpair failed and we were unable to recover it. 00:30:23.104 [2024-11-20 01:31:31.013862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.104 [2024-11-20 01:31:31.013977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.104 [2024-11-20 01:31:31.014002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.104 qpair failed and we were unable to recover it. 00:30:23.104 [2024-11-20 01:31:31.014088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.104 [2024-11-20 01:31:31.014238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.104 [2024-11-20 01:31:31.014267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.104 qpair failed and we were unable to recover it. 00:30:23.104 [2024-11-20 01:31:31.014362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.104 [2024-11-20 01:31:31.014469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.104 [2024-11-20 01:31:31.014493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.104 qpair failed and we were unable to recover it. 00:30:23.104 [2024-11-20 01:31:31.014588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.104 [2024-11-20 01:31:31.014677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.104 [2024-11-20 01:31:31.014701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.104 qpair failed and we were unable to recover it. 00:30:23.104 [2024-11-20 01:31:31.014813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.104 [2024-11-20 01:31:31.014926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.104 [2024-11-20 01:31:31.014951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.104 qpair failed and we were unable to recover it. 00:30:23.104 [2024-11-20 01:31:31.015109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.104 [2024-11-20 01:31:31.015200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.104 [2024-11-20 01:31:31.015225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.104 qpair failed and we were unable to recover it. 00:30:23.104 [2024-11-20 01:31:31.015317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.104 [2024-11-20 01:31:31.015437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.104 [2024-11-20 01:31:31.015462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.104 qpair failed and we were unable to recover it. 00:30:23.104 [2024-11-20 01:31:31.015573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.104 [2024-11-20 01:31:31.015688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.104 [2024-11-20 01:31:31.015712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.104 qpair failed and we were unable to recover it. 00:30:23.104 [2024-11-20 01:31:31.015831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.104 [2024-11-20 01:31:31.015944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.104 [2024-11-20 01:31:31.015968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.104 qpair failed and we were unable to recover it. 00:30:23.104 [2024-11-20 01:31:31.016081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.104 [2024-11-20 01:31:31.016175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.104 [2024-11-20 01:31:31.016201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.104 qpair failed and we were unable to recover it. 00:30:23.104 [2024-11-20 01:31:31.016297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.104 [2024-11-20 01:31:31.016437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.104 [2024-11-20 01:31:31.016462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.104 qpair failed and we were unable to recover it. 00:30:23.104 [2024-11-20 01:31:31.016604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.104 [2024-11-20 01:31:31.016750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.104 [2024-11-20 01:31:31.016775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.104 qpair failed and we were unable to recover it. 00:30:23.104 [2024-11-20 01:31:31.016872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.104 [2024-11-20 01:31:31.016964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.104 [2024-11-20 01:31:31.016991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.104 qpair failed and we were unable to recover it. 00:30:23.104 [2024-11-20 01:31:31.017090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.104 [2024-11-20 01:31:31.017206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.104 [2024-11-20 01:31:31.017232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.104 qpair failed and we were unable to recover it. 00:30:23.104 [2024-11-20 01:31:31.017322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.104 [2024-11-20 01:31:31.017414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.104 [2024-11-20 01:31:31.017438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.104 qpair failed and we were unable to recover it. 00:30:23.104 [2024-11-20 01:31:31.017553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.104 [2024-11-20 01:31:31.017667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.104 [2024-11-20 01:31:31.017692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.104 qpair failed and we were unable to recover it. 00:30:23.104 [2024-11-20 01:31:31.017787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.104 [2024-11-20 01:31:31.017869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.104 [2024-11-20 01:31:31.017894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.104 qpair failed and we were unable to recover it. 00:30:23.104 [2024-11-20 01:31:31.017976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.104 [2024-11-20 01:31:31.018120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.104 [2024-11-20 01:31:31.018145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.104 qpair failed and we were unable to recover it. 00:30:23.104 [2024-11-20 01:31:31.018228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.104 [2024-11-20 01:31:31.018339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.104 [2024-11-20 01:31:31.018363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.104 qpair failed and we were unable to recover it. 00:30:23.104 [2024-11-20 01:31:31.018448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.104 [2024-11-20 01:31:31.018532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.104 [2024-11-20 01:31:31.018557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.104 qpair failed and we were unable to recover it. 00:30:23.104 [2024-11-20 01:31:31.018639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.104 [2024-11-20 01:31:31.018727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.104 [2024-11-20 01:31:31.018751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.104 qpair failed and we were unable to recover it. 00:30:23.104 [2024-11-20 01:31:31.018863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.104 [2024-11-20 01:31:31.019014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.104 [2024-11-20 01:31:31.019039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.104 qpair failed and we were unable to recover it. 00:30:23.104 [2024-11-20 01:31:31.019145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.104 [2024-11-20 01:31:31.019267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.104 [2024-11-20 01:31:31.019292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.104 qpair failed and we were unable to recover it. 00:30:23.104 [2024-11-20 01:31:31.019439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.104 [2024-11-20 01:31:31.019579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.104 [2024-11-20 01:31:31.019604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.104 qpair failed and we were unable to recover it. 00:30:23.104 [2024-11-20 01:31:31.019721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.104 [2024-11-20 01:31:31.019806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.104 [2024-11-20 01:31:31.019831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.104 qpair failed and we were unable to recover it. 00:30:23.104 EAL: No free 2048 kB hugepages reported on node 1 00:30:23.105 [2024-11-20 01:31:31.019949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.105 [2024-11-20 01:31:31.020037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.105 [2024-11-20 01:31:31.020062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.105 qpair failed and we were unable to recover it. 00:30:23.105 [2024-11-20 01:31:31.020174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.105 [2024-11-20 01:31:31.020300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.105 [2024-11-20 01:31:31.020324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.105 qpair failed and we were unable to recover it. 00:30:23.105 [2024-11-20 01:31:31.020415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.105 [2024-11-20 01:31:31.020512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.105 [2024-11-20 01:31:31.020536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.105 qpair failed and we were unable to recover it. 00:30:23.105 [2024-11-20 01:31:31.020652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.105 [2024-11-20 01:31:31.020772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.105 [2024-11-20 01:31:31.020797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.105 qpair failed and we were unable to recover it. 00:30:23.105 [2024-11-20 01:31:31.020923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.105 [2024-11-20 01:31:31.021042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.105 [2024-11-20 01:31:31.021066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.105 qpair failed and we were unable to recover it. 00:30:23.105 [2024-11-20 01:31:31.021162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.105 [2024-11-20 01:31:31.021270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.105 [2024-11-20 01:31:31.021295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.105 qpair failed and we were unable to recover it. 00:30:23.105 [2024-11-20 01:31:31.021418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.105 [2024-11-20 01:31:31.021532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.105 [2024-11-20 01:31:31.021556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.105 qpair failed and we were unable to recover it. 00:30:23.105 [2024-11-20 01:31:31.021680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.105 [2024-11-20 01:31:31.021792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.105 [2024-11-20 01:31:31.021817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.105 qpair failed and we were unable to recover it. 00:30:23.105 [2024-11-20 01:31:31.021903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.105 [2024-11-20 01:31:31.022019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.105 [2024-11-20 01:31:31.022044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.105 qpair failed and we were unable to recover it. 00:30:23.105 [2024-11-20 01:31:31.022144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.105 [2024-11-20 01:31:31.022255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.105 [2024-11-20 01:31:31.022279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.105 qpair failed and we were unable to recover it. 00:30:23.105 [2024-11-20 01:31:31.022367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.105 [2024-11-20 01:31:31.022472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.105 [2024-11-20 01:31:31.022497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.105 qpair failed and we were unable to recover it. 00:30:23.105 [2024-11-20 01:31:31.022612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.105 [2024-11-20 01:31:31.022700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.105 [2024-11-20 01:31:31.022724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.105 qpair failed and we were unable to recover it. 00:30:23.105 [2024-11-20 01:31:31.022813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.105 [2024-11-20 01:31:31.022899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.105 [2024-11-20 01:31:31.022924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.105 qpair failed and we were unable to recover it. 00:30:23.105 [2024-11-20 01:31:31.023014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.105 [2024-11-20 01:31:31.023162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.105 [2024-11-20 01:31:31.023188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.105 qpair failed and we were unable to recover it. 00:30:23.105 [2024-11-20 01:31:31.023290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.105 [2024-11-20 01:31:31.023387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.105 [2024-11-20 01:31:31.023412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.105 qpair failed and we were unable to recover it. 00:30:23.105 [2024-11-20 01:31:31.023508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.105 [2024-11-20 01:31:31.023602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.105 [2024-11-20 01:31:31.023625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.105 qpair failed and we were unable to recover it. 00:30:23.105 [2024-11-20 01:31:31.023739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.105 [2024-11-20 01:31:31.023844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.105 [2024-11-20 01:31:31.023868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.105 qpair failed and we were unable to recover it. 00:30:23.105 [2024-11-20 01:31:31.023955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.105 [2024-11-20 01:31:31.024033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.105 [2024-11-20 01:31:31.024058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.105 qpair failed and we were unable to recover it. 00:30:23.105 [2024-11-20 01:31:31.024156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.105 [2024-11-20 01:31:31.024269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.105 [2024-11-20 01:31:31.024294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.105 qpair failed and we were unable to recover it. 00:30:23.105 [2024-11-20 01:31:31.024386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.105 [2024-11-20 01:31:31.024530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.105 [2024-11-20 01:31:31.024555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.105 qpair failed and we were unable to recover it. 00:30:23.105 [2024-11-20 01:31:31.024648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.105 [2024-11-20 01:31:31.024727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.105 [2024-11-20 01:31:31.024751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.105 qpair failed and we were unable to recover it. 00:30:23.105 [2024-11-20 01:31:31.024835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.105 [2024-11-20 01:31:31.024958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.105 [2024-11-20 01:31:31.024983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.105 qpair failed and we were unable to recover it. 00:30:23.105 [2024-11-20 01:31:31.025128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.105 [2024-11-20 01:31:31.025248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.105 [2024-11-20 01:31:31.025273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.105 qpair failed and we were unable to recover it. 00:30:23.105 [2024-11-20 01:31:31.025389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.105 [2024-11-20 01:31:31.025507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.105 [2024-11-20 01:31:31.025532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.105 qpair failed and we were unable to recover it. 00:30:23.105 [2024-11-20 01:31:31.025644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.105 [2024-11-20 01:31:31.025734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.105 [2024-11-20 01:31:31.025759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.105 qpair failed and we were unable to recover it. 00:30:23.106 [2024-11-20 01:31:31.025852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.106 [2024-11-20 01:31:31.025975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.106 [2024-11-20 01:31:31.025999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.106 qpair failed and we were unable to recover it. 00:30:23.106 [2024-11-20 01:31:31.026115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.106 [2024-11-20 01:31:31.026236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.106 [2024-11-20 01:31:31.026261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.106 qpair failed and we were unable to recover it. 00:30:23.106 [2024-11-20 01:31:31.026356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.106 [2024-11-20 01:31:31.026470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.106 [2024-11-20 01:31:31.026495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.106 qpair failed and we were unable to recover it. 00:30:23.106 [2024-11-20 01:31:31.026581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.106 [2024-11-20 01:31:31.026678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.106 [2024-11-20 01:31:31.026703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.106 qpair failed and we were unable to recover it. 00:30:23.106 [2024-11-20 01:31:31.026788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.106 [2024-11-20 01:31:31.026926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.106 [2024-11-20 01:31:31.026950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.106 qpair failed and we were unable to recover it. 00:30:23.106 [2024-11-20 01:31:31.027077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.106 [2024-11-20 01:31:31.027162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.106 [2024-11-20 01:31:31.027187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.106 qpair failed and we were unable to recover it. 00:30:23.106 [2024-11-20 01:31:31.027279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.106 [2024-11-20 01:31:31.027373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.106 [2024-11-20 01:31:31.027397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.106 qpair failed and we were unable to recover it. 00:30:23.106 [2024-11-20 01:31:31.027500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.106 [2024-11-20 01:31:31.027614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.106 [2024-11-20 01:31:31.027638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.106 qpair failed and we were unable to recover it. 00:30:23.106 [2024-11-20 01:31:31.027728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.106 [2024-11-20 01:31:31.027866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.106 [2024-11-20 01:31:31.027891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.106 qpair failed and we were unable to recover it. 00:30:23.106 [2024-11-20 01:31:31.028009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.106 [2024-11-20 01:31:31.028094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.106 [2024-11-20 01:31:31.028120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.106 qpair failed and we were unable to recover it. 00:30:23.106 [2024-11-20 01:31:31.028204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.106 [2024-11-20 01:31:31.028289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.106 [2024-11-20 01:31:31.028314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.106 qpair failed and we were unable to recover it. 00:30:23.106 [2024-11-20 01:31:31.028403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.106 [2024-11-20 01:31:31.028483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.106 [2024-11-20 01:31:31.028507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.106 qpair failed and we were unable to recover it. 00:30:23.106 [2024-11-20 01:31:31.028606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.106 [2024-11-20 01:31:31.028691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.106 [2024-11-20 01:31:31.028715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.106 qpair failed and we were unable to recover it. 00:30:23.106 [2024-11-20 01:31:31.028841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.106 [2024-11-20 01:31:31.028929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.106 [2024-11-20 01:31:31.028955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.106 qpair failed and we were unable to recover it. 00:30:23.106 [2024-11-20 01:31:31.029076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.106 [2024-11-20 01:31:31.029187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.106 [2024-11-20 01:31:31.029211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.106 qpair failed and we were unable to recover it. 00:30:23.106 [2024-11-20 01:31:31.029328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.106 [2024-11-20 01:31:31.029442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.106 [2024-11-20 01:31:31.029466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.106 qpair failed and we were unable to recover it. 00:30:23.106 [2024-11-20 01:31:31.029554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.106 [2024-11-20 01:31:31.029638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.106 [2024-11-20 01:31:31.029663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.106 qpair failed and we were unable to recover it. 00:30:23.106 [2024-11-20 01:31:31.029778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.106 [2024-11-20 01:31:31.029897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.106 [2024-11-20 01:31:31.029923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.106 qpair failed and we were unable to recover it. 00:30:23.106 [2024-11-20 01:31:31.030012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.106 [2024-11-20 01:31:31.030135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.106 [2024-11-20 01:31:31.030160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.106 qpair failed and we were unable to recover it. 00:30:23.106 [2024-11-20 01:31:31.030260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.106 [2024-11-20 01:31:31.030370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.106 [2024-11-20 01:31:31.030394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.106 qpair failed and we were unable to recover it. 00:30:23.106 [2024-11-20 01:31:31.030490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.106 [2024-11-20 01:31:31.030599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.106 [2024-11-20 01:31:31.030623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.106 qpair failed and we were unable to recover it. 00:30:23.106 [2024-11-20 01:31:31.030708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.106 [2024-11-20 01:31:31.030797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.106 [2024-11-20 01:31:31.030821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.106 qpair failed and we were unable to recover it. 00:30:23.106 [2024-11-20 01:31:31.030911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.106 [2024-11-20 01:31:31.031035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.106 [2024-11-20 01:31:31.031059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.106 qpair failed and we were unable to recover it. 00:30:23.106 [2024-11-20 01:31:31.031221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.106 [2024-11-20 01:31:31.031339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.106 [2024-11-20 01:31:31.031365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.106 qpair failed and we were unable to recover it. 00:30:23.106 [2024-11-20 01:31:31.031477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.106 [2024-11-20 01:31:31.031559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.106 [2024-11-20 01:31:31.031584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.106 qpair failed and we were unable to recover it. 00:30:23.106 [2024-11-20 01:31:31.031668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.106 [2024-11-20 01:31:31.031780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.106 [2024-11-20 01:31:31.031805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.106 qpair failed and we were unable to recover it. 00:30:23.106 [2024-11-20 01:31:31.031919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.106 [2024-11-20 01:31:31.032010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.106 [2024-11-20 01:31:31.032034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.106 qpair failed and we were unable to recover it. 00:30:23.106 [2024-11-20 01:31:31.032160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.106 [2024-11-20 01:31:31.032276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.106 [2024-11-20 01:31:31.032300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.106 qpair failed and we were unable to recover it. 00:30:23.106 [2024-11-20 01:31:31.032395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.106 [2024-11-20 01:31:31.032488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.107 [2024-11-20 01:31:31.032513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.107 qpair failed and we were unable to recover it. 00:30:23.107 [2024-11-20 01:31:31.032631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.107 [2024-11-20 01:31:31.032774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.107 [2024-11-20 01:31:31.032798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.107 qpair failed and we were unable to recover it. 00:30:23.107 [2024-11-20 01:31:31.032886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.107 [2024-11-20 01:31:31.032971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.107 [2024-11-20 01:31:31.032997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.107 qpair failed and we were unable to recover it. 00:30:23.107 [2024-11-20 01:31:31.033082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.107 [2024-11-20 01:31:31.033168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.107 [2024-11-20 01:31:31.033192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.107 qpair failed and we were unable to recover it. 00:30:23.107 [2024-11-20 01:31:31.033283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.107 [2024-11-20 01:31:31.033381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.107 [2024-11-20 01:31:31.033406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.107 qpair failed and we were unable to recover it. 00:30:23.107 [2024-11-20 01:31:31.033500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.107 [2024-11-20 01:31:31.033606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.107 [2024-11-20 01:31:31.033630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.107 qpair failed and we were unable to recover it. 00:30:23.107 [2024-11-20 01:31:31.033772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.107 [2024-11-20 01:31:31.033888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.107 [2024-11-20 01:31:31.033913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.107 qpair failed and we were unable to recover it. 00:30:23.107 [2024-11-20 01:31:31.033995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.107 [2024-11-20 01:31:31.034109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.107 [2024-11-20 01:31:31.034134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.107 qpair failed and we were unable to recover it. 00:30:23.107 [2024-11-20 01:31:31.034256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.107 [2024-11-20 01:31:31.034341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.107 [2024-11-20 01:31:31.034366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.107 qpair failed and we were unable to recover it. 00:30:23.107 [2024-11-20 01:31:31.034452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.107 [2024-11-20 01:31:31.034575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.107 [2024-11-20 01:31:31.034600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.107 qpair failed and we were unable to recover it. 00:30:23.107 [2024-11-20 01:31:31.034693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.107 [2024-11-20 01:31:31.034782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.107 [2024-11-20 01:31:31.034806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.107 qpair failed and we were unable to recover it. 00:30:23.107 [2024-11-20 01:31:31.034898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.107 [2024-11-20 01:31:31.035011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.107 [2024-11-20 01:31:31.035036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.107 qpair failed and we were unable to recover it. 00:30:23.107 [2024-11-20 01:31:31.035139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.107 [2024-11-20 01:31:31.035258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.107 [2024-11-20 01:31:31.035283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.107 qpair failed and we were unable to recover it. 00:30:23.107 [2024-11-20 01:31:31.035364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.107 [2024-11-20 01:31:31.035447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.107 [2024-11-20 01:31:31.035472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.107 qpair failed and we were unable to recover it. 00:30:23.107 [2024-11-20 01:31:31.035563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.107 [2024-11-20 01:31:31.035679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.107 [2024-11-20 01:31:31.035704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.107 qpair failed and we were unable to recover it. 00:30:23.107 [2024-11-20 01:31:31.035787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.107 [2024-11-20 01:31:31.035906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.107 [2024-11-20 01:31:31.035932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.107 qpair failed and we were unable to recover it. 00:30:23.107 [2024-11-20 01:31:31.036054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.107 [2024-11-20 01:31:31.036221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.107 [2024-11-20 01:31:31.036247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.107 qpair failed and we were unable to recover it. 00:30:23.107 [2024-11-20 01:31:31.036339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.107 [2024-11-20 01:31:31.036425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.107 [2024-11-20 01:31:31.036451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.107 qpair failed and we were unable to recover it. 00:30:23.107 [2024-11-20 01:31:31.036598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.107 [2024-11-20 01:31:31.036727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.107 [2024-11-20 01:31:31.036753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.107 qpair failed and we were unable to recover it. 00:30:23.107 [2024-11-20 01:31:31.036874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.107 [2024-11-20 01:31:31.036961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.107 [2024-11-20 01:31:31.036986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.107 qpair failed and we were unable to recover it. 00:30:23.107 [2024-11-20 01:31:31.037079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.107 [2024-11-20 01:31:31.037198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.107 [2024-11-20 01:31:31.037223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.107 qpair failed and we were unable to recover it. 00:30:23.107 [2024-11-20 01:31:31.037335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.107 [2024-11-20 01:31:31.037428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.107 [2024-11-20 01:31:31.037453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.107 qpair failed and we were unable to recover it. 00:30:23.107 [2024-11-20 01:31:31.037572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.107 [2024-11-20 01:31:31.037661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.107 [2024-11-20 01:31:31.037687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.107 qpair failed and we were unable to recover it. 00:30:23.107 [2024-11-20 01:31:31.037774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.107 [2024-11-20 01:31:31.037875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.107 [2024-11-20 01:31:31.037901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.107 qpair failed and we were unable to recover it. 00:30:23.107 [2024-11-20 01:31:31.038025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.107 [2024-11-20 01:31:31.038134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.107 [2024-11-20 01:31:31.038161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.107 qpair failed and we were unable to recover it. 00:30:23.107 [2024-11-20 01:31:31.038248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.107 [2024-11-20 01:31:31.038325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.107 [2024-11-20 01:31:31.038351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.107 qpair failed and we were unable to recover it. 00:30:23.107 [2024-11-20 01:31:31.038440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.107 [2024-11-20 01:31:31.038586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.107 [2024-11-20 01:31:31.038611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.107 qpair failed and we were unable to recover it. 00:30:23.107 [2024-11-20 01:31:31.038724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.107 [2024-11-20 01:31:31.038803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.107 [2024-11-20 01:31:31.038828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.107 qpair failed and we were unable to recover it. 00:30:23.107 [2024-11-20 01:31:31.038949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.107 [2024-11-20 01:31:31.039063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.107 [2024-11-20 01:31:31.039095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.107 qpair failed and we were unable to recover it. 00:30:23.108 [2024-11-20 01:31:31.039214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.108 [2024-11-20 01:31:31.039332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.108 [2024-11-20 01:31:31.039357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.108 qpair failed and we were unable to recover it. 00:30:23.108 [2024-11-20 01:31:31.039452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.108 [2024-11-20 01:31:31.039540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.108 [2024-11-20 01:31:31.039565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.108 qpair failed and we were unable to recover it. 00:30:23.108 [2024-11-20 01:31:31.039681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.108 [2024-11-20 01:31:31.039795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.108 [2024-11-20 01:31:31.039819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.108 qpair failed and we were unable to recover it. 00:30:23.108 [2024-11-20 01:31:31.039945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.108 [2024-11-20 01:31:31.040056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.108 [2024-11-20 01:31:31.040104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.108 qpair failed and we were unable to recover it. 00:30:23.108 [2024-11-20 01:31:31.040217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.108 [2024-11-20 01:31:31.040341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.108 [2024-11-20 01:31:31.040367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.108 qpair failed and we were unable to recover it. 00:30:23.108 [2024-11-20 01:31:31.040458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.108 [2024-11-20 01:31:31.040541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.108 [2024-11-20 01:31:31.040565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.108 qpair failed and we were unable to recover it. 00:30:23.108 [2024-11-20 01:31:31.040659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.108 [2024-11-20 01:31:31.040747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.108 [2024-11-20 01:31:31.040774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.108 qpair failed and we were unable to recover it. 00:30:23.108 [2024-11-20 01:31:31.040885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.108 [2024-11-20 01:31:31.040997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.108 [2024-11-20 01:31:31.041023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.108 qpair failed and we were unable to recover it. 00:30:23.108 [2024-11-20 01:31:31.041109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.108 [2024-11-20 01:31:31.041202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.108 [2024-11-20 01:31:31.041227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.108 qpair failed and we were unable to recover it. 00:30:23.108 [2024-11-20 01:31:31.041323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.108 [2024-11-20 01:31:31.041403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.108 [2024-11-20 01:31:31.041429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.108 qpair failed and we were unable to recover it. 00:30:23.108 [2024-11-20 01:31:31.041546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.108 [2024-11-20 01:31:31.041630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.108 [2024-11-20 01:31:31.041655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.108 qpair failed and we were unable to recover it. 00:30:23.108 [2024-11-20 01:31:31.041759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.108 [2024-11-20 01:31:31.041874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.108 [2024-11-20 01:31:31.041900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.108 qpair failed and we were unable to recover it. 00:30:23.108 [2024-11-20 01:31:31.042003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.108 [2024-11-20 01:31:31.042117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.108 [2024-11-20 01:31:31.042143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.108 qpair failed and we were unable to recover it. 00:30:23.108 [2024-11-20 01:31:31.042253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.108 [2024-11-20 01:31:31.042371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.108 [2024-11-20 01:31:31.042396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.108 qpair failed and we were unable to recover it. 00:30:23.108 [2024-11-20 01:31:31.042480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.108 [2024-11-20 01:31:31.042569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.108 [2024-11-20 01:31:31.042594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.108 qpair failed and we were unable to recover it. 00:30:23.108 [2024-11-20 01:31:31.042686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.108 [2024-11-20 01:31:31.042781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.108 [2024-11-20 01:31:31.042806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.108 qpair failed and we were unable to recover it. 00:30:23.108 [2024-11-20 01:31:31.042900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.108 [2024-11-20 01:31:31.043014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.108 [2024-11-20 01:31:31.043040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.108 qpair failed and we were unable to recover it. 00:30:23.108 [2024-11-20 01:31:31.043139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.108 [2024-11-20 01:31:31.043232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.108 [2024-11-20 01:31:31.043258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.108 qpair failed and we were unable to recover it. 00:30:23.108 [2024-11-20 01:31:31.043344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.108 [2024-11-20 01:31:31.043468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.108 [2024-11-20 01:31:31.043493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.108 qpair failed and we were unable to recover it. 00:30:23.108 [2024-11-20 01:31:31.043586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.108 [2024-11-20 01:31:31.043679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.108 [2024-11-20 01:31:31.043704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.108 qpair failed and we were unable to recover it. 00:30:23.108 [2024-11-20 01:31:31.043790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.108 [2024-11-20 01:31:31.043882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.108 [2024-11-20 01:31:31.043908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.108 qpair failed and we were unable to recover it. 00:30:23.108 [2024-11-20 01:31:31.043993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.108 [2024-11-20 01:31:31.044115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.108 [2024-11-20 01:31:31.044140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.108 qpair failed and we were unable to recover it. 00:30:23.108 [2024-11-20 01:31:31.044228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.108 [2024-11-20 01:31:31.044307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.108 [2024-11-20 01:31:31.044332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.108 qpair failed and we were unable to recover it. 00:30:23.108 [2024-11-20 01:31:31.044411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.108 [2024-11-20 01:31:31.044537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.108 [2024-11-20 01:31:31.044562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.108 qpair failed and we were unable to recover it. 00:30:23.108 [2024-11-20 01:31:31.044643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.108 [2024-11-20 01:31:31.044735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.108 [2024-11-20 01:31:31.044760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.108 qpair failed and we were unable to recover it. 00:30:23.108 [2024-11-20 01:31:31.044879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.108 [2024-11-20 01:31:31.044996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.108 [2024-11-20 01:31:31.045022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.108 qpair failed and we were unable to recover it. 00:30:23.108 [2024-11-20 01:31:31.045117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.108 [2024-11-20 01:31:31.045228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.108 [2024-11-20 01:31:31.045252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.108 qpair failed and we were unable to recover it. 00:30:23.108 [2024-11-20 01:31:31.045343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.108 [2024-11-20 01:31:31.045431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.108 [2024-11-20 01:31:31.045456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.108 qpair failed and we were unable to recover it. 00:30:23.108 [2024-11-20 01:31:31.045570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.109 [2024-11-20 01:31:31.045679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.109 [2024-11-20 01:31:31.045703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.109 qpair failed and we were unable to recover it. 00:30:23.109 [2024-11-20 01:31:31.045784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.109 [2024-11-20 01:31:31.045901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.109 [2024-11-20 01:31:31.045926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.109 qpair failed and we were unable to recover it. 00:30:23.109 [2024-11-20 01:31:31.046010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.109 [2024-11-20 01:31:31.046129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.109 [2024-11-20 01:31:31.046154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.109 qpair failed and we were unable to recover it. 00:30:23.109 [2024-11-20 01:31:31.046240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.109 [2024-11-20 01:31:31.046317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.109 [2024-11-20 01:31:31.046342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.109 qpair failed and we were unable to recover it. 00:30:23.109 [2024-11-20 01:31:31.046420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.109 [2024-11-20 01:31:31.046529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.109 [2024-11-20 01:31:31.046554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.109 qpair failed and we were unable to recover it. 00:30:23.109 [2024-11-20 01:31:31.046666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.109 [2024-11-20 01:31:31.046773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.109 [2024-11-20 01:31:31.046798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.109 qpair failed and we were unable to recover it. 00:30:23.109 [2024-11-20 01:31:31.046889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.109 [2024-11-20 01:31:31.047004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.109 [2024-11-20 01:31:31.047029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.109 qpair failed and we were unable to recover it. 00:30:23.109 [2024-11-20 01:31:31.047124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.109 [2024-11-20 01:31:31.047242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.109 [2024-11-20 01:31:31.047271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.109 qpair failed and we were unable to recover it. 00:30:23.109 [2024-11-20 01:31:31.047393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.109 [2024-11-20 01:31:31.047480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.109 [2024-11-20 01:31:31.047504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.109 qpair failed and we were unable to recover it. 00:30:23.109 [2024-11-20 01:31:31.047593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.109 [2024-11-20 01:31:31.047711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.109 [2024-11-20 01:31:31.047736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.109 qpair failed and we were unable to recover it. 00:30:23.109 [2024-11-20 01:31:31.047829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.109 [2024-11-20 01:31:31.047945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.109 [2024-11-20 01:31:31.047971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.109 qpair failed and we were unable to recover it. 00:30:23.109 [2024-11-20 01:31:31.048089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.109 [2024-11-20 01:31:31.048172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.109 [2024-11-20 01:31:31.048196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.109 qpair failed and we were unable to recover it. 00:30:23.109 [2024-11-20 01:31:31.048279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.109 [2024-11-20 01:31:31.048422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.109 [2024-11-20 01:31:31.048447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.109 qpair failed and we were unable to recover it. 00:30:23.109 [2024-11-20 01:31:31.048563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.109 [2024-11-20 01:31:31.048649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.109 [2024-11-20 01:31:31.048674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.109 qpair failed and we were unable to recover it. 00:30:23.109 [2024-11-20 01:31:31.048794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.109 [2024-11-20 01:31:31.048909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.109 [2024-11-20 01:31:31.048934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.109 qpair failed and we were unable to recover it. 00:30:23.109 [2024-11-20 01:31:31.049015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.109 [2024-11-20 01:31:31.049130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.109 [2024-11-20 01:31:31.049155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.109 qpair failed and we were unable to recover it. 00:30:23.109 [2024-11-20 01:31:31.049267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.109 [2024-11-20 01:31:31.049348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.109 [2024-11-20 01:31:31.049373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.109 qpair failed and we were unable to recover it. 00:30:23.109 [2024-11-20 01:31:31.049494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.109 [2024-11-20 01:31:31.049601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.109 [2024-11-20 01:31:31.049630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.109 qpair failed and we were unable to recover it. 00:30:23.109 [2024-11-20 01:31:31.049719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.109 [2024-11-20 01:31:31.049837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.109 [2024-11-20 01:31:31.049861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.109 qpair failed and we were unable to recover it. 00:30:23.109 [2024-11-20 01:31:31.049975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.109 [2024-11-20 01:31:31.050117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.109 [2024-11-20 01:31:31.050143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.109 qpair failed and we were unable to recover it. 00:30:23.109 [2024-11-20 01:31:31.050230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.109 [2024-11-20 01:31:31.050376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.109 [2024-11-20 01:31:31.050401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.109 qpair failed and we were unable to recover it. 00:30:23.109 [2024-11-20 01:31:31.050522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.109 [2024-11-20 01:31:31.050633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.109 [2024-11-20 01:31:31.050658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.109 qpair failed and we were unable to recover it. 00:30:23.109 [2024-11-20 01:31:31.050746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.109 [2024-11-20 01:31:31.050858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.109 [2024-11-20 01:31:31.050883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.109 qpair failed and we were unable to recover it. 00:30:23.109 [2024-11-20 01:31:31.050994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.109 [2024-11-20 01:31:31.051083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.109 [2024-11-20 01:31:31.051109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.109 qpair failed and we were unable to recover it. 00:30:23.109 [2024-11-20 01:31:31.051201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.109 [2024-11-20 01:31:31.051282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.109 [2024-11-20 01:31:31.051307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.109 qpair failed and we were unable to recover it. 00:30:23.109 [2024-11-20 01:31:31.051419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.109 [2024-11-20 01:31:31.051511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.110 [2024-11-20 01:31:31.051535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.110 qpair failed and we were unable to recover it. 00:30:23.110 [2024-11-20 01:31:31.051620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.110 [2024-11-20 01:31:31.051732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.110 [2024-11-20 01:31:31.051756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.110 qpair failed and we were unable to recover it. 00:30:23.110 [2024-11-20 01:31:31.051877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.110 [2024-11-20 01:31:31.051986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.110 [2024-11-20 01:31:31.052015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.110 qpair failed and we were unable to recover it. 00:30:23.110 [2024-11-20 01:31:31.052136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.110 [2024-11-20 01:31:31.052223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.110 [2024-11-20 01:31:31.052249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.110 qpair failed and we were unable to recover it. 00:30:23.110 [2024-11-20 01:31:31.052339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.110 [2024-11-20 01:31:31.052451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.110 [2024-11-20 01:31:31.052475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.110 qpair failed and we were unable to recover it. 00:30:23.110 [2024-11-20 01:31:31.052560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.110 [2024-11-20 01:31:31.052635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.110 [2024-11-20 01:31:31.052659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.110 qpair failed and we were unable to recover it. 00:30:23.110 [2024-11-20 01:31:31.052769] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:30:23.110 [2024-11-20 01:31:31.052800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.110 [2024-11-20 01:31:31.052921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.110 [2024-11-20 01:31:31.052945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.110 qpair failed and we were unable to recover it. 00:30:23.110 [2024-11-20 01:31:31.053038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.110 [2024-11-20 01:31:31.053176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.110 [2024-11-20 01:31:31.053200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.110 qpair failed and we were unable to recover it. 00:30:23.110 [2024-11-20 01:31:31.053319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.110 [2024-11-20 01:31:31.053406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.110 [2024-11-20 01:31:31.053432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.110 qpair failed and we were unable to recover it. 00:30:23.110 [2024-11-20 01:31:31.053526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.110 [2024-11-20 01:31:31.053614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.110 [2024-11-20 01:31:31.053638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.110 qpair failed and we were unable to recover it. 00:30:23.110 [2024-11-20 01:31:31.053720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.110 [2024-11-20 01:31:31.053834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.110 [2024-11-20 01:31:31.053858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.110 qpair failed and we were unable to recover it. 00:30:23.110 [2024-11-20 01:31:31.053942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.110 [2024-11-20 01:31:31.054036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.110 [2024-11-20 01:31:31.054062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.110 qpair failed and we were unable to recover it. 00:30:23.110 [2024-11-20 01:31:31.054216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.110 [2024-11-20 01:31:31.054306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.110 [2024-11-20 01:31:31.054331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.110 qpair failed and we were unable to recover it. 00:30:23.110 [2024-11-20 01:31:31.054415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.110 [2024-11-20 01:31:31.054533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.110 [2024-11-20 01:31:31.054557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.110 qpair failed and we were unable to recover it. 00:30:23.110 [2024-11-20 01:31:31.054642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.110 [2024-11-20 01:31:31.054756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.110 [2024-11-20 01:31:31.054780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.110 qpair failed and we were unable to recover it. 00:30:23.110 [2024-11-20 01:31:31.054926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.110 [2024-11-20 01:31:31.055014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.110 [2024-11-20 01:31:31.055038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.110 qpair failed and we were unable to recover it. 00:30:23.110 [2024-11-20 01:31:31.055167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.110 [2024-11-20 01:31:31.055286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.110 [2024-11-20 01:31:31.055310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.110 qpair failed and we were unable to recover it. 00:30:23.110 [2024-11-20 01:31:31.055401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.110 [2024-11-20 01:31:31.055489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.110 [2024-11-20 01:31:31.055514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.110 qpair failed and we were unable to recover it. 00:30:23.110 [2024-11-20 01:31:31.055633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.110 [2024-11-20 01:31:31.055752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.110 [2024-11-20 01:31:31.055777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.110 qpair failed and we were unable to recover it. 00:30:23.110 [2024-11-20 01:31:31.055873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.110 [2024-11-20 01:31:31.055987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.110 [2024-11-20 01:31:31.056012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.110 qpair failed and we were unable to recover it. 00:30:23.110 [2024-11-20 01:31:31.056106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.110 [2024-11-20 01:31:31.056192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.110 [2024-11-20 01:31:31.056217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.110 qpair failed and we were unable to recover it. 00:30:23.110 [2024-11-20 01:31:31.056336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.110 [2024-11-20 01:31:31.056430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.110 [2024-11-20 01:31:31.056454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.110 qpair failed and we were unable to recover it. 00:30:23.110 [2024-11-20 01:31:31.056567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.110 [2024-11-20 01:31:31.056708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.110 [2024-11-20 01:31:31.056737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.110 qpair failed and we were unable to recover it. 00:30:23.110 [2024-11-20 01:31:31.056826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.110 [2024-11-20 01:31:31.056969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.110 [2024-11-20 01:31:31.056994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.110 qpair failed and we were unable to recover it. 00:30:23.110 [2024-11-20 01:31:31.057107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.110 [2024-11-20 01:31:31.057224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.110 [2024-11-20 01:31:31.057250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.110 qpair failed and we were unable to recover it. 00:30:23.110 [2024-11-20 01:31:31.057366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.110 [2024-11-20 01:31:31.057455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.110 [2024-11-20 01:31:31.057479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.110 qpair failed and we were unable to recover it. 00:30:23.110 [2024-11-20 01:31:31.057566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.110 [2024-11-20 01:31:31.057681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.110 [2024-11-20 01:31:31.057705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.110 qpair failed and we were unable to recover it. 00:30:23.110 [2024-11-20 01:31:31.057790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.110 [2024-11-20 01:31:31.057912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.110 [2024-11-20 01:31:31.057936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.110 qpair failed and we were unable to recover it. 00:30:23.110 [2024-11-20 01:31:31.058075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.110 [2024-11-20 01:31:31.058161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.111 [2024-11-20 01:31:31.058185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.111 qpair failed and we were unable to recover it. 00:30:23.111 [2024-11-20 01:31:31.058269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.111 [2024-11-20 01:31:31.058407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.111 [2024-11-20 01:31:31.058431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.111 qpair failed and we were unable to recover it. 00:30:23.111 [2024-11-20 01:31:31.058543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.111 [2024-11-20 01:31:31.058628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.111 [2024-11-20 01:31:31.058653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.111 qpair failed and we were unable to recover it. 00:30:23.111 [2024-11-20 01:31:31.058750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.111 [2024-11-20 01:31:31.058866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.111 [2024-11-20 01:31:31.058891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.111 qpair failed and we were unable to recover it. 00:30:23.111 [2024-11-20 01:31:31.059038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.111 [2024-11-20 01:31:31.059130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.111 [2024-11-20 01:31:31.059160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.111 qpair failed and we were unable to recover it. 00:30:23.111 [2024-11-20 01:31:31.059282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.111 [2024-11-20 01:31:31.059361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.111 [2024-11-20 01:31:31.059385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.111 qpair failed and we were unable to recover it. 00:30:23.111 [2024-11-20 01:31:31.059477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.111 [2024-11-20 01:31:31.059571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.111 [2024-11-20 01:31:31.059595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.111 qpair failed and we were unable to recover it. 00:30:23.111 [2024-11-20 01:31:31.059682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.111 [2024-11-20 01:31:31.059803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.111 [2024-11-20 01:31:31.059828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.111 qpair failed and we were unable to recover it. 00:30:23.111 [2024-11-20 01:31:31.059914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.111 [2024-11-20 01:31:31.060036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.111 [2024-11-20 01:31:31.060060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.111 qpair failed and we were unable to recover it. 00:30:23.111 [2024-11-20 01:31:31.060159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.111 [2024-11-20 01:31:31.060253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.111 [2024-11-20 01:31:31.060279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.111 qpair failed and we were unable to recover it. 00:30:23.111 [2024-11-20 01:31:31.060401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.111 [2024-11-20 01:31:31.060485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.111 [2024-11-20 01:31:31.060510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.111 qpair failed and we were unable to recover it. 00:30:23.111 [2024-11-20 01:31:31.060595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.111 [2024-11-20 01:31:31.060683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.111 [2024-11-20 01:31:31.060707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.111 qpair failed and we were unable to recover it. 00:30:23.111 [2024-11-20 01:31:31.060802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.111 [2024-11-20 01:31:31.060916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.111 [2024-11-20 01:31:31.060940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.111 qpair failed and we were unable to recover it. 00:30:23.111 [2024-11-20 01:31:31.061053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.111 [2024-11-20 01:31:31.061144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.111 [2024-11-20 01:31:31.061169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.111 qpair failed and we were unable to recover it. 00:30:23.111 [2024-11-20 01:31:31.061265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.111 [2024-11-20 01:31:31.061380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.111 [2024-11-20 01:31:31.061408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.111 qpair failed and we were unable to recover it. 00:30:23.111 [2024-11-20 01:31:31.061494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.111 [2024-11-20 01:31:31.061608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.111 [2024-11-20 01:31:31.061633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.111 qpair failed and we were unable to recover it. 00:30:23.111 [2024-11-20 01:31:31.061780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.111 [2024-11-20 01:31:31.061899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.111 [2024-11-20 01:31:31.061923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.111 qpair failed and we were unable to recover it. 00:30:23.111 [2024-11-20 01:31:31.062009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.111 [2024-11-20 01:31:31.062124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.111 [2024-11-20 01:31:31.062149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.111 qpair failed and we were unable to recover it. 00:30:23.111 [2024-11-20 01:31:31.062240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.111 [2024-11-20 01:31:31.062357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.111 [2024-11-20 01:31:31.062381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.111 qpair failed and we were unable to recover it. 00:30:23.111 [2024-11-20 01:31:31.062492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.111 [2024-11-20 01:31:31.062580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.111 [2024-11-20 01:31:31.062605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.111 qpair failed and we were unable to recover it. 00:30:23.111 [2024-11-20 01:31:31.062706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.111 [2024-11-20 01:31:31.062825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.111 [2024-11-20 01:31:31.062850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.111 qpair failed and we were unable to recover it. 00:30:23.111 [2024-11-20 01:31:31.062943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.111 [2024-11-20 01:31:31.063066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.111 [2024-11-20 01:31:31.063098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.111 qpair failed and we were unable to recover it. 00:30:23.111 [2024-11-20 01:31:31.063193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.111 [2024-11-20 01:31:31.063281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.111 [2024-11-20 01:31:31.063307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.111 qpair failed and we were unable to recover it. 00:30:23.111 [2024-11-20 01:31:31.063425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.111 [2024-11-20 01:31:31.063514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.111 [2024-11-20 01:31:31.063540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.111 qpair failed and we were unable to recover it. 00:30:23.111 [2024-11-20 01:31:31.063625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.111 [2024-11-20 01:31:31.063713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.111 [2024-11-20 01:31:31.063741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.111 qpair failed and we were unable to recover it. 00:30:23.111 [2024-11-20 01:31:31.063828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.111 [2024-11-20 01:31:31.063947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.111 [2024-11-20 01:31:31.063971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.111 qpair failed and we were unable to recover it. 00:30:23.111 [2024-11-20 01:31:31.064075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.111 [2024-11-20 01:31:31.064166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.111 [2024-11-20 01:31:31.064190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.111 qpair failed and we were unable to recover it. 00:30:23.111 [2024-11-20 01:31:31.064302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.111 [2024-11-20 01:31:31.064388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.111 [2024-11-20 01:31:31.064413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.111 qpair failed and we were unable to recover it. 00:30:23.111 [2024-11-20 01:31:31.064542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.111 [2024-11-20 01:31:31.064663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.111 [2024-11-20 01:31:31.064689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.111 qpair failed and we were unable to recover it. 00:30:23.112 [2024-11-20 01:31:31.064810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.112 [2024-11-20 01:31:31.064925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.112 [2024-11-20 01:31:31.064950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.112 qpair failed and we were unable to recover it. 00:30:23.112 [2024-11-20 01:31:31.065041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.112 [2024-11-20 01:31:31.065189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.112 [2024-11-20 01:31:31.065215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.112 qpair failed and we were unable to recover it. 00:30:23.112 [2024-11-20 01:31:31.065332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.112 [2024-11-20 01:31:31.065448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.112 [2024-11-20 01:31:31.065473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.112 qpair failed and we were unable to recover it. 00:30:23.112 [2024-11-20 01:31:31.065563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.112 [2024-11-20 01:31:31.065650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.112 [2024-11-20 01:31:31.065676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.112 qpair failed and we were unable to recover it. 00:30:23.112 [2024-11-20 01:31:31.065816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.112 [2024-11-20 01:31:31.065960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.112 [2024-11-20 01:31:31.065986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.112 qpair failed and we were unable to recover it. 00:30:23.112 [2024-11-20 01:31:31.066107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.112 [2024-11-20 01:31:31.066206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.112 [2024-11-20 01:31:31.066232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.112 qpair failed and we were unable to recover it. 00:30:23.112 [2024-11-20 01:31:31.066357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.112 [2024-11-20 01:31:31.066473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.112 [2024-11-20 01:31:31.066499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.112 qpair failed and we were unable to recover it. 00:30:23.112 [2024-11-20 01:31:31.066642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.112 [2024-11-20 01:31:31.066728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.112 [2024-11-20 01:31:31.066753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.112 qpair failed and we were unable to recover it. 00:30:23.112 [2024-11-20 01:31:31.066837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.112 [2024-11-20 01:31:31.066923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.112 [2024-11-20 01:31:31.066947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.112 qpair failed and we were unable to recover it. 00:30:23.112 [2024-11-20 01:31:31.067045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.112 [2024-11-20 01:31:31.067145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.112 [2024-11-20 01:31:31.067171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.112 qpair failed and we were unable to recover it. 00:30:23.112 [2024-11-20 01:31:31.067294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.112 [2024-11-20 01:31:31.067382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.112 [2024-11-20 01:31:31.067406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.112 qpair failed and we were unable to recover it. 00:30:23.112 [2024-11-20 01:31:31.067494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.112 [2024-11-20 01:31:31.067584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.112 [2024-11-20 01:31:31.067609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.112 qpair failed and we were unable to recover it. 00:30:23.112 [2024-11-20 01:31:31.067702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.112 [2024-11-20 01:31:31.067818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.112 [2024-11-20 01:31:31.067844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.112 qpair failed and we were unable to recover it. 00:30:23.112 [2024-11-20 01:31:31.067962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.112 [2024-11-20 01:31:31.068079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.112 [2024-11-20 01:31:31.068104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.112 qpair failed and we were unable to recover it. 00:30:23.112 [2024-11-20 01:31:31.068216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.112 [2024-11-20 01:31:31.068356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.112 [2024-11-20 01:31:31.068380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.112 qpair failed and we were unable to recover it. 00:30:23.112 [2024-11-20 01:31:31.068527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.112 [2024-11-20 01:31:31.068642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.112 [2024-11-20 01:31:31.068667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.112 qpair failed and we were unable to recover it. 00:30:23.112 [2024-11-20 01:31:31.068765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.112 [2024-11-20 01:31:31.068881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.112 [2024-11-20 01:31:31.068908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.112 qpair failed and we were unable to recover it. 00:30:23.112 [2024-11-20 01:31:31.068999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.112 [2024-11-20 01:31:31.069114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.112 [2024-11-20 01:31:31.069139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.112 qpair failed and we were unable to recover it. 00:30:23.112 [2024-11-20 01:31:31.069257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.112 [2024-11-20 01:31:31.069371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.112 [2024-11-20 01:31:31.069397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.112 qpair failed and we were unable to recover it. 00:30:23.112 [2024-11-20 01:31:31.069512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.112 [2024-11-20 01:31:31.069592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.112 [2024-11-20 01:31:31.069616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.112 qpair failed and we were unable to recover it. 00:30:23.112 [2024-11-20 01:31:31.069740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.112 [2024-11-20 01:31:31.069826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.112 [2024-11-20 01:31:31.069851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.112 qpair failed and we were unable to recover it. 00:30:23.112 [2024-11-20 01:31:31.069964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.112 [2024-11-20 01:31:31.070079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.112 [2024-11-20 01:31:31.070105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.112 qpair failed and we were unable to recover it. 00:30:23.112 [2024-11-20 01:31:31.070228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.112 [2024-11-20 01:31:31.070319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.112 [2024-11-20 01:31:31.070344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.112 qpair failed and we were unable to recover it. 00:30:23.112 [2024-11-20 01:31:31.070457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.112 [2024-11-20 01:31:31.070546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.112 [2024-11-20 01:31:31.070570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.112 qpair failed and we were unable to recover it. 00:30:23.112 [2024-11-20 01:31:31.070656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.112 [2024-11-20 01:31:31.070740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.112 [2024-11-20 01:31:31.070766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.112 qpair failed and we were unable to recover it. 00:30:23.112 [2024-11-20 01:31:31.070862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.112 [2024-11-20 01:31:31.070949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.112 [2024-11-20 01:31:31.070974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.112 qpair failed and we were unable to recover it. 00:30:23.112 [2024-11-20 01:31:31.071100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.112 [2024-11-20 01:31:31.071214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.112 [2024-11-20 01:31:31.071240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.112 qpair failed and we were unable to recover it. 00:30:23.112 [2024-11-20 01:31:31.071354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.112 [2024-11-20 01:31:31.071494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.112 [2024-11-20 01:31:31.071519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.112 qpair failed and we were unable to recover it. 00:30:23.112 [2024-11-20 01:31:31.071635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.112 [2024-11-20 01:31:31.071715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.113 [2024-11-20 01:31:31.071740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.113 qpair failed and we were unable to recover it. 00:30:23.113 [2024-11-20 01:31:31.071823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.113 [2024-11-20 01:31:31.071905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.113 [2024-11-20 01:31:31.071928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.113 qpair failed and we were unable to recover it. 00:30:23.113 [2024-11-20 01:31:31.072020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.113 [2024-11-20 01:31:31.072161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.113 [2024-11-20 01:31:31.072186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.113 qpair failed and we were unable to recover it. 00:30:23.113 [2024-11-20 01:31:31.072280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.113 [2024-11-20 01:31:31.072369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.113 [2024-11-20 01:31:31.072394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.113 qpair failed and we were unable to recover it. 00:30:23.113 [2024-11-20 01:31:31.072541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.113 [2024-11-20 01:31:31.072630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.113 [2024-11-20 01:31:31.072655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.113 qpair failed and we were unable to recover it. 00:30:23.113 [2024-11-20 01:31:31.072750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.113 [2024-11-20 01:31:31.072863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.113 [2024-11-20 01:31:31.072887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.113 qpair failed and we were unable to recover it. 00:30:23.113 [2024-11-20 01:31:31.072973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.113 [2024-11-20 01:31:31.073115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.113 [2024-11-20 01:31:31.073141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.113 qpair failed and we were unable to recover it. 00:30:23.113 [2024-11-20 01:31:31.073225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.113 [2024-11-20 01:31:31.073344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.113 [2024-11-20 01:31:31.073369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.113 qpair failed and we were unable to recover it. 00:30:23.113 [2024-11-20 01:31:31.073495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.113 [2024-11-20 01:31:31.073605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.113 [2024-11-20 01:31:31.073630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.113 qpair failed and we were unable to recover it. 00:30:23.113 [2024-11-20 01:31:31.073712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.113 [2024-11-20 01:31:31.073829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.113 [2024-11-20 01:31:31.073855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.113 qpair failed and we were unable to recover it. 00:30:23.113 [2024-11-20 01:31:31.074001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.113 [2024-11-20 01:31:31.074110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.113 [2024-11-20 01:31:31.074136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.113 qpair failed and we were unable to recover it. 00:30:23.113 [2024-11-20 01:31:31.074253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.113 [2024-11-20 01:31:31.074345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.113 [2024-11-20 01:31:31.074372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.113 qpair failed and we were unable to recover it. 00:30:23.113 [2024-11-20 01:31:31.074497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.113 [2024-11-20 01:31:31.074610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.113 [2024-11-20 01:31:31.074634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.113 qpair failed and we were unable to recover it. 00:30:23.113 [2024-11-20 01:31:31.074742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.113 [2024-11-20 01:31:31.074826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.113 [2024-11-20 01:31:31.074852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.113 qpair failed and we were unable to recover it. 00:30:23.113 [2024-11-20 01:31:31.074940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.113 [2024-11-20 01:31:31.075081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.113 [2024-11-20 01:31:31.075106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.113 qpair failed and we were unable to recover it. 00:30:23.113 [2024-11-20 01:31:31.075226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.113 [2024-11-20 01:31:31.075344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.113 [2024-11-20 01:31:31.075369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.113 qpair failed and we were unable to recover it. 00:30:23.113 [2024-11-20 01:31:31.075484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.113 [2024-11-20 01:31:31.075598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.113 [2024-11-20 01:31:31.075624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.113 qpair failed and we were unable to recover it. 00:30:23.113 [2024-11-20 01:31:31.075714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.113 [2024-11-20 01:31:31.075823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.113 [2024-11-20 01:31:31.075847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.113 qpair failed and we were unable to recover it. 00:30:23.113 [2024-11-20 01:31:31.075970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.113 [2024-11-20 01:31:31.076085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.113 [2024-11-20 01:31:31.076110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.113 qpair failed and we were unable to recover it. 00:30:23.113 [2024-11-20 01:31:31.076208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.113 [2024-11-20 01:31:31.076352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.113 [2024-11-20 01:31:31.076376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.113 qpair failed and we were unable to recover it. 00:30:23.113 [2024-11-20 01:31:31.076471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.113 [2024-11-20 01:31:31.076564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.113 [2024-11-20 01:31:31.076589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.113 qpair failed and we were unable to recover it. 00:30:23.113 [2024-11-20 01:31:31.076674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.113 [2024-11-20 01:31:31.076755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.113 [2024-11-20 01:31:31.076779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.113 qpair failed and we were unable to recover it. 00:30:23.113 [2024-11-20 01:31:31.076901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.113 [2024-11-20 01:31:31.076989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.113 [2024-11-20 01:31:31.077014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.113 qpair failed and we were unable to recover it. 00:30:23.113 [2024-11-20 01:31:31.077095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.113 [2024-11-20 01:31:31.077208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.113 [2024-11-20 01:31:31.077232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.113 qpair failed and we were unable to recover it. 00:30:23.113 [2024-11-20 01:31:31.077351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.113 [2024-11-20 01:31:31.077467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.113 [2024-11-20 01:31:31.077492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.113 qpair failed and we were unable to recover it. 00:30:23.113 [2024-11-20 01:31:31.077602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.113 [2024-11-20 01:31:31.077725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.113 [2024-11-20 01:31:31.077750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.113 qpair failed and we were unable to recover it. 00:30:23.113 [2024-11-20 01:31:31.077872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.113 [2024-11-20 01:31:31.077965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.113 [2024-11-20 01:31:31.077990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.113 qpair failed and we were unable to recover it. 00:30:23.113 [2024-11-20 01:31:31.078103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.113 [2024-11-20 01:31:31.078223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.113 [2024-11-20 01:31:31.078247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.113 qpair failed and we were unable to recover it. 00:30:23.113 [2024-11-20 01:31:31.078392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.113 [2024-11-20 01:31:31.078474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.113 [2024-11-20 01:31:31.078499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.113 qpair failed and we were unable to recover it. 00:30:23.114 [2024-11-20 01:31:31.078595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.114 [2024-11-20 01:31:31.078707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.114 [2024-11-20 01:31:31.078731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.114 qpair failed and we were unable to recover it. 00:30:23.114 [2024-11-20 01:31:31.078823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.114 [2024-11-20 01:31:31.078940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.114 [2024-11-20 01:31:31.078965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.114 qpair failed and we were unable to recover it. 00:30:23.114 [2024-11-20 01:31:31.079087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.114 [2024-11-20 01:31:31.079176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.114 [2024-11-20 01:31:31.079200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.114 qpair failed and we were unable to recover it. 00:30:23.114 [2024-11-20 01:31:31.079314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.114 [2024-11-20 01:31:31.079397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.114 [2024-11-20 01:31:31.079421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.114 qpair failed and we were unable to recover it. 00:30:23.114 [2024-11-20 01:31:31.079513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.114 [2024-11-20 01:31:31.079604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.114 [2024-11-20 01:31:31.079629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.114 qpair failed and we were unable to recover it. 00:30:23.114 [2024-11-20 01:31:31.079770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.114 [2024-11-20 01:31:31.079888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.114 [2024-11-20 01:31:31.079912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.114 qpair failed and we were unable to recover it. 00:30:23.114 [2024-11-20 01:31:31.080031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.114 [2024-11-20 01:31:31.080158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.114 [2024-11-20 01:31:31.080185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.114 qpair failed and we were unable to recover it. 00:30:23.114 [2024-11-20 01:31:31.080270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.114 [2024-11-20 01:31:31.080384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.114 [2024-11-20 01:31:31.080408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.114 qpair failed and we were unable to recover it. 00:30:23.114 [2024-11-20 01:31:31.080527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.114 [2024-11-20 01:31:31.080639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.114 [2024-11-20 01:31:31.080664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.114 qpair failed and we were unable to recover it. 00:30:23.114 [2024-11-20 01:31:31.080815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.114 [2024-11-20 01:31:31.080917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.114 [2024-11-20 01:31:31.080942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.114 qpair failed and we were unable to recover it. 00:30:23.114 [2024-11-20 01:31:31.081058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.114 [2024-11-20 01:31:31.081157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.114 [2024-11-20 01:31:31.081183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.114 qpair failed and we were unable to recover it. 00:30:23.114 [2024-11-20 01:31:31.081272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.114 [2024-11-20 01:31:31.081384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.114 [2024-11-20 01:31:31.081408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.114 qpair failed and we were unable to recover it. 00:30:23.114 [2024-11-20 01:31:31.081529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.114 [2024-11-20 01:31:31.081614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.114 [2024-11-20 01:31:31.081638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.114 qpair failed and we were unable to recover it. 00:30:23.114 [2024-11-20 01:31:31.081754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.114 [2024-11-20 01:31:31.081842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.114 [2024-11-20 01:31:31.081866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.114 qpair failed and we were unable to recover it. 00:30:23.114 [2024-11-20 01:31:31.081988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.114 [2024-11-20 01:31:31.082082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.114 [2024-11-20 01:31:31.082109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.114 qpair failed and we were unable to recover it. 00:30:23.114 [2024-11-20 01:31:31.082204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.114 [2024-11-20 01:31:31.082344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.114 [2024-11-20 01:31:31.082369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.114 qpair failed and we were unable to recover it. 00:30:23.114 [2024-11-20 01:31:31.082484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.114 [2024-11-20 01:31:31.082604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.114 [2024-11-20 01:31:31.082628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.114 qpair failed and we were unable to recover it. 00:30:23.114 [2024-11-20 01:31:31.082711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.114 [2024-11-20 01:31:31.082807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.114 [2024-11-20 01:31:31.082832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.114 qpair failed and we were unable to recover it. 00:30:23.114 [2024-11-20 01:31:31.082922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.114 [2024-11-20 01:31:31.083042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.114 [2024-11-20 01:31:31.083077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.114 qpair failed and we were unable to recover it. 00:30:23.114 [2024-11-20 01:31:31.083227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.114 [2024-11-20 01:31:31.083367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.114 [2024-11-20 01:31:31.083395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:23.114 qpair failed and we were unable to recover it. 00:30:23.114 [2024-11-20 01:31:31.083517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.114 [2024-11-20 01:31:31.083636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.114 [2024-11-20 01:31:31.083662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:23.114 qpair failed and we were unable to recover it. 00:30:23.114 [2024-11-20 01:31:31.083778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.114 [2024-11-20 01:31:31.083924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.114 [2024-11-20 01:31:31.083948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:23.114 qpair failed and we were unable to recover it. 00:30:23.114 [2024-11-20 01:31:31.084065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.114 [2024-11-20 01:31:31.084186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.114 [2024-11-20 01:31:31.084211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:23.114 qpair failed and we were unable to recover it. 00:30:23.114 [2024-11-20 01:31:31.084298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.114 [2024-11-20 01:31:31.084384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.114 [2024-11-20 01:31:31.084409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:23.114 qpair failed and we were unable to recover it. 00:30:23.114 [2024-11-20 01:31:31.084553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.114 [2024-11-20 01:31:31.084645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.114 [2024-11-20 01:31:31.084671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:23.114 qpair failed and we were unable to recover it. 00:30:23.115 [2024-11-20 01:31:31.084786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.115 [2024-11-20 01:31:31.084866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.115 [2024-11-20 01:31:31.084891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:23.115 qpair failed and we were unable to recover it. 00:30:23.115 [2024-11-20 01:31:31.084981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.115 [2024-11-20 01:31:31.085101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.115 [2024-11-20 01:31:31.085127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:23.115 qpair failed and we were unable to recover it. 00:30:23.115 [2024-11-20 01:31:31.085241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.115 [2024-11-20 01:31:31.085327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.115 [2024-11-20 01:31:31.085352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:23.115 qpair failed and we were unable to recover it. 00:30:23.115 [2024-11-20 01:31:31.085493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.115 [2024-11-20 01:31:31.085584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.115 [2024-11-20 01:31:31.085611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:23.115 qpair failed and we were unable to recover it. 00:30:23.115 [2024-11-20 01:31:31.085692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.115 [2024-11-20 01:31:31.085810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.115 [2024-11-20 01:31:31.085835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:23.115 qpair failed and we were unable to recover it. 00:30:23.115 [2024-11-20 01:31:31.085946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.115 [2024-11-20 01:31:31.086035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.115 [2024-11-20 01:31:31.086059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:23.115 qpair failed and we were unable to recover it. 00:30:23.115 [2024-11-20 01:31:31.086192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.115 [2024-11-20 01:31:31.086273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.115 [2024-11-20 01:31:31.086297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:23.115 qpair failed and we were unable to recover it. 00:30:23.115 [2024-11-20 01:31:31.086418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.115 [2024-11-20 01:31:31.086507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.115 [2024-11-20 01:31:31.086533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:23.115 qpair failed and we were unable to recover it. 00:30:23.115 [2024-11-20 01:31:31.086677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.115 [2024-11-20 01:31:31.086795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.115 [2024-11-20 01:31:31.086820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd48000b90 with addr=10.0.0.2, port=4420 00:30:23.115 qpair failed and we were unable to recover it. 00:30:23.115 [2024-11-20 01:31:31.086944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.115 [2024-11-20 01:31:31.087065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.115 [2024-11-20 01:31:31.087097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.115 qpair failed and we were unable to recover it. 00:30:23.115 [2024-11-20 01:31:31.087196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.115 [2024-11-20 01:31:31.087309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.115 [2024-11-20 01:31:31.087334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.115 qpair failed and we were unable to recover it. 00:30:23.115 [2024-11-20 01:31:31.087421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.115 [2024-11-20 01:31:31.087542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.115 [2024-11-20 01:31:31.087567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.115 qpair failed and we were unable to recover it. 00:30:23.115 [2024-11-20 01:31:31.087654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.115 [2024-11-20 01:31:31.087743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.115 [2024-11-20 01:31:31.087767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.115 qpair failed and we were unable to recover it. 00:30:23.115 [2024-11-20 01:31:31.087911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.115 [2024-11-20 01:31:31.088024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.115 [2024-11-20 01:31:31.088049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.115 qpair failed and we were unable to recover it. 00:30:23.115 [2024-11-20 01:31:31.088177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.115 [2024-11-20 01:31:31.088302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.115 [2024-11-20 01:31:31.088327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.115 qpair failed and we were unable to recover it. 00:30:23.115 [2024-11-20 01:31:31.088440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.115 [2024-11-20 01:31:31.088553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.115 [2024-11-20 01:31:31.088580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.115 qpair failed and we were unable to recover it. 00:30:23.115 [2024-11-20 01:31:31.088693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.115 [2024-11-20 01:31:31.088806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.115 [2024-11-20 01:31:31.088831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.115 qpair failed and we were unable to recover it. 00:30:23.115 [2024-11-20 01:31:31.088928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.115 [2024-11-20 01:31:31.089040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.115 [2024-11-20 01:31:31.089064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.115 qpair failed and we were unable to recover it. 00:30:23.115 [2024-11-20 01:31:31.089164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.115 [2024-11-20 01:31:31.089244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.115 [2024-11-20 01:31:31.089269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.115 qpair failed and we were unable to recover it. 00:30:23.115 [2024-11-20 01:31:31.089355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.115 [2024-11-20 01:31:31.089496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.115 [2024-11-20 01:31:31.089521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.115 qpair failed and we were unable to recover it. 00:30:23.115 [2024-11-20 01:31:31.089609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.115 [2024-11-20 01:31:31.089722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.115 [2024-11-20 01:31:31.089748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.115 qpair failed and we were unable to recover it. 00:30:23.115 [2024-11-20 01:31:31.089832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.115 [2024-11-20 01:31:31.089919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.115 [2024-11-20 01:31:31.089944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.115 qpair failed and we were unable to recover it. 00:30:23.115 [2024-11-20 01:31:31.090028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.115 [2024-11-20 01:31:31.090126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.115 [2024-11-20 01:31:31.090152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.115 qpair failed and we were unable to recover it. 00:30:23.115 [2024-11-20 01:31:31.090271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.115 [2024-11-20 01:31:31.090382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.115 [2024-11-20 01:31:31.090408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.115 qpair failed and we were unable to recover it. 00:30:23.115 [2024-11-20 01:31:31.090527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.115 [2024-11-20 01:31:31.090626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.115 [2024-11-20 01:31:31.090652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.115 qpair failed and we were unable to recover it. 00:30:23.115 [2024-11-20 01:31:31.090769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.115 [2024-11-20 01:31:31.090910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.115 [2024-11-20 01:31:31.090935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.115 qpair failed and we were unable to recover it. 00:30:23.115 [2024-11-20 01:31:31.091021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.115 [2024-11-20 01:31:31.091137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.115 [2024-11-20 01:31:31.091164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.115 qpair failed and we were unable to recover it. 00:30:23.115 [2024-11-20 01:31:31.091280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.115 [2024-11-20 01:31:31.091363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.115 [2024-11-20 01:31:31.091388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.115 qpair failed and we were unable to recover it. 00:30:23.115 [2024-11-20 01:31:31.091472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.115 [2024-11-20 01:31:31.091583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.116 [2024-11-20 01:31:31.091607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.116 qpair failed and we were unable to recover it. 00:30:23.116 [2024-11-20 01:31:31.091692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.116 [2024-11-20 01:31:31.091782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.116 [2024-11-20 01:31:31.091806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.116 qpair failed and we were unable to recover it. 00:30:23.116 [2024-11-20 01:31:31.091902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.116 [2024-11-20 01:31:31.091983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.116 [2024-11-20 01:31:31.092007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.116 qpair failed and we were unable to recover it. 00:30:23.116 [2024-11-20 01:31:31.092124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.116 [2024-11-20 01:31:31.092238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.116 [2024-11-20 01:31:31.092263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.116 qpair failed and we were unable to recover it. 00:30:23.116 [2024-11-20 01:31:31.092415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.116 [2024-11-20 01:31:31.092509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.116 [2024-11-20 01:31:31.092535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.116 qpair failed and we were unable to recover it. 00:30:23.116 [2024-11-20 01:31:31.092626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.116 [2024-11-20 01:31:31.092748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.116 [2024-11-20 01:31:31.092773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.116 qpair failed and we were unable to recover it. 00:30:23.116 [2024-11-20 01:31:31.092855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.116 [2024-11-20 01:31:31.092946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.116 [2024-11-20 01:31:31.092971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.116 qpair failed and we were unable to recover it. 00:30:23.116 [2024-11-20 01:31:31.093103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.116 [2024-11-20 01:31:31.093187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.116 [2024-11-20 01:31:31.093212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.116 qpair failed and we were unable to recover it. 00:30:23.116 [2024-11-20 01:31:31.093329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.116 [2024-11-20 01:31:31.093415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.116 [2024-11-20 01:31:31.093439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.116 qpair failed and we were unable to recover it. 00:30:23.116 [2024-11-20 01:31:31.093532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.116 [2024-11-20 01:31:31.093622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.116 [2024-11-20 01:31:31.093647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.116 qpair failed and we were unable to recover it. 00:30:23.116 [2024-11-20 01:31:31.093761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.116 [2024-11-20 01:31:31.093842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.116 [2024-11-20 01:31:31.093867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.116 qpair failed and we were unable to recover it. 00:30:23.116 [2024-11-20 01:31:31.093955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.116 [2024-11-20 01:31:31.094041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.116 [2024-11-20 01:31:31.094066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.116 qpair failed and we were unable to recover it. 00:30:23.116 [2024-11-20 01:31:31.094167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.116 [2024-11-20 01:31:31.094245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.116 [2024-11-20 01:31:31.094271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.116 qpair failed and we were unable to recover it. 00:30:23.116 [2024-11-20 01:31:31.094390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.116 [2024-11-20 01:31:31.094506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.116 [2024-11-20 01:31:31.094531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.116 qpair failed and we were unable to recover it. 00:30:23.116 [2024-11-20 01:31:31.094675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.116 [2024-11-20 01:31:31.094785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.116 [2024-11-20 01:31:31.094811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.116 qpair failed and we were unable to recover it. 00:30:23.116 [2024-11-20 01:31:31.094924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.116 [2024-11-20 01:31:31.095018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.116 [2024-11-20 01:31:31.095043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.116 qpair failed and we were unable to recover it. 00:30:23.116 [2024-11-20 01:31:31.095203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.116 [2024-11-20 01:31:31.095291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.116 [2024-11-20 01:31:31.095320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.116 qpair failed and we were unable to recover it. 00:30:23.116 [2024-11-20 01:31:31.095416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.116 [2024-11-20 01:31:31.095497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.116 [2024-11-20 01:31:31.095522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.116 qpair failed and we were unable to recover it. 00:30:23.116 [2024-11-20 01:31:31.095637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.116 [2024-11-20 01:31:31.095748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.116 [2024-11-20 01:31:31.095773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.116 qpair failed and we were unable to recover it. 00:30:23.116 [2024-11-20 01:31:31.095892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.116 [2024-11-20 01:31:31.096005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.116 [2024-11-20 01:31:31.096030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.116 qpair failed and we were unable to recover it. 00:30:23.116 [2024-11-20 01:31:31.096128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.116 [2024-11-20 01:31:31.096230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.116 [2024-11-20 01:31:31.096255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.116 qpair failed and we were unable to recover it. 00:30:23.116 [2024-11-20 01:31:31.096340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.116 [2024-11-20 01:31:31.096448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.116 [2024-11-20 01:31:31.096473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.116 qpair failed and we were unable to recover it. 00:30:23.116 [2024-11-20 01:31:31.096569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.116 [2024-11-20 01:31:31.096663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.116 [2024-11-20 01:31:31.096688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.116 qpair failed and we were unable to recover it. 00:30:23.116 [2024-11-20 01:31:31.096797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.116 [2024-11-20 01:31:31.096906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.116 [2024-11-20 01:31:31.096931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.116 qpair failed and we were unable to recover it. 00:30:23.116 [2024-11-20 01:31:31.097020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.116 [2024-11-20 01:31:31.097114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.116 [2024-11-20 01:31:31.097140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.116 qpair failed and we were unable to recover it. 00:30:23.116 [2024-11-20 01:31:31.097235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.116 [2024-11-20 01:31:31.097326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.116 [2024-11-20 01:31:31.097350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.116 qpair failed and we were unable to recover it. 00:30:23.116 [2024-11-20 01:31:31.097447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.116 [2024-11-20 01:31:31.097614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.116 [2024-11-20 01:31:31.097643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.116 qpair failed and we were unable to recover it. 00:30:23.116 [2024-11-20 01:31:31.097728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.116 [2024-11-20 01:31:31.097836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.116 [2024-11-20 01:31:31.097861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.116 qpair failed and we were unable to recover it. 00:30:23.116 [2024-11-20 01:31:31.097947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.116 [2024-11-20 01:31:31.098061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.116 [2024-11-20 01:31:31.098094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.117 qpair failed and we were unable to recover it. 00:30:23.117 [2024-11-20 01:31:31.098178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.117 [2024-11-20 01:31:31.098282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.117 [2024-11-20 01:31:31.098308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.117 qpair failed and we were unable to recover it. 00:30:23.117 [2024-11-20 01:31:31.098421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.117 [2024-11-20 01:31:31.098515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.117 [2024-11-20 01:31:31.098539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.117 qpair failed and we were unable to recover it. 00:30:23.117 [2024-11-20 01:31:31.098626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.117 [2024-11-20 01:31:31.098737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.117 [2024-11-20 01:31:31.098762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.117 qpair failed and we were unable to recover it. 00:30:23.117 [2024-11-20 01:31:31.098869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.117 [2024-11-20 01:31:31.098980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.117 [2024-11-20 01:31:31.099005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.117 qpair failed and we were unable to recover it. 00:30:23.117 [2024-11-20 01:31:31.099093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.117 [2024-11-20 01:31:31.099237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.117 [2024-11-20 01:31:31.099263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.117 qpair failed and we were unable to recover it. 00:30:23.117 [2024-11-20 01:31:31.099354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.117 [2024-11-20 01:31:31.099429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.117 [2024-11-20 01:31:31.099454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.117 qpair failed and we were unable to recover it. 00:30:23.117 [2024-11-20 01:31:31.099542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.117 [2024-11-20 01:31:31.099688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.117 [2024-11-20 01:31:31.099713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.117 qpair failed and we were unable to recover it. 00:30:23.117 [2024-11-20 01:31:31.099807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.117 [2024-11-20 01:31:31.099897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.117 [2024-11-20 01:31:31.099927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.117 qpair failed and we were unable to recover it. 00:30:23.117 [2024-11-20 01:31:31.100020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.117 [2024-11-20 01:31:31.100138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.117 [2024-11-20 01:31:31.100164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.117 qpair failed and we were unable to recover it. 00:30:23.117 [2024-11-20 01:31:31.100249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.117 [2024-11-20 01:31:31.100336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.117 [2024-11-20 01:31:31.100362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.117 qpair failed and we were unable to recover it. 00:30:23.117 [2024-11-20 01:31:31.100508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.117 [2024-11-20 01:31:31.100618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.117 [2024-11-20 01:31:31.100642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.117 qpair failed and we were unable to recover it. 00:30:23.117 [2024-11-20 01:31:31.100728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.117 [2024-11-20 01:31:31.100844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.117 [2024-11-20 01:31:31.100870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.117 qpair failed and we were unable to recover it. 00:30:23.117 [2024-11-20 01:31:31.100963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.117 [2024-11-20 01:31:31.101078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.117 [2024-11-20 01:31:31.101104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.117 qpair failed and we were unable to recover it. 00:30:23.117 [2024-11-20 01:31:31.101193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.117 [2024-11-20 01:31:31.101278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.117 [2024-11-20 01:31:31.101303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.117 qpair failed and we were unable to recover it. 00:30:23.117 [2024-11-20 01:31:31.101421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.117 [2024-11-20 01:31:31.101563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.117 [2024-11-20 01:31:31.101588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.117 qpair failed and we were unable to recover it. 00:30:23.117 [2024-11-20 01:31:31.101675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.117 [2024-11-20 01:31:31.101761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.117 [2024-11-20 01:31:31.101786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.117 qpair failed and we were unable to recover it. 00:30:23.117 [2024-11-20 01:31:31.101884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.117 [2024-11-20 01:31:31.101995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.117 [2024-11-20 01:31:31.102020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.117 qpair failed and we were unable to recover it. 00:30:23.117 [2024-11-20 01:31:31.102139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.117 [2024-11-20 01:31:31.102236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.117 [2024-11-20 01:31:31.102261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.117 qpair failed and we were unable to recover it. 00:30:23.117 [2024-11-20 01:31:31.102352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.117 [2024-11-20 01:31:31.102465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.117 [2024-11-20 01:31:31.102490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.117 qpair failed and we were unable to recover it. 00:30:23.117 [2024-11-20 01:31:31.102611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.117 [2024-11-20 01:31:31.102700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.117 [2024-11-20 01:31:31.102726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.117 qpair failed and we were unable to recover it. 00:30:23.117 [2024-11-20 01:31:31.102824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.117 [2024-11-20 01:31:31.102934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.117 [2024-11-20 01:31:31.102959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.117 qpair failed and we were unable to recover it. 00:30:23.117 [2024-11-20 01:31:31.103048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.117 [2024-11-20 01:31:31.103145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.117 [2024-11-20 01:31:31.103170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.117 qpair failed and we were unable to recover it. 00:30:23.117 [2024-11-20 01:31:31.103292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.117 [2024-11-20 01:31:31.103376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.117 [2024-11-20 01:31:31.103401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.117 qpair failed and we were unable to recover it. 00:30:23.117 [2024-11-20 01:31:31.103522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.117 [2024-11-20 01:31:31.103606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.117 [2024-11-20 01:31:31.103630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.117 qpair failed and we were unable to recover it. 00:30:23.117 [2024-11-20 01:31:31.103722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.117 [2024-11-20 01:31:31.103839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.117 [2024-11-20 01:31:31.103866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.117 qpair failed and we were unable to recover it. 00:30:23.117 [2024-11-20 01:31:31.103954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.117 [2024-11-20 01:31:31.104076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.117 [2024-11-20 01:31:31.104101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.117 qpair failed and we were unable to recover it. 00:30:23.117 [2024-11-20 01:31:31.104190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.117 [2024-11-20 01:31:31.104279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.117 [2024-11-20 01:31:31.104303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.117 qpair failed and we were unable to recover it. 00:30:23.117 [2024-11-20 01:31:31.104392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.117 [2024-11-20 01:31:31.104514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.117 [2024-11-20 01:31:31.104539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.117 qpair failed and we were unable to recover it. 00:30:23.117 [2024-11-20 01:31:31.104642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.118 [2024-11-20 01:31:31.104726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.118 [2024-11-20 01:31:31.104750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.118 qpair failed and we were unable to recover it. 00:30:23.118 [2024-11-20 01:31:31.104847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.118 [2024-11-20 01:31:31.104964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.118 [2024-11-20 01:31:31.104990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.118 qpair failed and we were unable to recover it. 00:30:23.118 [2024-11-20 01:31:31.105093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.118 [2024-11-20 01:31:31.105206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.118 [2024-11-20 01:31:31.105231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.118 qpair failed and we were unable to recover it. 00:30:23.118 [2024-11-20 01:31:31.105317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.118 [2024-11-20 01:31:31.105427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.118 [2024-11-20 01:31:31.105451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.118 qpair failed and we were unable to recover it. 00:30:23.118 [2024-11-20 01:31:31.105562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.118 [2024-11-20 01:31:31.105677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.118 [2024-11-20 01:31:31.105702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.118 qpair failed and we were unable to recover it. 00:30:23.118 [2024-11-20 01:31:31.105815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.118 [2024-11-20 01:31:31.105896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.118 [2024-11-20 01:31:31.105920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.118 qpair failed and we were unable to recover it. 00:30:23.118 [2024-11-20 01:31:31.106039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.118 [2024-11-20 01:31:31.106148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.118 [2024-11-20 01:31:31.106173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.118 qpair failed and we were unable to recover it. 00:30:23.118 [2024-11-20 01:31:31.106297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.118 [2024-11-20 01:31:31.106382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.118 [2024-11-20 01:31:31.106405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.118 qpair failed and we were unable to recover it. 00:30:23.118 [2024-11-20 01:31:31.106519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.118 [2024-11-20 01:31:31.106639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.118 [2024-11-20 01:31:31.106664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.118 qpair failed and we were unable to recover it. 00:30:23.118 [2024-11-20 01:31:31.106777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.118 [2024-11-20 01:31:31.106863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.118 [2024-11-20 01:31:31.106888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.118 qpair failed and we were unable to recover it. 00:30:23.118 [2024-11-20 01:31:31.106992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.118 [2024-11-20 01:31:31.107084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.118 [2024-11-20 01:31:31.107111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.118 qpair failed and we were unable to recover it. 00:30:23.118 [2024-11-20 01:31:31.107191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.118 [2024-11-20 01:31:31.107335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.118 [2024-11-20 01:31:31.107359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.118 qpair failed and we were unable to recover it. 00:30:23.118 [2024-11-20 01:31:31.107451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.118 [2024-11-20 01:31:31.107538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.118 [2024-11-20 01:31:31.107562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.118 qpair failed and we were unable to recover it. 00:30:23.118 [2024-11-20 01:31:31.107658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.118 [2024-11-20 01:31:31.107788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.118 [2024-11-20 01:31:31.107813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.118 qpair failed and we were unable to recover it. 00:30:23.118 [2024-11-20 01:31:31.107903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.118 [2024-11-20 01:31:31.108015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.118 [2024-11-20 01:31:31.108039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.118 qpair failed and we were unable to recover it. 00:30:23.118 [2024-11-20 01:31:31.108166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.118 [2024-11-20 01:31:31.108253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.118 [2024-11-20 01:31:31.108277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.118 qpair failed and we were unable to recover it. 00:30:23.118 [2024-11-20 01:31:31.108417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.118 [2024-11-20 01:31:31.108526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.118 [2024-11-20 01:31:31.108550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.118 qpair failed and we were unable to recover it. 00:30:23.118 [2024-11-20 01:31:31.108679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.118 [2024-11-20 01:31:31.108773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.118 [2024-11-20 01:31:31.108798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.118 qpair failed and we were unable to recover it. 00:30:23.118 [2024-11-20 01:31:31.108920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.118 [2024-11-20 01:31:31.109033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.118 [2024-11-20 01:31:31.109058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.118 qpair failed and we were unable to recover it. 00:30:23.118 [2024-11-20 01:31:31.109163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.118 [2024-11-20 01:31:31.109280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.118 [2024-11-20 01:31:31.109305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.118 qpair failed and we were unable to recover it. 00:30:23.118 [2024-11-20 01:31:31.109426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.118 [2024-11-20 01:31:31.109512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.118 [2024-11-20 01:31:31.109536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.118 qpair failed and we were unable to recover it. 00:30:23.118 [2024-11-20 01:31:31.109654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.118 [2024-11-20 01:31:31.109764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.118 [2024-11-20 01:31:31.109789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.118 qpair failed and we were unable to recover it. 00:30:23.118 [2024-11-20 01:31:31.109884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.118 [2024-11-20 01:31:31.109992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.118 [2024-11-20 01:31:31.110016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.118 qpair failed and we were unable to recover it. 00:30:23.118 [2024-11-20 01:31:31.110097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.118 [2024-11-20 01:31:31.110182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.118 [2024-11-20 01:31:31.110207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.118 qpair failed and we were unable to recover it. 00:30:23.118 [2024-11-20 01:31:31.110293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.118 [2024-11-20 01:31:31.110421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.118 [2024-11-20 01:31:31.110445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.118 qpair failed and we were unable to recover it. 00:30:23.118 [2024-11-20 01:31:31.110537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.118 [2024-11-20 01:31:31.110682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.118 [2024-11-20 01:31:31.110707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.118 qpair failed and we were unable to recover it. 00:30:23.118 [2024-11-20 01:31:31.110848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.118 [2024-11-20 01:31:31.110947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.118 [2024-11-20 01:31:31.110971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.118 qpair failed and we were unable to recover it. 00:30:23.118 [2024-11-20 01:31:31.111084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.118 [2024-11-20 01:31:31.111167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.118 [2024-11-20 01:31:31.111191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.118 qpair failed and we were unable to recover it. 00:30:23.118 [2024-11-20 01:31:31.111281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.119 [2024-11-20 01:31:31.111397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.119 [2024-11-20 01:31:31.111422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.119 qpair failed and we were unable to recover it. 00:30:23.119 [2024-11-20 01:31:31.111512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.119 [2024-11-20 01:31:31.111604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.119 [2024-11-20 01:31:31.111630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.119 qpair failed and we were unable to recover it. 00:30:23.119 [2024-11-20 01:31:31.111781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.119 [2024-11-20 01:31:31.111877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.119 [2024-11-20 01:31:31.111902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.119 qpair failed and we were unable to recover it. 00:30:23.119 [2024-11-20 01:31:31.112015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.119 [2024-11-20 01:31:31.112106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.119 [2024-11-20 01:31:31.112131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.119 qpair failed and we were unable to recover it. 00:30:23.119 [2024-11-20 01:31:31.112217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.119 [2024-11-20 01:31:31.112309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.119 [2024-11-20 01:31:31.112334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.119 qpair failed and we were unable to recover it. 00:30:23.119 [2024-11-20 01:31:31.112453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.119 [2024-11-20 01:31:31.112568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.119 [2024-11-20 01:31:31.112593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.119 qpair failed and we were unable to recover it. 00:30:23.119 [2024-11-20 01:31:31.112717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.119 [2024-11-20 01:31:31.112802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.119 [2024-11-20 01:31:31.112826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.119 qpair failed and we were unable to recover it. 00:30:23.119 [2024-11-20 01:31:31.112947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.119 [2024-11-20 01:31:31.113036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.119 [2024-11-20 01:31:31.113061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.119 qpair failed and we were unable to recover it. 00:30:23.119 [2024-11-20 01:31:31.113158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.119 [2024-11-20 01:31:31.113265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.119 [2024-11-20 01:31:31.113289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.119 qpair failed and we were unable to recover it. 00:30:23.119 [2024-11-20 01:31:31.113372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.119 [2024-11-20 01:31:31.113486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.119 [2024-11-20 01:31:31.113511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.119 qpair failed and we were unable to recover it. 00:30:23.119 [2024-11-20 01:31:31.113599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.119 [2024-11-20 01:31:31.113719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.119 [2024-11-20 01:31:31.113745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.119 qpair failed and we were unable to recover it. 00:30:23.119 [2024-11-20 01:31:31.113833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.119 [2024-11-20 01:31:31.113952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.119 [2024-11-20 01:31:31.113977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.119 qpair failed and we were unable to recover it. 00:30:23.119 [2024-11-20 01:31:31.114102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.119 [2024-11-20 01:31:31.114197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.119 [2024-11-20 01:31:31.114223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.119 qpair failed and we were unable to recover it. 00:30:23.119 [2024-11-20 01:31:31.114341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.119 [2024-11-20 01:31:31.114451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.119 [2024-11-20 01:31:31.114476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.119 qpair failed and we were unable to recover it. 00:30:23.119 [2024-11-20 01:31:31.114571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.119 [2024-11-20 01:31:31.114688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.119 [2024-11-20 01:31:31.114715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.119 qpair failed and we were unable to recover it. 00:30:23.119 [2024-11-20 01:31:31.114832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.119 [2024-11-20 01:31:31.114944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.119 [2024-11-20 01:31:31.114969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.119 qpair failed and we were unable to recover it. 00:30:23.119 [2024-11-20 01:31:31.115085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.119 [2024-11-20 01:31:31.115203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.119 [2024-11-20 01:31:31.115228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.119 qpair failed and we were unable to recover it. 00:30:23.119 [2024-11-20 01:31:31.115315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.119 [2024-11-20 01:31:31.115406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.119 [2024-11-20 01:31:31.115433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.119 qpair failed and we were unable to recover it. 00:30:23.119 [2024-11-20 01:31:31.115580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.119 [2024-11-20 01:31:31.115692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.119 [2024-11-20 01:31:31.115717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.119 qpair failed and we were unable to recover it. 00:30:23.119 [2024-11-20 01:31:31.115803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.119 [2024-11-20 01:31:31.115883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.119 [2024-11-20 01:31:31.115908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.119 qpair failed and we were unable to recover it. 00:30:23.119 [2024-11-20 01:31:31.116023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.119 [2024-11-20 01:31:31.116108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.119 [2024-11-20 01:31:31.116134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.119 qpair failed and we were unable to recover it. 00:30:23.119 [2024-11-20 01:31:31.116227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.119 [2024-11-20 01:31:31.116319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.119 [2024-11-20 01:31:31.116344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.119 qpair failed and we were unable to recover it. 00:30:23.119 [2024-11-20 01:31:31.116438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.119 [2024-11-20 01:31:31.116553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.119 [2024-11-20 01:31:31.116579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.119 qpair failed and we were unable to recover it. 00:30:23.119 [2024-11-20 01:31:31.116705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.119 [2024-11-20 01:31:31.116788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.119 [2024-11-20 01:31:31.116812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.119 qpair failed and we were unable to recover it. 00:30:23.119 [2024-11-20 01:31:31.116908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.119 [2024-11-20 01:31:31.116994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.119 [2024-11-20 01:31:31.117020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.119 qpair failed and we were unable to recover it. 00:30:23.120 [2024-11-20 01:31:31.117148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.120 [2024-11-20 01:31:31.117257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.120 [2024-11-20 01:31:31.117283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.120 qpair failed and we were unable to recover it. 00:30:23.120 [2024-11-20 01:31:31.117365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.120 [2024-11-20 01:31:31.117482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.120 [2024-11-20 01:31:31.117509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.120 qpair failed and we were unable to recover it. 00:30:23.120 [2024-11-20 01:31:31.117629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.120 [2024-11-20 01:31:31.117712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.120 [2024-11-20 01:31:31.117736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.120 qpair failed and we were unable to recover it. 00:30:23.120 [2024-11-20 01:31:31.117856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.120 [2024-11-20 01:31:31.117972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.120 [2024-11-20 01:31:31.117996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.120 qpair failed and we were unable to recover it. 00:30:23.120 [2024-11-20 01:31:31.118096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.120 [2024-11-20 01:31:31.118240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.120 [2024-11-20 01:31:31.118265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.120 qpair failed and we were unable to recover it. 00:30:23.120 [2024-11-20 01:31:31.118357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.120 [2024-11-20 01:31:31.118503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.120 [2024-11-20 01:31:31.118526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.120 qpair failed and we were unable to recover it. 00:30:23.120 [2024-11-20 01:31:31.118640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.120 [2024-11-20 01:31:31.118758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.120 [2024-11-20 01:31:31.118782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.120 qpair failed and we were unable to recover it. 00:30:23.120 [2024-11-20 01:31:31.118876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.120 [2024-11-20 01:31:31.118987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.120 [2024-11-20 01:31:31.119012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.120 qpair failed and we were unable to recover it. 00:30:23.120 [2024-11-20 01:31:31.119160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.120 [2024-11-20 01:31:31.119276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.120 [2024-11-20 01:31:31.119302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.120 qpair failed and we were unable to recover it. 00:30:23.120 [2024-11-20 01:31:31.119394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.120 [2024-11-20 01:31:31.119513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.120 [2024-11-20 01:31:31.119538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.120 qpair failed and we were unable to recover it. 00:30:23.120 [2024-11-20 01:31:31.119628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.120 [2024-11-20 01:31:31.119718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.120 [2024-11-20 01:31:31.119743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.120 qpair failed and we were unable to recover it. 00:30:23.120 [2024-11-20 01:31:31.119857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.120 [2024-11-20 01:31:31.119941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.120 [2024-11-20 01:31:31.119965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.120 qpair failed and we were unable to recover it. 00:30:23.120 [2024-11-20 01:31:31.120088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.120 [2024-11-20 01:31:31.120173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.120 [2024-11-20 01:31:31.120197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.120 qpair failed and we were unable to recover it. 00:30:23.120 [2024-11-20 01:31:31.120313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.120 [2024-11-20 01:31:31.120396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.120 [2024-11-20 01:31:31.120422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.120 qpair failed and we were unable to recover it. 00:30:23.120 [2024-11-20 01:31:31.120540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.120 [2024-11-20 01:31:31.120624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.120 [2024-11-20 01:31:31.120648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.120 qpair failed and we were unable to recover it. 00:30:23.120 [2024-11-20 01:31:31.120759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.120 [2024-11-20 01:31:31.120900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.120 [2024-11-20 01:31:31.120925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.120 qpair failed and we were unable to recover it. 00:30:23.120 [2024-11-20 01:31:31.121004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.120 [2024-11-20 01:31:31.121118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.120 [2024-11-20 01:31:31.121143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.120 qpair failed and we were unable to recover it. 00:30:23.120 [2024-11-20 01:31:31.121228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.120 [2024-11-20 01:31:31.121312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.120 [2024-11-20 01:31:31.121337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.120 qpair failed and we were unable to recover it. 00:30:23.120 [2024-11-20 01:31:31.121456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.120 [2024-11-20 01:31:31.121552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.120 [2024-11-20 01:31:31.121575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.120 qpair failed and we were unable to recover it. 00:30:23.120 [2024-11-20 01:31:31.121718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.120 [2024-11-20 01:31:31.121804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.120 [2024-11-20 01:31:31.121828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.120 qpair failed and we were unable to recover it. 00:30:23.120 [2024-11-20 01:31:31.121946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.120 [2024-11-20 01:31:31.122060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.120 [2024-11-20 01:31:31.122141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.120 qpair failed and we were unable to recover it. 00:30:23.120 [2024-11-20 01:31:31.122233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.120 [2024-11-20 01:31:31.122351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.120 [2024-11-20 01:31:31.122375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.120 qpair failed and we were unable to recover it. 00:30:23.120 [2024-11-20 01:31:31.122462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.120 [2024-11-20 01:31:31.122599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.120 [2024-11-20 01:31:31.122623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.120 qpair failed and we were unable to recover it. 00:30:23.120 [2024-11-20 01:31:31.122735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.120 [2024-11-20 01:31:31.122817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.120 [2024-11-20 01:31:31.122841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.120 qpair failed and we were unable to recover it. 00:30:23.120 [2024-11-20 01:31:31.122922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.120 [2024-11-20 01:31:31.123003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.120 [2024-11-20 01:31:31.123027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.120 qpair failed and we were unable to recover it. 00:30:23.120 [2024-11-20 01:31:31.123147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.120 [2024-11-20 01:31:31.123238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.120 [2024-11-20 01:31:31.123262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.120 qpair failed and we were unable to recover it. 00:30:23.120 [2024-11-20 01:31:31.123377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.120 [2024-11-20 01:31:31.123469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.120 [2024-11-20 01:31:31.123493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.120 qpair failed and we were unable to recover it. 00:30:23.120 [2024-11-20 01:31:31.123609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.120 [2024-11-20 01:31:31.123694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.120 [2024-11-20 01:31:31.123720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.120 qpair failed and we were unable to recover it. 00:30:23.120 [2024-11-20 01:31:31.123807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.120 [2024-11-20 01:31:31.123923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.121 [2024-11-20 01:31:31.123948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.121 qpair failed and we were unable to recover it. 00:30:23.121 [2024-11-20 01:31:31.124042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.121 [2024-11-20 01:31:31.124161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.121 [2024-11-20 01:31:31.124184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.121 qpair failed and we were unable to recover it. 00:30:23.121 [2024-11-20 01:31:31.124283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.121 [2024-11-20 01:31:31.124376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.121 [2024-11-20 01:31:31.124401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.121 qpair failed and we were unable to recover it. 00:30:23.121 [2024-11-20 01:31:31.124526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.121 [2024-11-20 01:31:31.124626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.121 [2024-11-20 01:31:31.124651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.121 qpair failed and we were unable to recover it. 00:30:23.121 [2024-11-20 01:31:31.124736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.121 [2024-11-20 01:31:31.124850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.121 [2024-11-20 01:31:31.124876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.121 qpair failed and we were unable to recover it. 00:30:23.121 [2024-11-20 01:31:31.124986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.121 [2024-11-20 01:31:31.125083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.121 [2024-11-20 01:31:31.125110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.121 qpair failed and we were unable to recover it. 00:30:23.121 [2024-11-20 01:31:31.125213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.121 [2024-11-20 01:31:31.125353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.121 [2024-11-20 01:31:31.125380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.121 qpair failed and we were unable to recover it. 00:30:23.121 [2024-11-20 01:31:31.125501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.121 [2024-11-20 01:31:31.125582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.121 [2024-11-20 01:31:31.125608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.121 qpair failed and we were unable to recover it. 00:30:23.121 [2024-11-20 01:31:31.125730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.121 [2024-11-20 01:31:31.125874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.121 [2024-11-20 01:31:31.125900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.121 qpair failed and we were unable to recover it. 00:30:23.121 [2024-11-20 01:31:31.126024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.121 [2024-11-20 01:31:31.126153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.121 [2024-11-20 01:31:31.126182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.121 qpair failed and we were unable to recover it. 00:30:23.121 [2024-11-20 01:31:31.126265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.121 [2024-11-20 01:31:31.126346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.121 [2024-11-20 01:31:31.126371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.121 qpair failed and we were unable to recover it. 00:30:23.121 [2024-11-20 01:31:31.126488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.121 [2024-11-20 01:31:31.126583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.121 [2024-11-20 01:31:31.126609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.121 qpair failed and we were unable to recover it. 00:30:23.121 [2024-11-20 01:31:31.126725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.121 [2024-11-20 01:31:31.126835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.121 [2024-11-20 01:31:31.126861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.121 qpair failed and we were unable to recover it. 00:30:23.121 [2024-11-20 01:31:31.126971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.121 [2024-11-20 01:31:31.127055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.121 [2024-11-20 01:31:31.127110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.121 qpair failed and we were unable to recover it. 00:30:23.121 [2024-11-20 01:31:31.127237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.121 [2024-11-20 01:31:31.127325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.121 [2024-11-20 01:31:31.127352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.121 qpair failed and we were unable to recover it. 00:30:23.121 [2024-11-20 01:31:31.127497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.121 [2024-11-20 01:31:31.127621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.121 [2024-11-20 01:31:31.127646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.121 qpair failed and we were unable to recover it. 00:30:23.121 [2024-11-20 01:31:31.127741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.121 [2024-11-20 01:31:31.127829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.121 [2024-11-20 01:31:31.127855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.121 qpair failed and we were unable to recover it. 00:30:23.121 [2024-11-20 01:31:31.127945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.121 [2024-11-20 01:31:31.128090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.121 [2024-11-20 01:31:31.128116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.121 qpair failed and we were unable to recover it. 00:30:23.121 [2024-11-20 01:31:31.128232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.121 [2024-11-20 01:31:31.128348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.121 [2024-11-20 01:31:31.128375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.121 qpair failed and we were unable to recover it. 00:30:23.121 [2024-11-20 01:31:31.128475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.121 [2024-11-20 01:31:31.128597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.121 [2024-11-20 01:31:31.128624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.121 qpair failed and we were unable to recover it. 00:30:23.121 [2024-11-20 01:31:31.128769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.121 [2024-11-20 01:31:31.128882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.121 [2024-11-20 01:31:31.128909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.121 qpair failed and we were unable to recover it. 00:30:23.121 [2024-11-20 01:31:31.129020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.121 [2024-11-20 01:31:31.129145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.121 [2024-11-20 01:31:31.129172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.121 qpair failed and we were unable to recover it. 00:30:23.121 [2024-11-20 01:31:31.129290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.121 [2024-11-20 01:31:31.129408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.121 [2024-11-20 01:31:31.129435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.121 qpair failed and we were unable to recover it. 00:30:23.121 [2024-11-20 01:31:31.129524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.121 [2024-11-20 01:31:31.129638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.121 [2024-11-20 01:31:31.129664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.121 qpair failed and we were unable to recover it. 00:30:23.121 [2024-11-20 01:31:31.129778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.121 [2024-11-20 01:31:31.129891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.121 [2024-11-20 01:31:31.129918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.121 qpair failed and we were unable to recover it. 00:30:23.121 [2024-11-20 01:31:31.130041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.121 [2024-11-20 01:31:31.130128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.121 [2024-11-20 01:31:31.130154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.121 qpair failed and we were unable to recover it. 00:30:23.121 [2024-11-20 01:31:31.130241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.121 [2024-11-20 01:31:31.130330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.121 [2024-11-20 01:31:31.130356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.121 qpair failed and we were unable to recover it. 00:30:23.121 [2024-11-20 01:31:31.130469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.121 [2024-11-20 01:31:31.130561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.121 [2024-11-20 01:31:31.130588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.121 qpair failed and we were unable to recover it. 00:30:23.121 [2024-11-20 01:31:31.130709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.121 [2024-11-20 01:31:31.130826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.121 [2024-11-20 01:31:31.130853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.121 qpair failed and we were unable to recover it. 00:30:23.122 [2024-11-20 01:31:31.130970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.122 [2024-11-20 01:31:31.131053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.122 [2024-11-20 01:31:31.131089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.122 qpair failed and we were unable to recover it. 00:30:23.122 [2024-11-20 01:31:31.131214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.122 [2024-11-20 01:31:31.131304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.122 [2024-11-20 01:31:31.131330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.122 qpair failed and we were unable to recover it. 00:30:23.122 [2024-11-20 01:31:31.131423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.122 [2024-11-20 01:31:31.131501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.122 [2024-11-20 01:31:31.131527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.122 qpair failed and we were unable to recover it. 00:30:23.122 [2024-11-20 01:31:31.131645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.122 [2024-11-20 01:31:31.131758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.122 [2024-11-20 01:31:31.131784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.122 qpair failed and we were unable to recover it. 00:30:23.122 [2024-11-20 01:31:31.131896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.122 [2024-11-20 01:31:31.132052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.122 [2024-11-20 01:31:31.132112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.122 qpair failed and we were unable to recover it. 00:30:23.122 [2024-11-20 01:31:31.132207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.122 [2024-11-20 01:31:31.132289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.122 [2024-11-20 01:31:31.132316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.122 qpair failed and we were unable to recover it. 00:30:23.122 [2024-11-20 01:31:31.132413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.122 [2024-11-20 01:31:31.132558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.122 [2024-11-20 01:31:31.132584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.122 qpair failed and we were unable to recover it. 00:30:23.122 [2024-11-20 01:31:31.132667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.122 [2024-11-20 01:31:31.132785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.122 [2024-11-20 01:31:31.132810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.122 qpair failed and we were unable to recover it. 00:30:23.122 [2024-11-20 01:31:31.132923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.122 [2024-11-20 01:31:31.133020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.122 [2024-11-20 01:31:31.133046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.122 qpair failed and we were unable to recover it. 00:30:23.122 [2024-11-20 01:31:31.133177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.122 [2024-11-20 01:31:31.133260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.122 [2024-11-20 01:31:31.133286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.122 qpair failed and we were unable to recover it. 00:30:23.122 [2024-11-20 01:31:31.133410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.122 [2024-11-20 01:31:31.133518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.122 [2024-11-20 01:31:31.133549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.122 qpair failed and we were unable to recover it. 00:30:23.122 [2024-11-20 01:31:31.133641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.122 [2024-11-20 01:31:31.133755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.122 [2024-11-20 01:31:31.133781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.122 qpair failed and we were unable to recover it. 00:30:23.122 [2024-11-20 01:31:31.133865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.122 [2024-11-20 01:31:31.133982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.122 [2024-11-20 01:31:31.134010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.122 qpair failed and we were unable to recover it. 00:30:23.122 [2024-11-20 01:31:31.134133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.122 [2024-11-20 01:31:31.134287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.122 [2024-11-20 01:31:31.134314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.122 qpair failed and we were unable to recover it. 00:30:23.122 [2024-11-20 01:31:31.134406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.122 [2024-11-20 01:31:31.134518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.122 [2024-11-20 01:31:31.134544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.122 qpair failed and we were unable to recover it. 00:30:23.122 [2024-11-20 01:31:31.134630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.122 [2024-11-20 01:31:31.134716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.122 [2024-11-20 01:31:31.134743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.122 qpair failed and we were unable to recover it. 00:30:23.122 [2024-11-20 01:31:31.134829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.122 [2024-11-20 01:31:31.134912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.122 [2024-11-20 01:31:31.134938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.122 qpair failed and we were unable to recover it. 00:30:23.122 [2024-11-20 01:31:31.135050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.122 [2024-11-20 01:31:31.135145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.122 [2024-11-20 01:31:31.135172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.122 qpair failed and we were unable to recover it. 00:30:23.122 [2024-11-20 01:31:31.135268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.122 [2024-11-20 01:31:31.135366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.122 [2024-11-20 01:31:31.135391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.122 qpair failed and we were unable to recover it. 00:30:23.122 [2024-11-20 01:31:31.135510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.122 [2024-11-20 01:31:31.135621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.122 [2024-11-20 01:31:31.135646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.122 qpair failed and we were unable to recover it. 00:30:23.122 [2024-11-20 01:31:31.135791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.122 [2024-11-20 01:31:31.135904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.122 [2024-11-20 01:31:31.135933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.122 qpair failed and we were unable to recover it. 00:30:23.122 [2024-11-20 01:31:31.136025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.122 [2024-11-20 01:31:31.136154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.122 [2024-11-20 01:31:31.136182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.122 qpair failed and we were unable to recover it. 00:30:23.122 [2024-11-20 01:31:31.136273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.122 [2024-11-20 01:31:31.136355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.122 [2024-11-20 01:31:31.136381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.122 qpair failed and we were unable to recover it. 00:30:23.122 [2024-11-20 01:31:31.136498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.122 [2024-11-20 01:31:31.136618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.122 [2024-11-20 01:31:31.136643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.122 qpair failed and we were unable to recover it. 00:30:23.122 [2024-11-20 01:31:31.136761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.122 [2024-11-20 01:31:31.136876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.122 [2024-11-20 01:31:31.136901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.122 qpair failed and we were unable to recover it. 00:30:23.122 [2024-11-20 01:31:31.137016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.122 [2024-11-20 01:31:31.137106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.122 [2024-11-20 01:31:31.137132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.122 qpair failed and we were unable to recover it. 00:30:23.122 [2024-11-20 01:31:31.137225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.122 [2024-11-20 01:31:31.137364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.122 [2024-11-20 01:31:31.137389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.122 qpair failed and we were unable to recover it. 00:30:23.122 [2024-11-20 01:31:31.137479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.122 [2024-11-20 01:31:31.137609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.122 [2024-11-20 01:31:31.137635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.122 qpair failed and we were unable to recover it. 00:30:23.122 [2024-11-20 01:31:31.137729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.123 [2024-11-20 01:31:31.137847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.123 [2024-11-20 01:31:31.137874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.123 qpair failed and we were unable to recover it. 00:30:23.123 [2024-11-20 01:31:31.137985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.123 [2024-11-20 01:31:31.138104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.123 [2024-11-20 01:31:31.138132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.123 qpair failed and we were unable to recover it. 00:30:23.123 [2024-11-20 01:31:31.138277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.123 [2024-11-20 01:31:31.138393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.123 [2024-11-20 01:31:31.138424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.123 qpair failed and we were unable to recover it. 00:30:23.123 [2024-11-20 01:31:31.138511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.123 [2024-11-20 01:31:31.138605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.123 [2024-11-20 01:31:31.138632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.123 qpair failed and we were unable to recover it. 00:30:23.123 [2024-11-20 01:31:31.138721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.123 [2024-11-20 01:31:31.138837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.123 [2024-11-20 01:31:31.138861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.123 qpair failed and we were unable to recover it. 00:30:23.123 [2024-11-20 01:31:31.138975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.123 [2024-11-20 01:31:31.139095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.123 [2024-11-20 01:31:31.139122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.123 qpair failed and we were unable to recover it. 00:30:23.123 [2024-11-20 01:31:31.139202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.123 [2024-11-20 01:31:31.139346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.123 [2024-11-20 01:31:31.139372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.123 qpair failed and we were unable to recover it. 00:30:23.123 [2024-11-20 01:31:31.139488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.123 [2024-11-20 01:31:31.139567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.123 [2024-11-20 01:31:31.139593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.123 qpair failed and we were unable to recover it. 00:30:23.123 [2024-11-20 01:31:31.139705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.123 [2024-11-20 01:31:31.139799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.123 [2024-11-20 01:31:31.139826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.123 qpair failed and we were unable to recover it. 00:30:23.123 [2024-11-20 01:31:31.139941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.123 [2024-11-20 01:31:31.140052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.123 [2024-11-20 01:31:31.140084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.123 qpair failed and we were unable to recover it. 00:30:23.123 [2024-11-20 01:31:31.140182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.123 [2024-11-20 01:31:31.140288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.123 [2024-11-20 01:31:31.140312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.123 qpair failed and we were unable to recover it. 00:30:23.123 [2024-11-20 01:31:31.140402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.123 [2024-11-20 01:31:31.140518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.123 [2024-11-20 01:31:31.140546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.123 qpair failed and we were unable to recover it. 00:30:23.123 [2024-11-20 01:31:31.140693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.123 [2024-11-20 01:31:31.140783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.123 [2024-11-20 01:31:31.140809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.123 qpair failed and we were unable to recover it. 00:30:23.123 [2024-11-20 01:31:31.140908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.123 [2024-11-20 01:31:31.141026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.123 [2024-11-20 01:31:31.141052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.123 qpair failed and we were unable to recover it. 00:30:23.123 [2024-11-20 01:31:31.141172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.123 [2024-11-20 01:31:31.141290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.123 [2024-11-20 01:31:31.141318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.123 qpair failed and we were unable to recover it. 00:30:23.123 [2024-11-20 01:31:31.141410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.123 [2024-11-20 01:31:31.141503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.123 [2024-11-20 01:31:31.141529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.123 qpair failed and we were unable to recover it. 00:30:23.123 [2024-11-20 01:31:31.141608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.123 [2024-11-20 01:31:31.141690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.123 [2024-11-20 01:31:31.141689] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:23.123 [2024-11-20 01:31:31.141716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.123 qpair failed and we were unable to recover it. 00:30:23.123 [2024-11-20 01:31:31.141808] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:23.123 [2024-11-20 01:31:31.141829] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:23.123 [2024-11-20 01:31:31.141829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.123 [2024-11-20 01:31:31.141842] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:23.123 [2024-11-20 01:31:31.141920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.123 [2024-11-20 01:31:31.141946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.123 qpair failed and we were unable to recover it. 00:30:23.123 [2024-11-20 01:31:31.141922] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:30:23.123 [2024-11-20 01:31:31.142031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.123 [2024-11-20 01:31:31.141971] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:30:23.123 [2024-11-20 01:31:31.141997] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:30:23.123 [2024-11-20 01:31:31.142001] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:30:23.123 [2024-11-20 01:31:31.142155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.123 [2024-11-20 01:31:31.142180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.123 qpair failed and we were unable to recover it. 00:30:23.123 [2024-11-20 01:31:31.142272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.123 [2024-11-20 01:31:31.142369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.123 [2024-11-20 01:31:31.142397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.123 qpair failed and we were unable to recover it. 00:30:23.123 [2024-11-20 01:31:31.142515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.123 [2024-11-20 01:31:31.142599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.123 [2024-11-20 01:31:31.142629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.123 qpair failed and we were unable to recover it. 00:30:23.123 [2024-11-20 01:31:31.142719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.123 [2024-11-20 01:31:31.142834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.123 [2024-11-20 01:31:31.142859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.123 qpair failed and we were unable to recover it. 00:30:23.123 [2024-11-20 01:31:31.142938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.123 [2024-11-20 01:31:31.143048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.123 [2024-11-20 01:31:31.143081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.123 qpair failed and we were unable to recover it. 00:30:23.123 [2024-11-20 01:31:31.143204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.124 [2024-11-20 01:31:31.143286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.124 [2024-11-20 01:31:31.143312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.124 qpair failed and we were unable to recover it. 00:30:23.124 [2024-11-20 01:31:31.143458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.124 [2024-11-20 01:31:31.143543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.124 [2024-11-20 01:31:31.143570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.124 qpair failed and we were unable to recover it. 00:30:23.124 [2024-11-20 01:31:31.143674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.124 [2024-11-20 01:31:31.143787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.124 [2024-11-20 01:31:31.143812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.124 qpair failed and we were unable to recover it. 00:30:23.124 [2024-11-20 01:31:31.143933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.124 [2024-11-20 01:31:31.144044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.124 [2024-11-20 01:31:31.144078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.124 qpair failed and we were unable to recover it. 00:30:23.124 [2024-11-20 01:31:31.144165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.124 [2024-11-20 01:31:31.144276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.124 [2024-11-20 01:31:31.144302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.124 qpair failed and we were unable to recover it. 00:30:23.124 [2024-11-20 01:31:31.144392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.124 [2024-11-20 01:31:31.144491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.124 [2024-11-20 01:31:31.144517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.124 qpair failed and we were unable to recover it. 00:30:23.124 [2024-11-20 01:31:31.144602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.124 [2024-11-20 01:31:31.144687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.124 [2024-11-20 01:31:31.144714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.124 qpair failed and we were unable to recover it. 00:30:23.124 [2024-11-20 01:31:31.144860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.124 [2024-11-20 01:31:31.144973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.124 [2024-11-20 01:31:31.144999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.124 qpair failed and we were unable to recover it. 00:30:23.124 [2024-11-20 01:31:31.145093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.124 [2024-11-20 01:31:31.145182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.124 [2024-11-20 01:31:31.145208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.124 qpair failed and we were unable to recover it. 00:30:23.124 [2024-11-20 01:31:31.145304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.124 [2024-11-20 01:31:31.145388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.124 [2024-11-20 01:31:31.145414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.124 qpair failed and we were unable to recover it. 00:30:23.124 [2024-11-20 01:31:31.145560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.124 [2024-11-20 01:31:31.145675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.124 [2024-11-20 01:31:31.145700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.124 qpair failed and we were unable to recover it. 00:30:23.124 [2024-11-20 01:31:31.145782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.124 [2024-11-20 01:31:31.145897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.124 [2024-11-20 01:31:31.145923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.124 qpair failed and we were unable to recover it. 00:30:23.124 [2024-11-20 01:31:31.146045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.124 [2024-11-20 01:31:31.146212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.124 [2024-11-20 01:31:31.146239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.124 qpair failed and we were unable to recover it. 00:30:23.124 [2024-11-20 01:31:31.146360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.124 [2024-11-20 01:31:31.146472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.124 [2024-11-20 01:31:31.146499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.124 qpair failed and we were unable to recover it. 00:30:23.124 [2024-11-20 01:31:31.146608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.124 [2024-11-20 01:31:31.146685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.124 [2024-11-20 01:31:31.146711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.124 qpair failed and we were unable to recover it. 00:30:23.124 [2024-11-20 01:31:31.146798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.124 [2024-11-20 01:31:31.146911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.124 [2024-11-20 01:31:31.146937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.124 qpair failed and we were unable to recover it. 00:30:23.124 [2024-11-20 01:31:31.147032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.124 [2024-11-20 01:31:31.147161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.124 [2024-11-20 01:31:31.147187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.124 qpair failed and we were unable to recover it. 00:30:23.124 [2024-11-20 01:31:31.147277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.124 [2024-11-20 01:31:31.147396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.124 [2024-11-20 01:31:31.147422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.124 qpair failed and we were unable to recover it. 00:30:23.124 [2024-11-20 01:31:31.147529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.124 [2024-11-20 01:31:31.147606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.124 [2024-11-20 01:31:31.147632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.124 qpair failed and we were unable to recover it. 00:30:23.124 [2024-11-20 01:31:31.147747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.124 [2024-11-20 01:31:31.147860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.124 [2024-11-20 01:31:31.147886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.124 qpair failed and we were unable to recover it. 00:30:23.124 [2024-11-20 01:31:31.148007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.124 [2024-11-20 01:31:31.148093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.124 [2024-11-20 01:31:31.148119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.124 qpair failed and we were unable to recover it. 00:30:23.124 [2024-11-20 01:31:31.148207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.124 [2024-11-20 01:31:31.148292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.124 [2024-11-20 01:31:31.148318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.124 qpair failed and we were unable to recover it. 00:30:23.124 [2024-11-20 01:31:31.148449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.124 [2024-11-20 01:31:31.148558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.124 [2024-11-20 01:31:31.148584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.124 qpair failed and we were unable to recover it. 00:30:23.124 [2024-11-20 01:31:31.148701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.124 [2024-11-20 01:31:31.148794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.124 [2024-11-20 01:31:31.148820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.124 qpair failed and we were unable to recover it. 00:30:23.124 [2024-11-20 01:31:31.148933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.124 [2024-11-20 01:31:31.149017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.124 [2024-11-20 01:31:31.149042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.124 qpair failed and we were unable to recover it. 00:30:23.124 [2024-11-20 01:31:31.149142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.124 [2024-11-20 01:31:31.149261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.124 [2024-11-20 01:31:31.149287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.124 qpair failed and we were unable to recover it. 00:30:23.124 [2024-11-20 01:31:31.149431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.124 [2024-11-20 01:31:31.149541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.124 [2024-11-20 01:31:31.149567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.124 qpair failed and we were unable to recover it. 00:30:23.124 [2024-11-20 01:31:31.149651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.124 [2024-11-20 01:31:31.149761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.124 [2024-11-20 01:31:31.149787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.124 qpair failed and we were unable to recover it. 00:30:23.124 [2024-11-20 01:31:31.149910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.124 [2024-11-20 01:31:31.149992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.124 [2024-11-20 01:31:31.150017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.125 qpair failed and we were unable to recover it. 00:30:23.125 [2024-11-20 01:31:31.150103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.125 [2024-11-20 01:31:31.150249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.125 [2024-11-20 01:31:31.150274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.125 qpair failed and we were unable to recover it. 00:30:23.125 [2024-11-20 01:31:31.150360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.125 [2024-11-20 01:31:31.150444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.125 [2024-11-20 01:31:31.150470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.125 qpair failed and we were unable to recover it. 00:30:23.125 [2024-11-20 01:31:31.150563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.125 [2024-11-20 01:31:31.150707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.125 [2024-11-20 01:31:31.150733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.125 qpair failed and we were unable to recover it. 00:30:23.125 [2024-11-20 01:31:31.150818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.125 [2024-11-20 01:31:31.150912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.125 [2024-11-20 01:31:31.150937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.125 qpair failed and we were unable to recover it. 00:30:23.125 [2024-11-20 01:31:31.151055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.125 [2024-11-20 01:31:31.151146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.125 [2024-11-20 01:31:31.151173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.125 qpair failed and we were unable to recover it. 00:30:23.125 [2024-11-20 01:31:31.151268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.125 [2024-11-20 01:31:31.151357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.125 [2024-11-20 01:31:31.151384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.125 qpair failed and we were unable to recover it. 00:30:23.125 [2024-11-20 01:31:31.151477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.125 [2024-11-20 01:31:31.151588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.125 [2024-11-20 01:31:31.151613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.125 qpair failed and we were unable to recover it. 00:30:23.125 [2024-11-20 01:31:31.151730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.125 [2024-11-20 01:31:31.151837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.125 [2024-11-20 01:31:31.151863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.125 qpair failed and we were unable to recover it. 00:30:23.125 [2024-11-20 01:31:31.151978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.125 [2024-11-20 01:31:31.152059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.125 [2024-11-20 01:31:31.152092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.125 qpair failed and we were unable to recover it. 00:30:23.125 [2024-11-20 01:31:31.152221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.125 [2024-11-20 01:31:31.152339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.125 [2024-11-20 01:31:31.152365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.125 qpair failed and we were unable to recover it. 00:30:23.125 [2024-11-20 01:31:31.152455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.125 [2024-11-20 01:31:31.152542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.125 [2024-11-20 01:31:31.152567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.125 qpair failed and we were unable to recover it. 00:30:23.125 [2024-11-20 01:31:31.152654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.125 [2024-11-20 01:31:31.152743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.125 [2024-11-20 01:31:31.152768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.125 qpair failed and we were unable to recover it. 00:30:23.125 [2024-11-20 01:31:31.152881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.125 [2024-11-20 01:31:31.152966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.125 [2024-11-20 01:31:31.152991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.125 qpair failed and we were unable to recover it. 00:30:23.125 [2024-11-20 01:31:31.153083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.125 [2024-11-20 01:31:31.153200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.125 [2024-11-20 01:31:31.153227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.125 qpair failed and we were unable to recover it. 00:30:23.125 [2024-11-20 01:31:31.153339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.125 [2024-11-20 01:31:31.153440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.125 [2024-11-20 01:31:31.153466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.125 qpair failed and we were unable to recover it. 00:30:23.125 [2024-11-20 01:31:31.153587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.125 [2024-11-20 01:31:31.153672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.125 [2024-11-20 01:31:31.153698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.125 qpair failed and we were unable to recover it. 00:30:23.125 [2024-11-20 01:31:31.153783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.125 [2024-11-20 01:31:31.153865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.125 [2024-11-20 01:31:31.153891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.125 qpair failed and we were unable to recover it. 00:30:23.125 [2024-11-20 01:31:31.154009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.125 [2024-11-20 01:31:31.154098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.125 [2024-11-20 01:31:31.154126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.125 qpair failed and we were unable to recover it. 00:30:23.125 [2024-11-20 01:31:31.154217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.125 [2024-11-20 01:31:31.154338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.125 [2024-11-20 01:31:31.154364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.125 qpair failed and we were unable to recover it. 00:30:23.125 [2024-11-20 01:31:31.154451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.125 [2024-11-20 01:31:31.154578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.125 [2024-11-20 01:31:31.154603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.125 qpair failed and we were unable to recover it. 00:30:23.125 [2024-11-20 01:31:31.154689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.125 [2024-11-20 01:31:31.154803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.125 [2024-11-20 01:31:31.154830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.125 qpair failed and we were unable to recover it. 00:30:23.125 [2024-11-20 01:31:31.154943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.125 [2024-11-20 01:31:31.155057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.125 [2024-11-20 01:31:31.155136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.125 qpair failed and we were unable to recover it. 00:30:23.125 [2024-11-20 01:31:31.155226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.125 [2024-11-20 01:31:31.155309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.125 [2024-11-20 01:31:31.155334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.125 qpair failed and we were unable to recover it. 00:30:23.125 [2024-11-20 01:31:31.155455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.125 [2024-11-20 01:31:31.155596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.125 [2024-11-20 01:31:31.155621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.125 qpair failed and we were unable to recover it. 00:30:23.125 [2024-11-20 01:31:31.155706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.125 [2024-11-20 01:31:31.155821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.125 [2024-11-20 01:31:31.155847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.125 qpair failed and we were unable to recover it. 00:30:23.125 [2024-11-20 01:31:31.155959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.125 [2024-11-20 01:31:31.156046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.125 [2024-11-20 01:31:31.156077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.125 qpair failed and we were unable to recover it. 00:30:23.125 [2024-11-20 01:31:31.156192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.125 [2024-11-20 01:31:31.156306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.125 [2024-11-20 01:31:31.156330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.125 qpair failed and we were unable to recover it. 00:30:23.125 [2024-11-20 01:31:31.156452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.125 [2024-11-20 01:31:31.156584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.125 [2024-11-20 01:31:31.156609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.125 qpair failed and we were unable to recover it. 00:30:23.125 [2024-11-20 01:31:31.156697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.126 [2024-11-20 01:31:31.156808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.126 [2024-11-20 01:31:31.156833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.126 qpair failed and we were unable to recover it. 00:30:23.126 [2024-11-20 01:31:31.156928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.126 [2024-11-20 01:31:31.157010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.126 [2024-11-20 01:31:31.157037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.126 qpair failed and we were unable to recover it. 00:30:23.126 [2024-11-20 01:31:31.157131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.126 [2024-11-20 01:31:31.157277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.126 [2024-11-20 01:31:31.157302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.126 qpair failed and we were unable to recover it. 00:30:23.126 [2024-11-20 01:31:31.157386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.126 [2024-11-20 01:31:31.157473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.126 [2024-11-20 01:31:31.157500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.126 qpair failed and we were unable to recover it. 00:30:23.126 [2024-11-20 01:31:31.157611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.126 [2024-11-20 01:31:31.157690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.126 [2024-11-20 01:31:31.157715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.126 qpair failed and we were unable to recover it. 00:30:23.126 [2024-11-20 01:31:31.157813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.126 [2024-11-20 01:31:31.157924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.126 [2024-11-20 01:31:31.157949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.126 qpair failed and we were unable to recover it. 00:30:23.126 [2024-11-20 01:31:31.158077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.126 [2024-11-20 01:31:31.158198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.126 [2024-11-20 01:31:31.158223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.126 qpair failed and we were unable to recover it. 00:30:23.126 [2024-11-20 01:31:31.158308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.126 [2024-11-20 01:31:31.158399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.126 [2024-11-20 01:31:31.158425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.126 qpair failed and we were unable to recover it. 00:30:23.126 [2024-11-20 01:31:31.158516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.126 [2024-11-20 01:31:31.158628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.126 [2024-11-20 01:31:31.158655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.126 qpair failed and we were unable to recover it. 00:30:23.126 [2024-11-20 01:31:31.158745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.126 [2024-11-20 01:31:31.158848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.126 [2024-11-20 01:31:31.158874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.126 qpair failed and we were unable to recover it. 00:30:23.126 [2024-11-20 01:31:31.158960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.126 [2024-11-20 01:31:31.159076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.126 [2024-11-20 01:31:31.159102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.126 qpair failed and we were unable to recover it. 00:30:23.126 [2024-11-20 01:31:31.159224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.126 [2024-11-20 01:31:31.159343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.126 [2024-11-20 01:31:31.159367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.126 qpair failed and we were unable to recover it. 00:30:23.126 [2024-11-20 01:31:31.159456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.126 [2024-11-20 01:31:31.159545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.126 [2024-11-20 01:31:31.159570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.126 qpair failed and we were unable to recover it. 00:30:23.126 [2024-11-20 01:31:31.159691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.126 [2024-11-20 01:31:31.159806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.126 [2024-11-20 01:31:31.159831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.126 qpair failed and we were unable to recover it. 00:30:23.126 [2024-11-20 01:31:31.159917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.126 [2024-11-20 01:31:31.160031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.126 [2024-11-20 01:31:31.160056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.126 qpair failed and we were unable to recover it. 00:30:23.126 [2024-11-20 01:31:31.160170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.126 [2024-11-20 01:31:31.160261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.126 [2024-11-20 01:31:31.160286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.126 qpair failed and we were unable to recover it. 00:30:23.126 [2024-11-20 01:31:31.160417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.126 [2024-11-20 01:31:31.160507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.126 [2024-11-20 01:31:31.160534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.126 qpair failed and we were unable to recover it. 00:30:23.126 [2024-11-20 01:31:31.160649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.126 [2024-11-20 01:31:31.160737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.126 [2024-11-20 01:31:31.160764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.126 qpair failed and we were unable to recover it. 00:30:23.126 [2024-11-20 01:31:31.160885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.126 [2024-11-20 01:31:31.160998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.126 [2024-11-20 01:31:31.161024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.126 qpair failed and we were unable to recover it. 00:30:23.126 [2024-11-20 01:31:31.161126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.126 [2024-11-20 01:31:31.161219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.126 [2024-11-20 01:31:31.161245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.126 qpair failed and we were unable to recover it. 00:30:23.126 [2024-11-20 01:31:31.161338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.126 [2024-11-20 01:31:31.161451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.126 [2024-11-20 01:31:31.161476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.126 qpair failed and we were unable to recover it. 00:30:23.126 [2024-11-20 01:31:31.161561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.126 [2024-11-20 01:31:31.161656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.126 [2024-11-20 01:31:31.161682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.126 qpair failed and we were unable to recover it. 00:30:23.126 [2024-11-20 01:31:31.161811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.126 [2024-11-20 01:31:31.161926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.126 [2024-11-20 01:31:31.161953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.126 qpair failed and we were unable to recover it. 00:30:23.126 [2024-11-20 01:31:31.162077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.126 [2024-11-20 01:31:31.162193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.126 [2024-11-20 01:31:31.162220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.126 qpair failed and we were unable to recover it. 00:30:23.126 [2024-11-20 01:31:31.162307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.126 [2024-11-20 01:31:31.162399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.126 [2024-11-20 01:31:31.162425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.126 qpair failed and we were unable to recover it. 00:30:23.126 [2024-11-20 01:31:31.162525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.126 [2024-11-20 01:31:31.162621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.126 [2024-11-20 01:31:31.162646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.126 qpair failed and we were unable to recover it. 00:30:23.126 [2024-11-20 01:31:31.162736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.126 [2024-11-20 01:31:31.162825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.126 [2024-11-20 01:31:31.162850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.126 qpair failed and we were unable to recover it. 00:30:23.126 [2024-11-20 01:31:31.162972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.126 [2024-11-20 01:31:31.163060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.126 [2024-11-20 01:31:31.163105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.126 qpair failed and we were unable to recover it. 00:30:23.126 [2024-11-20 01:31:31.163223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.126 [2024-11-20 01:31:31.163334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.126 [2024-11-20 01:31:31.163359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.127 qpair failed and we were unable to recover it. 00:30:23.127 [2024-11-20 01:31:31.163484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.127 [2024-11-20 01:31:31.163565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.127 [2024-11-20 01:31:31.163590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.127 qpair failed and we were unable to recover it. 00:30:23.127 [2024-11-20 01:31:31.163683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.127 [2024-11-20 01:31:31.163766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.127 [2024-11-20 01:31:31.163791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.127 qpair failed and we were unable to recover it. 00:30:23.127 [2024-11-20 01:31:31.163921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.127 [2024-11-20 01:31:31.164076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.127 [2024-11-20 01:31:31.164103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.127 qpair failed and we were unable to recover it. 00:30:23.127 [2024-11-20 01:31:31.164190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.127 [2024-11-20 01:31:31.164271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.127 [2024-11-20 01:31:31.164295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.127 qpair failed and we were unable to recover it. 00:30:23.127 [2024-11-20 01:31:31.164406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.127 [2024-11-20 01:31:31.164490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.127 [2024-11-20 01:31:31.164515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.127 qpair failed and we were unable to recover it. 00:30:23.127 [2024-11-20 01:31:31.164628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.127 [2024-11-20 01:31:31.164749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.127 [2024-11-20 01:31:31.164775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.127 qpair failed and we were unable to recover it. 00:30:23.127 [2024-11-20 01:31:31.164853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.127 [2024-11-20 01:31:31.164966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.127 [2024-11-20 01:31:31.164991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.127 qpair failed and we were unable to recover it. 00:30:23.127 [2024-11-20 01:31:31.165119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.127 [2024-11-20 01:31:31.165212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.127 [2024-11-20 01:31:31.165238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.127 qpair failed and we were unable to recover it. 00:30:23.127 [2024-11-20 01:31:31.165354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.127 [2024-11-20 01:31:31.165441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.127 [2024-11-20 01:31:31.165466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.127 qpair failed and we were unable to recover it. 00:30:23.127 [2024-11-20 01:31:31.165555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.127 [2024-11-20 01:31:31.165634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.127 [2024-11-20 01:31:31.165658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.127 qpair failed and we were unable to recover it. 00:30:23.127 [2024-11-20 01:31:31.165801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.127 [2024-11-20 01:31:31.165916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.127 [2024-11-20 01:31:31.165940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.127 qpair failed and we were unable to recover it. 00:30:23.127 [2024-11-20 01:31:31.166018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.127 [2024-11-20 01:31:31.166115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.127 [2024-11-20 01:31:31.166142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.127 qpair failed and we were unable to recover it. 00:30:23.127 [2024-11-20 01:31:31.166235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.127 [2024-11-20 01:31:31.166334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.127 [2024-11-20 01:31:31.166360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.127 qpair failed and we were unable to recover it. 00:30:23.127 [2024-11-20 01:31:31.166502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.127 [2024-11-20 01:31:31.166623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.127 [2024-11-20 01:31:31.166649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.127 qpair failed and we were unable to recover it. 00:30:23.127 [2024-11-20 01:31:31.166770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.127 [2024-11-20 01:31:31.166883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.127 [2024-11-20 01:31:31.166909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.127 qpair failed and we were unable to recover it. 00:30:23.127 [2024-11-20 01:31:31.166996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.127 [2024-11-20 01:31:31.167113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.127 [2024-11-20 01:31:31.167140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.127 qpair failed and we were unable to recover it. 00:30:23.127 [2024-11-20 01:31:31.167265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.127 [2024-11-20 01:31:31.167383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.127 [2024-11-20 01:31:31.167409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.127 qpair failed and we were unable to recover it. 00:30:23.127 [2024-11-20 01:31:31.167491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.127 [2024-11-20 01:31:31.167579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.127 [2024-11-20 01:31:31.167605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.127 qpair failed and we were unable to recover it. 00:30:23.127 [2024-11-20 01:31:31.167725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.127 [2024-11-20 01:31:31.167814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.127 [2024-11-20 01:31:31.167839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.127 qpair failed and we were unable to recover it. 00:30:23.127 [2024-11-20 01:31:31.167947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.127 [2024-11-20 01:31:31.168063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.127 [2024-11-20 01:31:31.168094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.127 qpair failed and we were unable to recover it. 00:30:23.127 [2024-11-20 01:31:31.168186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.127 [2024-11-20 01:31:31.168299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.127 [2024-11-20 01:31:31.168324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.127 qpair failed and we were unable to recover it. 00:30:23.127 [2024-11-20 01:31:31.168406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.127 [2024-11-20 01:31:31.168533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.127 [2024-11-20 01:31:31.168559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.127 qpair failed and we were unable to recover it. 00:30:23.127 [2024-11-20 01:31:31.168637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.127 [2024-11-20 01:31:31.168760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.127 [2024-11-20 01:31:31.168786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.127 qpair failed and we were unable to recover it. 00:30:23.127 [2024-11-20 01:31:31.168903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.127 [2024-11-20 01:31:31.168990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.127 [2024-11-20 01:31:31.169016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.127 qpair failed and we were unable to recover it. 00:30:23.127 [2024-11-20 01:31:31.169135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.127 [2024-11-20 01:31:31.169219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.127 [2024-11-20 01:31:31.169244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.127 qpair failed and we were unable to recover it. 00:30:23.127 [2024-11-20 01:31:31.169325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.127 [2024-11-20 01:31:31.169436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.127 [2024-11-20 01:31:31.169461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.127 qpair failed and we were unable to recover it. 00:30:23.127 [2024-11-20 01:31:31.169548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.127 [2024-11-20 01:31:31.169632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.127 [2024-11-20 01:31:31.169659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.127 qpair failed and we were unable to recover it. 00:30:23.127 [2024-11-20 01:31:31.169748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.127 [2024-11-20 01:31:31.169838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.127 [2024-11-20 01:31:31.169864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.127 qpair failed and we were unable to recover it. 00:30:23.128 [2024-11-20 01:31:31.169961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.128 [2024-11-20 01:31:31.170043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.128 [2024-11-20 01:31:31.170075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.128 qpair failed and we were unable to recover it. 00:30:23.128 [2024-11-20 01:31:31.170200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.128 [2024-11-20 01:31:31.170289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.128 [2024-11-20 01:31:31.170314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.128 qpair failed and we were unable to recover it. 00:30:23.128 [2024-11-20 01:31:31.170437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.128 [2024-11-20 01:31:31.170550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.128 [2024-11-20 01:31:31.170575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.128 qpair failed and we were unable to recover it. 00:30:23.128 [2024-11-20 01:31:31.170665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.128 [2024-11-20 01:31:31.170755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.128 [2024-11-20 01:31:31.170781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.128 qpair failed and we were unable to recover it. 00:30:23.128 [2024-11-20 01:31:31.170877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.128 [2024-11-20 01:31:31.170992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.128 [2024-11-20 01:31:31.171017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.128 qpair failed and we were unable to recover it. 00:30:23.128 [2024-11-20 01:31:31.171118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.128 [2024-11-20 01:31:31.171195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.128 [2024-11-20 01:31:31.171219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.128 qpair failed and we were unable to recover it. 00:30:23.128 [2024-11-20 01:31:31.171326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.128 [2024-11-20 01:31:31.171407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.128 [2024-11-20 01:31:31.171433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.128 qpair failed and we were unable to recover it. 00:30:23.128 [2024-11-20 01:31:31.171524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.128 [2024-11-20 01:31:31.171603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.128 [2024-11-20 01:31:31.171628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.128 qpair failed and we were unable to recover it. 00:30:23.128 [2024-11-20 01:31:31.171709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.128 [2024-11-20 01:31:31.171818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.128 [2024-11-20 01:31:31.171842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.128 qpair failed and we were unable to recover it. 00:30:23.128 [2024-11-20 01:31:31.171925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.128 [2024-11-20 01:31:31.172033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.128 [2024-11-20 01:31:31.172059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.128 qpair failed and we were unable to recover it. 00:30:23.128 [2024-11-20 01:31:31.172179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.128 [2024-11-20 01:31:31.172263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.128 [2024-11-20 01:31:31.172289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.128 qpair failed and we were unable to recover it. 00:30:23.128 [2024-11-20 01:31:31.172376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.128 [2024-11-20 01:31:31.172465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.128 [2024-11-20 01:31:31.172491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.128 qpair failed and we were unable to recover it. 00:30:23.128 [2024-11-20 01:31:31.172577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.128 [2024-11-20 01:31:31.172670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.128 [2024-11-20 01:31:31.172695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.128 qpair failed and we were unable to recover it. 00:30:23.128 [2024-11-20 01:31:31.172786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.128 [2024-11-20 01:31:31.172874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.128 [2024-11-20 01:31:31.172899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.128 qpair failed and we were unable to recover it. 00:30:23.128 [2024-11-20 01:31:31.172983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.128 [2024-11-20 01:31:31.173077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.128 [2024-11-20 01:31:31.173109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.128 qpair failed and we were unable to recover it. 00:30:23.128 [2024-11-20 01:31:31.173206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.128 [2024-11-20 01:31:31.173322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.128 [2024-11-20 01:31:31.173348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.128 qpair failed and we were unable to recover it. 00:30:23.128 [2024-11-20 01:31:31.173446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.128 [2024-11-20 01:31:31.173531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.128 [2024-11-20 01:31:31.173555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.128 qpair failed and we were unable to recover it. 00:30:23.128 [2024-11-20 01:31:31.173670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.128 [2024-11-20 01:31:31.173786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.128 [2024-11-20 01:31:31.173811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.128 qpair failed and we were unable to recover it. 00:30:23.128 [2024-11-20 01:31:31.173900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.128 [2024-11-20 01:31:31.174033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.128 [2024-11-20 01:31:31.174058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.128 qpair failed and we were unable to recover it. 00:30:23.128 [2024-11-20 01:31:31.174176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.128 [2024-11-20 01:31:31.174292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.128 [2024-11-20 01:31:31.174317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.128 qpair failed and we were unable to recover it. 00:30:23.128 [2024-11-20 01:31:31.174429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.128 [2024-11-20 01:31:31.174511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.128 [2024-11-20 01:31:31.174536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.128 qpair failed and we were unable to recover it. 00:30:23.128 [2024-11-20 01:31:31.174622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.128 [2024-11-20 01:31:31.174705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.128 [2024-11-20 01:31:31.174731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.128 qpair failed and we were unable to recover it. 00:30:23.128 [2024-11-20 01:31:31.174857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.128 [2024-11-20 01:31:31.174939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.128 [2024-11-20 01:31:31.174966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.128 qpair failed and we were unable to recover it. 00:30:23.128 [2024-11-20 01:31:31.175053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.128 [2024-11-20 01:31:31.175159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.128 [2024-11-20 01:31:31.175185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.128 qpair failed and we were unable to recover it. 00:30:23.129 [2024-11-20 01:31:31.175299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.129 [2024-11-20 01:31:31.175381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.129 [2024-11-20 01:31:31.175415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.129 qpair failed and we were unable to recover it. 00:30:23.129 [2024-11-20 01:31:31.175506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.129 [2024-11-20 01:31:31.175648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.129 [2024-11-20 01:31:31.175673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.129 qpair failed and we were unable to recover it. 00:30:23.129 [2024-11-20 01:31:31.175756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.129 [2024-11-20 01:31:31.175832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.129 [2024-11-20 01:31:31.175856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.129 qpair failed and we were unable to recover it. 00:30:23.129 [2024-11-20 01:31:31.175981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.129 [2024-11-20 01:31:31.176067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.129 [2024-11-20 01:31:31.176101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.129 qpair failed and we were unable to recover it. 00:30:23.129 [2024-11-20 01:31:31.176214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.129 [2024-11-20 01:31:31.176333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.129 [2024-11-20 01:31:31.176357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.129 qpair failed and we were unable to recover it. 00:30:23.129 [2024-11-20 01:31:31.176452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.129 [2024-11-20 01:31:31.176573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.129 [2024-11-20 01:31:31.176598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.129 qpair failed and we were unable to recover it. 00:30:23.129 [2024-11-20 01:31:31.176720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.129 [2024-11-20 01:31:31.176812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.129 [2024-11-20 01:31:31.176837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.129 qpair failed and we were unable to recover it. 00:30:23.129 [2024-11-20 01:31:31.176958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.129 [2024-11-20 01:31:31.177041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.129 [2024-11-20 01:31:31.177067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.129 qpair failed and we were unable to recover it. 00:30:23.129 [2024-11-20 01:31:31.177162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.129 [2024-11-20 01:31:31.177251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.129 [2024-11-20 01:31:31.177277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.129 qpair failed and we were unable to recover it. 00:30:23.129 [2024-11-20 01:31:31.177372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.129 [2024-11-20 01:31:31.177455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.129 [2024-11-20 01:31:31.177481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.129 qpair failed and we were unable to recover it. 00:30:23.129 [2024-11-20 01:31:31.177601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.129 [2024-11-20 01:31:31.177717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.129 [2024-11-20 01:31:31.177748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.129 qpair failed and we were unable to recover it. 00:30:23.129 [2024-11-20 01:31:31.177834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.129 [2024-11-20 01:31:31.177915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.129 [2024-11-20 01:31:31.177939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.129 qpair failed and we were unable to recover it. 00:30:23.129 [2024-11-20 01:31:31.178050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.129 [2024-11-20 01:31:31.178175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.129 [2024-11-20 01:31:31.178201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.129 qpair failed and we were unable to recover it. 00:30:23.129 [2024-11-20 01:31:31.178290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.129 [2024-11-20 01:31:31.178400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.129 [2024-11-20 01:31:31.178425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.129 qpair failed and we were unable to recover it. 00:30:23.129 [2024-11-20 01:31:31.178535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.129 [2024-11-20 01:31:31.178618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.129 [2024-11-20 01:31:31.178644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.129 qpair failed and we were unable to recover it. 00:30:23.129 [2024-11-20 01:31:31.178757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.129 [2024-11-20 01:31:31.178870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.129 [2024-11-20 01:31:31.178894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.129 qpair failed and we were unable to recover it. 00:30:23.129 [2024-11-20 01:31:31.178983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.129 [2024-11-20 01:31:31.179102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.129 [2024-11-20 01:31:31.179128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.129 qpair failed and we were unable to recover it. 00:30:23.129 [2024-11-20 01:31:31.179218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.129 [2024-11-20 01:31:31.179304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.129 [2024-11-20 01:31:31.179331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.129 qpair failed and we were unable to recover it. 00:30:23.129 [2024-11-20 01:31:31.179436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.129 [2024-11-20 01:31:31.179523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.129 [2024-11-20 01:31:31.179549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.129 qpair failed and we were unable to recover it. 00:30:23.129 [2024-11-20 01:31:31.179632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.129 [2024-11-20 01:31:31.179743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.129 [2024-11-20 01:31:31.179768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.129 qpair failed and we were unable to recover it. 00:30:23.129 [2024-11-20 01:31:31.179930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.129 [2024-11-20 01:31:31.180077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.129 [2024-11-20 01:31:31.180116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.129 qpair failed and we were unable to recover it. 00:30:23.129 [2024-11-20 01:31:31.180203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.129 [2024-11-20 01:31:31.180322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.129 [2024-11-20 01:31:31.180349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.129 qpair failed and we were unable to recover it. 00:30:23.129 [2024-11-20 01:31:31.180447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.129 [2024-11-20 01:31:31.180530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.129 [2024-11-20 01:31:31.180554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.129 qpair failed and we were unable to recover it. 00:30:23.129 [2024-11-20 01:31:31.180668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.129 [2024-11-20 01:31:31.180780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.129 [2024-11-20 01:31:31.180805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.129 qpair failed and we were unable to recover it. 00:30:23.129 [2024-11-20 01:31:31.180889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.129 [2024-11-20 01:31:31.180974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.129 [2024-11-20 01:31:31.180999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.129 qpair failed and we were unable to recover it. 00:30:23.129 [2024-11-20 01:31:31.181144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.129 [2024-11-20 01:31:31.181230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.129 [2024-11-20 01:31:31.181256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.129 qpair failed and we were unable to recover it. 00:30:23.129 [2024-11-20 01:31:31.181384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.129 [2024-11-20 01:31:31.181500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.129 [2024-11-20 01:31:31.181527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.129 qpair failed and we were unable to recover it. 00:30:23.129 [2024-11-20 01:31:31.181647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.129 [2024-11-20 01:31:31.181789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.129 [2024-11-20 01:31:31.181815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.129 qpair failed and we were unable to recover it. 00:30:23.129 [2024-11-20 01:31:31.181904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.130 [2024-11-20 01:31:31.181990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.130 [2024-11-20 01:31:31.182016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.130 qpair failed and we were unable to recover it. 00:30:23.130 [2024-11-20 01:31:31.182113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.130 [2024-11-20 01:31:31.182243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.130 [2024-11-20 01:31:31.182269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.130 qpair failed and we were unable to recover it. 00:30:23.130 [2024-11-20 01:31:31.182396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.130 [2024-11-20 01:31:31.182515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.130 [2024-11-20 01:31:31.182540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.130 qpair failed and we were unable to recover it. 00:30:23.130 [2024-11-20 01:31:31.182667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.130 [2024-11-20 01:31:31.182749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.130 [2024-11-20 01:31:31.182775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.130 qpair failed and we were unable to recover it. 00:30:23.130 [2024-11-20 01:31:31.182898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.130 [2024-11-20 01:31:31.183023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.130 [2024-11-20 01:31:31.183048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.130 qpair failed and we were unable to recover it. 00:30:23.130 [2024-11-20 01:31:31.183153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.130 [2024-11-20 01:31:31.183238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.130 [2024-11-20 01:31:31.183265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.130 qpair failed and we were unable to recover it. 00:30:23.130 [2024-11-20 01:31:31.183392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.130 [2024-11-20 01:31:31.183483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.130 [2024-11-20 01:31:31.183508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.130 qpair failed and we were unable to recover it. 00:30:23.130 [2024-11-20 01:31:31.183591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.130 [2024-11-20 01:31:31.183669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.130 [2024-11-20 01:31:31.183695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.130 qpair failed and we were unable to recover it. 00:30:23.130 [2024-11-20 01:31:31.183815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.130 [2024-11-20 01:31:31.183894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.130 [2024-11-20 01:31:31.183919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.130 qpair failed and we were unable to recover it. 00:30:23.130 [2024-11-20 01:31:31.184005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.130 [2024-11-20 01:31:31.184090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.130 [2024-11-20 01:31:31.184116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.130 qpair failed and we were unable to recover it. 00:30:23.130 [2024-11-20 01:31:31.184192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.130 [2024-11-20 01:31:31.184273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.130 [2024-11-20 01:31:31.184299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.130 qpair failed and we were unable to recover it. 00:30:23.130 [2024-11-20 01:31:31.184420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.130 [2024-11-20 01:31:31.184506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.130 [2024-11-20 01:31:31.184531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.130 qpair failed and we were unable to recover it. 00:30:23.130 [2024-11-20 01:31:31.184642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.130 [2024-11-20 01:31:31.184716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.130 [2024-11-20 01:31:31.184741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.130 qpair failed and we were unable to recover it. 00:30:23.130 [2024-11-20 01:31:31.184829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.130 [2024-11-20 01:31:31.184938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.130 [2024-11-20 01:31:31.184963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.130 qpair failed and we were unable to recover it. 00:30:23.130 [2024-11-20 01:31:31.185100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.130 [2024-11-20 01:31:31.185193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.130 [2024-11-20 01:31:31.185218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.130 qpair failed and we were unable to recover it. 00:30:23.130 [2024-11-20 01:31:31.185314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.130 [2024-11-20 01:31:31.185434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.130 [2024-11-20 01:31:31.185459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.130 qpair failed and we were unable to recover it. 00:30:23.130 [2024-11-20 01:31:31.185538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.130 [2024-11-20 01:31:31.185653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.130 [2024-11-20 01:31:31.185678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.130 qpair failed and we were unable to recover it. 00:30:23.130 [2024-11-20 01:31:31.185767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.130 [2024-11-20 01:31:31.185848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.130 [2024-11-20 01:31:31.185874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.130 qpair failed and we were unable to recover it. 00:30:23.130 [2024-11-20 01:31:31.185959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.130 [2024-11-20 01:31:31.186047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.130 [2024-11-20 01:31:31.186077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.130 qpair failed and we were unable to recover it. 00:30:23.130 [2024-11-20 01:31:31.186192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.130 [2024-11-20 01:31:31.186276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.130 [2024-11-20 01:31:31.186301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.130 qpair failed and we were unable to recover it. 00:30:23.130 [2024-11-20 01:31:31.186388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.130 [2024-11-20 01:31:31.186481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.130 [2024-11-20 01:31:31.186508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.130 qpair failed and we were unable to recover it. 00:30:23.130 [2024-11-20 01:31:31.186587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.130 [2024-11-20 01:31:31.186695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.130 [2024-11-20 01:31:31.186720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.130 qpair failed and we were unable to recover it. 00:30:23.130 [2024-11-20 01:31:31.186809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.130 [2024-11-20 01:31:31.186925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.130 [2024-11-20 01:31:31.186949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.130 qpair failed and we were unable to recover it. 00:30:23.130 [2024-11-20 01:31:31.187039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.130 [2024-11-20 01:31:31.187154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.130 [2024-11-20 01:31:31.187180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.130 qpair failed and we were unable to recover it. 00:30:23.130 [2024-11-20 01:31:31.187299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.130 [2024-11-20 01:31:31.187415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.130 [2024-11-20 01:31:31.187441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.130 qpair failed and we were unable to recover it. 00:30:23.130 [2024-11-20 01:31:31.187530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.130 [2024-11-20 01:31:31.187618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.130 [2024-11-20 01:31:31.187644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.130 qpair failed and we were unable to recover it. 00:30:23.130 [2024-11-20 01:31:31.187733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.130 [2024-11-20 01:31:31.187818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.130 [2024-11-20 01:31:31.187844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.130 qpair failed and we were unable to recover it. 00:30:23.130 [2024-11-20 01:31:31.187925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.130 [2024-11-20 01:31:31.188022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.130 [2024-11-20 01:31:31.188064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.130 qpair failed and we were unable to recover it. 00:30:23.130 [2024-11-20 01:31:31.188164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.130 [2024-11-20 01:31:31.188258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.131 [2024-11-20 01:31:31.188284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.131 qpair failed and we were unable to recover it. 00:30:23.131 [2024-11-20 01:31:31.188399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.131 [2024-11-20 01:31:31.188478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.131 [2024-11-20 01:31:31.188504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.131 qpair failed and we were unable to recover it. 00:30:23.131 [2024-11-20 01:31:31.188622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.131 [2024-11-20 01:31:31.188736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.131 [2024-11-20 01:31:31.188763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.131 qpair failed and we were unable to recover it. 00:30:23.131 [2024-11-20 01:31:31.188862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.131 [2024-11-20 01:31:31.188942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.131 [2024-11-20 01:31:31.188967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.131 qpair failed and we were unable to recover it. 00:30:23.131 [2024-11-20 01:31:31.189078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.131 [2024-11-20 01:31:31.189166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.131 [2024-11-20 01:31:31.189192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.131 qpair failed and we were unable to recover it. 00:30:23.131 [2024-11-20 01:31:31.189291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.131 [2024-11-20 01:31:31.189388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.131 [2024-11-20 01:31:31.189414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.131 qpair failed and we were unable to recover it. 00:30:23.131 [2024-11-20 01:31:31.189527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.131 [2024-11-20 01:31:31.189644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.131 [2024-11-20 01:31:31.189670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.131 qpair failed and we were unable to recover it. 00:30:23.131 [2024-11-20 01:31:31.189757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.131 [2024-11-20 01:31:31.189851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.131 [2024-11-20 01:31:31.189876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.131 qpair failed and we were unable to recover it. 00:30:23.131 [2024-11-20 01:31:31.189963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.131 [2024-11-20 01:31:31.190111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.131 [2024-11-20 01:31:31.190136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.131 qpair failed and we were unable to recover it. 00:30:23.131 [2024-11-20 01:31:31.190226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.131 [2024-11-20 01:31:31.190310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.131 [2024-11-20 01:31:31.190336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.131 qpair failed and we were unable to recover it. 00:30:23.131 [2024-11-20 01:31:31.190440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.131 [2024-11-20 01:31:31.190523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.131 [2024-11-20 01:31:31.190548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.131 qpair failed and we were unable to recover it. 00:30:23.131 [2024-11-20 01:31:31.190643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.131 [2024-11-20 01:31:31.190760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.131 [2024-11-20 01:31:31.190785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.131 qpair failed and we were unable to recover it. 00:30:23.131 [2024-11-20 01:31:31.190869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.131 [2024-11-20 01:31:31.190980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.131 [2024-11-20 01:31:31.191004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.131 qpair failed and we were unable to recover it. 00:30:23.131 [2024-11-20 01:31:31.191104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.131 [2024-11-20 01:31:31.191195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.131 [2024-11-20 01:31:31.191220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.131 qpair failed and we were unable to recover it. 00:30:23.131 [2024-11-20 01:31:31.191302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.131 [2024-11-20 01:31:31.191396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.131 [2024-11-20 01:31:31.191424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.131 qpair failed and we were unable to recover it. 00:30:23.131 [2024-11-20 01:31:31.191519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.131 [2024-11-20 01:31:31.191629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.131 [2024-11-20 01:31:31.191653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.131 qpair failed and we were unable to recover it. 00:30:23.131 [2024-11-20 01:31:31.191766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.131 [2024-11-20 01:31:31.191858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.131 [2024-11-20 01:31:31.191883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.131 qpair failed and we were unable to recover it. 00:30:23.131 [2024-11-20 01:31:31.191982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.131 [2024-11-20 01:31:31.192107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.131 [2024-11-20 01:31:31.192133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.131 qpair failed and we were unable to recover it. 00:30:23.131 [2024-11-20 01:31:31.192217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.131 [2024-11-20 01:31:31.192334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.131 [2024-11-20 01:31:31.192369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.131 qpair failed and we were unable to recover it. 00:30:23.131 [2024-11-20 01:31:31.192482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.131 [2024-11-20 01:31:31.192595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.131 [2024-11-20 01:31:31.192620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.131 qpair failed and we were unable to recover it. 00:30:23.131 [2024-11-20 01:31:31.192740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.131 [2024-11-20 01:31:31.192829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.131 [2024-11-20 01:31:31.192855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.131 qpair failed and we were unable to recover it. 00:30:23.131 [2024-11-20 01:31:31.192952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.131 [2024-11-20 01:31:31.193034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.131 [2024-11-20 01:31:31.193076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.131 qpair failed and we were unable to recover it. 00:30:23.131 [2024-11-20 01:31:31.193175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.131 [2024-11-20 01:31:31.193259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.131 [2024-11-20 01:31:31.193285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.131 qpair failed and we were unable to recover it. 00:30:23.131 [2024-11-20 01:31:31.193385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.131 [2024-11-20 01:31:31.193474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.131 [2024-11-20 01:31:31.193500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.131 qpair failed and we were unable to recover it. 00:30:23.131 [2024-11-20 01:31:31.193645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.131 [2024-11-20 01:31:31.193728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.131 [2024-11-20 01:31:31.193753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.131 qpair failed and we were unable to recover it. 00:30:23.131 [2024-11-20 01:31:31.193835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.131 [2024-11-20 01:31:31.193939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.131 [2024-11-20 01:31:31.193964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.131 qpair failed and we were unable to recover it. 00:30:23.131 [2024-11-20 01:31:31.194062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.131 [2024-11-20 01:31:31.194164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.131 [2024-11-20 01:31:31.194190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.131 qpair failed and we were unable to recover it. 00:30:23.131 [2024-11-20 01:31:31.194280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.131 [2024-11-20 01:31:31.194388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.131 [2024-11-20 01:31:31.194413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.131 qpair failed and we were unable to recover it. 00:30:23.131 [2024-11-20 01:31:31.194500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.131 [2024-11-20 01:31:31.194590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.131 [2024-11-20 01:31:31.194615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.131 qpair failed and we were unable to recover it. 00:30:23.132 [2024-11-20 01:31:31.194724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.132 [2024-11-20 01:31:31.194831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.132 [2024-11-20 01:31:31.194855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.132 qpair failed and we were unable to recover it. 00:30:23.132 [2024-11-20 01:31:31.194974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.132 [2024-11-20 01:31:31.195095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.132 [2024-11-20 01:31:31.195122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.132 qpair failed and we were unable to recover it. 00:30:23.132 [2024-11-20 01:31:31.195220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.132 [2024-11-20 01:31:31.195346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.132 [2024-11-20 01:31:31.195373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.132 qpair failed and we were unable to recover it. 00:30:23.132 [2024-11-20 01:31:31.195517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.132 [2024-11-20 01:31:31.195602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.132 [2024-11-20 01:31:31.195626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.132 qpair failed and we were unable to recover it. 00:30:23.132 [2024-11-20 01:31:31.195714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.132 [2024-11-20 01:31:31.195841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.132 [2024-11-20 01:31:31.195867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.132 qpair failed and we were unable to recover it. 00:30:23.132 [2024-11-20 01:31:31.195947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.132 [2024-11-20 01:31:31.196041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.132 [2024-11-20 01:31:31.196080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.132 qpair failed and we were unable to recover it. 00:30:23.132 [2024-11-20 01:31:31.196178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.132 [2024-11-20 01:31:31.196263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.132 [2024-11-20 01:31:31.196288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.132 qpair failed and we were unable to recover it. 00:30:23.132 [2024-11-20 01:31:31.196430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.132 [2024-11-20 01:31:31.196509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.132 [2024-11-20 01:31:31.196533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.132 qpair failed and we were unable to recover it. 00:30:23.132 [2024-11-20 01:31:31.196619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.132 [2024-11-20 01:31:31.196706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.132 [2024-11-20 01:31:31.196732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.132 qpair failed and we were unable to recover it. 00:30:23.132 [2024-11-20 01:31:31.196820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.132 [2024-11-20 01:31:31.196941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.132 [2024-11-20 01:31:31.196966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.132 qpair failed and we were unable to recover it. 00:30:23.132 [2024-11-20 01:31:31.197052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.132 [2024-11-20 01:31:31.197165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.132 [2024-11-20 01:31:31.197190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.132 qpair failed and we were unable to recover it. 00:30:23.132 [2024-11-20 01:31:31.197284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.132 [2024-11-20 01:31:31.197367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.132 [2024-11-20 01:31:31.197393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.132 qpair failed and we were unable to recover it. 00:30:23.132 [2024-11-20 01:31:31.197481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.132 [2024-11-20 01:31:31.197566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.132 [2024-11-20 01:31:31.197592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.132 qpair failed and we were unable to recover it. 00:30:23.132 [2024-11-20 01:31:31.197726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.132 [2024-11-20 01:31:31.197818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.132 [2024-11-20 01:31:31.197843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.132 qpair failed and we were unable to recover it. 00:30:23.132 [2024-11-20 01:31:31.197938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.132 [2024-11-20 01:31:31.198028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.132 [2024-11-20 01:31:31.198064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.132 qpair failed and we were unable to recover it. 00:30:23.132 [2024-11-20 01:31:31.198217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.132 [2024-11-20 01:31:31.198393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.132 [2024-11-20 01:31:31.198419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.132 qpair failed and we were unable to recover it. 00:30:23.132 [2024-11-20 01:31:31.198545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.132 [2024-11-20 01:31:31.198623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.132 [2024-11-20 01:31:31.198648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.132 qpair failed and we were unable to recover it. 00:30:23.132 [2024-11-20 01:31:31.198757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.132 [2024-11-20 01:31:31.198858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.132 [2024-11-20 01:31:31.198884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.132 qpair failed and we were unable to recover it. 00:30:23.132 [2024-11-20 01:31:31.199011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.132 [2024-11-20 01:31:31.199101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.132 [2024-11-20 01:31:31.199126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.132 qpair failed and we were unable to recover it. 00:30:23.132 [2024-11-20 01:31:31.199223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.132 [2024-11-20 01:31:31.199312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.132 [2024-11-20 01:31:31.199337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.132 qpair failed and we were unable to recover it. 00:30:23.132 [2024-11-20 01:31:31.199424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.132 [2024-11-20 01:31:31.199545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.132 [2024-11-20 01:31:31.199571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.132 qpair failed and we were unable to recover it. 00:30:23.132 [2024-11-20 01:31:31.199660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.132 [2024-11-20 01:31:31.199800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.132 [2024-11-20 01:31:31.199826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.132 qpair failed and we were unable to recover it. 00:30:23.132 [2024-11-20 01:31:31.199941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.132 [2024-11-20 01:31:31.200035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.132 [2024-11-20 01:31:31.200077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.132 qpair failed and we were unable to recover it. 00:30:23.132 [2024-11-20 01:31:31.200196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.132 [2024-11-20 01:31:31.200321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.132 [2024-11-20 01:31:31.200357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.132 qpair failed and we were unable to recover it. 00:30:23.132 [2024-11-20 01:31:31.200475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.132 [2024-11-20 01:31:31.200588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.132 [2024-11-20 01:31:31.200614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.132 qpair failed and we were unable to recover it. 00:30:23.132 [2024-11-20 01:31:31.200731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.132 [2024-11-20 01:31:31.200830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.133 [2024-11-20 01:31:31.200856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.133 qpair failed and we were unable to recover it. 00:30:23.133 [2024-11-20 01:31:31.200948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.133 [2024-11-20 01:31:31.201094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.133 [2024-11-20 01:31:31.201121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.133 qpair failed and we were unable to recover it. 00:30:23.133 [2024-11-20 01:31:31.201219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.133 [2024-11-20 01:31:31.201302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.133 [2024-11-20 01:31:31.201326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.133 qpair failed and we were unable to recover it. 00:30:23.133 [2024-11-20 01:31:31.201407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.133 [2024-11-20 01:31:31.201517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.133 [2024-11-20 01:31:31.201541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.133 qpair failed and we were unable to recover it. 00:30:23.133 [2024-11-20 01:31:31.201630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.133 [2024-11-20 01:31:31.201771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.133 [2024-11-20 01:31:31.201796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.133 qpair failed and we were unable to recover it. 00:30:23.133 [2024-11-20 01:31:31.201890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.133 [2024-11-20 01:31:31.201993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.133 [2024-11-20 01:31:31.202017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.133 qpair failed and we were unable to recover it. 00:30:23.133 [2024-11-20 01:31:31.202121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.133 [2024-11-20 01:31:31.202204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.133 [2024-11-20 01:31:31.202231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.133 qpair failed and we were unable to recover it. 00:30:23.133 [2024-11-20 01:31:31.202324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.133 [2024-11-20 01:31:31.202477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.133 [2024-11-20 01:31:31.202502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.133 qpair failed and we were unable to recover it. 00:30:23.133 [2024-11-20 01:31:31.202582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.133 [2024-11-20 01:31:31.202674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.133 [2024-11-20 01:31:31.202700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.133 qpair failed and we were unable to recover it. 00:30:23.133 [2024-11-20 01:31:31.202778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.133 [2024-11-20 01:31:31.202895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.133 [2024-11-20 01:31:31.202920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.133 qpair failed and we were unable to recover it. 00:30:23.133 [2024-11-20 01:31:31.203037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.133 [2024-11-20 01:31:31.203134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.133 [2024-11-20 01:31:31.203161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.133 qpair failed and we were unable to recover it. 00:30:23.133 [2024-11-20 01:31:31.203260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.133 [2024-11-20 01:31:31.203389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.133 [2024-11-20 01:31:31.203414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.133 qpair failed and we were unable to recover it. 00:30:23.133 [2024-11-20 01:31:31.203508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.133 [2024-11-20 01:31:31.203624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.133 [2024-11-20 01:31:31.203649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.133 qpair failed and we were unable to recover it. 00:30:23.133 [2024-11-20 01:31:31.203735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.133 [2024-11-20 01:31:31.203827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.133 [2024-11-20 01:31:31.203852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.133 qpair failed and we were unable to recover it. 00:30:23.133 [2024-11-20 01:31:31.203970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.133 [2024-11-20 01:31:31.204087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.133 [2024-11-20 01:31:31.204114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.133 qpair failed and we were unable to recover it. 00:30:23.133 [2024-11-20 01:31:31.204211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.133 [2024-11-20 01:31:31.204301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.133 [2024-11-20 01:31:31.204327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.133 qpair failed and we were unable to recover it. 00:30:23.133 [2024-11-20 01:31:31.204459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.133 [2024-11-20 01:31:31.204621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.133 [2024-11-20 01:31:31.204646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.133 qpair failed and we were unable to recover it. 00:30:23.133 [2024-11-20 01:31:31.204763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.133 [2024-11-20 01:31:31.204860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.133 [2024-11-20 01:31:31.204886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.133 qpair failed and we were unable to recover it. 00:30:23.133 [2024-11-20 01:31:31.204975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.133 [2024-11-20 01:31:31.205055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.133 [2024-11-20 01:31:31.205131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.133 qpair failed and we were unable to recover it. 00:30:23.133 [2024-11-20 01:31:31.205346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.133 [2024-11-20 01:31:31.205441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.133 [2024-11-20 01:31:31.205467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.133 qpair failed and we were unable to recover it. 00:30:23.133 [2024-11-20 01:31:31.205552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.133 [2024-11-20 01:31:31.205660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.133 [2024-11-20 01:31:31.205685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.133 qpair failed and we were unable to recover it. 00:30:23.133 [2024-11-20 01:31:31.205770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.133 [2024-11-20 01:31:31.205985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.133 [2024-11-20 01:31:31.206012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.133 qpair failed and we were unable to recover it. 00:30:23.133 [2024-11-20 01:31:31.206135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.133 [2024-11-20 01:31:31.206251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.133 [2024-11-20 01:31:31.206277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.133 qpair failed and we were unable to recover it. 00:30:23.133 [2024-11-20 01:31:31.206379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.133 [2024-11-20 01:31:31.206495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.133 [2024-11-20 01:31:31.206521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.133 qpair failed and we were unable to recover it. 00:30:23.133 [2024-11-20 01:31:31.206614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.133 [2024-11-20 01:31:31.206700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.133 [2024-11-20 01:31:31.206724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.133 qpair failed and we were unable to recover it. 00:30:23.133 [2024-11-20 01:31:31.206840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.133 [2024-11-20 01:31:31.206954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.133 [2024-11-20 01:31:31.206980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.133 qpair failed and we were unable to recover it. 00:30:23.133 [2024-11-20 01:31:31.207079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.133 [2024-11-20 01:31:31.207295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.133 [2024-11-20 01:31:31.207321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.133 qpair failed and we were unable to recover it. 00:30:23.133 [2024-11-20 01:31:31.207411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.133 [2024-11-20 01:31:31.207501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.133 [2024-11-20 01:31:31.207526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.133 qpair failed and we were unable to recover it. 00:30:23.133 [2024-11-20 01:31:31.207623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.133 [2024-11-20 01:31:31.207712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.133 [2024-11-20 01:31:31.207739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.133 qpair failed and we were unable to recover it. 00:30:23.134 [2024-11-20 01:31:31.207855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.134 [2024-11-20 01:31:31.207940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.134 [2024-11-20 01:31:31.207965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.134 qpair failed and we were unable to recover it. 00:30:23.134 [2024-11-20 01:31:31.208051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.134 [2024-11-20 01:31:31.208141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.134 [2024-11-20 01:31:31.208167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.134 qpair failed and we were unable to recover it. 00:30:23.134 [2024-11-20 01:31:31.208255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.134 [2024-11-20 01:31:31.208381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.134 [2024-11-20 01:31:31.208406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.134 qpair failed and we were unable to recover it. 00:30:23.134 [2024-11-20 01:31:31.208485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.134 [2024-11-20 01:31:31.208567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.134 [2024-11-20 01:31:31.208593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.134 qpair failed and we were unable to recover it. 00:30:23.134 [2024-11-20 01:31:31.208737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.134 [2024-11-20 01:31:31.208833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.134 [2024-11-20 01:31:31.208859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.134 qpair failed and we were unable to recover it. 00:30:23.134 [2024-11-20 01:31:31.208974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.134 [2024-11-20 01:31:31.209064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.134 [2024-11-20 01:31:31.209098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.134 qpair failed and we were unable to recover it. 00:30:23.134 [2024-11-20 01:31:31.209189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.134 [2024-11-20 01:31:31.209289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.134 [2024-11-20 01:31:31.209314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.134 qpair failed and we were unable to recover it. 00:30:23.134 [2024-11-20 01:31:31.209419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.134 [2024-11-20 01:31:31.209510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.134 [2024-11-20 01:31:31.209535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.134 qpair failed and we were unable to recover it. 00:30:23.134 [2024-11-20 01:31:31.209680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.134 [2024-11-20 01:31:31.209769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.134 [2024-11-20 01:31:31.209795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.134 qpair failed and we were unable to recover it. 00:30:23.134 [2024-11-20 01:31:31.209883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.134 [2024-11-20 01:31:31.210001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.134 [2024-11-20 01:31:31.210026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.134 qpair failed and we were unable to recover it. 00:30:23.134 [2024-11-20 01:31:31.210132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.134 [2024-11-20 01:31:31.210212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.134 [2024-11-20 01:31:31.210237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.134 qpair failed and we were unable to recover it. 00:30:23.134 [2024-11-20 01:31:31.210347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.134 [2024-11-20 01:31:31.210456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.134 [2024-11-20 01:31:31.210481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.134 qpair failed and we were unable to recover it. 00:30:23.134 [2024-11-20 01:31:31.210601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.134 [2024-11-20 01:31:31.210708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.134 [2024-11-20 01:31:31.210743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.134 qpair failed and we were unable to recover it. 00:30:23.134 [2024-11-20 01:31:31.210832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.134 [2024-11-20 01:31:31.210949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.134 [2024-11-20 01:31:31.210973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.134 qpair failed and we were unable to recover it. 00:30:23.134 [2024-11-20 01:31:31.211066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.134 [2024-11-20 01:31:31.211164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.134 [2024-11-20 01:31:31.211190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.134 qpair failed and we were unable to recover it. 00:30:23.134 [2024-11-20 01:31:31.211281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.134 [2024-11-20 01:31:31.211363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.134 [2024-11-20 01:31:31.211387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.134 qpair failed and we were unable to recover it. 00:30:23.134 [2024-11-20 01:31:31.211468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.134 [2024-11-20 01:31:31.211586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.134 [2024-11-20 01:31:31.211612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.134 qpair failed and we were unable to recover it. 00:30:23.134 [2024-11-20 01:31:31.211710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.134 [2024-11-20 01:31:31.211794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.134 [2024-11-20 01:31:31.211820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.134 qpair failed and we were unable to recover it. 00:30:23.134 [2024-11-20 01:31:31.211942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.134 [2024-11-20 01:31:31.212038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.134 [2024-11-20 01:31:31.212079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.134 qpair failed and we were unable to recover it. 00:30:23.134 [2024-11-20 01:31:31.212170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.134 [2024-11-20 01:31:31.212263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.134 [2024-11-20 01:31:31.212289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.134 qpair failed and we were unable to recover it. 00:30:23.134 [2024-11-20 01:31:31.212391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.134 [2024-11-20 01:31:31.212507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.134 [2024-11-20 01:31:31.212532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.134 qpair failed and we were unable to recover it. 00:30:23.134 [2024-11-20 01:31:31.212615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.134 [2024-11-20 01:31:31.212728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.134 [2024-11-20 01:31:31.212753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.134 qpair failed and we were unable to recover it. 00:30:23.134 [2024-11-20 01:31:31.212866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.134 [2024-11-20 01:31:31.212946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.134 [2024-11-20 01:31:31.212975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.134 qpair failed and we were unable to recover it. 00:30:23.134 [2024-11-20 01:31:31.213092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.134 [2024-11-20 01:31:31.213178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.134 [2024-11-20 01:31:31.213204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.134 qpair failed and we were unable to recover it. 00:30:23.134 [2024-11-20 01:31:31.213317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.134 [2024-11-20 01:31:31.213410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.134 [2024-11-20 01:31:31.213435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.134 qpair failed and we were unable to recover it. 00:30:23.134 [2024-11-20 01:31:31.213525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.134 [2024-11-20 01:31:31.213637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.134 [2024-11-20 01:31:31.213662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.134 qpair failed and we were unable to recover it. 00:30:23.134 [2024-11-20 01:31:31.213746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.134 [2024-11-20 01:31:31.213857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.134 [2024-11-20 01:31:31.213883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.134 qpair failed and we were unable to recover it. 00:30:23.134 [2024-11-20 01:31:31.213971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.134 [2024-11-20 01:31:31.214088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.134 [2024-11-20 01:31:31.214114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.134 qpair failed and we were unable to recover it. 00:30:23.134 [2024-11-20 01:31:31.214205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.135 [2024-11-20 01:31:31.214327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.135 [2024-11-20 01:31:31.214351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.135 qpair failed and we were unable to recover it. 00:30:23.135 [2024-11-20 01:31:31.214436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.135 [2024-11-20 01:31:31.214523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.135 [2024-11-20 01:31:31.214548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.135 qpair failed and we were unable to recover it. 00:30:23.135 [2024-11-20 01:31:31.214632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.135 [2024-11-20 01:31:31.214729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.135 [2024-11-20 01:31:31.214753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.135 qpair failed and we were unable to recover it. 00:30:23.135 [2024-11-20 01:31:31.214868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.135 [2024-11-20 01:31:31.214988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.135 [2024-11-20 01:31:31.215012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.135 qpair failed and we were unable to recover it. 00:30:23.135 [2024-11-20 01:31:31.215133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.135 [2024-11-20 01:31:31.215238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.135 [2024-11-20 01:31:31.215267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.135 qpair failed and we were unable to recover it. 00:30:23.135 [2024-11-20 01:31:31.215370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.135 [2024-11-20 01:31:31.215479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.135 [2024-11-20 01:31:31.215504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.135 qpair failed and we were unable to recover it. 00:30:23.135 [2024-11-20 01:31:31.215587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.135 [2024-11-20 01:31:31.215694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.135 [2024-11-20 01:31:31.215719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.135 qpair failed and we were unable to recover it. 00:30:23.135 [2024-11-20 01:31:31.215845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.135 [2024-11-20 01:31:31.215961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.135 [2024-11-20 01:31:31.215986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.135 qpair failed and we were unable to recover it. 00:30:23.135 [2024-11-20 01:31:31.216067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.135 [2024-11-20 01:31:31.216165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.135 [2024-11-20 01:31:31.216190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.135 qpair failed and we were unable to recover it. 00:30:23.135 [2024-11-20 01:31:31.216282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.135 [2024-11-20 01:31:31.216362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.135 [2024-11-20 01:31:31.216387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.135 qpair failed and we were unable to recover it. 00:30:23.135 [2024-11-20 01:31:31.216502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.135 [2024-11-20 01:31:31.216621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.135 [2024-11-20 01:31:31.216648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.135 qpair failed and we were unable to recover it. 00:30:23.135 [2024-11-20 01:31:31.216762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.135 [2024-11-20 01:31:31.216848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.135 [2024-11-20 01:31:31.216873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.135 qpair failed and we were unable to recover it. 00:30:23.135 [2024-11-20 01:31:31.216962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.135 [2024-11-20 01:31:31.217099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.135 [2024-11-20 01:31:31.217126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.135 qpair failed and we were unable to recover it. 00:30:23.135 [2024-11-20 01:31:31.217210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.135 [2024-11-20 01:31:31.217299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.135 [2024-11-20 01:31:31.217323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.135 qpair failed and we were unable to recover it. 00:30:23.135 [2024-11-20 01:31:31.217432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.135 [2024-11-20 01:31:31.217515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.135 [2024-11-20 01:31:31.217544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.135 qpair failed and we were unable to recover it. 00:30:23.135 [2024-11-20 01:31:31.217653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.135 [2024-11-20 01:31:31.217765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.135 [2024-11-20 01:31:31.217789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.135 qpair failed and we were unable to recover it. 00:30:23.135 [2024-11-20 01:31:31.217879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.135 [2024-11-20 01:31:31.217960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.135 [2024-11-20 01:31:31.217985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.135 qpair failed and we were unable to recover it. 00:30:23.135 [2024-11-20 01:31:31.218074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.135 [2024-11-20 01:31:31.218192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.135 [2024-11-20 01:31:31.218217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.135 qpair failed and we were unable to recover it. 00:30:23.135 [2024-11-20 01:31:31.218331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.135 [2024-11-20 01:31:31.218449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.135 [2024-11-20 01:31:31.218474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.135 qpair failed and we were unable to recover it. 00:30:23.135 [2024-11-20 01:31:31.218584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.135 [2024-11-20 01:31:31.218669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.135 [2024-11-20 01:31:31.218694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.135 qpair failed and we were unable to recover it. 00:30:23.135 [2024-11-20 01:31:31.218774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.135 [2024-11-20 01:31:31.218863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.135 [2024-11-20 01:31:31.218887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.135 qpair failed and we were unable to recover it. 00:30:23.135 [2024-11-20 01:31:31.218997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.135 [2024-11-20 01:31:31.219090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.135 [2024-11-20 01:31:31.219115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.135 qpair failed and we were unable to recover it. 00:30:23.135 [2024-11-20 01:31:31.219235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.135 [2024-11-20 01:31:31.219321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.135 [2024-11-20 01:31:31.219345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.135 qpair failed and we were unable to recover it. 00:30:23.135 [2024-11-20 01:31:31.219433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.135 [2024-11-20 01:31:31.219571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.135 [2024-11-20 01:31:31.219595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.135 qpair failed and we were unable to recover it. 00:30:23.135 [2024-11-20 01:31:31.219712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.135 [2024-11-20 01:31:31.219795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.135 [2024-11-20 01:31:31.219821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.135 qpair failed and we were unable to recover it. 00:30:23.135 [2024-11-20 01:31:31.219917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.135 [2024-11-20 01:31:31.219999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.135 [2024-11-20 01:31:31.220024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.135 qpair failed and we were unable to recover it. 00:30:23.135 [2024-11-20 01:31:31.220176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.135 [2024-11-20 01:31:31.220286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.135 [2024-11-20 01:31:31.220312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.135 qpair failed and we were unable to recover it. 00:30:23.135 [2024-11-20 01:31:31.220398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.135 [2024-11-20 01:31:31.220539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.135 [2024-11-20 01:31:31.220566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.135 qpair failed and we were unable to recover it. 00:30:23.135 [2024-11-20 01:31:31.220650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.135 [2024-11-20 01:31:31.220760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.135 [2024-11-20 01:31:31.220785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.136 qpair failed and we were unable to recover it. 00:30:23.136 [2024-11-20 01:31:31.220878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.136 [2024-11-20 01:31:31.220966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.136 [2024-11-20 01:31:31.220991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.136 qpair failed and we were unable to recover it. 00:30:23.136 [2024-11-20 01:31:31.221102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.136 [2024-11-20 01:31:31.221215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.136 [2024-11-20 01:31:31.221240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.136 qpair failed and we were unable to recover it. 00:30:23.136 [2024-11-20 01:31:31.221322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.136 [2024-11-20 01:31:31.221408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.136 [2024-11-20 01:31:31.221432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.136 qpair failed and we were unable to recover it. 00:30:23.136 [2024-11-20 01:31:31.221535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.136 [2024-11-20 01:31:31.221624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.136 [2024-11-20 01:31:31.221649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.136 qpair failed and we were unable to recover it. 00:30:23.136 [2024-11-20 01:31:31.221727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.136 [2024-11-20 01:31:31.221847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.136 [2024-11-20 01:31:31.221872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.136 qpair failed and we were unable to recover it. 00:30:23.136 [2024-11-20 01:31:31.221960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.136 [2024-11-20 01:31:31.222076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.136 [2024-11-20 01:31:31.222102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.136 qpair failed and we were unable to recover it. 00:30:23.136 [2024-11-20 01:31:31.222219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.136 [2024-11-20 01:31:31.222300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.136 [2024-11-20 01:31:31.222325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.136 qpair failed and we were unable to recover it. 00:30:23.136 [2024-11-20 01:31:31.222408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.136 [2024-11-20 01:31:31.222496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.136 [2024-11-20 01:31:31.222522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.136 qpair failed and we were unable to recover it. 00:30:23.136 [2024-11-20 01:31:31.222613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.136 [2024-11-20 01:31:31.222725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.136 [2024-11-20 01:31:31.222750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.136 qpair failed and we were unable to recover it. 00:30:23.136 [2024-11-20 01:31:31.222836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.136 [2024-11-20 01:31:31.222977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.136 [2024-11-20 01:31:31.223007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.136 qpair failed and we were unable to recover it. 00:30:23.136 [2024-11-20 01:31:31.223117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.136 [2024-11-20 01:31:31.223207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.136 [2024-11-20 01:31:31.223232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.136 qpair failed and we were unable to recover it. 00:30:23.136 [2024-11-20 01:31:31.223314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.136 [2024-11-20 01:31:31.223398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.136 [2024-11-20 01:31:31.223422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.136 qpair failed and we were unable to recover it. 00:30:23.136 [2024-11-20 01:31:31.223537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.136 [2024-11-20 01:31:31.223622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.136 [2024-11-20 01:31:31.223647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.136 qpair failed and we were unable to recover it. 00:30:23.136 [2024-11-20 01:31:31.223729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.136 [2024-11-20 01:31:31.223806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.136 [2024-11-20 01:31:31.223831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.136 qpair failed and we were unable to recover it. 00:30:23.136 [2024-11-20 01:31:31.223951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.136 [2024-11-20 01:31:31.224063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.136 [2024-11-20 01:31:31.224134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.136 qpair failed and we were unable to recover it. 00:30:23.136 [2024-11-20 01:31:31.224217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.136 [2024-11-20 01:31:31.224329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.136 [2024-11-20 01:31:31.224354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.136 qpair failed and we were unable to recover it. 00:30:23.136 [2024-11-20 01:31:31.224454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.136 [2024-11-20 01:31:31.224539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.136 [2024-11-20 01:31:31.224564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.136 qpair failed and we were unable to recover it. 00:30:23.136 [2024-11-20 01:31:31.224681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.136 [2024-11-20 01:31:31.224801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.136 [2024-11-20 01:31:31.224826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.136 qpair failed and we were unable to recover it. 00:30:23.136 [2024-11-20 01:31:31.224948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.136 [2024-11-20 01:31:31.225031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.136 [2024-11-20 01:31:31.225056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.136 qpair failed and we were unable to recover it. 00:30:23.136 [2024-11-20 01:31:31.225188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.136 [2024-11-20 01:31:31.225305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.136 [2024-11-20 01:31:31.225330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.136 qpair failed and we were unable to recover it. 00:30:23.136 [2024-11-20 01:31:31.225409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.136 [2024-11-20 01:31:31.225523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.136 [2024-11-20 01:31:31.225548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.136 qpair failed and we were unable to recover it. 00:30:23.136 [2024-11-20 01:31:31.225634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.136 [2024-11-20 01:31:31.225717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.136 [2024-11-20 01:31:31.225743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.136 qpair failed and we were unable to recover it. 00:30:23.136 [2024-11-20 01:31:31.225864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.136 [2024-11-20 01:31:31.225948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.136 [2024-11-20 01:31:31.225974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.136 qpair failed and we were unable to recover it. 00:30:23.136 [2024-11-20 01:31:31.226057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.136 [2024-11-20 01:31:31.226144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.136 [2024-11-20 01:31:31.226169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.136 qpair failed and we were unable to recover it. 00:30:23.136 [2024-11-20 01:31:31.226258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.136 [2024-11-20 01:31:31.226394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.136 [2024-11-20 01:31:31.226418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.136 qpair failed and we were unable to recover it. 00:30:23.136 [2024-11-20 01:31:31.226508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.136 [2024-11-20 01:31:31.226615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.136 [2024-11-20 01:31:31.226639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.136 qpair failed and we were unable to recover it. 00:30:23.136 [2024-11-20 01:31:31.226754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.136 [2024-11-20 01:31:31.226865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.136 [2024-11-20 01:31:31.226890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.136 qpair failed and we were unable to recover it. 00:30:23.136 [2024-11-20 01:31:31.227014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.136 [2024-11-20 01:31:31.227103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.136 [2024-11-20 01:31:31.227128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.136 qpair failed and we were unable to recover it. 00:30:23.136 [2024-11-20 01:31:31.227219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.137 [2024-11-20 01:31:31.227306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.137 [2024-11-20 01:31:31.227333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.137 qpair failed and we were unable to recover it. 00:30:23.137 [2024-11-20 01:31:31.227444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.137 [2024-11-20 01:31:31.227531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.137 [2024-11-20 01:31:31.227558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.137 qpair failed and we were unable to recover it. 00:30:23.137 [2024-11-20 01:31:31.227671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.137 [2024-11-20 01:31:31.227759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.137 [2024-11-20 01:31:31.227785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.137 qpair failed and we were unable to recover it. 00:30:23.137 [2024-11-20 01:31:31.227895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.137 [2024-11-20 01:31:31.227989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.137 [2024-11-20 01:31:31.228013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.137 qpair failed and we were unable to recover it. 00:30:23.137 [2024-11-20 01:31:31.228137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.137 [2024-11-20 01:31:31.228246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.137 [2024-11-20 01:31:31.228271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.137 qpair failed and we were unable to recover it. 00:30:23.137 [2024-11-20 01:31:31.228348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.137 [2024-11-20 01:31:31.228442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.137 [2024-11-20 01:31:31.228467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.137 qpair failed and we were unable to recover it. 00:30:23.137 [2024-11-20 01:31:31.228583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.137 [2024-11-20 01:31:31.228671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.137 [2024-11-20 01:31:31.228697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.137 qpair failed and we were unable to recover it. 00:30:23.137 [2024-11-20 01:31:31.228815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.137 [2024-11-20 01:31:31.228894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.137 [2024-11-20 01:31:31.228919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.137 qpair failed and we were unable to recover it. 00:30:23.137 [2024-11-20 01:31:31.229045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.137 [2024-11-20 01:31:31.229141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.137 [2024-11-20 01:31:31.229167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.137 qpair failed and we were unable to recover it. 00:30:23.137 [2024-11-20 01:31:31.229251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.137 [2024-11-20 01:31:31.229345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.137 [2024-11-20 01:31:31.229370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.137 qpair failed and we were unable to recover it. 00:30:23.137 [2024-11-20 01:31:31.229461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.137 [2024-11-20 01:31:31.229573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.137 [2024-11-20 01:31:31.229598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.137 qpair failed and we were unable to recover it. 00:30:23.137 [2024-11-20 01:31:31.229678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.137 [2024-11-20 01:31:31.229794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.137 [2024-11-20 01:31:31.229820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.137 qpair failed and we were unable to recover it. 00:30:23.137 [2024-11-20 01:31:31.229934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.137 [2024-11-20 01:31:31.230087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.137 [2024-11-20 01:31:31.230113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.137 qpair failed and we were unable to recover it. 00:30:23.137 [2024-11-20 01:31:31.230199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.137 [2024-11-20 01:31:31.230316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.137 [2024-11-20 01:31:31.230341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.137 qpair failed and we were unable to recover it. 00:30:23.137 [2024-11-20 01:31:31.230462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.137 [2024-11-20 01:31:31.230552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.137 [2024-11-20 01:31:31.230577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.137 qpair failed and we were unable to recover it. 00:30:23.137 [2024-11-20 01:31:31.230690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.137 [2024-11-20 01:31:31.230769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.137 [2024-11-20 01:31:31.230794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.137 qpair failed and we were unable to recover it. 00:30:23.137 [2024-11-20 01:31:31.230884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.137 [2024-11-20 01:31:31.230996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.137 [2024-11-20 01:31:31.231020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.137 qpair failed and we were unable to recover it. 00:30:23.137 [2024-11-20 01:31:31.231102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.137 [2024-11-20 01:31:31.231217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.137 [2024-11-20 01:31:31.231242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.137 qpair failed and we were unable to recover it. 00:30:23.137 [2024-11-20 01:31:31.231335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.137 [2024-11-20 01:31:31.231419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.137 [2024-11-20 01:31:31.231444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.137 qpair failed and we were unable to recover it. 00:30:23.137 [2024-11-20 01:31:31.231529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.137 [2024-11-20 01:31:31.231604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.137 [2024-11-20 01:31:31.231629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.137 qpair failed and we were unable to recover it. 00:30:23.137 [2024-11-20 01:31:31.231739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.137 [2024-11-20 01:31:31.231828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.137 [2024-11-20 01:31:31.231855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.137 qpair failed and we were unable to recover it. 00:30:23.137 [2024-11-20 01:31:31.231949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.137 [2024-11-20 01:31:31.232060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.137 [2024-11-20 01:31:31.232101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.137 qpair failed and we were unable to recover it. 00:30:23.137 [2024-11-20 01:31:31.232200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.137 [2024-11-20 01:31:31.232317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.137 [2024-11-20 01:31:31.232343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.137 qpair failed and we were unable to recover it. 00:30:23.137 [2024-11-20 01:31:31.232441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.137 [2024-11-20 01:31:31.232536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.137 [2024-11-20 01:31:31.232560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.137 qpair failed and we were unable to recover it. 00:30:23.137 [2024-11-20 01:31:31.232654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.137 [2024-11-20 01:31:31.232739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.137 [2024-11-20 01:31:31.232763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.137 qpair failed and we were unable to recover it. 00:30:23.138 [2024-11-20 01:31:31.232875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.232959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.232985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.138 qpair failed and we were unable to recover it. 00:30:23.138 [2024-11-20 01:31:31.233077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.233155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.233194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.138 qpair failed and we were unable to recover it. 00:30:23.138 [2024-11-20 01:31:31.233279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.233374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.233399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.138 qpair failed and we were unable to recover it. 00:30:23.138 [2024-11-20 01:31:31.233511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.233595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.233621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.138 qpair failed and we were unable to recover it. 00:30:23.138 [2024-11-20 01:31:31.233701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.233824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.233849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.138 qpair failed and we were unable to recover it. 00:30:23.138 [2024-11-20 01:31:31.233928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.234020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.234045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.138 qpair failed and we were unable to recover it. 00:30:23.138 [2024-11-20 01:31:31.234142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.234236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.234261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.138 qpair failed and we were unable to recover it. 00:30:23.138 [2024-11-20 01:31:31.234344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.234435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.234462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.138 qpair failed and we were unable to recover it. 00:30:23.138 [2024-11-20 01:31:31.234573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.234655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.234680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.138 qpair failed and we were unable to recover it. 00:30:23.138 [2024-11-20 01:31:31.234763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.234871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.234896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.138 qpair failed and we were unable to recover it. 00:30:23.138 [2024-11-20 01:31:31.235021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.235106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.235131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.138 qpair failed and we were unable to recover it. 00:30:23.138 [2024-11-20 01:31:31.235226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.235346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.235371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.138 qpair failed and we were unable to recover it. 00:30:23.138 [2024-11-20 01:31:31.235458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.235538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.235563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.138 qpair failed and we were unable to recover it. 00:30:23.138 [2024-11-20 01:31:31.235682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.235797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.235822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.138 qpair failed and we were unable to recover it. 00:30:23.138 [2024-11-20 01:31:31.235910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.236062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.236095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.138 qpair failed and we were unable to recover it. 00:30:23.138 [2024-11-20 01:31:31.236211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.236330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.236354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.138 qpair failed and we were unable to recover it. 00:30:23.138 [2024-11-20 01:31:31.236473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.236581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.236605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.138 qpair failed and we were unable to recover it. 00:30:23.138 [2024-11-20 01:31:31.236719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.236803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.236828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.138 qpair failed and we were unable to recover it. 00:30:23.138 [2024-11-20 01:31:31.236918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.237056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.237088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.138 qpair failed and we were unable to recover it. 00:30:23.138 [2024-11-20 01:31:31.237184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.237266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.237291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.138 qpair failed and we were unable to recover it. 00:30:23.138 [2024-11-20 01:31:31.237402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.237492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.237516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.138 qpair failed and we were unable to recover it. 00:30:23.138 [2024-11-20 01:31:31.237605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.237712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.237736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.138 qpair failed and we were unable to recover it. 00:30:23.138 [2024-11-20 01:31:31.237826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.237943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.237968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.138 qpair failed and we were unable to recover it. 00:30:23.138 [2024-11-20 01:31:31.238046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.238134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.238159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.138 qpair failed and we were unable to recover it. 00:30:23.138 [2024-11-20 01:31:31.238280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.238375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.238402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.138 qpair failed and we were unable to recover it. 00:30:23.138 [2024-11-20 01:31:31.238483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.238576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.238602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.138 qpair failed and we were unable to recover it. 00:30:23.138 [2024-11-20 01:31:31.238693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.238784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.238810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.138 qpair failed and we were unable to recover it. 00:30:23.138 [2024-11-20 01:31:31.238898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.239019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.239043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.138 qpair failed and we were unable to recover it. 00:30:23.138 [2024-11-20 01:31:31.239146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.239230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.239256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.138 qpair failed and we were unable to recover it. 00:30:23.138 [2024-11-20 01:31:31.239390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.239532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.239556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.138 qpair failed and we were unable to recover it. 00:30:23.138 [2024-11-20 01:31:31.239640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.239782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.138 [2024-11-20 01:31:31.239807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.138 qpair failed and we were unable to recover it. 00:30:23.139 [2024-11-20 01:31:31.239893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.240037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.240079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.139 qpair failed and we were unable to recover it. 00:30:23.139 [2024-11-20 01:31:31.240172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.240266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.240292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.139 qpair failed and we were unable to recover it. 00:30:23.139 [2024-11-20 01:31:31.240406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.240489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.240513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.139 qpair failed and we were unable to recover it. 00:30:23.139 [2024-11-20 01:31:31.240603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.240715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.240741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.139 qpair failed and we were unable to recover it. 00:30:23.139 [2024-11-20 01:31:31.240824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.240937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.240963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.139 qpair failed and we were unable to recover it. 00:30:23.139 [2024-11-20 01:31:31.241098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.241188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.241213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.139 qpair failed and we were unable to recover it. 00:30:23.139 [2024-11-20 01:31:31.241295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.241427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.241452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.139 qpair failed and we were unable to recover it. 00:30:23.139 [2024-11-20 01:31:31.241568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.241673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.241698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.139 qpair failed and we were unable to recover it. 00:30:23.139 [2024-11-20 01:31:31.241798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.241873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.241898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.139 qpair failed and we were unable to recover it. 00:30:23.139 [2024-11-20 01:31:31.241981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.242099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.242124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.139 qpair failed and we were unable to recover it. 00:30:23.139 [2024-11-20 01:31:31.242215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.242300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.242326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.139 qpair failed and we were unable to recover it. 00:30:23.139 [2024-11-20 01:31:31.242438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.242515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.242539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.139 qpair failed and we were unable to recover it. 00:30:23.139 [2024-11-20 01:31:31.242624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.242743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.242769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.139 qpair failed and we were unable to recover it. 00:30:23.139 [2024-11-20 01:31:31.242915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.243005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.243030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.139 qpair failed and we were unable to recover it. 00:30:23.139 [2024-11-20 01:31:31.243116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.243201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.243227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.139 qpair failed and we were unable to recover it. 00:30:23.139 [2024-11-20 01:31:31.243316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.243463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.243489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.139 qpair failed and we were unable to recover it. 00:30:23.139 [2024-11-20 01:31:31.243631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.243746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.243772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.139 qpair failed and we were unable to recover it. 00:30:23.139 [2024-11-20 01:31:31.243849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.243930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.243955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.139 qpair failed and we were unable to recover it. 00:30:23.139 [2024-11-20 01:31:31.244091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.244174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.244199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.139 qpair failed and we were unable to recover it. 00:30:23.139 [2024-11-20 01:31:31.244309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.244406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.244431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.139 qpair failed and we were unable to recover it. 00:30:23.139 [2024-11-20 01:31:31.244519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.244639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.244664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.139 qpair failed and we were unable to recover it. 00:30:23.139 [2024-11-20 01:31:31.244776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.244859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.244885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.139 qpair failed and we were unable to recover it. 00:30:23.139 [2024-11-20 01:31:31.244971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.245062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.245102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.139 qpair failed and we were unable to recover it. 00:30:23.139 [2024-11-20 01:31:31.245189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.245298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.245324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.139 qpair failed and we were unable to recover it. 00:30:23.139 [2024-11-20 01:31:31.245410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.245495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.245521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.139 qpair failed and we were unable to recover it. 00:30:23.139 [2024-11-20 01:31:31.245609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.245724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.245748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.139 qpair failed and we were unable to recover it. 00:30:23.139 [2024-11-20 01:31:31.245835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.245976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.246001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.139 qpair failed and we were unable to recover it. 00:30:23.139 [2024-11-20 01:31:31.246123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.246237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.246262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.139 qpair failed and we were unable to recover it. 00:30:23.139 [2024-11-20 01:31:31.246389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.246504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.246529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.139 qpair failed and we were unable to recover it. 00:30:23.139 [2024-11-20 01:31:31.246625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.246707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.246732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.139 qpair failed and we were unable to recover it. 00:30:23.139 [2024-11-20 01:31:31.246822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.246932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.139 [2024-11-20 01:31:31.246958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.140 qpair failed and we were unable to recover it. 00:30:23.140 [2024-11-20 01:31:31.247087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.247174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.247200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.140 qpair failed and we were unable to recover it. 00:30:23.140 [2024-11-20 01:31:31.247298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.247391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.247420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.140 qpair failed and we were unable to recover it. 00:30:23.140 [2024-11-20 01:31:31.247536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.247621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.247647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.140 qpair failed and we were unable to recover it. 00:30:23.140 [2024-11-20 01:31:31.247762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.247870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.247895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.140 qpair failed and we were unable to recover it. 00:30:23.140 [2024-11-20 01:31:31.247984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.248084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.248110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.140 qpair failed and we were unable to recover it. 00:30:23.140 [2024-11-20 01:31:31.248197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.248289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.248314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.140 qpair failed and we were unable to recover it. 00:30:23.140 [2024-11-20 01:31:31.248433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.248558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.248583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.140 qpair failed and we were unable to recover it. 00:30:23.140 [2024-11-20 01:31:31.248669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.248751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.248776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.140 qpair failed and we were unable to recover it. 00:30:23.140 [2024-11-20 01:31:31.248896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.248977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.249001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.140 qpair failed and we were unable to recover it. 00:30:23.140 [2024-11-20 01:31:31.249096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.249271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.249296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.140 qpair failed and we were unable to recover it. 00:30:23.140 [2024-11-20 01:31:31.249410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.249539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.249565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.140 qpair failed and we were unable to recover it. 00:30:23.140 [2024-11-20 01:31:31.249680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.249762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.249792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.140 qpair failed and we were unable to recover it. 00:30:23.140 [2024-11-20 01:31:31.249947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.250032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.250067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.140 qpair failed and we were unable to recover it. 00:30:23.140 [2024-11-20 01:31:31.250168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.250260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.250285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.140 qpair failed and we were unable to recover it. 00:30:23.140 [2024-11-20 01:31:31.250407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.250525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.250551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.140 qpair failed and we were unable to recover it. 00:30:23.140 [2024-11-20 01:31:31.250671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.250783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.250809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.140 qpair failed and we were unable to recover it. 00:30:23.140 [2024-11-20 01:31:31.250911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.251029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.251066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.140 qpair failed and we were unable to recover it. 00:30:23.140 [2024-11-20 01:31:31.251169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.251258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.251283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.140 qpair failed and we were unable to recover it. 00:30:23.140 [2024-11-20 01:31:31.251378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.251521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.251546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.140 qpair failed and we were unable to recover it. 00:30:23.140 [2024-11-20 01:31:31.251630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.251714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.251740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.140 qpair failed and we were unable to recover it. 00:30:23.140 [2024-11-20 01:31:31.251837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.251949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.251974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.140 qpair failed and we were unable to recover it. 00:30:23.140 [2024-11-20 01:31:31.252055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.252155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.252187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.140 qpair failed and we were unable to recover it. 00:30:23.140 [2024-11-20 01:31:31.252309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.252408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.252435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.140 qpair failed and we were unable to recover it. 00:30:23.140 [2024-11-20 01:31:31.252528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.252610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.252635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.140 qpair failed and we were unable to recover it. 00:30:23.140 [2024-11-20 01:31:31.252716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.252808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.252833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.140 qpair failed and we were unable to recover it. 00:30:23.140 [2024-11-20 01:31:31.252921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.253002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.253028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.140 qpair failed and we were unable to recover it. 00:30:23.140 [2024-11-20 01:31:31.253139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.253224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.253250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.140 qpair failed and we were unable to recover it. 00:30:23.140 [2024-11-20 01:31:31.253336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.253430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.253455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.140 qpair failed and we were unable to recover it. 00:30:23.140 [2024-11-20 01:31:31.253542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.253658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.253685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.140 qpair failed and we were unable to recover it. 00:30:23.140 [2024-11-20 01:31:31.253775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.253859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.140 [2024-11-20 01:31:31.253886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.140 qpair failed and we were unable to recover it. 00:30:23.141 [2024-11-20 01:31:31.253974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.141 [2024-11-20 01:31:31.254051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.141 [2024-11-20 01:31:31.254085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.141 qpair failed and we were unable to recover it. 00:30:23.141 [2024-11-20 01:31:31.254199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.141 [2024-11-20 01:31:31.254285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.141 [2024-11-20 01:31:31.254310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.141 qpair failed and we were unable to recover it. 00:30:23.141 [2024-11-20 01:31:31.254401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.141 [2024-11-20 01:31:31.254513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.141 [2024-11-20 01:31:31.254538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.141 qpair failed and we were unable to recover it. 00:30:23.141 [2024-11-20 01:31:31.254628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.141 [2024-11-20 01:31:31.254715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.141 [2024-11-20 01:31:31.254741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.141 qpair failed and we were unable to recover it. 00:30:23.141 [2024-11-20 01:31:31.254832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.141 [2024-11-20 01:31:31.254912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.141 [2024-11-20 01:31:31.254938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.141 qpair failed and we were unable to recover it. 00:30:23.141 [2024-11-20 01:31:31.255023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.141 [2024-11-20 01:31:31.255138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.141 [2024-11-20 01:31:31.255164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.141 qpair failed and we were unable to recover it. 00:30:23.141 [2024-11-20 01:31:31.255250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.141 [2024-11-20 01:31:31.255333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.141 [2024-11-20 01:31:31.255359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.141 qpair failed and we were unable to recover it. 00:30:23.141 [2024-11-20 01:31:31.255526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.141 [2024-11-20 01:31:31.255669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.141 [2024-11-20 01:31:31.255694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.141 qpair failed and we were unable to recover it. 00:30:23.141 [2024-11-20 01:31:31.255773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.141 [2024-11-20 01:31:31.255858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.141 [2024-11-20 01:31:31.255884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.141 qpair failed and we were unable to recover it. 00:30:23.141 [2024-11-20 01:31:31.255980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.141 [2024-11-20 01:31:31.256098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.141 [2024-11-20 01:31:31.256126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.141 qpair failed and we were unable to recover it. 00:30:23.141 [2024-11-20 01:31:31.256276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.141 [2024-11-20 01:31:31.256388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.141 [2024-11-20 01:31:31.256414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.141 qpair failed and we were unable to recover it. 00:30:23.141 [2024-11-20 01:31:31.256500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.141 [2024-11-20 01:31:31.256578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.141 [2024-11-20 01:31:31.256603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.141 qpair failed and we were unable to recover it. 00:30:23.141 [2024-11-20 01:31:31.256704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.141 [2024-11-20 01:31:31.256812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.141 [2024-11-20 01:31:31.256837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.141 qpair failed and we were unable to recover it. 00:30:23.141 [2024-11-20 01:31:31.256958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.141 [2024-11-20 01:31:31.257077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.141 [2024-11-20 01:31:31.257103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.141 qpair failed and we were unable to recover it. 00:30:23.141 [2024-11-20 01:31:31.257189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.141 [2024-11-20 01:31:31.257275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.141 [2024-11-20 01:31:31.257300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.141 qpair failed and we were unable to recover it. 00:30:23.141 [2024-11-20 01:31:31.257413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.141 [2024-11-20 01:31:31.257520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.141 [2024-11-20 01:31:31.257545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.141 qpair failed and we were unable to recover it. 00:30:23.141 [2024-11-20 01:31:31.257637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.141 [2024-11-20 01:31:31.257720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.141 [2024-11-20 01:31:31.257744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.141 qpair failed and we were unable to recover it. 00:30:23.141 [2024-11-20 01:31:31.257822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.141 [2024-11-20 01:31:31.257903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.141 [2024-11-20 01:31:31.257929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.141 qpair failed and we were unable to recover it. 00:30:23.141 [2024-11-20 01:31:31.258042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.141 [2024-11-20 01:31:31.258144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.141 [2024-11-20 01:31:31.258171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.141 qpair failed and we were unable to recover it. 00:30:23.141 [2024-11-20 01:31:31.258254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.141 [2024-11-20 01:31:31.258369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.141 [2024-11-20 01:31:31.258393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.141 qpair failed and we were unable to recover it. 00:30:23.141 [2024-11-20 01:31:31.258487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.141 [2024-11-20 01:31:31.258569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.141 [2024-11-20 01:31:31.258593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.141 qpair failed and we were unable to recover it. 00:30:23.141 [2024-11-20 01:31:31.258677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.141 [2024-11-20 01:31:31.258766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.141 [2024-11-20 01:31:31.258792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.141 qpair failed and we were unable to recover it. 00:30:23.141 [2024-11-20 01:31:31.258912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.141 [2024-11-20 01:31:31.258996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.141 [2024-11-20 01:31:31.259022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.141 qpair failed and we were unable to recover it. 00:30:23.141 [2024-11-20 01:31:31.259141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.141 [2024-11-20 01:31:31.259229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.141 [2024-11-20 01:31:31.259253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.141 qpair failed and we were unable to recover it. 00:30:23.141 [2024-11-20 01:31:31.259347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.141 [2024-11-20 01:31:31.259432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.141 [2024-11-20 01:31:31.259457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.141 qpair failed and we were unable to recover it. 00:30:23.141 [2024-11-20 01:31:31.259575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.141 [2024-11-20 01:31:31.259660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.141 [2024-11-20 01:31:31.259686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.141 qpair failed and we were unable to recover it. 00:30:23.141 [2024-11-20 01:31:31.259803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.141 [2024-11-20 01:31:31.259946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.141 [2024-11-20 01:31:31.259972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.141 qpair failed and we were unable to recover it. 00:30:23.141 [2024-11-20 01:31:31.260107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.142 [2024-11-20 01:31:31.260189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.142 [2024-11-20 01:31:31.260214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.142 qpair failed and we were unable to recover it. 00:30:23.142 [2024-11-20 01:31:31.260309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.142 [2024-11-20 01:31:31.260394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.142 [2024-11-20 01:31:31.260420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.142 qpair failed and we were unable to recover it. 00:30:23.142 [2024-11-20 01:31:31.260503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.142 [2024-11-20 01:31:31.260622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.142 [2024-11-20 01:31:31.260648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.142 qpair failed and we were unable to recover it. 00:30:23.142 [2024-11-20 01:31:31.260793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.142 [2024-11-20 01:31:31.260868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.142 [2024-11-20 01:31:31.260893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.142 qpair failed and we were unable to recover it. 00:30:23.142 [2024-11-20 01:31:31.261005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.142 [2024-11-20 01:31:31.261115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.142 [2024-11-20 01:31:31.261141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.142 qpair failed and we were unable to recover it. 00:30:23.142 [2024-11-20 01:31:31.261255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.142 [2024-11-20 01:31:31.261343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.142 [2024-11-20 01:31:31.261368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.142 qpair failed and we were unable to recover it. 00:30:23.142 [2024-11-20 01:31:31.261493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.142 [2024-11-20 01:31:31.261584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.142 [2024-11-20 01:31:31.261609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.142 qpair failed and we were unable to recover it. 00:30:23.142 [2024-11-20 01:31:31.261726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.142 [2024-11-20 01:31:31.261841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.142 [2024-11-20 01:31:31.261866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.142 qpair failed and we were unable to recover it. 00:30:23.142 [2024-11-20 01:31:31.262012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.142 [2024-11-20 01:31:31.262124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.142 [2024-11-20 01:31:31.262151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.142 qpair failed and we were unable to recover it. 00:30:23.142 [2024-11-20 01:31:31.262233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.142 [2024-11-20 01:31:31.262317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.142 [2024-11-20 01:31:31.262343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.142 qpair failed and we were unable to recover it. 00:30:23.142 [2024-11-20 01:31:31.262464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.142 [2024-11-20 01:31:31.262578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.142 [2024-11-20 01:31:31.262603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.142 qpair failed and we were unable to recover it. 00:30:23.142 [2024-11-20 01:31:31.262718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.142 [2024-11-20 01:31:31.262806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.142 [2024-11-20 01:31:31.262830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.142 qpair failed and we were unable to recover it. 00:30:23.142 [2024-11-20 01:31:31.262947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.142 [2024-11-20 01:31:31.263028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.142 [2024-11-20 01:31:31.263053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.142 qpair failed and we were unable to recover it. 00:30:23.142 [2024-11-20 01:31:31.263148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.142 [2024-11-20 01:31:31.263232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.142 [2024-11-20 01:31:31.263258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.142 qpair failed and we were unable to recover it. 00:30:23.142 [2024-11-20 01:31:31.263368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.142 [2024-11-20 01:31:31.263484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.142 [2024-11-20 01:31:31.263510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.142 qpair failed and we were unable to recover it. 00:30:23.142 [2024-11-20 01:31:31.263604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.142 [2024-11-20 01:31:31.263689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.142 [2024-11-20 01:31:31.263714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.142 qpair failed and we were unable to recover it. 00:30:23.142 [2024-11-20 01:31:31.263828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.142 [2024-11-20 01:31:31.263936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.142 [2024-11-20 01:31:31.263962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.142 qpair failed and we were unable to recover it. 00:30:23.142 [2024-11-20 01:31:31.264095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.142 [2024-11-20 01:31:31.264239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.142 [2024-11-20 01:31:31.264265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.142 qpair failed and we were unable to recover it. 00:30:23.142 [2024-11-20 01:31:31.264351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.142 [2024-11-20 01:31:31.264492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.142 [2024-11-20 01:31:31.264518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.142 qpair failed and we were unable to recover it. 00:30:23.143 [2024-11-20 01:31:31.264613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.143 [2024-11-20 01:31:31.264728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.143 [2024-11-20 01:31:31.264755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.143 qpair failed and we were unable to recover it. 00:30:23.143 [2024-11-20 01:31:31.264871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.143 [2024-11-20 01:31:31.264954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.143 [2024-11-20 01:31:31.264979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.143 qpair failed and we were unable to recover it. 00:30:23.143 [2024-11-20 01:31:31.265067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.143 [2024-11-20 01:31:31.265219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.143 [2024-11-20 01:31:31.265245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.143 qpair failed and we were unable to recover it. 00:30:23.143 [2024-11-20 01:31:31.265385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.143 [2024-11-20 01:31:31.265475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.143 [2024-11-20 01:31:31.265501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.143 qpair failed and we were unable to recover it. 00:30:23.143 [2024-11-20 01:31:31.265589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.143 [2024-11-20 01:31:31.265705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.143 [2024-11-20 01:31:31.265731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.143 qpair failed and we were unable to recover it. 00:30:23.143 [2024-11-20 01:31:31.265809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.143 [2024-11-20 01:31:31.265888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.143 [2024-11-20 01:31:31.265913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.143 qpair failed and we were unable to recover it. 00:30:23.143 [2024-11-20 01:31:31.266025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.143 [2024-11-20 01:31:31.266175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.143 [2024-11-20 01:31:31.266202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.143 qpair failed and we were unable to recover it. 00:30:23.143 [2024-11-20 01:31:31.266286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.143 [2024-11-20 01:31:31.266361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.143 [2024-11-20 01:31:31.266386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.143 qpair failed and we were unable to recover it. 00:30:23.143 [2024-11-20 01:31:31.266474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.143 [2024-11-20 01:31:31.266566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.143 [2024-11-20 01:31:31.266592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.143 qpair failed and we were unable to recover it. 00:30:23.143 [2024-11-20 01:31:31.266757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.143 [2024-11-20 01:31:31.266870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.143 [2024-11-20 01:31:31.266895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.143 qpair failed and we were unable to recover it. 00:30:23.143 [2024-11-20 01:31:31.266974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.143 [2024-11-20 01:31:31.267090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.143 [2024-11-20 01:31:31.267117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.143 qpair failed and we were unable to recover it. 00:30:23.143 [2024-11-20 01:31:31.267215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.143 [2024-11-20 01:31:31.267297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.143 [2024-11-20 01:31:31.267329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.143 qpair failed and we were unable to recover it. 00:30:23.143 [2024-11-20 01:31:31.267413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.143 [2024-11-20 01:31:31.267527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.143 [2024-11-20 01:31:31.267552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.143 qpair failed and we were unable to recover it. 00:30:23.143 [2024-11-20 01:31:31.267647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.143 [2024-11-20 01:31:31.267759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.143 [2024-11-20 01:31:31.267785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.143 qpair failed and we were unable to recover it. 00:30:23.143 [2024-11-20 01:31:31.267898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.143 [2024-11-20 01:31:31.267981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.143 [2024-11-20 01:31:31.268006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.143 qpair failed and we were unable to recover it. 00:30:23.143 [2024-11-20 01:31:31.268094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.143 [2024-11-20 01:31:31.268207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.143 [2024-11-20 01:31:31.268232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbd50000b90 with addr=10.0.0.2, port=4420 00:30:23.143 qpair failed and we were unable to recover it. 00:30:23.143 A controller has encountered a failure and is being reset. 00:30:23.143 [2024-11-20 01:31:31.268410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.143 [2024-11-20 01:31:31.268525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.143 [2024-11-20 01:31:31.268554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x948e00 with addr=10.0.0.2, port=4420 00:30:23.143 [2024-11-20 01:31:31.268574] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x948e00 is same with the state(5) to be set 00:30:23.143 [2024-11-20 01:31:31.268602] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x948e00 (9): Bad file descriptor 00:30:23.143 [2024-11-20 01:31:31.268621] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.143 [2024-11-20 01:31:31.268636] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.143 [2024-11-20 01:31:31.268653] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.143 Unable to reset the controller. 00:30:23.714 01:31:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:23.714 01:31:31 -- common/autotest_common.sh@862 -- # return 0 00:30:23.714 01:31:31 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:23.714 01:31:31 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:23.714 01:31:31 -- common/autotest_common.sh@10 -- # set +x 00:30:24.013 01:31:31 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:24.013 01:31:31 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:24.013 01:31:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:24.013 01:31:31 -- common/autotest_common.sh@10 -- # set +x 00:30:24.013 Malloc0 00:30:24.013 01:31:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:24.013 01:31:31 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:30:24.013 01:31:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:24.013 01:31:31 -- common/autotest_common.sh@10 -- # set +x 00:30:24.013 [2024-11-20 01:31:31.974064] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:24.013 01:31:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:24.013 01:31:31 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:24.013 01:31:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:24.013 01:31:31 -- common/autotest_common.sh@10 -- # set +x 00:30:24.013 01:31:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:24.013 01:31:31 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:24.013 01:31:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:24.013 01:31:31 -- common/autotest_common.sh@10 -- # set +x 00:30:24.013 01:31:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:24.013 01:31:31 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:24.013 01:31:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:24.013 01:31:31 -- common/autotest_common.sh@10 -- # set +x 00:30:24.013 [2024-11-20 01:31:32.002362] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:24.013 01:31:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:24.013 01:31:32 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:30:24.013 01:31:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:24.013 01:31:32 -- common/autotest_common.sh@10 -- # set +x 00:30:24.013 01:31:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:24.013 01:31:32 -- host/target_disconnect.sh@58 -- # wait 1272520 00:30:24.272 Controller properly reset. 00:30:29.546 Initializing NVMe Controllers 00:30:29.546 Attaching to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:30:29.546 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:30:29.546 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:30:29.546 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:30:29.546 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:30:29.546 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:30:29.546 Initialization complete. Launching workers. 00:30:29.546 Starting thread on core 1 00:30:29.546 Starting thread on core 2 00:30:29.546 Starting thread on core 3 00:30:29.546 Starting thread on core 0 00:30:29.546 01:31:37 -- host/target_disconnect.sh@59 -- # sync 00:30:29.546 00:30:29.546 real 0m11.401s 00:30:29.546 user 0m36.485s 00:30:29.546 sys 0m7.500s 00:30:29.546 01:31:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:29.546 01:31:37 -- common/autotest_common.sh@10 -- # set +x 00:30:29.546 ************************************ 00:30:29.546 END TEST nvmf_target_disconnect_tc2 00:30:29.546 ************************************ 00:30:29.546 01:31:37 -- host/target_disconnect.sh@80 -- # '[' -n '' ']' 00:30:29.546 01:31:37 -- host/target_disconnect.sh@84 -- # trap - SIGINT SIGTERM EXIT 00:30:29.546 01:31:37 -- host/target_disconnect.sh@85 -- # nvmftestfini 00:30:29.546 01:31:37 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:29.546 01:31:37 -- nvmf/common.sh@116 -- # sync 00:30:29.546 01:31:37 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:29.546 01:31:37 -- nvmf/common.sh@119 -- # set +e 00:30:29.546 01:31:37 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:29.546 01:31:37 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:29.546 rmmod nvme_tcp 00:30:29.546 rmmod nvme_fabrics 00:30:29.546 rmmod nvme_keyring 00:30:29.546 01:31:37 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:29.546 01:31:37 -- nvmf/common.sh@123 -- # set -e 00:30:29.546 01:31:37 -- nvmf/common.sh@124 -- # return 0 00:30:29.546 01:31:37 -- nvmf/common.sh@477 -- # '[' -n 1272938 ']' 00:30:29.546 01:31:37 -- nvmf/common.sh@478 -- # killprocess 1272938 00:30:29.546 01:31:37 -- common/autotest_common.sh@936 -- # '[' -z 1272938 ']' 00:30:29.546 01:31:37 -- common/autotest_common.sh@940 -- # kill -0 1272938 00:30:29.546 01:31:37 -- common/autotest_common.sh@941 -- # uname 00:30:29.546 01:31:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:29.546 01:31:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1272938 00:30:29.546 01:31:37 -- common/autotest_common.sh@942 -- # process_name=reactor_4 00:30:29.547 01:31:37 -- common/autotest_common.sh@946 -- # '[' reactor_4 = sudo ']' 00:30:29.547 01:31:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1272938' 00:30:29.547 killing process with pid 1272938 00:30:29.547 01:31:37 -- common/autotest_common.sh@955 -- # kill 1272938 00:30:29.547 01:31:37 -- common/autotest_common.sh@960 -- # wait 1272938 00:30:29.547 01:31:37 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:30:29.547 01:31:37 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:29.547 01:31:37 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:29.547 01:31:37 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:29.547 01:31:37 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:29.547 01:31:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:29.547 01:31:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:29.547 01:31:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:31.453 01:31:39 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:31.453 00:30:31.453 real 0m16.199s 00:30:31.453 user 1m2.226s 00:30:31.453 sys 0m9.709s 00:30:31.453 01:31:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:31.453 01:31:39 -- common/autotest_common.sh@10 -- # set +x 00:30:31.453 ************************************ 00:30:31.453 END TEST nvmf_target_disconnect 00:30:31.453 ************************************ 00:30:31.453 01:31:39 -- nvmf/nvmf.sh@127 -- # timing_exit host 00:30:31.453 01:31:39 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:31.453 01:31:39 -- common/autotest_common.sh@10 -- # set +x 00:30:31.453 01:31:39 -- nvmf/nvmf.sh@129 -- # trap - SIGINT SIGTERM EXIT 00:30:31.453 00:30:31.453 real 22m53.856s 00:30:31.453 user 66m39.596s 00:30:31.453 sys 5m34.739s 00:30:31.453 01:31:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:31.453 01:31:39 -- common/autotest_common.sh@10 -- # set +x 00:30:31.453 ************************************ 00:30:31.453 END TEST nvmf_tcp 00:30:31.453 ************************************ 00:30:31.712 01:31:39 -- spdk/autotest.sh@283 -- # [[ 0 -eq 0 ]] 00:30:31.712 01:31:39 -- spdk/autotest.sh@284 -- # run_test spdkcli_nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:30:31.712 01:31:39 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:30:31.712 01:31:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:31.712 01:31:39 -- common/autotest_common.sh@10 -- # set +x 00:30:31.712 ************************************ 00:30:31.712 START TEST spdkcli_nvmf_tcp 00:30:31.712 ************************************ 00:30:31.712 01:31:39 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:30:31.712 * Looking for test storage... 00:30:31.712 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:30:31.712 01:31:39 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:30:31.712 01:31:39 -- common/autotest_common.sh@1690 -- # lcov --version 00:30:31.712 01:31:39 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:30:31.712 01:31:39 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:30:31.712 01:31:39 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:30:31.712 01:31:39 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:30:31.712 01:31:39 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:30:31.712 01:31:39 -- scripts/common.sh@335 -- # IFS=.-: 00:30:31.712 01:31:39 -- scripts/common.sh@335 -- # read -ra ver1 00:30:31.712 01:31:39 -- scripts/common.sh@336 -- # IFS=.-: 00:30:31.712 01:31:39 -- scripts/common.sh@336 -- # read -ra ver2 00:30:31.712 01:31:39 -- scripts/common.sh@337 -- # local 'op=<' 00:30:31.712 01:31:39 -- scripts/common.sh@339 -- # ver1_l=2 00:30:31.712 01:31:39 -- scripts/common.sh@340 -- # ver2_l=1 00:30:31.712 01:31:39 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:30:31.712 01:31:39 -- scripts/common.sh@343 -- # case "$op" in 00:30:31.712 01:31:39 -- scripts/common.sh@344 -- # : 1 00:30:31.712 01:31:39 -- scripts/common.sh@363 -- # (( v = 0 )) 00:30:31.712 01:31:39 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:30:31.712 01:31:39 -- scripts/common.sh@364 -- # decimal 1 00:30:31.712 01:31:39 -- scripts/common.sh@352 -- # local d=1 00:30:31.712 01:31:39 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:30:31.712 01:31:39 -- scripts/common.sh@354 -- # echo 1 00:30:31.712 01:31:39 -- scripts/common.sh@364 -- # ver1[v]=1 00:30:31.712 01:31:39 -- scripts/common.sh@365 -- # decimal 2 00:30:31.712 01:31:39 -- scripts/common.sh@352 -- # local d=2 00:30:31.712 01:31:39 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:30:31.712 01:31:39 -- scripts/common.sh@354 -- # echo 2 00:30:31.712 01:31:39 -- scripts/common.sh@365 -- # ver2[v]=2 00:30:31.712 01:31:39 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:30:31.712 01:31:39 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:30:31.712 01:31:39 -- scripts/common.sh@367 -- # return 0 00:30:31.712 01:31:39 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:30:31.712 01:31:39 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:30:31.712 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:31.712 --rc genhtml_branch_coverage=1 00:30:31.712 --rc genhtml_function_coverage=1 00:30:31.712 --rc genhtml_legend=1 00:30:31.712 --rc geninfo_all_blocks=1 00:30:31.712 --rc geninfo_unexecuted_blocks=1 00:30:31.712 00:30:31.712 ' 00:30:31.712 01:31:39 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:30:31.712 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:31.712 --rc genhtml_branch_coverage=1 00:30:31.712 --rc genhtml_function_coverage=1 00:30:31.712 --rc genhtml_legend=1 00:30:31.712 --rc geninfo_all_blocks=1 00:30:31.712 --rc geninfo_unexecuted_blocks=1 00:30:31.712 00:30:31.712 ' 00:30:31.712 01:31:39 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:30:31.712 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:31.712 --rc genhtml_branch_coverage=1 00:30:31.712 --rc genhtml_function_coverage=1 00:30:31.712 --rc genhtml_legend=1 00:30:31.712 --rc geninfo_all_blocks=1 00:30:31.712 --rc geninfo_unexecuted_blocks=1 00:30:31.712 00:30:31.712 ' 00:30:31.712 01:31:39 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:30:31.712 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:31.712 --rc genhtml_branch_coverage=1 00:30:31.712 --rc genhtml_function_coverage=1 00:30:31.712 --rc genhtml_legend=1 00:30:31.712 --rc geninfo_all_blocks=1 00:30:31.712 --rc geninfo_unexecuted_blocks=1 00:30:31.712 00:30:31.712 ' 00:30:31.712 01:31:39 -- spdkcli/nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:30:31.712 01:31:39 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:30:31.712 01:31:39 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:30:31.712 01:31:39 -- spdkcli/nvmf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:31.712 01:31:39 -- nvmf/common.sh@7 -- # uname -s 00:30:31.712 01:31:39 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:31.712 01:31:39 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:31.712 01:31:39 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:31.712 01:31:39 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:31.712 01:31:39 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:31.712 01:31:39 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:31.712 01:31:39 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:31.712 01:31:39 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:31.712 01:31:39 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:31.712 01:31:39 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:31.712 01:31:39 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:30:31.712 01:31:39 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:30:31.712 01:31:39 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:31.712 01:31:39 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:31.712 01:31:39 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:31.712 01:31:39 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:31.712 01:31:39 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:31.712 01:31:39 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:31.712 01:31:39 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:31.713 01:31:39 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:31.713 01:31:39 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:31.713 01:31:39 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:31.713 01:31:39 -- paths/export.sh@5 -- # export PATH 00:30:31.713 01:31:39 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:31.713 01:31:39 -- nvmf/common.sh@46 -- # : 0 00:30:31.713 01:31:39 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:31.713 01:31:39 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:31.713 01:31:39 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:31.713 01:31:39 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:31.713 01:31:39 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:31.713 01:31:39 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:31.713 01:31:39 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:31.713 01:31:39 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:31.713 01:31:39 -- spdkcli/nvmf.sh@12 -- # MATCH_FILE=spdkcli_nvmf.test 00:30:31.713 01:31:39 -- spdkcli/nvmf.sh@13 -- # SPDKCLI_BRANCH=/nvmf 00:30:31.713 01:31:39 -- spdkcli/nvmf.sh@15 -- # trap cleanup EXIT 00:30:31.713 01:31:39 -- spdkcli/nvmf.sh@17 -- # timing_enter run_nvmf_tgt 00:30:31.713 01:31:39 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:31.713 01:31:39 -- common/autotest_common.sh@10 -- # set +x 00:30:31.713 01:31:39 -- spdkcli/nvmf.sh@18 -- # run_nvmf_tgt 00:30:31.713 01:31:39 -- spdkcli/common.sh@33 -- # nvmf_tgt_pid=1274167 00:30:31.713 01:31:39 -- spdkcli/common.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x3 -p 0 00:30:31.713 01:31:39 -- spdkcli/common.sh@34 -- # waitforlisten 1274167 00:30:31.713 01:31:39 -- common/autotest_common.sh@829 -- # '[' -z 1274167 ']' 00:30:31.713 01:31:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:31.713 01:31:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:31.713 01:31:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:31.713 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:31.713 01:31:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:31.713 01:31:39 -- common/autotest_common.sh@10 -- # set +x 00:30:31.713 [2024-11-20 01:31:39.903852] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:30:31.713 [2024-11-20 01:31:39.903928] [ DPDK EAL parameters: nvmf --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1274167 ] 00:30:31.973 EAL: No free 2048 kB hugepages reported on node 1 00:30:31.973 [2024-11-20 01:31:39.964497] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:30:31.973 [2024-11-20 01:31:40.056534] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:31.973 [2024-11-20 01:31:40.056757] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:31.973 [2024-11-20 01:31:40.056764] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:32.909 01:31:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:32.909 01:31:40 -- common/autotest_common.sh@862 -- # return 0 00:30:32.909 01:31:40 -- spdkcli/nvmf.sh@19 -- # timing_exit run_nvmf_tgt 00:30:32.909 01:31:40 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:32.909 01:31:40 -- common/autotest_common.sh@10 -- # set +x 00:30:32.909 01:31:40 -- spdkcli/nvmf.sh@21 -- # NVMF_TARGET_IP=127.0.0.1 00:30:32.909 01:31:40 -- spdkcli/nvmf.sh@22 -- # [[ tcp == \r\d\m\a ]] 00:30:32.909 01:31:40 -- spdkcli/nvmf.sh@27 -- # timing_enter spdkcli_create_nvmf_config 00:30:32.909 01:31:40 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:32.909 01:31:40 -- common/autotest_common.sh@10 -- # set +x 00:30:32.909 01:31:40 -- spdkcli/nvmf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/bdevs/malloc create 32 512 Malloc1'\'' '\''Malloc1'\'' True 00:30:32.909 '\''/bdevs/malloc create 32 512 Malloc2'\'' '\''Malloc2'\'' True 00:30:32.909 '\''/bdevs/malloc create 32 512 Malloc3'\'' '\''Malloc3'\'' True 00:30:32.909 '\''/bdevs/malloc create 32 512 Malloc4'\'' '\''Malloc4'\'' True 00:30:32.909 '\''/bdevs/malloc create 32 512 Malloc5'\'' '\''Malloc5'\'' True 00:30:32.909 '\''/bdevs/malloc create 32 512 Malloc6'\'' '\''Malloc6'\'' True 00:30:32.909 '\''nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192'\'' '\'''\'' True 00:30:32.909 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:30:32.909 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1'\'' '\''Malloc3'\'' True 00:30:32.909 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2'\'' '\''Malloc4'\'' True 00:30:32.909 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:30:32.909 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:32.909 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2'\'' '\''Malloc2'\'' True 00:30:32.909 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:30:32.909 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:32.909 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1'\'' '\''Malloc1'\'' True 00:30:32.909 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:30:32.909 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:30:32.909 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:30:32.909 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:32.909 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True'\'' '\''Allow any host'\'' 00:30:32.909 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False'\'' '\''Allow any host'\'' True 00:30:32.909 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:30:32.909 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4'\'' '\''127.0.0.1:4262'\'' True 00:30:32.909 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:32.909 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5'\'' '\''Malloc5'\'' True 00:30:32.909 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6'\'' '\''Malloc6'\'' True 00:30:32.909 '\''/nvmf/referral create tcp 127.0.0.2 4030 IPv4'\'' 00:30:32.909 ' 00:30:33.169 [2024-11-20 01:31:41.339640] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:30:35.703 [2024-11-20 01:31:43.529680] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:36.638 [2024-11-20 01:31:44.782200] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4260 *** 00:30:39.174 [2024-11-20 01:31:47.097518] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4261 *** 00:30:41.092 [2024-11-20 01:31:49.120239] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4262 *** 00:30:42.472 Executing command: ['/bdevs/malloc create 32 512 Malloc1', 'Malloc1', True] 00:30:42.472 Executing command: ['/bdevs/malloc create 32 512 Malloc2', 'Malloc2', True] 00:30:42.472 Executing command: ['/bdevs/malloc create 32 512 Malloc3', 'Malloc3', True] 00:30:42.472 Executing command: ['/bdevs/malloc create 32 512 Malloc4', 'Malloc4', True] 00:30:42.472 Executing command: ['/bdevs/malloc create 32 512 Malloc5', 'Malloc5', True] 00:30:42.472 Executing command: ['/bdevs/malloc create 32 512 Malloc6', 'Malloc6', True] 00:30:42.472 Executing command: ['nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192', '', True] 00:30:42.472 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode1', True] 00:30:42.472 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1', 'Malloc3', True] 00:30:42.472 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2', 'Malloc4', True] 00:30:42.472 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:30:42.472 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:30:42.472 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2', 'Malloc2', True] 00:30:42.472 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:30:42.472 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:30:42.472 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1', 'Malloc1', True] 00:30:42.472 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:30:42.472 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:30:42.472 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1', 'nqn.2014-08.org.spdk:cnode1', True] 00:30:42.472 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:30:42.472 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True', 'Allow any host', False] 00:30:42.473 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False', 'Allow any host', True] 00:30:42.473 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:30:42.473 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4', '127.0.0.1:4262', True] 00:30:42.473 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:30:42.473 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5', 'Malloc5', True] 00:30:42.473 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6', 'Malloc6', True] 00:30:42.473 Executing command: ['/nvmf/referral create tcp 127.0.0.2 4030 IPv4', False] 00:30:42.731 01:31:50 -- spdkcli/nvmf.sh@66 -- # timing_exit spdkcli_create_nvmf_config 00:30:42.731 01:31:50 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:42.731 01:31:50 -- common/autotest_common.sh@10 -- # set +x 00:30:42.731 01:31:50 -- spdkcli/nvmf.sh@68 -- # timing_enter spdkcli_check_match 00:30:42.731 01:31:50 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:42.731 01:31:50 -- common/autotest_common.sh@10 -- # set +x 00:30:42.731 01:31:50 -- spdkcli/nvmf.sh@69 -- # check_match 00:30:42.731 01:31:50 -- spdkcli/common.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdkcli.py ll /nvmf 00:30:42.989 01:31:51 -- spdkcli/common.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/match/match /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test.match 00:30:43.248 01:31:51 -- spdkcli/common.sh@46 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test 00:30:43.248 01:31:51 -- spdkcli/nvmf.sh@70 -- # timing_exit spdkcli_check_match 00:30:43.248 01:31:51 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:43.248 01:31:51 -- common/autotest_common.sh@10 -- # set +x 00:30:43.248 01:31:51 -- spdkcli/nvmf.sh@72 -- # timing_enter spdkcli_clear_nvmf_config 00:30:43.248 01:31:51 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:43.248 01:31:51 -- common/autotest_common.sh@10 -- # set +x 00:30:43.248 01:31:51 -- spdkcli/nvmf.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1'\'' '\''Malloc3'\'' 00:30:43.248 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all'\'' '\''Malloc4'\'' 00:30:43.248 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:30:43.248 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' 00:30:43.248 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262'\'' '\''127.0.0.1:4262'\'' 00:30:43.248 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all'\'' '\''127.0.0.1:4261'\'' 00:30:43.248 '\''/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3'\'' '\''nqn.2014-08.org.spdk:cnode3'\'' 00:30:43.248 '\''/nvmf/subsystem delete_all'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:30:43.248 '\''/bdevs/malloc delete Malloc6'\'' '\''Malloc6'\'' 00:30:43.248 '\''/bdevs/malloc delete Malloc5'\'' '\''Malloc5'\'' 00:30:43.248 '\''/bdevs/malloc delete Malloc4'\'' '\''Malloc4'\'' 00:30:43.248 '\''/bdevs/malloc delete Malloc3'\'' '\''Malloc3'\'' 00:30:43.248 '\''/bdevs/malloc delete Malloc2'\'' '\''Malloc2'\'' 00:30:43.248 '\''/bdevs/malloc delete Malloc1'\'' '\''Malloc1'\'' 00:30:43.248 ' 00:30:48.521 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1', 'Malloc3', False] 00:30:48.521 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all', 'Malloc4', False] 00:30:48.521 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', False] 00:30:48.521 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all', 'nqn.2014-08.org.spdk:cnode1', False] 00:30:48.521 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262', '127.0.0.1:4262', False] 00:30:48.521 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all', '127.0.0.1:4261', False] 00:30:48.521 Executing command: ['/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3', 'nqn.2014-08.org.spdk:cnode3', False] 00:30:48.521 Executing command: ['/nvmf/subsystem delete_all', 'nqn.2014-08.org.spdk:cnode2', False] 00:30:48.521 Executing command: ['/bdevs/malloc delete Malloc6', 'Malloc6', False] 00:30:48.521 Executing command: ['/bdevs/malloc delete Malloc5', 'Malloc5', False] 00:30:48.521 Executing command: ['/bdevs/malloc delete Malloc4', 'Malloc4', False] 00:30:48.521 Executing command: ['/bdevs/malloc delete Malloc3', 'Malloc3', False] 00:30:48.521 Executing command: ['/bdevs/malloc delete Malloc2', 'Malloc2', False] 00:30:48.521 Executing command: ['/bdevs/malloc delete Malloc1', 'Malloc1', False] 00:30:48.521 01:31:56 -- spdkcli/nvmf.sh@88 -- # timing_exit spdkcli_clear_nvmf_config 00:30:48.521 01:31:56 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:48.521 01:31:56 -- common/autotest_common.sh@10 -- # set +x 00:30:48.521 01:31:56 -- spdkcli/nvmf.sh@90 -- # killprocess 1274167 00:30:48.521 01:31:56 -- common/autotest_common.sh@936 -- # '[' -z 1274167 ']' 00:30:48.521 01:31:56 -- common/autotest_common.sh@940 -- # kill -0 1274167 00:30:48.521 01:31:56 -- common/autotest_common.sh@941 -- # uname 00:30:48.521 01:31:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:48.521 01:31:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1274167 00:30:48.521 01:31:56 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:30:48.521 01:31:56 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:30:48.521 01:31:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1274167' 00:30:48.521 killing process with pid 1274167 00:30:48.521 01:31:56 -- common/autotest_common.sh@955 -- # kill 1274167 00:30:48.521 [2024-11-20 01:31:56.663143] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:30:48.521 01:31:56 -- common/autotest_common.sh@960 -- # wait 1274167 00:30:48.779 01:31:56 -- spdkcli/nvmf.sh@1 -- # cleanup 00:30:48.779 01:31:56 -- spdkcli/common.sh@10 -- # '[' -n '' ']' 00:30:48.779 01:31:56 -- spdkcli/common.sh@13 -- # '[' -n 1274167 ']' 00:30:48.779 01:31:56 -- spdkcli/common.sh@14 -- # killprocess 1274167 00:30:48.779 01:31:56 -- common/autotest_common.sh@936 -- # '[' -z 1274167 ']' 00:30:48.779 01:31:56 -- common/autotest_common.sh@940 -- # kill -0 1274167 00:30:48.779 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1274167) - No such process 00:30:48.779 01:31:56 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1274167 is not found' 00:30:48.779 Process with pid 1274167 is not found 00:30:48.779 01:31:56 -- spdkcli/common.sh@16 -- # '[' -n '' ']' 00:30:48.779 01:31:56 -- spdkcli/common.sh@19 -- # '[' -n '' ']' 00:30:48.779 01:31:56 -- spdkcli/common.sh@22 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_nvmf.test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_details_vhost.test /tmp/sample_aio 00:30:48.779 00:30:48.779 real 0m17.214s 00:30:48.779 user 0m36.775s 00:30:48.779 sys 0m0.873s 00:30:48.779 01:31:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:48.779 01:31:56 -- common/autotest_common.sh@10 -- # set +x 00:30:48.779 ************************************ 00:30:48.779 END TEST spdkcli_nvmf_tcp 00:30:48.779 ************************************ 00:30:48.779 01:31:56 -- spdk/autotest.sh@285 -- # run_test nvmf_identify_passthru /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:30:48.779 01:31:56 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:30:48.779 01:31:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:48.779 01:31:56 -- common/autotest_common.sh@10 -- # set +x 00:30:48.779 ************************************ 00:30:48.779 START TEST nvmf_identify_passthru 00:30:48.779 ************************************ 00:30:48.779 01:31:56 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:30:48.779 * Looking for test storage... 00:30:48.779 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:30:48.779 01:31:56 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:30:48.779 01:31:56 -- common/autotest_common.sh@1690 -- # lcov --version 00:30:48.779 01:31:56 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:30:49.038 01:31:57 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:30:49.038 01:31:57 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:30:49.038 01:31:57 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:30:49.038 01:31:57 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:30:49.038 01:31:57 -- scripts/common.sh@335 -- # IFS=.-: 00:30:49.038 01:31:57 -- scripts/common.sh@335 -- # read -ra ver1 00:30:49.038 01:31:57 -- scripts/common.sh@336 -- # IFS=.-: 00:30:49.038 01:31:57 -- scripts/common.sh@336 -- # read -ra ver2 00:30:49.038 01:31:57 -- scripts/common.sh@337 -- # local 'op=<' 00:30:49.038 01:31:57 -- scripts/common.sh@339 -- # ver1_l=2 00:30:49.038 01:31:57 -- scripts/common.sh@340 -- # ver2_l=1 00:30:49.038 01:31:57 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:30:49.038 01:31:57 -- scripts/common.sh@343 -- # case "$op" in 00:30:49.038 01:31:57 -- scripts/common.sh@344 -- # : 1 00:30:49.038 01:31:57 -- scripts/common.sh@363 -- # (( v = 0 )) 00:30:49.038 01:31:57 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:30:49.038 01:31:57 -- scripts/common.sh@364 -- # decimal 1 00:30:49.038 01:31:57 -- scripts/common.sh@352 -- # local d=1 00:30:49.038 01:31:57 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:30:49.038 01:31:57 -- scripts/common.sh@354 -- # echo 1 00:30:49.038 01:31:57 -- scripts/common.sh@364 -- # ver1[v]=1 00:30:49.038 01:31:57 -- scripts/common.sh@365 -- # decimal 2 00:30:49.038 01:31:57 -- scripts/common.sh@352 -- # local d=2 00:30:49.038 01:31:57 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:30:49.038 01:31:57 -- scripts/common.sh@354 -- # echo 2 00:30:49.038 01:31:57 -- scripts/common.sh@365 -- # ver2[v]=2 00:30:49.038 01:31:57 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:30:49.038 01:31:57 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:30:49.038 01:31:57 -- scripts/common.sh@367 -- # return 0 00:30:49.038 01:31:57 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:30:49.038 01:31:57 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:30:49.038 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:49.038 --rc genhtml_branch_coverage=1 00:30:49.038 --rc genhtml_function_coverage=1 00:30:49.038 --rc genhtml_legend=1 00:30:49.038 --rc geninfo_all_blocks=1 00:30:49.038 --rc geninfo_unexecuted_blocks=1 00:30:49.038 00:30:49.038 ' 00:30:49.038 01:31:57 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:30:49.038 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:49.038 --rc genhtml_branch_coverage=1 00:30:49.038 --rc genhtml_function_coverage=1 00:30:49.038 --rc genhtml_legend=1 00:30:49.038 --rc geninfo_all_blocks=1 00:30:49.038 --rc geninfo_unexecuted_blocks=1 00:30:49.038 00:30:49.038 ' 00:30:49.038 01:31:57 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:30:49.038 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:49.038 --rc genhtml_branch_coverage=1 00:30:49.038 --rc genhtml_function_coverage=1 00:30:49.038 --rc genhtml_legend=1 00:30:49.038 --rc geninfo_all_blocks=1 00:30:49.038 --rc geninfo_unexecuted_blocks=1 00:30:49.038 00:30:49.038 ' 00:30:49.038 01:31:57 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:30:49.038 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:49.038 --rc genhtml_branch_coverage=1 00:30:49.038 --rc genhtml_function_coverage=1 00:30:49.038 --rc genhtml_legend=1 00:30:49.038 --rc geninfo_all_blocks=1 00:30:49.038 --rc geninfo_unexecuted_blocks=1 00:30:49.038 00:30:49.038 ' 00:30:49.038 01:31:57 -- target/identify_passthru.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:49.038 01:31:57 -- nvmf/common.sh@7 -- # uname -s 00:30:49.039 01:31:57 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:49.039 01:31:57 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:49.039 01:31:57 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:49.039 01:31:57 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:49.039 01:31:57 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:49.039 01:31:57 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:49.039 01:31:57 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:49.039 01:31:57 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:49.039 01:31:57 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:49.039 01:31:57 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:49.039 01:31:57 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:30:49.039 01:31:57 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:30:49.039 01:31:57 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:49.039 01:31:57 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:49.039 01:31:57 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:49.039 01:31:57 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:49.039 01:31:57 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:49.039 01:31:57 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:49.039 01:31:57 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:49.039 01:31:57 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:49.039 01:31:57 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:49.039 01:31:57 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:49.039 01:31:57 -- paths/export.sh@5 -- # export PATH 00:30:49.039 01:31:57 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:49.039 01:31:57 -- nvmf/common.sh@46 -- # : 0 00:30:49.039 01:31:57 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:49.039 01:31:57 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:49.039 01:31:57 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:49.039 01:31:57 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:49.039 01:31:57 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:49.039 01:31:57 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:49.039 01:31:57 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:49.039 01:31:57 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:49.039 01:31:57 -- target/identify_passthru.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:49.039 01:31:57 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:49.039 01:31:57 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:49.039 01:31:57 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:49.039 01:31:57 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:49.039 01:31:57 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:49.039 01:31:57 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:49.039 01:31:57 -- paths/export.sh@5 -- # export PATH 00:30:49.039 01:31:57 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:49.039 01:31:57 -- target/identify_passthru.sh@12 -- # nvmftestinit 00:30:49.039 01:31:57 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:30:49.039 01:31:57 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:30:49.039 01:31:57 -- nvmf/common.sh@436 -- # prepare_net_devs 00:30:49.039 01:31:57 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:30:49.039 01:31:57 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:30:49.039 01:31:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:49.039 01:31:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:30:49.039 01:31:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:49.039 01:31:57 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:30:49.039 01:31:57 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:30:49.039 01:31:57 -- nvmf/common.sh@284 -- # xtrace_disable 00:30:49.039 01:31:57 -- common/autotest_common.sh@10 -- # set +x 00:30:50.942 01:31:59 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:30:50.942 01:31:59 -- nvmf/common.sh@290 -- # pci_devs=() 00:30:50.942 01:31:59 -- nvmf/common.sh@290 -- # local -a pci_devs 00:30:50.942 01:31:59 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:30:50.942 01:31:59 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:30:50.942 01:31:59 -- nvmf/common.sh@292 -- # pci_drivers=() 00:30:50.942 01:31:59 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:30:50.942 01:31:59 -- nvmf/common.sh@294 -- # net_devs=() 00:30:50.942 01:31:59 -- nvmf/common.sh@294 -- # local -ga net_devs 00:30:50.942 01:31:59 -- nvmf/common.sh@295 -- # e810=() 00:30:50.942 01:31:59 -- nvmf/common.sh@295 -- # local -ga e810 00:30:50.942 01:31:59 -- nvmf/common.sh@296 -- # x722=() 00:30:50.942 01:31:59 -- nvmf/common.sh@296 -- # local -ga x722 00:30:50.942 01:31:59 -- nvmf/common.sh@297 -- # mlx=() 00:30:50.942 01:31:59 -- nvmf/common.sh@297 -- # local -ga mlx 00:30:50.942 01:31:59 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:30:50.942 01:31:59 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:30:50.942 01:31:59 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:30:50.942 01:31:59 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:30:50.942 01:31:59 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:30:50.942 01:31:59 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:30:50.942 01:31:59 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:30:50.942 01:31:59 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:30:50.942 01:31:59 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:30:50.942 01:31:59 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:30:50.942 01:31:59 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:30:50.943 01:31:59 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:30:50.943 01:31:59 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:30:50.943 01:31:59 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:30:50.943 01:31:59 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:30:50.943 01:31:59 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:30:50.943 01:31:59 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:30:50.943 01:31:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:50.943 01:31:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:30:50.943 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:30:50.943 01:31:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:50.943 01:31:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:50.943 01:31:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:50.943 01:31:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:50.943 01:31:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:50.943 01:31:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:50.943 01:31:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:30:50.943 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:30:50.943 01:31:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:50.943 01:31:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:50.943 01:31:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:50.943 01:31:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:50.943 01:31:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:50.943 01:31:59 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:30:50.943 01:31:59 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:30:50.943 01:31:59 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:30:50.943 01:31:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:50.943 01:31:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:50.943 01:31:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:50.943 01:31:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:50.943 01:31:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:30:50.943 Found net devices under 0000:0a:00.0: cvl_0_0 00:30:50.943 01:31:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:50.943 01:31:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:50.943 01:31:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:50.943 01:31:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:50.943 01:31:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:50.943 01:31:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:30:50.943 Found net devices under 0000:0a:00.1: cvl_0_1 00:30:50.943 01:31:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:50.943 01:31:59 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:30:50.943 01:31:59 -- nvmf/common.sh@402 -- # is_hw=yes 00:30:50.943 01:31:59 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:30:50.943 01:31:59 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:30:50.943 01:31:59 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:30:50.943 01:31:59 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:30:50.943 01:31:59 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:30:50.943 01:31:59 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:30:50.943 01:31:59 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:30:50.943 01:31:59 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:30:50.943 01:31:59 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:30:50.943 01:31:59 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:30:50.943 01:31:59 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:30:50.943 01:31:59 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:30:50.943 01:31:59 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:30:50.943 01:31:59 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:30:50.943 01:31:59 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:30:50.943 01:31:59 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:30:50.943 01:31:59 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:30:50.943 01:31:59 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:30:50.943 01:31:59 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:30:50.943 01:31:59 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:30:51.200 01:31:59 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:30:51.200 01:31:59 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:30:51.200 01:31:59 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:30:51.200 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:30:51.200 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.221 ms 00:30:51.200 00:30:51.200 --- 10.0.0.2 ping statistics --- 00:30:51.200 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:51.200 rtt min/avg/max/mdev = 0.221/0.221/0.221/0.000 ms 00:30:51.200 01:31:59 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:30:51.200 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:30:51.200 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.116 ms 00:30:51.200 00:30:51.200 --- 10.0.0.1 ping statistics --- 00:30:51.200 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:51.200 rtt min/avg/max/mdev = 0.116/0.116/0.116/0.000 ms 00:30:51.200 01:31:59 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:30:51.200 01:31:59 -- nvmf/common.sh@410 -- # return 0 00:30:51.200 01:31:59 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:30:51.200 01:31:59 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:30:51.200 01:31:59 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:30:51.200 01:31:59 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:30:51.200 01:31:59 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:30:51.200 01:31:59 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:30:51.200 01:31:59 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:30:51.200 01:31:59 -- target/identify_passthru.sh@14 -- # timing_enter nvme_identify 00:30:51.200 01:31:59 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:51.200 01:31:59 -- common/autotest_common.sh@10 -- # set +x 00:30:51.200 01:31:59 -- target/identify_passthru.sh@16 -- # get_first_nvme_bdf 00:30:51.200 01:31:59 -- common/autotest_common.sh@1519 -- # bdfs=() 00:30:51.200 01:31:59 -- common/autotest_common.sh@1519 -- # local bdfs 00:30:51.200 01:31:59 -- common/autotest_common.sh@1520 -- # bdfs=($(get_nvme_bdfs)) 00:30:51.200 01:31:59 -- common/autotest_common.sh@1520 -- # get_nvme_bdfs 00:30:51.200 01:31:59 -- common/autotest_common.sh@1508 -- # bdfs=() 00:30:51.200 01:31:59 -- common/autotest_common.sh@1508 -- # local bdfs 00:30:51.200 01:31:59 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:30:51.200 01:31:59 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:30:51.200 01:31:59 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:30:51.200 01:31:59 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:30:51.200 01:31:59 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:30:51.200 01:31:59 -- common/autotest_common.sh@1522 -- # echo 0000:88:00.0 00:30:51.200 01:31:59 -- target/identify_passthru.sh@16 -- # bdf=0000:88:00.0 00:30:51.200 01:31:59 -- target/identify_passthru.sh@17 -- # '[' -z 0000:88:00.0 ']' 00:30:51.200 01:31:59 -- target/identify_passthru.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:30:51.200 01:31:59 -- target/identify_passthru.sh@23 -- # grep 'Serial Number:' 00:30:51.200 01:31:59 -- target/identify_passthru.sh@23 -- # awk '{print $3}' 00:30:51.200 EAL: No free 2048 kB hugepages reported on node 1 00:30:55.396 01:32:03 -- target/identify_passthru.sh@23 -- # nvme_serial_number=PHLJ916004901P0FGN 00:30:55.396 01:32:03 -- target/identify_passthru.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:30:55.396 01:32:03 -- target/identify_passthru.sh@24 -- # grep 'Model Number:' 00:30:55.396 01:32:03 -- target/identify_passthru.sh@24 -- # awk '{print $3}' 00:30:55.396 EAL: No free 2048 kB hugepages reported on node 1 00:30:59.589 01:32:07 -- target/identify_passthru.sh@24 -- # nvme_model_number=INTEL 00:30:59.589 01:32:07 -- target/identify_passthru.sh@26 -- # timing_exit nvme_identify 00:30:59.589 01:32:07 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:59.589 01:32:07 -- common/autotest_common.sh@10 -- # set +x 00:30:59.589 01:32:07 -- target/identify_passthru.sh@28 -- # timing_enter start_nvmf_tgt 00:30:59.589 01:32:07 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:59.589 01:32:07 -- common/autotest_common.sh@10 -- # set +x 00:30:59.589 01:32:07 -- target/identify_passthru.sh@31 -- # nvmfpid=1278904 00:30:59.589 01:32:07 -- target/identify_passthru.sh@30 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:30:59.589 01:32:07 -- target/identify_passthru.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:30:59.589 01:32:07 -- target/identify_passthru.sh@35 -- # waitforlisten 1278904 00:30:59.589 01:32:07 -- common/autotest_common.sh@829 -- # '[' -z 1278904 ']' 00:30:59.589 01:32:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:59.589 01:32:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:59.589 01:32:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:59.589 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:59.589 01:32:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:59.589 01:32:07 -- common/autotest_common.sh@10 -- # set +x 00:30:59.589 [2024-11-20 01:32:07.730911] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:30:59.589 [2024-11-20 01:32:07.730993] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:59.589 EAL: No free 2048 kB hugepages reported on node 1 00:30:59.589 [2024-11-20 01:32:07.801005] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:30:59.847 [2024-11-20 01:32:07.892326] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:59.847 [2024-11-20 01:32:07.892497] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:59.847 [2024-11-20 01:32:07.892518] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:59.847 [2024-11-20 01:32:07.892533] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:59.847 [2024-11-20 01:32:07.892616] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:59.847 [2024-11-20 01:32:07.892696] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:30:59.847 [2024-11-20 01:32:07.892781] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:30:59.847 [2024-11-20 01:32:07.892784] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:59.847 01:32:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:59.847 01:32:07 -- common/autotest_common.sh@862 -- # return 0 00:30:59.847 01:32:07 -- target/identify_passthru.sh@36 -- # rpc_cmd -v nvmf_set_config --passthru-identify-ctrlr 00:30:59.847 01:32:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:59.847 01:32:07 -- common/autotest_common.sh@10 -- # set +x 00:30:59.847 INFO: Log level set to 20 00:30:59.847 INFO: Requests: 00:30:59.847 { 00:30:59.847 "jsonrpc": "2.0", 00:30:59.847 "method": "nvmf_set_config", 00:30:59.847 "id": 1, 00:30:59.847 "params": { 00:30:59.847 "admin_cmd_passthru": { 00:30:59.847 "identify_ctrlr": true 00:30:59.847 } 00:30:59.847 } 00:30:59.847 } 00:30:59.847 00:30:59.847 INFO: response: 00:30:59.847 { 00:30:59.847 "jsonrpc": "2.0", 00:30:59.847 "id": 1, 00:30:59.847 "result": true 00:30:59.847 } 00:30:59.847 00:30:59.848 01:32:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:59.848 01:32:07 -- target/identify_passthru.sh@37 -- # rpc_cmd -v framework_start_init 00:30:59.848 01:32:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:59.848 01:32:07 -- common/autotest_common.sh@10 -- # set +x 00:30:59.848 INFO: Setting log level to 20 00:30:59.848 INFO: Setting log level to 20 00:30:59.848 INFO: Log level set to 20 00:30:59.848 INFO: Log level set to 20 00:30:59.848 INFO: Requests: 00:30:59.848 { 00:30:59.848 "jsonrpc": "2.0", 00:30:59.848 "method": "framework_start_init", 00:30:59.848 "id": 1 00:30:59.848 } 00:30:59.848 00:30:59.848 INFO: Requests: 00:30:59.848 { 00:30:59.848 "jsonrpc": "2.0", 00:30:59.848 "method": "framework_start_init", 00:30:59.848 "id": 1 00:30:59.848 } 00:30:59.848 00:30:59.848 [2024-11-20 01:32:08.058379] nvmf_tgt.c: 423:nvmf_tgt_advance_state: *NOTICE*: Custom identify ctrlr handler enabled 00:31:00.108 INFO: response: 00:31:00.108 { 00:31:00.108 "jsonrpc": "2.0", 00:31:00.108 "id": 1, 00:31:00.108 "result": true 00:31:00.108 } 00:31:00.108 00:31:00.108 INFO: response: 00:31:00.108 { 00:31:00.108 "jsonrpc": "2.0", 00:31:00.108 "id": 1, 00:31:00.108 "result": true 00:31:00.108 } 00:31:00.108 00:31:00.108 01:32:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:00.108 01:32:08 -- target/identify_passthru.sh@38 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:31:00.108 01:32:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:00.108 01:32:08 -- common/autotest_common.sh@10 -- # set +x 00:31:00.108 INFO: Setting log level to 40 00:31:00.108 INFO: Setting log level to 40 00:31:00.108 INFO: Setting log level to 40 00:31:00.108 [2024-11-20 01:32:08.068498] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:31:00.108 01:32:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:00.108 01:32:08 -- target/identify_passthru.sh@39 -- # timing_exit start_nvmf_tgt 00:31:00.108 01:32:08 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:00.108 01:32:08 -- common/autotest_common.sh@10 -- # set +x 00:31:00.108 01:32:08 -- target/identify_passthru.sh@41 -- # rpc_cmd bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 00:31:00.108 01:32:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:00.108 01:32:08 -- common/autotest_common.sh@10 -- # set +x 00:31:03.401 Nvme0n1 00:31:03.401 01:32:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:03.401 01:32:10 -- target/identify_passthru.sh@42 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 1 00:31:03.401 01:32:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:03.401 01:32:10 -- common/autotest_common.sh@10 -- # set +x 00:31:03.401 01:32:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:03.401 01:32:10 -- target/identify_passthru.sh@43 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:31:03.401 01:32:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:03.401 01:32:10 -- common/autotest_common.sh@10 -- # set +x 00:31:03.401 01:32:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:03.401 01:32:10 -- target/identify_passthru.sh@44 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:03.401 01:32:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:03.401 01:32:10 -- common/autotest_common.sh@10 -- # set +x 00:31:03.401 [2024-11-20 01:32:10.961340] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:03.401 01:32:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:03.401 01:32:10 -- target/identify_passthru.sh@46 -- # rpc_cmd nvmf_get_subsystems 00:31:03.401 01:32:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:03.401 01:32:10 -- common/autotest_common.sh@10 -- # set +x 00:31:03.401 [2024-11-20 01:32:10.969042] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:31:03.401 [ 00:31:03.401 { 00:31:03.401 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:31:03.401 "subtype": "Discovery", 00:31:03.401 "listen_addresses": [], 00:31:03.401 "allow_any_host": true, 00:31:03.401 "hosts": [] 00:31:03.401 }, 00:31:03.401 { 00:31:03.401 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:31:03.401 "subtype": "NVMe", 00:31:03.401 "listen_addresses": [ 00:31:03.401 { 00:31:03.401 "transport": "TCP", 00:31:03.401 "trtype": "TCP", 00:31:03.401 "adrfam": "IPv4", 00:31:03.401 "traddr": "10.0.0.2", 00:31:03.401 "trsvcid": "4420" 00:31:03.401 } 00:31:03.401 ], 00:31:03.401 "allow_any_host": true, 00:31:03.401 "hosts": [], 00:31:03.401 "serial_number": "SPDK00000000000001", 00:31:03.401 "model_number": "SPDK bdev Controller", 00:31:03.401 "max_namespaces": 1, 00:31:03.401 "min_cntlid": 1, 00:31:03.401 "max_cntlid": 65519, 00:31:03.401 "namespaces": [ 00:31:03.401 { 00:31:03.401 "nsid": 1, 00:31:03.401 "bdev_name": "Nvme0n1", 00:31:03.401 "name": "Nvme0n1", 00:31:03.401 "nguid": "861049EEFAF044D08768D99EDCE786EE", 00:31:03.401 "uuid": "861049ee-faf0-44d0-8768-d99edce786ee" 00:31:03.401 } 00:31:03.401 ] 00:31:03.401 } 00:31:03.402 ] 00:31:03.402 01:32:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:03.402 01:32:10 -- target/identify_passthru.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:31:03.402 01:32:10 -- target/identify_passthru.sh@54 -- # grep 'Serial Number:' 00:31:03.402 01:32:10 -- target/identify_passthru.sh@54 -- # awk '{print $3}' 00:31:03.402 EAL: No free 2048 kB hugepages reported on node 1 00:31:03.402 01:32:11 -- target/identify_passthru.sh@54 -- # nvmf_serial_number=PHLJ916004901P0FGN 00:31:03.402 01:32:11 -- target/identify_passthru.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:31:03.402 01:32:11 -- target/identify_passthru.sh@61 -- # grep 'Model Number:' 00:31:03.402 01:32:11 -- target/identify_passthru.sh@61 -- # awk '{print $3}' 00:31:03.402 EAL: No free 2048 kB hugepages reported on node 1 00:31:03.402 01:32:11 -- target/identify_passthru.sh@61 -- # nvmf_model_number=INTEL 00:31:03.402 01:32:11 -- target/identify_passthru.sh@63 -- # '[' PHLJ916004901P0FGN '!=' PHLJ916004901P0FGN ']' 00:31:03.402 01:32:11 -- target/identify_passthru.sh@68 -- # '[' INTEL '!=' INTEL ']' 00:31:03.402 01:32:11 -- target/identify_passthru.sh@73 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:31:03.402 01:32:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:03.402 01:32:11 -- common/autotest_common.sh@10 -- # set +x 00:31:03.402 01:32:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:03.402 01:32:11 -- target/identify_passthru.sh@75 -- # trap - SIGINT SIGTERM EXIT 00:31:03.402 01:32:11 -- target/identify_passthru.sh@77 -- # nvmftestfini 00:31:03.402 01:32:11 -- nvmf/common.sh@476 -- # nvmfcleanup 00:31:03.402 01:32:11 -- nvmf/common.sh@116 -- # sync 00:31:03.402 01:32:11 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:31:03.402 01:32:11 -- nvmf/common.sh@119 -- # set +e 00:31:03.402 01:32:11 -- nvmf/common.sh@120 -- # for i in {1..20} 00:31:03.402 01:32:11 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:31:03.402 rmmod nvme_tcp 00:31:03.402 rmmod nvme_fabrics 00:31:03.402 rmmod nvme_keyring 00:31:03.402 01:32:11 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:31:03.402 01:32:11 -- nvmf/common.sh@123 -- # set -e 00:31:03.402 01:32:11 -- nvmf/common.sh@124 -- # return 0 00:31:03.402 01:32:11 -- nvmf/common.sh@477 -- # '[' -n 1278904 ']' 00:31:03.402 01:32:11 -- nvmf/common.sh@478 -- # killprocess 1278904 00:31:03.402 01:32:11 -- common/autotest_common.sh@936 -- # '[' -z 1278904 ']' 00:31:03.402 01:32:11 -- common/autotest_common.sh@940 -- # kill -0 1278904 00:31:03.402 01:32:11 -- common/autotest_common.sh@941 -- # uname 00:31:03.402 01:32:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:31:03.402 01:32:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1278904 00:31:03.402 01:32:11 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:31:03.402 01:32:11 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:31:03.402 01:32:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1278904' 00:31:03.402 killing process with pid 1278904 00:31:03.402 01:32:11 -- common/autotest_common.sh@955 -- # kill 1278904 00:31:03.402 [2024-11-20 01:32:11.313685] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:31:03.402 01:32:11 -- common/autotest_common.sh@960 -- # wait 1278904 00:31:04.783 01:32:12 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:31:04.783 01:32:12 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:31:04.783 01:32:12 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:31:04.783 01:32:12 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:31:04.783 01:32:12 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:31:04.783 01:32:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:04.783 01:32:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:31:04.783 01:32:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:06.692 01:32:14 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:31:06.692 00:31:06.692 real 0m17.973s 00:31:06.692 user 0m26.414s 00:31:06.692 sys 0m2.290s 00:31:06.692 01:32:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:06.692 01:32:14 -- common/autotest_common.sh@10 -- # set +x 00:31:06.692 ************************************ 00:31:06.692 END TEST nvmf_identify_passthru 00:31:06.692 ************************************ 00:31:06.951 01:32:14 -- spdk/autotest.sh@287 -- # run_test nvmf_dif /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:31:06.951 01:32:14 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:06.951 01:32:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:06.951 01:32:14 -- common/autotest_common.sh@10 -- # set +x 00:31:06.951 ************************************ 00:31:06.951 START TEST nvmf_dif 00:31:06.951 ************************************ 00:31:06.951 01:32:14 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:31:06.951 * Looking for test storage... 00:31:06.951 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:31:06.951 01:32:14 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:31:06.951 01:32:14 -- common/autotest_common.sh@1690 -- # lcov --version 00:31:06.951 01:32:14 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:31:06.951 01:32:15 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:31:06.951 01:32:15 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:31:06.951 01:32:15 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:31:06.951 01:32:15 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:31:06.951 01:32:15 -- scripts/common.sh@335 -- # IFS=.-: 00:31:06.951 01:32:15 -- scripts/common.sh@335 -- # read -ra ver1 00:31:06.951 01:32:15 -- scripts/common.sh@336 -- # IFS=.-: 00:31:06.951 01:32:15 -- scripts/common.sh@336 -- # read -ra ver2 00:31:06.951 01:32:15 -- scripts/common.sh@337 -- # local 'op=<' 00:31:06.951 01:32:15 -- scripts/common.sh@339 -- # ver1_l=2 00:31:06.951 01:32:15 -- scripts/common.sh@340 -- # ver2_l=1 00:31:06.951 01:32:15 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:31:06.951 01:32:15 -- scripts/common.sh@343 -- # case "$op" in 00:31:06.951 01:32:15 -- scripts/common.sh@344 -- # : 1 00:31:06.951 01:32:15 -- scripts/common.sh@363 -- # (( v = 0 )) 00:31:06.951 01:32:15 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:31:06.951 01:32:15 -- scripts/common.sh@364 -- # decimal 1 00:31:06.951 01:32:15 -- scripts/common.sh@352 -- # local d=1 00:31:06.951 01:32:15 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:31:06.951 01:32:15 -- scripts/common.sh@354 -- # echo 1 00:31:06.951 01:32:15 -- scripts/common.sh@364 -- # ver1[v]=1 00:31:06.951 01:32:15 -- scripts/common.sh@365 -- # decimal 2 00:31:06.951 01:32:15 -- scripts/common.sh@352 -- # local d=2 00:31:06.951 01:32:15 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:31:06.951 01:32:15 -- scripts/common.sh@354 -- # echo 2 00:31:06.951 01:32:15 -- scripts/common.sh@365 -- # ver2[v]=2 00:31:06.951 01:32:15 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:31:06.951 01:32:15 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:31:06.951 01:32:15 -- scripts/common.sh@367 -- # return 0 00:31:06.951 01:32:15 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:31:06.951 01:32:15 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:31:06.951 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:06.951 --rc genhtml_branch_coverage=1 00:31:06.951 --rc genhtml_function_coverage=1 00:31:06.951 --rc genhtml_legend=1 00:31:06.951 --rc geninfo_all_blocks=1 00:31:06.951 --rc geninfo_unexecuted_blocks=1 00:31:06.951 00:31:06.951 ' 00:31:06.951 01:32:15 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:31:06.951 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:06.951 --rc genhtml_branch_coverage=1 00:31:06.951 --rc genhtml_function_coverage=1 00:31:06.951 --rc genhtml_legend=1 00:31:06.951 --rc geninfo_all_blocks=1 00:31:06.951 --rc geninfo_unexecuted_blocks=1 00:31:06.951 00:31:06.951 ' 00:31:06.951 01:32:15 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:31:06.951 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:06.951 --rc genhtml_branch_coverage=1 00:31:06.951 --rc genhtml_function_coverage=1 00:31:06.951 --rc genhtml_legend=1 00:31:06.951 --rc geninfo_all_blocks=1 00:31:06.951 --rc geninfo_unexecuted_blocks=1 00:31:06.951 00:31:06.951 ' 00:31:06.951 01:32:15 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:31:06.951 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:06.951 --rc genhtml_branch_coverage=1 00:31:06.951 --rc genhtml_function_coverage=1 00:31:06.951 --rc genhtml_legend=1 00:31:06.951 --rc geninfo_all_blocks=1 00:31:06.951 --rc geninfo_unexecuted_blocks=1 00:31:06.951 00:31:06.951 ' 00:31:06.951 01:32:15 -- target/dif.sh@13 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:31:06.951 01:32:15 -- nvmf/common.sh@7 -- # uname -s 00:31:06.951 01:32:15 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:31:06.951 01:32:15 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:31:06.951 01:32:15 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:31:06.952 01:32:15 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:31:06.952 01:32:15 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:31:06.952 01:32:15 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:31:06.952 01:32:15 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:31:06.952 01:32:15 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:31:06.952 01:32:15 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:31:06.952 01:32:15 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:31:06.952 01:32:15 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:31:06.952 01:32:15 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:31:06.952 01:32:15 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:31:06.952 01:32:15 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:31:06.952 01:32:15 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:31:06.952 01:32:15 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:06.952 01:32:15 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:06.952 01:32:15 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:06.952 01:32:15 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:06.952 01:32:15 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:06.952 01:32:15 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:06.952 01:32:15 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:06.952 01:32:15 -- paths/export.sh@5 -- # export PATH 00:31:06.952 01:32:15 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:06.952 01:32:15 -- nvmf/common.sh@46 -- # : 0 00:31:06.952 01:32:15 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:31:06.952 01:32:15 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:31:06.952 01:32:15 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:31:06.952 01:32:15 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:31:06.952 01:32:15 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:31:06.952 01:32:15 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:31:06.952 01:32:15 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:31:06.952 01:32:15 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:31:06.952 01:32:15 -- target/dif.sh@15 -- # NULL_META=16 00:31:06.952 01:32:15 -- target/dif.sh@15 -- # NULL_BLOCK_SIZE=512 00:31:06.952 01:32:15 -- target/dif.sh@15 -- # NULL_SIZE=64 00:31:06.952 01:32:15 -- target/dif.sh@15 -- # NULL_DIF=1 00:31:06.952 01:32:15 -- target/dif.sh@135 -- # nvmftestinit 00:31:06.952 01:32:15 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:31:06.952 01:32:15 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:31:06.952 01:32:15 -- nvmf/common.sh@436 -- # prepare_net_devs 00:31:06.952 01:32:15 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:31:06.952 01:32:15 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:31:06.952 01:32:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:06.952 01:32:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:31:06.952 01:32:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:06.952 01:32:15 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:31:06.952 01:32:15 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:31:06.952 01:32:15 -- nvmf/common.sh@284 -- # xtrace_disable 00:31:06.952 01:32:15 -- common/autotest_common.sh@10 -- # set +x 00:31:08.907 01:32:17 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:31:08.907 01:32:17 -- nvmf/common.sh@290 -- # pci_devs=() 00:31:08.907 01:32:17 -- nvmf/common.sh@290 -- # local -a pci_devs 00:31:08.907 01:32:17 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:31:08.907 01:32:17 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:31:08.907 01:32:17 -- nvmf/common.sh@292 -- # pci_drivers=() 00:31:08.907 01:32:17 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:31:08.907 01:32:17 -- nvmf/common.sh@294 -- # net_devs=() 00:31:08.907 01:32:17 -- nvmf/common.sh@294 -- # local -ga net_devs 00:31:08.907 01:32:17 -- nvmf/common.sh@295 -- # e810=() 00:31:08.907 01:32:17 -- nvmf/common.sh@295 -- # local -ga e810 00:31:08.907 01:32:17 -- nvmf/common.sh@296 -- # x722=() 00:31:08.907 01:32:17 -- nvmf/common.sh@296 -- # local -ga x722 00:31:08.907 01:32:17 -- nvmf/common.sh@297 -- # mlx=() 00:31:08.907 01:32:17 -- nvmf/common.sh@297 -- # local -ga mlx 00:31:08.907 01:32:17 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:31:08.907 01:32:17 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:31:08.907 01:32:17 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:31:08.907 01:32:17 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:31:08.907 01:32:17 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:31:08.907 01:32:17 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:31:08.907 01:32:17 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:31:08.907 01:32:17 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:31:08.907 01:32:17 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:31:08.907 01:32:17 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:31:08.907 01:32:17 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:31:08.907 01:32:17 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:31:08.907 01:32:17 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:31:08.907 01:32:17 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:31:08.907 01:32:17 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:31:08.907 01:32:17 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:31:08.907 01:32:17 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:31:08.907 01:32:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:08.907 01:32:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:31:08.907 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:31:08.907 01:32:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:08.907 01:32:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:08.907 01:32:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:08.907 01:32:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:08.907 01:32:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:08.907 01:32:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:08.907 01:32:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:31:08.907 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:31:08.907 01:32:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:08.907 01:32:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:08.907 01:32:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:08.907 01:32:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:08.907 01:32:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:08.907 01:32:17 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:31:08.907 01:32:17 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:31:08.907 01:32:17 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:31:08.907 01:32:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:08.907 01:32:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:08.907 01:32:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:08.907 01:32:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:08.907 01:32:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:31:08.907 Found net devices under 0000:0a:00.0: cvl_0_0 00:31:08.907 01:32:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:08.907 01:32:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:08.907 01:32:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:08.907 01:32:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:08.907 01:32:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:08.907 01:32:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:31:08.907 Found net devices under 0000:0a:00.1: cvl_0_1 00:31:08.907 01:32:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:08.907 01:32:17 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:31:08.907 01:32:17 -- nvmf/common.sh@402 -- # is_hw=yes 00:31:08.907 01:32:17 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:31:08.907 01:32:17 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:31:08.907 01:32:17 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:31:08.907 01:32:17 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:31:08.907 01:32:17 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:31:08.907 01:32:17 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:31:08.907 01:32:17 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:31:08.907 01:32:17 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:31:08.907 01:32:17 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:31:08.907 01:32:17 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:31:08.907 01:32:17 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:31:08.907 01:32:17 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:31:08.907 01:32:17 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:31:08.907 01:32:17 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:31:08.907 01:32:17 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:31:08.907 01:32:17 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:31:08.907 01:32:17 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:31:08.907 01:32:17 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:31:08.907 01:32:17 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:31:09.167 01:32:17 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:31:09.167 01:32:17 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:31:09.167 01:32:17 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:31:09.167 01:32:17 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:31:09.167 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:31:09.168 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.258 ms 00:31:09.168 00:31:09.168 --- 10.0.0.2 ping statistics --- 00:31:09.168 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:09.168 rtt min/avg/max/mdev = 0.258/0.258/0.258/0.000 ms 00:31:09.168 01:32:17 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:31:09.168 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:31:09.168 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.081 ms 00:31:09.168 00:31:09.168 --- 10.0.0.1 ping statistics --- 00:31:09.168 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:09.168 rtt min/avg/max/mdev = 0.081/0.081/0.081/0.000 ms 00:31:09.168 01:32:17 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:31:09.168 01:32:17 -- nvmf/common.sh@410 -- # return 0 00:31:09.168 01:32:17 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:31:09.168 01:32:17 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:31:10.106 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:31:10.106 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:31:10.106 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:31:10.106 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:31:10.106 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:31:10.106 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:31:10.106 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:31:10.106 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:31:10.106 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:31:10.106 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:31:10.106 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:31:10.106 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:31:10.106 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:31:10.106 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:31:10.106 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:31:10.106 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:31:10.106 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:31:10.365 01:32:18 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:31:10.365 01:32:18 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:31:10.365 01:32:18 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:31:10.365 01:32:18 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:31:10.365 01:32:18 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:31:10.365 01:32:18 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:31:10.365 01:32:18 -- target/dif.sh@136 -- # NVMF_TRANSPORT_OPTS+=' --dif-insert-or-strip' 00:31:10.365 01:32:18 -- target/dif.sh@137 -- # nvmfappstart 00:31:10.365 01:32:18 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:31:10.365 01:32:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:10.365 01:32:18 -- common/autotest_common.sh@10 -- # set +x 00:31:10.365 01:32:18 -- nvmf/common.sh@469 -- # nvmfpid=1282232 00:31:10.365 01:32:18 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:31:10.365 01:32:18 -- nvmf/common.sh@470 -- # waitforlisten 1282232 00:31:10.365 01:32:18 -- common/autotest_common.sh@829 -- # '[' -z 1282232 ']' 00:31:10.365 01:32:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:31:10.365 01:32:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:31:10.365 01:32:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:31:10.365 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:31:10.365 01:32:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:31:10.365 01:32:18 -- common/autotest_common.sh@10 -- # set +x 00:31:10.365 [2024-11-20 01:32:18.446391] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:31:10.365 [2024-11-20 01:32:18.446460] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:31:10.365 EAL: No free 2048 kB hugepages reported on node 1 00:31:10.365 [2024-11-20 01:32:18.516574] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:31:10.623 [2024-11-20 01:32:18.599704] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:31:10.623 [2024-11-20 01:32:18.599859] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:31:10.623 [2024-11-20 01:32:18.599875] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:31:10.623 [2024-11-20 01:32:18.599895] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:31:10.623 [2024-11-20 01:32:18.599922] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:31:11.569 01:32:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:31:11.569 01:32:19 -- common/autotest_common.sh@862 -- # return 0 00:31:11.569 01:32:19 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:31:11.569 01:32:19 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:11.569 01:32:19 -- common/autotest_common.sh@10 -- # set +x 00:31:11.569 01:32:19 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:31:11.569 01:32:19 -- target/dif.sh@139 -- # create_transport 00:31:11.569 01:32:19 -- target/dif.sh@50 -- # rpc_cmd nvmf_create_transport -t tcp -o --dif-insert-or-strip 00:31:11.569 01:32:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:11.569 01:32:19 -- common/autotest_common.sh@10 -- # set +x 00:31:11.569 [2024-11-20 01:32:19.446629] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:31:11.569 01:32:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:11.569 01:32:19 -- target/dif.sh@141 -- # run_test fio_dif_1_default fio_dif_1 00:31:11.569 01:32:19 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:11.569 01:32:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:11.569 01:32:19 -- common/autotest_common.sh@10 -- # set +x 00:31:11.569 ************************************ 00:31:11.569 START TEST fio_dif_1_default 00:31:11.569 ************************************ 00:31:11.569 01:32:19 -- common/autotest_common.sh@1114 -- # fio_dif_1 00:31:11.569 01:32:19 -- target/dif.sh@86 -- # create_subsystems 0 00:31:11.569 01:32:19 -- target/dif.sh@28 -- # local sub 00:31:11.569 01:32:19 -- target/dif.sh@30 -- # for sub in "$@" 00:31:11.569 01:32:19 -- target/dif.sh@31 -- # create_subsystem 0 00:31:11.569 01:32:19 -- target/dif.sh@18 -- # local sub_id=0 00:31:11.569 01:32:19 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:31:11.569 01:32:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:11.569 01:32:19 -- common/autotest_common.sh@10 -- # set +x 00:31:11.569 bdev_null0 00:31:11.569 01:32:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:11.569 01:32:19 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:11.569 01:32:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:11.569 01:32:19 -- common/autotest_common.sh@10 -- # set +x 00:31:11.569 01:32:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:11.569 01:32:19 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:11.569 01:32:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:11.569 01:32:19 -- common/autotest_common.sh@10 -- # set +x 00:31:11.569 01:32:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:11.569 01:32:19 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:11.569 01:32:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:11.569 01:32:19 -- common/autotest_common.sh@10 -- # set +x 00:31:11.569 [2024-11-20 01:32:19.482892] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:11.569 01:32:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:11.569 01:32:19 -- target/dif.sh@87 -- # fio /dev/fd/62 00:31:11.569 01:32:19 -- target/dif.sh@87 -- # create_json_sub_conf 0 00:31:11.569 01:32:19 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:31:11.569 01:32:19 -- nvmf/common.sh@520 -- # config=() 00:31:11.569 01:32:19 -- nvmf/common.sh@520 -- # local subsystem config 00:31:11.569 01:32:19 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:11.569 01:32:19 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:11.569 01:32:19 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:11.569 { 00:31:11.569 "params": { 00:31:11.569 "name": "Nvme$subsystem", 00:31:11.569 "trtype": "$TEST_TRANSPORT", 00:31:11.569 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:11.569 "adrfam": "ipv4", 00:31:11.569 "trsvcid": "$NVMF_PORT", 00:31:11.569 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:11.569 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:11.569 "hdgst": ${hdgst:-false}, 00:31:11.569 "ddgst": ${ddgst:-false} 00:31:11.569 }, 00:31:11.569 "method": "bdev_nvme_attach_controller" 00:31:11.569 } 00:31:11.569 EOF 00:31:11.569 )") 00:31:11.569 01:32:19 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:11.569 01:32:19 -- target/dif.sh@82 -- # gen_fio_conf 00:31:11.569 01:32:19 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:11.569 01:32:19 -- target/dif.sh@54 -- # local file 00:31:11.569 01:32:19 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:11.569 01:32:19 -- target/dif.sh@56 -- # cat 00:31:11.569 01:32:19 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:11.569 01:32:19 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:11.569 01:32:19 -- common/autotest_common.sh@1330 -- # shift 00:31:11.569 01:32:19 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:11.569 01:32:19 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:11.569 01:32:19 -- nvmf/common.sh@542 -- # cat 00:31:11.569 01:32:19 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:11.569 01:32:19 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:11.569 01:32:19 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:11.569 01:32:19 -- target/dif.sh@72 -- # (( file <= files )) 00:31:11.569 01:32:19 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:11.569 01:32:19 -- nvmf/common.sh@544 -- # jq . 00:31:11.569 01:32:19 -- nvmf/common.sh@545 -- # IFS=, 00:31:11.569 01:32:19 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:11.569 "params": { 00:31:11.569 "name": "Nvme0", 00:31:11.569 "trtype": "tcp", 00:31:11.569 "traddr": "10.0.0.2", 00:31:11.569 "adrfam": "ipv4", 00:31:11.569 "trsvcid": "4420", 00:31:11.569 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:11.569 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:11.569 "hdgst": false, 00:31:11.569 "ddgst": false 00:31:11.569 }, 00:31:11.569 "method": "bdev_nvme_attach_controller" 00:31:11.569 }' 00:31:11.569 01:32:19 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:11.569 01:32:19 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:11.569 01:32:19 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:11.569 01:32:19 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:11.569 01:32:19 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:11.569 01:32:19 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:11.569 01:32:19 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:11.569 01:32:19 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:11.569 01:32:19 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:11.569 01:32:19 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:11.569 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:31:11.569 fio-3.35 00:31:11.569 Starting 1 thread 00:31:11.569 EAL: No free 2048 kB hugepages reported on node 1 00:31:12.137 [2024-11-20 01:32:20.172514] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:12.137 [2024-11-20 01:32:20.172595] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:22.110 00:31:22.110 filename0: (groupid=0, jobs=1): err= 0: pid=1282474: Wed Nov 20 01:32:30 2024 00:31:22.110 read: IOPS=97, BW=390KiB/s (399kB/s)(3904KiB/10012msec) 00:31:22.110 slat (nsec): min=4523, max=55684, avg=9387.28, stdev=2813.48 00:31:22.110 clat (usec): min=40815, max=48732, avg=41002.52, stdev=496.24 00:31:22.110 lat (usec): min=40824, max=48750, avg=41011.90, stdev=496.18 00:31:22.110 clat percentiles (usec): 00:31:22.110 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:31:22.110 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:31:22.110 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:31:22.110 | 99.00th=[41157], 99.50th=[41157], 99.90th=[48497], 99.95th=[48497], 00:31:22.110 | 99.99th=[48497] 00:31:22.110 bw ( KiB/s): min= 384, max= 416, per=99.50%, avg=388.80, stdev=11.72, samples=20 00:31:22.110 iops : min= 96, max= 104, avg=97.20, stdev= 2.93, samples=20 00:31:22.110 lat (msec) : 50=100.00% 00:31:22.110 cpu : usr=91.55%, sys=8.11%, ctx=22, majf=0, minf=258 00:31:22.110 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:22.110 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:22.110 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:22.110 issued rwts: total=976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:22.110 latency : target=0, window=0, percentile=100.00%, depth=4 00:31:22.110 00:31:22.110 Run status group 0 (all jobs): 00:31:22.110 READ: bw=390KiB/s (399kB/s), 390KiB/s-390KiB/s (399kB/s-399kB/s), io=3904KiB (3998kB), run=10012-10012msec 00:31:22.368 01:32:30 -- target/dif.sh@88 -- # destroy_subsystems 0 00:31:22.368 01:32:30 -- target/dif.sh@43 -- # local sub 00:31:22.368 01:32:30 -- target/dif.sh@45 -- # for sub in "$@" 00:31:22.368 01:32:30 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:22.368 01:32:30 -- target/dif.sh@36 -- # local sub_id=0 00:31:22.368 01:32:30 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:22.368 01:32:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:22.368 01:32:30 -- common/autotest_common.sh@10 -- # set +x 00:31:22.368 01:32:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:22.368 01:32:30 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:22.368 01:32:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:22.368 01:32:30 -- common/autotest_common.sh@10 -- # set +x 00:31:22.627 01:32:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:22.627 00:31:22.627 real 0m11.134s 00:31:22.627 user 0m10.330s 00:31:22.627 sys 0m1.080s 00:31:22.627 01:32:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:22.627 01:32:30 -- common/autotest_common.sh@10 -- # set +x 00:31:22.627 ************************************ 00:31:22.627 END TEST fio_dif_1_default 00:31:22.627 ************************************ 00:31:22.627 01:32:30 -- target/dif.sh@142 -- # run_test fio_dif_1_multi_subsystems fio_dif_1_multi_subsystems 00:31:22.627 01:32:30 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:22.627 01:32:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:22.627 01:32:30 -- common/autotest_common.sh@10 -- # set +x 00:31:22.627 ************************************ 00:31:22.627 START TEST fio_dif_1_multi_subsystems 00:31:22.627 ************************************ 00:31:22.627 01:32:30 -- common/autotest_common.sh@1114 -- # fio_dif_1_multi_subsystems 00:31:22.627 01:32:30 -- target/dif.sh@92 -- # local files=1 00:31:22.627 01:32:30 -- target/dif.sh@94 -- # create_subsystems 0 1 00:31:22.627 01:32:30 -- target/dif.sh@28 -- # local sub 00:31:22.627 01:32:30 -- target/dif.sh@30 -- # for sub in "$@" 00:31:22.627 01:32:30 -- target/dif.sh@31 -- # create_subsystem 0 00:31:22.627 01:32:30 -- target/dif.sh@18 -- # local sub_id=0 00:31:22.627 01:32:30 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:31:22.627 01:32:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:22.627 01:32:30 -- common/autotest_common.sh@10 -- # set +x 00:31:22.627 bdev_null0 00:31:22.627 01:32:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:22.627 01:32:30 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:22.627 01:32:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:22.627 01:32:30 -- common/autotest_common.sh@10 -- # set +x 00:31:22.627 01:32:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:22.627 01:32:30 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:22.627 01:32:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:22.627 01:32:30 -- common/autotest_common.sh@10 -- # set +x 00:31:22.627 01:32:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:22.627 01:32:30 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:22.627 01:32:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:22.627 01:32:30 -- common/autotest_common.sh@10 -- # set +x 00:31:22.627 [2024-11-20 01:32:30.640730] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:22.627 01:32:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:22.627 01:32:30 -- target/dif.sh@30 -- # for sub in "$@" 00:31:22.627 01:32:30 -- target/dif.sh@31 -- # create_subsystem 1 00:31:22.627 01:32:30 -- target/dif.sh@18 -- # local sub_id=1 00:31:22.627 01:32:30 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:31:22.627 01:32:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:22.627 01:32:30 -- common/autotest_common.sh@10 -- # set +x 00:31:22.627 bdev_null1 00:31:22.627 01:32:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:22.627 01:32:30 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:31:22.627 01:32:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:22.627 01:32:30 -- common/autotest_common.sh@10 -- # set +x 00:31:22.627 01:32:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:22.627 01:32:30 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:31:22.627 01:32:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:22.627 01:32:30 -- common/autotest_common.sh@10 -- # set +x 00:31:22.627 01:32:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:22.627 01:32:30 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:22.627 01:32:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:22.627 01:32:30 -- common/autotest_common.sh@10 -- # set +x 00:31:22.627 01:32:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:22.627 01:32:30 -- target/dif.sh@95 -- # fio /dev/fd/62 00:31:22.627 01:32:30 -- target/dif.sh@95 -- # create_json_sub_conf 0 1 00:31:22.627 01:32:30 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:31:22.627 01:32:30 -- nvmf/common.sh@520 -- # config=() 00:31:22.627 01:32:30 -- nvmf/common.sh@520 -- # local subsystem config 00:31:22.627 01:32:30 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:22.627 01:32:30 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:22.627 01:32:30 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:22.627 { 00:31:22.627 "params": { 00:31:22.627 "name": "Nvme$subsystem", 00:31:22.627 "trtype": "$TEST_TRANSPORT", 00:31:22.627 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:22.627 "adrfam": "ipv4", 00:31:22.627 "trsvcid": "$NVMF_PORT", 00:31:22.627 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:22.627 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:22.627 "hdgst": ${hdgst:-false}, 00:31:22.627 "ddgst": ${ddgst:-false} 00:31:22.627 }, 00:31:22.627 "method": "bdev_nvme_attach_controller" 00:31:22.627 } 00:31:22.627 EOF 00:31:22.627 )") 00:31:22.627 01:32:30 -- target/dif.sh@82 -- # gen_fio_conf 00:31:22.627 01:32:30 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:22.627 01:32:30 -- target/dif.sh@54 -- # local file 00:31:22.627 01:32:30 -- target/dif.sh@56 -- # cat 00:31:22.627 01:32:30 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:22.627 01:32:30 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:22.627 01:32:30 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:22.627 01:32:30 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:22.627 01:32:30 -- common/autotest_common.sh@1330 -- # shift 00:31:22.627 01:32:30 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:22.627 01:32:30 -- nvmf/common.sh@542 -- # cat 00:31:22.627 01:32:30 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:22.627 01:32:30 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:22.627 01:32:30 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:22.627 01:32:30 -- target/dif.sh@72 -- # (( file <= files )) 00:31:22.627 01:32:30 -- target/dif.sh@73 -- # cat 00:31:22.627 01:32:30 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:22.627 01:32:30 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:22.627 01:32:30 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:22.627 01:32:30 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:22.627 { 00:31:22.627 "params": { 00:31:22.627 "name": "Nvme$subsystem", 00:31:22.627 "trtype": "$TEST_TRANSPORT", 00:31:22.627 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:22.627 "adrfam": "ipv4", 00:31:22.627 "trsvcid": "$NVMF_PORT", 00:31:22.627 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:22.627 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:22.627 "hdgst": ${hdgst:-false}, 00:31:22.627 "ddgst": ${ddgst:-false} 00:31:22.627 }, 00:31:22.627 "method": "bdev_nvme_attach_controller" 00:31:22.627 } 00:31:22.627 EOF 00:31:22.627 )") 00:31:22.627 01:32:30 -- nvmf/common.sh@542 -- # cat 00:31:22.627 01:32:30 -- target/dif.sh@72 -- # (( file++ )) 00:31:22.627 01:32:30 -- target/dif.sh@72 -- # (( file <= files )) 00:31:22.628 01:32:30 -- nvmf/common.sh@544 -- # jq . 00:31:22.628 01:32:30 -- nvmf/common.sh@545 -- # IFS=, 00:31:22.628 01:32:30 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:22.628 "params": { 00:31:22.628 "name": "Nvme0", 00:31:22.628 "trtype": "tcp", 00:31:22.628 "traddr": "10.0.0.2", 00:31:22.628 "adrfam": "ipv4", 00:31:22.628 "trsvcid": "4420", 00:31:22.628 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:22.628 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:22.628 "hdgst": false, 00:31:22.628 "ddgst": false 00:31:22.628 }, 00:31:22.628 "method": "bdev_nvme_attach_controller" 00:31:22.628 },{ 00:31:22.628 "params": { 00:31:22.628 "name": "Nvme1", 00:31:22.628 "trtype": "tcp", 00:31:22.628 "traddr": "10.0.0.2", 00:31:22.628 "adrfam": "ipv4", 00:31:22.628 "trsvcid": "4420", 00:31:22.628 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:31:22.628 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:31:22.628 "hdgst": false, 00:31:22.628 "ddgst": false 00:31:22.628 }, 00:31:22.628 "method": "bdev_nvme_attach_controller" 00:31:22.628 }' 00:31:22.628 01:32:30 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:22.628 01:32:30 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:22.628 01:32:30 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:22.628 01:32:30 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:22.628 01:32:30 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:22.628 01:32:30 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:22.628 01:32:30 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:22.628 01:32:30 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:22.628 01:32:30 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:22.628 01:32:30 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:22.886 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:31:22.886 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:31:22.886 fio-3.35 00:31:22.886 Starting 2 threads 00:31:22.886 EAL: No free 2048 kB hugepages reported on node 1 00:31:23.455 [2024-11-20 01:32:31.547856] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:23.455 [2024-11-20 01:32:31.547934] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:35.652 00:31:35.652 filename0: (groupid=0, jobs=1): err= 0: pid=1283916: Wed Nov 20 01:32:41 2024 00:31:35.652 read: IOPS=190, BW=762KiB/s (781kB/s)(7632KiB/10013msec) 00:31:35.652 slat (nsec): min=7055, max=84455, avg=8576.11, stdev=2843.15 00:31:35.652 clat (usec): min=527, max=42380, avg=20964.75, stdev=20381.22 00:31:35.652 lat (usec): min=535, max=42390, avg=20973.33, stdev=20380.97 00:31:35.652 clat percentiles (usec): 00:31:35.652 | 1.00th=[ 578], 5.00th=[ 586], 10.00th=[ 594], 20.00th=[ 603], 00:31:35.652 | 30.00th=[ 611], 40.00th=[ 627], 50.00th=[ 5080], 60.00th=[41157], 00:31:35.652 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:31:35.652 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:31:35.652 | 99.99th=[42206] 00:31:35.652 bw ( KiB/s): min= 704, max= 768, per=50.03%, avg=761.60, stdev=19.70, samples=20 00:31:35.652 iops : min= 176, max= 192, avg=190.40, stdev= 4.92, samples=20 00:31:35.652 lat (usec) : 750=49.48%, 1000=0.16% 00:31:35.652 lat (msec) : 2=0.26%, 10=0.21%, 50=49.90% 00:31:35.652 cpu : usr=95.33%, sys=4.37%, ctx=21, majf=0, minf=200 00:31:35.652 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:35.652 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:35.653 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:35.653 issued rwts: total=1908,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:35.653 latency : target=0, window=0, percentile=100.00%, depth=4 00:31:35.653 filename1: (groupid=0, jobs=1): err= 0: pid=1283917: Wed Nov 20 01:32:41 2024 00:31:35.653 read: IOPS=190, BW=761KiB/s (779kB/s)(7632KiB/10035msec) 00:31:35.653 slat (nsec): min=6930, max=84809, avg=8592.48, stdev=2714.66 00:31:35.653 clat (usec): min=550, max=46784, avg=21010.79, stdev=20413.63 00:31:35.653 lat (usec): min=557, max=46804, avg=21019.38, stdev=20413.35 00:31:35.653 clat percentiles (usec): 00:31:35.653 | 1.00th=[ 578], 5.00th=[ 603], 10.00th=[ 627], 20.00th=[ 644], 00:31:35.653 | 30.00th=[ 652], 40.00th=[ 660], 50.00th=[ 1106], 60.00th=[41157], 00:31:35.653 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[42206], 00:31:35.653 | 99.00th=[42206], 99.50th=[42206], 99.90th=[46924], 99.95th=[46924], 00:31:35.653 | 99.99th=[46924] 00:31:35.653 bw ( KiB/s): min= 704, max= 832, per=50.03%, avg=761.60, stdev=28.62, samples=20 00:31:35.653 iops : min= 176, max= 208, avg=190.40, stdev= 7.16, samples=20 00:31:35.653 lat (usec) : 750=49.37%, 1000=0.47% 00:31:35.653 lat (msec) : 2=0.26%, 50=49.90% 00:31:35.653 cpu : usr=95.55%, sys=4.16%, ctx=25, majf=0, minf=204 00:31:35.653 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:35.653 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:35.653 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:35.653 issued rwts: total=1908,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:35.653 latency : target=0, window=0, percentile=100.00%, depth=4 00:31:35.653 00:31:35.653 Run status group 0 (all jobs): 00:31:35.653 READ: bw=1521KiB/s (1558kB/s), 761KiB/s-762KiB/s (779kB/s-781kB/s), io=14.9MiB (15.6MB), run=10013-10035msec 00:31:35.653 01:32:41 -- target/dif.sh@96 -- # destroy_subsystems 0 1 00:31:35.653 01:32:41 -- target/dif.sh@43 -- # local sub 00:31:35.653 01:32:41 -- target/dif.sh@45 -- # for sub in "$@" 00:31:35.653 01:32:41 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:35.653 01:32:41 -- target/dif.sh@36 -- # local sub_id=0 00:31:35.653 01:32:41 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:35.653 01:32:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:35.653 01:32:41 -- common/autotest_common.sh@10 -- # set +x 00:31:35.653 01:32:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:35.653 01:32:41 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:35.653 01:32:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:35.653 01:32:41 -- common/autotest_common.sh@10 -- # set +x 00:31:35.653 01:32:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:35.653 01:32:41 -- target/dif.sh@45 -- # for sub in "$@" 00:31:35.653 01:32:41 -- target/dif.sh@46 -- # destroy_subsystem 1 00:31:35.653 01:32:41 -- target/dif.sh@36 -- # local sub_id=1 00:31:35.653 01:32:41 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:31:35.653 01:32:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:35.653 01:32:41 -- common/autotest_common.sh@10 -- # set +x 00:31:35.653 01:32:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:35.653 01:32:41 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:31:35.653 01:32:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:35.653 01:32:41 -- common/autotest_common.sh@10 -- # set +x 00:31:35.653 01:32:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:35.653 00:31:35.653 real 0m11.311s 00:31:35.653 user 0m20.379s 00:31:35.653 sys 0m1.153s 00:31:35.653 01:32:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:35.653 01:32:41 -- common/autotest_common.sh@10 -- # set +x 00:31:35.653 ************************************ 00:31:35.653 END TEST fio_dif_1_multi_subsystems 00:31:35.653 ************************************ 00:31:35.653 01:32:41 -- target/dif.sh@143 -- # run_test fio_dif_rand_params fio_dif_rand_params 00:31:35.653 01:32:41 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:35.653 01:32:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:35.653 01:32:41 -- common/autotest_common.sh@10 -- # set +x 00:31:35.653 ************************************ 00:31:35.653 START TEST fio_dif_rand_params 00:31:35.653 ************************************ 00:31:35.653 01:32:41 -- common/autotest_common.sh@1114 -- # fio_dif_rand_params 00:31:35.653 01:32:41 -- target/dif.sh@100 -- # local NULL_DIF 00:31:35.653 01:32:41 -- target/dif.sh@101 -- # local bs numjobs runtime iodepth files 00:31:35.653 01:32:41 -- target/dif.sh@103 -- # NULL_DIF=3 00:31:35.653 01:32:41 -- target/dif.sh@103 -- # bs=128k 00:31:35.653 01:32:41 -- target/dif.sh@103 -- # numjobs=3 00:31:35.653 01:32:41 -- target/dif.sh@103 -- # iodepth=3 00:31:35.653 01:32:41 -- target/dif.sh@103 -- # runtime=5 00:31:35.653 01:32:41 -- target/dif.sh@105 -- # create_subsystems 0 00:31:35.653 01:32:41 -- target/dif.sh@28 -- # local sub 00:31:35.653 01:32:41 -- target/dif.sh@30 -- # for sub in "$@" 00:31:35.653 01:32:41 -- target/dif.sh@31 -- # create_subsystem 0 00:31:35.653 01:32:41 -- target/dif.sh@18 -- # local sub_id=0 00:31:35.653 01:32:41 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:31:35.653 01:32:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:35.653 01:32:41 -- common/autotest_common.sh@10 -- # set +x 00:31:35.653 bdev_null0 00:31:35.653 01:32:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:35.653 01:32:41 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:35.653 01:32:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:35.653 01:32:41 -- common/autotest_common.sh@10 -- # set +x 00:31:35.653 01:32:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:35.653 01:32:41 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:35.653 01:32:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:35.653 01:32:41 -- common/autotest_common.sh@10 -- # set +x 00:31:35.653 01:32:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:35.653 01:32:41 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:35.653 01:32:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:35.653 01:32:41 -- common/autotest_common.sh@10 -- # set +x 00:31:35.653 [2024-11-20 01:32:41.976213] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:35.653 01:32:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:35.653 01:32:41 -- target/dif.sh@106 -- # fio /dev/fd/62 00:31:35.653 01:32:41 -- target/dif.sh@106 -- # create_json_sub_conf 0 00:31:35.653 01:32:41 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:31:35.653 01:32:41 -- nvmf/common.sh@520 -- # config=() 00:31:35.653 01:32:41 -- nvmf/common.sh@520 -- # local subsystem config 00:31:35.653 01:32:41 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:35.653 01:32:41 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:35.653 01:32:41 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:35.653 { 00:31:35.653 "params": { 00:31:35.653 "name": "Nvme$subsystem", 00:31:35.653 "trtype": "$TEST_TRANSPORT", 00:31:35.653 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:35.653 "adrfam": "ipv4", 00:31:35.653 "trsvcid": "$NVMF_PORT", 00:31:35.653 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:35.653 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:35.653 "hdgst": ${hdgst:-false}, 00:31:35.653 "ddgst": ${ddgst:-false} 00:31:35.653 }, 00:31:35.653 "method": "bdev_nvme_attach_controller" 00:31:35.653 } 00:31:35.653 EOF 00:31:35.653 )") 00:31:35.653 01:32:41 -- target/dif.sh@82 -- # gen_fio_conf 00:31:35.653 01:32:41 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:35.653 01:32:41 -- target/dif.sh@54 -- # local file 00:31:35.653 01:32:41 -- target/dif.sh@56 -- # cat 00:31:35.653 01:32:41 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:35.653 01:32:41 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:35.653 01:32:41 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:35.653 01:32:41 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:35.653 01:32:41 -- common/autotest_common.sh@1330 -- # shift 00:31:35.653 01:32:41 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:35.653 01:32:41 -- nvmf/common.sh@542 -- # cat 00:31:35.653 01:32:41 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:35.653 01:32:41 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:35.653 01:32:41 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:35.653 01:32:41 -- target/dif.sh@72 -- # (( file <= files )) 00:31:35.654 01:32:41 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:35.654 01:32:41 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:35.654 01:32:41 -- nvmf/common.sh@544 -- # jq . 00:31:35.654 01:32:41 -- nvmf/common.sh@545 -- # IFS=, 00:31:35.654 01:32:41 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:35.654 "params": { 00:31:35.654 "name": "Nvme0", 00:31:35.654 "trtype": "tcp", 00:31:35.654 "traddr": "10.0.0.2", 00:31:35.654 "adrfam": "ipv4", 00:31:35.654 "trsvcid": "4420", 00:31:35.654 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:35.654 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:35.654 "hdgst": false, 00:31:35.654 "ddgst": false 00:31:35.654 }, 00:31:35.654 "method": "bdev_nvme_attach_controller" 00:31:35.654 }' 00:31:35.654 01:32:42 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:35.654 01:32:42 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:35.654 01:32:42 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:35.654 01:32:42 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:35.654 01:32:42 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:35.654 01:32:42 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:35.654 01:32:42 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:35.654 01:32:42 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:35.654 01:32:42 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:35.654 01:32:42 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:35.654 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:31:35.654 ... 00:31:35.654 fio-3.35 00:31:35.654 Starting 3 threads 00:31:35.654 EAL: No free 2048 kB hugepages reported on node 1 00:31:35.654 [2024-11-20 01:32:42.649534] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:35.654 [2024-11-20 01:32:42.649619] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:39.839 00:31:39.839 filename0: (groupid=0, jobs=1): err= 0: pid=1285350: Wed Nov 20 01:32:47 2024 00:31:39.839 read: IOPS=226, BW=28.3MiB/s (29.7MB/s)(142MiB/5003msec) 00:31:39.839 slat (nsec): min=7362, max=36946, avg=12437.61, stdev=2383.68 00:31:39.839 clat (usec): min=4740, max=91520, avg=13241.77, stdev=9422.58 00:31:39.839 lat (usec): min=4753, max=91532, avg=13254.21, stdev=9422.49 00:31:39.839 clat percentiles (usec): 00:31:39.839 | 1.00th=[ 5145], 5.00th=[ 7570], 10.00th=[ 9241], 20.00th=[10028], 00:31:39.839 | 30.00th=[10552], 40.00th=[10945], 50.00th=[11338], 60.00th=[11731], 00:31:39.839 | 70.00th=[12256], 80.00th=[12911], 90.00th=[14484], 95.00th=[16909], 00:31:39.839 | 99.00th=[53216], 99.50th=[54789], 99.90th=[91751], 99.95th=[91751], 00:31:39.839 | 99.99th=[91751] 00:31:39.839 bw ( KiB/s): min=18176, max=35840, per=33.13%, avg=28902.40, stdev=5659.67, samples=10 00:31:39.839 iops : min= 142, max= 280, avg=225.80, stdev=44.22, samples=10 00:31:39.839 lat (msec) : 10=18.82%, 20=76.41%, 50=1.33%, 100=3.45% 00:31:39.839 cpu : usr=92.06%, sys=7.48%, ctx=9, majf=0, minf=79 00:31:39.839 IO depths : 1=1.8%, 2=98.2%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:39.839 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:39.839 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:39.839 issued rwts: total=1132,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:39.839 latency : target=0, window=0, percentile=100.00%, depth=3 00:31:39.839 filename0: (groupid=0, jobs=1): err= 0: pid=1285351: Wed Nov 20 01:32:47 2024 00:31:39.839 read: IOPS=217, BW=27.1MiB/s (28.5MB/s)(136MiB/5002msec) 00:31:39.839 slat (nsec): min=7026, max=43510, avg=12546.74, stdev=2417.98 00:31:39.839 clat (usec): min=4712, max=58231, avg=13801.24, stdev=7003.76 00:31:39.839 lat (usec): min=4724, max=58244, avg=13813.79, stdev=7003.62 00:31:39.839 clat percentiles (usec): 00:31:39.840 | 1.00th=[ 6915], 5.00th=[ 7963], 10.00th=[ 8586], 20.00th=[10421], 00:31:39.840 | 30.00th=[11600], 40.00th=[12256], 50.00th=[13042], 60.00th=[13698], 00:31:39.840 | 70.00th=[14484], 80.00th=[15270], 90.00th=[16319], 95.00th=[17171], 00:31:39.840 | 99.00th=[51643], 99.50th=[53740], 99.90th=[56886], 99.95th=[58459], 00:31:39.840 | 99.99th=[58459] 00:31:39.840 bw ( KiB/s): min=20008, max=32256, per=31.79%, avg=27728.80, stdev=3663.03, samples=10 00:31:39.840 iops : min= 156, max= 252, avg=216.60, stdev=28.69, samples=10 00:31:39.840 lat (msec) : 10=18.23%, 20=78.45%, 50=1.84%, 100=1.47% 00:31:39.840 cpu : usr=92.96%, sys=6.56%, ctx=14, majf=0, minf=114 00:31:39.840 IO depths : 1=0.6%, 2=99.4%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:39.840 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:39.840 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:39.840 issued rwts: total=1086,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:39.840 latency : target=0, window=0, percentile=100.00%, depth=3 00:31:39.840 filename0: (groupid=0, jobs=1): err= 0: pid=1285352: Wed Nov 20 01:32:47 2024 00:31:39.840 read: IOPS=238, BW=29.9MiB/s (31.3MB/s)(150MiB/5011msec) 00:31:39.840 slat (usec): min=6, max=153, avg=12.67, stdev= 4.70 00:31:39.840 clat (usec): min=5030, max=54949, avg=12539.31, stdev=5558.54 00:31:39.840 lat (usec): min=5038, max=54961, avg=12551.99, stdev=5558.65 00:31:39.840 clat percentiles (usec): 00:31:39.840 | 1.00th=[ 5276], 5.00th=[ 6652], 10.00th=[ 8356], 20.00th=[ 9634], 00:31:39.840 | 30.00th=[11076], 40.00th=[11600], 50.00th=[12125], 60.00th=[12780], 00:31:39.840 | 70.00th=[13435], 80.00th=[14353], 90.00th=[15270], 95.00th=[16057], 00:31:39.840 | 99.00th=[47973], 99.50th=[50594], 99.90th=[54789], 99.95th=[54789], 00:31:39.840 | 99.99th=[54789] 00:31:39.840 bw ( KiB/s): min=24064, max=34048, per=35.05%, avg=30572.70, stdev=3100.58, samples=10 00:31:39.840 iops : min= 188, max= 266, avg=238.80, stdev=24.21, samples=10 00:31:39.840 lat (msec) : 10=21.64%, 20=76.36%, 50=1.34%, 100=0.67% 00:31:39.840 cpu : usr=92.83%, sys=6.67%, ctx=14, majf=0, minf=171 00:31:39.840 IO depths : 1=0.2%, 2=99.8%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:39.840 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:39.840 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:39.840 issued rwts: total=1197,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:39.840 latency : target=0, window=0, percentile=100.00%, depth=3 00:31:39.840 00:31:39.840 Run status group 0 (all jobs): 00:31:39.840 READ: bw=85.2MiB/s (89.3MB/s), 27.1MiB/s-29.9MiB/s (28.5MB/s-31.3MB/s), io=427MiB (448MB), run=5002-5011msec 00:31:39.840 01:32:47 -- target/dif.sh@107 -- # destroy_subsystems 0 00:31:39.840 01:32:47 -- target/dif.sh@43 -- # local sub 00:31:39.840 01:32:47 -- target/dif.sh@45 -- # for sub in "$@" 00:31:39.840 01:32:47 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:39.840 01:32:47 -- target/dif.sh@36 -- # local sub_id=0 00:31:39.840 01:32:47 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:39.840 01:32:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:39.840 01:32:47 -- common/autotest_common.sh@10 -- # set +x 00:31:39.840 01:32:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:39.840 01:32:47 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:39.840 01:32:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:39.840 01:32:47 -- common/autotest_common.sh@10 -- # set +x 00:31:39.840 01:32:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:39.840 01:32:47 -- target/dif.sh@109 -- # NULL_DIF=2 00:31:39.840 01:32:47 -- target/dif.sh@109 -- # bs=4k 00:31:39.840 01:32:47 -- target/dif.sh@109 -- # numjobs=8 00:31:39.840 01:32:47 -- target/dif.sh@109 -- # iodepth=16 00:31:39.840 01:32:47 -- target/dif.sh@109 -- # runtime= 00:31:39.840 01:32:47 -- target/dif.sh@109 -- # files=2 00:31:39.840 01:32:47 -- target/dif.sh@111 -- # create_subsystems 0 1 2 00:31:39.840 01:32:47 -- target/dif.sh@28 -- # local sub 00:31:39.840 01:32:47 -- target/dif.sh@30 -- # for sub in "$@" 00:31:39.840 01:32:47 -- target/dif.sh@31 -- # create_subsystem 0 00:31:39.840 01:32:47 -- target/dif.sh@18 -- # local sub_id=0 00:31:39.840 01:32:47 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 2 00:31:39.840 01:32:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:39.840 01:32:47 -- common/autotest_common.sh@10 -- # set +x 00:31:39.840 bdev_null0 00:31:39.840 01:32:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:39.840 01:32:47 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:39.840 01:32:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:39.840 01:32:47 -- common/autotest_common.sh@10 -- # set +x 00:31:39.840 01:32:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:39.840 01:32:48 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:39.840 01:32:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:39.840 01:32:48 -- common/autotest_common.sh@10 -- # set +x 00:31:39.840 01:32:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:39.840 01:32:48 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:39.840 01:32:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:39.840 01:32:48 -- common/autotest_common.sh@10 -- # set +x 00:31:39.840 [2024-11-20 01:32:48.018615] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:39.840 01:32:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:39.840 01:32:48 -- target/dif.sh@30 -- # for sub in "$@" 00:31:39.840 01:32:48 -- target/dif.sh@31 -- # create_subsystem 1 00:31:39.840 01:32:48 -- target/dif.sh@18 -- # local sub_id=1 00:31:39.840 01:32:48 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 2 00:31:39.840 01:32:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:39.840 01:32:48 -- common/autotest_common.sh@10 -- # set +x 00:31:39.840 bdev_null1 00:31:39.840 01:32:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:39.840 01:32:48 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:31:39.840 01:32:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:39.840 01:32:48 -- common/autotest_common.sh@10 -- # set +x 00:31:39.840 01:32:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:39.840 01:32:48 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:31:39.840 01:32:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:39.840 01:32:48 -- common/autotest_common.sh@10 -- # set +x 00:31:39.840 01:32:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:39.840 01:32:48 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:39.840 01:32:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:39.840 01:32:48 -- common/autotest_common.sh@10 -- # set +x 00:31:39.840 01:32:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:39.840 01:32:48 -- target/dif.sh@30 -- # for sub in "$@" 00:31:39.840 01:32:48 -- target/dif.sh@31 -- # create_subsystem 2 00:31:39.840 01:32:48 -- target/dif.sh@18 -- # local sub_id=2 00:31:39.840 01:32:48 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null2 64 512 --md-size 16 --dif-type 2 00:31:39.840 01:32:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:39.840 01:32:48 -- common/autotest_common.sh@10 -- # set +x 00:31:40.099 bdev_null2 00:31:40.099 01:32:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:40.099 01:32:48 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 --serial-number 53313233-2 --allow-any-host 00:31:40.099 01:32:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:40.099 01:32:48 -- common/autotest_common.sh@10 -- # set +x 00:31:40.099 01:32:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:40.099 01:32:48 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 bdev_null2 00:31:40.099 01:32:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:40.099 01:32:48 -- common/autotest_common.sh@10 -- # set +x 00:31:40.099 01:32:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:40.099 01:32:48 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:31:40.099 01:32:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:40.099 01:32:48 -- common/autotest_common.sh@10 -- # set +x 00:31:40.099 01:32:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:40.099 01:32:48 -- target/dif.sh@112 -- # fio /dev/fd/62 00:31:40.099 01:32:48 -- target/dif.sh@112 -- # create_json_sub_conf 0 1 2 00:31:40.099 01:32:48 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:40.099 01:32:48 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 2 00:31:40.099 01:32:48 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:40.099 01:32:48 -- target/dif.sh@82 -- # gen_fio_conf 00:31:40.099 01:32:48 -- nvmf/common.sh@520 -- # config=() 00:31:40.099 01:32:48 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:40.099 01:32:48 -- nvmf/common.sh@520 -- # local subsystem config 00:31:40.099 01:32:48 -- target/dif.sh@54 -- # local file 00:31:40.099 01:32:48 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:40.099 01:32:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:40.099 01:32:48 -- target/dif.sh@56 -- # cat 00:31:40.099 01:32:48 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:40.099 01:32:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:40.099 { 00:31:40.099 "params": { 00:31:40.099 "name": "Nvme$subsystem", 00:31:40.099 "trtype": "$TEST_TRANSPORT", 00:31:40.099 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:40.099 "adrfam": "ipv4", 00:31:40.099 "trsvcid": "$NVMF_PORT", 00:31:40.099 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:40.099 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:40.099 "hdgst": ${hdgst:-false}, 00:31:40.099 "ddgst": ${ddgst:-false} 00:31:40.099 }, 00:31:40.099 "method": "bdev_nvme_attach_controller" 00:31:40.099 } 00:31:40.099 EOF 00:31:40.099 )") 00:31:40.099 01:32:48 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:40.099 01:32:48 -- common/autotest_common.sh@1330 -- # shift 00:31:40.099 01:32:48 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:40.099 01:32:48 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:40.099 01:32:48 -- nvmf/common.sh@542 -- # cat 00:31:40.099 01:32:48 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:40.099 01:32:48 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:40.099 01:32:48 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:40.099 01:32:48 -- target/dif.sh@72 -- # (( file <= files )) 00:31:40.099 01:32:48 -- target/dif.sh@73 -- # cat 00:31:40.099 01:32:48 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:40.099 01:32:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:40.099 01:32:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:40.099 { 00:31:40.099 "params": { 00:31:40.099 "name": "Nvme$subsystem", 00:31:40.099 "trtype": "$TEST_TRANSPORT", 00:31:40.099 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:40.099 "adrfam": "ipv4", 00:31:40.099 "trsvcid": "$NVMF_PORT", 00:31:40.099 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:40.099 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:40.099 "hdgst": ${hdgst:-false}, 00:31:40.099 "ddgst": ${ddgst:-false} 00:31:40.099 }, 00:31:40.099 "method": "bdev_nvme_attach_controller" 00:31:40.099 } 00:31:40.099 EOF 00:31:40.099 )") 00:31:40.099 01:32:48 -- target/dif.sh@72 -- # (( file++ )) 00:31:40.099 01:32:48 -- target/dif.sh@72 -- # (( file <= files )) 00:31:40.099 01:32:48 -- target/dif.sh@73 -- # cat 00:31:40.099 01:32:48 -- nvmf/common.sh@542 -- # cat 00:31:40.099 01:32:48 -- target/dif.sh@72 -- # (( file++ )) 00:31:40.099 01:32:48 -- target/dif.sh@72 -- # (( file <= files )) 00:31:40.099 01:32:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:40.099 01:32:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:40.099 { 00:31:40.099 "params": { 00:31:40.099 "name": "Nvme$subsystem", 00:31:40.099 "trtype": "$TEST_TRANSPORT", 00:31:40.099 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:40.099 "adrfam": "ipv4", 00:31:40.099 "trsvcid": "$NVMF_PORT", 00:31:40.099 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:40.099 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:40.099 "hdgst": ${hdgst:-false}, 00:31:40.099 "ddgst": ${ddgst:-false} 00:31:40.099 }, 00:31:40.099 "method": "bdev_nvme_attach_controller" 00:31:40.099 } 00:31:40.099 EOF 00:31:40.099 )") 00:31:40.099 01:32:48 -- nvmf/common.sh@542 -- # cat 00:31:40.099 01:32:48 -- nvmf/common.sh@544 -- # jq . 00:31:40.099 01:32:48 -- nvmf/common.sh@545 -- # IFS=, 00:31:40.099 01:32:48 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:40.099 "params": { 00:31:40.099 "name": "Nvme0", 00:31:40.099 "trtype": "tcp", 00:31:40.099 "traddr": "10.0.0.2", 00:31:40.099 "adrfam": "ipv4", 00:31:40.099 "trsvcid": "4420", 00:31:40.099 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:40.099 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:40.099 "hdgst": false, 00:31:40.099 "ddgst": false 00:31:40.099 }, 00:31:40.099 "method": "bdev_nvme_attach_controller" 00:31:40.099 },{ 00:31:40.099 "params": { 00:31:40.099 "name": "Nvme1", 00:31:40.099 "trtype": "tcp", 00:31:40.100 "traddr": "10.0.0.2", 00:31:40.100 "adrfam": "ipv4", 00:31:40.100 "trsvcid": "4420", 00:31:40.100 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:31:40.100 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:31:40.100 "hdgst": false, 00:31:40.100 "ddgst": false 00:31:40.100 }, 00:31:40.100 "method": "bdev_nvme_attach_controller" 00:31:40.100 },{ 00:31:40.100 "params": { 00:31:40.100 "name": "Nvme2", 00:31:40.100 "trtype": "tcp", 00:31:40.100 "traddr": "10.0.0.2", 00:31:40.100 "adrfam": "ipv4", 00:31:40.100 "trsvcid": "4420", 00:31:40.100 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:31:40.100 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:31:40.100 "hdgst": false, 00:31:40.100 "ddgst": false 00:31:40.100 }, 00:31:40.100 "method": "bdev_nvme_attach_controller" 00:31:40.100 }' 00:31:40.100 01:32:48 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:40.100 01:32:48 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:40.100 01:32:48 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:40.100 01:32:48 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:40.100 01:32:48 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:40.100 01:32:48 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:40.100 01:32:48 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:40.100 01:32:48 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:40.100 01:32:48 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:40.100 01:32:48 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:40.358 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:31:40.358 ... 00:31:40.358 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:31:40.358 ... 00:31:40.358 filename2: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:31:40.358 ... 00:31:40.358 fio-3.35 00:31:40.358 Starting 24 threads 00:31:40.358 EAL: No free 2048 kB hugepages reported on node 1 00:31:40.924 [2024-11-20 01:32:49.116610] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:40.924 [2024-11-20 01:32:49.116670] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:53.138 00:31:53.138 filename0: (groupid=0, jobs=1): err= 0: pid=1286244: Wed Nov 20 01:32:59 2024 00:31:53.138 read: IOPS=497, BW=1988KiB/s (2036kB/s)(19.4MiB/10011msec) 00:31:53.138 slat (usec): min=9, max=102, avg=43.51, stdev=14.24 00:31:53.138 clat (usec): min=14340, max=65228, avg=31799.56, stdev=2230.23 00:31:53.138 lat (usec): min=14363, max=65256, avg=31843.07, stdev=2229.84 00:31:53.138 clat percentiles (usec): 00:31:53.138 | 1.00th=[30540], 5.00th=[30802], 10.00th=[31065], 20.00th=[31327], 00:31:53.138 | 30.00th=[31327], 40.00th=[31589], 50.00th=[31589], 60.00th=[31851], 00:31:53.138 | 70.00th=[31851], 80.00th=[32113], 90.00th=[32375], 95.00th=[32900], 00:31:53.138 | 99.00th=[34866], 99.50th=[35390], 99.90th=[65274], 99.95th=[65274], 00:31:53.138 | 99.99th=[65274] 00:31:53.138 bw ( KiB/s): min= 1792, max= 2048, per=4.15%, avg=1980.63, stdev=78.31, samples=19 00:31:53.138 iops : min= 448, max= 512, avg=495.16, stdev=19.58, samples=19 00:31:53.138 lat (msec) : 20=0.32%, 50=99.36%, 100=0.32% 00:31:53.138 cpu : usr=96.92%, sys=1.75%, ctx=186, majf=0, minf=51 00:31:53.138 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:31:53.138 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.138 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.138 issued rwts: total=4976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:53.138 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:53.138 filename0: (groupid=0, jobs=1): err= 0: pid=1286245: Wed Nov 20 01:32:59 2024 00:31:53.138 read: IOPS=497, BW=1989KiB/s (2037kB/s)(19.4MiB/10007msec) 00:31:53.138 slat (usec): min=8, max=132, avg=50.59, stdev=23.88 00:31:53.138 clat (usec): min=28033, max=40208, avg=31758.48, stdev=847.68 00:31:53.138 lat (usec): min=28078, max=40236, avg=31809.07, stdev=845.60 00:31:53.138 clat percentiles (usec): 00:31:53.138 | 1.00th=[30540], 5.00th=[30802], 10.00th=[31065], 20.00th=[31327], 00:31:53.138 | 30.00th=[31327], 40.00th=[31589], 50.00th=[31589], 60.00th=[31851], 00:31:53.138 | 70.00th=[31851], 80.00th=[32113], 90.00th=[32375], 95.00th=[32900], 00:31:53.138 | 99.00th=[34866], 99.50th=[35390], 99.90th=[40109], 99.95th=[40109], 00:31:53.138 | 99.99th=[40109] 00:31:53.138 bw ( KiB/s): min= 1920, max= 2048, per=4.17%, avg=1987.37, stdev=65.66, samples=19 00:31:53.138 iops : min= 480, max= 512, avg=496.84, stdev=16.42, samples=19 00:31:53.138 lat (msec) : 50=100.00% 00:31:53.138 cpu : usr=98.50%, sys=1.06%, ctx=23, majf=0, minf=49 00:31:53.138 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:31:53.138 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.138 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.138 issued rwts: total=4976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:53.138 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:53.139 filename0: (groupid=0, jobs=1): err= 0: pid=1286246: Wed Nov 20 01:32:59 2024 00:31:53.139 read: IOPS=497, BW=1989KiB/s (2037kB/s)(19.4MiB/10006msec) 00:31:53.139 slat (usec): min=8, max=145, avg=46.66, stdev=24.05 00:31:53.139 clat (usec): min=28919, max=40177, avg=31798.41, stdev=855.18 00:31:53.139 lat (usec): min=28956, max=40195, avg=31845.07, stdev=851.60 00:31:53.139 clat percentiles (usec): 00:31:53.139 | 1.00th=[30540], 5.00th=[30802], 10.00th=[31065], 20.00th=[31327], 00:31:53.139 | 30.00th=[31327], 40.00th=[31589], 50.00th=[31851], 60.00th=[31851], 00:31:53.139 | 70.00th=[31851], 80.00th=[32113], 90.00th=[32375], 95.00th=[32900], 00:31:53.139 | 99.00th=[34866], 99.50th=[35390], 99.90th=[40109], 99.95th=[40109], 00:31:53.139 | 99.99th=[40109] 00:31:53.139 bw ( KiB/s): min= 1920, max= 2048, per=4.17%, avg=1987.37, stdev=65.66, samples=19 00:31:53.139 iops : min= 480, max= 512, avg=496.84, stdev=16.42, samples=19 00:31:53.139 lat (msec) : 50=100.00% 00:31:53.139 cpu : usr=98.72%, sys=0.84%, ctx=10, majf=0, minf=53 00:31:53.139 IO depths : 1=6.2%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.3%, 32=0.0%, >=64=0.0% 00:31:53.139 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.139 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.139 issued rwts: total=4976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:53.139 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:53.139 filename0: (groupid=0, jobs=1): err= 0: pid=1286247: Wed Nov 20 01:32:59 2024 00:31:53.139 read: IOPS=499, BW=1998KiB/s (2046kB/s)(19.6MiB/10026msec) 00:31:53.139 slat (nsec): min=8162, max=80987, avg=26797.34, stdev=10556.30 00:31:53.139 clat (usec): min=8957, max=37315, avg=31809.95, stdev=1793.12 00:31:53.139 lat (usec): min=8973, max=37356, avg=31836.75, stdev=1793.57 00:31:53.139 clat percentiles (usec): 00:31:53.139 | 1.00th=[29754], 5.00th=[31065], 10.00th=[31327], 20.00th=[31589], 00:31:53.139 | 30.00th=[31589], 40.00th=[31851], 50.00th=[31851], 60.00th=[31851], 00:31:53.139 | 70.00th=[32113], 80.00th=[32113], 90.00th=[32375], 95.00th=[33162], 00:31:53.139 | 99.00th=[34866], 99.50th=[35390], 99.90th=[36963], 99.95th=[37487], 00:31:53.139 | 99.99th=[37487] 00:31:53.139 bw ( KiB/s): min= 1920, max= 2048, per=4.19%, avg=1996.80, stdev=64.34, samples=20 00:31:53.139 iops : min= 480, max= 512, avg=499.20, stdev=16.08, samples=20 00:31:53.139 lat (msec) : 10=0.32%, 20=0.32%, 50=99.36% 00:31:53.139 cpu : usr=98.65%, sys=0.95%, ctx=20, majf=0, minf=72 00:31:53.139 IO depths : 1=6.0%, 2=12.2%, 4=24.9%, 8=50.4%, 16=6.5%, 32=0.0%, >=64=0.0% 00:31:53.139 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.139 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.139 issued rwts: total=5008,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:53.139 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:53.139 filename0: (groupid=0, jobs=1): err= 0: pid=1286248: Wed Nov 20 01:32:59 2024 00:31:53.139 read: IOPS=497, BW=1990KiB/s (2037kB/s)(19.4MiB/10004msec) 00:31:53.139 slat (usec): min=10, max=206, avg=49.93, stdev=31.41 00:31:53.139 clat (usec): min=14140, max=56575, avg=31642.68, stdev=1839.86 00:31:53.139 lat (usec): min=14174, max=56611, avg=31692.61, stdev=1841.01 00:31:53.139 clat percentiles (usec): 00:31:53.139 | 1.00th=[30278], 5.00th=[30802], 10.00th=[31065], 20.00th=[31327], 00:31:53.139 | 30.00th=[31327], 40.00th=[31327], 50.00th=[31589], 60.00th=[31589], 00:31:53.139 | 70.00th=[31851], 80.00th=[31851], 90.00th=[32113], 95.00th=[32637], 00:31:53.139 | 99.00th=[34866], 99.50th=[35914], 99.90th=[56361], 99.95th=[56361], 00:31:53.139 | 99.99th=[56361] 00:31:53.139 bw ( KiB/s): min= 1792, max= 2048, per=4.15%, avg=1980.79, stdev=88.83, samples=19 00:31:53.139 iops : min= 448, max= 512, avg=495.16, stdev=22.29, samples=19 00:31:53.139 lat (msec) : 20=0.32%, 50=99.36%, 100=0.32% 00:31:53.139 cpu : usr=98.49%, sys=1.05%, ctx=12, majf=0, minf=40 00:31:53.139 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:31:53.139 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.139 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.139 issued rwts: total=4976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:53.139 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:53.139 filename0: (groupid=0, jobs=1): err= 0: pid=1286249: Wed Nov 20 01:32:59 2024 00:31:53.139 read: IOPS=500, BW=2003KiB/s (2051kB/s)(19.6MiB/10031msec) 00:31:53.139 slat (nsec): min=8008, max=75534, avg=24187.27, stdev=10892.26 00:31:53.139 clat (usec): min=8078, max=52827, avg=31674.13, stdev=2451.79 00:31:53.139 lat (usec): min=8094, max=52835, avg=31698.32, stdev=2452.51 00:31:53.139 clat percentiles (usec): 00:31:53.139 | 1.00th=[15270], 5.00th=[31065], 10.00th=[31327], 20.00th=[31589], 00:31:53.139 | 30.00th=[31589], 40.00th=[31851], 50.00th=[31851], 60.00th=[31851], 00:31:53.139 | 70.00th=[32113], 80.00th=[32113], 90.00th=[32375], 95.00th=[32900], 00:31:53.139 | 99.00th=[34341], 99.50th=[35390], 99.90th=[49546], 99.95th=[50594], 00:31:53.139 | 99.99th=[52691] 00:31:53.139 bw ( KiB/s): min= 1920, max= 2176, per=4.21%, avg=2007.75, stdev=72.56, samples=20 00:31:53.139 iops : min= 480, max= 544, avg=501.90, stdev=18.14, samples=20 00:31:53.139 lat (msec) : 10=0.32%, 20=0.80%, 50=98.81%, 100=0.08% 00:31:53.139 cpu : usr=95.31%, sys=2.36%, ctx=312, majf=0, minf=65 00:31:53.139 IO depths : 1=5.7%, 2=12.0%, 4=25.0%, 8=50.5%, 16=6.8%, 32=0.0%, >=64=0.0% 00:31:53.139 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.139 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.139 issued rwts: total=5024,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:53.139 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:53.139 filename0: (groupid=0, jobs=1): err= 0: pid=1286250: Wed Nov 20 01:32:59 2024 00:31:53.139 read: IOPS=497, BW=1989KiB/s (2037kB/s)(19.4MiB/10007msec) 00:31:53.139 slat (usec): min=6, max=117, avg=42.25, stdev=13.36 00:31:53.139 clat (usec): min=13914, max=60623, avg=31780.94, stdev=2025.16 00:31:53.139 lat (usec): min=13947, max=60638, avg=31823.19, stdev=2024.92 00:31:53.139 clat percentiles (usec): 00:31:53.139 | 1.00th=[30802], 5.00th=[31065], 10.00th=[31065], 20.00th=[31327], 00:31:53.139 | 30.00th=[31327], 40.00th=[31589], 50.00th=[31589], 60.00th=[31851], 00:31:53.139 | 70.00th=[31851], 80.00th=[32113], 90.00th=[32375], 95.00th=[32637], 00:31:53.139 | 99.00th=[34866], 99.50th=[35390], 99.90th=[60556], 99.95th=[60556], 00:31:53.139 | 99.99th=[60556] 00:31:53.139 bw ( KiB/s): min= 1792, max= 2048, per=4.15%, avg=1980.63, stdev=78.31, samples=19 00:31:53.139 iops : min= 448, max= 512, avg=495.16, stdev=19.58, samples=19 00:31:53.139 lat (msec) : 20=0.32%, 50=99.36%, 100=0.32% 00:31:53.139 cpu : usr=97.39%, sys=1.49%, ctx=105, majf=0, minf=49 00:31:53.139 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:31:53.139 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.139 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.139 issued rwts: total=4976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:53.139 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:53.139 filename0: (groupid=0, jobs=1): err= 0: pid=1286251: Wed Nov 20 01:32:59 2024 00:31:53.139 read: IOPS=497, BW=1989KiB/s (2037kB/s)(19.4MiB/10005msec) 00:31:53.139 slat (usec): min=8, max=148, avg=42.73, stdev=15.51 00:31:53.139 clat (usec): min=14333, max=57417, avg=31770.76, stdev=2087.14 00:31:53.139 lat (usec): min=14366, max=57434, avg=31813.48, stdev=2087.52 00:31:53.139 clat percentiles (usec): 00:31:53.139 | 1.00th=[30540], 5.00th=[31065], 10.00th=[31065], 20.00th=[31327], 00:31:53.139 | 30.00th=[31327], 40.00th=[31589], 50.00th=[31589], 60.00th=[31851], 00:31:53.139 | 70.00th=[31851], 80.00th=[32113], 90.00th=[32375], 95.00th=[32637], 00:31:53.139 | 99.00th=[35390], 99.50th=[42730], 99.90th=[57410], 99.95th=[57410], 00:31:53.139 | 99.99th=[57410] 00:31:53.139 bw ( KiB/s): min= 1792, max= 2048, per=4.15%, avg=1980.63, stdev=89.18, samples=19 00:31:53.139 iops : min= 448, max= 512, avg=495.16, stdev=22.29, samples=19 00:31:53.139 lat (msec) : 20=0.32%, 50=99.32%, 100=0.36% 00:31:53.139 cpu : usr=98.81%, sys=0.75%, ctx=10, majf=0, minf=34 00:31:53.139 IO depths : 1=5.7%, 2=12.0%, 4=24.8%, 8=50.7%, 16=6.8%, 32=0.0%, >=64=0.0% 00:31:53.139 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.139 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.139 issued rwts: total=4976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:53.139 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:53.139 filename1: (groupid=0, jobs=1): err= 0: pid=1286252: Wed Nov 20 01:32:59 2024 00:31:53.139 read: IOPS=499, BW=1998KiB/s (2046kB/s)(19.6MiB/10044msec) 00:31:53.139 slat (usec): min=8, max=100, avg=36.45, stdev=14.41 00:31:53.139 clat (usec): min=8547, max=57210, avg=31668.12, stdev=3246.88 00:31:53.139 lat (usec): min=8563, max=57260, avg=31704.57, stdev=3248.86 00:31:53.139 clat percentiles (usec): 00:31:53.139 | 1.00th=[21103], 5.00th=[30278], 10.00th=[31065], 20.00th=[31327], 00:31:53.139 | 30.00th=[31589], 40.00th=[31589], 50.00th=[31589], 60.00th=[31851], 00:31:53.139 | 70.00th=[31851], 80.00th=[32113], 90.00th=[32375], 95.00th=[33817], 00:31:53.139 | 99.00th=[42206], 99.50th=[52167], 99.90th=[56886], 99.95th=[57410], 00:31:53.139 | 99.99th=[57410] 00:31:53.139 bw ( KiB/s): min= 1792, max= 2208, per=4.19%, avg=1996.79, stdev=102.06, samples=19 00:31:53.139 iops : min= 448, max= 552, avg=499.16, stdev=25.60, samples=19 00:31:53.139 lat (msec) : 10=0.16%, 20=0.80%, 50=98.33%, 100=0.72% 00:31:53.139 cpu : usr=98.33%, sys=1.07%, ctx=94, majf=0, minf=73 00:31:53.139 IO depths : 1=5.2%, 2=10.6%, 4=21.7%, 8=54.8%, 16=7.7%, 32=0.0%, >=64=0.0% 00:31:53.139 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.139 complete : 0=0.0%, 4=93.3%, 8=1.4%, 16=5.3%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.139 issued rwts: total=5018,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:53.139 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:53.139 filename1: (groupid=0, jobs=1): err= 0: pid=1286253: Wed Nov 20 01:32:59 2024 00:31:53.139 read: IOPS=495, BW=1983KiB/s (2030kB/s)(19.4MiB/10006msec) 00:31:53.139 slat (usec): min=5, max=208, avg=50.60, stdev=31.74 00:31:53.139 clat (usec): min=19489, max=70544, avg=31779.12, stdev=2435.59 00:31:53.139 lat (usec): min=19499, max=70557, avg=31829.71, stdev=2434.75 00:31:53.139 clat percentiles (usec): 00:31:53.139 | 1.00th=[30278], 5.00th=[30802], 10.00th=[31065], 20.00th=[31327], 00:31:53.139 | 30.00th=[31327], 40.00th=[31589], 50.00th=[31589], 60.00th=[31589], 00:31:53.139 | 70.00th=[31851], 80.00th=[31851], 90.00th=[32375], 95.00th=[32637], 00:31:53.140 | 99.00th=[34866], 99.50th=[41157], 99.90th=[70779], 99.95th=[70779], 00:31:53.140 | 99.99th=[70779] 00:31:53.140 bw ( KiB/s): min= 1792, max= 2048, per=4.15%, avg=1980.63, stdev=77.03, samples=19 00:31:53.140 iops : min= 448, max= 512, avg=495.16, stdev=19.26, samples=19 00:31:53.140 lat (msec) : 20=0.04%, 50=99.64%, 100=0.32% 00:31:53.140 cpu : usr=98.51%, sys=1.03%, ctx=12, majf=0, minf=48 00:31:53.140 IO depths : 1=5.0%, 2=11.2%, 4=25.0%, 8=51.3%, 16=7.5%, 32=0.0%, >=64=0.0% 00:31:53.140 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.140 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.140 issued rwts: total=4960,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:53.140 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:53.140 filename1: (groupid=0, jobs=1): err= 0: pid=1286254: Wed Nov 20 01:32:59 2024 00:31:53.140 read: IOPS=500, BW=2000KiB/s (2048kB/s)(19.6MiB/10026msec) 00:31:53.140 slat (nsec): min=6587, max=94459, avg=25557.74, stdev=16698.73 00:31:53.140 clat (usec): min=8675, max=57209, avg=31788.65, stdev=2356.53 00:31:53.140 lat (usec): min=8702, max=57217, avg=31814.21, stdev=2356.74 00:31:53.140 clat percentiles (usec): 00:31:53.140 | 1.00th=[26084], 5.00th=[31065], 10.00th=[31327], 20.00th=[31589], 00:31:53.140 | 30.00th=[31589], 40.00th=[31851], 50.00th=[31851], 60.00th=[31851], 00:31:53.140 | 70.00th=[32113], 80.00th=[32113], 90.00th=[32375], 95.00th=[32900], 00:31:53.140 | 99.00th=[34866], 99.50th=[36439], 99.90th=[57410], 99.95th=[57410], 00:31:53.140 | 99.99th=[57410] 00:31:53.140 bw ( KiB/s): min= 1920, max= 2176, per=4.19%, avg=1999.20, stdev=74.05, samples=20 00:31:53.140 iops : min= 480, max= 544, avg=499.80, stdev=18.51, samples=20 00:31:53.140 lat (msec) : 10=0.32%, 20=0.64%, 50=98.84%, 100=0.20% 00:31:53.140 cpu : usr=97.30%, sys=1.49%, ctx=146, majf=0, minf=36 00:31:53.140 IO depths : 1=4.8%, 2=11.0%, 4=24.9%, 8=51.5%, 16=7.7%, 32=0.0%, >=64=0.0% 00:31:53.140 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.140 complete : 0=0.0%, 4=94.2%, 8=0.1%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.140 issued rwts: total=5014,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:53.140 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:53.140 filename1: (groupid=0, jobs=1): err= 0: pid=1286255: Wed Nov 20 01:32:59 2024 00:31:53.140 read: IOPS=497, BW=1989KiB/s (2037kB/s)(19.4MiB/10007msec) 00:31:53.140 slat (usec): min=9, max=146, avg=50.03, stdev=22.40 00:31:53.140 clat (usec): min=27873, max=40229, avg=31737.63, stdev=849.53 00:31:53.140 lat (usec): min=27901, max=40251, avg=31787.66, stdev=849.31 00:31:53.140 clat percentiles (usec): 00:31:53.140 | 1.00th=[30540], 5.00th=[30802], 10.00th=[31065], 20.00th=[31327], 00:31:53.140 | 30.00th=[31327], 40.00th=[31589], 50.00th=[31589], 60.00th=[31851], 00:31:53.140 | 70.00th=[31851], 80.00th=[32113], 90.00th=[32375], 95.00th=[32637], 00:31:53.140 | 99.00th=[34866], 99.50th=[35914], 99.90th=[40109], 99.95th=[40109], 00:31:53.140 | 99.99th=[40109] 00:31:53.140 bw ( KiB/s): min= 1920, max= 2048, per=4.17%, avg=1987.37, stdev=65.66, samples=19 00:31:53.140 iops : min= 480, max= 512, avg=496.84, stdev=16.42, samples=19 00:31:53.140 lat (msec) : 50=100.00% 00:31:53.140 cpu : usr=98.46%, sys=1.09%, ctx=19, majf=0, minf=42 00:31:53.140 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:31:53.140 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.140 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.140 issued rwts: total=4976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:53.140 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:53.140 filename1: (groupid=0, jobs=1): err= 0: pid=1286256: Wed Nov 20 01:32:59 2024 00:31:53.140 read: IOPS=497, BW=1989KiB/s (2037kB/s)(19.4MiB/10005msec) 00:31:53.140 slat (usec): min=8, max=182, avg=51.42, stdev=29.09 00:31:53.140 clat (usec): min=14294, max=57945, avg=31641.92, stdev=1925.52 00:31:53.140 lat (usec): min=14330, max=57971, avg=31693.34, stdev=1927.55 00:31:53.140 clat percentiles (usec): 00:31:53.140 | 1.00th=[30540], 5.00th=[30802], 10.00th=[31065], 20.00th=[31065], 00:31:53.140 | 30.00th=[31327], 40.00th=[31327], 50.00th=[31589], 60.00th=[31589], 00:31:53.140 | 70.00th=[31851], 80.00th=[31851], 90.00th=[32113], 95.00th=[32637], 00:31:53.140 | 99.00th=[34866], 99.50th=[35390], 99.90th=[57934], 99.95th=[57934], 00:31:53.140 | 99.99th=[57934] 00:31:53.140 bw ( KiB/s): min= 1792, max= 2048, per=4.15%, avg=1980.63, stdev=89.18, samples=19 00:31:53.140 iops : min= 448, max= 512, avg=495.16, stdev=22.29, samples=19 00:31:53.140 lat (msec) : 20=0.32%, 50=99.36%, 100=0.32% 00:31:53.140 cpu : usr=98.52%, sys=1.04%, ctx=14, majf=0, minf=56 00:31:53.140 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:31:53.140 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.140 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.140 issued rwts: total=4976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:53.140 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:53.140 filename1: (groupid=0, jobs=1): err= 0: pid=1286257: Wed Nov 20 01:32:59 2024 00:31:53.140 read: IOPS=497, BW=1990KiB/s (2037kB/s)(19.4MiB/10004msec) 00:31:53.140 slat (usec): min=8, max=143, avg=43.18, stdev=19.50 00:31:53.140 clat (usec): min=14121, max=57891, avg=31759.52, stdev=1867.05 00:31:53.140 lat (usec): min=14154, max=57934, avg=31802.69, stdev=1867.89 00:31:53.140 clat percentiles (usec): 00:31:53.140 | 1.00th=[30540], 5.00th=[31065], 10.00th=[31065], 20.00th=[31327], 00:31:53.140 | 30.00th=[31327], 40.00th=[31589], 50.00th=[31589], 60.00th=[31851], 00:31:53.140 | 70.00th=[31851], 80.00th=[32113], 90.00th=[32375], 95.00th=[32637], 00:31:53.140 | 99.00th=[34866], 99.50th=[35914], 99.90th=[56886], 99.95th=[56886], 00:31:53.140 | 99.99th=[57934] 00:31:53.140 bw ( KiB/s): min= 1792, max= 2048, per=4.15%, avg=1980.79, stdev=88.83, samples=19 00:31:53.140 iops : min= 448, max= 512, avg=495.16, stdev=22.29, samples=19 00:31:53.140 lat (msec) : 20=0.32%, 50=99.36%, 100=0.32% 00:31:53.140 cpu : usr=97.94%, sys=1.29%, ctx=82, majf=0, minf=51 00:31:53.140 IO depths : 1=6.2%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.3%, 32=0.0%, >=64=0.0% 00:31:53.140 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.140 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.140 issued rwts: total=4976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:53.140 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:53.140 filename1: (groupid=0, jobs=1): err= 0: pid=1286258: Wed Nov 20 01:32:59 2024 00:31:53.140 read: IOPS=497, BW=1989KiB/s (2037kB/s)(19.4MiB/10007msec) 00:31:53.140 slat (usec): min=8, max=159, avg=33.09, stdev=14.57 00:31:53.140 clat (usec): min=20547, max=42785, avg=31879.82, stdev=927.40 00:31:53.140 lat (usec): min=20676, max=42808, avg=31912.91, stdev=927.69 00:31:53.140 clat percentiles (usec): 00:31:53.140 | 1.00th=[30802], 5.00th=[31065], 10.00th=[31327], 20.00th=[31327], 00:31:53.140 | 30.00th=[31589], 40.00th=[31589], 50.00th=[31851], 60.00th=[31851], 00:31:53.140 | 70.00th=[32113], 80.00th=[32113], 90.00th=[32375], 95.00th=[32900], 00:31:53.140 | 99.00th=[34866], 99.50th=[35390], 99.90th=[40109], 99.95th=[42206], 00:31:53.140 | 99.99th=[42730] 00:31:53.140 bw ( KiB/s): min= 1920, max= 2048, per=4.17%, avg=1987.37, stdev=65.66, samples=19 00:31:53.140 iops : min= 480, max= 512, avg=496.84, stdev=16.42, samples=19 00:31:53.140 lat (msec) : 50=100.00% 00:31:53.140 cpu : usr=98.30%, sys=1.10%, ctx=61, majf=0, minf=57 00:31:53.140 IO depths : 1=5.8%, 2=12.0%, 4=24.9%, 8=50.6%, 16=6.7%, 32=0.0%, >=64=0.0% 00:31:53.140 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.140 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.140 issued rwts: total=4976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:53.140 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:53.140 filename1: (groupid=0, jobs=1): err= 0: pid=1286259: Wed Nov 20 01:32:59 2024 00:31:53.140 read: IOPS=502, BW=2009KiB/s (2057kB/s)(19.6MiB/10004msec) 00:31:53.140 slat (usec): min=4, max=110, avg=18.70, stdev=13.12 00:31:53.140 clat (usec): min=3442, max=38374, avg=31700.26, stdev=2845.61 00:31:53.140 lat (usec): min=3447, max=38383, avg=31718.96, stdev=2846.52 00:31:53.140 clat percentiles (usec): 00:31:53.140 | 1.00th=[11076], 5.00th=[31065], 10.00th=[31327], 20.00th=[31589], 00:31:53.140 | 30.00th=[31589], 40.00th=[31851], 50.00th=[31851], 60.00th=[32113], 00:31:53.140 | 70.00th=[32113], 80.00th=[32375], 90.00th=[32637], 95.00th=[33162], 00:31:53.140 | 99.00th=[34866], 99.50th=[35390], 99.90th=[38536], 99.95th=[38536], 00:31:53.140 | 99.99th=[38536] 00:31:53.140 bw ( KiB/s): min= 1920, max= 2304, per=4.21%, avg=2007.58, stdev=94.86, samples=19 00:31:53.140 iops : min= 480, max= 576, avg=501.89, stdev=23.72, samples=19 00:31:53.140 lat (msec) : 4=0.32%, 10=0.60%, 20=0.32%, 50=98.77% 00:31:53.140 cpu : usr=98.00%, sys=1.21%, ctx=119, majf=0, minf=84 00:31:53.140 IO depths : 1=5.8%, 2=11.9%, 4=24.8%, 8=50.8%, 16=6.8%, 32=0.0%, >=64=0.0% 00:31:53.140 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.140 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.140 issued rwts: total=5024,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:53.140 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:53.140 filename2: (groupid=0, jobs=1): err= 0: pid=1286260: Wed Nov 20 01:32:59 2024 00:31:53.140 read: IOPS=500, BW=2002KiB/s (2050kB/s)(19.6MiB/10005msec) 00:31:53.140 slat (usec): min=8, max=109, avg=29.65, stdev=12.75 00:31:53.140 clat (usec): min=8105, max=35734, avg=31706.32, stdev=1994.02 00:31:53.140 lat (usec): min=8122, max=35749, avg=31735.97, stdev=1994.85 00:31:53.140 clat percentiles (usec): 00:31:53.140 | 1.00th=[23462], 5.00th=[31065], 10.00th=[31327], 20.00th=[31589], 00:31:53.140 | 30.00th=[31589], 40.00th=[31851], 50.00th=[31851], 60.00th=[31851], 00:31:53.140 | 70.00th=[32113], 80.00th=[32113], 90.00th=[32375], 95.00th=[32900], 00:31:53.140 | 99.00th=[34341], 99.50th=[34866], 99.90th=[35914], 99.95th=[35914], 00:31:53.140 | 99.99th=[35914] 00:31:53.140 bw ( KiB/s): min= 1920, max= 2176, per=4.20%, avg=2000.84, stdev=75.14, samples=19 00:31:53.140 iops : min= 480, max= 544, avg=500.11, stdev=18.74, samples=19 00:31:53.140 lat (msec) : 10=0.32%, 20=0.32%, 50=99.36% 00:31:53.140 cpu : usr=98.63%, sys=0.89%, ctx=17, majf=0, minf=62 00:31:53.140 IO depths : 1=6.0%, 2=12.2%, 4=24.8%, 8=50.5%, 16=6.5%, 32=0.0%, >=64=0.0% 00:31:53.140 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.140 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.140 issued rwts: total=5008,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:53.140 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:53.141 filename2: (groupid=0, jobs=1): err= 0: pid=1286261: Wed Nov 20 01:32:59 2024 00:31:53.141 read: IOPS=497, BW=1990KiB/s (2037kB/s)(19.4MiB/10004msec) 00:31:53.141 slat (usec): min=8, max=137, avg=45.11, stdev=18.67 00:31:53.141 clat (usec): min=14370, max=57449, avg=31724.63, stdev=1874.56 00:31:53.141 lat (usec): min=14405, max=57464, avg=31769.74, stdev=1875.23 00:31:53.141 clat percentiles (usec): 00:31:53.141 | 1.00th=[30540], 5.00th=[31065], 10.00th=[31065], 20.00th=[31327], 00:31:53.141 | 30.00th=[31327], 40.00th=[31589], 50.00th=[31589], 60.00th=[31851], 00:31:53.141 | 70.00th=[31851], 80.00th=[32113], 90.00th=[32375], 95.00th=[32637], 00:31:53.141 | 99.00th=[34866], 99.50th=[35390], 99.90th=[57410], 99.95th=[57410], 00:31:53.141 | 99.99th=[57410] 00:31:53.141 bw ( KiB/s): min= 1792, max= 2048, per=4.15%, avg=1980.63, stdev=89.18, samples=19 00:31:53.141 iops : min= 448, max= 512, avg=495.16, stdev=22.29, samples=19 00:31:53.141 lat (msec) : 20=0.32%, 50=99.36%, 100=0.32% 00:31:53.141 cpu : usr=98.11%, sys=1.22%, ctx=42, majf=0, minf=42 00:31:53.141 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:31:53.141 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.141 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.141 issued rwts: total=4976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:53.141 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:53.141 filename2: (groupid=0, jobs=1): err= 0: pid=1286262: Wed Nov 20 01:32:59 2024 00:31:53.141 read: IOPS=497, BW=1988KiB/s (2036kB/s)(19.4MiB/10012msec) 00:31:53.141 slat (nsec): min=4374, max=92931, avg=35385.39, stdev=12437.33 00:31:53.141 clat (usec): min=14160, max=65233, avg=31865.12, stdev=2345.36 00:31:53.141 lat (usec): min=14193, max=65258, avg=31900.51, stdev=2344.94 00:31:53.141 clat percentiles (usec): 00:31:53.141 | 1.00th=[30802], 5.00th=[31065], 10.00th=[31327], 20.00th=[31327], 00:31:53.141 | 30.00th=[31589], 40.00th=[31589], 50.00th=[31851], 60.00th=[31851], 00:31:53.141 | 70.00th=[31851], 80.00th=[32113], 90.00th=[32375], 95.00th=[32900], 00:31:53.141 | 99.00th=[34866], 99.50th=[42206], 99.90th=[65274], 99.95th=[65274], 00:31:53.141 | 99.99th=[65274] 00:31:53.141 bw ( KiB/s): min= 1792, max= 2048, per=4.15%, avg=1980.63, stdev=78.31, samples=19 00:31:53.141 iops : min= 448, max= 512, avg=495.16, stdev=19.58, samples=19 00:31:53.141 lat (msec) : 20=0.32%, 50=99.36%, 100=0.32% 00:31:53.141 cpu : usr=94.50%, sys=3.02%, ctx=1320, majf=0, minf=63 00:31:53.141 IO depths : 1=6.1%, 2=12.4%, 4=24.9%, 8=50.2%, 16=6.4%, 32=0.0%, >=64=0.0% 00:31:53.141 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.141 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.141 issued rwts: total=4976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:53.141 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:53.141 filename2: (groupid=0, jobs=1): err= 0: pid=1286263: Wed Nov 20 01:32:59 2024 00:31:53.141 read: IOPS=497, BW=1989KiB/s (2037kB/s)(19.4MiB/10006msec) 00:31:53.141 slat (nsec): min=8470, max=91128, avg=41881.26, stdev=12611.88 00:31:53.141 clat (usec): min=14383, max=59621, avg=31794.36, stdev=1975.18 00:31:53.141 lat (usec): min=14407, max=59661, avg=31836.24, stdev=1975.70 00:31:53.141 clat percentiles (usec): 00:31:53.141 | 1.00th=[30278], 5.00th=[31065], 10.00th=[31065], 20.00th=[31327], 00:31:53.141 | 30.00th=[31589], 40.00th=[31589], 50.00th=[31589], 60.00th=[31851], 00:31:53.141 | 70.00th=[31851], 80.00th=[32113], 90.00th=[32375], 95.00th=[32900], 00:31:53.141 | 99.00th=[34866], 99.50th=[35390], 99.90th=[59507], 99.95th=[59507], 00:31:53.141 | 99.99th=[59507] 00:31:53.141 bw ( KiB/s): min= 1792, max= 2048, per=4.15%, avg=1980.63, stdev=78.31, samples=19 00:31:53.141 iops : min= 448, max= 512, avg=495.16, stdev=19.58, samples=19 00:31:53.141 lat (msec) : 20=0.32%, 50=99.36%, 100=0.32% 00:31:53.141 cpu : usr=97.40%, sys=1.58%, ctx=132, majf=0, minf=49 00:31:53.141 IO depths : 1=6.1%, 2=12.3%, 4=24.9%, 8=50.2%, 16=6.4%, 32=0.0%, >=64=0.0% 00:31:53.141 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.141 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.141 issued rwts: total=4976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:53.141 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:53.141 filename2: (groupid=0, jobs=1): err= 0: pid=1286264: Wed Nov 20 01:32:59 2024 00:31:53.141 read: IOPS=497, BW=1989KiB/s (2037kB/s)(19.4MiB/10007msec) 00:31:53.141 slat (usec): min=8, max=125, avg=49.28, stdev=20.65 00:31:53.141 clat (usec): min=20662, max=42195, avg=31753.86, stdev=991.98 00:31:53.141 lat (usec): min=20673, max=42213, avg=31803.14, stdev=991.63 00:31:53.141 clat percentiles (usec): 00:31:53.141 | 1.00th=[30540], 5.00th=[30802], 10.00th=[31065], 20.00th=[31327], 00:31:53.141 | 30.00th=[31327], 40.00th=[31589], 50.00th=[31589], 60.00th=[31851], 00:31:53.141 | 70.00th=[31851], 80.00th=[32113], 90.00th=[32375], 95.00th=[32900], 00:31:53.141 | 99.00th=[34866], 99.50th=[36439], 99.90th=[41681], 99.95th=[42206], 00:31:53.141 | 99.99th=[42206] 00:31:53.141 bw ( KiB/s): min= 1920, max= 2048, per=4.17%, avg=1987.37, stdev=65.66, samples=19 00:31:53.141 iops : min= 480, max= 512, avg=496.84, stdev=16.42, samples=19 00:31:53.141 lat (msec) : 50=100.00% 00:31:53.141 cpu : usr=98.63%, sys=0.92%, ctx=13, majf=0, minf=36 00:31:53.141 IO depths : 1=6.2%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.3%, 32=0.0%, >=64=0.0% 00:31:53.141 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.141 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.141 issued rwts: total=4976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:53.141 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:53.141 filename2: (groupid=0, jobs=1): err= 0: pid=1286265: Wed Nov 20 01:32:59 2024 00:31:53.141 read: IOPS=497, BW=1989KiB/s (2037kB/s)(19.4MiB/10005msec) 00:31:53.141 slat (usec): min=8, max=128, avg=40.54, stdev=15.60 00:31:53.141 clat (usec): min=28969, max=40176, avg=31824.26, stdev=841.73 00:31:53.141 lat (usec): min=28998, max=40204, avg=31864.81, stdev=839.88 00:31:53.141 clat percentiles (usec): 00:31:53.141 | 1.00th=[30540], 5.00th=[30802], 10.00th=[31065], 20.00th=[31327], 00:31:53.141 | 30.00th=[31589], 40.00th=[31589], 50.00th=[31851], 60.00th=[31851], 00:31:53.141 | 70.00th=[31851], 80.00th=[32113], 90.00th=[32375], 95.00th=[32900], 00:31:53.141 | 99.00th=[34866], 99.50th=[35390], 99.90th=[40109], 99.95th=[40109], 00:31:53.141 | 99.99th=[40109] 00:31:53.141 bw ( KiB/s): min= 1920, max= 2048, per=4.17%, avg=1987.37, stdev=65.66, samples=19 00:31:53.141 iops : min= 480, max= 512, avg=496.84, stdev=16.42, samples=19 00:31:53.141 lat (msec) : 50=100.00% 00:31:53.141 cpu : usr=98.06%, sys=0.98%, ctx=92, majf=0, minf=56 00:31:53.141 IO depths : 1=5.9%, 2=12.2%, 4=25.0%, 8=50.3%, 16=6.6%, 32=0.0%, >=64=0.0% 00:31:53.141 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.141 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.141 issued rwts: total=4976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:53.141 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:53.141 filename2: (groupid=0, jobs=1): err= 0: pid=1286266: Wed Nov 20 01:32:59 2024 00:31:53.141 read: IOPS=499, BW=1998KiB/s (2046kB/s)(19.6MiB/10026msec) 00:31:53.141 slat (usec): min=6, max=191, avg=41.91, stdev=21.46 00:31:53.141 clat (usec): min=8638, max=37591, avg=31651.73, stdev=1819.70 00:31:53.141 lat (usec): min=8649, max=37618, avg=31693.64, stdev=1821.27 00:31:53.141 clat percentiles (usec): 00:31:53.141 | 1.00th=[30278], 5.00th=[30802], 10.00th=[31065], 20.00th=[31327], 00:31:53.141 | 30.00th=[31327], 40.00th=[31589], 50.00th=[31589], 60.00th=[31851], 00:31:53.141 | 70.00th=[31851], 80.00th=[32113], 90.00th=[32375], 95.00th=[32900], 00:31:53.141 | 99.00th=[34866], 99.50th=[35390], 99.90th=[37487], 99.95th=[37487], 00:31:53.141 | 99.99th=[37487] 00:31:53.141 bw ( KiB/s): min= 1920, max= 2048, per=4.19%, avg=1996.80, stdev=64.34, samples=20 00:31:53.141 iops : min= 480, max= 512, avg=499.20, stdev=16.08, samples=20 00:31:53.141 lat (msec) : 10=0.32%, 20=0.32%, 50=99.36% 00:31:53.141 cpu : usr=95.93%, sys=2.13%, ctx=355, majf=0, minf=69 00:31:53.141 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:31:53.141 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.141 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.141 issued rwts: total=5008,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:53.141 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:53.141 filename2: (groupid=0, jobs=1): err= 0: pid=1286267: Wed Nov 20 01:32:59 2024 00:31:53.141 read: IOPS=497, BW=1989KiB/s (2037kB/s)(19.4MiB/10007msec) 00:31:53.141 slat (usec): min=6, max=107, avg=44.96, stdev=17.96 00:31:53.141 clat (usec): min=20453, max=43069, avg=31785.15, stdev=893.35 00:31:53.141 lat (usec): min=20462, max=43098, avg=31830.12, stdev=893.93 00:31:53.141 clat percentiles (usec): 00:31:53.141 | 1.00th=[30540], 5.00th=[31065], 10.00th=[31065], 20.00th=[31327], 00:31:53.141 | 30.00th=[31589], 40.00th=[31589], 50.00th=[31589], 60.00th=[31851], 00:31:53.141 | 70.00th=[31851], 80.00th=[32113], 90.00th=[32375], 95.00th=[32637], 00:31:53.141 | 99.00th=[34866], 99.50th=[35914], 99.90th=[40109], 99.95th=[40109], 00:31:53.141 | 99.99th=[43254] 00:31:53.141 bw ( KiB/s): min= 1920, max= 2048, per=4.17%, avg=1987.37, stdev=65.66, samples=19 00:31:53.141 iops : min= 480, max= 512, avg=496.84, stdev=16.42, samples=19 00:31:53.141 lat (msec) : 50=100.00% 00:31:53.141 cpu : usr=98.61%, sys=0.95%, ctx=15, majf=0, minf=40 00:31:53.141 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:31:53.141 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.141 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.141 issued rwts: total=4976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:53.141 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:53.141 00:31:53.141 Run status group 0 (all jobs): 00:31:53.141 READ: bw=46.5MiB/s (48.8MB/s), 1983KiB/s-2009KiB/s (2030kB/s-2057kB/s), io=468MiB (490MB), run=10004-10044msec 00:31:53.141 01:32:59 -- target/dif.sh@113 -- # destroy_subsystems 0 1 2 00:31:53.141 01:32:59 -- target/dif.sh@43 -- # local sub 00:31:53.141 01:32:59 -- target/dif.sh@45 -- # for sub in "$@" 00:31:53.141 01:32:59 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:53.141 01:32:59 -- target/dif.sh@36 -- # local sub_id=0 00:31:53.141 01:32:59 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:53.141 01:32:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:53.141 01:32:59 -- common/autotest_common.sh@10 -- # set +x 00:31:53.141 01:32:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:53.142 01:32:59 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:53.142 01:32:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:53.142 01:32:59 -- common/autotest_common.sh@10 -- # set +x 00:31:53.142 01:32:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:53.142 01:32:59 -- target/dif.sh@45 -- # for sub in "$@" 00:31:53.142 01:32:59 -- target/dif.sh@46 -- # destroy_subsystem 1 00:31:53.142 01:32:59 -- target/dif.sh@36 -- # local sub_id=1 00:31:53.142 01:32:59 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:31:53.142 01:32:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:53.142 01:32:59 -- common/autotest_common.sh@10 -- # set +x 00:31:53.142 01:32:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:53.142 01:32:59 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:31:53.142 01:32:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:53.142 01:32:59 -- common/autotest_common.sh@10 -- # set +x 00:31:53.142 01:32:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:53.142 01:32:59 -- target/dif.sh@45 -- # for sub in "$@" 00:31:53.142 01:32:59 -- target/dif.sh@46 -- # destroy_subsystem 2 00:31:53.142 01:32:59 -- target/dif.sh@36 -- # local sub_id=2 00:31:53.142 01:32:59 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:31:53.142 01:32:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:53.142 01:32:59 -- common/autotest_common.sh@10 -- # set +x 00:31:53.142 01:32:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:53.142 01:32:59 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null2 00:31:53.142 01:32:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:53.142 01:32:59 -- common/autotest_common.sh@10 -- # set +x 00:31:53.142 01:32:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:53.142 01:32:59 -- target/dif.sh@115 -- # NULL_DIF=1 00:31:53.142 01:32:59 -- target/dif.sh@115 -- # bs=8k,16k,128k 00:31:53.142 01:32:59 -- target/dif.sh@115 -- # numjobs=2 00:31:53.142 01:32:59 -- target/dif.sh@115 -- # iodepth=8 00:31:53.142 01:32:59 -- target/dif.sh@115 -- # runtime=5 00:31:53.142 01:32:59 -- target/dif.sh@115 -- # files=1 00:31:53.142 01:32:59 -- target/dif.sh@117 -- # create_subsystems 0 1 00:31:53.142 01:32:59 -- target/dif.sh@28 -- # local sub 00:31:53.142 01:32:59 -- target/dif.sh@30 -- # for sub in "$@" 00:31:53.142 01:32:59 -- target/dif.sh@31 -- # create_subsystem 0 00:31:53.142 01:32:59 -- target/dif.sh@18 -- # local sub_id=0 00:31:53.142 01:32:59 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:31:53.142 01:32:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:53.142 01:32:59 -- common/autotest_common.sh@10 -- # set +x 00:31:53.142 bdev_null0 00:31:53.142 01:32:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:53.142 01:32:59 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:53.142 01:32:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:53.142 01:32:59 -- common/autotest_common.sh@10 -- # set +x 00:31:53.142 01:32:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:53.142 01:32:59 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:53.142 01:32:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:53.142 01:32:59 -- common/autotest_common.sh@10 -- # set +x 00:31:53.142 01:32:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:53.142 01:32:59 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:53.142 01:32:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:53.142 01:32:59 -- common/autotest_common.sh@10 -- # set +x 00:31:53.142 [2024-11-20 01:32:59.722429] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:53.142 01:32:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:53.142 01:32:59 -- target/dif.sh@30 -- # for sub in "$@" 00:31:53.142 01:32:59 -- target/dif.sh@31 -- # create_subsystem 1 00:31:53.142 01:32:59 -- target/dif.sh@18 -- # local sub_id=1 00:31:53.142 01:32:59 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:31:53.142 01:32:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:53.142 01:32:59 -- common/autotest_common.sh@10 -- # set +x 00:31:53.142 bdev_null1 00:31:53.142 01:32:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:53.142 01:32:59 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:31:53.142 01:32:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:53.142 01:32:59 -- common/autotest_common.sh@10 -- # set +x 00:31:53.142 01:32:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:53.142 01:32:59 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:31:53.142 01:32:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:53.142 01:32:59 -- common/autotest_common.sh@10 -- # set +x 00:31:53.142 01:32:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:53.142 01:32:59 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:53.142 01:32:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:53.142 01:32:59 -- common/autotest_common.sh@10 -- # set +x 00:31:53.142 01:32:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:53.142 01:32:59 -- target/dif.sh@118 -- # fio /dev/fd/62 00:31:53.142 01:32:59 -- target/dif.sh@118 -- # create_json_sub_conf 0 1 00:31:53.142 01:32:59 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:53.142 01:32:59 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:31:53.142 01:32:59 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:53.142 01:32:59 -- nvmf/common.sh@520 -- # config=() 00:31:53.142 01:32:59 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:53.142 01:32:59 -- target/dif.sh@82 -- # gen_fio_conf 00:31:53.142 01:32:59 -- nvmf/common.sh@520 -- # local subsystem config 00:31:53.142 01:32:59 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:53.142 01:32:59 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:53.142 01:32:59 -- target/dif.sh@54 -- # local file 00:31:53.142 01:32:59 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:53.142 01:32:59 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:53.142 01:32:59 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:53.142 { 00:31:53.142 "params": { 00:31:53.142 "name": "Nvme$subsystem", 00:31:53.142 "trtype": "$TEST_TRANSPORT", 00:31:53.142 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:53.142 "adrfam": "ipv4", 00:31:53.142 "trsvcid": "$NVMF_PORT", 00:31:53.142 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:53.142 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:53.142 "hdgst": ${hdgst:-false}, 00:31:53.142 "ddgst": ${ddgst:-false} 00:31:53.142 }, 00:31:53.142 "method": "bdev_nvme_attach_controller" 00:31:53.142 } 00:31:53.142 EOF 00:31:53.142 )") 00:31:53.142 01:32:59 -- target/dif.sh@56 -- # cat 00:31:53.142 01:32:59 -- common/autotest_common.sh@1330 -- # shift 00:31:53.142 01:32:59 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:53.142 01:32:59 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:53.142 01:32:59 -- nvmf/common.sh@542 -- # cat 00:31:53.142 01:32:59 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:53.142 01:32:59 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:53.142 01:32:59 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:53.142 01:32:59 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:53.142 01:32:59 -- target/dif.sh@72 -- # (( file <= files )) 00:31:53.142 01:32:59 -- target/dif.sh@73 -- # cat 00:31:53.142 01:32:59 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:53.142 01:32:59 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:53.142 { 00:31:53.142 "params": { 00:31:53.142 "name": "Nvme$subsystem", 00:31:53.142 "trtype": "$TEST_TRANSPORT", 00:31:53.142 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:53.142 "adrfam": "ipv4", 00:31:53.142 "trsvcid": "$NVMF_PORT", 00:31:53.142 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:53.142 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:53.142 "hdgst": ${hdgst:-false}, 00:31:53.142 "ddgst": ${ddgst:-false} 00:31:53.142 }, 00:31:53.142 "method": "bdev_nvme_attach_controller" 00:31:53.142 } 00:31:53.142 EOF 00:31:53.142 )") 00:31:53.142 01:32:59 -- target/dif.sh@72 -- # (( file++ )) 00:31:53.142 01:32:59 -- target/dif.sh@72 -- # (( file <= files )) 00:31:53.142 01:32:59 -- nvmf/common.sh@542 -- # cat 00:31:53.142 01:32:59 -- nvmf/common.sh@544 -- # jq . 00:31:53.142 01:32:59 -- nvmf/common.sh@545 -- # IFS=, 00:31:53.142 01:32:59 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:53.142 "params": { 00:31:53.142 "name": "Nvme0", 00:31:53.142 "trtype": "tcp", 00:31:53.142 "traddr": "10.0.0.2", 00:31:53.142 "adrfam": "ipv4", 00:31:53.142 "trsvcid": "4420", 00:31:53.142 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:53.142 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:53.142 "hdgst": false, 00:31:53.142 "ddgst": false 00:31:53.142 }, 00:31:53.142 "method": "bdev_nvme_attach_controller" 00:31:53.142 },{ 00:31:53.142 "params": { 00:31:53.142 "name": "Nvme1", 00:31:53.142 "trtype": "tcp", 00:31:53.142 "traddr": "10.0.0.2", 00:31:53.142 "adrfam": "ipv4", 00:31:53.142 "trsvcid": "4420", 00:31:53.142 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:31:53.142 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:31:53.142 "hdgst": false, 00:31:53.142 "ddgst": false 00:31:53.142 }, 00:31:53.142 "method": "bdev_nvme_attach_controller" 00:31:53.142 }' 00:31:53.142 01:32:59 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:53.142 01:32:59 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:53.142 01:32:59 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:53.142 01:32:59 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:53.142 01:32:59 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:53.142 01:32:59 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:53.142 01:32:59 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:53.143 01:32:59 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:53.143 01:32:59 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:53.143 01:32:59 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:53.143 filename0: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:31:53.143 ... 00:31:53.143 filename1: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:31:53.143 ... 00:31:53.143 fio-3.35 00:31:53.143 Starting 4 threads 00:31:53.143 EAL: No free 2048 kB hugepages reported on node 1 00:31:53.143 [2024-11-20 01:33:00.824540] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:53.143 [2024-11-20 01:33:00.824594] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:58.407 00:31:58.407 filename0: (groupid=0, jobs=1): err= 0: pid=1287749: Wed Nov 20 01:33:05 2024 00:31:58.407 read: IOPS=1883, BW=14.7MiB/s (15.4MB/s)(73.6MiB/5003msec) 00:31:58.407 slat (nsec): min=3937, max=68058, avg=22220.39, stdev=9741.49 00:31:58.407 clat (usec): min=603, max=7800, avg=4168.87, stdev=401.85 00:31:58.407 lat (usec): min=622, max=7812, avg=4191.09, stdev=401.94 00:31:58.407 clat percentiles (usec): 00:31:58.407 | 1.00th=[ 3064], 5.00th=[ 3752], 10.00th=[ 3884], 20.00th=[ 3982], 00:31:58.407 | 30.00th=[ 4047], 40.00th=[ 4113], 50.00th=[ 4178], 60.00th=[ 4228], 00:31:58.407 | 70.00th=[ 4293], 80.00th=[ 4359], 90.00th=[ 4424], 95.00th=[ 4555], 00:31:58.407 | 99.00th=[ 5538], 99.50th=[ 6259], 99.90th=[ 7111], 99.95th=[ 7373], 00:31:58.407 | 99.99th=[ 7832] 00:31:58.407 bw ( KiB/s): min=14464, max=15360, per=25.08%, avg=15067.00, stdev=281.79, samples=10 00:31:58.407 iops : min= 1808, max= 1920, avg=1883.30, stdev=35.21, samples=10 00:31:58.407 lat (usec) : 750=0.03%, 1000=0.10% 00:31:58.407 lat (msec) : 2=0.27%, 4=20.94%, 10=78.67% 00:31:58.407 cpu : usr=90.90%, sys=6.20%, ctx=491, majf=0, minf=56 00:31:58.407 IO depths : 1=0.4%, 2=16.4%, 4=57.5%, 8=25.7%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:58.407 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:58.407 complete : 0=0.0%, 4=90.9%, 8=9.1%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:58.407 issued rwts: total=9423,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:58.407 latency : target=0, window=0, percentile=100.00%, depth=8 00:31:58.407 filename0: (groupid=0, jobs=1): err= 0: pid=1287750: Wed Nov 20 01:33:05 2024 00:31:58.407 read: IOPS=1869, BW=14.6MiB/s (15.3MB/s)(73.0MiB/5002msec) 00:31:58.407 slat (usec): min=3, max=140, avg=22.52, stdev=11.18 00:31:58.407 clat (usec): min=729, max=8121, avg=4194.69, stdev=456.41 00:31:58.407 lat (usec): min=741, max=8141, avg=4217.22, stdev=455.96 00:31:58.407 clat percentiles (usec): 00:31:58.407 | 1.00th=[ 2868], 5.00th=[ 3818], 10.00th=[ 3884], 20.00th=[ 3982], 00:31:58.407 | 30.00th=[ 4047], 40.00th=[ 4113], 50.00th=[ 4178], 60.00th=[ 4228], 00:31:58.407 | 70.00th=[ 4293], 80.00th=[ 4359], 90.00th=[ 4490], 95.00th=[ 4686], 00:31:58.407 | 99.00th=[ 6063], 99.50th=[ 6718], 99.90th=[ 7504], 99.95th=[ 7767], 00:31:58.407 | 99.99th=[ 8094] 00:31:58.407 bw ( KiB/s): min=14080, max=15360, per=24.97%, avg=15002.44, stdev=417.25, samples=9 00:31:58.407 iops : min= 1760, max= 1920, avg=1875.22, stdev=52.13, samples=9 00:31:58.407 lat (usec) : 750=0.01%, 1000=0.11% 00:31:58.407 lat (msec) : 2=0.40%, 4=21.36%, 10=78.13% 00:31:58.407 cpu : usr=92.80%, sys=5.28%, ctx=103, majf=0, minf=43 00:31:58.407 IO depths : 1=0.1%, 2=20.0%, 4=54.0%, 8=26.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:58.407 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:58.407 complete : 0=0.0%, 4=90.8%, 8=9.2%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:58.407 issued rwts: total=9349,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:58.407 latency : target=0, window=0, percentile=100.00%, depth=8 00:31:58.407 filename1: (groupid=0, jobs=1): err= 0: pid=1287751: Wed Nov 20 01:33:05 2024 00:31:58.407 read: IOPS=1880, BW=14.7MiB/s (15.4MB/s)(73.5MiB/5004msec) 00:31:58.407 slat (nsec): min=3845, max=72654, avg=20251.91, stdev=10879.38 00:31:58.407 clat (usec): min=848, max=7726, avg=4183.39, stdev=424.67 00:31:58.407 lat (usec): min=862, max=7757, avg=4203.64, stdev=424.83 00:31:58.407 clat percentiles (usec): 00:31:58.407 | 1.00th=[ 3097], 5.00th=[ 3752], 10.00th=[ 3884], 20.00th=[ 4015], 00:31:58.407 | 30.00th=[ 4047], 40.00th=[ 4113], 50.00th=[ 4178], 60.00th=[ 4228], 00:31:58.407 | 70.00th=[ 4293], 80.00th=[ 4359], 90.00th=[ 4490], 95.00th=[ 4555], 00:31:58.407 | 99.00th=[ 5932], 99.50th=[ 6587], 99.90th=[ 7439], 99.95th=[ 7570], 00:31:58.407 | 99.99th=[ 7701] 00:31:58.407 bw ( KiB/s): min=14464, max=15376, per=25.03%, avg=15040.00, stdev=263.01, samples=10 00:31:58.407 iops : min= 1808, max= 1922, avg=1880.00, stdev=32.88, samples=10 00:31:58.407 lat (usec) : 1000=0.02% 00:31:58.407 lat (msec) : 2=0.20%, 4=19.94%, 10=79.84% 00:31:58.407 cpu : usr=95.24%, sys=4.22%, ctx=16, majf=0, minf=93 00:31:58.407 IO depths : 1=0.6%, 2=15.4%, 4=58.0%, 8=26.1%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:58.407 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:58.407 complete : 0=0.0%, 4=91.3%, 8=8.7%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:58.407 issued rwts: total=9408,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:58.407 latency : target=0, window=0, percentile=100.00%, depth=8 00:31:58.407 filename1: (groupid=0, jobs=1): err= 0: pid=1287752: Wed Nov 20 01:33:05 2024 00:31:58.407 read: IOPS=1879, BW=14.7MiB/s (15.4MB/s)(73.5MiB/5002msec) 00:31:58.407 slat (nsec): min=3812, max=76620, avg=22598.84, stdev=11034.86 00:31:58.407 clat (usec): min=766, max=7680, avg=4170.04, stdev=411.05 00:31:58.407 lat (usec): min=779, max=7697, avg=4192.64, stdev=411.14 00:31:58.407 clat percentiles (usec): 00:31:58.407 | 1.00th=[ 3097], 5.00th=[ 3752], 10.00th=[ 3884], 20.00th=[ 3982], 00:31:58.407 | 30.00th=[ 4047], 40.00th=[ 4113], 50.00th=[ 4146], 60.00th=[ 4228], 00:31:58.407 | 70.00th=[ 4293], 80.00th=[ 4359], 90.00th=[ 4490], 95.00th=[ 4621], 00:31:58.407 | 99.00th=[ 5735], 99.50th=[ 6325], 99.90th=[ 7308], 99.95th=[ 7373], 00:31:58.407 | 99.99th=[ 7701] 00:31:58.407 bw ( KiB/s): min=14464, max=15360, per=25.12%, avg=15095.11, stdev=313.04, samples=9 00:31:58.407 iops : min= 1808, max= 1920, avg=1886.89, stdev=39.13, samples=9 00:31:58.407 lat (usec) : 1000=0.09% 00:31:58.407 lat (msec) : 2=0.31%, 4=22.41%, 10=77.20% 00:31:58.407 cpu : usr=95.58%, sys=3.86%, ctx=11, majf=0, minf=45 00:31:58.407 IO depths : 1=0.6%, 2=20.3%, 4=54.0%, 8=25.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:58.407 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:58.407 complete : 0=0.0%, 4=90.5%, 8=9.5%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:58.407 issued rwts: total=9403,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:58.407 latency : target=0, window=0, percentile=100.00%, depth=8 00:31:58.407 00:31:58.407 Run status group 0 (all jobs): 00:31:58.407 READ: bw=58.7MiB/s (61.5MB/s), 14.6MiB/s-14.7MiB/s (15.3MB/s-15.4MB/s), io=294MiB (308MB), run=5002-5004msec 00:31:58.407 01:33:06 -- target/dif.sh@119 -- # destroy_subsystems 0 1 00:31:58.407 01:33:06 -- target/dif.sh@43 -- # local sub 00:31:58.407 01:33:06 -- target/dif.sh@45 -- # for sub in "$@" 00:31:58.407 01:33:06 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:58.407 01:33:06 -- target/dif.sh@36 -- # local sub_id=0 00:31:58.407 01:33:06 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:58.407 01:33:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:58.407 01:33:06 -- common/autotest_common.sh@10 -- # set +x 00:31:58.407 01:33:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:58.407 01:33:06 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:58.407 01:33:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:58.407 01:33:06 -- common/autotest_common.sh@10 -- # set +x 00:31:58.407 01:33:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:58.407 01:33:06 -- target/dif.sh@45 -- # for sub in "$@" 00:31:58.407 01:33:06 -- target/dif.sh@46 -- # destroy_subsystem 1 00:31:58.407 01:33:06 -- target/dif.sh@36 -- # local sub_id=1 00:31:58.407 01:33:06 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:31:58.407 01:33:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:58.407 01:33:06 -- common/autotest_common.sh@10 -- # set +x 00:31:58.407 01:33:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:58.407 01:33:06 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:31:58.408 01:33:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:58.408 01:33:06 -- common/autotest_common.sh@10 -- # set +x 00:31:58.408 01:33:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:58.408 00:31:58.408 real 0m24.242s 00:31:58.408 user 4m32.216s 00:31:58.408 sys 0m6.152s 00:31:58.408 01:33:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:58.408 01:33:06 -- common/autotest_common.sh@10 -- # set +x 00:31:58.408 ************************************ 00:31:58.408 END TEST fio_dif_rand_params 00:31:58.408 ************************************ 00:31:58.408 01:33:06 -- target/dif.sh@144 -- # run_test fio_dif_digest fio_dif_digest 00:31:58.408 01:33:06 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:58.408 01:33:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:58.408 01:33:06 -- common/autotest_common.sh@10 -- # set +x 00:31:58.408 ************************************ 00:31:58.408 START TEST fio_dif_digest 00:31:58.408 ************************************ 00:31:58.408 01:33:06 -- common/autotest_common.sh@1114 -- # fio_dif_digest 00:31:58.408 01:33:06 -- target/dif.sh@123 -- # local NULL_DIF 00:31:58.408 01:33:06 -- target/dif.sh@124 -- # local bs numjobs runtime iodepth files 00:31:58.408 01:33:06 -- target/dif.sh@125 -- # local hdgst ddgst 00:31:58.408 01:33:06 -- target/dif.sh@127 -- # NULL_DIF=3 00:31:58.408 01:33:06 -- target/dif.sh@127 -- # bs=128k,128k,128k 00:31:58.408 01:33:06 -- target/dif.sh@127 -- # numjobs=3 00:31:58.408 01:33:06 -- target/dif.sh@127 -- # iodepth=3 00:31:58.408 01:33:06 -- target/dif.sh@127 -- # runtime=10 00:31:58.408 01:33:06 -- target/dif.sh@128 -- # hdgst=true 00:31:58.408 01:33:06 -- target/dif.sh@128 -- # ddgst=true 00:31:58.408 01:33:06 -- target/dif.sh@130 -- # create_subsystems 0 00:31:58.408 01:33:06 -- target/dif.sh@28 -- # local sub 00:31:58.408 01:33:06 -- target/dif.sh@30 -- # for sub in "$@" 00:31:58.408 01:33:06 -- target/dif.sh@31 -- # create_subsystem 0 00:31:58.408 01:33:06 -- target/dif.sh@18 -- # local sub_id=0 00:31:58.408 01:33:06 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:31:58.408 01:33:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:58.408 01:33:06 -- common/autotest_common.sh@10 -- # set +x 00:31:58.408 bdev_null0 00:31:58.408 01:33:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:58.408 01:33:06 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:58.408 01:33:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:58.408 01:33:06 -- common/autotest_common.sh@10 -- # set +x 00:31:58.408 01:33:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:58.408 01:33:06 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:58.408 01:33:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:58.408 01:33:06 -- common/autotest_common.sh@10 -- # set +x 00:31:58.408 01:33:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:58.408 01:33:06 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:58.408 01:33:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:58.408 01:33:06 -- common/autotest_common.sh@10 -- # set +x 00:31:58.408 [2024-11-20 01:33:06.254708] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:58.408 01:33:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:58.408 01:33:06 -- target/dif.sh@131 -- # fio /dev/fd/62 00:31:58.408 01:33:06 -- target/dif.sh@131 -- # create_json_sub_conf 0 00:31:58.408 01:33:06 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:31:58.408 01:33:06 -- nvmf/common.sh@520 -- # config=() 00:31:58.408 01:33:06 -- nvmf/common.sh@520 -- # local subsystem config 00:31:58.408 01:33:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:58.408 01:33:06 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:58.408 01:33:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:58.408 { 00:31:58.408 "params": { 00:31:58.408 "name": "Nvme$subsystem", 00:31:58.408 "trtype": "$TEST_TRANSPORT", 00:31:58.408 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:58.408 "adrfam": "ipv4", 00:31:58.408 "trsvcid": "$NVMF_PORT", 00:31:58.408 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:58.408 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:58.408 "hdgst": ${hdgst:-false}, 00:31:58.408 "ddgst": ${ddgst:-false} 00:31:58.408 }, 00:31:58.408 "method": "bdev_nvme_attach_controller" 00:31:58.408 } 00:31:58.408 EOF 00:31:58.408 )") 00:31:58.408 01:33:06 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:58.408 01:33:06 -- target/dif.sh@82 -- # gen_fio_conf 00:31:58.408 01:33:06 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:58.408 01:33:06 -- target/dif.sh@54 -- # local file 00:31:58.408 01:33:06 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:58.408 01:33:06 -- target/dif.sh@56 -- # cat 00:31:58.408 01:33:06 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:58.408 01:33:06 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:58.408 01:33:06 -- common/autotest_common.sh@1330 -- # shift 00:31:58.408 01:33:06 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:58.408 01:33:06 -- nvmf/common.sh@542 -- # cat 00:31:58.408 01:33:06 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:58.408 01:33:06 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:58.408 01:33:06 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:58.408 01:33:06 -- target/dif.sh@72 -- # (( file <= files )) 00:31:58.408 01:33:06 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:58.408 01:33:06 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:58.408 01:33:06 -- nvmf/common.sh@544 -- # jq . 00:31:58.408 01:33:06 -- nvmf/common.sh@545 -- # IFS=, 00:31:58.408 01:33:06 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:58.408 "params": { 00:31:58.408 "name": "Nvme0", 00:31:58.408 "trtype": "tcp", 00:31:58.408 "traddr": "10.0.0.2", 00:31:58.408 "adrfam": "ipv4", 00:31:58.408 "trsvcid": "4420", 00:31:58.408 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:58.408 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:58.408 "hdgst": true, 00:31:58.408 "ddgst": true 00:31:58.408 }, 00:31:58.408 "method": "bdev_nvme_attach_controller" 00:31:58.408 }' 00:31:58.408 01:33:06 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:58.408 01:33:06 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:58.408 01:33:06 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:58.408 01:33:06 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:58.408 01:33:06 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:58.408 01:33:06 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:58.408 01:33:06 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:58.408 01:33:06 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:58.408 01:33:06 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:58.408 01:33:06 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:58.408 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:31:58.408 ... 00:31:58.408 fio-3.35 00:31:58.408 Starting 3 threads 00:31:58.408 EAL: No free 2048 kB hugepages reported on node 1 00:31:59.042 [2024-11-20 01:33:07.017005] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:59.042 [2024-11-20 01:33:07.017100] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:32:09.012 00:32:09.012 filename0: (groupid=0, jobs=1): err= 0: pid=1288580: Wed Nov 20 01:33:17 2024 00:32:09.012 read: IOPS=199, BW=25.0MiB/s (26.2MB/s)(251MiB/10046msec) 00:32:09.012 slat (nsec): min=4233, max=55736, avg=13524.32, stdev=2941.84 00:32:09.012 clat (usec): min=11648, max=52837, avg=14977.98, stdev=1553.47 00:32:09.012 lat (usec): min=11663, max=52850, avg=14991.51, stdev=1553.48 00:32:09.012 clat percentiles (usec): 00:32:09.012 | 1.00th=[12518], 5.00th=[13173], 10.00th=[13566], 20.00th=[14091], 00:32:09.012 | 30.00th=[14353], 40.00th=[14746], 50.00th=[14877], 60.00th=[15139], 00:32:09.012 | 70.00th=[15401], 80.00th=[15795], 90.00th=[16319], 95.00th=[16712], 00:32:09.012 | 99.00th=[17433], 99.50th=[18220], 99.90th=[22152], 99.95th=[49021], 00:32:09.012 | 99.99th=[52691] 00:32:09.012 bw ( KiB/s): min=24320, max=27136, per=33.23%, avg=25664.00, stdev=742.31, samples=20 00:32:09.012 iops : min= 190, max= 212, avg=200.50, stdev= 5.80, samples=20 00:32:09.012 lat (msec) : 20=99.85%, 50=0.10%, 100=0.05% 00:32:09.012 cpu : usr=91.95%, sys=7.57%, ctx=27, majf=0, minf=206 00:32:09.012 IO depths : 1=0.1%, 2=100.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:09.012 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:09.012 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:09.012 issued rwts: total=2007,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:09.012 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:09.012 filename0: (groupid=0, jobs=1): err= 0: pid=1288581: Wed Nov 20 01:33:17 2024 00:32:09.012 read: IOPS=205, BW=25.6MiB/s (26.9MB/s)(258MiB/10049msec) 00:32:09.012 slat (nsec): min=3586, max=36940, avg=13582.09, stdev=2875.85 00:32:09.012 clat (usec): min=10553, max=50878, avg=14581.27, stdev=1584.97 00:32:09.012 lat (usec): min=10581, max=50891, avg=14594.85, stdev=1584.91 00:32:09.012 clat percentiles (usec): 00:32:09.012 | 1.00th=[11994], 5.00th=[12780], 10.00th=[13173], 20.00th=[13698], 00:32:09.012 | 30.00th=[13960], 40.00th=[14222], 50.00th=[14484], 60.00th=[14746], 00:32:09.012 | 70.00th=[15139], 80.00th=[15401], 90.00th=[16057], 95.00th=[16450], 00:32:09.012 | 99.00th=[17695], 99.50th=[17957], 99.90th=[20579], 99.95th=[48497], 00:32:09.012 | 99.99th=[51119] 00:32:09.012 bw ( KiB/s): min=24320, max=27904, per=34.14%, avg=26368.00, stdev=1047.31, samples=20 00:32:09.012 iops : min= 190, max= 218, avg=206.00, stdev= 8.18, samples=20 00:32:09.012 lat (msec) : 20=99.76%, 50=0.19%, 100=0.05% 00:32:09.012 cpu : usr=91.57%, sys=7.94%, ctx=27, majf=0, minf=73 00:32:09.012 IO depths : 1=0.2%, 2=99.8%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:09.012 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:09.012 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:09.012 issued rwts: total=2062,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:09.012 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:09.012 filename0: (groupid=0, jobs=1): err= 0: pid=1288582: Wed Nov 20 01:33:17 2024 00:32:09.012 read: IOPS=198, BW=24.8MiB/s (26.0MB/s)(249MiB/10047msec) 00:32:09.012 slat (usec): min=4, max=123, avg=13.73, stdev= 3.92 00:32:09.012 clat (usec): min=11420, max=51789, avg=15077.38, stdev=1574.26 00:32:09.012 lat (usec): min=11434, max=51802, avg=15091.11, stdev=1574.30 00:32:09.012 clat percentiles (usec): 00:32:09.012 | 1.00th=[12780], 5.00th=[13304], 10.00th=[13698], 20.00th=[14091], 00:32:09.012 | 30.00th=[14484], 40.00th=[14746], 50.00th=[15008], 60.00th=[15270], 00:32:09.012 | 70.00th=[15533], 80.00th=[15926], 90.00th=[16450], 95.00th=[16909], 00:32:09.012 | 99.00th=[17695], 99.50th=[18220], 99.90th=[48497], 99.95th=[51643], 00:32:09.012 | 99.99th=[51643] 00:32:09.012 bw ( KiB/s): min=24320, max=26624, per=33.00%, avg=25487.20, stdev=803.72, samples=20 00:32:09.012 iops : min= 190, max= 208, avg=199.10, stdev= 6.31, samples=20 00:32:09.012 lat (msec) : 20=99.75%, 50=0.20%, 100=0.05% 00:32:09.012 cpu : usr=92.33%, sys=7.19%, ctx=21, majf=0, minf=158 00:32:09.012 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:09.012 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:09.012 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:09.012 issued rwts: total=1994,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:09.012 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:09.012 00:32:09.012 Run status group 0 (all jobs): 00:32:09.012 READ: bw=75.4MiB/s (79.1MB/s), 24.8MiB/s-25.6MiB/s (26.0MB/s-26.9MB/s), io=758MiB (795MB), run=10046-10049msec 00:32:09.270 01:33:17 -- target/dif.sh@132 -- # destroy_subsystems 0 00:32:09.270 01:33:17 -- target/dif.sh@43 -- # local sub 00:32:09.270 01:33:17 -- target/dif.sh@45 -- # for sub in "$@" 00:32:09.270 01:33:17 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:09.270 01:33:17 -- target/dif.sh@36 -- # local sub_id=0 00:32:09.270 01:33:17 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:09.270 01:33:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:09.270 01:33:17 -- common/autotest_common.sh@10 -- # set +x 00:32:09.270 01:33:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:09.270 01:33:17 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:09.270 01:33:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:09.270 01:33:17 -- common/autotest_common.sh@10 -- # set +x 00:32:09.270 01:33:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:09.270 00:32:09.270 real 0m11.203s 00:32:09.270 user 0m28.864s 00:32:09.270 sys 0m2.568s 00:32:09.270 01:33:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:09.270 01:33:17 -- common/autotest_common.sh@10 -- # set +x 00:32:09.270 ************************************ 00:32:09.270 END TEST fio_dif_digest 00:32:09.270 ************************************ 00:32:09.270 01:33:17 -- target/dif.sh@146 -- # trap - SIGINT SIGTERM EXIT 00:32:09.270 01:33:17 -- target/dif.sh@147 -- # nvmftestfini 00:32:09.270 01:33:17 -- nvmf/common.sh@476 -- # nvmfcleanup 00:32:09.270 01:33:17 -- nvmf/common.sh@116 -- # sync 00:32:09.270 01:33:17 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:32:09.270 01:33:17 -- nvmf/common.sh@119 -- # set +e 00:32:09.270 01:33:17 -- nvmf/common.sh@120 -- # for i in {1..20} 00:32:09.270 01:33:17 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:32:09.270 rmmod nvme_tcp 00:32:09.270 rmmod nvme_fabrics 00:32:09.270 rmmod nvme_keyring 00:32:09.529 01:33:17 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:32:09.529 01:33:17 -- nvmf/common.sh@123 -- # set -e 00:32:09.529 01:33:17 -- nvmf/common.sh@124 -- # return 0 00:32:09.529 01:33:17 -- nvmf/common.sh@477 -- # '[' -n 1282232 ']' 00:32:09.529 01:33:17 -- nvmf/common.sh@478 -- # killprocess 1282232 00:32:09.529 01:33:17 -- common/autotest_common.sh@936 -- # '[' -z 1282232 ']' 00:32:09.529 01:33:17 -- common/autotest_common.sh@940 -- # kill -0 1282232 00:32:09.529 01:33:17 -- common/autotest_common.sh@941 -- # uname 00:32:09.529 01:33:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:32:09.529 01:33:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1282232 00:32:09.529 01:33:17 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:32:09.529 01:33:17 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:32:09.529 01:33:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1282232' 00:32:09.529 killing process with pid 1282232 00:32:09.529 01:33:17 -- common/autotest_common.sh@955 -- # kill 1282232 00:32:09.529 01:33:17 -- common/autotest_common.sh@960 -- # wait 1282232 00:32:09.787 01:33:17 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:32:09.787 01:33:17 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:32:10.723 Waiting for block devices as requested 00:32:10.723 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:32:10.981 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:10.981 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:11.239 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:11.239 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:11.239 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:11.239 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:11.496 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:11.496 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:11.496 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:11.496 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:11.754 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:11.754 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:11.754 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:11.754 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:12.013 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:12.013 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:12.013 01:33:20 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:32:12.013 01:33:20 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:32:12.013 01:33:20 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:32:12.013 01:33:20 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:32:12.013 01:33:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:32:12.013 01:33:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:32:12.013 01:33:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:32:14.548 01:33:22 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:32:14.548 00:32:14.548 real 1m7.301s 00:32:14.548 user 6m29.486s 00:32:14.548 sys 0m17.678s 00:32:14.548 01:33:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:14.548 01:33:22 -- common/autotest_common.sh@10 -- # set +x 00:32:14.548 ************************************ 00:32:14.548 END TEST nvmf_dif 00:32:14.548 ************************************ 00:32:14.548 01:33:22 -- spdk/autotest.sh@288 -- # run_test nvmf_abort_qd_sizes /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:32:14.548 01:33:22 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:14.548 01:33:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:14.548 01:33:22 -- common/autotest_common.sh@10 -- # set +x 00:32:14.548 ************************************ 00:32:14.548 START TEST nvmf_abort_qd_sizes 00:32:14.548 ************************************ 00:32:14.548 01:33:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:32:14.548 * Looking for test storage... 00:32:14.548 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:32:14.548 01:33:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:32:14.548 01:33:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:32:14.548 01:33:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:32:14.548 01:33:22 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:32:14.548 01:33:22 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:32:14.548 01:33:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:32:14.548 01:33:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:32:14.548 01:33:22 -- scripts/common.sh@335 -- # IFS=.-: 00:32:14.548 01:33:22 -- scripts/common.sh@335 -- # read -ra ver1 00:32:14.548 01:33:22 -- scripts/common.sh@336 -- # IFS=.-: 00:32:14.548 01:33:22 -- scripts/common.sh@336 -- # read -ra ver2 00:32:14.548 01:33:22 -- scripts/common.sh@337 -- # local 'op=<' 00:32:14.548 01:33:22 -- scripts/common.sh@339 -- # ver1_l=2 00:32:14.548 01:33:22 -- scripts/common.sh@340 -- # ver2_l=1 00:32:14.548 01:33:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:32:14.548 01:33:22 -- scripts/common.sh@343 -- # case "$op" in 00:32:14.548 01:33:22 -- scripts/common.sh@344 -- # : 1 00:32:14.548 01:33:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:32:14.548 01:33:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:32:14.548 01:33:22 -- scripts/common.sh@364 -- # decimal 1 00:32:14.548 01:33:22 -- scripts/common.sh@352 -- # local d=1 00:32:14.548 01:33:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:32:14.548 01:33:22 -- scripts/common.sh@354 -- # echo 1 00:32:14.548 01:33:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:32:14.548 01:33:22 -- scripts/common.sh@365 -- # decimal 2 00:32:14.548 01:33:22 -- scripts/common.sh@352 -- # local d=2 00:32:14.548 01:33:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:32:14.548 01:33:22 -- scripts/common.sh@354 -- # echo 2 00:32:14.548 01:33:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:32:14.548 01:33:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:32:14.548 01:33:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:32:14.548 01:33:22 -- scripts/common.sh@367 -- # return 0 00:32:14.548 01:33:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:32:14.548 01:33:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:32:14.548 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:14.548 --rc genhtml_branch_coverage=1 00:32:14.548 --rc genhtml_function_coverage=1 00:32:14.548 --rc genhtml_legend=1 00:32:14.548 --rc geninfo_all_blocks=1 00:32:14.548 --rc geninfo_unexecuted_blocks=1 00:32:14.548 00:32:14.548 ' 00:32:14.548 01:33:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:32:14.548 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:14.548 --rc genhtml_branch_coverage=1 00:32:14.548 --rc genhtml_function_coverage=1 00:32:14.548 --rc genhtml_legend=1 00:32:14.548 --rc geninfo_all_blocks=1 00:32:14.548 --rc geninfo_unexecuted_blocks=1 00:32:14.548 00:32:14.548 ' 00:32:14.548 01:33:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:32:14.548 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:14.548 --rc genhtml_branch_coverage=1 00:32:14.548 --rc genhtml_function_coverage=1 00:32:14.548 --rc genhtml_legend=1 00:32:14.548 --rc geninfo_all_blocks=1 00:32:14.548 --rc geninfo_unexecuted_blocks=1 00:32:14.548 00:32:14.548 ' 00:32:14.548 01:33:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:32:14.548 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:14.548 --rc genhtml_branch_coverage=1 00:32:14.548 --rc genhtml_function_coverage=1 00:32:14.548 --rc genhtml_legend=1 00:32:14.548 --rc geninfo_all_blocks=1 00:32:14.548 --rc geninfo_unexecuted_blocks=1 00:32:14.548 00:32:14.548 ' 00:32:14.548 01:33:22 -- target/abort_qd_sizes.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:32:14.548 01:33:22 -- nvmf/common.sh@7 -- # uname -s 00:32:14.548 01:33:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:32:14.548 01:33:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:32:14.548 01:33:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:32:14.548 01:33:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:32:14.548 01:33:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:32:14.548 01:33:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:32:14.548 01:33:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:32:14.548 01:33:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:32:14.548 01:33:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:32:14.548 01:33:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:32:14.548 01:33:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:32:14.548 01:33:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:32:14.548 01:33:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:32:14.548 01:33:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:32:14.548 01:33:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:32:14.548 01:33:22 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:32:14.548 01:33:22 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:32:14.548 01:33:22 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:32:14.548 01:33:22 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:32:14.548 01:33:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:14.548 01:33:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:14.548 01:33:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:14.548 01:33:22 -- paths/export.sh@5 -- # export PATH 00:32:14.548 01:33:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:14.548 01:33:22 -- nvmf/common.sh@46 -- # : 0 00:32:14.548 01:33:22 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:32:14.548 01:33:22 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:32:14.548 01:33:22 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:32:14.549 01:33:22 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:32:14.549 01:33:22 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:32:14.549 01:33:22 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:32:14.549 01:33:22 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:32:14.549 01:33:22 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:32:14.549 01:33:22 -- target/abort_qd_sizes.sh@73 -- # nvmftestinit 00:32:14.549 01:33:22 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:32:14.549 01:33:22 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:32:14.549 01:33:22 -- nvmf/common.sh@436 -- # prepare_net_devs 00:32:14.549 01:33:22 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:32:14.549 01:33:22 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:32:14.549 01:33:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:32:14.549 01:33:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:32:14.549 01:33:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:32:14.549 01:33:22 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:32:14.549 01:33:22 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:32:14.549 01:33:22 -- nvmf/common.sh@284 -- # xtrace_disable 00:32:14.549 01:33:22 -- common/autotest_common.sh@10 -- # set +x 00:32:16.450 01:33:24 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:32:16.450 01:33:24 -- nvmf/common.sh@290 -- # pci_devs=() 00:32:16.450 01:33:24 -- nvmf/common.sh@290 -- # local -a pci_devs 00:32:16.450 01:33:24 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:32:16.450 01:33:24 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:32:16.450 01:33:24 -- nvmf/common.sh@292 -- # pci_drivers=() 00:32:16.450 01:33:24 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:32:16.450 01:33:24 -- nvmf/common.sh@294 -- # net_devs=() 00:32:16.450 01:33:24 -- nvmf/common.sh@294 -- # local -ga net_devs 00:32:16.450 01:33:24 -- nvmf/common.sh@295 -- # e810=() 00:32:16.450 01:33:24 -- nvmf/common.sh@295 -- # local -ga e810 00:32:16.450 01:33:24 -- nvmf/common.sh@296 -- # x722=() 00:32:16.450 01:33:24 -- nvmf/common.sh@296 -- # local -ga x722 00:32:16.450 01:33:24 -- nvmf/common.sh@297 -- # mlx=() 00:32:16.450 01:33:24 -- nvmf/common.sh@297 -- # local -ga mlx 00:32:16.450 01:33:24 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:32:16.450 01:33:24 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:32:16.450 01:33:24 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:32:16.450 01:33:24 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:32:16.450 01:33:24 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:32:16.450 01:33:24 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:32:16.450 01:33:24 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:32:16.450 01:33:24 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:32:16.450 01:33:24 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:32:16.450 01:33:24 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:32:16.450 01:33:24 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:32:16.450 01:33:24 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:32:16.450 01:33:24 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:32:16.450 01:33:24 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:32:16.450 01:33:24 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:32:16.450 01:33:24 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:32:16.450 01:33:24 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:32:16.450 01:33:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:32:16.450 01:33:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:32:16.450 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:32:16.450 01:33:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:32:16.450 01:33:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:32:16.450 01:33:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:32:16.450 01:33:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:32:16.450 01:33:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:32:16.450 01:33:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:32:16.450 01:33:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:32:16.450 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:32:16.450 01:33:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:32:16.450 01:33:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:32:16.450 01:33:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:32:16.450 01:33:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:32:16.450 01:33:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:32:16.450 01:33:24 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:32:16.450 01:33:24 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:32:16.450 01:33:24 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:32:16.450 01:33:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:32:16.450 01:33:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:32:16.450 01:33:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:32:16.450 01:33:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:32:16.450 01:33:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:32:16.450 Found net devices under 0000:0a:00.0: cvl_0_0 00:32:16.450 01:33:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:32:16.450 01:33:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:32:16.450 01:33:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:32:16.450 01:33:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:32:16.450 01:33:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:32:16.450 01:33:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:32:16.450 Found net devices under 0000:0a:00.1: cvl_0_1 00:32:16.450 01:33:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:32:16.450 01:33:24 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:32:16.450 01:33:24 -- nvmf/common.sh@402 -- # is_hw=yes 00:32:16.450 01:33:24 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:32:16.450 01:33:24 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:32:16.450 01:33:24 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:32:16.450 01:33:24 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:32:16.450 01:33:24 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:32:16.450 01:33:24 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:32:16.450 01:33:24 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:32:16.450 01:33:24 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:32:16.450 01:33:24 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:32:16.450 01:33:24 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:32:16.450 01:33:24 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:32:16.450 01:33:24 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:32:16.450 01:33:24 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:32:16.450 01:33:24 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:32:16.450 01:33:24 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:32:16.450 01:33:24 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:32:16.450 01:33:24 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:32:16.450 01:33:24 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:32:16.450 01:33:24 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:32:16.450 01:33:24 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:32:16.450 01:33:24 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:32:16.450 01:33:24 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:32:16.450 01:33:24 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:32:16.450 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:32:16.450 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.159 ms 00:32:16.450 00:32:16.450 --- 10.0.0.2 ping statistics --- 00:32:16.450 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:32:16.450 rtt min/avg/max/mdev = 0.159/0.159/0.159/0.000 ms 00:32:16.450 01:33:24 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:32:16.450 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:32:16.450 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.097 ms 00:32:16.450 00:32:16.450 --- 10.0.0.1 ping statistics --- 00:32:16.450 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:32:16.450 rtt min/avg/max/mdev = 0.097/0.097/0.097/0.000 ms 00:32:16.450 01:33:24 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:32:16.450 01:33:24 -- nvmf/common.sh@410 -- # return 0 00:32:16.450 01:33:24 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:32:16.450 01:33:24 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:32:17.825 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:32:17.825 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:32:17.825 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:32:17.825 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:32:17.825 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:32:17.825 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:32:17.825 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:32:17.825 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:32:17.825 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:32:17.825 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:32:17.825 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:32:17.825 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:32:17.825 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:32:17.825 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:32:17.825 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:32:17.825 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:32:18.763 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:32:18.763 01:33:26 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:32:18.763 01:33:26 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:32:18.763 01:33:26 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:32:18.763 01:33:26 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:32:18.763 01:33:26 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:32:18.763 01:33:26 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:32:18.763 01:33:26 -- target/abort_qd_sizes.sh@74 -- # nvmfappstart -m 0xf 00:32:18.763 01:33:26 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:32:18.763 01:33:26 -- common/autotest_common.sh@722 -- # xtrace_disable 00:32:18.763 01:33:26 -- common/autotest_common.sh@10 -- # set +x 00:32:18.763 01:33:26 -- nvmf/common.sh@469 -- # nvmfpid=1294140 00:32:18.763 01:33:26 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xf 00:32:18.763 01:33:26 -- nvmf/common.sh@470 -- # waitforlisten 1294140 00:32:18.763 01:33:26 -- common/autotest_common.sh@829 -- # '[' -z 1294140 ']' 00:32:18.763 01:33:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:32:18.763 01:33:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:32:18.763 01:33:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:32:18.763 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:32:18.763 01:33:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:32:18.763 01:33:26 -- common/autotest_common.sh@10 -- # set +x 00:32:18.763 [2024-11-20 01:33:26.851419] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:32:18.763 [2024-11-20 01:33:26.851524] [ DPDK EAL parameters: nvmf -c 0xf --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:32:18.763 EAL: No free 2048 kB hugepages reported on node 1 00:32:18.763 [2024-11-20 01:33:26.922276] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:32:19.020 [2024-11-20 01:33:27.017962] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:32:19.020 [2024-11-20 01:33:27.018134] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:32:19.020 [2024-11-20 01:33:27.018159] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:32:19.020 [2024-11-20 01:33:27.018172] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:32:19.020 [2024-11-20 01:33:27.018228] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:32:19.020 [2024-11-20 01:33:27.018290] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:32:19.020 [2024-11-20 01:33:27.018350] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:32:19.020 [2024-11-20 01:33:27.018354] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:32:19.951 01:33:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:32:19.951 01:33:27 -- common/autotest_common.sh@862 -- # return 0 00:32:19.951 01:33:27 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:32:19.951 01:33:27 -- common/autotest_common.sh@728 -- # xtrace_disable 00:32:19.951 01:33:27 -- common/autotest_common.sh@10 -- # set +x 00:32:19.951 01:33:27 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:32:19.951 01:33:27 -- target/abort_qd_sizes.sh@76 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini || :; clean_kernel_target' SIGINT SIGTERM EXIT 00:32:19.951 01:33:27 -- target/abort_qd_sizes.sh@78 -- # mapfile -t nvmes 00:32:19.951 01:33:27 -- target/abort_qd_sizes.sh@78 -- # nvme_in_userspace 00:32:19.951 01:33:27 -- scripts/common.sh@311 -- # local bdf bdfs 00:32:19.951 01:33:27 -- scripts/common.sh@312 -- # local nvmes 00:32:19.951 01:33:27 -- scripts/common.sh@314 -- # [[ -n 0000:88:00.0 ]] 00:32:19.951 01:33:27 -- scripts/common.sh@315 -- # nvmes=(${pci_bus_cache["0x010802"]}) 00:32:19.951 01:33:27 -- scripts/common.sh@320 -- # for bdf in "${nvmes[@]}" 00:32:19.951 01:33:27 -- scripts/common.sh@321 -- # [[ -e /sys/bus/pci/drivers/nvme/0000:88:00.0 ]] 00:32:19.951 01:33:27 -- scripts/common.sh@322 -- # uname -s 00:32:19.951 01:33:27 -- scripts/common.sh@322 -- # [[ Linux == FreeBSD ]] 00:32:19.951 01:33:27 -- scripts/common.sh@325 -- # bdfs+=("$bdf") 00:32:19.951 01:33:27 -- scripts/common.sh@327 -- # (( 1 )) 00:32:19.951 01:33:27 -- scripts/common.sh@328 -- # printf '%s\n' 0000:88:00.0 00:32:19.951 01:33:27 -- target/abort_qd_sizes.sh@79 -- # (( 1 > 0 )) 00:32:19.951 01:33:27 -- target/abort_qd_sizes.sh@81 -- # nvme=0000:88:00.0 00:32:19.951 01:33:27 -- target/abort_qd_sizes.sh@83 -- # run_test spdk_target_abort spdk_target 00:32:19.951 01:33:27 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:19.951 01:33:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:19.951 01:33:27 -- common/autotest_common.sh@10 -- # set +x 00:32:19.951 ************************************ 00:32:19.951 START TEST spdk_target_abort 00:32:19.951 ************************************ 00:32:19.951 01:33:27 -- common/autotest_common.sh@1114 -- # spdk_target 00:32:19.951 01:33:27 -- target/abort_qd_sizes.sh@43 -- # local name=spdk_target 00:32:19.951 01:33:27 -- target/abort_qd_sizes.sh@44 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:32:19.951 01:33:27 -- target/abort_qd_sizes.sh@46 -- # rpc_cmd bdev_nvme_attach_controller -t pcie -a 0000:88:00.0 -b spdk_target 00:32:19.951 01:33:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:19.951 01:33:27 -- common/autotest_common.sh@10 -- # set +x 00:32:23.230 spdk_targetn1 00:32:23.230 01:33:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:23.230 01:33:30 -- target/abort_qd_sizes.sh@48 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:32:23.230 01:33:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:23.230 01:33:30 -- common/autotest_common.sh@10 -- # set +x 00:32:23.230 [2024-11-20 01:33:30.700306] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:32:23.230 01:33:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:23.230 01:33:30 -- target/abort_qd_sizes.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:spdk_target -a -s SPDKISFASTANDAWESOME 00:32:23.230 01:33:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:23.230 01:33:30 -- common/autotest_common.sh@10 -- # set +x 00:32:23.230 01:33:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:23.230 01:33:30 -- target/abort_qd_sizes.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:spdk_target spdk_targetn1 00:32:23.230 01:33:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:23.230 01:33:30 -- common/autotest_common.sh@10 -- # set +x 00:32:23.230 01:33:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:23.230 01:33:30 -- target/abort_qd_sizes.sh@51 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:spdk_target -t tcp -a 10.0.0.2 -s 4420 00:32:23.230 01:33:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:23.230 01:33:30 -- common/autotest_common.sh@10 -- # set +x 00:32:23.230 [2024-11-20 01:33:30.732592] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:23.230 01:33:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:23.230 01:33:30 -- target/abort_qd_sizes.sh@53 -- # rabort tcp IPv4 10.0.0.2 4420 nqn.2016-06.io.spdk:spdk_target 00:32:23.230 01:33:30 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:32:23.230 01:33:30 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:32:23.230 01:33:30 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.2 00:32:23.230 01:33:30 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:32:23.231 01:33:30 -- target/abort_qd_sizes.sh@21 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:32:23.231 01:33:30 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:32:23.231 01:33:30 -- target/abort_qd_sizes.sh@24 -- # local target r 00:32:23.231 01:33:30 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:32:23.231 01:33:30 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:23.231 01:33:30 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:32:23.231 01:33:30 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:23.231 01:33:30 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:32:23.231 01:33:30 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:23.231 01:33:30 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2' 00:32:23.231 01:33:30 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:23.231 01:33:30 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:32:23.231 01:33:30 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:23.231 01:33:30 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:23.231 01:33:30 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:23.231 01:33:30 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:23.231 EAL: No free 2048 kB hugepages reported on node 1 00:32:26.510 Initializing NVMe Controllers 00:32:26.510 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:32:26.510 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:32:26.510 Initialization complete. Launching workers. 00:32:26.510 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 11658, failed: 0 00:32:26.511 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1185, failed to submit 10473 00:32:26.511 success 666, unsuccess 519, failed 0 00:32:26.511 01:33:34 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:26.511 01:33:34 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:26.511 EAL: No free 2048 kB hugepages reported on node 1 00:32:29.037 Initializing NVMe Controllers 00:32:29.037 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:32:29.037 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:32:29.037 Initialization complete. Launching workers. 00:32:29.037 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 8722, failed: 0 00:32:29.037 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1228, failed to submit 7494 00:32:29.037 success 332, unsuccess 896, failed 0 00:32:29.037 01:33:37 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:29.037 01:33:37 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:29.295 EAL: No free 2048 kB hugepages reported on node 1 00:32:32.578 Initializing NVMe Controllers 00:32:32.578 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:32:32.578 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:32:32.578 Initialization complete. Launching workers. 00:32:32.578 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 31000, failed: 0 00:32:32.578 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 2622, failed to submit 28378 00:32:32.578 success 528, unsuccess 2094, failed 0 00:32:32.578 01:33:40 -- target/abort_qd_sizes.sh@55 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:spdk_target 00:32:32.578 01:33:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:32.578 01:33:40 -- common/autotest_common.sh@10 -- # set +x 00:32:32.578 01:33:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:32.578 01:33:40 -- target/abort_qd_sizes.sh@56 -- # rpc_cmd bdev_nvme_detach_controller spdk_target 00:32:32.578 01:33:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:32.578 01:33:40 -- common/autotest_common.sh@10 -- # set +x 00:32:33.510 01:33:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:33.510 01:33:41 -- target/abort_qd_sizes.sh@62 -- # killprocess 1294140 00:32:33.510 01:33:41 -- common/autotest_common.sh@936 -- # '[' -z 1294140 ']' 00:32:33.510 01:33:41 -- common/autotest_common.sh@940 -- # kill -0 1294140 00:32:33.510 01:33:41 -- common/autotest_common.sh@941 -- # uname 00:32:33.510 01:33:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:32:33.510 01:33:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1294140 00:32:33.769 01:33:41 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:32:33.769 01:33:41 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:32:33.769 01:33:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1294140' 00:32:33.769 killing process with pid 1294140 00:32:33.769 01:33:41 -- common/autotest_common.sh@955 -- # kill 1294140 00:32:33.769 01:33:41 -- common/autotest_common.sh@960 -- # wait 1294140 00:32:34.027 00:32:34.027 real 0m14.135s 00:32:34.027 user 0m56.244s 00:32:34.027 sys 0m2.482s 00:32:34.027 01:33:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:34.027 01:33:41 -- common/autotest_common.sh@10 -- # set +x 00:32:34.027 ************************************ 00:32:34.027 END TEST spdk_target_abort 00:32:34.027 ************************************ 00:32:34.027 01:33:42 -- target/abort_qd_sizes.sh@84 -- # run_test kernel_target_abort kernel_target 00:32:34.027 01:33:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:34.027 01:33:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:34.027 01:33:42 -- common/autotest_common.sh@10 -- # set +x 00:32:34.027 ************************************ 00:32:34.027 START TEST kernel_target_abort 00:32:34.027 ************************************ 00:32:34.028 01:33:42 -- common/autotest_common.sh@1114 -- # kernel_target 00:32:34.028 01:33:42 -- target/abort_qd_sizes.sh@66 -- # local name=kernel_target 00:32:34.028 01:33:42 -- target/abort_qd_sizes.sh@68 -- # configure_kernel_target kernel_target 00:32:34.028 01:33:42 -- nvmf/common.sh@621 -- # kernel_name=kernel_target 00:32:34.028 01:33:42 -- nvmf/common.sh@622 -- # nvmet=/sys/kernel/config/nvmet 00:32:34.028 01:33:42 -- nvmf/common.sh@623 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/kernel_target 00:32:34.028 01:33:42 -- nvmf/common.sh@624 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:32:34.028 01:33:42 -- nvmf/common.sh@625 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:32:34.028 01:33:42 -- nvmf/common.sh@627 -- # local block nvme 00:32:34.028 01:33:42 -- nvmf/common.sh@629 -- # [[ ! -e /sys/module/nvmet ]] 00:32:34.028 01:33:42 -- nvmf/common.sh@630 -- # modprobe nvmet 00:32:34.028 01:33:42 -- nvmf/common.sh@633 -- # [[ -e /sys/kernel/config/nvmet ]] 00:32:34.028 01:33:42 -- nvmf/common.sh@635 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:32:34.963 Waiting for block devices as requested 00:32:34.963 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:32:35.223 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:35.223 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:35.481 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:35.481 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:35.481 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:35.481 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:35.481 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:35.740 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:35.740 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:35.740 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:35.740 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:35.998 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:35.998 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:35.998 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:36.257 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:36.257 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:36.257 01:33:44 -- nvmf/common.sh@638 -- # for block in /sys/block/nvme* 00:32:36.257 01:33:44 -- nvmf/common.sh@639 -- # [[ -e /sys/block/nvme0n1 ]] 00:32:36.257 01:33:44 -- nvmf/common.sh@640 -- # block_in_use nvme0n1 00:32:36.257 01:33:44 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:32:36.257 01:33:44 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:32:36.257 No valid GPT data, bailing 00:32:36.257 01:33:44 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:32:36.257 01:33:44 -- scripts/common.sh@393 -- # pt= 00:32:36.257 01:33:44 -- scripts/common.sh@394 -- # return 1 00:32:36.257 01:33:44 -- nvmf/common.sh@640 -- # nvme=/dev/nvme0n1 00:32:36.257 01:33:44 -- nvmf/common.sh@643 -- # [[ -b /dev/nvme0n1 ]] 00:32:36.515 01:33:44 -- nvmf/common.sh@645 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:32:36.515 01:33:44 -- nvmf/common.sh@646 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:32:36.515 01:33:44 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:32:36.515 01:33:44 -- nvmf/common.sh@652 -- # echo SPDK-kernel_target 00:32:36.515 01:33:44 -- nvmf/common.sh@654 -- # echo 1 00:32:36.515 01:33:44 -- nvmf/common.sh@655 -- # echo /dev/nvme0n1 00:32:36.515 01:33:44 -- nvmf/common.sh@656 -- # echo 1 00:32:36.515 01:33:44 -- nvmf/common.sh@662 -- # echo 10.0.0.1 00:32:36.515 01:33:44 -- nvmf/common.sh@663 -- # echo tcp 00:32:36.515 01:33:44 -- nvmf/common.sh@664 -- # echo 4420 00:32:36.515 01:33:44 -- nvmf/common.sh@665 -- # echo ipv4 00:32:36.515 01:33:44 -- nvmf/common.sh@668 -- # ln -s /sys/kernel/config/nvmet/subsystems/kernel_target /sys/kernel/config/nvmet/ports/1/subsystems/ 00:32:36.515 01:33:44 -- nvmf/common.sh@671 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.1 -t tcp -s 4420 00:32:36.515 00:32:36.515 Discovery Log Number of Records 2, Generation counter 2 00:32:36.515 =====Discovery Log Entry 0====== 00:32:36.515 trtype: tcp 00:32:36.515 adrfam: ipv4 00:32:36.515 subtype: current discovery subsystem 00:32:36.515 treq: not specified, sq flow control disable supported 00:32:36.516 portid: 1 00:32:36.516 trsvcid: 4420 00:32:36.516 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:32:36.516 traddr: 10.0.0.1 00:32:36.516 eflags: none 00:32:36.516 sectype: none 00:32:36.516 =====Discovery Log Entry 1====== 00:32:36.516 trtype: tcp 00:32:36.516 adrfam: ipv4 00:32:36.516 subtype: nvme subsystem 00:32:36.516 treq: not specified, sq flow control disable supported 00:32:36.516 portid: 1 00:32:36.516 trsvcid: 4420 00:32:36.516 subnqn: kernel_target 00:32:36.516 traddr: 10.0.0.1 00:32:36.516 eflags: none 00:32:36.516 sectype: none 00:32:36.516 01:33:44 -- target/abort_qd_sizes.sh@69 -- # rabort tcp IPv4 10.0.0.1 4420 kernel_target 00:32:36.516 01:33:44 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:32:36.516 01:33:44 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:32:36.516 01:33:44 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.1 00:32:36.516 01:33:44 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:32:36.516 01:33:44 -- target/abort_qd_sizes.sh@21 -- # local subnqn=kernel_target 00:32:36.516 01:33:44 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:32:36.516 01:33:44 -- target/abort_qd_sizes.sh@24 -- # local target r 00:32:36.516 01:33:44 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:32:36.516 01:33:44 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:36.516 01:33:44 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:32:36.516 01:33:44 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:36.516 01:33:44 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:32:36.516 01:33:44 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:36.516 01:33:44 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1' 00:32:36.516 01:33:44 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:36.516 01:33:44 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420' 00:32:36.516 01:33:44 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:36.516 01:33:44 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:32:36.516 01:33:44 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:36.516 01:33:44 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:32:36.516 EAL: No free 2048 kB hugepages reported on node 1 00:32:39.854 Initializing NVMe Controllers 00:32:39.854 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:32:39.854 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:32:39.854 Initialization complete. Launching workers. 00:32:39.854 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 45297, failed: 0 00:32:39.854 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 45297, failed to submit 0 00:32:39.854 success 0, unsuccess 45297, failed 0 00:32:39.854 01:33:47 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:39.854 01:33:47 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:32:39.854 EAL: No free 2048 kB hugepages reported on node 1 00:32:43.133 Initializing NVMe Controllers 00:32:43.133 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:32:43.133 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:32:43.133 Initialization complete. Launching workers. 00:32:43.133 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 81050, failed: 0 00:32:43.133 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 20430, failed to submit 60620 00:32:43.133 success 0, unsuccess 20430, failed 0 00:32:43.133 01:33:50 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:43.133 01:33:50 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:32:43.133 EAL: No free 2048 kB hugepages reported on node 1 00:32:46.415 Initializing NVMe Controllers 00:32:46.415 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:32:46.415 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:32:46.415 Initialization complete. Launching workers. 00:32:46.415 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 78368, failed: 0 00:32:46.415 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 19558, failed to submit 58810 00:32:46.415 success 0, unsuccess 19558, failed 0 00:32:46.415 01:33:53 -- target/abort_qd_sizes.sh@70 -- # clean_kernel_target 00:32:46.415 01:33:53 -- nvmf/common.sh@675 -- # [[ -e /sys/kernel/config/nvmet/subsystems/kernel_target ]] 00:32:46.415 01:33:53 -- nvmf/common.sh@677 -- # echo 0 00:32:46.415 01:33:53 -- nvmf/common.sh@679 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/kernel_target 00:32:46.415 01:33:53 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:32:46.415 01:33:53 -- nvmf/common.sh@681 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:32:46.415 01:33:53 -- nvmf/common.sh@682 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:32:46.415 01:33:53 -- nvmf/common.sh@684 -- # modules=(/sys/module/nvmet/holders/*) 00:32:46.415 01:33:53 -- nvmf/common.sh@686 -- # modprobe -r nvmet_tcp nvmet 00:32:46.415 00:32:46.415 real 0m11.933s 00:32:46.415 user 0m5.697s 00:32:46.415 sys 0m2.421s 00:32:46.415 01:33:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:46.415 01:33:53 -- common/autotest_common.sh@10 -- # set +x 00:32:46.415 ************************************ 00:32:46.415 END TEST kernel_target_abort 00:32:46.415 ************************************ 00:32:46.415 01:33:53 -- target/abort_qd_sizes.sh@86 -- # trap - SIGINT SIGTERM EXIT 00:32:46.415 01:33:53 -- target/abort_qd_sizes.sh@87 -- # nvmftestfini 00:32:46.415 01:33:53 -- nvmf/common.sh@476 -- # nvmfcleanup 00:32:46.415 01:33:53 -- nvmf/common.sh@116 -- # sync 00:32:46.415 01:33:53 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:32:46.415 01:33:53 -- nvmf/common.sh@119 -- # set +e 00:32:46.415 01:33:53 -- nvmf/common.sh@120 -- # for i in {1..20} 00:32:46.415 01:33:53 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:32:46.415 rmmod nvme_tcp 00:32:46.415 rmmod nvme_fabrics 00:32:46.415 rmmod nvme_keyring 00:32:46.415 01:33:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:32:46.415 01:33:54 -- nvmf/common.sh@123 -- # set -e 00:32:46.415 01:33:54 -- nvmf/common.sh@124 -- # return 0 00:32:46.415 01:33:54 -- nvmf/common.sh@477 -- # '[' -n 1294140 ']' 00:32:46.415 01:33:54 -- nvmf/common.sh@478 -- # killprocess 1294140 00:32:46.415 01:33:54 -- common/autotest_common.sh@936 -- # '[' -z 1294140 ']' 00:32:46.415 01:33:54 -- common/autotest_common.sh@940 -- # kill -0 1294140 00:32:46.415 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1294140) - No such process 00:32:46.415 01:33:54 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1294140 is not found' 00:32:46.415 Process with pid 1294140 is not found 00:32:46.415 01:33:54 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:32:46.415 01:33:54 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:32:47.350 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:32:47.350 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:32:47.350 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:32:47.350 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:32:47.350 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:32:47.350 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:32:47.350 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:32:47.350 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:32:47.350 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:32:47.350 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:32:47.350 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:32:47.350 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:32:47.350 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:32:47.350 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:32:47.350 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:32:47.350 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:32:47.350 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:32:47.350 01:33:55 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:32:47.350 01:33:55 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:32:47.350 01:33:55 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:32:47.350 01:33:55 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:32:47.350 01:33:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:32:47.350 01:33:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:32:47.350 01:33:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:32:49.887 01:33:57 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:32:49.887 00:32:49.887 real 0m35.339s 00:32:49.887 user 1m4.410s 00:32:49.887 sys 0m8.350s 00:32:49.887 01:33:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:49.887 01:33:57 -- common/autotest_common.sh@10 -- # set +x 00:32:49.887 ************************************ 00:32:49.887 END TEST nvmf_abort_qd_sizes 00:32:49.887 ************************************ 00:32:49.887 01:33:57 -- spdk/autotest.sh@298 -- # '[' 0 -eq 1 ']' 00:32:49.887 01:33:57 -- spdk/autotest.sh@302 -- # '[' 0 -eq 1 ']' 00:32:49.887 01:33:57 -- spdk/autotest.sh@306 -- # '[' 0 -eq 1 ']' 00:32:49.887 01:33:57 -- spdk/autotest.sh@311 -- # '[' 0 -eq 1 ']' 00:32:49.887 01:33:57 -- spdk/autotest.sh@320 -- # '[' 0 -eq 1 ']' 00:32:49.887 01:33:57 -- spdk/autotest.sh@325 -- # '[' 0 -eq 1 ']' 00:32:49.887 01:33:57 -- spdk/autotest.sh@329 -- # '[' 0 -eq 1 ']' 00:32:49.887 01:33:57 -- spdk/autotest.sh@333 -- # '[' 0 -eq 1 ']' 00:32:49.887 01:33:57 -- spdk/autotest.sh@337 -- # '[' 0 -eq 1 ']' 00:32:49.887 01:33:57 -- spdk/autotest.sh@342 -- # '[' 0 -eq 1 ']' 00:32:49.887 01:33:57 -- spdk/autotest.sh@346 -- # '[' 0 -eq 1 ']' 00:32:49.887 01:33:57 -- spdk/autotest.sh@353 -- # [[ 0 -eq 1 ]] 00:32:49.887 01:33:57 -- spdk/autotest.sh@357 -- # [[ 0 -eq 1 ]] 00:32:49.887 01:33:57 -- spdk/autotest.sh@361 -- # [[ 0 -eq 1 ]] 00:32:49.887 01:33:57 -- spdk/autotest.sh@365 -- # [[ 0 -eq 1 ]] 00:32:49.887 01:33:57 -- spdk/autotest.sh@370 -- # trap - SIGINT SIGTERM EXIT 00:32:49.887 01:33:57 -- spdk/autotest.sh@372 -- # timing_enter post_cleanup 00:32:49.887 01:33:57 -- common/autotest_common.sh@722 -- # xtrace_disable 00:32:49.887 01:33:57 -- common/autotest_common.sh@10 -- # set +x 00:32:49.887 01:33:57 -- spdk/autotest.sh@373 -- # autotest_cleanup 00:32:49.887 01:33:57 -- common/autotest_common.sh@1381 -- # local autotest_es=0 00:32:49.887 01:33:57 -- common/autotest_common.sh@1382 -- # xtrace_disable 00:32:49.887 01:33:57 -- common/autotest_common.sh@10 -- # set +x 00:32:51.265 INFO: APP EXITING 00:32:51.265 INFO: killing all VMs 00:32:51.265 INFO: killing vhost app 00:32:51.265 INFO: EXIT DONE 00:32:52.199 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:32:52.458 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:32:52.458 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:32:52.458 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:32:52.458 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:32:52.458 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:32:52.458 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:32:52.458 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:32:52.458 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:32:52.458 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:32:52.458 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:32:52.458 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:32:52.458 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:32:52.458 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:32:52.458 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:32:52.458 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:32:52.458 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:32:53.832 Cleaning 00:32:53.832 Removing: /var/run/dpdk/spdk0/config 00:32:53.832 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:32:53.832 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:32:53.832 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:32:53.832 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:32:53.832 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-0 00:32:53.832 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-1 00:32:53.832 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-2 00:32:53.832 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-3 00:32:53.832 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:32:53.832 Removing: /var/run/dpdk/spdk0/hugepage_info 00:32:53.832 Removing: /var/run/dpdk/spdk1/config 00:32:53.832 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:32:53.832 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:32:53.832 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:32:53.832 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:32:53.832 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-0 00:32:53.833 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-1 00:32:53.833 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-2 00:32:53.833 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-3 00:32:53.833 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:32:53.833 Removing: /var/run/dpdk/spdk1/hugepage_info 00:32:53.833 Removing: /var/run/dpdk/spdk1/mp_socket 00:32:53.833 Removing: /var/run/dpdk/spdk2/config 00:32:53.833 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:32:53.833 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:32:53.833 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:32:53.833 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:32:53.833 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-0 00:32:53.833 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-1 00:32:53.833 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-2 00:32:53.833 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-3 00:32:53.833 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:32:53.833 Removing: /var/run/dpdk/spdk2/hugepage_info 00:32:53.833 Removing: /var/run/dpdk/spdk3/config 00:32:53.833 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:32:53.833 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:32:53.833 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:32:53.833 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:32:53.833 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-0 00:32:53.833 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-1 00:32:53.833 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-2 00:32:53.833 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-3 00:32:53.833 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:32:53.833 Removing: /var/run/dpdk/spdk3/hugepage_info 00:32:53.833 Removing: /var/run/dpdk/spdk4/config 00:32:53.833 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:32:53.833 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:32:53.833 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:32:53.833 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:32:53.833 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-0 00:32:53.833 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-1 00:32:53.833 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-2 00:32:54.091 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-3 00:32:54.091 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:32:54.091 Removing: /var/run/dpdk/spdk4/hugepage_info 00:32:54.091 Removing: /dev/shm/bdev_svc_trace.1 00:32:54.091 Removing: /dev/shm/nvmf_trace.0 00:32:54.091 Removing: /dev/shm/spdk_tgt_trace.pid1013694 00:32:54.091 Removing: /var/run/dpdk/spdk0 00:32:54.091 Removing: /var/run/dpdk/spdk1 00:32:54.091 Removing: /var/run/dpdk/spdk2 00:32:54.091 Removing: /var/run/dpdk/spdk3 00:32:54.091 Removing: /var/run/dpdk/spdk4 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1011970 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1012751 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1013694 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1014187 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1015536 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1016478 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1016805 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1017016 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1017359 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1017693 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1017850 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1018006 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1018199 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1018780 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1021340 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1021516 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1021812 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1021952 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1022258 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1022400 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1022761 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1022858 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1023152 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1023296 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1023460 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1023602 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1023976 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1024138 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1024401 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1024645 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1024664 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1024851 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1025006 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1025159 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1025347 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1025585 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1025735 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1025890 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1026051 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1026315 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1026457 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1026613 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1026759 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1027030 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1027184 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1027339 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1027477 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1027757 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1027903 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1028066 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1028204 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1028476 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1028628 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1028787 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1028933 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1029206 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1029349 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1029516 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1029656 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1029934 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1030074 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1030239 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1030393 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1030659 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1030810 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1030974 00:32:54.091 Removing: /var/run/dpdk/spdk_pid1031192 00:32:54.092 Removing: /var/run/dpdk/spdk_pid1031398 00:32:54.092 Removing: /var/run/dpdk/spdk_pid1031540 00:32:54.092 Removing: /var/run/dpdk/spdk_pid1031707 00:32:54.092 Removing: /var/run/dpdk/spdk_pid1031965 00:32:54.092 Removing: /var/run/dpdk/spdk_pid1032127 00:32:54.092 Removing: /var/run/dpdk/spdk_pid1032253 00:32:54.092 Removing: /var/run/dpdk/spdk_pid1032536 00:32:54.092 Removing: /var/run/dpdk/spdk_pid1034625 00:32:54.092 Removing: /var/run/dpdk/spdk_pid1092088 00:32:54.092 Removing: /var/run/dpdk/spdk_pid1094750 00:32:54.092 Removing: /var/run/dpdk/spdk_pid1102494 00:32:54.092 Removing: /var/run/dpdk/spdk_pid1105848 00:32:54.092 Removing: /var/run/dpdk/spdk_pid1108357 00:32:54.092 Removing: /var/run/dpdk/spdk_pid1108780 00:32:54.092 Removing: /var/run/dpdk/spdk_pid1112793 00:32:54.092 Removing: /var/run/dpdk/spdk_pid1112795 00:32:54.092 Removing: /var/run/dpdk/spdk_pid1113427 00:32:54.092 Removing: /var/run/dpdk/spdk_pid1114030 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1114703 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1115110 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1115124 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1115267 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1115402 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1115407 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1116086 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1116762 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1117317 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1117726 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1117857 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1117997 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1119151 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1119934 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1125563 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1125847 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1129150 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1132914 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1135156 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1141789 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1147195 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1148427 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1149117 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1159750 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1162114 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1165182 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1166928 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1168296 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1168568 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1168717 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1168872 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1169460 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1170952 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1171946 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1172392 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1175963 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1179716 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1183372 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1207970 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1210813 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1214644 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1215739 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1216867 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1219461 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1221987 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1226392 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1226394 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1229598 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1230145 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1230356 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1230634 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1230675 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1231869 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1233088 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1234297 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1235542 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1236760 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1237974 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1241984 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1242322 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1243650 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1244531 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1248318 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1250366 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1253979 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1257848 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1262026 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1262449 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1262865 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1263289 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1263878 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1264430 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1264985 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1265534 00:32:54.350 Removing: /var/run/dpdk/spdk_pid1268207 00:32:54.351 Removing: /var/run/dpdk/spdk_pid1268365 00:32:54.351 Removing: /var/run/dpdk/spdk_pid1272217 00:32:54.351 Removing: /var/run/dpdk/spdk_pid1272520 00:32:54.351 Removing: /var/run/dpdk/spdk_pid1274167 00:32:54.351 Removing: /var/run/dpdk/spdk_pid1279336 00:32:54.351 Removing: /var/run/dpdk/spdk_pid1279341 00:32:54.351 Removing: /var/run/dpdk/spdk_pid1282411 00:32:54.351 Removing: /var/run/dpdk/spdk_pid1283846 00:32:54.351 Removing: /var/run/dpdk/spdk_pid1285285 00:32:54.351 Removing: /var/run/dpdk/spdk_pid1286064 00:32:54.351 Removing: /var/run/dpdk/spdk_pid1287510 00:32:54.351 Removing: /var/run/dpdk/spdk_pid1288439 00:32:54.351 Removing: /var/run/dpdk/spdk_pid1294755 00:32:54.351 Removing: /var/run/dpdk/spdk_pid1295161 00:32:54.351 Removing: /var/run/dpdk/spdk_pid1296201 00:32:54.351 Removing: /var/run/dpdk/spdk_pid1298816 00:32:54.351 Removing: /var/run/dpdk/spdk_pid1299228 00:32:54.351 Removing: /var/run/dpdk/spdk_pid1299807 00:32:54.351 Clean 00:32:54.608 killing process with pid 983525 00:33:04.602 killing process with pid 983522 00:33:04.602 killing process with pid 983524 00:33:04.602 killing process with pid 983523 00:33:04.602 01:34:11 -- common/autotest_common.sh@1446 -- # return 0 00:33:04.602 01:34:11 -- spdk/autotest.sh@374 -- # timing_exit post_cleanup 00:33:04.602 01:34:11 -- common/autotest_common.sh@728 -- # xtrace_disable 00:33:04.602 01:34:11 -- common/autotest_common.sh@10 -- # set +x 00:33:04.602 01:34:11 -- spdk/autotest.sh@376 -- # timing_exit autotest 00:33:04.602 01:34:11 -- common/autotest_common.sh@728 -- # xtrace_disable 00:33:04.602 01:34:11 -- common/autotest_common.sh@10 -- # set +x 00:33:04.602 01:34:11 -- spdk/autotest.sh@377 -- # chmod a+r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:33:04.602 01:34:11 -- spdk/autotest.sh@379 -- # [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log ]] 00:33:04.602 01:34:11 -- spdk/autotest.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log 00:33:04.602 01:34:11 -- spdk/autotest.sh@381 -- # [[ y == y ]] 00:33:04.602 01:34:11 -- spdk/autotest.sh@383 -- # hostname 00:33:04.603 01:34:11 -- spdk/autotest.sh@383 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -t spdk-gp-11 -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info 00:33:04.603 geninfo: WARNING: invalid characters removed from testname! 00:33:36.695 01:34:39 -- spdk/autotest.sh@384 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:36.695 01:34:43 -- spdk/autotest.sh@385 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/dpdk/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:38.074 01:34:46 -- spdk/autotest.sh@389 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info --ignore-errors unused,unused '/usr/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:41.365 01:34:48 -- spdk/autotest.sh@390 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/examples/vmd/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:43.904 01:34:51 -- spdk/autotest.sh@391 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_lspci/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:46.506 01:34:54 -- spdk/autotest.sh@392 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_top/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:49.045 01:34:57 -- spdk/autotest.sh@393 -- # rm -f cov_base.info cov_test.info OLD_STDOUT OLD_STDERR 00:33:49.045 01:34:57 -- common/autotest_common.sh@1689 -- $ [[ y == y ]] 00:33:49.045 01:34:57 -- common/autotest_common.sh@1690 -- $ lcov --version 00:33:49.045 01:34:57 -- common/autotest_common.sh@1690 -- $ awk '{print $NF}' 00:33:49.045 01:34:57 -- common/autotest_common.sh@1690 -- $ lt 1.15 2 00:33:49.045 01:34:57 -- scripts/common.sh@372 -- $ cmp_versions 1.15 '<' 2 00:33:49.045 01:34:57 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:33:49.045 01:34:57 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:33:49.045 01:34:57 -- scripts/common.sh@335 -- $ IFS=.-: 00:33:49.045 01:34:57 -- scripts/common.sh@335 -- $ read -ra ver1 00:33:49.045 01:34:57 -- scripts/common.sh@336 -- $ IFS=.-: 00:33:49.045 01:34:57 -- scripts/common.sh@336 -- $ read -ra ver2 00:33:49.045 01:34:57 -- scripts/common.sh@337 -- $ local 'op=<' 00:33:49.045 01:34:57 -- scripts/common.sh@339 -- $ ver1_l=2 00:33:49.045 01:34:57 -- scripts/common.sh@340 -- $ ver2_l=1 00:33:49.045 01:34:57 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:33:49.045 01:34:57 -- scripts/common.sh@343 -- $ case "$op" in 00:33:49.045 01:34:57 -- scripts/common.sh@344 -- $ : 1 00:33:49.045 01:34:57 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:33:49.045 01:34:57 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:33:49.045 01:34:57 -- scripts/common.sh@364 -- $ decimal 1 00:33:49.045 01:34:57 -- scripts/common.sh@352 -- $ local d=1 00:33:49.045 01:34:57 -- scripts/common.sh@353 -- $ [[ 1 =~ ^[0-9]+$ ]] 00:33:49.045 01:34:57 -- scripts/common.sh@354 -- $ echo 1 00:33:49.045 01:34:57 -- scripts/common.sh@364 -- $ ver1[v]=1 00:33:49.045 01:34:57 -- scripts/common.sh@365 -- $ decimal 2 00:33:49.045 01:34:57 -- scripts/common.sh@352 -- $ local d=2 00:33:49.045 01:34:57 -- scripts/common.sh@353 -- $ [[ 2 =~ ^[0-9]+$ ]] 00:33:49.045 01:34:57 -- scripts/common.sh@354 -- $ echo 2 00:33:49.045 01:34:57 -- scripts/common.sh@365 -- $ ver2[v]=2 00:33:49.045 01:34:57 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:33:49.045 01:34:57 -- scripts/common.sh@367 -- $ (( ver1[v] < ver2[v] )) 00:33:49.045 01:34:57 -- scripts/common.sh@367 -- $ return 0 00:33:49.045 01:34:57 -- common/autotest_common.sh@1691 -- $ lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:33:49.045 01:34:57 -- common/autotest_common.sh@1703 -- $ export 'LCOV_OPTS= 00:33:49.045 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:33:49.046 --rc genhtml_branch_coverage=1 00:33:49.046 --rc genhtml_function_coverage=1 00:33:49.046 --rc genhtml_legend=1 00:33:49.046 --rc geninfo_all_blocks=1 00:33:49.046 --rc geninfo_unexecuted_blocks=1 00:33:49.046 00:33:49.046 ' 00:33:49.046 01:34:57 -- common/autotest_common.sh@1703 -- $ LCOV_OPTS=' 00:33:49.046 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:33:49.046 --rc genhtml_branch_coverage=1 00:33:49.046 --rc genhtml_function_coverage=1 00:33:49.046 --rc genhtml_legend=1 00:33:49.046 --rc geninfo_all_blocks=1 00:33:49.046 --rc geninfo_unexecuted_blocks=1 00:33:49.046 00:33:49.046 ' 00:33:49.046 01:34:57 -- common/autotest_common.sh@1704 -- $ export 'LCOV=lcov 00:33:49.046 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:33:49.046 --rc genhtml_branch_coverage=1 00:33:49.046 --rc genhtml_function_coverage=1 00:33:49.046 --rc genhtml_legend=1 00:33:49.046 --rc geninfo_all_blocks=1 00:33:49.046 --rc geninfo_unexecuted_blocks=1 00:33:49.046 00:33:49.046 ' 00:33:49.046 01:34:57 -- common/autotest_common.sh@1704 -- $ LCOV='lcov 00:33:49.046 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:33:49.046 --rc genhtml_branch_coverage=1 00:33:49.046 --rc genhtml_function_coverage=1 00:33:49.046 --rc genhtml_legend=1 00:33:49.046 --rc geninfo_all_blocks=1 00:33:49.046 --rc geninfo_unexecuted_blocks=1 00:33:49.046 00:33:49.046 ' 00:33:49.046 01:34:57 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:33:49.046 01:34:57 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:33:49.046 01:34:57 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:33:49.046 01:34:57 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:33:49.046 01:34:57 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:49.046 01:34:57 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:49.046 01:34:57 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:49.046 01:34:57 -- paths/export.sh@5 -- $ export PATH 00:33:49.046 01:34:57 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:49.046 01:34:57 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:33:49.046 01:34:57 -- common/autobuild_common.sh@440 -- $ date +%s 00:33:49.046 01:34:57 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1732062897.XXXXXX 00:33:49.046 01:34:57 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1732062897.oAlvfp 00:33:49.046 01:34:57 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:33:49.046 01:34:57 -- common/autobuild_common.sh@446 -- $ '[' -n v22.11.4 ']' 00:33:49.046 01:34:57 -- common/autobuild_common.sh@447 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:33:49.046 01:34:57 -- common/autobuild_common.sh@447 -- $ scanbuild_exclude=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk' 00:33:49.046 01:34:57 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:33:49.046 01:34:57 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:33:49.046 01:34:57 -- common/autobuild_common.sh@456 -- $ get_config_params 00:33:49.046 01:34:57 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:33:49.046 01:34:57 -- common/autotest_common.sh@10 -- $ set +x 00:33:49.046 01:34:57 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build' 00:33:49.046 01:34:57 -- spdk/autopackage.sh@10 -- $ MAKEFLAGS=-j48 00:33:49.046 01:34:57 -- spdk/autopackage.sh@11 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:33:49.046 01:34:57 -- spdk/autopackage.sh@13 -- $ [[ 0 -eq 1 ]] 00:33:49.046 01:34:57 -- spdk/autopackage.sh@18 -- $ [[ 1 -eq 0 ]] 00:33:49.046 01:34:57 -- spdk/autopackage.sh@18 -- $ [[ 0 -eq 0 ]] 00:33:49.046 01:34:57 -- spdk/autopackage.sh@19 -- $ timing_finish 00:33:49.046 01:34:57 -- common/autotest_common.sh@734 -- $ flamegraph=/usr/local/FlameGraph/flamegraph.pl 00:33:49.046 01:34:57 -- common/autotest_common.sh@735 -- $ '[' -x /usr/local/FlameGraph/flamegraph.pl ']' 00:33:49.046 01:34:57 -- common/autotest_common.sh@737 -- $ /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:33:49.046 01:34:57 -- spdk/autopackage.sh@20 -- $ exit 0 00:33:49.046 + [[ -n 928720 ]] 00:33:49.046 + sudo kill 928720 00:33:49.318 [Pipeline] } 00:33:49.337 [Pipeline] // stage 00:33:49.342 [Pipeline] } 00:33:49.357 [Pipeline] // timeout 00:33:49.362 [Pipeline] } 00:33:49.375 [Pipeline] // catchError 00:33:49.381 [Pipeline] } 00:33:49.396 [Pipeline] // wrap 00:33:49.402 [Pipeline] } 00:33:49.414 [Pipeline] // catchError 00:33:49.423 [Pipeline] stage 00:33:49.425 [Pipeline] { (Epilogue) 00:33:49.438 [Pipeline] catchError 00:33:49.440 [Pipeline] { 00:33:49.452 [Pipeline] echo 00:33:49.454 Cleanup processes 00:33:49.460 [Pipeline] sh 00:33:49.748 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:33:49.748 1312214 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:33:49.763 [Pipeline] sh 00:33:50.051 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:33:50.051 ++ grep -v 'sudo pgrep' 00:33:50.051 ++ awk '{print $1}' 00:33:50.051 + sudo kill -9 00:33:50.051 + true 00:33:50.065 [Pipeline] sh 00:33:50.351 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:34:00.334 [Pipeline] sh 00:34:00.623 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:34:00.623 Artifacts sizes are good 00:34:00.639 [Pipeline] archiveArtifacts 00:34:00.646 Archiving artifacts 00:34:00.826 [Pipeline] sh 00:34:01.129 + sudo chown -R sys_sgci: /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:34:01.146 [Pipeline] cleanWs 00:34:01.160 [WS-CLEANUP] Deleting project workspace... 00:34:01.161 [WS-CLEANUP] Deferred wipeout is used... 00:34:01.178 [WS-CLEANUP] done 00:34:01.181 [Pipeline] } 00:34:01.205 [Pipeline] // catchError 00:34:01.212 [Pipeline] sh 00:34:01.489 + logger -p user.info -t JENKINS-CI 00:34:01.498 [Pipeline] } 00:34:01.512 [Pipeline] // stage 00:34:01.517 [Pipeline] } 00:34:01.531 [Pipeline] // node 00:34:01.536 [Pipeline] End of Pipeline 00:34:01.579 Finished: SUCCESS